Neural Networks
Deep Learning
CC-BY
Fabian M. Suchanek
Neural Network
A Neural Network is a method to compute a function
, which has
been developed in the 1960’s and is inspired by the human brain.
2
Neurons, by
Ivan Atanassov
Deep Learning
Neural Networks have recently achieved impressive performance (and
almost mystical popularity) under the name “Deep Learning”, because
1. Standard classification datasets emerged
thus allowing a more objective comparisons of methods.
2.
Hardware (in particular GPUs) became more powerful
lending their strength to machine learning algorithms
3.
More data became available
allowing better training
4.
New neural network algorithms and architectures were devised
3
Overview
4
Perceptrons
Neural networks
Embeddings
Special Architectures
Transformers
References
5
F. Suchanek, J. Lajus, A. Boschin, G. Weikum:
“
Knowledge Representation and Rule Mining in Entity-Centric KBs
”
Invited paper at the Reasoning Web Summer School (RW) , 2019
The morning paper: “
The amazing power of word embeddings
”
Colah’s blog: “
Understanding LSTM Networks
”
Jay Alammar:
The Illustrated Transformer