Week 47: Recurrent neural networks and Autoencoders
Contents
Plan for week 47
Reading recommendations
TensorFlow examples
What is a recurrent NN?
Why RNNs?
RNNs in more detail
RNNs in more detail, part 2
RNNs in more detail, part 3
RNNs in more detail, part 4
RNNs in more detail, part 5
RNNs in more detail, part 6
RNNs in more detail, part 7
The mathematics of RNNs, the basic architecture
Gating mechanism: Long Short Term Memory (LSTM)
Implementing a memory cell in a neural network
LSTM details
Basic layout (All figures from Raschka
et al.,
)
LSTM details
Comparing with a standard RNN
LSTM details I
LSTM details II
LSTM details III
Forget gate
The forget gate
Basic layout
Input gate
Short summary
Forget and input
Basic layout
Output gate
Summary of LSTM
LSTM implementation using TensorFlow
And the corresponding one with PyTorch
Dynamical ordinary differential equation
The Runge-Kutta-4 code
Using the above data to train an RNN
Plan for week 47
Recurrent neural networks, code examples and long-short-term memory
Readings and Videos:
These lecture notes at
https://github.com/CompPhysics/MachineLearning/blob/master/doc/pub/week47/ipynb/week47.ipynb
See also lecture notes from week 46 at
https://github.com/CompPhysics/MachineLearning/blob/master/doc/pub/week46/ipynb/week46.ipynb
. The lecture on Monday starts with a repetition on recurrent neural networks. The second lecture starts with basics of autoenconders.
Work and Discussion of project 3
Last weekly exercise
«
1
2
3
4
5
6
7
8
9
10
11
...
37
»