Week 45, Convolutional Neural Networks (CCNs)
Contents
Plans for week 45
Material for the lab sessions
Material for Lecture Monday November 3
Convolutional Neural Networks (recognizing images), reminder from last week
What is the Difference
Neural Networks vs CNNs
Why CNNS for images, sound files, medical images from CT scans etc?
Regular NNs don’t scale well to full images
3D volumes of neurons
More on Dimensionalities
Further remarks
Layers used to build CNNs
Transforming images
CNNs in brief
A deep CNN model ("From Raschka et al":"https://github.com/rasbt/machine-learning-book")
Key Idea
Mathematics of CNNs
Convolution Examples: Polynomial multiplication
Efficient Polynomial Multiplication
Further simplification
A more efficient way of coding the above Convolution
Commutative process
Toeplitz matrices
Fourier series and Toeplitz matrices
Generalizing the above one-dimensional case
Memory considerations
Padding
New vector
Rewriting as dot products
Cross correlation
Two-dimensional objects
CNNs in more detail, simple example
The convolution stage
Finding the number of parameters
New image (or volume)
Parameters to train, common settings
Examples of CNN setups
Summarizing: Performing a general discrete convolution ("From Raschka et al":"https://github.com/rasbt/machine-learning-book")
Pooling
Pooling arithmetic
Pooling types ("From Raschka et al":"https://github.com/rasbt/machine-learning-book")
Building convolutional neural networks using Tensorflow and Keras
Setting it up
The MNIST dataset again
Strong correlations
Layers of a CNN
Systematic reduction
Prerequisites: Collect and pre-process data
Importing Keras and Tensorflow
Running with Keras
Final part
Final visualization
The CIFAR01 data set
Verifying the data set
Set up the model
Add Dense layers on top
Compile and train the model
Finally, evaluate the model
Building code using Pytorch
Plans for week 45
Convolutional Neural Networks, codes and examples (TensorFlow and Pytorch implementations)
Readings and Videos:
These lecture notes at
https://github.com/CompPhysics/MachineLearning/blob/master/doc/pub/week45/ipynb/week45.ipynb
Video of lecture at
https://youtu.be/dZt6Vm1wjhs
Whiteboard notes at
https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2025/FYSSTKweek45.pdf
For a more in depth discussion on CNNs we recommend Goodfellow et al chapters 9. See also chapter 11 and 12 on practicalities and applications
Reading suggestions for implementation of CNNs, see Raschka et al chapters 14-15 at
https://github.com/rasbt/machine-learning-book
.
Video on Deep Learning at
https://www.youtube.com/playlist?list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi
«
1
2
3
4
5
6
7
8
9
10
11
...
59
»