Plans for week 43

Dear all, here are our plans for week 43:

Plans for week 43

Material for the active learning sessions on Tuesday and Wednesday.

• Exercise on writing your own neural network code, application to the OR and XOR gates

• The exercises this week will be continued next week as well

• Discussion of project 2

Material for the lecture on Thursday October 26, 2023.

• Building our own Feed-forward Neural Network and discussion of project 2, continuation from last week

• Solving differential equations with Neural Networks and intro to Tensorflow with examples.

• Readings and Videos:

  • These lecture notes, see attachment below

  • Aurelien Geron's chapters 10-11

  • For a more in depth discussion on neural networks we recommend Goodfellow et al chapters 6 and 7.

  • Neural Networks demystified

  • Building Neural Networks from scratch

  • Video on Neural Networks

  • Video on the back propagation algorithm

I also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at http://neuralnetworksanddeeplearning.com/chap4.html.

The exercises this week are continued next week as well and can be reused entirely in the project solution. 

Best wishes to you all,

Adam, Daniel, Fahimeh, Ida, Karl Henrik, Mia and Morten