Foundations of Deep Learning (Fall 2025)
Graduate course (MSc level), University of Basel, Department of Mathematics and Computer Science, 2025
Duty
I served as a Teaching Assistant for the exercise sessions. My responsibilities included designing new exercise sheets and continuous-assessment questions, preparing tutorial material (including a PyTorch tutorial notebook), mentoring student project groups, and grading homeworks, the midterm, the project write-ups, and the written exam. I also contributed to preparing new exam material and supported students through Q&A and office-hour style help.
Topics
- Linear and non-linear networks (activations, backpropagation)
- Approximation theory (including universal approximation)
- Complexity theory
- Optimization for deep learning
- Optimization landscape of neural networks
- Architectures (selected modern architectures)
- Neural Tangent Kernel (NTK)
- Regularization and implicit bias
- Generalization bounds (theory and modern phenomena)
- Adversarial examples and robustness
- Reinforcement learning (introductory module)
- Double descent
