In this section, we review the material from:
Hastie, James, Tibshirani, and Witten, An Introduction to Statistical Learning, 2023, first 3 chapters
Bach, Learning Theory from First Principles, 2025, first 3 chapters
Chapter 24 of Spin Glass Theory and Far Beyond, 2023, “Neural Networks: From the Perceptron to Deep Nets”
Statistical Learning Theory Prerequisites¶
Machine Learning Prerequisites¶
Neural Network Prerequisites¶
We now draw from Chapter 24 of Spin Glass Theory and Far Beyond.