Semester 1 · Core
Foundations of Machine Learning
https://epochschool.com/subjects/foundations-of-ml
How machines learn from data, built from first principles: framing a problem, preparing data, linear and non-linear models, generalisation and regularisation, evaluation, and unsupervised learning.
You derive each method, implement it from scratch, then use the library version with understanding.
- Prerequisites
- Recommended: Helpful background. You can start without it if you are willing to fill the gaps.
What you’ll be able to do
- LO1Frame a real problem as a learning task (task, experience, performance measure) and choose a suitable model family.
- LO2Prepare data and design train, validation and test protocols that avoid leakage.
- LO3Derive, implement and fit linear models for regression and classification.
- LO4Diagnose under- and over-fitting and control it with regularisation and cross-validation.
- LO5Choose, compute and interpret evaluation metrics for regression and classification.
- LO6Apply and compare non-linear and instance-based methods (k-NN, naive Bayes, SVM, trees, ensembles).
- LO7Apply unsupervised methods (clustering, dimensionality reduction) and judge their output critically.
- LO8Run a reproducible end-to-end ML workflow and document a model responsibly.
Chapters
- 01What it means for a machine to learn
- 02Data, features and honest evaluation
- 03Linear regression from first principles
- 04Generalisation: bias, variance and regularisation
- 05Logistic regression and probabilistic classification
- 06Evaluating models
- 07Nearest neighbours and naive Bayes
- 08Margins, kernels and linear discriminants
- 09Decision trees and ensembles
- 10Clustering
- 11Dimensionality reduction
- 12The ML workflow and a first neural network
Graded labs
- L1
Linear regression three ways
After chapter 3 · about 8 hours · Diabetes dataset · BSD-3-Clause (scikit-learn) · Runs on a CPU
- L2
Fighting overfitting
After chapter 4 · about 8 hours · Noisy 1-D curve · Generated for this course; no third-party data · Runs on a CPU
- L3
A screening classifier
After chapter 6 · about 8 hours · Breast Cancer Wisconsin · BSD-3-Clause (scikit-learn) · Runs on a CPU
- L4
Trees, forests and boosting
After chapter 9 · about 8 hours · Wine recognition dataset · BSD-3-Clause (scikit-learn) · Runs on a CPU
- L5
Structure without labels
After chapter 11 · about 8 hours · Optical recognition of handwritten digits · BSD-3-Clause (scikit-learn) · Runs on a CPU
Before you start
Recommended
Helpful background. You can start without it if you are willing to fill the gaps.
Bridge: Maths Refresher
Where it leads
Neural Networks & Deep Learning
Optimisation & Training at Scale
Sequence Models & Transformers
Responsible AI, Ethics & Governance
Image Formation and Classical Computer Vision
Probabilistic ML & Bayesian Methods
Reinforcement Learning Foundations
Capstone Project
How it’s taught
You read short sections written for the page. Each ends with a check, and in-browser exercises let you practise. Graded labs run on your own cloud lab machine, CPU-friendly.
No videos. No live classes. No AI tutor.