Semester 1 · Core

Linear Algebra & Calculus for ML

The mathematics every model is built from: vectors and matrices as geometry, solving linear systems, projections, eigenvalues and the SVD, then calculus from single-variable optimisation to gradients, Jacobians and the chain rule.

Every idea is derived, then computed in NumPy.

3 credits · 90 h · 8 chapters · 5 labs

Semester
1
Kind
Core
Credits
3
Hours
90
Chapters
8
Graded labs
5
Prerequisites
Recommended: Helpful background. You can start without it if you are willing to fill the gaps.

What you’ll be able to do

  1. LO1Reason about vectors geometrically using dot products, norms, angles and projections.
  2. LO2Interpret matrices as linear maps and use rank, span, column space and null space to describe them.
  3. LO3Solve linear systems with Gaussian elimination and LU decomposition, and judge numerical conditioning.
  4. LO4Use orthogonality, eigen-decomposition, quadratic forms and the SVD to analyse and compress data.
  5. LO5Differentiate and optimise functions of one variable, including Taylor approximations.
  6. LO6Compute gradients, Jacobians and Hessians of multivariable functions and apply the chain rule to model losses.
A matrix as a transformationA unit square, hatched, and its image under a shear matrix, a slanted parallelogram.[1 1; 0 1]unit square
Fig. 1A matrix as a transformation. Illustration.

Chapters

8 chapters · each section ends with a short check

  1. 01Vectors as data and geometry
  2. 02Matrices as linear maps
  3. 03Solving linear systems
  4. 04Orthogonality and projections
  5. 05Eigenvalues and quadratic forms
  6. 06The singular value decomposition
  7. 07Calculus of one variable, for optimisation
  8. 08Gradients, Jacobians and the chain rule

Graded labs

  1. L1

    Finding similar documents with vectors

    After chapter 1 · about 7 hours · Word-count matrix of 30 short news items in five topics plus one blank item · CC0-1.0 (authored for this course) · Runs on a CPU

  2. L2

    LU decomposition from scratch

    After chapter 3 · about 7 hours · Random Gaussian matrices, hand-written singular matrices and Hilbert matrices · Generated for this course; no third-party data · Runs on a CPU

  3. L3

    Eigenvectors and a tiny PageRank

    After chapter 5 · about 7 hours · Synthetic directed link graphs and matrices with known eigenvalues · CC0-1.0 (authored for this lab) · Runs on a CPU

  4. L4

    Compressing images with the SVD

    After chapter 6 · about 7 hours · Sample photographs china.jpg and flower.jpg · CC BY 2.0 (creativecommons.org/licenses/by/2.0). china.jpg by danielbuechele (flickr.com/photos/danielbuechele/6061409035); flower.jpg by vultilion (flickr.com/photos/vultilion/6056698931); both retrieved by Robert Layton for scikit-learn. · Runs on a CPU

  5. L5

    Gradients by hand and by finite differences

    After chapter 8 · about 7 hours · Synthetic regression and binary classification data · CC0-1.0 (authored for this lab) · Runs on a CPU

Before you start

Recommended

Helpful background. You can start without it if you are willing to fill the gaps.

Where it leads

Semester 4 · Capstone

Capstone Project

8 credits · 240 h · 5 milestones · solo

How it’s taught

You read short sections written for the page. Each ends with a check, and in-browser exercises let you practise. Graded labs run on your own cloud lab machine, CPU-friendly.

No videos. No live classes. No AI tutor.

How it works

Linear Algebra & Calculus for ML, in Semester 1

Enrolment isn't open yet. Pricing will be announced before it opens.

We use your email only to tell you about Epoch School's launch. Unsubscribe any time. Privacy