← All roadmaps
Study Roadmap

ML / AI & Nature of Code

creative coding → simulation → learning algorithms → ML engineering

A path from creative coding to working machine learning: make natural systems move on a screen, build the classic learning algorithms by hand, then cross into deep learning and shipping real ML. This roadmap curates the outside world's best resources; the taught, from-first-principles version of the deep material lives in the Zero Series' AI Zero book, which each theory stage links to as its canonical home.

13Stages
0/56Resources done
Day streak
00
STAGE 00 · numbers before symbols
Math You Can See
you finish able to → vector, gradient, and probability intuition you can picture
0 of 5 done
Web 3Blue1Brown — Essence of Linear Algebra free — vectors and matrices as motion; the mental model everything later reuses
Web 3Blue1Brown — Essence of Calculus free — derivatives and gradients, the machinery behind training
Web StatQuest — Statistics Fundamentals free — distributions, likelihood, Bayes, explained slowly and clearly
Web Khan Academy — Linear Algebra free — work the exercises if the videos aren't enough on their own
Web AI Zero — the algebra, calculus & probability primers series canonical home: the numbers-before-symbols primers this roadmap is built around
01
STAGE 01 · make something move
Creative Coding Foundations
you finish able to → a habit of turning an idea into a running sketch the same day
0 of 7 done
Web The Nature of Code (Shiffman, free online) free — the whole book reads in the browser; vectors, forces, oscillation, agents
Web p5.js — get started free — the sketch environment Nature of Code uses; runs anywhere
Web The Coding Train (Daniel Shiffman) free — the friendliest creative-coding video channel there is
Book 1.The Nature of Code (Shiffman) own the print/PDF to work through offline
Book 2.Generative Design (Bohnacker et al.) form from rules — typography, colour, motion systems
Web Game Engine Zero — 2D math & trigonometry, applied series canonical home for the vectors/trig/rendering under every sketch
Lab Sketch-a-day journal
Lab setup
  • Software: the p5.js Web Editor (link) — nothing to install; or VS Code + the p5.vscode extension for local work.
  • Hardware: any laptop; a drawing tablet is optional for interactive pieces.
  • Cadence: one small sketch per Nature of Code section, each committed to a git repo so the progression is visible.
  • Guardrail: keep sketches short and self-contained — this stage is about reps, not one giant project.
02
STAGE 02 · systems that come alive
Simulation & Emergence
you finish able to → flocking, cellular automata, and physics you built yourself
0 of 4 done
Web Nature of Code — Autonomous Agents & Particle Systems free — steering, flocking, particle systems, chapter by chapter
Book 1.The Computational Beauty of Nature (Flake) fractals, chaos, cellular automata, L-systems — the deep reference
Web Complexity Explorer (Santa Fe Institute) free courses — agent-based modeling and complex systems
Web Nicky Case — Explorable Explanations free — playable simulations that teach emergence by feel
03
STAGE 03 · evolution as search
Evolutionary Computation
you finish able to → a genetic algorithm evolving a solution in front of you
0 of 4 done
Web Nature of Code — The Evolution of Code free — build a GA from scratch: selection, crossover, mutation
Book 1.An Introduction to Genetic Algorithms (Mitchell) the classic, readable treatment
Web NEAT — evolving neural network topologies free — the paper + implementations behind neuroevolution
Lab Evolve-a-creature lab
Lab setup
  • Software: p5.js or plain Python (numpy) — no framework needed for a first GA.
  • Build: evolve a phrase, then smart rockets, then a walking creature so you can watch fitness climb.
  • Hardware: any laptop; GAs are CPU-light at this scale.
  • Guardrail: log and plot best/mean fitness per generation — an evolution you can't see converging is a bug you can't find.
04
STAGE 04 · before the deep end
Classical Machine Learning
you finish able to → the ability to frame a problem, train a model, and read its errors
0 of 5 done
Web Andrew Ng — Machine Learning Specialization free to audit — the canonical first ML course
Book 1.Hands-On Machine Learning, 3e (Géron) the practitioner's bible — scikit-learn then Keras
Book 2.Python Data Science Handbook (VanderPlas) free online — numpy, pandas, matplotlib, scikit-learn
Web scikit-learn — user guide free — the reference for classical ML in Python
Web Python Zero — Python, data structures & tooling series canonical home for the Python this stage assumes
05
STAGE 05 · no framework yet
Neural Nets from Scratch
you finish able to → backprop implemented by hand, so the framework holds no mystery
0 of 4 done
Web Andrej Karpathy — Neural Networks: Zero to Hero free — build micrograd and backprop from nothing; the best from-scratch series there is
Web Nature of Code — Neural Networks free — perceptron → network, built by hand in p5.js
Book 1.Neural Networks from Scratch in Python (Kinsley & Kukieła) every line of a net, no libraries
Web AI Zero — the taught neural-network curriculum series canonical home for the theory, derived slowly from the primers
06
STAGE 06 · now use the tools
Deep Learning with a Framework
you finish able to → real models trained on a GPU, checkpointed and evaluated
0 of 5 done
Web fast.ai — Practical Deep Learning for Coders free — top-down: get models running fast, theory follows
Book 1.Deep Learning with PyTorch (Stevens, Antiga, Viehmann)
Web Dive into Deep Learning (d2l.ai) free — interactive book with runnable PyTorch/JAX code
Book 2.Deep Learning (Goodfellow, Bengio, Courville) the theory reference — free online; dip in as needed
Lab GPU training lab
Lab setup
  • Free tier: Google Colab or Kaggle Notebooks give a free GPU with zero local setup — start here.
  • Local stack: Python via uv, PyTorch, and a CUDA-capable NVIDIA GPU (a used RTX 3060 12GB is the budget sweet spot) once you outgrow free tiers.
  • Hardware note: VRAM is the ceiling — 8GB trains small models, 12–24GB for real work.
  • Guardrail: checkpoint every epoch and watch a validation curve; free GPU sessions time out, so save often.
07
STAGE 07 · the two big architectures
Vision & Sequence Models
you finish able to → hands-on CNNs for images and RNNs for sequences
0 of 3 done
Web CS231n — Convolutional Neural Networks for Visual Recognition free — Stanford's course notes, still the best CV intro
Web Karpathy — The Unreasonable Effectiveness of RNNs free — the essay that makes sequence models click
Web Hugging Face — Computer Vision course free — modern CV with transformers and diffusion
08
STAGE 08 · back to art, with nets
Generative & Creative AI
you finish able to → your own image/audio generators, wired back into sketches
0 of 4 done
Web ml5.js free — friendly ML in the browser; pairs directly with your p5.js sketches
Book 1.Generative Deep Learning, 2e (Foster) VAEs, GANs, diffusion, and transformers for making things
Web Hugging Face — Diffusion Models course free — how modern image generation actually works, with code
Web Distill.pub free — the clearest visual explanations of how these models work
09
STAGE 09 · the current frontier
Transformers & LLMs
you finish able to → a small language model you built and trained yourself
0 of 5 done
Web The Illustrated Transformer (Jay Alammar) free — the diagram that makes attention click
Book 1.Build a Large Language Model (From Scratch) (Raschka) a working GPT, chapter by chapter
Web Karpathy — Let's build GPT / nanoGPT free — build and train a GPT from scratch on video
Web Hugging Face — LLM course free — transformers, fine-tuning, and the ecosystem
Web AI Zero — LLM & transformer chapters series canonical home for the taught path; follow the link, don't duplicate
10
STAGE 10 · learning from reward
Reinforcement Learning
you finish able to → an agent that learns to act, from Q-learning to policy gradients
0 of 4 done
Book 1.Reinforcement Learning: An Introduction (Sutton & Barto) the field's founding text — free online
Web OpenAI Spinning Up in Deep RL free — the most practical deep-RL on-ramp, with code
Web David Silver — RL Course (DeepMind) free — the classic lecture series
Lab Agent-in-a-world lab
Lab setup
  • Software: Gymnasium (the maintained fork of OpenAI Gym) for environments, plus Stable-Baselines3 for reference algorithms.
  • Build: solve CartPole with tabular Q-learning first, then a policy-gradient agent, then something with pixels.
  • Hardware: CPU is fine for the classic control tasks; a GPU only matters for pixel-based envs.
  • Guardrail: log episode reward and seed everything — RL is famously noisy, so compare runs, not single episodes.
11
STAGE 11 · ship it, keep it working
ML Engineering & MLOps
you finish able to → a trained model served, monitored, and reproducible
0 of 4 done
Book 1.Designing Machine Learning Systems (Huyen) data, features, deployment, monitoring — the practitioner's map
Web Made With ML free — MLOps, testing, CI/CD for ML, production patterns
Web AI Ops Zero — model serving, evals, drift & guardrails series canonical home for running models in production
Lab Serve-a-model lab
Lab setup
  • Software: FastAPI to wrap the model from Stage 06, containerized with podman (not docker), served locally.
  • Hardware: any laptop for CPU inference.
  • Stretch: deploy the container to a homelab k8s cluster or a free-tier cloud runtime.
  • Guardrail: pin dependencies (a uv lockfile) and record input/output schemas so the served model matches what you trained.
+
STAGE + · adjacent interest
Side track · Safety & Interpretability
0 of 2 done
Web Anthropic — Interpretability research free — how people are trying to read what a model has learned
Web AI Safety Fundamentals (BlueDot) free curriculum — alignment and governance, as a reading course