Gradient Lab — see how machines learn

Gradient Lab is a free, interactive playground for understanding gradient descent and optimization. Watch the loss landscape in 1D, 2D and 3D; compare optimizers — Gradient Descent, Momentum, Nesterov, AdaGrad, RMSProp and Adam — from the same start; race them; map the basins of attraction; and work through a built-in course from "which way is down?" to a real tiny neural network.

This application is interactive and requires JavaScript. Please enable JavaScript to use it.