04 / 06 · Optimisers on a loss surface
Gradient descent playground
SGD, momentum and Adam race across a non-convex loss surface while you change the learning rate.
04 / 06 · Optimisers on a loss surface
SGD, momentum and Adam race across a non-convex loss surface while you change the learning rate.