by Neil E. Cotter

Research Assistant Professor

Last Updated: 10/14/10

 

(† = missing, * = article)

 

Gradient Descent

Introduction (pdf)

Example

Cost of scrap iron (pdf)

Cooling steel (pdf)

Mill setup (pdf)

Single-neuron network (pdf)

Algorithm (pdf)

Intuitive pictorial view (pdf)

Mathematical view (pdf)

Function minimization (pdf)

Local minima (pdf)

Quadratic bowls (pdf)

Solving optimization problems (pdf)

Error surface estimation (pdf)

Calculating gradients (pdf)