Calculus
↓ Optimization
The mathematics of finding minima and maxima — from gradient descent's calculus to linear programming's algebra.
2 concepts— start at the top and work your way down
- 1→
Derivatives
The instantaneous rate of change of a function — defined as the limit of the difference quotient and interpreted as the slope of a tangent line.
- 2→
Gradient Descent
An iterative optimisation algorithm that repeatedly moves in the direction of the negative gradient to find a local minimum of a loss function.