# topic/math/calculus
6 notes · all tags
Calculus and Optimization
Calculus studies local change; optimization uses local change to choose better parameters. The useful mental model is: derivatives describe sensitivity, Taylor expansions…
13 links · 2 backlinks
# topic/math/calculus# topic/math/optimization
Chain Rule (Multivariable)
If , the chain rule gives:
4 links · 5 backlinks
# topic/math/calculus
Gradient
The gradient of a scalar function is the vector of all partial derivatives:
4 links · 7 backlinks
# topic/math/calculus
Hessian Matrix
The Hessian of a scalar function is the matrix of second partial derivatives:
6 links · 6 backlinks
# topic/math/calculus
Jacobian Matrix
The Jacobian of a vector-valued function is the matrix of all partial derivatives:
4 links · 4 backlinks
# topic/math/calculus
Taylor Expansion
Taylor expansion approximates a function near a point using its derivatives:
5 links · 4 backlinks
# topic/math/calculus