Newton's method in optimization

Common card · No. 264676

In calculus, Newton's method (also called Newton–Raphson) is an iterative method for finding the roots of a differentiable function f {\displaystyle f} , which are solutions to the equation f ( x ) = 0 {\displaystyle f(x)=0} . However, to optimize a twice-differentiable f {\displaystyle f} , our goal is to find the roots of f ′ {\displaystyle f'} . We can therefore use Newton's method on its derivative f ′ {\displaystyle f'} to find solutions to f ′ ( x ) = 0 {\displaystyle f'(x)=0} , also known as the critical points of f {\displaystyle...

Read on Wikipedia · Image Oleg Alexandrov, Public domain