0

I'm trying to prove the following:

Show that $f$ grows fastest along path for which $\gamma'(t)=\nabla f(\gamma(t))$ than along any other path.

My reasoning is that of course $f$ along $\gamma$ must be growing the fastest since by definition the gradient at a point $x_0$ is the direction to which the function grows fastest and its magnitude gives the steepness of the growth.

But what about "any other path"?

mavavilj
  • 7,270
  • Related question http://math.stackexchange.com/questions/401845/why-the-nabla-fx-in-the-direction-orthogonal-to-fx/402080#402080 – Elias Costa Nov 24 '16 at 12:52

1 Answers1

3

Let $\eta$ be any other path. Then the growth of $f$ along $\eta$ is measured by the the derivative: $(f\circ \eta)'(t)=\nabla f(\eta(t))\cdot\eta'(t)$, which by the Cauchy-Schwarz inequality is $\leq || \nabla f(\eta(t)||\ || \eta'(t)||$. Therefore, the maximum value of the derivative will be attained when this is an equality, i.e. when the vectors are parallel. In other words, when $\eta'(t)=\lambda \nabla f(\eta(t))$, for some $\lambda$.

However, note that you can always reparametrize $\eta$ to get $\lambda=1$.

Sak
  • 3,866
  • So how does this relate to $f(\gamma (t))$? – mavavilj Nov 24 '16 at 10:35
  • $f(\gamma(t))$ precisely satisfies that $(f\circ\gamma)'(t) = || \nabla f(\gamma(t)) ||^2$, or in other words, it makes the Cauchy-Schwarz inequality, an equality, therefore attaining the maximum value. – Sak Nov 24 '16 at 10:39
  • Why does it satisfy that? – mavavilj Nov 24 '16 at 10:40
  • Because of your hypothesis that $\gamma'(t)=\nabla f(\gamma(t))$. Just substitute in the inequality in my answer. Note that $\eta$ is any path, in particular you can choose $\gamma$ – Sak Nov 24 '16 at 10:41
  • Do you know if using C-S is the only way to solve this? – mavavilj Nov 24 '16 at 13:16
  • I don't know of any other proof unfortunately – Sak Nov 25 '16 at 17:29