14

In my calculus class, to show that $\frac{d}{dx}e^x=e^x$ we did something like this:

$$\lim_{h \to 0} \frac{a^{x+h} - a^x}{h} = a^x \lim_{h \to 0} \frac{a^h-1} h,$$

and then we defined $e$ to be the base $a$ that makes the limit

$$\lim_{h \to 0} \frac{a^h-1}{h}$$

equal to $1$. Now, my question is this: how can we know beforehand that the function which is its own derivative is an exponential function? In other words, if we have

$$ \lim_{h \to 0} \frac{f(x+h) - f(x)}{h} = f(x),$$

how do we know $f(x)$ is of the form $ka^x$ (ignoring the trivial case $f(x) = 0$)? How can we show that there aren't functions of other forms that give the same result?

Jacob
  • 739

7 Answers7

11

If $f'=f$, take $g(x)=f(x)e^{-x}$. Then $g'(x)=f'(x)e^{-x}-f(x)e^{-x}=0$ and so $g$ is constant. The constant is $g(0)=f(0)$. Therefore, $f'=f$ implies $f(x)=f(0)e^{x}$.

lhf
  • 216,483
  • 1
    I followed along easily until the last sentence. In case others have the same problem I did: we have $g(x) = f(x)e^{-x} = f(0)$ and can multiply all sides of the equation by $e^x$ to get $g(x)e^x = f(x) = f(0)e^x$. – Daniel Wagner Nov 16 '16 at 18:04
  • 5
    When you took $g'(x)$ you assumed that $\frac{d}{dx}e^{-x} = - e^{-x}$, which is exactly what you're trying to prove. – Devsman Nov 16 '16 at 19:22
  • 5
    @Devsman I think in this case we are assuming that $\frac{d}{dx}ke^x=ke^x$ and showing that this is the only form the solution to $f=f'$ can take (which answers the 2nd part of my question). – Jacob Nov 16 '16 at 20:06
10

Hint. If $f$ is such a function then calculating the derivative of $f(x)/e^x$ provides useful information about $f$.

Ethan Bolker
  • 95,224
  • 7
  • 108
  • 199
  • 2
    So we need to find the derivative of $f(x)/e^x$ to find the derivative of $e^x$?! – Fly by Night Nov 16 '16 at 21:23
  • 2
    @FlybyNight No. If you read the question carefully you'll see that the OP knows that $e^x$ is its own derivative. He or she is asking how to show that's (essentially) the only function with that property. – Ethan Bolker Nov 17 '16 at 00:33
7

OK, so we are given the differential equation $$f'(x)=f(x) \tag{1}$$ Of course this implies that $f$ is differentiable.

Let's first make the observation that whenever $f(x)$ is a solution to this differential equation, then for arbitrary $s,c\in\mathbb R$, $$g(x) = s\,f(x-c) \tag{2}$$ is also a solution.

Let's further have a look at the general form the solutions may have. If at some $x$, $f(x)>0$, then due to continuity we have $f(x)>0$ in some neighbourhood. Since $f'(x)=f(x)$ this also implies that $f(x)$ is monotonously growing in that neighbourhood. Clearly if it is positive and growing, it cannot reach $0$ for any larger value of $x$. Analogously, if it is anywhere negative, it will remain negative for all larger $x$.

Thus we have by now restricted the possible solutions to functions of one of the following types:

  • Either the function is everywhere strictly positive and monotonously growing.

  • Or the function is zero up for all $x\le x_0$, and strictly positive for all $x>x_0$ (at $x_0$ if has to be $0$ due to continuity, as a limit from the left must reproduce the function value).

  • Or the function is zero everywhere.

  • Or the function is the negative of one of the first two types.

Of course the constant function $f(x)=0$ is one solution of $(1)$. If there are other solutions, there must be at least one $x$ so that $f(x)\ne 0$. Because of $(2)$ we can thus assume wlog that $f(0)=1$. Also, for convenience, define for the first case $x_0=-\infty$.

Now assume $f(x)\ne 0$. Then $f(x+1)/f(x)$ is well defined in a neighbourhood, and we have \begin{align} \frac{\mathrm d}{\mathrm dx}\,\frac{f(x+1)}{f(x)} &= \frac{f(x)f'(x+1) - f(x+1)f'(x)}{f(x)^2}\\ &= \frac{f(x)f(x+1) - f(x+1)f(x)}{f(x)^2} = 0\tag{3} \end{align} In other words, $f(x+1)/f(x)$ is a constant. This holds for all $x>x_0$.

So since we have assumed that $f(0)=1$, we have $f(1)=f(0+1)=af(0)=a$, $f(2)=a(1+1)=af(1)=a^2$. Also, assuming $x_0<-1$, $af(-1)=f(0)$, so $f(-1)=a^{-1}$ etc. Or in short, for any $n\in\mathbb Z$ with $n>x_0$, $f(n)=a^n$.

But then, in $(3)$, instead of $f(x+1)$ we could have used $f(x+1/k)$ with the same result, giving $f(n/k)=b^n$. For $n=k$, we thus get $a = f(1) = f(k/k) = b^k$, that is, $b=a^{1/k}$. So in summary, we have for all $q\in\mathbb Q$ with $q>x_0$ that $f(q)=a^q$.

But since $f$ is differentiable, it is in particular continuous, and thus determined by its values at rational points. And since $a^x$ is continuous, too, we get $f(x)=a^x$ for all $x\in\mathbb R$ with $x>x_0$.

Continuity of $a^x$ then also implies $\lim_{x\to x_0+0}f(x) = \lim_{x\to x_0+0}a^x = a^{x_0}$. However since by assumption $f(x)$ is continuous, $\lim_{x\to x_0+0}f(x) = f(x_0)$. But we previously have seen, also by continuity, that $f(x_0)=0$. Since the equation $0=a^{x_0}$ has no solution in $\mathbb R$, this means that the second case cannot apply, and the function therefore is strictly positive everywhere, and thus is $a^x$ everywhere.

In other words, the function is an exponential function.

celtschk
  • 43,384
  • Great answer, other than a small typo (I think): $f(-1)=af(0)$ should be $af(-1)=f(0)$. Accepting this one because it best answers my main question – Jacob Nov 17 '16 at 00:52
  • 1
    “[…] we can conclude by limit that this has to be the case also if $f(x)=0$.” Only in isolated roots. If we had, say, $f([2, 4]) = {0}$, the continuity argument doesn't work out. – Hermann Döppes Nov 17 '16 at 06:27
  • @jacer21: Thank you, fixed. – celtschk Nov 17 '16 at 21:38
  • @HermannDöppes: I've reworked that part by adding some extra discussion of the function's behaviour, so I now don't need that specific argument. – celtschk Nov 17 '16 at 21:39
  • @celtschk 1.) I fixed some (presumed) typos. Please ensure I have not mutilated anything. 2.) Your $a$ in (2) is not the $a$ from the question and not the $a$ you use later. You might want to consider renaming it to avoid confusion. – Hermann Döppes Nov 17 '16 at 21:55
  • @HermannDöppes: 1. Thank you for your fixes, they seem to all be fine. 2. Good point; I now changed the $a$ to $s$ in $(2)$. – celtschk Nov 17 '16 at 22:27
4

First, notice that

  • In order to show that $\dfrac d {dx} a^x = ( a^x\cdot\text{constant}),$ you don't need to show that only exponential functions satisfy the equation $f'(x) = \big(f(x)\cdot\text{constant}\big).$
  • You already see in the discrete case that exponential functions grow at a rate proportional to their current size: $$ \frac{\Delta 2^x}{\Delta x} = \frac{2^{x+1} - 2^x}{1} = 2^x.$$

To show that no other functions satisfy $f'(x) = f(x),$ can be done by supposing $f$ is such a function and considering $$ g(x) = \frac{f(x)}{e^x}. $$ Then $$ g'(x) = \frac{e^x f'(x) - f(x) e^x }{e^{2x}} = \frac{f'(x) - f(x)}{e^x} = \frac{f(x)-f(x)}{e^x} = 0. $$ If $g'(x) = 0$ for all values of $x$, then $g$ is constant, so $g(x) = \Big( f(x)\cdot \text{constant}\Big).$

Note that the mean value theorem was tacitly used above: It is used in the proof that functions whose derivatives are everywhere $0$ are constant.

3

So essentially we are looking for the solution to the differential equation $\frac{dy}{dx}=y$ where $y=f(x)$. This can be solved by using separation of variables $\frac{dy}{y}=dx$ and then we integrate both sides and solve for $y$ and get $ke^x$ now when you solve a differential equation there is something about a uniqueness of the solution and that all solutions are contained by changing the constant $k$. So therefore you know the only functions where $y=y'$ are in the form $ke^x$

Teh Rod
  • 3,108
  • 1
    Correct - but a student in a beginning calculus class isn't likely to know about separating variables in a differential equation. – Ethan Bolker Nov 16 '16 at 16:00
  • 2
    The separation of variables method can be made more rigorous by the observation that $\frac{f'(x)}{f(x)}$ is the derivative of $\ln(|f(x)|)$. You need to consider the cases (i) $f$ is identically equal to zero, so that the above fraction is never well-defined, or (ii) there is at least one point $x_0$ for which $f(x_0) \neq 0$. By continuity, you get an $\epsilon$-interval where $f \neq 0$, and then you can use the above observation to solve for $f$ in the interval, and then beyond the interval. – Dustan Levenstein Nov 16 '16 at 16:50
0

Consider the more general equation:

$$y=a^x \tag{1}$$

We apply logarithmic rules:

\begin{align} \ln y &= x\ln a\\ \frac{\mathrm d}{\mathrm dx}\,\ln y &= \frac{\mathrm d}{\mathrm dx}\,x \ln a\\ \frac{\mathrm d}{\mathrm dx}\,\ln y &= \ln a \frac{\mathrm d}{\mathrm dx}\,x\\ \frac{\mathrm d}{\mathrm dx}\,\ln y &= \ln a \tag{2}\\ \end{align}

We apply the chain rule to the LHS of (2)

\begin{align} \frac{\mathrm d \ln y}{\mathrm dy}\,\frac{\mathrm dy}{\mathrm dx} &= \ln a\\ \frac{1}{y}\,\frac{\mathrm dy}{\mathrm dx} &= \ln a\\ \frac{\mathrm dy}{\mathrm dx} &= y \ln a \\ \frac{\mathrm d}{\mathrm dx}\, a^x &= a^x \ln a \tag{3} \end{align}

Thus, (3) is the general result for the derivative w.r.t. $x$ of a function where $a$ is raised to $x$.

We ask ourselves, for what value of $a$ is our constant $\ln a$ equal to 1 and the answer is, of course, $e$

\begin{align} \frac{\mathrm d}{\mathrm dx}\, a^x &= a^x \ln a \\ \frac{\mathrm d}{\mathrm dx}\, e^x &= e^x \ln e \\ \frac{\mathrm d}{\mathrm dx}\, e^x &= e^x \end{align}

Dancrumb
  • 375
-1

\mathrm We want an expression which when differentiated yields itself. The first possible case is when $f(x)=0.$

Second, let's solve the initial value problem $f(0)=1$ and $f(x)=f'(x)$. Now taking $f(x)=1,$ and then integrating the previous function and adding the result to obtain a better solution to the initial value problem, we get, $f(x)=1 + x$, and then further integrating the second element, and repeating we get, $f(x)=1 + x + (x^2)/2.$ Repeating the process will eventually yield the taylor series expansion for the exponential function as $f(x)=\sum_{i=0}^n (x^n)/k!$ And then we define the nth root of this expression as being the constant e. Also, by differentiating the inverse of the function $f(x)$, we arrive at $(f^-1)'(x)=1/x$, which is the natural logarithm.

The essence of the exponential function with base e is that it is its own derivative and as such can be taken as its definition.

PS: We can also define e to be the positive upper limit of integration in the integral definition of the natural logarithm, and deduce that $e^x$ is its own derivative.

YuiTo Cheng
  • 4,705