Chapter 6What's so special about Euler's number e?
"Who has not be amazed to learn that the function , like a phoenix rising again from its own ashes, is its own derivative?"
- Francois le Lionnais
I’ve introduce a few derivative formulas, but a really important one I left out was exponentials. So here I want to talk about the derivatives of exponential functions like , , and to show why is arguably the most important exponential.
First of all, to get an intuition, let’s focus on the exponential function .
And let’s think of that input as a time, , in days, and the output as a population size, perhaps of a particularly fertile band of creatures, which doubles every day.
Actually, instead of population size, which grows in discrete little jumps with each new baby creature, maybe let’s think of as the total mass of the population, which better reflects the continuity of this function .
For example, at time , the total mass , for the mass of one creature. At day, the population has grown to creatures masses. And day , it’s at , and in general it keeps doubling every day.
For the derivative, we want to find , the rate at which this population mass is growing, thought of as a tiny change to mass divided by a tiny change in time. Let’s start by thinking of the rate of change over a full day, say between day and day . In that case, it grows from to , so that’s eight creatures masses added over the course of that day.
Between day and day , the mass grows from to , so that’s a rate of creature masses per day, which again, is equal to the population size at the start of the day. And in general, the rate of growth over a full day equals the population size at the start of that day.
So it might be tempting to say that this means the derivative of equals itself; that the rate of change of at a given time equals the value of itself. On the day when is , the number of new creature-masses added per day is also ; on the day when is , the number of new creature-masses added per day is also .
This is definitely in the right direction, but it’s not quite correct. What we’re doing here is making comparisons over the course of a full day, considering the difference between and . But for the derivative, we need to ask about what happens for smaller and smaller changes. What’s the growth rate over the course of a tenth of a day... a hundredth of a day... one one billionth of a day, etc.
This is why I had us think of the function as representing population mass vs. time, since it makes sense to ask about a tiny change in mass over a tiny fraction of a day, but it doesn’t make as much sense to ask about the tiny change in the discrete population size per second.
We know that the derivative of the exponential function is close-to, but not quite equal-to itself, suggesting that the derivative of an exponential function is another exponential function. Looking at any point on the plot, will the actual derivative be smaller or larger than the output of the function?
More abstractly, for some tiny change in time , we want to understand the difference between and , all divided by . The change in the function per unit time, but now we’re looking very narrowly around a given point in time, rather than over the course of a full day.
Here’s the thing. I would love if there was some clear geometric picture that made what’s about to follow just pop out. Some diagram where you could point to one value and say "see that part, that is the derivative of ". If you know of one, please, let me know. And while the goal here, as with the rest of the series, is to maintain a spirit of playful discovery, the type of play that follows will have more to do with finding numerical patterns, rather than visual ones.
Finding the Derivative
Start by taking a close look at the exponent term in the numerator. A core property of exponentials is that you can break this up as . That really is the most important property of exponents; if you add two values in the exponent, you can break up the output as a product of some kind. This is what lets you relate additive ideas, like tiny steps in time, to multiplicative ideas, like rates and ratios.
Applying this property gives us the expression below.
Notice how both expressions in the numerator contain the term , so we can factor out , leaving us with the expression below. And remember, the derivative of is whatever this whole expression on the right approaches as approaches .
At first glance this might look like an unimportant manipulation, but a tremendously important fact is that this term on the right in parentheses, where lives, is completely separate from the term itself; it doesn’t depend on the actual time where we started.
What happens if you plug in a very small value for into a calculator to approximate this term in parentheses?
Substutiting in for we get the value.
Substutiting in for we get the value.
And, substutiting in for we get the value.
You’ll find that it for smaller and smaller choices of , this value approaches a specific number, around So the derivative of is itself multiplied by this value.
Don’t worry if that number seems mysterious, the central point is that this is some kind of constant; unlike derivatives of other functions, all the stuff that depends on is separate from the value of itself.
So the derivative of is just itself, but multiplied by some constant. This should kind of make sense, because earlier it felt like the rate of growth for our population with size , at least when we were looking at changes over the course a full day. Evidently, the rate of change for this function over much smaller time scales is not quite equal to itself, but it is proportional to itself, with this very peculiar proportionality constant of
There’s not much special to the number here. If instead had we dealt with the function , the exponential property would also have led us to the conclusion that the derivative of is proportional to itself, but this time with a proportionality constant of about .
For any other base to your exponent you can have fun seeing what the various proportionality constants are, maybe trying to find a pattern.
For example, if you plug in as the base of the exponential function, you can see the relevant proportionality constant is around . And maybe, just maybe, you would notice that this number happens to be exactly times the constant associated with the base of . So these numbers aren’t random, there is some pattern. But what is the pattern? What does have to do with and what does have to do with .
A second question, which ultimately explains these mystery constants, is whether there is some base where that proportionality constant is ; where the derivative of is not just proportional to itself, but equal to itself.
As it turns out, there is a number. It’s the special constant , around , called Euler's number. In fact, it’s not just that happens to show up here, this is, in a sense, what defines the number . This special exponential function with Euler's Number as the base is called the exponential function.
All exponential functions are proportional to their own derivative, but the exponential function base alone is the special number so that the proportionality constant is , meaning actually equals its own derivative.
If you look at the graph of , it has the peculiar property that the slope of a tangent line to any point on the graph equals the height of that point above the horizontal axis.
So how does the exponential function help us find the derivatives of other exponential functions? Well, maybe you noticed that different exponentials look like horizontally scaled versions of each other. This is true for all exponential functions, but best seen with exponential functions with related bases.
This means that you can re-write one exponential in terms of another's base. For example, if we have an exponential function of base and want to re-write the function in terms of base , it can be written like this.
One way to see how to convert between two bases is to zoom in on the graph between and to see how fast the first base grows to to the value of the second base. In this case, base grows twice as fast as base and reaches the output of in half the time. So to convert base to base we can multiply the input of the base function by the constant , which is the same as scaling by a factor of in the horizontal direction.
So we've found a function, the exponential function of base , with a really nice derivative property. Can we take any old exponential function and re-write it in terms of the exponential function? Or in other words, what constant do we multiply the input variable by to make the exponential function have the same output as another exponential function?
For example, let's try to re-write in terms of the exponential function.
As before, we can zoom in on a plot of the two functions, and compare their behavior. Specifically, how long does it take the exponential function to grow to ?
Well, looking at the graph, it takes about units which is exactly equal to the same proportionality constant we found before! If we multiply the input variable in the exponential function by this constant, the exponential function has the same output as .
This type of question we are asking leads us directly towards another function, the inverse of the exponential function, the natural logarithm function.
The existence of a function like this can answer the question of the mystery constants, and it’s because it gives a different way to think about functions that are proportional to their own derivative. There's nothing fancy here, this is simply the definition of the natural log, which asks the question " to the what equals ".
And indeed, go plug in the natural log of to a calculator, and you’ll find that it’s , the mystery constant we ran into earlier. And same goes for all the other bases, the mystery proportionality constant that pops up when taking derivatives and when re-writing exponential functions using is the natural log of the base; the answer the the question " to the what equals that base".
Importantly, the natural logarithm function gives us the missing tool we need to find the derivative of any exponential function. The key is to re-write the function and then use the chain rule. For example, what is the derivative of the function ? Well, let's re-write this function in terms of the exponential function using the natural logarithm to calculate the horizontally-scaling proportionality constant.
Then, we can calculate the derivative of using the chain rule by. First, take the derivative of the outermost function, which due to the special nature of the exponential funtion is itself. Then, second, multiply this by the derivative of the inner function , which is the constant .
This is the same derivative we found using algebra above, since
The same technique can be used to find the derivative of any exponential function.
In fact, throughout applications of calculus, you rarely see exponentials written as some base to a power . Instead you almost always write exponentials as raised to some constant multiplied by . It’s all equivalent; any function like or can be written as . The difference is that framing things in terms of the exponential function plays much more smoothly with the process of derivatives.
Why we care
I know this is all pretty symbol heavy, but the reason we care is that all sorts of natural phenomena involve a certain rate of change being proportional to the thing changing.
For example, the rate of growth of a population actually does tend to be proportional to the size of the population itself, assuming there isn’t some limited resource slowing that growth down. If you put a cup of hot water in a cool room, the rate at which the water cools is proportional to the difference in temperature between the room and the water. Or said differently, the rate at which that difference changes is proportional to itself. If you invest your money, the rate at which it grows is proportional to the amount of money there at any time.
In all these cases, where some variable’s rate of change is proportional to itself, the function describing that variable over time will be some exponential. And even though there’s lot’s of ways to write any exponential function, it’s very natural to choose to express these functions as , since that constant in the exponent carries a very natural meaning: It’s the same as the proportionality constant between the size of the changing variable and the rate of change.