LEC ANA1 25

Taylor’s theorem

Let $f:[a,b]\to \mathbb{R}$ be twice differentiable. Fix $x\in [a,b]$. Consider the simplest approximation of $f$ that can be made: a constant function.

$$f(x+h)=\underset{E_0(h)}{\underbrace{f(x)}}+r_0(h)$$

Here, $E_0(h)$ is a constant polynomial approximation, and $r_0(h)$ is the error. Note that ${\lim }_{h\to 0}{r}_0(h)=0$. Now, we can try to refine our approximation by siphoning information from the error function. Consider the limit

$$\begin{array}{r}\underset{h\to 0}{\lim }\frac{r_0(h)}{h}=\underset{h\to 0}{\lim }\frac{f(x+h)-f(x)}{h}=f^{\prime }(x).\end{array}$$

Let

$$r_1(h)\equiv \frac{r_0(h)}{h}-f^{\prime }(x).$$

Clearly, ${\lim }_{h\to 0}{r}_1(h)=0$. Plugging in the value of $r_0(h)$ in terms of $r_1(h)$ in the zero degree approximation gives the first degree approximation $E_1(h)$ at $x$.

$$f(x+h)=\underset{E_1(h)}{\underbrace{f(x)+f^{\prime }(x)h}}+r_1(h)h,$$

How would you obtain a second degree approximation? Once more, consider the limit

$$\begin{array}{rl}\underset{h\to 0}{\lim }\frac{r_1(h)}{h}& =\underset{h\to 0}{\lim }\frac{f(x+h)-f(x)-f^{\prime }(x)h}{h^2}\\ & =\underset{h\to 0}{\lim }\frac{f^{\prime }(x+h)-f^{\prime }(x)}{2h}=\frac{f^{\prime \prime }(x)}{2}\end{array}$$

and let

$$r_2(h)\equiv \frac{r_1(h)}{h}-\frac{f^{\prime \prime }(x)}{2}.$$

Again, ${\lim }_{h\to 0}{r}_2(h)=0$. Plugging in the value of $r_1(h)$ in terms of $r_2(h)$ in the first degree approximation yields:

$$f(x+h)=\underset{E_2(h)}{\underbrace{f(x)+f^{\prime }(x)h+\frac{f^{\prime \prime }(x)}{2}{h}^2}}+r_2(h)h^2.$$

where ${\lim }_{h\to 0}{r}_2(h)=0$.

$E_n$ is called the $n$th Taylor polynomial at $x$.

Theorem 147.1(Rudin 5.15).

Suppose $f:[a,b]\to \mathbb{R}$, and $f^{(0)},f^{(1)},\dots ,f^{(m-1)}$ are continuous on $[a,b]$, and $f^{(m)}$ exists on $(a,b)$. Let $x,x+h\in [a,b]$.
Then, there exists $\theta$ strictly between $x$ and $x+h$ such that

$$f(x+h)=\underset{E_{m-1}(h)}{\underbrace{f^{(0)}(x)+f^{(1)}(x)(h)+\frac{f^{(2)}(x)}{2}(h{)}^2+\cdots +\frac{f^{(m-1)}(x)}{(m-1)!}(h{)}^{m-1}}}+\frac{f^{(m)}(\theta )}{m!}(h{)}^m.$$

Proof.

We have shown that$f$ can be expressed as

$$f(x+h)=E_{m-1}(h)+r_{m-1}(h)h^{m-1}.$$

Let $M$ be the number defined by

$$f(x+h)=E_{m-1}(h)+M{h}^m.$$

Define

$$g(x+k)\equiv r_{m-1}(k)k^{m-1}-M{k}^m,$$

where $x+k\in [a,b]$. Note that $g(x)=0$, and $g(x+h)=0$. Also note that $g^{(1)}(x),g^{(2)}(x),\dots ,g^{(m-1)}(x)$ are zero.

On differentiating both sides $m$ times with respect to $k$ we get

$$g^{(m)}(x+k)=f^{(m)}(x+k)-Mm!$$

Now, since $g(x)=0$ and $g(x+h)=0$, there must exist $x+t_1$ between $x$ and $x+h$ such that $g^{\prime }(x+t_1)=0$, thanks to the mean value theorem. Again, since $g^{\prime }(x)=0$ and $g^{\prime }(x+t_1)=0$, there must exist $x+t_2$ between $x$ and $x+t_1$ such that $g^{\prime \prime }(x+t_2)=0$. After $m$ steps, we obtain $x+t_m\in (x,x+h)$ such that $g^{(m)}(x+t_m)=0$. Therefore, $M=\frac{f^{(m)}(x+t_m)}{m!}$.□

If we know that bounds on $|f^{(m)}(x)|$, we can bound the error!

---

MVT analogue for vector valued functions

The mean value theorem and L’Hospital’s rule are not true for complex or vector valued functions. For an example of the former, consider the map

$$\mathbf{f}:\mathbb{R}\to {\mathbb{R}}^2,\mathbf{f}(x)=(\cos x,\sin x).$$

${\mathbf{f}}^{\prime }(x)=(-\sin x,\cos x)$. Note that $|{\mathbf{f}}^{\prime }(x)|=1$ for all $x$. Now,

$$\begin{array}{r}\frac{\mathbf{f}(2\pi )-\mathbf{f}(0)}{2\pi }=0\ne {\mathbf{f}}^{\prime }(x)\forall x.\end{array}$$

However, an analogue of the MVT does exist:

Theorem 147.2(Rudin 5.19).

Suppose $\mathbf{f}$ is a continuous mapping of $[a,b]$ into ${\mathbb{R}}^k$ and $\mathbf{f}$ is differentiable in $(a,b)$. Then there exists $x\in (a,b)$ such that

$$|\mathbf{f}(b)-\mathbf{f}(a)|\le (b-a)|{\mathbf{f}}^{\prime }(x)|.$$

Proof.

Let$\mathbf{z}=\mathbf{f}(a)-\mathbf{f}(b)$. Define

$$\varphi (t)=\mathbf{z}\cdot \mathbf{f}(t).$$

Now, $\varphi$ is a continuous real function. Thus, the mean value theorem tells us

$$\varphi (a)-\varphi (b)=(b-a){\varphi }^{\prime }(x)=(b-a)\mathbf{z}\cdot {\mathbf{f}}^{\prime }(x)$$

for some $x\in (a,b)$. Also,

$$\varphi (b)-\varphi (a)=\mathbf{z}\cdot \mathbf{z}=|\mathbf{z}{|}^2.$$

Thus,

$$|\mathbf{z}{|}^2=(b-a)\mathbf{z}\cdot {\mathbf{f}}^{\prime }(x)\le (b-a)|\mathbf{z}||{\mathbf{f}}^{\prime }(x)|.$$ □