courseshub.world · Lives in Mathematics and Physics

Richard Courant

Richard Courant

A course in two strands: the life of Hilbert’s assistant who built two great mathematical institutes, one in Göttingen and one in exile in New York, and the analysis he created for physics, engineering and computation.

Born 8 January 1888, Lublinitz Died 27 January 1972, New Rochelle Founded the Courant Institute, New York Level advanced undergraduate → graduate
The Courant–Friedrichs–Lewy condition. The grid point at the top depends on the shaded triangle of grid values. A scheme can converge only if this triangle contains the true domain of dependence, bounded by the characteristics (solid lines).
Lesson 00

How to use this course

Richard Courant is a rare case of a mathematician whose institutions are as famous as his theorems. Students meet his name in the Courant–Fischer minimax principle, the nodal domain theorem, the Courant–Friedrichs–Lewy condition of numerical analysis and the book Methods of Mathematical Physics. Many more met mathematics itself through What is Mathematics?. He also built the Mathematical Institute at Göttingen and, after his expulsion by the Nazi regime, the institute at New York University that now bears his name.

Prerequisites for Part II
  • Multivariable calculus, linear algebra and a first course in real analysis.
  • Basic complex analysis: holomorphic functions and conformal maps.
  • Partial differential equations at the level of the heat, wave and Laplace equations.
  • For Lessons 05 to 08, the idea of a Hilbert space and of the Sobolev space \(H^1_0\) is helpful but not essential.

Each technical lesson opens with a paragraph for the general reader, then gives precise statements, proof sketches and exercises with folded solutions. The thread running through Part II is Courant’s lifelong method: turn a problem of physics into a problem of minimizing an energy, then use the minimization both to prove existence and to compute.

Reference

Timeline

1888Born 8 January in Lublinitz, Upper Silesia (now Lubliniec, Poland), eldest son of Siegmund Courant and Martha Freund.
1905Leaves the König-Wilhelm Gymnasium in Breslau; passes the university entrance examination in 1906.
1907A semester in Zurich; arrives in Göttingen on 1 November.
1908Becomes assistant to David Hilbert.
1910Doctorate under Hilbert on Dirichlet’s principle and conformal mapping.
1912Habilitation at Göttingen. Marries Nelly Neumann.
1914–18Military service; wounded on 27 September 1915. Develops an earth telegraph for the front.
1919Marries Nerina (Nina) Runge, daughter of Carl Runge, on 22 January.
1920Brief professorship at Münster; returns to Göttingen to succeed Erich Hecke. Paper on the eigenvalues of the equations of mathematical physics.
1922Hurwitz–Courant, Funktionentheorie.
1924Courant–Hilbert, Methoden der mathematischen Physik, volume I.
1928Courant, Friedrichs and Lewy on difference equations: the CFL condition.
1929The new Mathematical Institute at Göttingen, funded by the Rockefeller Foundation, is dedicated on 2 December.
1933Placed on leave under the civil-service law. Moves to Cambridge for a year.
1934Begins teaching at New York University; professor and head of the graduate mathematics department from 1936.
1937Volume II of Methoden der mathematischen Physik.
1940US citizenship.
1941What is Mathematics?, with Herbert Robbins.
1943Variational methods paper: piecewise linear approximation on triangles, a forerunner of finite elements.
1948Supersonic Flow and Shock Waves, with Kurt Friedrichs.
1950Dirichlet’s Principle, Conformal Mapping, and Minimal Surfaces.
1955Elected to the US National Academy of Sciences.
1958Retires as director of the NYU institute. Navy Distinguished Public Service Award.
1964The institute is named the Courant Institute of Mathematical Sciences.
1965Distinguished Service Award of the Mathematical Association of America.
1972Dies 27 January in New Rochelle, New York, after a stroke, aged 84.
Part I · Formation
Lesson 01

Silesia and Breslau, 1888–1907

Richard Courant was born on 8 January 1888 in Lublinitz, a small town in Upper Silesia, then part of Prussia. He was the eldest son of Siegmund Courant, a Jewish businessman, and Martha Freund. The family moved to Glatz and then, when Richard was nine, to Breslau (now Wrocław). The philosopher Edith Stein was his cousin through his mother’s family.

His father’s businesses failed more than once, and the family’s money was never secure. When the family moved to Berlin in 1905, Richard stayed behind in Breslau, supporting himself by tutoring. He left the König-Wilhelm Gymnasium early, passed the university entrance examination in 1906 as an external candidate, and studied at the University of Breslau.

Breslau was a good school in mathematics, but its best young men were already looking to Göttingen. Otto Toeplitz and Ernst Hellinger, both from Breslau, had gone there to work with David Hilbert. After a semester in Zurich in 1907, Courant followed them. He arrived in Göttingen on 1 November 1907.

Lesson 02

Hilbert’s Göttingen, 1907–1914

Göttingen in 1907 was the centre of the mathematical world. Felix Klein ran its institutions, Hilbert set its research agenda, and Hermann Minkowski was about to give space-time its geometry. Courant found his way quickly. In 1908 he became Hilbert’s assistant, preparing lecture notes and working closely with him on analysis.

Hilbert had just rescued Dirichlet’s principle, the idea of finding a harmonic function by minimizing an energy, from the objections of Karl Weierstrass (Lesson 04). Courant’s dissertation of 1910, Über die Anwendung des Dirichletschen Prinzipes auf die Probleme der konformen Abbildung, used the rehabilitated principle to prove existence theorems for conformal maps. The method of the thesis, existence through minimization, guided his work for the next sixty years.

He completed his habilitation in 1912, with an inaugural lecture on existence proofs in mathematics on 23 February. In the summer of that year he married Nelly Neumann, a mathematician from Breslau. Among the young Göttingen mathematicians and physicists of these years were Hermann Weyl and Max Born, his friend from Breslau.

Lesson 03

War, Münster and return, 1914–1920

When war broke out in 1914 Courant was drafted into the infantry. He served on the Western Front, fell ill with typhoid, and was seriously wounded on 27 September 1915. Back in uniform after his recovery, he turned his skills to technology. With colleagues he developed an earth telegraph, a device that sent signals through the ground between trenches, where wires were constantly cut by shelling. The project taught him to work with industry and the army, and to raise money, skills he used for the rest of his life.

His first marriage ended in divorce in 1916. Nelly Neumann was murdered by the Nazis in 1942. On 22 January 1919 Courant married Nerina (Nina) Runge, daughter of the Göttingen applied mathematician Carl Runge. They had four children: Ernest, who became a particle physicist; Gertrude, a biologist, who married the mathematician Jürgen Moser; Hans, a physicist; and Leonore (Lori), a violist, whose second husband was the mathematician Peter Lax.

In 1920 Courant accepted a chair at Münster. He stayed only a few months. When Erich Hecke left Göttingen for Hamburg, Klein and Hilbert brought Courant back to succeed him. In the same year he published a paper on the eigenvalues of the differential equations of mathematical physics, which contains the minimax principle of Lesson 05.

Part II · The mathematics
Lesson 04

Dirichlet’s principle and conformal mapping

For the general reader. A soap film stretched on a wire frame settles into the shape with the least energy. Bernhard Riemann used the same idea to find solutions of the equations of electrostatics: among all candidate functions, take the one with the least energy. Weierstrass showed that a least-energy function need not exist. Hilbert repaired the argument, and Courant made it a working tool, starting with his thesis on conformal maps.

Goals
  • State Dirichlet’s principle and see why minimizers are harmonic.
  • Understand Weierstrass’s objection and how it is overcome.
  • See how the principle proves the Riemann mapping theorem.

The principle

Let \(\Omega\subset\mathbb R^2\) be a bounded domain and \(g\) a function on \(\partial\Omega\). The Dirichlet integral is

\[ D[u]=\iint_\Omega |\nabla u|^2\,dx\,dy . \]
Dirichlet’s principle (Hilbert 1900; modern form)

Let \(\Omega\) be a bounded domain and let \(g\in H^1(\Omega)\). Among all \(u\in H^1(\Omega)\) with \(u-g\in H^1_0(\Omega)\), there is exactly one minimizer of \(D\), and it is the weak solution of \(\Delta u=0\) in \(\Omega\) with boundary values \(g\). It is smooth and harmonic in the interior.

Why the minimizer is harmonic. If \(u\) minimizes and \(\varphi\) vanishes on the boundary, then \(t\mapsto D[u+t\varphi]\) has a minimum at \(t=0\), so

\[ 0=\frac{d}{dt}\Big|_{t=0}D[u+t\varphi]=2\iint_\Omega\nabla u\cdot\nabla\varphi=-2\iint_\Omega\varphi\,\Delta u \]

for all such \(\varphi\), hence \(\Delta u=0\). Why a minimizer exists. Take a minimizing sequence \(u_n\). The parallelogram law gives

\[ D\Big[\frac{u_n-u_m}{2}\Big]=\frac12D[u_n]+\frac12D[u_m]-D\Big[\frac{u_n+u_m}{2}\Big]\le\frac12D[u_n]+\frac12D[u_m]-d, \]

where \(d\) is the infimum, so \((u_n)\) is Cauchy for the energy norm. Completeness of \(H^1_0\), which Riemann did not have, supplies the limit. Hilbert’s 1900 rescue used a direct compactness argument; the Hilbert-space proof above is the later form that Courant’s school made standard.

Weierstrass’s objection

In 1870 Weierstrass pointed out that a positive functional need not attain its infimum. His example is a one-dimensional variational problem whose infimum is 0 but is approached only by functions that converge to a discontinuous limit (Exercise 4.1). Riemann had assumed that a minimizer exists because the energy is bounded below. Making existence rigorous required both the right function space and lower semicontinuity of the energy.

Conformal mapping

For a simply connected domain \(\Omega\) with a smooth boundary and a point \(z_0\in\Omega\), let \(u\) be harmonic in \(\Omega\) with \(u(z)=\log|z-z_0|\) on \(\partial\Omega\). Then \(G(z)=\log|z-z_0|-u(z)\) vanishes on \(\partial\Omega\), is harmonic except for a logarithmic pole at \(z_0\), and is negative inside. With \(\tilde u\) a harmonic conjugate of \(u\), the function

\[ f(z)=(z-z_0)\,e^{-u(z)-i\tilde u(z)},\qquad |f(z)|=e^{G(z)}, \]

is single-valued, holomorphic, vanishes only at \(z_0\) and has \(|f|=1\) on \(\partial\Omega\). An argument-principle count shows that \(f\) maps \(\Omega\) one-to-one onto the unit disc. This is the Riemann mapping theorem, obtained from one application of Dirichlet’s principle. Courant’s thesis extended such arguments to multiply connected domains and to mappings onto canonical slit domains, and his 1950 book collected the theory.

Exercise 4.1Weierstrass’s example. Minimize \(J[y]=\int_{-1}^{1}x^2\,y'(x)^2\,dx\) over smooth \(y\) with \(y(-1)=-1\), \(y(1)=1\). Show that \(\inf J=0\) and that it is not attained.

Show solution
Let \(y_\varepsilon(x)=\arctan(x/\varepsilon)/\arctan(1/\varepsilon)\). Then \(y_\varepsilon'=\frac{\varepsilon}{(\varepsilon^2+x^2)\arctan(1/\varepsilon)}\), and \(x^2y_\varepsilon'^2\le\frac{\varepsilon^2}{(\varepsilon^2+x^2)\arctan^2(1/\varepsilon)}\), whose integral is at most \(\frac{\pi\varepsilon}{\arctan^2(1/\varepsilon)}\to0\). If \(J[y]=0\) then \(y'=0\) for \(x\ne0\), so \(y\) is constant on each side and cannot be smooth with \(y(-1)=-1\), \(y(1)=1\). The minimizing sequence converges to the sign function.

Exercise 4.2On the unit disc, let \(u=r^n\cos n\theta\). Compute \(D[u]\) and show that the harmonic extension of \(g(\theta)=\sum_n a_n\cos n\theta\) has \(D[u]=\pi\sum_n n\,a_n^2\). Deduce that some continuous boundary data have no harmonic extension of finite energy.

Show solution
\(|\nabla u|^2=u_r^2+r^{-2}u_\theta^2=n^2r^{2n-2}(\cos^2n\theta+\sin^2n\theta)=n^2r^{2n-2}\). So \(D=\int_0^{2\pi}\!\int_0^1n^2r^{2n-1}dr\,d\theta=\pi n\). The functions \(r^n\cos n\theta\) have orthogonal gradients for different \(n\), so \(D[\sum a_nr^n\cos n\theta]=\pi\sum na_n^2\). Hadamard’s example takes \(a_n=k^{-2}\) when \(n=k^4\) and \(a_n=0\) otherwise. Then \(\sum|a_n|<\infty\), so \(g\) is continuous, but \(\sum na_n^2=\sum_k k^4\cdot k^{-4}=\infty\). Continuous boundary values can have infinite Dirichlet energy, a second obstacle Riemann did not see.
Lesson 05

Eigenvalues: the minimax principle

For the general reader. A drum can sound many notes, and each note corresponds to a shape of vibration. The notes are the eigenvalues of the Laplacian on the drumhead. Courant showed in 1920 that each note can be found as the answer to a game of minimizing and maximizing energy. The characterization makes it easy to compare drums: shrink the drum and every note rises.

Goals
  • State the Courant–Fischer minimax principle for matrices and for the Dirichlet Laplacian.
  • Derive domain monotonicity and comparison theorems.
  • See how Courant used the principle to prove Weyl’s law.

Matrices

Let \(A\) be a real symmetric \(n\times n\) matrix with eigenvalues \(\lambda_1\le\cdots\le\lambda_n\), and let \(R(x)=\frac{x^\mathsf TAx}{x^\mathsf Tx}\) be its Rayleigh quotient.

Theorem (Fischer 1905, Courant 1920) \[ \lambda_k=\min_{\dim V=k}\ \max_{x\in V\setminus0}R(x)=\max_{\dim W=k-1}\ \min_{x\perp W,\,x\ne0}R(x). \]

Proof of the first equality. Let \(e_1,\dots,e_n\) be orthonormal eigenvectors. For \(V=\mathrm{span}(e_1,\dots,e_k)\), \(\max_VR=\lambda_k\). Conversely, any \(k\)-dimensional \(V\) meets the \((n-k+1)\)-dimensional span of \(e_k,\dots,e_n\) in a nonzero vector \(x\), and \(R(x)\ge\lambda_k\). The second equality is proved the same way. Courant’s form, the max–min, is useful because it does not require knowing the earlier eigenvectors.

The Dirichlet Laplacian

For a bounded domain \(\Omega\subset\mathbb R^d\), the problem \(-\Delta u=\lambda u\) in \(\Omega\), \(u=0\) on \(\partial\Omega\), has eigenvalues \(0<\lambda_1<\lambda_2\le\lambda_3\le\cdots\to\infty\).

Courant’s minimax principle \[ \lambda_k(\Omega)=\min_{\substack{V\subset H^1_0(\Omega)\\ \dim V=k}}\ \max_{u\in V\setminus0}\ \frac{\int_\Omega|\nabla u|^2}{\int_\Omega u^2}. \]
Corollary (domain monotonicity)

If \(\Omega_1\subset\Omega_2\), then \(\lambda_k(\Omega_1)\ge\lambda_k(\Omega_2)\) for every \(k\).

Extending by zero embeds \(H^1_0(\Omega_1)\) in \(H^1_0(\Omega_2)\), so the minimum for \(\Omega_2\) is taken over a larger family. The Neumann eigenvalues \(\mu_k\) have the same characterization over \(H^1(\Omega)\), which gives \(\mu_k\le\lambda_k\).

Weyl’s law by bracketing

Hermann Weyl proved in 1911 that the counting function \(N(\lambda)=\#\{k:\lambda_k\le\lambda\}\) satisfies

\[ N(\lambda)\sim\frac{\omega_d\,|\Omega|}{(2\pi)^d}\,\lambda^{d/2}\qquad(\lambda\to\infty), \]

where \(\omega_d\) is the volume of the unit ball; for \(d=2\), \(N(\lambda)\sim\frac{|\Omega|}{4\pi}\lambda\). Courant gave a flexible proof by Dirichlet–Neumann bracketing. Cover \(\Omega\) by small squares. Imposing extra Dirichlet conditions on the inner edges raises eigenvalues, and replacing them by Neumann conditions lowers them, by the minimax principle. For squares the eigenvalues are explicit, and the two bounds agree to leading order as the squares shrink.

Exercise 5.1Find the Dirichlet eigenvalues of the square \((0,\pi)^2\), list the first six with multiplicity, and check Weyl’s law roughly at \(\lambda=50\).

Show solution
Eigenfunctions \(\sin mx\sin ny\), eigenvalues \(m^2+n^2\), \(m,n\ge1\): \(2,5,5,8,10,10\). \(N(50)\) counts lattice points with \(m,n\ge1\), \(m^2+n^2\le50\). For \(m=1,\dots,7\) there are \(7,6,6,5,5,3,1\) values of \(n\), so \(N(50)=33\). Weyl predicts \(\frac{\pi^2}{4\pi}\cdot50\approx39\). The difference is the boundary correction \(-\frac{|\partial\Omega|}{4\pi}\sqrt\lambda\approx-\frac{4\pi}{4\pi}\sqrt{50}\approx-7\), giving about 32, close to the true count.

Exercise 5.2Use the minimax principle with a single test function to show that the unit disc has \(\lambda_1\le 6\).

Show solution
Take \(u=1-r^2\). Then \(\int|\nabla u|^2=\int_0^1(2r)^2\,2\pi r\,dr=2\pi\), and \(\int u^2=2\pi\int_0^1(1-r^2)^2r\,dr=2\pi\cdot\frac16\). The quotient is 6. The exact value is \(j_{0,1}^2\approx5.783\).

Exercise 5.3Show that if \(A\le B\) (meaning \(B-A\) is positive semidefinite) then \(\lambda_k(A)\le\lambda_k(B)\) for all \(k\).

Show solution
\(R_A(x)\le R_B(x)\) for every \(x\), so for each \(V\), \(\max_VR_A\le\max_VR_B\). Minimizing over \(V\) preserves the inequality.
Lesson 06

Nodal domains

For the general reader. Sprinkle sand on a vibrating plate and it collects along lines that do not move. These nodal lines cut the plate into regions. Courant proved in 1923 that the \(k\)-th mode of vibration cuts the plate into at most \(k\) regions. Higher notes can have finer patterns, but never more pieces than their rank allows.

Goals
  • State and prove Courant’s nodal domain theorem.
  • See the one-dimensional case, Sturm’s theorem.
  • Learn that the first eigenfunction does not change sign.

Let \(u_k\) be an eigenfunction for \(\lambda_k\) on a bounded connected domain \(\Omega\). A nodal domain of \(u_k\) is a connected component of \(\{x\in\Omega:u_k(x)\ne0\}\).

Courant’s nodal domain theorem (1923)

Any eigenfunction belonging to \(\lambda_k\) has at most \(k\) nodal domains.

Proof sketch. Suppose \(u=u_k\) had nodal domains \(D_1,\dots,D_m\) with \(m\ge k+1\). Let \(\varphi_j=u\) on \(D_j\) and 0 elsewhere. Each \(\varphi_j\in H^1_0(\Omega)\), and integrating by parts on \(D_j\) gives \(\int|\nabla\varphi_j|^2=\lambda_k\int\varphi_j^2\). The \(\varphi_j\) have disjoint supports. Take a nonzero combination \(\varphi=\sum_{j=1}^kc_j\varphi_j\) orthogonal to \(u_1,\dots,u_{k-1}\); it exists because there are \(k\) coefficients and \(k-1\) conditions. Then the Rayleigh quotient of \(\varphi\) equals \(\lambda_k\), and by the variational characterization \(\varphi\) is itself an eigenfunction for \(\lambda_k\). But \(\varphi\) vanishes on the open set \(D_{k+1}\), contradicting the unique continuation property of solutions of \(\Delta\varphi+\lambda_k\varphi=0\).

Corollary

The first Dirichlet eigenfunction does not change sign, and \(\lambda_1\) is simple. Every other eigenfunction changes sign.

In one dimension, Sturm’s oscillation theorem of 1836 says more: the \(k\)-th eigenfunction of a regular Sturm–Liouville problem has exactly \(k-1\) interior zeros, so exactly \(k\) nodal domains. In higher dimensions equality fails for most \(k\). Åke Pleijel showed in 1956 that equality holds for only finitely many \(k\).

Exercise 6.1On the square \((0,\pi)^2\), the eigenvalue 5 is double, with eigenfunctions \(\sin x\sin2y\), \(\sin2x\sin y\). Show that \(\sin x\sin2y+\sin2x\sin y\) has exactly 2 nodal domains, consistent with \(k=2\).

Show solution
\(\sin x\sin2y+\sin2x\sin y=2\sin x\sin y(\cos y+\cos x)\). In the open square \(\sin x\sin y>0\), so the nodal set is \(\cos x+\cos y=0\), i.e. \(x+y=\pi\): the anti-diagonal. It cuts the square into two triangles. Both eigenfunctions belong to \(\lambda_2=\lambda_3=5\), and the bound \(k=2\) holds.

Exercise 6.2On \((0,\pi)^2\), how many nodal domains does \(\sin3x\sin3y\) have, and what is the smallest index \(k\) with \(\lambda_k=18\)? Does Courant’s bound hold?

Show solution
The nodal lines \(x=\pi/3,2\pi/3\) and \(y=\pi/3,2\pi/3\) cut the square into 9 nodal domains. Eigenvalues below 18 are \(2,5,5,8,10,10,13,13,17,17\): ten of them. So \(\lambda_{11}=18\), and \(9\le11\). The bound holds with room to spare.
Lesson 07

Difference equations and the CFL condition

For the general reader. To solve the equations of physics on a computer, one replaces smooth space and time by a grid. In 1928, nearly two decades before electronic computers, Courant, Kurt Friedrichs and Hans Lewy asked when grid solutions approach the true ones. For waves they found a simple rule: in one time step, the computation must be able to “see” at least as far as the wave can travel. Every weather and climate model obeys it.

Goals
  • State the CFL condition and prove that it is necessary for convergence.
  • Analyse the upwind scheme for the advection equation.
  • See the paper’s other theme: discrete harmonic functions and random walks.

Domains of dependence

Consider \(u_t+a\,u_x=0\) with \(a>0\). The solution is \(u(x,t)=u_0(x-at)\), so \(u(x,t)\) depends only on the initial value at one point \(x-at\). On a grid \(x_j=j\Delta x\), \(t^n=n\Delta t\), an explicit scheme computes \(U_j^{n+1}\) from \(U_{j-p}^n,\dots,U_{j+q}^n\). After \(n\) steps, \(U_j^n\) depends on initial data in \([x_j-pn\Delta x,\ x_j+qn\Delta x]\), the numerical domain of dependence.

Theorem (Courant–Friedrichs–Lewy, 1928)

For an explicit scheme for a hyperbolic equation, refined with \(\Delta t/\Delta x\) fixed, a necessary condition for convergence to the solution for all initial data is that the numerical domain of dependence of each grid point contain the physical domain of dependence. For \(u_t+au_x=0\) with a scheme using \(U_{j-1}^n,U_j^n,U_{j+1}^n\), this is the Courant number condition

\[ \nu=\frac{|a|\,\Delta t}{\Delta x}\le1 . \]

Proof. Suppose the physical point \(x-at\) lies outside the numerical interval. Change the initial data near \(x-at\) only. The true solution at \((x,t)\) changes; the numerical solution does not, for any grid in the refinement. So the numerical solutions cannot converge to the true one for both sets of data.

The upwind scheme

For \(a>0\), \(U_j^{n+1}=U_j^n-\nu\,(U_j^n-U_{j-1}^n)\). If \(0\le\nu\le1\) this is a convex combination \((1-\nu)U_j^n+\nu U_{j-1}^n\), so \(\max_j|U_j^n|\) never grows: the scheme is stable. Consistency plus stability gives convergence, by the Lax equivalence theorem proved at the Courant Institute in 1956. For \(\nu>1\) the CFL condition fails and the scheme diverges.

The elliptic case

The same paper proved that the five-point discrete Laplacian converges to the continuous one for the Dirichlet problem, and linked discrete harmonic functions to random walks: the value at a grid point equals the expected boundary value at the point where a random walk started there first leaves the domain. This is one of the earliest uses of random walks in analysis.

Exercise 7.1Von Neumann analysis. Insert \(U_j^n=G^ne^{ij\theta}\) into the upwind scheme. Show \(|G|^2=1-2\nu(1-\nu)(1-\cos\theta)\) and deduce stability exactly for \(0\le\nu\le1\).

Show solution
\(G=1-\nu+\nu e^{-i\theta}\). Then \(|G|^2=(1-\nu+\nu\cos\theta)^2+\nu^2\sin^2\theta=(1-\nu)^2+2\nu(1-\nu)\cos\theta+\nu^2=1-2\nu(1-\nu)(1-\cos\theta)\). For \(0\le\nu\le1\), \(\nu(1-\nu)\ge0\) and \(|G|\le1\). For \(\nu>1\), \(\nu(1-\nu)<0\) and \(|G|>1\) at \(\theta=\pi\), so high-frequency errors grow.

Exercise 7.2For the wave equation \(u_{tt}=c^2u_{xx}\) with the scheme \(U_j^{n+1}-2U_j^n+U_j^{n-1}=\nu^2(U_{j+1}^n-2U_j^n+U_{j-1}^n)\), \(\nu=c\Delta t/\Delta x\), show that von Neumann stability requires \(\nu\le1\).

Show solution
With \(U_j^n=G^ne^{ij\theta}\): \(G-2+G^{-1}=-4\nu^2\sin^2(\theta/2)\). Set \(s=\nu\sin(\theta/2)\). Then \(G^2-2(1-2s^2)G+1=0\), whose roots have product 1. They are on the unit circle iff \(|1-2s^2|\le1\), i.e. \(s^2\le1\). This holds for all \(\theta\) iff \(\nu\le1\), which is the CFL condition: characteristics \(dx/dt=\pm c\) must stay inside the three-point stencil.

Exercise 7.3A symmetric random walk on the integers \(\{0,1,\dots,N\}\) starts at \(j\) and stops at 0 or \(N\). Show that the probability \(h(j)\) of stopping at \(N\) is discrete harmonic, and find it.

Show solution
Conditioning on the first step gives \(h(j)=\frac12h(j-1)+\frac12h(j+1)\), so \(h(j+1)-2h(j)+h(j-1)=0\), with \(h(0)=0\), \(h(N)=1\). Hence \(h(j)=j/N\), the discrete analogue of a linear harmonic function.
Lesson 08

Variational methods and finite elements

For the general reader. Engineers today compute the stresses in bridges, aircraft and teeth by cutting the object into small triangles or tetrahedra and approximating the solution by simple functions on each piece. In a 1943 lecture Courant proposed exactly this, as a way to compute the minimum of an energy. The idea was rediscovered by engineers in the 1950s and named the finite element method.

Goals
  • Set up the Rayleigh–Ritz method for a model problem.
  • Build the piecewise linear element on a triangulation.
  • Prove that the Galerkin solution is the best approximation in the energy norm.

The setting

The Poisson problem \(-\Delta u=f\) in \(\Omega\), \(u=0\) on \(\partial\Omega\), is the Euler–Lagrange equation of

\[ E[v]=\frac12\int_\Omega|\nabla v|^2-\int_\Omega fv,\qquad v\in H^1_0(\Omega). \]

Walther Ritz (1908) proposed minimizing \(E\) over a finite-dimensional subspace \(V_h\subset H^1_0\). Ritz used global polynomials. Courant’s 1943 paper, written up from his 1941 address to the American Mathematical Society, used the space of continuous functions that are linear on each triangle of a triangulation and vanish on the boundary. Its basis consists of “hat” functions \(\phi_i\), equal to 1 at vertex \(i\) and 0 at all other vertices. He applied it to the torsion problem for a beam.

Writing \(u_h=\sum_iU_i\phi_i\) and minimizing gives the linear system \(KU=F\), with stiffness matrix \(K_{ij}=\int\nabla\phi_i\cdot\nabla\phi_j\) and load vector \(F_i=\int f\phi_i\). Because each hat function overlaps only its neighbours, \(K\) is sparse, symmetric and positive definite.

Theorem (Galerkin orthogonality and best approximation)

Let \(u\) minimize \(E\) on \(H^1_0\) and \(u_h\) minimize it on \(V_h\). Then \(\int\nabla(u-u_h)\cdot\nabla v_h=0\) for all \(v_h\in V_h\), and

\[ \|\nabla(u-u_h)\|_{L^2}=\min_{v_h\in V_h}\|\nabla(u-v_h)\|_{L^2}. \]

Proof. Both minimizers satisfy the weak equation \(\int\nabla w\cdot\nabla v=\int fv\) for test functions in their spaces; subtracting gives orthogonality. Then for any \(v_h\), \(\|\nabla(u-v_h)\|^2=\|\nabla(u-u_h)\|^2+\|\nabla(u_h-v_h)\|^2\) by Pythagoras. So \(u_h\) is the orthogonal projection of \(u\) onto \(V_h\) in the energy inner product. With interpolation estimates for piecewise linear functions this gives an error of order \(h\) in the energy norm for smooth \(u\).

Exercise 8.1For \(-u''=f\) on \((0,1)\), \(u(0)=u(1)=0\), with hat functions on a uniform mesh of width \(h\), compute the stiffness matrix.

Show solution
\(\phi_i'=\pm1/h\) on the two intervals adjacent to \(x_i\). Then \(K_{ii}=2/h\), \(K_{i,i\pm1}=-1/h\), and all other entries vanish: \(K=\frac1h\,\mathrm{tridiag}(-1,2,-1)\). Up to the factor \(h\) this is the classical three-point difference operator, so in one dimension finite elements and finite differences nearly coincide.

Exercise 8.2On the reference triangle with vertices \((0,0),(1,0),(0,1)\), compute the element stiffness matrix of the three linear basis functions.

Show solution
\(\phi_1=1-x-y\), \(\phi_2=x\), \(\phi_3=y\), with gradients \((-1,-1),(1,0),(0,1)\). The area is \(\frac12\), so \(K_{ij}=\frac12\nabla\phi_i\cdot\nabla\phi_j\): \(K=\frac12\begin{pmatrix}2&-1&-1\\-1&1&0\\-1&0&1\end{pmatrix}\). Rows sum to zero because constants have zero energy.
Lesson 09

Supersonic flow and shock waves

For the general reader. A supersonic aircraft or an explosion pushes the air faster than sound can carry warning ahead. Pressure then jumps almost instantly across a thin layer, a shock wave. During the Second World War Courant and Friedrichs wrote the mathematical account of such flows for military research, and published it in 1948 as Supersonic Flow and Shock Waves. It founded the modern theory of hyperbolic conservation laws.

Goals
  • Solve a scalar conservation law by characteristics and find when it breaks.
  • Derive the Rankine–Hugoniot jump condition.
  • Meet Riemann invariants for one-dimensional gas dynamics.

Characteristics and breaking

The simplest model is Burgers’ equation \(u_t+\big(\tfrac12u^2\big)_x=0\), or more generally \(u_t+f(u)_x=0\). Along curves with \(dx/dt=f'(u)\), the solution is constant. These characteristics are straight lines, and if a faster one starts behind a slower one, they cross.

Proposition (breaking time)

For Burgers’ equation with smooth initial data \(u_0\) such that \(\min u_0'<0\), the classical solution exists exactly for \(0\le t<t^*=-1/\min_xu_0'(x)\).

Indeed \(u_x=\dfrac{u_0'(\xi)}{1+t\,u_0'(\xi)}\) along the characteristic from \(\xi\), which blows up when \(1+tu_0'(\xi)=0\).

Weak solutions and jump conditions

Beyond \(t^*\) one admits discontinuous weak solutions, functions satisfying \(\iint(u\varphi_t+f(u)\varphi_x)\,dx\,dt+\int u_0\varphi(x,0)\,dx=0\) for all smooth compactly supported \(\varphi\).

Rankine–Hugoniot condition

A piecewise smooth weak solution with a jump along a curve \(x=s(t)\) must satisfy

\[ s'(t)\,\big(u_+-u_-\big)=f(u_+)-f(u_-). \]

Integrate the equation over \([a,b]\) containing the shock: \(\frac{d}{dt}\int_a^bu\,dx=f(u(a))-f(u(b))\). Splitting at \(s(t)\) and letting \(a,b\to s\) gives \(s'(u_--u_+)=f(u_-)-f(u_+)\). Weak solutions are not unique; the physical one is selected by an entropy condition, which for convex \(f\) says that characteristics enter the shock from both sides: \(f'(u_+)<s'<f'(u_-)\). Courant and Friedrichs set out these principles for gas dynamics, and Peter Lax, a student of Friedrichs and later Courant’s son-in-law, gave the general theory in the 1950s.

Gas dynamics

For one-dimensional isentropic flow of a polytropic gas with velocity \(u\), sound speed \(c\) and adiabatic exponent \(\gamma\), the quantities \(r_\pm=u\pm\frac{2c}{\gamma-1}\) are Riemann invariants: \(r_\pm\) is constant along characteristics \(dx/dt=u\pm c\). This is how Courant and Friedrichs solved piston problems, rarefaction waves and nozzle flows.

Exercise 9.1For Burgers’ equation with \(u_0(x)=-\tanh x\), find \(t^*\).

Show solution
\(u_0'=-\mathrm{sech}^2x\), with minimum \(-1\) at \(x=0\). So \(t^*=1\). The shock forms at \(x=0\), where the slope is steepest.

Exercise 9.2Solve the Riemann problem for Burgers’ equation with \(u_0=1\) for \(x<0\) and \(u_0=0\) for \(x>0\). Then do the case \(u_0=0\) for \(x<0\), \(u_0=1\) for \(x>0\).

Show solution
First case: \(u_-=1>u_+=0\), so characteristics collide and a shock forms with speed \(s'=\frac{\frac12\cdot1-0}{1-0}=\frac12\); the entropy condition \(0<\frac12<1\) holds. Second case: the jump \(0\to1\) would violate the entropy condition. The admissible solution is the rarefaction fan \(u=0\) for \(x<0\), \(u=x/t\) for \(0\le x\le t\), \(u=1\) for \(x>t\).

Exercise 9.3Check the Riemann invariant \(r_+=u+\frac{2c}{\gamma-1}\) for the linearized case: when \(u\) and the density perturbation are small, show it reduces to the familiar statement that right-moving sound waves carry \(u+\frac{c_0}{\rho_0}\rho'\) unchanged.

Show solution
For a polytropic gas \(c^2=\gamma p/\rho\propto\rho^{\gamma-1}\), so \(\frac{dc}{d\rho}=\frac{\gamma-1}{2}\frac{c}{\rho}\). Linearizing about \((0,\rho_0,c_0)\): \(\frac{2}{\gamma-1}c\approx\frac{2c_0}{\gamma-1}+\frac{c_0}{\rho_0}\rho'\). So \(r_+\approx\text{const}+u+\frac{c_0}{\rho_0}\rho'\), constant along \(dx/dt=c_0\): the right-moving solution of the acoustic equations.
Lesson 10

Plateau’s problem and minimal surfaces

For the general reader. Dip a twisted wire loop in soapy water and a film forms, using the least area the wire allows. Proving that such a surface always exists was Plateau’s problem. Jesse Douglas and Tibor Radó solved it around 1930. Courant then showed that Dirichlet’s principle, the tool of his thesis, gives a simpler solution and extends to films of more complicated shape.

Goals
  • See why minimizing the Dirichlet integral is easier than minimizing area.
  • Prove the Courant–Lebesgue lemma.
  • Understand the role of the three-point condition.

From area to energy

Let \(\Gamma\subset\mathbb R^3\) be a Jordan curve. Look for \(x:\bar B\to\mathbb R^3\) on the closed unit disc, mapping \(\partial B\) monotonically onto \(\Gamma\), that minimizes area \(A[x]=\iint|x_u\times x_v|\). Area is invariant under all reparametrizations, which destroys compactness. Douglas and Courant instead minimized the Dirichlet integral \(D[x]=\frac12\iint(|x_u|^2+|x_v|^2)\), which satisfies \(A[x]\le D[x]\) with equality exactly when \(x\) is conformal. A minimizer of \(D\) turns out to be harmonic and conformal, hence a minimal surface.

The key lemma

Courant–Lebesgue lemma

Let \(x\in C^1(B)\cap C^0(\bar B)\) with \(\iint_B|\nabla x|^2\le K\), let \(p\in\bar B\) and \(0<\delta<1\). Then there is \(\rho\in[\delta,\sqrt\delta]\) such that the image under \(x\) of the arc \(C_\rho=\{z\in B:|z-p|=\rho\}\) has length at most \(\sqrt{4\pi K/\log(1/\delta)}\).

Proof. In polar coordinates about \(p\), let \(L(\rho)=\int_{C_\rho}|x_\theta|\,d\theta\). By Cauchy–Schwarz and \(|x_\theta|\le\rho|\nabla x|\), \(L(\rho)^2\le2\pi\rho^2\int_{C_\rho}|\nabla x|^2d\theta\). Divide by \(\rho\) and integrate from \(\delta\) to \(\sqrt\delta\):

\[ \min_{\rho}L(\rho)^2\cdot\tfrac12\log\tfrac1\delta\le\int_\delta^{\sqrt\delta}\frac{L(\rho)^2}{\rho}\,d\rho\le2\pi\iint_B|\nabla x|^2\le2\pi K . \]

The lemma gives equicontinuity of the boundary values of a minimizing sequence, once three points of \(\partial B\) are fixed to map to three chosen points of \(\Gamma\). The three-point condition removes the noncompact group of conformal automorphisms of the disc. With equicontinuity, the Arzelà–Ascoli theorem produces a convergent subsequence and a minimizer. Courant extended the method to surfaces of higher genus and to free boundary problems, and presented the theory in his 1950 book.

Exercise 10.1Show that \(|x_u\times x_v|\le\frac12(|x_u|^2+|x_v|^2)\), with equality iff \(|x_u|=|x_v|\) and \(x_u\cdot x_v=0\).

Show solution
\(|x_u\times x_v|\le|x_u||x_v|\le\frac12(|x_u|^2+|x_v|^2)\) by the AM–GM inequality. Equality in the first step needs \(x_u\perp x_v\), in the second \(|x_u|=|x_v|\). These are the conformality relations.

Exercise 10.2Show that the Dirichlet integral is invariant under conformal automorphisms of the disc, and explain why a minimizing sequence without the three-point condition can lose compactness.

Show solution
For a conformal map \(\phi\), \(|\nabla(x\circ\phi)|^2=|\phi'|^2\,|\nabla x|^2\circ\phi\), and the area element changes by \(|\phi'|^{-2}\), so \(D[x\circ\phi]=D[x]\). The Möbius maps \(\phi_a(z)=\frac{z-a}{1-\bar az}\) with \(|a|\to1\) push almost all of the disc toward one boundary point. Composing a fixed surface with them gives a sequence with constant energy whose boundary parametrizations concentrate, with no convergent subsequence. Fixing three boundary points eliminates this freedom.
Part III · Life and legacy
Lesson 11

The Göttingen institute and 1933

Back in Göttingen from 1920, Courant combined research with a talent for organization that his colleagues found remarkable. He edited Springer’s yellow series of monographs, the Grundlehren der mathematischen Wissenschaften, which he had helped launch, and wrote books that became classics. In 1922 he completed Adolf Hurwitz’s lectures on function theory as Hurwitz–Courant. In 1924 he published volume I of Methoden der mathematischen Physik, which carries Hilbert’s name as co-author because it drew on Hilbert’s lectures, but which Courant wrote. Its account of eigenvalue problems, published just before quantum mechanics, became a handbook for the physicists who created it. His calculus lectures appeared in 1927–29.

His students in Göttingen included Kurt Friedrichs, Hans Lewy, Franz Rellich, Herbert Busemann, Otto Neugebauer, Fritz John and Edgar Krahn. Courant’s greatest project was a home for the mathematical sciences. Göttingen’s mathematicians were scattered among rented rooms. With Klein’s backing and funding from the Rockefeller Foundation’s International Education Board, a new Mathematical Institute was built in 1927–29 and dedicated on 2 December 1929. Courant directed it.

1933

Within weeks of the Nazi seizure of power, the civil-service law of 7 April 1933 removed Jewish officials and political opponents. Courant had served at the front, which in principle protected him, but he had been active on the social-democratic left. On 5 May 1933 he was notified that he was placed on leave. Colleagues collected signatures on his behalf, without effect. In the same months Emmy Noether, Weyl, Bernays and many others were driven out, and the Göttingen school was destroyed in a few months. Courant accepted an invitation to Cambridge for the academic year 1933–34, and in 1935 he was formally retired from Göttingen.

DiscussionCourant was sometimes criticized as more an organizer than a mathematician. Compare the long-term influence of his institutions with that of his theorems. Is it meaningful to separate them?

Lesson 12

New York, death and legacy, 1934–1972

In 1934 Courant accepted a two-year position at New York University, which had almost no research mathematics. In 1936 he became professor and head of the graduate department. He brought Friedrichs from Germany, and later Fritz John and James Stoker, and built a group devoted to analysis and its applications. He became a US citizen in 1940. With Herbert Robbins he wrote What is Mathematics? (1941), which introduced generations of readers to number theory, geometry, topology and calculus. In 1937 the second volume of Methoden appeared.

During the Second World War Courant served on the Applied Mathematics Panel of the Office of Scientific Research and Development, and his group worked on shock waves, underwater explosions and gas dynamics. The postwar result was Supersonic Flow and Shock Waves (1948), and a new institute. NYU created its Institute of Mathematical Sciences in the early 1950s with Courant as director, and the Atomic Energy Commission placed a computing centre with a UNIVAC there. Courant retired as director in 1958. In 1964 the institute was renamed the Courant Institute of Mathematical Sciences, and in 1965 it moved into Warren Weaver Hall.

His honours included election to the American Philosophical Society (1953) and the National Academy of Sciences (1955), the Navy Distinguished Public Service Award (1958), the Grand Cross of Merit with Star of the Federal Republic of Germany (1959) and the Distinguished Service Award of the Mathematical Association of America (1965). In 1965 he also published, with Fritz John, the revised Introduction to Calculus and Analysis. He suffered a stroke on 19 November 1971 and died in New Rochelle, New York, on 27 January 1972, aged 84.

Legacy

  • Analysis: the minimax principle, the nodal domain theorem, the Courant–Lebesgue lemma and the direct method of the calculus of variations are standard tools of spectral theory and geometric analysis.
  • Computation: the CFL condition and the piecewise linear elements of 1943 are at the root of numerical methods for partial differential equations.
  • Books: Courant–Hilbert, Courant–Friedrichs and Courant–Robbins remain in print.
  • Institutions: the Göttingen Mathematical Institute and the Courant Institute, whose members have included Friedrichs, John, Stoker, Lax, Moser, Louis Nirenberg and S. R. S. Varadhan.
  • Students: his doctoral students included Kurt Friedrichs, Hans Lewy, Franz Rellich, Herbert Busemann, William Feller, Otto Neugebauer, Fritz John, Harold Grad, Joseph Keller, Martin Kruskal and Anneli Lax.

Final projectChoose one result from Part II. Write a two-page account for a strong undergraduate that states it, works one example in full, and shows how the same result serves both to prove existence and to compute an approximate solution.

Reference

Sources and further reading

Biography

  1. J. J. O’Connor and E. F. Robertson, Richard Courant, MacTutor History of Mathematics.
  2. Richard Courant, Wikipedia.
  3. Courant, Richard, Neue Deutsche Biographie / Deutsche Biographie.
  4. New York University Archives, Richard Courant Papers, biographical note.
  5. C. Reid, Courant in Göttingen and New York: The Story of an Improbable Mathematician, Springer, 1976.
  6. P. D. Lax, Richard Courant, Biographical Memoirs of the National Academy of Sciences.

Mathematics

  1. R. Courant, Über die Anwendung des Dirichletschen Prinzipes auf die Probleme der konformen Abbildung, dissertation, Göttingen, 1910.
  2. R. Courant, Über die Eigenwerte bei den Differentialgleichungen der mathematischen Physik, Math. Z. 7 (1920).
  3. R. Courant and D. Hilbert, Methoden der mathematischen Physik, 2 vols., Springer, 1924 and 1937; English edition Methods of Mathematical Physics, Interscience.
  4. R. Courant, K. Friedrichs and H. Lewy, Über die partiellen Differenzengleichungen der mathematischen Physik, Math. Ann. 100 (1928) 32–74; English translation IBM J. Res. Dev. 11 (1967) 215–234.
  5. R. Courant, Variational methods for the solution of problems of equilibrium and vibrations, Bull. Amer. Math. Soc. 49 (1943) 1–23.
  6. R. Courant and H. Robbins, What is Mathematics?, Oxford University Press, 1941.
  7. R. Courant and K. O. Friedrichs, Supersonic Flow and Shock Waves, Interscience, 1948.
  8. R. Courant, Dirichlet’s Principle, Conformal Mapping, and Minimal Surfaces, Interscience, 1950.
  9. P. D. Lax, Hyperbolic Systems of Conservation Laws and the Mathematical Theory of Shock Waves, SIAM, 1973.