courseshub.world · Lives in Mathematics and Physics

Aleksandr Lyapunov

Александр Михайлович Ляпунов · Aleksandr Mikhailovich Lyapunov

A course in two strands: the life of Chebyshev’s most rigorous student, from Yaroslavl to Kharkov, St Petersburg and Odessa, and the mathematics he left behind: stability of motion, Lyapunov functions, the central limit theorem and the shapes of rotating fluid planets.

Born 6 June 1857, Yaroslavl Died 3 November 1918, Odessa Doctorate Moscow, 1892: The general problem of the stability of motion Level advanced undergraduate → graduate
A damped oscillator \(\ddot x+0.3\,\dot x+x=0\) in the phase plane. The trajectory crosses every level curve of a quadratic Lyapunov function inward, which proves stability without solving the equation.
Lesson 00

How to use this course

Every engineer who designs a control loop, every physicist who asks whether an orbit will last, and every statistician who quotes a normal approximation uses something Aleksandr Lyapunov proved. His name is on stability, on functions that certify it, on exponents that measure chaos, and on a version of the central limit theorem. He published little and slowly, wrote with a rigour unusual for his time, and spent the last third of his life on one hard problem in celestial mechanics.

Prerequisites for Part II
  • Linear algebra, including eigenvalues, the matrix exponential and positive definite matrices.
  • Ordinary differential equations: existence, uniqueness, phase portraits.
  • For Lesson 08, vector calculus and the Laplace equation.
  • For Lesson 09, probability at the level of independent random variables and characteristic functions.
  • For Lessons 04 and 10, Newtonian gravitation; some classical mechanics helps.

Each technical lesson opens with a paragraph for the general reader, then gives precise statements, proof sketches and exercises with folded solutions. The order follows his career: rotating fluids (1882–1885), stability of motion (1888–1902), potential theory (1886–1898), probability (1900–1901), and the figures of equilibrium (1903–1918). Dates before February 1918 were recorded in Russia in the Julian calendar; this course uses the modern calendar unless stated.

Reference

Timeline

1857Born 6 June (25 May Old Style) in Yaroslavl, son of the astronomer Mikhail Vasilievich Lyapunov.
1868Death of his father. His uncle R. M. Sechenov takes charge of his education.
1870His mother moves the family to Nizhny Novgorod.
1876Graduates from the Nizhny Novgorod gymnasium; enters St Petersburg University.
1880Graduates; gold medal for an essay on hydrostatics. Stays at the university to prepare for a professorship.
1882Chebyshev asks him whether figures of equilibrium other than ellipsoids branch off the ellipsoids of a rotating fluid.
1884–85Master’s thesis on the stability of ellipsoidal forms of a rotating liquid, defended in 1885.
1885Autumn: Privatdozent in mechanics at Kharkov University.
1886Marries his cousin Natalia Rafailovna Sechenova.
1888First papers on the stability of mechanical systems.
1891–98Vice-president of the Kharkov Mathematical Society.
1892The general problem of the stability of motion, published at Kharkov and defended as his doctorate at Moscow University.
1893Ordinary professor at Kharkov.
1897–98Papers on the double-layer potential and the Dirichlet problem.
1899–1902President of the Kharkov Mathematical Society and editor of its Communications.
1900–01Two memoirs proving the central limit theorem by characteristic functions.
1901Elected associate member, then ordinary academician in applied mathematics, of the St Petersburg Academy of Sciences, in the chair vacant since Chebyshev’s death.
1902Moves to St Petersburg and devotes himself to research.
1903–14Memoirs on figures of equilibrium of rotating fluids, including four parts on figures close to ellipsoids (1906–1914).
1908Attends the International Congress of Mathematicians in Rome. Editor of volumes of Euler’s Opera omnia.
1909Foreign member of the Accademia dei Lincei.
1916Elected to the Paris Academy of Sciences.
1917Summer: moves to Odessa for his wife’s health; lectures at the university. James Jeans confirms his result on the pear-shaped figures.
191831 October: his wife dies and he shoots himself. Dies 3 November in Odessa, aged 61.
Part I · Formation
Lesson 01

Yaroslavl and Nizhny Novgorod, 1857–1876

Aleksandr Mikhailovich Lyapunov was born in Yaroslavl on 6 June 1857. His father, Mikhail Vasilievich Lyapunov, was an astronomer who had worked at Kazan University and then directed the Demidov Lyceum in Yaroslavl. His mother was Sofia Aleksandrovna Shilipova. The family was gifted: his younger brother Sergei became a composer and pianist, and another brother, Boris, became a specialist in Slavic languages and a member of the Soviet Academy of Sciences.

Aleksandr was taught at home by his father, who died in 1868. His education then passed to an uncle, R. M. Sechenov, a brother of the physiologist Ivan Sechenov. The uncle’s daughter, Natalia Rafailovna, would become Lyapunov’s wife in 1886.

In 1870 his mother moved the family to Nizhny Novgorod, where Aleksandr entered the gymnasium. He graduated with distinction in 1876. The schooling was classical and heavy on languages, but by the end he had chosen mathematics and the natural sciences.

Lesson 02

St Petersburg and Chebyshev, 1876–1885

In 1876 Lyapunov entered the Faculty of Physics and Mathematics at St Petersburg University. He began in the natural sciences and moved to mathematics within a month. The faculty was dominated by Pafnuty Chebyshev, whose lectures combined concrete problems with strict demands on proof. Andrey Markov, a year older, was also studying under Chebyshev; the two became Chebyshev’s best-known pupils and, much later, colleagues in the Academy.

Lyapunov graduated in 1880 and received a gold medal for an essay on hydrostatics. On the recommendation of the mechanician D. K. Bobylev he stayed at the university to prepare for a professorship, and in 1881 he published two papers on the equilibrium of heavy bodies in fluids.

Chebyshev’s question

In 1882 Chebyshev gave him a problem. A homogeneous fluid mass rotating as a rigid body can take the form of a Maclaurin spheroid or, at higher angular momentum, a Jacobi ellipsoid. Do other figures of equilibrium branch off these ellipsoids as the angular velocity changes? Lyapunov could not answer it then. He took up an easier question that turned out to be just as deep: are the ellipsoids stable? His master’s thesis, On the stability of ellipsoidal forms of equilibrium of a rotating liquid, was completed in 1884 and defended at St Petersburg in 1885. Henri Poincaré, working independently, published his own famous memoir on the same figures in 1885. Lyapunov returned to Chebyshev’s original question twenty years later (Lesson 10).

Lesson 03

Kharkov, 1885–1902

In the autumn of 1885 Lyapunov became Privatdozent in mechanics at Kharkov University. Teaching took most of his time at first. He prepared his own lecture courses in mechanics. Over the following seventeen years Kharkov became the place where he did nearly all the work for which he is known today.

From 1888 he published papers on the stability of mechanical systems with finitely many degrees of freedom. They culminated in the 1892 monograph The general problem of the stability of motion, issued by the Kharkov Mathematical Society and defended that year as his doctoral dissertation at Moscow University, with the aerodynamicist Nikolai Zhukovsky among the examiners. In 1893 he became ordinary professor.

He was vice-president of the Kharkov Mathematical Society from 1891 to 1898, and from 1899 its president and the editor of its Communications. His students at Kharkov included Vladimir Steklov, who extended his potential theory and later became an academician, and Nikolai Saltykov, later a professor in Belgrade. In the late 1890s he turned to the Dirichlet problem, and around 1900 his lectures on probability led to his proof of the central limit theorem.

In 1901 the St Petersburg Academy of Sciences elected him an associate member early in the year and, at the end of it, an ordinary academician in applied mathematics. The chair had stood empty since Chebyshev’s death in 1894. Lyapunov left Kharkov for the capital in 1902.

Part II · The mathematics
Lesson 04

Rotating fluids and the ellipsoids

For the general reader. A spinning ball of liquid held together by its own gravity flattens at the poles, the way the Earth does. Spin it faster and it flattens more, until at some point a lopsided, three-axis shape becomes possible. Lyapunov’s first research asked which of these shapes a real fluid planet could actually keep.

Goals
  • Derive the Maclaurin relation between angular velocity and eccentricity.
  • Locate the Jacobi bifurcation and the maximum rotation rate.
  • Understand the energy criterion for stability that Lyapunov made rigorous.

The Maclaurin spheroids

Consider a homogeneous incompressible fluid of density \(\rho\) rotating rigidly with angular velocity \(\Omega\). In the rotating frame, equilibrium requires the free surface to be a level set of the sum of the gravitational potential and the centrifugal potential \(-\tfrac12\Omega^2(x^2+y^2)\). Colin Maclaurin showed in 1742 that oblate spheroids of eccentricity \(e\) are figures of equilibrium.

Theorem (Maclaurin)

An oblate spheroid of eccentricity \(e\in(0,1)\) is a figure of equilibrium for a homogeneous fluid rotating with angular velocity \(\Omega\) if and only if

\[ \frac{\Omega^2}{\pi G\rho} \;=\; \frac{2\sqrt{1-e^2}}{e^3}\,(3-2e^2)\arcsin e \;-\; \frac{6(1-e^2)}{e^2}. \]

The right side rises from 0 at \(e=0\) to a maximum of about \(0.4493\) at \(e\approx0.9300\), then falls back to 0 as \(e\to1\). So there is a maximum angular velocity for a spheroid of given density, and below it each \(\Omega\) corresponds to two spheroids, a moderately flattened one and a very flat one.

Jacobi’s ellipsoids and the bifurcation

In 1834 Carl Jacobi found that triaxial ellipsoids rotating about their shortest axis are also figures of equilibrium. The Jacobi family meets the Maclaurin family at a single spheroid, with \(e\approx0.8127\) and \(\Omega^2/(\pi G\rho)\approx0.3742\). This is the first bifurcation point along the Maclaurin sequence, the first place where a new family of shapes branches off.

Stability by energy

Kelvin and Tait had proposed a criterion: a figure of equilibrium is stable if it minimizes the appropriate energy (gravitational plus rotational, at fixed angular momentum) among neighbouring shapes. Lyapunov’s thesis examined this principle with a care no one had applied to it. He noted that the second variation of energy may vanish in some directions and that a correct sufficient condition must then involve higher variations. He showed that positivity of these higher variations does guarantee stability, and applied the criterion to both ellipsoid families. With dissipation present (so-called secular stability) the Maclaurin spheroids lose stability exactly at the Jacobi bifurcation, and the Jacobi ellipsoids take over as the stable branch.

Exercise 4.1Show that for small \(e\) the Maclaurin relation becomes \(\Omega^2/(\pi G\rho)\approx\tfrac{8}{15}e^2\). Use this to estimate the flattening \(f=1-\sqrt{1-e^2}\) of a homogeneous Earth with mean density \(5514\ \mathrm{kg\,m^{-3}}\) and \(\Omega=7.292\times10^{-5}\ \mathrm{s^{-1}}\). Compare with the observed \(f\approx1/298\).

Show solution
Expand \(\arcsin e=e+\tfrac{e^3}{6}+\tfrac{3e^5}{40}+\cdots\) and \(\sqrt{1-e^2}=1-\tfrac{e^2}{2}-\tfrac{e^4}{8}+\cdots\). The terms of order \(e^{-2}\) and \(e^0\) cancel and the \(e^2\) coefficient is \(8/15\). With \(G=6.674\times10^{-11}\), \(q=\Omega^2/(\pi G\rho)\approx0.00460\), so \(e^2\approx\tfrac{15}{8}q\approx0.0086\) and \(f\approx e^2/2\approx0.0043\approx1/232\). The real Earth is less flattened because its mass is concentrated toward the centre. Clairaut’s theory of inhomogeneous figures, which Lyapunov revisited in 1904, accounts for the difference.

Exercise 4.2Using the maximum \(\Omega^2_{\max}\approx0.4493\,\pi G\rho\), find the shortest rotation period of a Maclaurin spheroid of density \(1000\ \mathrm{kg\,m^{-3}}\). Why is the answer independent of the size of the body?

Show solution
\(T_{\min}=2\pi/\sqrt{0.4493\,\pi G\rho}\approx2.05\times10^4\ \mathrm s\approx5.7\) hours. The relation involves only \(\Omega^2\) and \(G\rho\): gravity and centrifugal acceleration both scale linearly with radius at fixed density, so size cancels.
Lesson 05

What stability means

For the general reader. A pencil balanced on its tip is in equilibrium, but the slightest breath topples it. A marble in a bowl returns after a nudge. Before Lyapunov, “stable” had several loose meanings. His 1892 memoir fixed one precise definition and built a whole theory on it. The definition is still the one in every textbook.

Goals
  • State Lyapunov stability and asymptotic stability precisely.
  • Reduce stability of any motion to stability of an equilibrium.
  • See examples that separate the different notions.

Perturbed motion

Lyapunov considered a known motion of a mechanical system, the unperturbed motion, and asked what happens to motions that start nearby. Writing the deviation as \(x(t)\in\mathbb R^n\), the equations of perturbed motion take the form

\[ \dot x = f(t,x), \qquad f(t,0)=0, \]

so that the unperturbed motion becomes the equilibrium \(x=0\). This reduction is the first idea of the memoir: stability of any motion is stability of an equilibrium of a different system.

Definition (Lyapunov, 1892)

The equilibrium \(x=0\) is stable if for every \(\varepsilon>0\) and every \(t_0\) there is \(\delta>0\) such that \(|x(t_0)|<\delta\) implies \(|x(t)|<\varepsilon\) for all \(t\ge t_0\). It is asymptotically stable if it is stable and, in addition, \(x(t)\to0\) as \(t\to\infty\) for all \(x(t_0)\) close enough to 0. Otherwise it is unstable.

Three features distinguish this from earlier usage. The time interval is infinite. The perturbation is in the initial conditions only, not in the equations. And stability is a property of a single solution, not of the system as a whole. Lyapunov also considered stability with respect to some of the variables only, a notion that later became important in mechanics and control.

Two methods

Lyapunov divided his methods into two groups. The first method uses explicit information about solutions, usually series expansions or the linearized equations (Lesson 06). The second method, often called the direct method, decides stability without solving anything, using an auxiliary function (Lesson 07).

Exercise 5.1For \(\dot x=-x^3\) on \(\mathbb R\), solve explicitly and show that 0 is asymptotically stable, yet no estimate \(|x(t)|\le Ce^{-at}|x(0)|\) with \(a>0\) holds.

Show solution
\(x(t)=x_0/\sqrt{1+2x_0^2t}\). Then \(|x(t)|\le|x_0|\), so 0 is stable, and \(x(t)\to0\). But \(|x(t)|\sim1/\sqrt{2t}\) decays like a power, slower than any exponential. Asymptotic stability does not imply exponential stability unless the linearization decides the question.

Exercise 5.2Show that the undamped pendulum \(\ddot\theta+\sin\theta=0\) has a stable but not asymptotically stable equilibrium at \(\theta=0\). Then show that the circular orbits of the Kepler problem, regarded as motions in \(\mathbb R^4\), are not Lyapunov stable, although nearby orbits stay close as curves.

Show solution
Energy \(E=\tfrac12\dot\theta^2+1-\cos\theta\) is conserved and has a strict minimum at the origin, so small energy keeps the motion in a small neighbourhood (stable). Energy is conserved, so a solution with \(E>0\) never reaches the origin (not asymptotically stable). For Kepler, a slightly larger circular orbit has a slightly longer period. The two bodies drift apart in phase, and after a long time are on opposite sides of the orbit. The distance in phase space is then large. This is orbital stability without Lyapunov stability.
Lesson 06

The first method: linearization and characteristic exponents

For the general reader. Near an equilibrium, most systems behave like their linear approximation. If every small disturbance of the linear system dies out exponentially, the nonlinear system is stable too. Lyapunov made this precise, found the cases where linearization says nothing, and introduced the growth rates now called Lyapunov exponents.

Goals
  • State and prove the theorem on stability in the first approximation.
  • Recognize the critical cases.
  • Define Lyapunov’s characteristic numbers and their modern form.
Theorem (stability in the first approximation)

Let \(\dot x=Ax+g(x)\), where \(A\) is a constant \(n\times n\) matrix and \(g\) is continuous with \(|g(x)|/|x|\to0\) as \(x\to0\).

  1. If every eigenvalue of \(A\) has negative real part, then \(x=0\) is asymptotically stable (indeed exponentially).
  2. If some eigenvalue of \(A\) has positive real part, then \(x=0\) is unstable.

Proof of part 1. It is cleanest with the second method. Since \(A\) is a stable matrix, the integral \(P=\int_0^\infty e^{A^{\mathsf T}t}e^{At}\,dt\) converges and is symmetric positive definite, and \(A^{\mathsf T}P+PA=-I\) (Lesson 07). Let \(V(x)=x^{\mathsf T}Px\). Along solutions,

\[ \dot V = x^{\mathsf T}(A^{\mathsf T}P+PA)x + 2x^{\mathsf T}Pg(x) = -|x|^2 + 2x^{\mathsf T}Pg(x) \le -|x|^2+2\|P\|\,|x|\,|g(x)|. \]

For \(|x|\) small, \(|g(x)|\le|x|/(4\|P\|)\), so \(\dot V\le-\tfrac12|x|^2\le-\tfrac{1}{2\|P\|}V\). Hence \(V\) decays exponentially, and so does \(|x|\).

Critical cases

If all eigenvalues have non-positive real part and some lie on the imaginary axis, linearization cannot decide. Lyapunov analysed in detail the case of a single zero eigenvalue and the case of a pair of purely imaginary eigenvalues, where stability depends on higher-order terms. In the second case he also proved the theorem now called the Lyapunov centre theorem: for an analytic Hamiltonian or conservative system whose linearization has purely imaginary eigenvalues \(\pm i\omega\) with no other eigenvalue an integer multiple of \(i\omega\), there is a one-parameter family of periodic orbits emanating from the equilibrium with periods tending to \(2\pi/\omega\).

Characteristic numbers

For time-dependent linear systems \(\dot x=A(t)x\) eigenvalues lose their meaning. Lyapunov attached to each function \(x(t)\) its characteristic number

\[ \lambda[x] = -\limsup_{t\to\infty}\frac1t\log|x(t)|. \]

Modern usage takes the opposite sign and calls \(\chi[x]=\limsup_{t\to\infty}\frac1t\log|x(t)|\) the Lyapunov exponent. A linear system has at most \(n\) distinct exponents. Lyapunov singled out regular systems, for which the exponents behave as eigenvalues do, and proved that for regular systems negative exponents of the linear part again imply stability of the nonlinear system. The general theory of exponents along trajectories of nonlinear systems, the multiplicative ergodic theorem of Valery Oseledets (1968), rests on these ideas.

Exercise 6.1Linearize the damped pendulum \(\ddot\theta+k\dot\theta+\sin\theta=0\) (\(k>0\)) at \(\theta=0\) and at \(\theta=\pi\). Decide the stability of each equilibrium.

Show solution
With \(x=(\theta,\dot\theta)\): at \(\theta=0\), \(A=\begin{pmatrix}0&1\\-1&-k\end{pmatrix}\), eigenvalues \(\tfrac{-k\pm\sqrt{k^2-4}}{2}\), both with negative real part, so asymptotically stable. At \(\theta=\pi\), \(\sin\theta\approx-(\theta-\pi)\), so \(A=\begin{pmatrix}0&1\\1&-k\end{pmatrix}\) with eigenvalues \(\tfrac{-k\pm\sqrt{k^2+4}}{2}\), one positive: unstable.

Exercise 6.2Compute the Lyapunov exponent \(\chi\) of \(x(t)=t^5e^{-2t}\) and of \(x(t)=e^{t\sin t}\). For the doubling map \(x\mapsto2x\bmod1\), compute the exponent \(\lim\frac1n\log|(f^n)'(x)|\).

Show solution
\(\frac1t\log(t^5e^{-2t})=\frac{5\log t}{t}-2\to-2\), so \(\chi=-2\) (Lyapunov’s characteristic number is \(+2\)). For \(e^{t\sin t}\), \(\frac1t\log x=\sin t\), whose lim sup is 1, so \(\chi=1\) even though the function returns to 1 infinitely often. For the doubling map \((f^n)'=2^n\), so the exponent is \(\log2>0\): nearby points separate exponentially, the signature of chaos.
Lesson 07

The second method: Lyapunov functions

For the general reader. To know that a marble will stay in a bowl, you do not need to compute its path. It is enough that it always loses height. Lyapunov turned this observation into a general method: find a function that behaves like energy and never increases along motions, and stability follows.

Goals
  • State Lyapunov’s stability, asymptotic stability and instability theorems.
  • Solve the Lyapunov matrix equation.
  • Construct Lyapunov functions in examples, including critical cases.

Let \(\dot x=f(x)\) with \(f(0)=0\), and let \(V\) be a continuously differentiable function near 0 with \(V(0)=0\). Its derivative along solutions is \(\dot V(x)=\nabla V(x)\cdot f(x)\), computable from the equation alone. \(V\) is positive definite if \(V(x)>0\) for \(x\neq0\) near 0.

Theorems (Lyapunov, 1892)
  1. Stability. If \(V\) is positive definite and \(\dot V\le0\) near 0, then \(x=0\) is stable.
  2. Asymptotic stability. If \(V\) is positive definite and \(\dot V\) is negative definite, then \(x=0\) is asymptotically stable.
  3. Instability. If \(\dot V\) is positive definite and \(V\) takes positive values at points arbitrarily close to 0, then \(x=0\) is unstable.

Proof of 1. Given \(\varepsilon\), let \(m=\min\{V(x):|x|=\varepsilon\}>0\). By continuity choose \(\delta<\varepsilon\) with \(V<m\) on \(|x|<\delta\). A solution starting there has \(V(x(t))\le V(x(t_0))<m\) for all \(t\), so it can never reach the sphere \(|x|=\varepsilon\). Proof of 2. \(V(x(t))\) decreases to a limit \(c\ge0\). If \(c>0\), the solution stays in a compact annulus where \(\dot V\le-\mu<0\), and \(V\) would become negative in finite time. So \(c=0\), and positive definiteness forces \(x(t)\to0\). The time-dependent versions require bounds of \(V\) from above and below by functions of \(|x|\) independent of \(t\), which Lyapunov formulated.

The Lyapunov equation

Theorem

For a real matrix \(A\), all eigenvalues have negative real part if and only if for some (equivalently, every) symmetric positive definite \(Q\) the equation

\[ A^{\mathsf T}P+PA=-Q \]

has a symmetric positive definite solution \(P\). The solution is then unique and equals \(P=\int_0^\infty e^{A^{\mathsf T}t}Qe^{At}\,dt\).

Then \(V(x)=x^{\mathsf T}Px\) is a quadratic Lyapunov function for \(\dot x=Ax\), with \(\dot V=-x^{\mathsf T}Qx\). The hero illustration on this page shows the level sets of such a \(V\) for a damped oscillator. In control theory this equation and its relatives (Riccati equations, linear matrix inequalities) are among the most used tools of the subject.

Later developments

When \(\dot V\le0\) but is not negative definite, as for mechanical systems with friction acting only on velocities, asymptotic stability can still follow if no complete solution stays in the set \(\{\dot V=0\}\) other than the equilibrium. This invariance principle is due to Barbashin and Krasovskii (1952) and to LaSalle (1960). Nikolai Chetaev generalized the instability theorem in 1934. Converse theorems, showing that a Lyapunov function exists whenever the equilibrium is asymptotically stable, were proved by José Massera and Jaroslav Kurzweil between 1949 and 1956.

Exercise 7.1Solve \(A^{\mathsf T}P+PA=-I\) for \(A=\begin{pmatrix}0&1\\-2&-3\end{pmatrix}\) and check that \(P\) is positive definite.

Show solution
Write \(P=\begin{pmatrix}a&b\\b&c\end{pmatrix}\). The equation gives \(-4b=-1\), \(a-3b-2c=0\), \(2b-6c=-1\). So \(b=\tfrac14\), \(c=\tfrac14\), \(a=\tfrac54\). Then \(a>0\) and \(\det P=\tfrac{5}{16}-\tfrac1{16}=\tfrac14>0\), so \(P\) is positive definite, consistent with the eigenvalues \(-1,-2\).

Exercise 7.2Both systems \(\dot x=y-x^3,\ \dot y=-x-y^3\) and \(\dot x=y+x^3,\ \dot y=-x+y^3\) have the same linearization at 0. Show that the first is asymptotically stable and the second unstable.

Show solution
The linearization has eigenvalues \(\pm i\), a critical case. Take \(V=x^2+y^2\). For the first system \(\dot V=2x(y-x^3)+2y(-x-y^3)=-2(x^4+y^4)\), negative definite: asymptotically stable. For the second \(\dot V=2(x^4+y^4)\), positive definite, and \(V>0\) everywhere except 0: unstable by the third theorem.

Exercise 7.3For the damped pendulum \(\ddot\theta+k\dot\theta+\sin\theta=0\) with \(k>0\), show that the energy \(E=\tfrac12\omega^2+1-\cos\theta\) (\(\omega=\dot\theta\)) proves stability but not asymptotic stability with Lyapunov’s theorems alone. Then use the invariance principle to conclude asymptotic stability.

Show solution
\(\dot E=\omega\dot\omega+\sin\theta\,\omega=-k\omega^2\le0\). \(E\) is positive definite near 0, so the origin is stable, but \(\dot E\) vanishes on the whole line \(\omega=0\), so it is not negative definite. On \(\{\omega=0\}\), an entire solution has \(\dot\omega=-\sin\theta=0\), so near 0 only \(\theta=0\). By the invariance principle the origin is asymptotically stable.
Lesson 08

Potential theory and the Dirichlet problem

For the general reader. Find the steady temperature inside a body when the temperature on its surface is prescribed. This is the Dirichlet problem. In the nineteenth century it was often solved by formulas that assumed far more smoothness than anyone checked. Lyapunov identified exactly which surfaces make the classical method work, and those surfaces now carry his name.

Goals
  • Define single- and double-layer potentials and Lyapunov surfaces.
  • State the jump relations and see how they turn the Dirichlet problem into an integral equation.
  • Test whether given surfaces satisfy Lyapunov’s conditions.

Layer potentials

Let \(S\subset\mathbb R^3\) be a closed surface bounding a domain \(D\), with outward unit normal \(n\), and let \(\mu\) be a continuous density on \(S\). The double-layer potential is

\[ W(x) = \int_S \mu(y)\,\frac{\partial}{\partial n_y}\frac{1}{|x-y|}\,dS_y = \int_S \mu(y)\,\frac{(x-y)\cdot n_y}{|x-y|^3}\,dS_y . \]

It is harmonic off \(S\). Carl Neumann and others had proposed to solve the Dirichlet problem by choosing \(\mu\) so that the boundary values of \(W\) match the data, which needs precise knowledge of how \(W\) behaves as \(x\) approaches \(S\).

Definition (Lyapunov surface)

A closed surface \(S\) is a Lyapunov surface if (i) it has a tangent plane at every point; (ii) there is \(d>0\) such that, for every \(y_0\in S\), the part of \(S\) inside the ball of radius \(d\) about \(y_0\) meets each line parallel to \(n_{y_0}\) at most once; (iii) there are constants \(C>0\) and \(0<\alpha\le1\) such that the angle \(\theta\) between the normals at any two points at distance \(r\) satisfies \(\theta\le Cr^\alpha\).

Theorem (jump relations)

On a Lyapunov surface with continuous \(\mu\), the integral \(W(x_0)\) converges for \(x_0\in S\) and defines a continuous function there. \(W\) extends continuously to \(\bar D\) from inside and to the closure of the exterior from outside, with boundary values

\[ W_{\mathrm{int}}(x_0)=W(x_0)-2\pi\mu(x_0),\qquad W_{\mathrm{ext}}(x_0)=W(x_0)+2\pi\mu(x_0). \]

The interior Dirichlet problem \(\Delta u=0\) in \(D\), \(u=\varphi\) on \(S\), then becomes the integral equation \(W(x_0)-2\pi\mu(x_0)=\varphi(x_0)\) for \(\mu\), which Ivar Fredholm solved in general in 1900 with his theory of integral equations. Lyapunov’s 1897–1898 work established the continuity and jump properties on which this rests, and gave conditions under which the solution has normal derivatives on the boundary. The analogous results for the single-layer potential \(V(x)=\int_S\mu(y)|x-y|^{-1}dS_y\) and its normal derivative complete the classical method for the Neumann problem. Steklov and later Nikolai Günter developed this programme in Russia.

Exercise 8.1Take \(\mu\equiv1\). Show that \(W(x)=-4\pi\) for \(x\in D\), \(W(x)=0\) for \(x\) outside \(\bar D\), and check the jump relations with \(W(x_0)=-2\pi\) on a smooth \(S\).

Show solution
Write \(W(x)=-\int_S\frac{(y-x)\cdot n_y}{|y-x|^3}\,dS_y\). This is minus the flux through \(S\) of the field \((y-x)/|y-x|^3\), which is divergence free away from \(x\) and has flux \(4\pi\) through any closed surface enclosing \(x\) (Gauss). So \(W=-4\pi\) inside and \(0\) outside. At a point \(x_0\) of a smooth surface, half of a small sphere around \(x_0\) lies inside, giving \(W(x_0)=-2\pi\). Then \(W(x_0)-2\pi=-4\pi\) and \(W(x_0)+2\pi=0\), as the jump relations require.

Exercise 8.2Locally near the origin, which of the following surfaces satisfy condition (iii), and with which \(\alpha\)? (a) the graph \(z=x^2+y^2\); (b) the graph \(z=|x|^{3/2}\); (c) the cone \(z=\sqrt{x^2+y^2}\).

Show solution
(a) The normal is a smooth function of the point, so \(\theta\le Cr\): \(\alpha=1\). (b) The slope in \(x\) is \(\tfrac32\operatorname{sgn}(x)|x|^{1/2}\), which is Hölder continuous with exponent \(\tfrac12\), so \(\theta\le Cr^{1/2}\): a Lyapunov surface with \(\alpha=\tfrac12\), though not \(C^2\). (c) There is no tangent plane at the vertex, so condition (i) fails. Lyapunov surfaces are exactly those of class \(C^{1,\alpha}\).
Lesson 09

The central limit theorem

For the general reader. Add up many small independent random effects, and the total is approximately normally distributed, whatever the effects look like individually. This is the central limit theorem. Chebyshev and Markov proved versions of it by comparing moments. Lyapunov found a different route, through Fourier transforms, that needs much weaker assumptions and became the standard method of the twentieth century.

Goals
  • State the central limit theorem under Lyapunov’s condition.
  • Prove it with characteristic functions.
  • Check the condition in examples and see a sum where it fails.

Setting

Let \(X_1,X_2,\dots\) be independent random variables with means \(m_k\), finite variances \(\sigma_k^2\), and \(B_n=\sum_{k=1}^n\sigma_k^2\). Chebyshev had outlined a proof in 1887 by the method of moments, assuming all moments finite and bounded. Markov completed that proof in 1898. Lyapunov needed only a little more than two moments.

Theorem (Lyapunov, 1900–1901)

Suppose that for some \(\delta>0\) the absolute moments \(\mathbb E|X_k-m_k|^{2+\delta}\) are finite and

\[ L_{n,\delta}=\frac{1}{B_n^{1+\delta/2}}\sum_{k=1}^n\mathbb E|X_k-m_k|^{2+\delta}\;\longrightarrow\;0 \qquad (n\to\infty). \]

Then, uniformly in \(x\in\mathbb R\),

\[ \mathbb P\Big(\frac{1}{\sqrt{B_n}}\sum_{k=1}^n(X_k-m_k)\le x\Big)\;\longrightarrow\;\Phi(x)=\frac{1}{\sqrt{2\pi}}\int_{-\infty}^xe^{-u^2/2}\,du. \]

The 1900 memoir Sur une proposition de la théorie des probabilités treated the case of third moments, and the 1901 memoir Nouvelle forme du théorème sur la limite de probabilité extended it to \(2+\delta\). Lyapunov also bounded the error: for \(\delta=1\) the difference from \(\Phi\) is at most a constant times \(L_{n,1}\log(1/L_{n,1})\). The Berry–Esseen theorem of 1941–42 removed the logarithm.

Proof sketch with characteristic functions

Take \(m_k=0\) and \(0<\delta\le1\). Let \(\varphi_k(t)=\mathbb Ee^{itX_k}\). From the inequality \(|e^{iu}-1-iu+\tfrac{u^2}{2}|\le\min(u^2,|u|^3)\le|u|^{2+\delta}\),

\[ \Big|\varphi_k\big(t/\sqrt{B_n}\big)-1+\frac{\sigma_k^2t^2}{2B_n}\Big|\le\frac{|t|^{2+\delta}\,\mathbb E|X_k|^{2+\delta}}{B_n^{1+\delta/2}}. \]

Lyapunov’s condition implies \(\max_k\sigma_k^2/B_n\to0\) (by Lyapunov’s inequality \(\sigma_k^{2+\delta}\le\mathbb E|X_k|^{2+\delta}\)), so every factor is close to 1 and one may take logarithms. Summing, \(\sum_k\log\varphi_k(t/\sqrt{B_n})=-\tfrac{t^2}{2}+O(|t|^{2+\delta}L_{n,\delta})+o(1)\), so the characteristic function of the normalized sum tends to \(e^{-t^2/2}\). The continuity theorem of Paul Lévy, proved in the 1920s, now finishes the proof. Lyapunov, writing before it existed, derived the convergence of distributions from the characteristic functions directly, with explicit estimates.

Jarl Lindeberg in 1922 found a weaker sufficient condition, and William Feller in 1935 showed it is also necessary when the individual variances are negligible. Markov later showed that the method of moments could also reach Lyapunov’s conditions.

Exercise 9.1Let \(X_k\) be independent Bernoulli variables with parameters \(p_k\), and suppose \(\sum_kp_k(1-p_k)=\infty\). Verify Lyapunov’s condition with \(\delta=1\).

Show solution
\(\mathbb E|X_k-p_k|^3=p_k(1-p_k)\big(p_k^2+(1-p_k)^2\big)\le p_k(1-p_k)=\sigma_k^2\). So \(L_{n,1}\le B_n/B_n^{3/2}=B_n^{-1/2}\to0\). The number of successes is asymptotically normal, a result that goes back to de Moivre and Laplace for equal \(p_k\).

Exercise 9.2Let \(X_k\) be uniform on \([-k,k]\). Does the central limit theorem hold?

Show solution
\(\sigma_k^2=k^2/3\), so \(B_n\sim n^3/9\). \(\mathbb E|X_k|^3=k^3/4\), so \(\sum_{k\le n}\mathbb E|X_k|^3\sim n^4/16\). Then \(L_{n,1}\sim\frac{n^4/16}{(n^3/9)^{3/2}}=\frac{27}{16\sqrt n}\to0\). Yes, even though the variables grow.

Exercise 9.3Let \(X_k=\pm2^k\) with probability \(\tfrac12\) each. Show that Lyapunov’s condition fails, and find the limit law of \(\sum_{k\le n}X_k/\sqrt{B_n}\).

Show solution
\(B_n=\sum_{k\le n}4^k\sim\tfrac43 4^n\) and \(\sum\mathbb E|X_k|^3\sim\tfrac87 8^n\), so \(L_{n,1}\to\frac{8/7}{(4/3)^{3/2}}\approx0.74\neq0\). Write \(\sum_{k=1}^n\varepsilon_k2^k=2^{n+1}\sum_{j=1}^n\varepsilon_{n+1-j}2^{-j}\). The sum \(\sum_j\varepsilon_j2^{-j}\) with independent random signs converges in law to the uniform distribution on \([-1,1]\). Since \(\sqrt{B_n}\sim2^{n+1}/\sqrt3\), the limit is uniform on \([-\sqrt3,\sqrt3]\). The last term carries a fixed fraction of the variance, and normality fails.
Lesson 10

Figures of equilibrium and the pear

For the general reader. As a Jacobi ellipsoid spins faster, it reaches a point where a pear-shaped figure branches off. George Darwin hoped that this pear would pinch in two and explain how double stars and the Earth–Moon system formed. Lyapunov spent years on the calculation and concluded that the pear is unstable. He was right, and the theory of fission collapsed.

Goals
  • Understand bifurcation from a family of equilibria and exchange of stability.
  • State the Lyapunov–Schmidt reduction.
  • Follow the history of the pear-shaped figures.

Chebyshev’s question answered

Between 1906 and 1914 Lyapunov published four long memoirs, Sur les figures d’équilibre peu différentes des ellipsoïdes d’une masse liquide homogène douée d’un mouvement de rotation. He proved rigorously that at each bifurcation point (“ellipsoid of bifurcation”) on the Maclaurin and Jacobi sequences a new family of equilibrium figures branches off, expressed as convergent series in a small parameter. Poincaré had found these points in 1885 using linearized equations, without proving that the new families exist. Lyapunov’s convergence proofs settled Chebyshev’s question of 1882.

The reduction method

The analytic core of his existence proofs is a method for nonlinear equations near a point where the linearization is not invertible. Erhard Schmidt developed it independently for integral equations in 1908.

Theorem (Lyapunov–Schmidt reduction)

Let \(X,Y\) be Banach spaces and \(F:X\times\mathbb R\to Y\) smooth with \(F(0,\lambda)=0\) for all \(\lambda\). Suppose \(L=D_xF(0,\lambda_0)\) is a Fredholm operator with kernel \(N\) and range \(R\) of finite codimension. Write \(X=N\oplus M\) and \(Y=R\oplus Z\), with \(Q\) the projection onto \(Z\). Then near \((0,\lambda_0)\) the equation \(F(x,\lambda)=0\) is equivalent to a finite system \(\Phi(u,\lambda)=Q\,F(u+w(u,\lambda),\lambda)=0\) for \(u\in N\), where \(w(u,\lambda)\in M\) is obtained from the implicit function theorem.

When \(N\) is one-dimensional the problem reduces to a single scalar equation, the bifurcation equation. Its solutions near the trivial branch give the new family. In the fluid problem, \(x\) is the deformation of the ellipsoid’s surface and \(\lambda\) the angular velocity.

Stability of the pear

Poincaré’s 1885 memoir located the point on the Jacobi sequence where the pear-shaped family branches off, and argued, through an approximate energy computation, that the pear might be stable for a while. Darwin’s numerical work seemed to agree. Lyapunov’s calculation, carried to a higher order, showed the opposite. In 1911 Poincaré wrote that he was no longer sure of his earlier view. Lyapunov published his computations in the third memoir of the series (1912), but no one checked them at the time. In 1917 James Jeans confirmed that the pear-shaped figures are unstable and found the error in Darwin’s numerics. Fission of a homogeneous rotating fluid into a binary is therefore not a continuous process through stable equilibria.

Exercise 10.1Apply the reduction to \(F(x,\lambda)=\lambda x-x^3\) on \(\mathbb R\). Find the bifurcation point, the branches, and their stability for \(\dot x=F(x,\lambda)\).

Show solution
\(D_xF(0,\lambda)=\lambda\) vanishes at \(\lambda_0=0\), with one-dimensional kernel. Solutions: \(x=0\) for all \(\lambda\), and \(x=\pm\sqrt\lambda\) for \(\lambda>0\). Stability from \(D_xF\): at \(x=0\) it is \(\lambda\), so the trivial branch is stable for \(\lambda<0\) and unstable for \(\lambda>0\). On the new branches \(D_xF=\lambda-3\lambda=-2\lambda<0\): stable. Stability passes from the old branch to the new one, the same exchange that occurs at the Maclaurin–Jacobi bifurcation.

Exercise 10.2Now take \(F(x,\lambda)=\lambda x+x^3\). What changes? Relate the answer to the pear-shaped figures.

Show solution
The new branches \(x=\pm\sqrt{-\lambda}\) exist for \(\lambda<0\), on the side where the trivial branch is stable. There \(D_xF=\lambda+3(-\lambda)=-2\lambda>0\): the bifurcating branches are unstable (a subcritical pitchfork). The sign of a higher-order coefficient decides the stability of the branch. For the pear, that coefficient required an expansion beyond Poincaré’s approximation, and Lyapunov’s computation of it gave the unstable sign.
Part III · Life and legacy
Lesson 11

The Academy years, 1902–1917

In St Petersburg Lyapunov devoted himself almost entirely to research. He returned to the rotating fluid. The memoirs of 1903–1904 treated the figures of celestial bodies and the Clairaut equation for slowly rotating, nearly spherical, inhomogeneous masses. The four parts on figures close to ellipsoids followed between 1906 and 1914, and a further study, of series of equilibrium figures for a fluid of variable density, was published only after his death (1925–1927). He wrote his major memoirs in French, which made them accessible abroad.

His 1892 monograph found readers outside Russia only gradually. A French translation by Édouard Davaux was published at Toulouse, and wider attention came only from the 1930s, when Soviet mechanicians took up his methods.

He attended the International Congress of Mathematicians in Rome in 1908. He was an editor of volumes XVIII and XIX of the first series of Leonhard Euler’s Opera omnia. The Accademia dei Lincei elected him a foreign member in 1909 and the Paris Academy of Sciences elected him in 1916. The universities of St Petersburg, Kharkov and Kazan made him an honorary member.

DiscussionLyapunov chose to work on one difficult problem for years at a time and published only when every step was rigorous. Poincaré worked quickly, across many fields, often leaving gaps for others to fill. Compare the strengths and costs of the two styles, using their work on rotating fluids as the example.

Lesson 12

Odessa, death and legacy

In the summer of 1917 Lyapunov moved to Odessa with his wife, Natalia, who was seriously ill with tuberculosis. He began lecturing at the university there, and in 1918 gave a lecture on the shape of celestial bodies. He was himself losing his sight to cataracts. The revolution and civil war made life in Odessa precarious. His wife’s condition worsened through 1918, and she died on 31 October. That same day Lyapunov shot himself. He died three days later, on 3 November 1918, without regaining consciousness. He had asked to be buried with her.

Legacy

  • Stability and control: Lyapunov stability, Lyapunov functions and the Lyapunov equation are the foundation of nonlinear control theory and the analysis of dynamical systems. Chetaev, Malkin and Krasovskii built a Soviet school on them; Kalman and others brought them into Western engineering around 1960.
  • Chaos and ergodic theory: Lyapunov exponents measure sensitive dependence on initial conditions. The Oseledets theorem guarantees they exist almost everywhere for a measure-preserving system, and Pesin theory links them to entropy.
  • Probability: the Fourier method he introduced became the standard approach to limit theorems, and the Lyapunov condition is still the one most often checked in practice.
  • Analysis: Lyapunov surfaces, the Lyapunov centre theorem and the Lyapunov–Schmidt reduction are standard tools in potential theory, Hamiltonian dynamics and bifurcation theory.
  • Honours: a lunar crater bears his name. The Russian Academy of Sciences awards a Lyapunov Gold Medal for work in mathematics and mechanics.

Not every Lyapunov in mathematics is Aleksandr Mikhailovich. The theorem that the range of a non-atomic vector measure is convex is due to Aleksei Andreevich Lyapunov (1911–1973), a pioneer of Soviet cybernetics.

Final projectChoose a physical system with friction or feedback (a thermostat, a bicycle, a population model). Write its equations, find an equilibrium, and prove its stability twice: once by linearization and once with an explicit Lyapunov function. Explain what the second proof tells you that the first does not, for example an estimate of the region of attraction.

Reference

Connections

People linked to Aleksandr Lyapunov across this collection. A name without a link has no page here yet. See Aleksandr Lyapunov in the network of all 337 lives →

Teachers and advisors

Students

  • Nikolai Saltykov 1905
  • Vladimir Steklov

Influenced by

Influenced

Colleagues and collaborators

Rivals

Family

  • Sergei Lyapunov

Also mentioned in this life

Fields

On CoursesHub

Reference

Sources and further reading

Biography

  1. J. J. O’Connor and E. F. Robertson, Aleksandr Mikhailovich Lyapunov, MacTutor History of Mathematics.
  2. Lyapunov, Aleksandr Mikhailovich, Dictionary of Scientific Biography (via MacTutor).
  3. Aleksandr Lyapunov, Wikipedia.
  4. Aleksandr Lyapunov, Mathematics Genealogy Project.
  5. V. I. Smirnov, Biography of A. M. Lyapunov, translated in Int. J. Control 55 (1992), centenary issue.

Mathematics

  1. A. M. Lyapunov, The general problem of the stability of motion, Kharkov, 1892. French translation by É. Davaux, Ann. Fac. Sci. Toulouse; reprinted as Annals of Mathematics Studies 17, Princeton, 1947. English translation by A. T. Fuller, Int. J. Control 55 (1992) and Taylor & Francis, 1992.
  2. A. M. Lyapunov, Sur une proposition de la théorie des probabilités, Bull. Acad. Imp. Sci. St.-Pétersbourg (5) 13 (1900), 359–386.
  3. A. M. Lyapunov, Nouvelle forme du théorème sur la limite de probabilité, Mém. Acad. Imp. Sci. St.-Pétersbourg (8) 12 (1901), 1–24.
  4. A. M. Lyapunov, Sur certaines questions qui se rattachent au problème de Dirichlet, J. Math. Pures Appl. (5) 4 (1898).
  5. Lyapunov theorem, Encyclopedia of Mathematics.
  6. H. Fischer, A History of the Central Limit Theorem, Springer, 2011.
  7. From classical to modern central limit theorems, arXiv:2405.19828.
  8. The dawning of the theory of equilibrium figures, arXiv:1409.3858.
  9. S. Chandrasekhar, Ellipsoidal Figures of Equilibrium, Yale University Press, 1969.
  10. H. K. Khalil, Nonlinear Systems, 3rd ed., Prentice Hall, 2002.
  11. L. Barreira and Ya. Pesin, Lyapunov Exponents and Smooth Ergodic Theory, AMS, 2002.