courseshub.world · Lives in Mathematics and Physics

Maurice Fréchet

René Maurice Fréchet

A course in two strands: the life of the French analyst who turned functions into points of abstract spaces, and the ideas he left to analysis, topology and probability, from metric spaces and compactness to the law of the largest value.

Born 2 September 1878, Maligny Died 4 June 1973, Paris Thesis metric spaces and compactness, Paris, 1906 Level advanced undergraduate → graduate
The Fréchet distance between two curves: the shortest leash that lets a walker and a dog traverse them, both moving forward. One coupling is shown; its longest leash is highlighted.
Lesson 00

How to use this course

Every student of analysis uses Maurice Fréchet’s ideas, usually without his name. The metric space, the abstract notion of compactness, and the idea that a function can be a single point of a space all come from his 1906 thesis. His name survives in the Fréchet derivative, Fréchet spaces, the Fréchet distance between curves, the Fréchet distribution of extreme values and the Fréchet bounds of probability. This course follows his long life, from a village in Burgundy to the Paris Academy of Sciences, which elected him at 78, and works through the main threads of his mathematics.

Prerequisites for Part II
  • Real analysis: uniform convergence, compactness in \(\mathbb R^n\), the Bolzano–Weierstrass theorem.
  • Linear algebra and basic inner-product spaces.
  • Multivariable calculus: the derivative as a linear map.
  • For Lessons 09 and 10, a first course in probability.

Each technical lesson opens with a paragraph for the general reader, then gives precise statements, proof sketches and exercises with folded solutions. Lessons 04 to 08 follow his work in analysis and topology (1904–1928); Lessons 09 and 10 follow his turn to probability and statistics (1927–1951).

Reference

Timeline

1878Born 2 September in Maligny, Yonne, to Jacques and Zoé Fréchet, a Protestant family.
1890sAt the Lycée Buffon in Paris, taught by Jacques Hadamard.
1900Enters the École Normale Supérieure.
1903Agrégation in mathematics; publishes his first four papers.
1905Writes up Émile Borel’s lectures on functions of real variables.
19062 April: thesis Sur quelques points du calcul fonctionnel, introducing metric spaces and abstract compactness.
1907Representation of continuous linear functionals on \(L^2\), found at the same time as Frigyes Riesz. Teaches at the lycée in Besançon.
1908Lycée in Nantes. Marries Suzanne Carrive.
1910Professor of mechanics at Poitiers. Embeds every separable metric space isometrically in a single space of bounded sequences.
1911Notes on the differential in general spaces.
1914–18Mobilized 4 August 1914; interpreter with the British Army, about two and a half years at or near the front.
1919Professor of higher analysis and director of the Mathematics Institute at the French University of Strasbourg.
1925La notion de différentielle dans l’analyse générale.
1927The Fréchet distribution of the largest value of a sample.
1928Les espaces abstraits. Invited speaker at the International Congress of Mathematicians in Bologna. Moves to Paris.
1929Foreign member of the Polish Academy of Sciences and Letters.
1935The Fréchet inequalities for probabilities of combined events.
1937–38Recherches théoriques modernes sur la théorie des probabilités, including Markov chains. Wolfgang Doeblin completes his doctorate with him.
1941Chair of the Calculus of Probabilities and Mathematical Physics at the Sorbonne.
1943An information inequality for estimators, independently of the later Cramér–Rao bound.
1949Retires from his chair.
1950–53President of the International Association of Esperantist Scientists.
1951Bounds for joint distributions with given margins.
1956Elected to the Académie des sciences, aged 78.
1973Dies 4 June in Paris, aged 94.
Part I · Formation
Lesson 01

Maligny, Paris and Hadamard, 1878–1900

René Maurice Fréchet was born on 2 September 1878 in Maligny, a village in the Yonne department of Burgundy, to Jacques and Zoé Fréchet. The family was Protestant, a small minority in the France of the Third Republic.

In Paris he attended the Lycée Buffon. His mathematics teacher there, from 1890 to 1893, was Jacques Hadamard, then a young man who had just finished his own thesis and would soon prove the prime number theorem. Hadamard recognized his ability and encouraged him. The connection lasted for decades. Hadamard later supervised Fréchet’s doctorate, and Fréchet’s early research grew directly out of Hadamard’s work on functionals, the functions whose arguments are themselves functions.

In 1900 Fréchet entered the École Normale Supérieure, the elite school that trained French academics and teachers. Its students were close to the new theories of sets and of real functions then coming out of Paris: Émile Borel’s measure, René Baire’s classification of functions, and Henri Lebesgue’s integral, published in 1902.

Lesson 02

The École Normale and the thesis, 1900–1906

Fréchet passed the agrégation in 1903 and in the same year published four research papers. He also worked closely with Borel. In 1905 he wrote up Borel’s lectures as a book, Leçons sur les fonctions de variables réelles et les développements en séries de polynômes.

His thesis, Sur quelques points du calcul fonctionnel, was submitted on 2 April 1906 under Hadamard’s supervision. Its starting point was a question of Hadamard and of Vito Volterra: how to extend the calculus of functions of numbers to functions of curves, surfaces and other functions. Fréchet’s answer was to stop asking what the points of a space are. He considered an arbitrary set with a notion of limit, or with a distance he called the écart, and asked which theorems of analysis survive.

The thesis introduced what Felix Hausdorff named, in 1914, the metric space. It also introduced the abstract notion of compactness, and it studied concrete spaces of functions, curves and sequences in the new framework. Lessons 04 and 05 present its main results. Few readers understood at first how much the abstraction would simplify analysis; within thirty years it was the standard language.

Lesson 03

Lycées, Poitiers and the war, 1907–1919

Like many French mathematicians of his generation, Fréchet began his career in secondary schools. He taught at the lycée in Besançon in 1907–1908 and at the lycée in Nantes in 1908–1909. In 1908 he married Suzanne Carrive. In 1910 he became professor of mechanics at the Faculty of Science in Poitiers.

These were productive years. In 1907 he and the Hungarian Frigyes Riesz found, in notes published side by side in the Comptes rendus, the representation of continuous linear functionals on square-integrable functions (Lesson 06). In 1910 he showed that every separable metric space sits isometrically inside one fixed space of bounded sequences. In 1911 and 1912 he wrote on the general notion of differential (Lesson 07).

On 4 August 1914 he was mobilized. Because of his languages he was attached to the British Army as an interpreter, and he spent about two and a half years at or near the front. He kept writing mathematics when he could.

Part II · The mathematics
Lesson 04

Metric spaces and compactness

For the general reader. To talk about nearness, you need a way to measure distance. Before Fréchet, distance meant the distance between points of a line, plane or space. He noticed that most of analysis uses only three properties of distance, so any set with a distance satisfying them can be studied the same way, whether its points are numbers, curves or functions.

Goals
  • State the metric axioms and recognize the main examples.
  • Prove that sequential compactness and the “extremal” property agree in metric spaces.
  • Understand why Fréchet’s abstract compactness was a new idea.
Definition (Fréchet, 1906)

A metric space is a set \(E\) with a function \(d:E\times E\to[0,\infty)\) such that for all \(x,y,z\): \(d(x,y)=0\) iff \(x=y\); \(d(x,y)=d(y,x)\); and \(d(x,z)\le d(x,y)+d(y,z)\). A sequence \(x_n\to x\) when \(d(x_n,x)\to0\).

Fréchet’s thesis called these sets “classes (E)”, the letter for écart. His main examples were \(\mathbb R^n\); the continuous functions on \([a,b]\) with \(d(f,g)=\max|f-g|\); the space of all real sequences with

\[ d(x,y)=\sum_{n\ge1}2^{-n}\frac{|x_n-y_n|}{1+|x_n-y_n|}, \]

in which convergence is coordinatewise convergence; and a space of curves (Lesson 05).

Compactness

Fréchet called a set compact if every infinite subset has a limit point, and extremal if it is compact and closed. In modern terms, an extremal set is a sequentially compact set. The name expressed the main theorem:

Theorem (after Fréchet, 1906)

Let \(K\) be a subset of a metric space. Then \(K\) is sequentially compact if and only if every continuous real function on \(K\) is bounded and attains its maximum and minimum. A sequentially compact metric space is also complete and totally bounded, and conversely.

Proof sketch. If \(K\) is sequentially compact and \(f\) is continuous, take \(x_n\) with \(f(x_n)\to\sup f\) (possibly \(+\infty\)); a convergent subsequence \(x_{n_k}\to x\) gives \(f(x)=\sup f\), finite. Conversely, if a sequence \((x_n)\) of distinct points of \(K\) has no convergent subsequence, the set \(S=\{x_n\}\) is closed in \(K\) and every subset of it is closed. The function \(x_n\mapsto n\) is continuous on \(S\), and by the Tietze extension theorem (metric spaces are normal) it extends to a continuous unbounded function on \(K\).

In \(\mathbb R^n\) this is the Bolzano–Weierstrass theorem. Fréchet’s point was that the same statement, with the same proof, holds in spaces of functions, once one knows which sets are compact there.

Exercise 4.1Show that \(d(x,y)=\sum_n2^{-n}\frac{|x_n-y_n|}{1+|x_n-y_n|}\) satisfies the triangle inequality, and that \(d(x^{(k)},x)\to0\) iff \(x^{(k)}_n\to x_n\) for every \(n\).

Show solution
The function \(\varphi(t)=t/(1+t)\) is increasing and subadditive on \([0,\infty)\), so \(\varphi(|a-c|)\le\varphi(|a-b|+|b-c|)\le\varphi(|a-b|)+\varphi(|b-c|)\); sum with weights \(2^{-n}\). If each coordinate converges, the first \(N\) terms are small and the tail is at most \(2^{-N}\). Conversely, \(2^{-n}\varphi(|x^{(k)}_n-x_n|)\le d(x^{(k)},x)\), and \(\varphi(t)\to0\) only when \(t\to0\).

Exercise 4.2In \(C[0,1]\) with the max distance, show that the closed unit ball is not compact by finding a continuous functional on it that is bounded but does not attain its supremum.

Show solution
Take \(F(f)=\int_0^{1/2}f\,dt-\int_{1/2}^1f\,dt\). On the unit ball, \(F(f)<1\) for every continuous \(f\), because equality would force \(f=1\) on \([0,\tfrac12)\) and \(f=-1\) on \((\tfrac12,1]\), which is discontinuous. Steep continuous approximations to that step function give values arbitrarily close to 1. So the supremum 1 is not attained.

Exercise 4.3Prove that a compact metric space is separable.

Show solution
For each \(m\), total boundedness gives a finite set \(A_m\) with every point within \(1/m\) of \(A_m\). The countable union \(\bigcup_m A_m\) is dense.
Lesson 05

Spaces of functions and curves

For the general reader. Once functions are points, one can ask which collections of functions are “small” in the sense of compactness. Fréchet recognized the theorem of Cesare Arzelà and Giulio Ascoli as an answer. He also defined a distance between curves that respects the order in which they are traced, which computational geometry still uses to compare GPS tracks and handwriting.

Goals
  • State Arzelà–Ascoli as a characterization of compact sets in \(C[a,b]\).
  • Define the Fréchet distance between curves and compute simple examples.
  • Prove Fréchet’s embedding of separable metric spaces into \(\ell^\infty\).
Theorem (Arzelà–Ascoli, in Fréchet’s form)

A subset \(\mathcal F\subseteq C[a,b]\) has compact closure if and only if it is uniformly bounded and equicontinuous: for every \(\varepsilon>0\) there is \(\delta>0\) with \(|f(s)-f(t)|<\varepsilon\) whenever \(|s-t|<\delta\), for all \(f\in\mathcal F\).

The Fréchet distance

For curves \(P,Q:[0,1]\to\mathbb R^n\), Fréchet defined in 1906

\[ d_F(P,Q)=\inf_{\alpha,\beta}\ \max_{t\in[0,1]}\big|P(\alpha(t))-Q(\beta(t))\big|, \]

where \(\alpha,\beta\) range over continuous non-decreasing surjections of \([0,1]\) onto itself. A walker follows \(P\), a dog follows \(Q\), neither goes backwards, and \(d_F\) is the shortest leash that suffices. Two parametrizations of the same oriented curve are at distance 0, so \(d_F\) is a metric on curves up to reparametrization. In 1995 Helmut Alt and Michael Godau gave a polynomial-time algorithm for polygonal curves.

A universal space

Theorem (Fréchet, 1910)

Every separable metric space embeds isometrically in \(\ell^\infty\), the space of bounded real sequences with the sup distance.

Let \(\{x_n\}\) be dense in \(E\) and fix \(x_0\). Map \(x\mapsto\Phi(x)=\big(d(x,x_n)-d(x_0,x_n)\big)_{n\ge1}\). By the triangle inequality each coordinate is bounded by \(d(x,x_0)\), and \(|\Phi(x)_n-\Phi(y)_n|\le d(x,y)\). Choosing \(x_n\) close to \(x\) makes \(|\Phi(x)_n-\Phi(y)_n|\) close to \(d(x,y)\), so the sup equals \(d(x,y)\).

Exercise 5.1Let \(P(t)=(t,0)\) and \(Q(t)=(1-t,0)\) trace the same segment in opposite directions. Compute \(d_F(P,Q)\).

Show solution
At the start the walker is at \((0,0)\) and the dog at \((1,0)\); at the end they have swapped. The leash is at least 1 at the start, so \(d_F\ge1\). The ordinary parametrization keeps \(|P(t)-Q(t)|=|2t-1|\le1\). So \(d_F=1\), while the Hausdorff distance between the two point sets is 0.

Exercise 5.2Show that \(\{f_n(t)=\sin(nt)\}\subseteq C[0,\pi]\) has no uniformly convergent subsequence, and identify the hypothesis of Arzelà–Ascoli that fails.

Show solution
The family is uniformly bounded. Equicontinuity fails: \(f_n(\pi/(2n))-f_n(0)=1\) while \(\pi/(2n)\to0\). If a subsequence converged uniformly, its limit would be continuous and the subsequence would be equicontinuous, which it is not, by the same estimate.

Exercise 5.3Show that in Fréchet’s embedding, \(\sup_n|\Phi(x)_n-\Phi(y)_n|=d(x,y)\).

Show solution
\(|\Phi(x)_n-\Phi(y)_n|=|d(x,x_n)-d(y,x_n)|\le d(x,y)\). Given \(\varepsilon\), choose \(x_n\) with \(d(x,x_n)<\varepsilon\). Then \(d(y,x_n)-d(x,x_n)\ge d(x,y)-2d(x,x_n)>d(x,y)-2\varepsilon\).
Lesson 06

Linear functionals and Riesz–Fréchet

For the general reader. A linear functional assigns a number to each function, linearly. Integration against a fixed weight is the basic example. In 1907 Fréchet and Riesz proved that, for the square-integrable functions of Lebesgue’s new theory, there are no other continuous examples. The result is now the starting point of the theory of Hilbert spaces.

Goals
  • State and prove the Riesz–Fréchet representation theorem.
  • Apply it to existence of solutions by projection.
  • See how Fréchet spaces generalize normed spaces.

In 1903 Hadamard had represented continuous linear functionals on \(C[a,b]\) as limits of integrals, and Fréchet developed this in a series of papers Sur les opérations linéaires (1904–1907). Riesz found the definitive form for \(C[a,b]\) in 1909 with Stieltjes integrals. For \(L^2\) the answer is simpler.

Theorem (Riesz; Fréchet, 1907)

Let \(H\) be a Hilbert space (for instance \(L^2[a,b]\)). For every continuous linear functional \(\Lambda:H\to\mathbb R\) there is a unique \(g\in H\) with \(\Lambda(f)=\langle f,g\rangle\) for all \(f\). Moreover \(\|\Lambda\|=\|g\|\).

Proof. If \(\Lambda=0\), take \(g=0\). Otherwise \(N=\ker\Lambda\) is a closed proper subspace, so there is a unit vector \(u\perp N\) (by orthogonal projection, which needs completeness). For any \(f\), \(\Lambda(f)u-\Lambda(u)f\in N\), so \(\langle\Lambda(f)u-\Lambda(u)f,u\rangle=0\), that is, \(\Lambda(f)=\langle f,\Lambda(u)u\rangle\). Set \(g=\Lambda(u)u\). Uniqueness: if \(\langle f,g-g'\rangle=0\) for all \(f\), take \(f=g-g'\). The norm identity follows from Cauchy–Schwarz and \(\Lambda(g)=\|g\|^2\).

Fréchet spaces

The sequence space of Lesson 04 is not normed, but it is a complete metric vector space whose topology comes from the countable family of seminorms \(p_n(x)=|x_n|\). Stefan Banach called complete metrizable topological vector spaces “spaces (F)” in Fréchet’s honour in 1932. Today a Fréchet space is usually taken to be also locally convex: its topology is given by a translation-invariant complete metric built from countably many seminorms. Examples include \(C^\infty(\mathbb R)\), the holomorphic functions on a disc with uniform convergence on compact sets, and the Schwartz space of distribution theory. The open mapping and closed graph theorems hold for Fréchet spaces.

Exercise 6.1On \(L^2[0,1]\), find the representing \(g\) for \(\Lambda(f)=\int_0^{1/2}f(t)\,dt\), and compute \(\|\Lambda\|\).

Show solution
\(g=\mathbf 1_{[0,1/2]}\), since \(\Lambda(f)=\int fg\). Then \(\|\Lambda\|=\|g\|_2=(1/2)^{1/2}=1/\sqrt2\).

Exercise 6.2Show that point evaluation \(f\mapsto f(0)\) is not continuous on the polynomials with the \(L^2[0,1]\) norm, so the theorem says nothing about it.

Show solution
Let \(p_n(t)=(1-t)^n\). Then \(p_n(0)=1\) while \(\|p_n\|_2^2=\int_0^1(1-t)^{2n}dt=\frac1{2n+1}\to0\). A continuous functional would send \(p_n\) to values tending to 0.

Exercise 6.3Show that \(C^\infty[0,1]\) with \(d(f,g)=\sum_k2^{-k}\min\big(1,\|f^{(k)}-g^{(k)}\|_\infty\big)\) is complete.

Show solution
A Cauchy sequence \((f_m)\) has each derivative sequence \((f_m^{(k)})\) uniformly Cauchy, hence uniformly convergent to some \(g_k\). Uniform convergence of \(f_m^{(k)}\) and of \(f_m^{(k+1)}\) implies \(g_k\) is differentiable with \(g_k'=g_{k+1}\). So \(g_0\in C^\infty\) with \(g_0^{(k)}=g_k\), and \(f_m\to g_0\) in \(d\).
Lesson 07

The Fréchet derivative

For the general reader. The derivative of a function at a point is the best linear approximation to the function near that point. Fréchet took this sentence as the definition, which works whenever the inputs and outputs live in spaces where “linear” and “small” make sense. It is now how every analyst defines differentiability.

Goals
  • Define the Fréchet derivative and compare it with the Gateaux derivative.
  • Compute derivatives of functionals from the calculus of variations.
  • State the inverse function theorem in Banach spaces.
Definition (Fréchet, 1911; 1925)

Let \(X,Y\) be normed spaces and \(U\subseteq X\) open. A map \(F:U\to Y\) is Fréchet differentiable at \(x\in U\) if there is a bounded linear operator \(A:X\to Y\) with

\[ \lim_{h\to0}\frac{\|F(x+h)-F(x)-Ah\|_Y}{\|h\|_X}=0. \]

The operator \(A=DF(x)\) is unique and is called the derivative of \(F\) at \(x\).

Fréchet gave the definition in notes of 1911 and a paper of 1912, and developed it for general spaces in a 1925 paper in the Annales de l’École Normale Supérieure. In finite dimensions it is the total derivative already found in Karl Weierstrass’s lectures and in textbooks of Otto Stolz and W. H. Young; Fréchet’s contribution was to see it as the right definition in infinite dimensions.

The weaker Gateaux derivative asks only that \(\frac{d}{dt}F(x+th)\big|_{t=0}\) exist for each direction \(h\) and be linear in \(h\). A Fréchet differentiable map is Gateaux differentiable with the same derivative; the converse fails, because Fréchet’s definition demands the limit uniformly over directions.

Theorem (inverse function theorem)

Let \(X,Y\) be Banach spaces and \(F:U\to Y\) continuously Fréchet differentiable near \(x_0\), with \(DF(x_0)\) a bijection \(X\to Y\). Then \(F\) maps a neighbourhood of \(x_0\) bijectively onto a neighbourhood of \(F(x_0)\), with a continuously differentiable inverse.

The proof is the usual contraction-mapping argument applied to \(x\mapsto x-DF(x_0)^{-1}(F(x)-y)\); completeness of \(X\) is exactly what it needs. Through this theorem, Fréchet’s derivative is the basic tool for nonlinear partial differential equations.

Exercise 7.1On \(C[0,1]\) with the max norm, let \(J(u)=\int_0^1u(t)^2\,dt\). Compute \(DJ(u)\).

Show solution
\(J(u+h)-J(u)=\int2uh+\int h^2\). The map \(h\mapsto\int_0^12u h\) is bounded and linear, and \(|\int h^2|\le\|h\|_\infty^2=o(\|h\|_\infty)\). So \(DJ(u)h=2\int_0^1u(t)h(t)\,dt\).

Exercise 7.2Let \(f(x,y)=\frac{x^3y}{x^4+y^2}\) for \((x,y)\ne0\) and \(f(0)=0\). Show that every directional derivative at 0 is 0, but \(f\) is not Fréchet differentiable at 0.

Show solution
For \(h=(a,b)\) with \(b\ne0\): \(f(ta,tb)/t=\frac{t^4a^3b}{t(t^4a^4+t^2b^2)}=\frac{t\,a^3b}{t^2a^4+b^2}\to0\); for \(b=0\), \(f=0\). So the Gateaux derivative is 0. Along \(y=x^2\), \(f(x,x^2)=\frac{x^5}{2x^4}=\frac x2\), and \(|f(x,x^2)|/\|(x,x^2)\|\to\frac12\ne0\). So the zero map is not a Fréchet derivative, and no other candidate exists.

Exercise 7.3Use the chain rule to differentiate \(G(u)=\sin\!\big(J(u)\big)\), with \(J\) from Exercise 7.1.

Show solution
\(DG(u)h=\cos(J(u))\,DJ(u)h=2\cos\!\Big(\int_0^1u^2\Big)\int_0^1u\,h\,dt\).
Lesson 08

Abstract spaces without a distance

For the general reader. Some important kinds of convergence, such as pointwise convergence of functions, cannot be described by any distance. Fréchet looked for the weakest structure on which analysis still works, and his search helped produce general topology. His 1928 book Les espaces abstraits surveyed the field.

Goals
  • State Fréchet’s axioms for limit spaces (classes (L)).
  • Prove that pointwise convergence on \([0,1]\) is not metrizable.
  • Recognize the \(T_1\) axiom and Fréchet–Urysohn spaces.
Definition (Fréchet, 1906: classes (L))

A set \(E\) with a rule declaring certain sequences convergent to certain points, such that: (1) a constant sequence \(x,x,x,\dots\) converges to \(x\); (2) every subsequence of a sequence converging to \(x\) also converges to \(x\); (3) a sequence has at most one limit.

Closed sets are those containing the limits of their convergent sequences. Later authors added a fourth condition (if every subsequence has a further subsequence converging to \(x\), the sequence converges to \(x\)) to bring sequential convergence closer to topology. Fréchet also studied spaces defined by neighbourhoods, and Hausdorff’s 1914 axioms for topological spaces built partly on his work.

A topological space in which every single point is closed is now called a \(T_1\) space; older texts call it accessible, or a Fréchet space in a second sense. A Fréchet–Urysohn space is one where the closure of any set is obtained by adding limits of sequences from it. Metric spaces are Fréchet–Urysohn; many spaces of analysis are not.

Proposition

There is no metric on the set of real functions on \([0,1]\) whose convergent sequences are exactly the pointwise convergent ones, with the same limits.

Exercise 8.1 gives the proof.

Exercise 8.1Let \(\mathcal B_0\) be the continuous functions on \([0,1]\) and \(\mathcal B_1\) the pointwise limits of sequences from \(\mathcal B_0\). Show that in a metric space, a limit of limits of sequences from a set \(S\) is itself a limit of a sequence from \(S\). Then use the indicator function of \(\mathbb Q\cap[0,1]\) to prove the proposition.

Show solution
In a metric space, if \(y_k\to y\) and \(s_{k,m}\to y_k\) as \(m\to\infty\) with \(s_{k,m}\in S\), choose \(m_k\) with \(d(s_{k,m_k},y_k)<1/k\); then \(s_{k,m_k}\to y\). For pointwise convergence this fails. Enumerate the rationals as \(q_1,q_2,\dots\); the indicator \(g_k\) of \(\{q_1,\dots,q_k\}\) is a pointwise limit of continuous functions (narrow tents), so \(g_k\in\mathcal B_1\), and \(g_k\to\mathbf 1_{\mathbb Q}\) pointwise. But \(\mathbf 1_{\mathbb Q}\notin\mathcal B_1\): by René Baire’s theorem, a function of Baire class 1 has a point of continuity, and \(\mathbf 1_{\mathbb Q}\) is continuous nowhere. So pointwise convergence is not the convergence of any metric.

Exercise 8.2Show that every metric space is \(T_1\) and Fréchet–Urysohn.

Show solution
The complement of \(\{x\}\) is open: around \(y\ne x\), the ball of radius \(d(x,y)\) misses \(x\). If \(x\in\overline A\), choose \(a_n\in A\) with \(d(a_n,x)<1/n\); then \(a_n\to x\).
Lesson 09

The law of the largest value

For the general reader. How high will the highest flood of the next century be? Questions like this concern the largest of many random values. In 1927 Fréchet found one of the three possible limiting laws for such maxima, the one with a heavy tail, where rare values are much larger than typical ones. It is used today for floods, insurance losses and financial crashes.

Goals
  • Define max-stability and verify it for the Fréchet law.
  • Derive the Fréchet limit for Pareto-type tails.
  • State the Fisher–Tippett–Gnedenko theorem.

Let \(X_1,X_2,\dots\) be independent with common distribution function \(F\), and \(M_n=\max(X_1,\dots,X_n)\). Then \(P(M_n\le x)=F(x)^n\). One looks for constants \(a_n>0,b_n\) such that \((M_n-b_n)/a_n\) has a non-degenerate limit \(G\).

Definition (Fréchet, 1927)

The Fréchet distribution with shape \(\alpha>0\) has distribution function \(\Phi_\alpha(x)=\exp(-x^{-\alpha})\) for \(x>0\), and \(\Phi_\alpha(x)=0\) for \(x\le0\). It is max-stable: \(\Phi_\alpha(n^{1/\alpha}x)^n=\Phi_\alpha(x)\).

Theorem (Fisher–Tippett, 1928; Gnedenko, 1943)

If \((M_n-b_n)/a_n\) converges in distribution to a non-degenerate \(G\), then \(G\) is, up to a change of location and scale, one of: the Gumbel law \(\exp(-e^{-x})\); a Fréchet law \(\Phi_\alpha\); a reversed Weibull law \(\Psi_\alpha(x)=\exp(-(-x)^{\alpha})\) for \(x<0\). The limit is \(\Phi_\alpha\) exactly when \(1-F(x)=x^{-\alpha}L(x)\) with \(L\) slowly varying.

Fréchet’s paper appeared in the Annales de la Société Polonaise de Mathématique in 1927. Ronald Fisher and Leonard Tippett found all three forms in 1928, and Boris Gnedenko proved in 1943 that there are no others and gave the domains of attraction. The three families are now combined as the generalized extreme value distribution.

Exercise 9.1Let \(X_i\) have the Pareto law \(P(X>x)=x^{-\alpha}\) for \(x\ge1\). Show that \(P(M_n\le n^{1/\alpha}x)\to\Phi_\alpha(x)\) for \(x>0\).

Show solution
For large \(n\), \(n^{1/\alpha}x\ge1\), so \(P(M_n\le n^{1/\alpha}x)=\big(1-\frac{x^{-\alpha}}{n}\big)^n\to\exp(-x^{-\alpha})\).

Exercise 9.2Show that a Fréchet random variable with shape \(\alpha\) has finite mean iff \(\alpha>1\), and that its mean is then \(\Gamma(1-1/\alpha)\).

Show solution
If \(X\sim\Phi_\alpha\), then \(Y=X^{-\alpha}\) satisfies \(P(Y\ge y)=P(X\le y^{-1/\alpha})=e^{-y}\), so \(Y\) is exponential with mean 1. Then \(\mathbb E X=\mathbb E\,Y^{-1/\alpha}=\int_0^\infty y^{-1/\alpha}e^{-y}dy=\Gamma(1-1/\alpha)\), finite iff \(1-1/\alpha>0\).

Exercise 9.3If \(X_i\) are standard exponential, show \(M_n-\log n\) converges to the Gumbel law, so exponential tails are not in the Fréchet domain.

Show solution
\(P(M_n\le x+\log n)=(1-e^{-x}/n)^n\to\exp(-e^{-x})\). The tail \(e^{-x}\) decays faster than every power, so it is not of the form \(x^{-\alpha}L(x)\).
Lesson 10

Dependence, bounds and estimation

For the general reader. If you know the chance of rain and the chance of wind, what can you say about the chance of both? Without knowing how the two are linked, only a range. Fréchet found the exact range, for two events and for whole distributions. He also proved one of the first lower bounds on how accurately a parameter can be estimated from data.

Goals
  • Prove the Fréchet inequalities and the Fréchet–Hoeffding bounds.
  • Derive the information inequality for unbiased estimators.
  • Know Fréchet’s role in Markov chain theory.
Theorem (Fréchet inequalities, 1935)

For events \(A,B\): \(\max\big(0,P(A)+P(B)-1\big)\le P(A\cap B)\le\min\big(P(A),P(B)\big)\), and \(\max\big(P(A),P(B)\big)\le P(A\cup B)\le\min\big(1,P(A)+P(B)\big)\). All four bounds are attained.

Theorem (Hoeffding, 1940; Fréchet, 1951)

If \(H\) is a joint distribution function on \(\mathbb R^2\) with margins \(F\) and \(G\), then for all \(x,y\)

\[ \max\big(F(x)+G(y)-1,\,0\big)\le H(x,y)\le\min\big(F(x),G(y)\big), \]

and both bounds are themselves distribution functions with margins \(F,G\).

Wassily Hoeffding found these bounds in 1940 in a paper that went largely unread outside Germany; Fréchet found them independently in 1951. The upper bound is attained by comonotone pairs \((F^{-1}(U),G^{-1}(U))\), the lower by countermonotone pairs \((F^{-1}(U),G^{-1}(1-U))\), with \(U\) uniform on \([0,1]\). In copula language, every copula lies between \(W(u,v)=\max(u+v-1,0)\) and \(M(u,v)=\min(u,v)\).

The information inequality (1943)

Theorem (Fréchet 1943; Darmois 1945; Rao 1945; Cramér 1946)

Let \(X\) have density \(f(x;\theta)\) regular enough to differentiate under the integral sign, and \(I(\theta)=\mathbb E\big[(\partial_\theta\log f)^2\big]\). If \(T(X)\) is an unbiased estimator of \(\theta\), then \(\operatorname{Var}T\ge1/I(\theta)\).

The bound is usually named after Calyampudi Radhakrishna Rao and Harald Cramér. Fréchet’s 1943 paper and Georges Darmois’s of 1945 reached it independently, as did Alexander Aitken and Harold Silverstone in 1942.

Proof. Let \(S=\partial_\theta\log f(X;\theta)\). Then \(\mathbb E S=\int\partial_\theta f=0\). Differentiating \(\int T f=\theta\) gives \(\mathbb E[TS]=1\), so \(\operatorname{Cov}(T,S)=1\). Cauchy–Schwarz: \(1\le\operatorname{Var}T\cdot\operatorname{Var}S=\operatorname{Var}T\cdot I(\theta)\).

Markov chains

The second volume of Fréchet’s Recherches théoriques modernes sur la théorie des probabilités (1938) gave a systematic treatment of Markov chains with finitely many states, based on the matrix of transition probabilities. His student Wolfgang Doeblin, in a thesis of 1938, extended the theory to general state spaces with the coupling method and the condition now named after him. In the 1930s Fréchet also campaigned against careless uses of the correlation coefficient as a measure of dependence.

Exercise 10.1If \(P(A)=0.7\) and \(P(B)=0.6\), find the range of \(P(A\cap B)\) and give examples attaining both ends.

Show solution
\(0.3\le P(A\cap B)\le0.6\). With \(U\) uniform on \([0,1]\): \(A=\{U\le0.7\},B=\{U\le0.6\}\) give 0.6; \(A=\{U\le0.7\},B=\{U>0.4\}\) give \(P(0.4<U\le0.7)=0.3\).

Exercise 10.2For \(X\sim N(\theta,\sigma^2)\) with \(n\) independent observations, compute \(I_n(\theta)\) and show that the sample mean attains the bound.

Show solution
For one observation, \(\partial_\theta\log f=(x-\theta)/\sigma^2\), so \(I(\theta)=1/\sigma^2\); for \(n\) observations, \(I_n=n/\sigma^2\). The sample mean is unbiased with variance \(\sigma^2/n=1/I_n\).

Exercise 10.3Prove the upper Fréchet–Hoeffding bound \(H(x,y)\le\min(F(x),G(y))\) and check that \((F^{-1}(U),G^{-1}(U))\) attains it when \(F,G\) are continuous and strictly increasing.

Show solution
\(\{X\le x,Y\le y\}\subseteq\{X\le x\}\) and \(\subseteq\{Y\le y\}\). For the pair, \(F^{-1}(U)\le x\iff U\le F(x)\), so \(H(x,y)=P(U\le F(x),U\le G(y))=\min(F(x),G(y))\).
Part III · Life and legacy
Lesson 11

Strasbourg and Paris, 1919–1949

After the war Alsace returned to France, and the French state rebuilt the University of Strasbourg as a showcase of French science. In 1919 Fréchet became its professor of higher analysis and director of its Mathematics Institute. At Strasbourg he began the work in probability and statistics that occupied much of the rest of his career. His first doctoral students, Ben-Zion Linfield (1925) and Feliks Burdecki (1926), finished there.

In 1928 he moved to Paris, first as a Rockefeller Foundation lecturer and then as professor at the Sorbonne, while also lecturing at the École Normale Supérieure until 1935. He held successive chairs of general mathematics (1933), differential and integral calculus (1935) and, from 1941, the calculus of probabilities and mathematical physics. The same year, 1928, he published Les espaces abstraits and was an invited speaker at the International Congress of Mathematicians in Bologna. In 1929 the Polish Academy elected him a foreign member, a sign of his close ties to the Warsaw school around Wacław Sierpiński.

Paris in the 1930s was a centre of probability, and Fréchet’s seminar trained many of its leaders. His doctoral students included Kinjirô Kunugui (1930), Nachman Aronszajn and Đuro Kurepa (1935), António Monteiro (1936), Wolfgang Doeblin (1938), Robert Fortet and Jean Ville (1939), and Ky Fan and Michel Loève (1941). Ville introduced martingales into probability in his thesis; Loève later built probability at Berkeley; Ky Fan co-wrote with Fréchet a book on combinatorial topology (1946). Doeblin, mobilized in 1939, took his own life in 1940 rather than be captured, leaving a sealed envelope at the Academy whose contents, opened in 2000, anticipated parts of stochastic calculus.

DiscussionFréchet moved from abstract spaces to statistics in mid-career. Which of his ideas from Part II carried over into the probability lessons, and what does that suggest about the value of abstraction for applied work?

Lesson 12

Late recognition and legacy, 1949–1973

Fréchet retired from his chair in 1949 but kept publishing for two more decades, including the anthology Pages choisies d’analyse générale (1953) and the essays Les mathématiques et le concret (1955). Recognition in France came late. He failed in several elections to the Académie des sciences before he was elected in 1956, aged 78. Abroad he was a Fellow of the Royal Society of Edinburgh (1947) and a foreign member of the Royal Netherlands Academy of Arts and Sciences (1950).

He was a committed supporter of Esperanto, published scientific articles in it, and from 1950 to 1953 presided over the International Association of Esperantist Scientists. He died in Paris on 4 June 1973, aged 94.

Legacy

  • Analysis: metric spaces, abstract compactness and function spaces are the setting of modern analysis; Banach and Hilbert spaces grew from his framework.
  • Calculus in infinite dimensions: the Fréchet derivative is the standard definition, and Fréchet spaces are the setting for distributions and smooth function spaces.
  • Topology: his abstract spaces fed directly into the axioms of general topology.
  • Probability and statistics: the Fréchet extreme-value law, the Fréchet bounds of copula theory, the Fréchet distance between curves, and the Fréchet mean in metric spaces are used across statistics, finance and computational geometry.

Final projectChoose one theorem from Part II. Write a two-page account for a strong undergraduate that states it, works one example in full, and shows how Fréchet’s abstract formulation lets the same proof work in a space of functions as well as in \(\mathbb R^n\).

Reference

Connections

People linked to Maurice Fréchet across this collection. A name without a link has no page here yet. See Maurice Fréchet in the network of all 337 lives →

Teachers and advisors

Students

  • André Blanc-Lapierre 1945
  • António Monteiro 1936
  • Ben-Zion Linfield 1925
  • Christian Pauc 1939
  • Jean Ville 1939
  • Kinjirô Kunugui 1930
  • Ky Fan 1941
  • Michel Loève 1941
  • Nachman Aronszajn 1935
  • Robert Fortet 1939
  • Wolfgang Doeblin 1938
  • Đuro Kurepa 1935

Influenced by

Influenced

Colleagues and collaborators

Rivals

Also mentioned in this life

Fields

On CoursesHub

Reference

Sources and further reading

Biography

  1. J. J. O’Connor and E. F. Robertson, René Maurice Fréchet, MacTutor History of Mathematics.
  2. Maurice Fréchet, Wikipedia.
  3. (René) Maurice Fréchet, Mathematics Genealogy Project.
  4. A. E. Taylor, A study of Maurice Fréchet I–III, Archive for History of Exact Sciences 27 (1982), 34 (1985), 37 (1987).

Mathematics

  1. M. Fréchet, Sur quelques points du calcul fonctionnel, Rend. Circ. Mat. Palermo 22 (1906), 1–74.
  2. M. Fréchet, Sur les ensembles de fonctions et les opérations linéaires, C. R. Acad. Sci. Paris 144 (1907); F. Riesz, Sur une espèce de géométrie analytique des systèmes de fonctions sommables, same volume.
  3. M. Fréchet, Les dimensions d’un ensemble abstrait, Math. Ann. 68 (1910).
  4. M. Fréchet, Sur la notion de différentielle, C. R. Acad. Sci. Paris 152 (1911); La notion de différentielle dans l’analyse générale, Ann. Sci. ENS 42 (1925).
  5. M. Fréchet, Sur la loi de probabilité de l’écart maximum, Ann. Soc. Polon. Math. 6 (1927), 93.
  6. M. Fréchet, Les espaces abstraits, Gauthier-Villars, 1928.
  7. M. Fréchet, Généralisations du théorème des probabilités totales, Fund. Math. 25 (1935), 379–387.
  8. M. Fréchet, Sur l’extension de certaines évaluations statistiques au cas de petits échantillons, Rev. Inst. Internat. Statist. 11 (1943).
  9. M. Fréchet, Sur les tableaux de corrélation dont les marges sont données, Ann. Univ. Lyon, Sect. A, 9 (1951), 53–77.
  10. R. A. Fisher and L. H. C. Tippett, Limiting forms of the frequency distribution of the largest or smallest member of a sample, Proc. Cambridge Philos. Soc. 24 (1928).
  11. H. Alt and M. Godau, Computing the Fréchet distance between two polygonal curves, Int. J. Comput. Geom. Appl. 5 (1995).
  12. Fréchet differential, Encyclopedia of Mathematics.