courseshub.world · Lives in Mathematics and Physics

Alonzo Church

Alonzo Church

A course in two strands: the life of the meticulous Princeton logician who built a school and a journal for his subject, and the λ-calculus, the thesis about computability and the undecidability theorem that made him a founder of computer science.

Born 14 June 1903, Washington, D.C. Died 11 August 1995, Hudson, Ohio Church’s theorem 1936 Level advanced undergraduate → graduate
Every way of reducing (λx. f x x)(I a), with I = λy. y, ends in the same normal form f a a. This is the Church–Rosser theorem in miniature.
Lesson 00

How to use this course

Alonzo Church spent almost his entire career at two universities and left a mark on three subjects. In mathematical logic he proved, in 1936, that first-order logic is undecidable, and gave with his students the first precise definition of an effectively calculable function. In computer science his λ-calculus became the core of functional programming, of the theory of programming languages and of modern proof assistants. In philosophy he developed an intensional logic of meaning and kept it going for half a century. He also founded, with others, the Journal of Symbolic Logic and edited its reviews for 43 years, and he supervised 31 doctoral students, among them Alan Turing.

Prerequisites for Part II
  • First-order logic: formulas, proofs, models, Gödel’s completeness theorem.
  • The idea of Gödel numbering and of recursive (computable) functions.
  • Basic probability for Lesson 09.
  • The Turing course on this site (Lessons 04 and 05) is a useful companion to Lessons 06 and 07.

Each technical lesson opens with a paragraph for the general reader, then gives precise statements, proof sketches and exercises with folded solutions. We write λ-terms in modern notation, \(\lambda x.\,M\), where Church wrote \(\lambda x[M]\). Lessons 04 to 07 follow the work of 1932–1936; Lesson 08 the type theory of 1940; Lessons 09 and 10 his later work in probability, automata and philosophical logic.

Reference

Timeline

1903Born 14 June in Washington, D.C., son of Samuel Robbins Church, a judge of the Municipal Court of the District of Columbia, and Mildred Hannah Letterman Parker.
1920Graduates from the Ridgefield School for Boys in Connecticut; enters Princeton.
1924A.B. in mathematics at Princeton. First paper, on Lorentz transformations.
1927PhD at Princeton under Oswald Veblen, Alternatives to Zermelo’s Assumption.
1927–29National Research Fellow: a year at Harvard, then a year at Göttingen and Amsterdam.
1929Assistant professor of mathematics at Princeton.
1932–33“A set of postulates for the foundation of logic”, two parts, in the Annals of Mathematics: the λ-calculus is born inside a larger logical system.
1934Doctorates of his students Stephen Kleene and J. Barkley Rosser.
1935Kleene and Rosser prove Church’s logical system inconsistent. Church announces his thesis on effective calculability.
1936“An unsolvable problem of elementary number theory”; “A note on the Entscheidungsproblem” in the first volume of the Journal of Symbolic Logic; Church–Rosser theorem. Turing arrives in Princeton in September.
1936–79Editor of the Journal of Symbolic Logic, in charge of its reviews section.
1938Turing’s PhD under Church.
1939Associate professor.
1940“A formulation of the simple theory of types”; “On the concept of a random sequence”.
1941The Calculi of Lambda-Conversion.
1944Introduction to Mathematical Logic, Part I (first version).
1947Professor of mathematics at Princeton.
1951“A formulation of the logic of sense and denotation”.
1956Introduction to Mathematical Logic, Volume I, revised and enlarged.
1957Poses the circuit synthesis problem at the Cornell summer institute in logic.
1961Professor of mathematics and philosophy.
1962Invited address at the International Congress of Mathematicians, Stockholm.
1967Moves to UCLA as professor of philosophy and mathematics. Elected to the American Academy of Arts and Sciences.
1978Elected to the National Academy of Sciences.
1990Retires from UCLA. Honorary degree from SUNY Buffalo at a symposium in his honour.
1995Dies 11 August in Hudson, Ohio, aged 92. Buried in Princeton Cemetery.
Part I · Formation
Lesson 01

Washington, Ridgefield, Princeton, 1903–1927

Alonzo Church was born in Washington, D.C., on 14 June 1903. His father, Samuel Robbins Church, was a judge of the Municipal Court of the District of Columbia. The family had academic roots: Church’s great-grandfather, also named Alonzo Church, had been professor of mathematics and astronomy and later president of the University of Georgia, and his grandfather Alonzo Webster Church was Librarian of the United States Senate for twenty years.

As a boy Church was blinded in one eye by an air-gun accident. His father’s eyesight also failed, forcing him to give up his position, and the family moved to Virginia. With help from an uncle, Alonzo went to the Ridgefield School for Boys in Connecticut, where he helped edit the school magazine, and graduated in 1920.

Princeton

He entered Princeton in 1920 and stayed, apart from three years, for almost half a century. As an undergraduate he won the Class of 1861 Prize, was elected to Phi Beta Kappa and in 1924 published his first paper, on Lorentz transformations. He graduated A.B. in 1924 and went straight into graduate work under Oswald Veblen, the geometer who was building Princeton into a mathematical centre. While still a graduate student he married Mary Julia Kuczinski; they had three children.

His doctoral thesis, Alternatives to Zermelo’s Assumption (1927), studied what happens to set theory if the axiom of choice is replaced by alternatives, in the spirit of the non-Euclidean geometries that arise from replacing the parallel postulate. It marked the direction of his work: foundations, treated with complete formal precision.

Lesson 02

A new foundation for logic, 1927–1935

After the PhD Church held a National Research Fellowship for two years: 1927–28 at Harvard, and 1928–29 at Göttingen and Amsterdam, the homes of David Hilbert’s formalism and L. E. J. Brouwer’s intuitionism. Hilbert’s programme was at its height, and the Entscheidungsproblem, the problem of finding a procedure to decide validity in first-order logic, had just been posed sharply by Hilbert and Wilhelm Ackermann in their 1928 textbook. In 1929 Church returned to Princeton as an assistant professor of mathematics.

The postulates of 1932–33

Church’s plan was a new foundation for logic that avoided both Bertrand Russell’s theory of types and the free variables of ordinary logic. In “A set of postulates for the foundation of logic”, published in two parts in the Annals of Mathematics in 1932 and 1933, every notion was built from functions, written with an abstraction operator \(\lambda\). Logical constants such as implication and the universal quantifier were functions too. To escape the paradoxes he restricted the law of excluded middle.

Two graduate students, Stephen Kleene and J. Barkley Rosser, worked on the system with him and received their doctorates in 1934. They developed the arithmetic of the pure function part. Kleene showed that a surprisingly wide class of number-theoretic functions could be defined in it, including the predecessor function, which Church had doubted was definable at all.

In 1935 Kleene and Rosser proved that the whole system was inconsistent: a version of the Richard paradox could be derived. Church abandoned the logic. He kept the part concerned only with functions and their application, which was consistent. This was the λ-calculus. In the same years Kurt Gödel lectured at Princeton (1934) on the incompleteness theorems and on recursive functions. When Church suggested that λ-definability captured exactly the effectively calculable functions, Gödel was unconvinced. The resolution of that disagreement is the subject of Lesson 06.

Lesson 03

1936

In 1935 Church announced, and in 1936 published, a definite claim: a function of positive integers is effectively calculable if and only if it is λ-definable, or equivalently, by work of Kleene, general recursive in the sense of Jacques Herbrand and Gödel. With this definition he could, for the first time, prove that some problems have no algorithmic solution. His paper “An unsolvable problem of elementary number theory” appeared in the American Journal of Mathematics in 1936. Within weeks he applied it to Hilbert’s problem: “A note on the Entscheidungsproblem”, in the first volume of the new Journal of Symbolic Logic, proved that no such decision procedure exists. With Rosser he proved the confluence theorem that now carries both names.

In Cambridge, Alan Turing reached the same negative answer independently, with his machines. Max Newman wrote to Church that Turing’s work was independent and different in method, and recommended him. Turing proved that his computable functions were exactly the λ-definable ones and arrived in September 1936. He wrote his thesis under Church on ordinal logics and received the PhD in 1938. Church, reviewing Turing’s paper in the Journal of Symbolic Logic in 1937, coined the term “Turing machine” and wrote that Turing’s analysis made the identification of computability with effectiveness evident immediately.

1936 was also the year the Association for Symbolic Logic was founded and its journal launched. Church was one of the principal founders and the journal’s first editor. Through its reviews section, which he ran until 1979, he set a standard of rigour for the whole field.

Part II · The mathematics
Lesson 04

The λ-calculus

For the general reader. The λ-calculus is a language with only three kinds of expression: variables, functions and applications of functions to arguments. There are no numbers, no truth values and no loops. Church and Kleene showed that numbers, arithmetic, logic and recursion can all be coded in it. It is the smallest programming language, and every functional language, from Lisp to Haskell, is built on it.

Goals
  • Define λ-terms, free variables, substitution and β-reduction.
  • Code numerals, arithmetic and booleans as λ-terms.
  • Understand the definition of λ-definable functions.

Syntax

Definition (λ-terms and β-reduction)

Terms are built from variables by abstraction and application: \(M::=x\mid \lambda x.\,M\mid (M\,N)\). Application associates to the left, and \(\lambda x.\) extends as far right as possible. In \(\lambda x.\,M\) the variable \(x\) is bound; terms that differ only in the names of bound variables (α-equivalent terms) are identified. The basic rule is

\[ (\lambda x.\,M)\,N \;\to_\beta\; M[x:=N], \]

where \(M[x:=N]\) replaces the free occurrences of \(x\) in \(M\) by \(N\), renaming bound variables of \(M\) to avoid capturing free variables of \(N\). One-step reduction applies this rule to any subterm; \(\twoheadrightarrow_\beta\) is its reflexive transitive closure, and \(=_\beta\) the equivalence relation it generates (Church’s “conversion”). A term with no subterm of the form \((\lambda x.M)N\) is in normal form.

Church’s own system, the λI-calculus, required \(x\) to occur free in \(M\) in every \(\lambda x.\,M\). The unrestricted version above, called the λK-calculus, is the one used today.

Church numerals

A natural number \(n\) is represented by the operation “apply a function \(n\) times”:

\[ \overline n=\lambda f.\,\lambda x.\,\underbrace{f(f(\cdots(f}_{n}\,x)\cdots)),\qquad \overline0=\lambda f.\,\lambda x.\,x,\quad \overline1=\lambda f.\,\lambda x.\,f\,x. \]

Successor, addition and multiplication are then

\[ \mathsf{S}=\lambda n.\,\lambda f.\,\lambda x.\,f\,(n\,f\,x),\qquad \mathsf{add}=\lambda m.\,\lambda n.\,\lambda f.\,\lambda x.\,m\,f\,(n\,f\,x),\qquad \mathsf{mul}=\lambda m.\,\lambda n.\,\lambda f.\,m\,(n\,f). \]
Definition (λ-definability)

A partial function \(\varphi:\mathbb N^k\to\mathbb N\) is λ-definable if there is a term \(F\) such that for all \(n_1,\dots,n_k\): if \(\varphi(n_1,\dots,n_k)=m\) then \(F\,\overline{n_1}\cdots\overline{n_k}=_\beta\overline m\), and if \(\varphi(n_1,\dots,n_k)\) is undefined then \(F\,\overline{n_1}\cdots\overline{n_k}\) has no normal form.

Booleans are coded as selectors, \(\mathsf T=\lambda x.\,\lambda y.\,x\) and \(\mathsf F=\lambda x.\,\lambda y.\,y\), so that “if \(B\) then \(M\) else \(N\)” is simply \(B\,M\,N\). Pairs are \(\langle M,N\rangle=\lambda z.\,z\,M\,N\), with projections obtained by applying to \(\mathsf T\) and \(\mathsf F\). These codings are now called Church encodings.

Exercise 4.1Reduce \(\mathsf{add}\,\overline1\,\overline1\) to normal form.

Show solution
\(\mathsf{add}\,\overline1\,\overline1\twoheadrightarrow\lambda f.\lambda x.\,\overline1\,f\,(\overline1\,f\,x)\). Now \(\overline1\,f\,x\to f\,x\), and \(\overline1\,f\,(f\,x)\to f\,(f\,x)\). The result is \(\lambda f.\lambda x.\,f(f\,x)=\overline2\).

Exercise 4.2Show that \(\mathsf{exp}=\lambda m.\,\lambda n.\,n\,m\) satisfies \(\mathsf{exp}\,\overline m\,\overline 2=_\beta\overline{m^2}\). What goes wrong for \(\overline1\)?

Show solution
\(\mathsf{exp}\,\overline m\,\overline2\twoheadrightarrow\overline2\,\overline m\to\lambda x.\,\overline m\,(\overline m\,x)\). Here \(\overline m\,x\to\lambda y.\,x^m y\), where \(x^m y\) means \(x(x(\cdots(x\,y)))\) with \(m\) copies of \(x\). Then \(\overline m\,(\lambda y.\,x^my)\to\lambda z.\,(\lambda y.x^my)^m z\twoheadrightarrow\lambda z.\,x^{m\cdot m}z\). So the result is \(\lambda x.\lambda z.\,x^{m^2}z=\overline{m^2}\). The same computation gives \(\overline n\,\overline m=_\beta\overline{m^n}\) for every \(n\ge2\). For \(n=1\), \(\overline1\,\overline m\twoheadrightarrow\lambda x.\,\overline m\,x\), which is a normal form different from \(\overline m\); the two are equal only under the extra η-rule \(\lambda x.\,Mx=M\).

Exercise 4.3Kleene’s predecessor. Let \(\Phi=\lambda p.\,\langle\mathsf S\,(p\,\mathsf T),\ p\,\mathsf T\rangle\) and \(\mathsf P=\lambda n.\,(n\,\Phi\,\langle\overline0,\overline0\rangle)\,\mathsf F\). Show \(\mathsf P\,\overline{n+1}=_\beta\overline n\) and \(\mathsf P\,\overline0=_\beta\overline0\).

Show solution
\(\Phi\) maps the pair \(\langle\overline k,\overline j\rangle\) to \(\langle\overline{k+1},\overline k\rangle\). Starting from \(\langle\overline0,\overline0\rangle\) and applying \(\Phi\) \(n\) times gives \(\langle\overline n,\overline{n-1}\rangle\) for \(n\ge1\), and \(\langle\overline0,\overline0\rangle\) for \(n=0\). Applying the pair to \(\mathsf F\) selects the second component: \(\overline{n-1}\), or \(\overline0\) when \(n=0\). The trick is to carry the previous value along, which is how primitive recursion is coded in general.
Lesson 05

Confluence and fixed points

For the general reader. A λ-term can usually be simplified in several places, in any order. Could different orders give different answers? Church and Rosser proved in 1936 that they cannot: if a term has a final answer, it is unique. The proof guarantees that the calculus is consistent as a theory of computation. Meanwhile the same calculus allows a term to be applied to itself, which yields fixed-point combinators: the means by which recursion, and the paradoxes that sank Church’s logic, both arise.

Goals
  • State and prove the Church–Rosser theorem via parallel reduction.
  • Deduce uniqueness of normal forms and consistency.
  • Construct fixed-point combinators and use them to define recursive functions.
Theorem (Church–Rosser, 1936)

If \(M\twoheadrightarrow_\beta N_1\) and \(M\twoheadrightarrow_\beta N_2\), then there is a term \(L\) with \(N_1\twoheadrightarrow_\beta L\) and \(N_2\twoheadrightarrow_\beta L\). Consequently, if \(M=_\beta N\) then \(M\) and \(N\) reduce to a common term, and a term has at most one normal form (up to α-equivalence).

Proof sketch

One-step reduction does not have the diamond property: in \((\lambda x.\,x\,x)\,(I\,a)\), contracting the inner redex first and then the outer gives \(a\,a\) in two steps, while contracting the outer first duplicates the inner redex and needs three. The standard proof, due to William Tait and Per Martin-Löf, uses parallel reduction \(\Rightarrow\): \(x\Rightarrow x\); if \(M\Rightarrow M'\) then \(\lambda x.M\Rightarrow\lambda x.M'\); if \(M\Rightarrow M'\) and \(N\Rightarrow N'\) then \(MN\Rightarrow M'N'\) and \((\lambda x.M)N\Rightarrow M'[x:=N']\).

  1. \(\to_\beta\ \subseteq\ \Rightarrow\ \subseteq\ \twoheadrightarrow_\beta\), so \(\Rightarrow\) and \(\to_\beta\) have the same reflexive transitive closure.
  2. Define \(M^*\) by contracting all redexes of \(M\) at once: \(x^*=x\), \((\lambda x.M)^*=\lambda x.M^*\), \(((\lambda x.M)N)^*=M^*[x:=N^*]\), and \((MN)^*=M^*N^*\) otherwise. By induction on \(M\), using a substitution lemma, \(M\Rightarrow N\) implies \(N\Rightarrow M^*\).
  3. So \(\Rightarrow\) has the diamond property, and a diamond property passes to the transitive closure by tiling. ∎

If \(M=_\beta N\), the chain of reductions and expansions joining them is straightened by repeated use of the theorem. If \(N_1,N_2\) are normal forms of \(M\), their common reduct must equal both. In particular \(\mathsf T\ne_\beta\mathsf F\) and \(\overline m\ne_\beta\overline n\) for \(m\ne n\): the equational theory is consistent.

Fixed points

Theorem (fixed points)

Let \(\mathsf Y=\lambda f.\,(\lambda x.\,f(x\,x))\,(\lambda x.\,f(x\,x))\). Then \(\mathsf Y\,F=_\beta F\,(\mathsf Y\,F)\) for every term \(F\). Turing’s combinator \(\Theta=(\lambda x.\lambda f.\,f\,(x\,x\,f))\,(\lambda x.\lambda f.\,f\,(x\,x\,f))\) satisfies the stronger \(\Theta\,F\twoheadrightarrow_\beta F\,(\Theta\,F)\).

The combinator \(\mathsf Y\) is usually credited to Haskell Curry; Turing published \(\Theta\) in 1937. With a fixed point, any recursive definition \(g=F\,g\) has a solution \(g=\mathsf Y F\). Inside a logic, the same construction applied to negation produces a sentence equal to its own negation, which is how paradoxes entered Church’s 1932 system.

Normal forms and strategies

The term \(\Omega=(\lambda x.\,x\,x)(\lambda x.\,x\,x)\) reduces only to itself and has no normal form. The term \((\lambda x.\,y)\,\Omega\) has normal form \(y\), but reducing inside \(\Omega\) first loops forever. The standardization theorem of Curry and Robert Feys says that always contracting the leftmost outermost redex (normal-order reduction) reaches the normal form whenever one exists.

Exercise 5.1Verify \(\mathsf Y\,F=_\beta F\,(\mathsf Y\,F)\). Why does \(\mathsf Y F\) not reduce to \(F(\mathsf Y F)\)?

Show solution
\(\mathsf Y F\to W\,W\) with \(W=\lambda x.\,F(x\,x)\), and \(W\,W\to F(W\,W)\). Also \(F(\mathsf Y F)\to F(W\,W)\). Both sides reduce to \(F(W\,W)\), so they are convertible. But \(\mathsf Y F\) never reduces to \(F(\mathsf YF)\) itself, since \(\mathsf Y\) disappears in the first step; the connection goes through a common reduct, as Church–Rosser predicts.

Exercise 5.2Using \(\mathsf Y\), an \(\mathsf{iszero}=\lambda n.\,n\,(\lambda z.\,\mathsf F)\,\mathsf T\) and Kleene’s predecessor \(\mathsf P\), write a term for the factorial function.

Show solution
\(\mathsf{fact}=\mathsf Y\,\big(\lambda g.\,\lambda n.\ \mathsf{iszero}\,n\ \overline1\ (\mathsf{mul}\,n\,(g\,(\mathsf P\,n)))\big)\). Check \(\mathsf{iszero}\,\overline0=\mathsf T\) and \(\mathsf{iszero}\,\overline{n+1}=(\lambda z.\mathsf F)(\cdots)=\mathsf F\). Under normal-order reduction the unused branch is never evaluated, so \(\mathsf{fact}\,\overline3\) reduces to \(\overline6\).

Exercise 5.3Show that the λ-calculus extended with the single equation \(\mathsf T=\mathsf F\) proves every equation.

Show solution
For any \(M,N\): \(M=_\beta\mathsf T\,M\,N=\mathsf F\,M\,N=_\beta N\). So consistency of the pure calculus, which follows from Church–Rosser, is a genuine content: it says \(\mathsf T\) and \(\mathsf F\) are distinct.
Lesson 06

Church’s thesis and an unsolvable problem

For the general reader. To prove that no algorithm solves a problem, one first needs to say exactly what an algorithm is. Church proposed that the functions computable by any mechanical method are exactly those definable in his λ-calculus, which turned out to be exactly the recursive functions of Herbrand and Gödel, and exactly those computable by Turing’s machines. With this definition in hand, he exhibited a precise question about λ-terms that no algorithm can answer.

Goals
  • State Church’s thesis and the equivalence theorems that support it.
  • Prove the second recursion theorem for the λ-calculus.
  • Prove that having a normal form is undecidable.

The equivalences

Theorem (Kleene 1936; Turing 1937)

For a partial function \(\varphi:\mathbb N^k\to\mathbb N\), the following are equivalent: (i) \(\varphi\) is λ-definable; (ii) \(\varphi\) is partial recursive (general recursive in the Herbrand–Gödel sense, with Kleene’s minimization); (iii) \(\varphi\) is computable by a Turing machine.

Kleene proved (i)⇔(ii) in “λ-definability and recursiveness” (1936); Turing proved (i)⇔(iii) in 1937. The proof of (ii)⇒(i) codes the initial functions, composition, primitive recursion (as in Exercise 4.3) and minimization (by a fixed-point search, as in Exercise 5.2). The proof of (i)⇒(ii) Gödel-numbers terms and observes that one-step reduction is primitive recursive, so that the value is found by searching for a reduction sequence ending in a numeral.

Church’s thesis (1936)

A function of positive integers is effectively calculable if and only if it is λ-definable, equivalently general recursive.

The thesis relates an informal notion to a formal one, so it is not a theorem. Church’s arguments were the equivalence of independent definitions and the fact that every known calculable function fell under them. Gödel accepted the thesis only after reading Turing’s analysis of what a human computer does. The combined claim is now called the Church–Turing thesis.

Self-reference in the calculus

Fix a computable Gödel numbering of terms, and write \(\ulcorner M\urcorner\) for the Church numeral of the code of \(M\).

Theorem (second fixed-point theorem)

For every term \(F\) there is a term \(X\) with \(F\,\ulcorner X\urcorner=_\beta X\).

Proof. There are terms \(\mathsf{App}\) and \(\mathsf{Num}\) with \(\mathsf{App}\,\ulcorner M\urcorner\,\ulcorner N\urcorner=_\beta\ulcorner MN\urcorner\) and \(\mathsf{Num}\,\ulcorner M\urcorner=_\beta\ulcorner\ulcorner M\urcorner\urcorner\), since both operations on codes are recursive. Let \(W=\lambda x.\,F\,(\mathsf{App}\,x\,(\mathsf{Num}\,x))\) and \(X=W\,\ulcorner W\urcorner\). Then \(X=_\beta F\,(\mathsf{App}\,\ulcorner W\urcorner\,\ulcorner\ulcorner W\urcorner\urcorner)=_\beta F\,\ulcorner W\,\ulcorner W\urcorner\urcorner=F\,\ulcorner X\urcorner\). ∎

Theorem (Church, 1936)

There is no λ-definable (equivalently, recursive) function that decides, given the code of a term, whether the term has a normal form. Equivalently, no recursive function decides \(=_\beta\) between two terms.

Proof (in the form given by Dana Scott and Curry). Suppose \(D\) is a term with \(D\,\ulcorner M\urcorner=_\beta\mathsf T\) if \(M\) has a normal form and \(\mathsf F\) otherwise. Let \(F=\lambda n.\,D\,n\,\Omega\,\overline0\) and take \(X\) with \(F\,\ulcorner X\urcorner=_\beta X\). If \(X\) has a normal form, \(D\,\ulcorner X\urcorner=\mathsf T\) and \(X=_\beta\Omega\), which has none, contradicting Church–Rosser. If not, \(X=_\beta\overline0\), which is normal. ∎ Church’s own 1936 paper reached the same conclusion through Gödel numbering and a diagonal argument on recursive functions. Since equality of terms is a question about integers once terms are coded, he described it as an unsolvable problem of elementary number theory.

Exercise 6.1Show that the set of codes of terms that have a normal form is recursively enumerable.

Show solution
Enumerate all pairs \((M,s)\) where \(s\) is a finite reduction sequence starting at \(M\), and list \(M\) whenever \(s\) ends in a normal form. Checking that a sequence is a valid reduction and that its last term is normal is decidable. So the set is r.e. but, by Church’s theorem, not recursive; its complement is not r.e.

Exercise 6.2Scott’s theorem. Let \(A\) be a set of terms closed under \(=_\beta\), with \(A\ne\emptyset\) and \(A\) not containing all terms. Show that \(\{\ulcorner M\urcorner:M\in A\}\) is not recursive.

Show solution
Pick \(M_0\in A\) and \(M_1\notin A\). If a term \(D\) decided membership, let \(F=\lambda n.\,D\,n\,M_1\,M_0\) and take \(X=_\beta F\ulcorner X\urcorner\). If \(X\in A\), then \(X=_\beta M_1\notin A\), contradicting closure. If \(X\notin A\), then \(X=_\beta M_0\in A\), a contradiction. Church’s theorem is the case \(A=\{\)terms with normal form\(\}\).

Exercise 6.3Explain why the definition of λ-definability for partial functions uses “has no normal form” for undefined values, and why a total λ-definable function cannot always be extended by checking first whether its argument terms normalize.

Show solution
An undefined value corresponds to a computation that never finishes, and a term with no normal form is exactly a computation that never yields a numeral. One cannot first test whether \(F\,\overline n\) normalizes, since that test is the undecidable problem of the theorem. This is the λ-calculus version of the halting problem.
Lesson 07

Church’s theorem

For the general reader. Hilbert hoped for a mechanical test that would decide, for any statement of logic, whether it follows from given axioms. Church proved in 1936 that no such test exists; Turing found a different proof weeks later. Logic can be searched for proofs, and every valid statement will eventually be found, but there is no procedure that also recognizes the statements that are not valid.

Goals
  • State Church’s theorem precisely and see why validity is semi-decidable.
  • Prove it from the undecidability of a finitely axiomatized arithmetic.
  • Compare decidable fragments.
Theorem (Church, 1936)

Let the first-order language contain a binary relation symbol and enough further symbols to express arithmetic (in fact a single binary relation suffices). Then the set of valid sentences, equivalently, by Gödel’s completeness theorem, the set of sentences provable in first-order logic, is not recursive.

Proof sketch

Let \(\mathsf Q\) be Raphael Robinson’s arithmetic (1950): seven axioms about \(0\), successor, addition and multiplication, without induction. Its key property is that every recursive function is representable in \(\mathsf Q\): for recursive \(\varphi\) there is a formula \(\psi(x,y)\) with \(\mathsf Q\vdash\forall y\,(\psi(\overline n,y)\leftrightarrow y=\overline{\varphi(n)})\).

  1. \(\mathsf Q\) is undecidable. If \(\{\ulcorner\sigma\urcorner:\mathsf Q\vdash\sigma\}\) were recursive, a diagonal argument as in Lesson 06 (or in Gödel’s theorem) produces a sentence \(\sigma\) with \(\mathsf Q\vdash\sigma\leftrightarrow\neg\mathrm{Thm}(\ulcorner\sigma\urcorner)\), where \(\mathrm{Thm}\) represents the decidable theoremhood; either answer yields a contradiction, since \(\mathsf Q\) is consistent (it has the standard model).
  2. Reduction to logic. Let \(\bigwedge\mathsf Q\) be the conjunction of the seven axioms. Then \(\mathsf Q\vdash\sigma\) iff \(\bigwedge\mathsf Q\to\sigma\) is valid. A decision procedure for validity would decide \(\mathsf Q\). ∎

Church’s 1936 note derived the result from his unsolvable problem, using Gödel’s representation of recursive functions in a formal system of arithmetic. The finite system \(\mathsf Q\) came later and makes the reduction to pure logic transparent. Turing’s proof instead encoded the behaviour of a machine directly in a first-order sentence (see the Turing course, Lesson 05).

What remains decidable

Validity is semi-decidable: by the completeness theorem the valid sentences are exactly the theorems, which can be listed. Some fragments are fully decidable. Leopold Löwenheim showed in 1915 that monadic first-order logic, with only one-place predicates, is decidable, and the prefix classes of sentences whose validity is decidable were classified over the following decades.

Exercise 7.1Show that the set of satisfiable first-order sentences is not recursively enumerable.

Show solution
\(\sigma\) is satisfiable iff \(\neg\sigma\) is not valid. If the satisfiable sentences were r.e., the non-valid sentences would be r.e.; the valid ones are r.e. by completeness, so validity would be decidable (Exercise 5.3 of the Turing course), contradicting Church’s theorem.

Exercise 7.2Show that a monadic sentence with \(k\) predicate symbols \(P_1,\dots,P_k\) and no equality that has a model has one with at most \(2^k\) elements. Deduce that monadic validity is decidable.

Show solution
In a model, call two elements equivalent if they satisfy the same \(P_i\). There are at most \(2^k\) classes. Collapse each class to one point; by induction on formulas, the truth value of every monadic formula is preserved, since a formula can only distinguish elements by which \(P_i\) they satisfy. To decide validity of \(\sigma\), check \(\neg\sigma\) in all structures of size at most \(2^k\), a finite search.

Exercise 7.3Explain why Church’s theorem implies that Peano arithmetic, if consistent, is undecidable, and why any consistent recursively axiomatized extension of \(\mathsf Q\) is incomplete.

Show solution
The diagonal argument of step 1 used only that the theory is consistent and represents recursive functions, which every consistent extension \(T\) of \(\mathsf Q\) does; so \(T\) is undecidable. If \(T\) were also complete and recursively axiomatized, we could enumerate its theorems and wait for \(\sigma\) or \(\neg\sigma\) to appear, deciding \(T\). So \(T\) is incomplete: Gödel’s first incompleteness theorem in Rosser’s form, recovered from undecidability.
Lesson 08

The simple theory of types

For the general reader. The untyped λ-calculus lets a function be applied to itself, which gives it its full computational power and also its paradoxes. In 1940 Church tamed it by giving every term a type, as in Russell’s theory of types, so that a function on numbers can only be applied to numbers. The result is a clean higher-order logic. Its descendants are the type systems of modern programming languages and the logic of proof assistants such as HOL and Isabelle.

Goals
  • Define Church’s simple types and typed terms.
  • Understand normalization and its price in expressive power.
  • See how higher-order logic is built from typed λ-terms.
Definition (Church, 1940)

Types are built from base types \(\iota\) (individuals) and \(o\) (truth values) by the function-type constructor: if \(\alpha,\beta\) are types, so is \(\alpha\to\beta\). (Church wrote \((\beta\alpha)\).) Each variable carries a type. Terms and their types are formed by: a variable \(x^\alpha\) has type \(\alpha\); if \(M:\alpha\to\beta\) and \(N:\alpha\) then \(MN:\beta\); if \(M:\beta\) then \(\lambda x^\alpha.\,M:\alpha\to\beta\).

Church’s logic adds constants: \(\neg:o\to o\), \(\wedge:o\to o\to o\), and for each type \(\alpha\) a universal quantifier \(\Pi_\alpha:(\alpha\to o)\to o\), so that \(\forall x^\alpha.\,\varphi\) is \(\Pi_\alpha(\lambda x^\alpha.\varphi)\), and a description or choice operator \(\iota_\alpha:(\alpha\to o)\to\alpha\). Sets of individuals are terms of type \(\iota\to o\). Axioms include extensionality and, for arithmetic, an axiom of infinity. All of mathematics formalized in Principia Mathematica can be carried out in this system.

Theorem (normalization)

Every simply typed λ-term has a normal form; in fact every reduction sequence terminates (strong normalization). Typing is preserved by reduction.

Proof idea (weak normalization). Define the degree of a redex \((\lambda x^\alpha.M)N\) as the length of its type \(\alpha\to\beta\). Contracting a redex of maximal degree that contains no other redex of that degree creates only redexes of smaller degree. A multiset induction on degrees then terminates. Turing wrote down an argument of this kind in an unpublished note, which Robin Gandy published in 1980. Strong normalization was proved later by Tait’s method of computability predicates.

Normalization rules out \(\Omega\) and \(\mathsf Y\), so typed terms cannot express general recursion. On Church numerals of type \((\alpha\to\alpha)\to\alpha\to\alpha\), Helmut Schwichtenberg showed in 1976 that the definable functions are exactly the extended polynomials, built from constants, addition, multiplication and a case distinction on zero. Higher-order logic regains arithmetic through its axioms, not through computation.

Completeness and Curry–Howard

By Gödel’s incompleteness theorem, Church’s type theory with its intended semantics, where type \(\alpha\to\beta\) ranges over all functions, has no complete proof system. In 1950 Church’s student Leon Henkin proved completeness with respect to general models, in which function types may range over smaller sets of functions. Read differently, the typing rules are the rules of natural deduction for implication: a type is a proposition and a closed term of that type is a proof. This correspondence, observed by Curry and made explicit by William Howard in 1969, links Church’s calculus to constructive logic and underlies proof assistants such as Coq and Lean.

Exercise 8.1Show that every Church numeral \(\overline n\) has type \((\alpha\to\alpha)\to\alpha\to\alpha\) for each type \(\alpha\), and give a type for \(\mathsf{add}\).

Show solution
With \(f:\alpha\to\alpha\) and \(x:\alpha\), each \(f(\cdots)\) has type \(\alpha\), so \(\lambda f.\lambda x.\,f^n x:(\alpha\to\alpha)\to\alpha\to\alpha\). Writing \(N_\alpha\) for this type, \(\mathsf{add}:N_\alpha\to N_\alpha\to N_\alpha\), since \(m\,f\,(n\,f\,x)\) is well typed when \(m,n:N_\alpha\).

Exercise 8.2Show that \(\lambda x.\,x\,x\) has no simple type.

Show solution
If \(x:\alpha\), then \(x\,x\) requires \(\alpha=\alpha\to\beta\) for some \(\beta\). But the type \(\alpha\to\beta\) is strictly longer than \(\alpha\), so no simple type satisfies this equation. Hence \(\Omega\) and \(\mathsf Y\), which contain self-application, are untypable, consistent with normalization.

Exercise 8.3Under Curry–Howard, what proposition does the term \(\lambda f.\,\lambda g.\,\lambda x.\,g\,(f\,x)\) prove?

Show solution
With \(f:A\to B\), \(g:B\to C\), \(x:A\), the body has type \(C\). The term has type \((A\to B)\to(B\to C)\to A\to C\): transitivity of implication, the hypothetical syllogism.
Lesson 09

Random sequences and circuit synthesis

For the general reader. Twice Church brought computability to bear on other fields. In 1940 he used it to repair a definition of randomness: a sequence of coin tosses is random if no computable betting rule can pick out a biased subsequence. In 1957 he asked whether a machine can automatically build a circuit that meets a specification written in logic, for every possible future input. The question founded the theory of reactive synthesis, now used to construct controllers that are correct by design.

Goals
  • State Church’s definition of a random sequence and prove that such sequences exist.
  • Understand Ville’s objection and the later definition of Martin-Löf.
  • State Church’s synthesis problem and its solution.

Randomness

Richard von Mises had defined a random sequence, a collective, as one in which the limiting frequency of 1s exists and is unchanged in every subsequence chosen by an admissible place-selection rule: a rule that decides whether to select the \(n\)-th term using only the earlier terms. If every rule is admissible, no sequence qualifies. Abraham Wald showed in 1937 that collectives exist for any countable family of rules.

Definition (Church, 1940)

A place-selection rule is a total recursive function \(\phi:\{0,1\}^*\to\{0,1\}\); it selects \(x_n\) when \(\phi(x_1\cdots x_{n-1})=1\). An infinite binary sequence \(x\) is random (with respect to probability \(\tfrac12\)) if for every such \(\phi\) that selects infinitely many terms, the selected subsequence has limiting frequency of 1s equal to \(\tfrac12\).

Theorem (Wald; Church)

The set of Church-random sequences has measure 1 for the fair coin measure. In particular such sequences exist, and none of them is computable.

There are countably many recursive rules, and for each, the strong law of large numbers shows that the selected subsequence has frequency \(\tfrac12\) almost surely; a countable intersection of measure-one sets has measure one. Jean Ville showed in 1939 that von Mises–Wald collectives can still violate other laws of probability: for any countable family of rules there is a collective whose initial frequencies of 1s are always at least \(\tfrac12\). The definition that answered this, Per Martin-Löf’s of 1966, uses effective statistical tests and coincides with the algorithmic randomness of Andrey Kolmogorov, Gregory Chaitin and Leonid Levin.

Synthesis

At the 1957 Summer Institute for Symbolic Logic at Cornell, Church posed the following problem. Given a specification \(\Phi\) in a logic of infinite sequences, relating an input stream \(x_0x_1\dots\) to an output stream \(y_0y_1\dots\), decide whether there is a finite-state circuit that produces \(y_t\) from \(x_0,\dots,x_t\) so that \(\Phi\) holds for every input, and if so, construct it.

Theorem (Büchi–Landweber, 1969)

For specifications in the monadic second-order logic of one successor, Church’s problem is decidable, and whenever a circuit exists, a finite-state circuit exists and can be constructed effectively.

The proof views synthesis as an infinite game between the environment, choosing inputs, and the circuit, choosing outputs, with a winning condition given by an automaton; such games are determined, and the winner has a finite-memory strategy. Michael Rabin, Church’s student, gave another solution using automata on infinite trees.

Exercise 9.1Show that a computable sequence \(x\) is not Church-random.

Show solution
Let \(\phi(w)=1\) iff the next term \(x_{|w|+1}\) of the fixed computable sequence equals 1, a total recursive function of \(w\) (it uses only the length of \(w\)). If \(x\) has infinitely many 1s, \(\phi\) selects exactly them, and the selected subsequence has frequency 1. If not, the rule “select when the next term is 0” selects a subsequence of frequency 0.

Exercise 9.2Inputs \(x_t\) and outputs \(y_t\) are bits. The specification says: \(y_t=1\) if and only if \(x_{t+1}=1\). Can a circuit satisfy it? What about “\(y_t=1\) if and only if \(x_{t-1}=1\)” for \(t\ge1\)?

Show solution
The first is unrealizable: \(y_t\) must be produced before \(x_{t+1}\) is seen, and the environment can always choose \(x_{t+1}\) to contradict it. The second is realized by a one-bit memory, a delay element that outputs the previous input. Synthesis asks exactly which specifications are of the second kind, and builds the circuit.
Lesson 10

Sense, denotation and knowability

For the general reader. “The morning star” and “the evening star” name the same planet, yet someone can believe that the morning star is bright without believing the evening star is. Gottlob Frege explained this by distinguishing what an expression refers to from the way it presents it. Church spent more than forty years building a formal logic for Frege’s distinction. In the course of his philosophical refereeing he also found a short argument with a startling conclusion about knowledge.

Goals
  • Understand the aims of Church’s logic of sense and denotation.
  • Follow Church’s translation argument and the slingshot.
  • Prove the knowability paradox.

The logic of sense and denotation

In Church’s papers of 1946, 1951 and later, every type of his type theory acquires a hierarchy of concept types: for each type \(\alpha\) there is a type \(\alpha_1\) of senses of expressions of type \(\alpha\), a type \(\alpha_2\) of senses of those, and so on. A relation \(\Delta\) connects a concept to what it is a concept of. Belief and other attitudes take senses, not denotations, as arguments, so that substituting co-referring names inside a belief report need not preserve truth. John Myhill found in 1958 that one formulation was inconsistent, and Church revised the system several times; the last paper appeared in 1993, when he was 90.

Two arguments

Church’s translation argument (1950) objected to analyses of belief sentences as statements about sentences: “Seneca said that man is a rational animal” and its translation into German say the same thing, but a statement about English words does not survive translation. His version of the slingshot argued, in Frege’s spirit, that if co-referring terms can be substituted and logically equivalent sentences have the same reference, then all true sentences have the same reference, so sentences should be taken to denote truth values.

The knowability paradox

In 1945 Church refereed a paper by Frederic Fitch and pointed out an argument that Fitch published in 1963. Now called Fitch’s paradox, or the Church–Fitch paradox, it shows that if every truth is knowable, then every truth is known.

Theorem (Church 1945; Fitch 1963)

Work in a modal logic with a knowledge operator \(K\) satisfying (i) \(K(p\wedge q)\to Kp\wedge Kq\) and (ii) \(Kp\to p\), and a possibility operator \(\Diamond\) such that \(\neg\varphi\) is a theorem implies \(\neg\Diamond\varphi\) is a theorem. If \(p\to\Diamond Kp\) holds for every \(p\), then \(p\to Kp\) holds for every \(p\).

Proof. First, \(K(p\wedge\neg Kp)\) is impossible: by (i) it gives \(Kp\) and \(K\neg Kp\), and by (ii) the latter gives \(\neg Kp\), a contradiction. So \(\neg\Diamond K(p\wedge\neg Kp)\). Applying the knowability principle to the sentence \(p\wedge\neg Kp\) gives \(\neg(p\wedge\neg Kp)\), that is, \(p\to Kp\). ∎

Exercise 10.1In the knowability proof, which step fails for an intuitionist, who reads \(\neg(p\wedge\neg Kp)\) without the law of excluded middle?

Show solution
From \(\neg(p\wedge\neg Kp)\) one gets intuitionistically \(p\to\neg\neg Kp\): no truth is known to be unknowable. The step to \(p\to Kp\) needs double-negation elimination. This is one of the standard responses to the paradox.

Exercise 10.2In Church’s concept hierarchy, if “Venus” has type \(\iota\) and “the morning star” and “the evening star” denote the same individual, what types do their senses have, and why can a belief operator distinguish them?

Show solution
Their senses are distinct objects of type \(\iota_1\), both standing in the relation \(\Delta\) to the same individual of type \(\iota\). A belief operator applies to a believer and a proposition-concept of type \(o_1\), so it sees the different senses, so “believes that the morning star is bright” and “believes that the evening star is bright” can differ in truth value although the planets referred to are identical.
Part III · Life and legacy
Lesson 11

The Princeton school, 1936–1967

Church became associate professor in 1939 and professor of mathematics in 1947; from 1961 he was professor of mathematics and philosophy. For three decades Princeton was a world centre of mathematical logic, and Church was its organizer. He supervised 31 doctoral dissertations. Among his students were Stephen Kleene and Barkley Rosser (1934), Alan Turing (1938), Leon Henkin (1947), John Kemeny (1949), Martin Davis (1950), William Boone (1952), Hartley Rogers (1952), Michael Rabin (1957), Dana Scott (1958), Raymond Smullyan (1959), Simon Kochen (1959) and Peter Andrews (1964). Rabin and Scott shared the 1976 Turing Award; Davis contributed to the negative solution of Hilbert’s tenth problem; Boone proved the word problem for groups unsolvable; Kemeny co-created the BASIC programming language.

His books set standards. The Calculi of Lambda-Conversion (1941) was for decades the reference on the λ-calculus. Introduction to Mathematical Logic, issued in a first version in 1944 and in a revised, enlarged Volume I in 1956, treated propositional and first-order logic with a rigour and historical scholarship that few textbooks have matched; its notes and exercises are a history of the subject in miniature. A planned second volume never appeared.

The editor

From 1936 to 1979 Church edited the reviews section of the Journal of Symbolic Logic, and he compiled its bibliography of symbolic logic from Leibniz onwards. He wrote many reviews himself and edited others line by line. Colleagues described him as exceedingly polite and careful, a worker of unflagging industry and high editorial standards, whose blackboard writing was immaculate. He read science fiction and was known to write to magazine editors pointing out scientific errors. He gave an invited address at the International Congress of Mathematicians in Stockholm in 1962.

DiscussionChurch announced his thesis before Turing, and proved the undecidability of logic first. Yet Gödel and many later writers found Turing’s analysis more convincing. What makes an argument for a definition persuasive, as opposed to a proof of a theorem?

Lesson 12

UCLA, death and legacy, 1967–1995

In 1967, at the age of 64, Church left Princeton for the University of California, Los Angeles, as professor of philosophy and mathematics. He joined a strong group of logicians and philosophers and continued to teach and supervise students until he retired in 1990, at 87. His work in these years was mainly on intensional logic and on the theory of types. He was elected to the American Academy of Arts and Sciences in 1967 and to the National Academy of Sciences in 1978, and he became a corresponding fellow of the British Academy. He received honorary doctorates from Case Western Reserve University (1969), Princeton (1985) and the State University of New York at Buffalo (1990).

His wife Mary Julia died in 1976. In 1992 he moved to Hudson, Ohio. He died there on 11 August 1995, aged 92, and was buried in Princeton Cemetery.

Legacy

  • Computability: Church’s thesis, with Turing’s analysis, is the foundation of the theory of computation; Church’s theorem gave the first undecidable problem in logic.
  • Programming languages: John McCarthy’s Lisp (1958) borrowed the λ notation; Peter Landin used the λ-calculus to give meaning to Algol 60; Dana Scott and Christopher Strachey built denotational semantics on models of it; ML, Haskell and the lambdas of mainstream languages descend from it.
  • Logic and proof: Church’s simple type theory is the logic of the HOL family of proof assistants; typed λ-calculi underlie Coq, Lean and Agda through Curry–Howard.
  • Automata and verification: Church’s synthesis problem is the origin of reactive synthesis and of the game-theoretic approach to verification.
  • Honours: the Alonzo Church Award, established in 2015 and given jointly by ACM SIGLOG, the EATCS, the EACSL and the Kurt Gödel Society, recognizes outstanding contributions to logic and computation.

Final projectRead §§1–7 of Church’s 1936 “An unsolvable problem of elementary number theory”. Write a two-page account for a strong undergraduate that states the main theorem in modern language, works one λ-definition in full, and explains how Church’s formulation in terms of conversion differs from the halting-problem formulation of the same idea.

Reference

Connections

People linked to Alonzo Church across this collection. A name without a link has no page here yet. See Alonzo Church in the network of all 337 lives →

Teachers and advisors

  • Oswald Veblen 1927

Students

  • Alan Turing 1938
  • Stephen Cole Kleene 1934
  • Dana Scott 1958
  • George Alfred Barnard 1936
  • Hartley Rogers Jr. 1952
  • J. Barkley Rosser 1934
  • John George Kemeny 1949
  • Leon Henkin 1947
  • Martin Davis 1950
  • Michael O. Rabin 1957
  • Nicholas Rescher 1951
  • Peter Andrews 1964
  • Raymond Smullyan 1959
  • Simon Kochen 1959
  • William Boone 1952

Influenced by

Influenced

  • John McCarthy

Colleagues and collaborators

Also mentioned in this life

Fields

Reference

Sources and further reading

Biography

  1. J. J. O’Connor and E. F. Robertson, Alonzo Church, MacTutor History of Mathematics.
  2. Alonzo Church, Wikipedia.
  3. Princeton Alumni Weekly, Alonzo Church ’24 *27 (memorial).
  4. H. B. Enderton, Alonzo Church: life and work, introduction to T. Burge and H. B. Enderton (eds.), The Collected Works of Alonzo Church, MIT Press, 2019.
  5. H. B. Enderton, In memoriam: Alonzo Church, 1903–1995, Bulletin of Symbolic Logic 1 (1995).
  6. Open Logic Project, Alonzo Church (short biography).
  7. S. C. Kleene, Origins of recursive function theory, Annals of the History of Computing 3 (1981) 52–67.

Mathematics and philosophy

  1. A. Church, A set of postulates for the foundation of logic, Ann. of Math. 33 (1932) 346–366; second paper, 34 (1933) 839–864.
  2. S. C. Kleene and J. B. Rosser, The inconsistency of certain formal logics, Ann. of Math. 36 (1935) 630–636.
  3. A. Church, An unsolvable problem of elementary number theory, Amer. J. Math. 58 (1936) 345–363.
  4. A. Church, A note on the Entscheidungsproblem, J. Symbolic Logic 1 (1936) 40–41; correction, 101–102.
  5. A. Church and J. B. Rosser, Some properties of conversion, Trans. Amer. Math. Soc. 39 (1936) 472–482.
  6. S. C. Kleene, λ-definability and recursiveness, Duke Math. J. 2 (1936) 340–353.
  7. A. Church, On the concept of a random sequence, Bull. Amer. Math. Soc. 46 (1940) 130–135.
  8. A. Church, A formulation of the simple theory of types, J. Symbolic Logic 5 (1940) 56–68.
  9. A. Church, The Calculi of Lambda-Conversion, Annals of Mathematics Studies 6, Princeton, 1941.
  10. A. Church, Introduction to Mathematical Logic, Vol. I, Princeton, 1956.
  11. J. R. Büchi and L. H. Landweber, Solving sequential conditions by finite-state strategies, Trans. Amer. Math. Soc. 138 (1969) 295–311.
  12. H. P. Barendregt, The Lambda Calculus: Its Syntax and Semantics, North-Holland, revised ed. 1984.
  13. F. Cardone and J. R. Hindley, History of lambda-calculus and combinatory logic, in Handbook of the History of Logic 5, 2009.
  14. H. B. Enderton and others, Alonzo Church, Stanford Encyclopedia of Philosophy.
  15. The Church–Turing thesis, Stanford Encyclopedia of Philosophy.