Compactness and the Löwenheim-Skolem Theorems for First-Order Logic
Anchor (Master): Enderton 2001 §2.6; Chang and Keisler 1990 *Model Theory* 3e (North-Holland) Ch. 1-2 (compactness via the completeness theorem and via the ultraproduct/Łoś construction, the Löwenheim-Skolem-Tarski theorem in full, the method of constants, elementary chains); Marker 2002 *Model Theory: An Introduction* (Springer GTM 217) Ch. 2 (compactness, Löwenheim-Skolem, the Tarski-Vaught test, the failure of first-order categoricity, non-standard models); Hodges 1993 *Model Theory* (Cambridge) Ch. 5-6 (downward and upward Löwenheim-Skolem, Skolem functions and Skolem hulls); Lindström 1969 *On extensions of elementary logic* (Theoria 35) (the maximality of first-order logic among logics with countable compactness and downward Löwenheim-Skolem); Robinson 1966 *Non-standard Analysis* (North-Holland) Ch. 1-3 (the hyperreals as a non-standard model of the reals)
Intuition Beginner
The previous unit settled a remarkable match: a batch of assumptions has a world making them all true exactly when the proof game cannot grind a contradiction out of them, and that game only ever touches finitely many assumptions at a time. Put those two facts side by side and a slogan drops out. A batch of demands can be satisfied all at once whenever every finite handful of them can be. Failure, if it happens, must already show up in some finite handful. This is the compactness theorem, now for the richer language that says "for all" and "there exists." It is far stronger than the switch-flipping version, since the demands can talk about numbers, orders, and structures.
The power shows up the moment you feed it a sneaky infinite list. Start with everything true about ordinary counting numbers. Add one new name, call it , and pile on the endless demands " is bigger than ," " is bigger than ," and so on forever. Any finite handful is easy: just let be a big enough ordinary number. So compactness hands you a single world satisfying the whole infinite list. In that world is bigger than every ordinary number — an infinite number sitting past all the familiar ones. The counting numbers, in this language, could never keep such intruders out.
Two more surprises follow the same way. A world you can pin down in words can always be shrunk to one with only countably many things in it, yet that shrunken world can still insist some of its own collections are too big to count. The next sections make "demand," "world," and "shrink" precise and prove these promises.
Visual Beginner
The picture is a number line that has grown an extra tail. The ordinary counting numbers sit at the start in their usual order. Compactness forces a new point that lies past every one of them, and once one such point exists, a whole block of new points appears around it.
FORCING A NUMBER BIGGER THAN ALL THE ORDINARY ONES
demands (every finite handful is easy to meet):
c > 1 , c > 2 , c > 3 , c > 4 , ... (never ends)
finite handful { c > 1, c > 2, c > 3 } :
let c = 100 -> all three hold -> satisfiable
so by compactness the WHOLE list has one world:
ordinary numbers new infinite numbers
0 1 2 3 4 ... ............ ... c-1 c c+1 ...
|---|---|---|---|---- ----|----|---|---|---
the familiar start a tail past every ordinary number
RESULT a single world where c sits beyond all of 0,1,2,3,...
yet every ordinary true statement still holds.Read it left to right. Each finite handful of "bigger than" demands is met by choosing a large enough ordinary number, so no finite handful ever clashes. Because every finite handful is satisfiable, compactness gives one world meeting all of them at once, and in that world has no ordinary size — it is an infinite number.
| ingredient | what it is | role |
|---|---|---|
| the old truths | everything true of counting | kept intact |
| the new name | one extra constant | the intruder |
| the endless demands | " bigger than each number" | force the tail |
| each finite handful | finitely many "bigger than" | met by a big ordinary number |
Nothing about ordinary arithmetic is broken; the world simply has more numbers than you bargained for, because finitely-checkable demands could not forbid them.
Worked example Beginner
We force a single infinite number into a world and watch finite-checking do all the work. Keep every true fact about ordinary counting numbers, where each number has a name: , then , then , and so on. Add one fresh name . Then add the endless list of demands " is bigger than ," " is bigger than ," " is bigger than ," continuing forever.
Step 1. Pick any finite handful of these demands. Say we grab — the demands " bigger than " up through " bigger than ." There are five of them.
Step 2. Satisfy that handful inside the ordinary numbers. Let name the number . Then is bigger than , and , so all five demands in the handful hold at once. Every true fact about ordinary counting still holds too, since we changed nothing except the meaning of the new name .
Step 3. Notice this always works. Whatever finite handful you grab, it mentions a largest number, say . Letting name meets every demand in that handful, because is bigger than . So every finite handful is satisfiable.
Step 4. Apply compactness. Since every finite handful of the whole infinite list is satisfiable, the entire list has one world that satisfies all of it together. Call this world .
Step 5. Inspect in . The name must satisfy all the demands at once: is bigger than , bigger than , bigger than , and so on without end. So in the object named is larger than every ordinary number. It is a number with no ordinary size — an infinite number.
What this tells us: by checking only finite handfuls, each met by a big enough ordinary number, we conjured a world containing a number past all the ordinary ones, while every ordinary truth survived. No finite handful could rule the intruder out, so the infinite list could not either. The next sections turn "keep the truths, add a constant beyond every numeral" into the precise compactness argument and its consequences.
Check your understanding Beginner
Formal definition Intermediate+
Fix a first-order language with equality, the satisfaction relation of 42.01.04 pending, the deductive calculus and consistency of 42.01.05 pending, and the completeness theorem of 42.01.06 pending in its model-existence form: every consistent set of sentences has a model. A theory is a set of -sentences; is satisfiable when some structure , and finitely satisfiable when every finite is satisfiable [Enderton §2.6].
Compactness theorem (first-order). A set of -sentences has a model if and only if every finite subset of has a model.
One direction is monotone: a model of models each finite subset. The substance is the converse, and it is a corollary of completeness. If has no model then by completeness is inconsistent, so and for some ; each deduction cites finitely many premises, so a finite proves both, is inconsistent, and by soundness 42.01.05 pending has no model. Contrapositively, finite satisfiability gives satisfiability. The whole content is the finiteness of deductions transported across ; the propositional case 42.01.02 pending is the same skeleton over truth values, but the first-order harvest is incomparably richer.
For two structures in the same language ( a substructure, with and the operations agreeing), is an elementary substructure, written , when for every formula and tuple from , . The Tarski-Vaught test characterizes this: iff and for every formula and from , whenever there is a witness with [Marker Ch. 2].
The downward Löwenheim-Skolem-Tarski theorem asserts that every infinite structure in a language of size has, for each , an elementary substructure with and . The upward Löwenheim-Skolem theorem asserts that a theory with an infinite model has a model of every cardinality . A theory is categorical if all its models are isomorphic.
Counterexamples to common slips Intermediate+
"Compactness is just the propositional theorem in a bigger language." The skeleton is shared, but a propositional theory only ever constrains truth values, while a first-order theory constrains structures: the constant-adjunction trick yields non-standard models, infinite cardinalities, and infinitesimals, none of which the propositional case
42.01.02pending can express."A consistent theory describing has only as a model." True arithmetic has non-standard models of every infinite cardinality. First-order axioms cannot exclude a constant placed above every numeral, so no infinite structure is pinned down up to isomorphism.
"An elementary substructure is the same as a substructure." The even numbers form a substructure of but not an elementary one once a constant for is present: "" fails inside the evens (no witness) yet holds in . Elementarity is the Tarski-Vaught witness condition, strictly stronger than closure under operations.
"Skolem's paradox shows set theory is inconsistent." It shows cardinality is not absolute. A countable model thinks some is uncountable because the bijection that exists outside is not an element of ; internal and external counting diverge, with no contradiction.
Key theorem with proof Intermediate+
The signature consequence of compactness is the construction of non-standard models — structures satisfying exactly the same first-order sentences as a target yet not isomorphic to it. The argument is the constant-adjunction template in its cleanest form, and it is what no propositional compactness theorem can produce.
Theorem (non-standard models of arithmetic). Let be the standard model and its complete first-order theory. There is a model with an element satisfying for every ; thus is elementarily equivalent to but not isomorphic to it [Enderton §2.6].
Proof. Expand to with a new constant , and set where is the numeral . Each finite uses only finitely many of the sentences , say for . Interpret in as the number : then with this interpretation models (the sentences of do not mention ) and every for , so . Hence is finitely satisfiable, and by compactness has a model . Let and let be its reduct, forgetting . Then , and since for every , the element exceeds every standard numeral's interpretation .
Because is complete, (they satisfy the same sentences). They are not isomorphic: an isomorphism would send the interpretation of each numeral to itself and so could not accommodate , which is the interpretation of no numeral, exceeding them all. The standard part is a proper initial segment, and lies strictly above it; is a non-standard model of true arithmetic.
Corollary (downward Löwenheim-Skolem from the term model). Since above is countable, the Henkin term model of 42.01.06 pending has cardinality at most , so may be taken countable: a countable non-standard model of arithmetic exists.
Bridge. The constant-adjunction argument is the foundational reason compactness has teeth a propositional theorem lacks: a single new constant plus an infinite-but-finitely-harmless batch of inequalities manufactures an element with no standard size, and this is exactly the completeness theorem of 42.01.06 pending read forward — consistency of every finite fragment delivers one model of the whole. It builds toward the upward and downward Löwenheim-Skolem theorems, which run the same template to scale cardinality up and down, and it appears again in the hyperreals and in model theory 42.02.01 pending, where the method of diagrams turns any consistent expansion into an elementary extension. The central insight is that first-order axioms see only finitely many premises at a time, so they cannot fence off a limit they never inspect; this is exactly why fails to be categorical, and putting these together, the same finiteness that makes the proof game safe makes first-order description leak — the bridge is that compactness converts the syntactic finiteness of deductions into the semantic impossibility of pinning down an infinite structure.
Exercises Intermediate+
Advanced results Master
The compactness theorem and the Löwenheim-Skolem theorems organize four developments: the two semantic routes to compactness and their equal strength; the upward and downward Löwenheim-Skolem-Tarski theorems with the resulting impossibility of first-order categoricity; Skolem's paradox and the non-absoluteness of cardinality; and the exact location of first-order logic among logics, fixed by Lindström's theorem as the maximal one carrying both metatheorems.
Theorem 1 (two proofs of compactness). Compactness has a deductive proof — completeness 42.01.06 pending plus deduction-finiteness — and a calculus-free ultraproduct proof [Chang-Keisler Ch. 1]. For the latter, let every finite have a model; index the finite subsets by , take for each a model of the finite subset , and let be an ultrafilter on containing each cone (these have the finite intersection property, so such exists by the ultrafilter lemma). By Łoś's theorem, the ultraproduct satisfies a sentence iff -almost-all factors do; each holds in for every , a -large set, so . The ultraproduct is a single model of . Both proofs use exactly the Boolean prime ideal theorem; over , first-order compactness is equivalent to it, as in the propositional case 42.01.02 pending, the ultrafilter on being the sole choice ingredient.
Theorem 2 (Löwenheim-Skolem-Tarski; failure of categoricity). Every infinite structure in a language of size has, for each , an elementary substructure with and — close under Skolem witnesses and apply the Tarski-Vaught test [Marker Ch. 2]. Dually, a theory with an infinite model has models of every cardinality : adjoin distinct constants and apply compactness for the lower bound, then the downward theorem to hit exactly. Together they yield models in every infinite cardinality for any theory with one infinite model, whence no first-order theory with an infinite model is categorical: it has models of distinct cardinalities, never all isomorphic. The substitute is -categoricity, governed by Morley's theorem 42.02.01 pending.
Theorem 3 (Skolem's paradox; non-absoluteness of cardinality). If is consistent it has a countable model , by the downward Löwenheim-Skolem theorem applied to any model [Enderton §2.6]. Inside the theorem of Cantor "there is an uncountable set" holds: some satisfies " is uncountable." Yet is countable in the real universe, since is. The resolution is that "uncountable" means "no bijection with exists as a set in the model." A bijection exists externally but is not an element of , so is uncountable relative to and countable relative to . Cardinality is a non-absolute notion: it depends on which functions the model contains. The first-order axioms of cannot force a model to contain every bijection, the precise mechanism by which Löwenheim-Skolem and Skolem's paradox coincide.
Theorem 4 (Lindström's theorem; the price of compactness). First-order logic is the maximal abstract logic satisfying both the countable compactness theorem and the downward Löwenheim-Skolem theorem to : any abstract logic extending it with both properties has exactly its expressive power [Lindström 1969]. This pinpoints the trade-off. Second-order logic, quantifying over subsets, is categorical for (the second-order Peano axioms have only up to isomorphism) and for (the complete ordered field is unique), but it loses compactness, loses the Löwenheim-Skolem theorems, and has no recursively axiomatizable complete proof system — its validities are not even arithmetically definable. The infinitary logic keeps a Löwenheim-Skolem theorem but loses compactness; the logic with "there exist uncountably many" keeps compactness in the countable form but loses downward Löwenheim-Skolem. The expressive limits derived here are not defects to be engineered away: by Lindström they are equivalent to possessing both metatheorems at all.
Synthesis. Compactness is the foundational reason first-order logic cannot control cardinality, and putting these together it organizes all four developments through one mechanism — finitely many axioms are inspected at a time, so any limit they never examine slips through. This is exactly what the two proofs of Theorem 1 make precise from opposite sides: the deductive route reads compactness off the finiteness of a single proof, the ultraproduct route off Łoś's theorem averaging finite models, and their equal strength (both equivalent to the Boolean prime ideal theorem) is dual to the same equivalence in the propositional case 42.01.02 pending. The cardinality flexibility of Theorem 2 is the central insight read in two directions — upward by adjoining distinct constants, downward by Skolem-closing under witnesses — and it generalises the term-model bound of 42.01.06 pending into the statement that no infinite structure is first-order categorical, so and alike escape capture. Skolem's paradox of Theorem 3 is this flexibility turned on set theory: the model that downward Löwenheim-Skolem shrinks is one whose internal cardinalities desynchronize from external ones, and the bridge is that cardinality depends on which functions a model holds, not an absolute. Lindström's theorem closes the circle: the limits are the logic. The keystone is that the same finiteness of deduction that made the proof game sound and complete 42.01.05 pending, 42.01.06 pending makes first-order description leak, and on this leak the whole model theory of 42.02.01 pending is built.
Full proof set Master
Proposition 1 (compactness from completeness). A set of -sentences has a model iff every finite subset of has a model.
Proof. () A model of models every subset. () Suppose has no model. By the completeness theorem 42.01.06 pending in model-existence form, is inconsistent, so and for some sentence . Each deduction is a finite sequence citing finitely many members of ; let be the finite union of premises cited in the two deductions. Then and , so is inconsistent, hence by soundness 42.01.05 pending has no model. Thus some finite subset of has no model; contrapositively, finite satisfiability gives satisfiability.
Proposition 2 (Tarski-Vaught test). For , iff for every formula and tuple from with there is with .
Proof. () If and , then by elementarity, so a witness has , hence again by elementarity. () Induct on to show for from . Atomic: term-values and atomic relations agree because is a substructure. Negation and implication: from the inductive hypothesis via the truth clauses. Existential : if , a witness gives , so by induction, whence . Conversely if , the witness hypothesis supplies with , so by induction, hence . The universal case is dual. So .
Proposition 3 (downward Löwenheim-Skolem-Tarski). Let be a structure in a language of size and . There is with and .
Proof. Set if nonempty, else a singleton. Given , for each formula of and each tuple from with , select one witness (axiom of choice) and let . The number of pairs is at most , so . Let ; then (a countable increasing union with bounded steps). is closed under the functions of — for a function symbol , the witness for lies in — so underlies a substructure . For Tarski-Vaught: a tuple from lies in some , and any contributed a witness . By Proposition 2, .
Proposition 4 (upward Löwenheim-Skolem). If a theory has an infinite model, then for every , has a model of cardinality exactly .
Proof. Adjoin new constants and let . A finite mentions finitely many constants; an infinite model interprets them as distinct elements, so . By compactness (Proposition 1) has a model ; its reduct has elements, the distinct . Now apply Proposition 3 with to obtain with and ; since forces , equality holds, and .
Proposition 5 (non-categoricity and Skolem's paradox). (i) No first-order theory with an infinite model is categorical. (ii) If is consistent, it has a countable model in which "there is an uncountable set" is true.
Proof. (i) By Proposition 4, has a model of cardinality and one of cardinality (taking when is countable; otherwise and via the downward theorem). Distinct cardinalities preclude a bijection, so the models are not isomorphic, and is not categorical. (ii) If is consistent it has a model by completeness; by Proposition 3 (with , ) it has a countable elementary submodel , so . Cantor's theorem is a theorem of , so ""; fix such an . The set injects into , which is countable, so has countably many members externally. A bijection exists in but, were it an element of , would witness " is countable," contradicting the choice of ; so it is not in . Hence is uncountable in and countable in , with no contradiction: cardinality is non-absolute.
Connections Master
Gödel's completeness theorem and the Henkin construction
42.01.06pending is the prerequisite this unit harvests. Completeness in model-existence form, combined with the finiteness of deductions, is the first-order compactness theorem; the term model's cardinality bound is the downward Löwenheim-Skolem theorem in its first form. Where42.01.06pending proved that consistency equals satisfiability, this unit reads the consequences of that identification when applied to finite fragments — the single move that turns a meaning-capturing calculus into a tool for manufacturing non-standard structures.The compactness theorem for propositional logic
42.01.02pending is the decidable warm-up. The finite-intersection skeleton and the equivalence with the Boolean prime ideal theorem are shared, and the ultraproduct proof here is the first-order analogue of the ultrafilter-on-the-Lindenbaum-algebra proof there. What changes is the harvest: truth-value cylinders become spaces of structures, so first-order compactness yields non-standard models, infinitesimals, and the failure of finite axiomatizability, none of which the propositional case can state. The connection isolates exactly the expressive jump from propositional to first-order logic.The model theory of first-order structures, co-produced as
42.02.01pending, rests on compactness and Löwenheim-Skolem as its two foundational metatheorems. The method of diagrams, elementary chains and amalgamation, the spectrum function counting models in each cardinality, Morley's categoricity theorem, and the stability-theoretic classification all presuppose that a consistent expansion has a model (compactness) and that cardinality is freely adjustable (Löwenheim-Skolem). The non-standard models built here are the prototype objects of that theory, and the Tarski-Vaught test introduced here is its basic tool for recognizing elementary substructures.Set theory and the cumulative hierarchy
42.03.01is where Skolem's paradox lives and is resolved. The countable model of produced by downward Löwenheim-Skolem, and the non-absoluteness of cardinality it exhibits, feed directly into the study of absoluteness, the Lévy hierarchy, and forcing, where which sets a model contains is precisely the object of manipulation. The paradox is not a defect but the first appearance of the relativity of set-theoretic notions that the independence proofs of42.03.01exploit systematically.Gödel's incompleteness theorems
42.01.09pending depend on the non-standard models compactness guarantees. The Gödel sentence is unprovable in precisely because it is false in some non-standard model of while true in , so ; the existence of those non-standard models is the constant-adjunction construction of this unit. Completeness and incompleteness are reconciled exactly through the multiplicity of models that compactness produces — provability matches full semantic consequence, but a fixed theory's models outrun the standard one.
Historical & philosophical context Master
The downward Löwenheim-Skolem theorem originates with Leopold Löwenheim's 1915 paper Über Möglichkeiten im Relativkalkül, which showed that a first-order sentence with a model has a countable model, and was sharpened and corrected by Thoralf Skolem in a sequence of papers from 1920 to 1923, who introduced the use of Skolem functions and normal forms and proved the theorem for sets of sentences [Enderton §2.6]. Skolem drew the unsettling consequence now bearing his name: a first-order axiomatization of set theory, if it has a model at all, has a countable one, in which "uncountable" sets nonetheless exist — the relativity of cardinality to the model. Skolem regarded this as evidence against the adequacy of any first-order foundation for the absolute notion of set, a stance that prefigured the later understanding of absoluteness and forcing.
The compactness theorem for first-order logic was isolated by Kurt Gödel as a corollary of his 1930 completeness theorem and given a direct semantic proof, independent of any deductive calculus, by Anatoly Maltsev in 1936, whose general (uncountable-language) form opened the door to applications in algebra; the ultraproduct proof is due to the work of Jerzy Łoś (1955), whose fundamental theorem on ultraproducts made the construction routine [Chang-Keisler Ch. 1]. Abraham Robinson built non-standard analysis on these foundations in 1961-1966, realizing Leibniz's infinitesimals as elements of a non-standard model of the reals obtained by compactness or ultrapower [Robinson Ch. 1-3]. Per Lindström's 1969 theorem established that compactness together with the downward Löwenheim-Skolem property characterizes first-order logic uniquely among abstract logics, fixing the precise sense in which the expressive limits derived here are the defining trait of elementary logic [Lindström 1969].
Bibliography Master
@book{enderton2001logic,
author = {Enderton, Herbert B.},
title = {A Mathematical Introduction to Logic},
edition = {2},
publisher = {Harcourt/Academic Press},
year = {2001}
}
@book{changkeisler1990modeltheory,
author = {Chang, Chen Chung and Keisler, H. Jerome},
title = {Model Theory},
edition = {3},
series = {Studies in Logic and the Foundations of Mathematics},
volume = {73},
publisher = {North-Holland},
year = {1990}
}
@book{marker2002modeltheory,
author = {Marker, David},
title = {Model Theory: An Introduction},
series = {Graduate Texts in Mathematics},
volume = {217},
publisher = {Springer},
year = {2002}
}
@book{hodges1993modeltheory,
author = {Hodges, Wilfrid},
title = {Model Theory},
series = {Encyclopedia of Mathematics and its Applications},
volume = {42},
publisher = {Cambridge University Press},
year = {1993}
}
@article{lowenheim1915,
author = {L\"{o}wenheim, Leopold},
title = {\"{U}ber M\"{o}glichkeiten im Relativkalk\"{u}l},
journal = {Mathematische Annalen},
volume = {76},
year = {1915},
pages = {447--470}
}
@article{skolem1920,
author = {Skolem, Thoralf},
title = {Logisch-kombinatorische Untersuchungen \"{u}ber die Erf\"{u}llbarkeit oder Beweisbarkeit mathematischer S\"{a}tze},
journal = {Skrifter utgit av Videnskapsselskapet i Kristiania},
year = {1920}
}
@article{malcev1936,
author = {Mal'cev, Anatoly I.},
title = {Untersuchungen aus dem Gebiete der mathematischen Logik},
journal = {Matematicheskii Sbornik},
volume = {1},
year = {1936},
pages = {323--336}
}
@article{los1955,
author = {{\L}o\'{s}, Jerzy},
title = {Quelques remarques, th\'{e}or\`{e}mes et probl\`{e}mes sur les classes d\'{e}finissables d'alg\`{e}bres},
journal = {Mathematical Interpretation of Formal Systems},
publisher = {North-Holland},
year = {1955},
pages = {98--113}
}
@book{robinson1966nonstandard,
author = {Robinson, Abraham},
title = {Non-standard Analysis},
publisher = {North-Holland},
year = {1966}
}
@article{lindstrom1969,
author = {Lindstr\"{o}m, Per},
title = {On extensions of elementary logic},
journal = {Theoria},
volume = {35},
year = {1969},
pages = {1--11}
}