Structures, Embeddings, and Elementary Equivalence
Anchor (Master): Marker 2002 *Model Theory: An Introduction* (Springer GTM 217) Ch. 1-2 (structures, embeddings, elementary maps, the Tarski-Vaught test, elementary chains, the method of diagrams, downward Löwenheim-Skolem); Chang and Keisler 1990 *Model Theory* 3e (North-Holland) Ch. 1-3 (the systematic theory of elementary equivalence, elementary extensions, and chains); Hodges 1993 *Model Theory* (Cambridge) Ch. 2-3 (homomorphisms and the preservation hierarchy, back-and-forth systems, Ehrenfeucht-Fraïssé games and the Fraïssé characterisation of ≡); Tarski and Vaught 1957 *Arithmetical extensions of relational systems* (Compositio Math. 13)
Intuition Beginner
The previous unit fixed what it means for a sentence to be true in a world — a structure — and gave a precise rule for checking it. Model theory begins the moment you stop looking at one world at a time and start comparing worlds. Two questions drive everything: when does one world sit inside another, and when can no logical statement tell two worlds apart?
The first question is about fitting in. The whole numbers sit inside the integers, which sit inside the fractions. Each smaller world is a faithful copy of part of the larger one: the same objects, the same addition, the same order. A map that plants one world inside another without distorting any of its symbols is an embedding. When the smaller world is literally a piece of the larger one, it is a substructure.
The second question is subtler and more surprising. Sometimes two worlds are not copies of each other at all — one might be small and the other huge — yet no statement you can write down distinguishes them. The ordered fractions and the ordered real numbers are like this: any finite check you perform comes out the same in both. We say such worlds are elementarily equivalent. They agree on every statement first-order logic can phrase, even though they are not the same size. Learning to build worlds inside worlds, and to detect when worlds are logically indistinguishable, is the whole toolkit this unit assembles. The rest of model theory deploys it.
Visual Beginner
Three worlds nested inside one another, and a separate picture of two worlds that no statement can separate. Read the left column as "sits inside"; read the right column as "looks the same to logic."
SUBSTRUCTURES (each world sits inside the next):
whole numbers { 0, 1, 2, 3, ... }
| sits inside (same +, same order)
v
integers { ..., -2, -1, 0, 1, 2, ... }
| sits inside
v
fractions { ..., 1/2, 3/4, -5/7, ... }
Each smaller world is a faithful copy of part of the larger one:
same objects where they overlap, same readings of every symbol.
ELEMENTARILY EQUIVALENT (no statement tells them apart):
ordered fractions <-- agree on every --> ordered reals
(countable) logical statement (uncountable)
different sizes, yet every first-order check
comes out the same in bothThe left picture shows nesting: a smaller world is carried, undistorted, into a bigger one. The right picture shows something different — two worlds of different sizes that nonetheless answer every logical question identically.
| relationship | what it means | example |
|---|---|---|
| substructure | one world is a piece of another | whole numbers inside integers |
| embedding | a faithful copy planted inside | integers planted inside fractions |
| elementarily equivalent | no statement separates them | ordered fractions and ordered reals |
| isomorphic | the same world relabelled | two five-bead ordered chains |
Nesting and indistinguishability are different ideas. Two worlds can be indistinguishable without one sitting inside the other, and one world can sit inside another while still being distinguishable from it.
Worked example Beginner
We compare two ordered worlds and decide, by hand, whether one sits inside the other and whether a statement separates them. World one: the whole numbers with their usual order. World two: the integers with their usual order. The only symbol is "less than."
Step 1. Does world one sit inside world two? Every whole number is an integer, and the order among whole numbers is the same order they have as integers: holds in both. So the whole numbers form a piece of the integers — a substructure. The planting map sends each whole number to itself.
Step 2. Now look for a statement that is true in one world but false in the other. Consider "there is a smallest object." In the whole numbers this is true: is below everything else. In the integers it is false: given any integer, a smaller one exists.
Step 3. So the two worlds disagree on the statement "there is a smallest object." They are not elementarily equivalent. One sits inside the other, yet a statement still separates them.
Step 4. Contrast with the fractions and the reals, both ordered. Take any property you can phrase with "less than," "and," "or," "not," "there exists," and "for all." Whatever you ask — is the order dense? does it have endpoints? — the fractions and the reals answer the same way. No statement separates them, so they are elementarily equivalent, even though the reals are far larger.
What this tells us: sitting inside and being indistinguishable are independent. The whole numbers sit inside the integers but a statement separates them; the fractions and reals do not nest one inside the other, yet no statement separates them. The strong notion that combines both — a piece that is also indistinguishable from the whole — is what the later sections call an elementary substructure.
Check your understanding Beginner
Formal definition Intermediate+
Fix a first-order language and recall the satisfaction relation from 42.01.04 pending. Let be -structures with universes .
An -homomorphism is a map with for each constant, for each function symbol, and for each relation symbol. An embedding is an injective for which the relation clause holds in both directions: . An isomorphism is a surjective embedding. When , the constants and functions of restrict to , and the relations of are the restrictions , we say is a substructure of and an extension, written ; equivalently is a subset of containing every and closed under every , carrying the induced relations [Marker §1.1].
An embedding is elementary when
$$
\mathfrak{M} \models \varphi[\bar a] \quad\Longleftrightarrow\quad \mathfrak{N} \models \varphi[h\bar a]
$$
for every -formula and tuple from . When and the inclusion is elementary, is an elementary substructure and an elementary extension, written [Marker §1.1]. The complete theory of is . Two structures are elementarily equivalent, , when — they satisfy the same sentences. Taking empty in the elementary condition shows , and isomorphisms are elementary 42.01.04 pending, so .
The method of diagrams packages embeddings as models. Expand to by adding a fresh constant for each . The atomic diagram is the set of atomic and negated-atomic -sentences true in (under ); the elementary diagram is the set of all -sentences true in . An -structure models iff its -reduct receives an embedding of , and models iff it receives an elementary embedding — the engine of the compactness constructions of 42.02.02 pending.
Counterexamples to common slips Intermediate+
"A substructure of is an elementary substructure." The whole numbers are a substructure of , but : only the former satisfies "there is a least element." Substructure-hood is about closure under the symbols; elementarity is the far stronger demand that all formulas, including quantified ones, be preserved.
" is the same as ." The orders and are elementarily equivalent (both are dense linear orders without endpoints, a complete theory) yet not isomorphic, since one is countable and the other is not. First-order logic cannot see this cardinality gap. The non-standard models of arithmetic
42.01.04pending are the other canonical witnesses: elementarily equivalent to , never isomorphic to it."An embedding preserves all formulas." A bare embedding preserves only quantifier-free formulas. The inclusion is an embedding but reverses the truth of "" at . Preservation of quantified formulas is exactly the surplus content of elementary embedding.
Key theorem with proof Intermediate+
The signature theorem of this unit is the Tarski-Vaught test: a usable, formula-by-formula criterion deciding when a substructure is elementary, replacing the unbounded quantifier-over-all-formulas in the definition by a single existential-witness condition. It is the lever behind the construction of every elementary substructure, including the downward Löwenheim-Skolem theorem.
Theorem (Tarski-Vaught test). Let be -structures. Then if and only if for every -formula and every tuple from , whenever there is some with [Tarski and Vaught 1957].
Proof. () Suppose and with from . By elementarity applied to the sentence-with-parameters , , so there is with ; elementarity again, now for , gives . The witness lies in , as required.
() Assume the witness condition. We prove for all and tuples from , by induction on . For atomic the equivalence holds because is a substructure: term values agree and the induced relations match. The connective cases and are immediate from the inductive hypothesis. The case that uses the hypothesis is . If , a witness gives , so by the inductive hypothesis, hence . Conversely if , the witness condition supplies with , and the inductive hypothesis gives , so . Universal quantifiers are handled through , already covered. Thus the inclusion is elementary.
Corollary (downward Löwenheim-Skolem). If , is infinite, is an -structure, and with , then there is with and . Build as a Skolem hull: starting from , repeatedly adjoin, for each formula with parameters already in hand that satisfies existentially, one witness . Each round adds at most elements and there are formulas, so the union has size , is closed under the witness condition, and is closed under functions; the Tarski-Vaught test then gives [Marker §2.3]. In particular every infinite structure in a countable language has a countable elementary substructure — the model-theoretic reading of the theorem, drawing on the compactness/Löwenheim-Skolem machinery of 42.01.07 pending.
Bridge. The Tarski-Vaught test is the foundational reason elementary substructure, defined by an unbounded condition over all formulas, is decided by a single existential-witness chase, and this is exactly the engine of the Skolem-hull construction. It builds toward the elementary-chain theorem below, whose proof reuses the existential-witness step stage by stage, and it appears again in the method of diagrams of 42.02.02 pending, where compactness builds elementary extensions by realising . The argument generalises the coincidence-and-isomorphism preservation of 42.01.04 pending from full structure maps to the partial setting of a substructure inclusion: an isomorphism preserves everything because it is onto, and the witness condition is precisely the surjectivity-surrogate that recovers elementarity for an inclusion that is not onto. The central insight is that elementarity is a closure property — closed under existential witnesses — not a global comparison, and putting these together, the same witness chase yields downward Löwenheim-Skolem, the elementary chain theorem, and the diagram constructions that carry the rest of model theory.
Exercises Intermediate+
Advanced results Master
The toolkit fixed in the Formal definition supports four developments: the preservation hierarchy that grades maps by the formulas they respect, the Tarski-Vaught machinery driving elementary chains and Löwenheim-Skolem, the back-and-forth and Ehrenfeucht-Fraïssé characterisations of elementary equivalence with no deductive calculus in sight, and the method of diagrams that turns embeddings into models.
Theorem 1 (the preservation hierarchy). The kinds of maps between -structures are graded by the syntactic class they preserve. A homomorphism preserves atomic positive formulas in the forward direction; an embedding preserves all quantifier-free formulas in both directions; an elementary embedding preserves every first-order formula [Hodges Ch. 1]. The Łoś-Tarski theorem sharpens the first level: a first-order theory is preserved under substructures iff it is axiomatisable by universal () sentences, and preserved under extensions iff by existential () sentences; the Chang-Łoś-Suszko theorem extends this to chains, where preservation under unions of chains characterises -axiomatisability. These preservation theorems read the map hierarchy off the quantifier prefix, the semantic counterpart of the prenex hierarchy of 42.01.03 pending.
Theorem 2 (Tarski-Vaught, elementary chains, and Löwenheim-Skolem). The Tarski-Vaught test characterises by the single condition that every -formula satisfiable in over parameters from is witnessed inside [Tarski and Vaught 1957]. From it the union of an elementary chain is an elementary extension of each member, and the Skolem-hull construction yields the downward Löwenheim-Skolem-Tarski theorem: every infinite with has, over any with , an elementary substructure of size . Compactness 42.01.07 pending supplies the upward direction — every infinite structure has arbitrarily large elementary extensions — so the elementary-substructure relation populates every infinite cardinal, and the Löwenheim-Skolem-Tarski theorem fixes the spectrum of cardinalities at which a theory has models.
Theorem 3 (back-and-forth, Ehrenfeucht-Fraïssé, and Fraïssé's characterisation of ). A back-and-forth system between and is a nonempty set of finite partial isomorphisms closed under the forth property (each extends to any ) and the back property (each extends to any ); its existence implies , and for countable implies [Hodges Ch. 3]. The finitary form is the Ehrenfeucht-Fraïssé game : across rounds Spoiler plays an element from either structure and Duplicator answers in the other, Duplicator winning iff the chosen tuples form a partial isomorphism. The Fraïssé-Hintikka theorem states that Duplicator wins iff and agree on all sentences of quantifier rank , so Duplicator wins every finite game iff . This converts elementary equivalence — a statement quantifying over the infinitely many sentences — into a combinatorial game, the indispensable tool for separating structures in finite model theory and for the - laws.
Theorem 4 (the method of diagrams). Robinson's diagram lemma renders embeddings as satisfaction facts: admits an embedding of iff some expansion of models the atomic diagram , and an elementary embedding iff it models the elementary diagram [Chang and Keisler Ch. 2]. Fed to the compactness theorem of 42.02.02 pending, this manufactures elementary extensions realising prescribed types, the source of saturated and homogeneous models; combined with downward Löwenheim-Skolem it produces the elementary substructures of controlled cardinality on which stability theory operates. The diagram method is the bridge from the static comparison of two structures to the constructive generation of new ones, and it is the technique unit 42.02.02 pending develops in full alongside quantifier elimination 42.02.05 pending.
Synthesis. The Tarski-Vaught test is the foundational reason elementarity is a closure property rather than a global comparison, and putting these together it controls all four developments: it is exactly what makes the elementary-chain theorem run stage by stage, and the Skolem hull it builds is the downward Löwenheim-Skolem theorem read as a witness-closure construction. The preservation hierarchy generalises the isomorphism-preserves-truth theorem of 42.01.04 pending from the top of the ladder downward — an isomorphism preserves everything because it is total and onto, an embedding preserves only the quantifier-free fragment because it sees no witnesses outside its image, and elementary embedding is the exact surplus that recovers the quantifiers; this is the central insight that the quantifier prefix of 42.01.03 pending, read semantically, grades both formulas and the maps preserving them. Back-and-forth is dual to the deductive route to : where completeness 42.01.06 pending certifies same-theory by a proof system, the Ehrenfeucht-Fraïssé game certifies it by a combinatorial strategy, the same relation approached from syntax and from play. The method of diagrams is the bridge that turns every preceding comparison into a construction, feeding the compactness of 42.02.02 pending to build the elementary extensions, types, and saturated models on which the structural model theory of 42.02.05 pending and beyond is erected. This is the toolkit promised at the Beginner tier — embeddings, , , and the games that detect it — assembled by recursion on the satisfaction relation of 42.01.04 pending and standing ready for the rest of model theory to deploy.
Full proof set Master
Proposition 1 (substructure preserves quantifier-free formulas; embedding criterion). If then for every quantifier-free and tuple from . Conversely an injective commuting with the constants and functions and satisfying is an embedding, and preserves all quantifier-free formulas.
Proof. Term values agree: by induction on terms, for from , since the constants and functions of restrict to those of . Atomic : both sides ask whether the common tuple of term values lies in , and the tuple is in , so the answers coincide; equality is identity in both. Connectives propagate the equivalence, and quantifier-free formulas are Boolean combinations of atomics, so the equivalence holds throughout. For the converse, the term induction uses the constant- and function-commutation; the atomic biconditional is the relation hypothesis together with injectivity for equality; Boolean combinations preserve the biconditional.
Proposition 2 (Tarski-Vaught test). For : iff for every and from , implies some has .
Proof. () Elementarity gives , so a witness has , and elementarity again gives . () Induct on to show for from . Atomic: Proposition 1. Connectives: inductive hypothesis. Existential : forward, a witness in transfers up by the inductive hypothesis; backward, the witness condition supplies with , and the inductive hypothesis gives . Universals reduce via . Hence the inclusion is elementary.
Proposition 3 (downward Löwenheim-Skolem-Tarski). Let infinite, an -structure, with . There is with and .
Proof. Fix a choice of Skolem witnesses: for each formula and tuple from with , select one with . Set and . Since there are formulas and, at each stage, parameter tuples, whenever ; by induction every has size , so has . contains all constants and is closed under functions (a function value is the witness for ), so is the universe of a substructure . For the witness condition: if with from , then lies in some , so witnesses . By Proposition 2, .
Proposition 4 (elementary chain theorem). If is an elementary chain then for every .
Proof. The union is a structure: universes increase, and each being a substructure inclusion makes the interpretations cohere, so a constant, function value, or relation instance computed in any containing the relevant elements is independent of . Prove for from , by induction on . Atomic: substructure relation. Connectives: inductive hypothesis. Existential : forward is immediate as ; backward, a witness lies in some , , so by the inductive hypothesis, whence , and returns . Universals via . So the inclusion is elementary.
Proposition 5 (back-and-forth yields , and isomorphism in the countable case). If a back-and-forth system between and exists then ; if moreover are countable then .
Proof. For : show by induction on quantifier rank that for with domain tuple and range tuple , and every , . Atomic and Boolean cases hold because is a partial isomorphism and the inductive hypothesis. For : if with witness , the forth property extends to with ; the inductive hypothesis applied to gives , so . The converse uses the back property symmetrically. Taking empty (the empty map lies in , which is nonempty and downward closed under restriction) gives equality of theories, . For isomorphism with countable, enumerate and and build in alternately forcing the next element of into the domain (forth) and the next element of into the range (back); the union is an order-respecting bijection commuting with all symbols, an isomorphism.
Connections Master
Structures and Tarski's definition of truth
42.01.04pending is the semantic foundation this unit builds on. The satisfaction relation , the coincidence lemma, and the isomorphism-preserves-truth theorem proved there are the exact inputs to the definitions of elementary embedding, , and here; every formula induction in this unit (Tarski-Vaught, elementary chains, back-and-forth) is run over the recursive satisfaction clauses of that unit. That unit owns the meaning of a single structure; this unit owns the comparison of structures.The Löwenheim-Skolem theorems
42.01.07pending supply the compactness and Skolem-function machinery that the downward Löwenheim-Skolem corollary here reads model-theoretically. The upward direction — arbitrarily large elementary extensions — is a compactness consequence proved there, and together with the Tarski-Vaught Skolem hull of this unit it fixes the cardinal spectrum of an elementary class. The two units meet wherever a theory's models must be produced at a prescribed cardinality.The method of diagrams and the compactness theorem in model theory, co-produced as
42.02.02pending, take the atomic and elementary diagrams introduced here as their primitive device. Robinson's diagram lemma of this unit, fed to compactness there, manufactures the elementary extensions, realised types, and saturated models that are the working objects of model theory; the embeddings and elementary embeddings defined here become satisfaction facts about diagrams there.Quantifier elimination and model completeness, co-produced as
42.02.05pending, specialise the preservation hierarchy and the Tarski-Vaught test of this unit to theories whose definable sets collapse to the quantifier-free level. Model completeness is exactly the statement that every embedding between models of the theory is elementary, the strongest possible link between the embedding and elementary-embedding levels graded here; quantifier elimination is the syntactic certificate that produces it, and the dense-linear-order back-and-forth of this unit is its first instance.
Historical & philosophical context Master
The systematic study of structures compared by embeddings and elementary maps belongs to the consolidation of model theory in the 1950s. Alfred Tarski and Robert Vaught's "Arithmetical extensions of relational systems" (1957) introduced the elementary-extension relation and the elementary-substructure relation as primary objects, proved the test now bearing their names, and established the elementary-chain union theorem; these results turned the Löwenheim-Skolem phenomena — Leopold Löwenheim (1915) and Thoralf Skolem (1920) had shown first-order theories with infinite models have countable models — into the controlled construction of elementary substructures and extensions of prescribed cardinality [Tarski and Vaught 1957].
The back-and-forth method descends from Georg Cantor's 1895 proof that the countable dense linear orders without endpoints form a single isomorphism type; Edward Huntington and others isolated the technique, and Roland Fraïssé (1954) and Andrzej Ehrenfeucht (1961) recast it as the game that characterises elementary equivalence by quantifier rank, the Fraïssé-Hintikka analysis fixing the connection to sentences of bounded rank. Abraham Robinson's method of diagrams, developed through the 1950s, made embeddings into models and supplied the model-theoretic proof technique that compactness drives; the preservation theorems of Łoś, Tarski, Suszko, and Chang reading the quantifier prefix off the map hierarchy were assembled in the same period and codified in the textbooks of Chang and Keisler, Hodges, and Marker [Chang and Keisler Ch. 3].
Bibliography Master
@book{marker2002modeltheory,
author = {Marker, David},
title = {Model Theory: An Introduction},
series = {Graduate Texts in Mathematics},
volume = {217},
publisher = {Springer},
year = {2002}
}
@book{changkeisler1990,
author = {Chang, Chen Chung and Keisler, H. Jerome},
title = {Model Theory},
edition = {3},
series = {Studies in Logic and the Foundations of Mathematics},
volume = {73},
publisher = {North-Holland},
year = {1990}
}
@book{hodges1993modeltheory,
author = {Hodges, Wilfrid},
title = {Model Theory},
series = {Encyclopedia of Mathematics and its Applications},
volume = {42},
publisher = {Cambridge University Press},
year = {1993}
}
@book{hodges1997shorter,
author = {Hodges, Wilfrid},
title = {A Shorter Model Theory},
publisher = {Cambridge University Press},
year = {1997}
}
@article{tarskivaught1957,
author = {Tarski, Alfred and Vaught, Robert L.},
title = {Arithmetical extensions of relational systems},
journal = {Compositio Mathematica},
volume = {13},
year = {1957},
pages = {81--102}
}
@article{fraisse1954,
author = {Fra\"{i}ss\'{e}, Roland},
title = {Sur quelques classifications des syst\`{e}mes de relations},
journal = {Publications Scientifiques de l'Universit\'{e} d'Alger, S\'{e}rie A},
volume = {1},
year = {1954},
pages = {35--182}
}
@article{ehrenfeucht1961,
author = {Ehrenfeucht, Andrzej},
title = {An application of games to the completeness problem for formalized theories},
journal = {Fundamenta Mathematicae},
volume = {49},
year = {1961},
pages = {129--141}
}