Sequences — convergence and limits
Anchor (Master): Rudin Ch. 3; Royden Real Analysis Ch. 2; Dieudonné Foundations of Modern Analysis Ch. 3
Intuition Beginner
A sequence is an infinite list of real numbers, one entry for each counting number: . The list never ends. The question that drives this whole chapter is whether the numbers in the list eventually settle down toward a single target value, or whether they keep wandering forever.
Take the list where the -th entry is . The entries shrink as you read down the list. Pick any tiny positive target distance, say . Once you read past entry , every remaining entry is smaller than . Pick a tinier distance, say . Once you read past entry one million, every remaining entry is smaller still. The list settles toward , and we say the sequence converges to .
Compare the list where the entries flip sign forever. No matter how far you read, the entries never settle. This sequence does not converge.
The precise rule for "settles toward a target" is the heart of this unit. The rule turns the vague idea of approaching into a checkable test: name any positive tolerance, however small, and there is a point in the list past which every entry sits within that tolerance of the target. That single rule, written down carefully, is what makes the rest of calculus possible.
Visual Beginner
The picture shows a number line from to . Tick marks appear at the sequence entries , clustering ever more tightly around . A shaded band of width sits around , and every tick mark past entry falls inside the band.
The band is the tolerance made visible. The picture says: name a band width, and there is an index past which every entry lives inside the band. That index is the cutoff the definition asks for.
Worked example Beginner
We check that the sequence converges to using the tolerance rule with a specific tolerance .
The rule asks for a cutoff index such that every entry with index at least lies within distance of the target . That requirement reads .
The inequality rearranges to . So works: for every index at least , the value is at most . The entry and every later entry is smaller, so all sit within the tolerance band around .
The same calculation produces a cutoff for any positive tolerance. For tolerance , choose . For tolerance , choose (rounded up). Each tolerance yields its own cutoff, and a cutoff exists for every positive tolerance. That existence is exactly what the statement "the sequence converges to " means.
Check your understanding Beginner
Formal definition Intermediate+
Fix the real line with its absolute value and the usual order from 02.02.01. A sequence of real numbers is a function , written or simply , where is the -th term.
Definition (convergence). The sequence converges to iff for every there exists such that for every , . Write or .
Definition (divergence). A sequence that does not converge is divergent. Divergence covers sequences that escape to infinity (), sequences that oscillate without settling (), and sequences with several accumulating values.
Definition (bounded sequence). A sequence is bounded iff some satisfies for every .
Definition (monotone sequence). is monotone increasing iff for every ; monotone decreasing iff for every ; monotone if either holds.
Definition (subsequence). A subsequence of is a sequence where is a strictly increasing sequence of indices in .
Definition (Cauchy sequence). A sequence is Cauchy iff for every there exists such that implies .
The Cauchy definition does not name a limit. Its equivalence with convergence over is a deep theorem that depends on the completeness axiom of 02.02.01; that equivalence, together with the Bolzano-Weierstrass theorem, is proved in full in 02.03.02. This unit builds the rest of the convergence toolkit — the limit laws, the squeeze theorem, the monotone convergence theorem — directly on the ε– definition, and states the Cauchy and Bolzano-Weierstrass results as forward references.
The presentation follows Rudin [Rudin Ch. 3] and Abbott [Abbott Ch. 2–3]; both organise the chapter so that the ε– definition and the algebraic limit theorem precede subsequences and the Cauchy criterion.
Counterexamples to common slips
- Consecutive entries getting closer to does not imply convergence to . The sequence has entries whose distance to decreases at every step, yet . Convergence requires the distance to drop below every positive tolerance, not merely to decrease.
- A bounded sequence need not converge. The sequence is bounded by but oscillates between two values. Boundedness plus monotonicity is what forces convergence (the monotone convergence theorem below); boundedness alone gives only a convergent subsequence (Bolzano-Weierstrass,
02.03.02). - A sequence can have several subsequential limits without converging. The sequence has a subsequence converging to and another converging to . The full sequence converges iff every subsequence converges to the same limit.
- Strict inequalities are not preserved by limits. If for every , the limits may agree: take and . The limit preserves only non-strict inequality (), proved below.
Key theorem with proof Intermediate+
Proposition (uniqueness of limits). If and in , then .
Proof. Suppose . Set . Choose so that gives both and . The triangle inequality of 00.01.02 gives , a contradiction. So .
Theorem (algebraic limit theorem). If and , then: (i) ; (ii) for any ; (iii) ; (iv) if and for all , then .
Proof of (i). Fix . Choose so gives . Choose so gives . Set . For , .
Proof of (ii). If the claim reads . If , fix and choose so gives . Then .
Proof of (iii). Decompose . Because , the sequence is bounded: some has for every (a convergent sequence is bounded, proved in the Full proof set). Set . Fix and choose so gives both and . Then .
Proof of (iv). It is enough to show ; the quotient rule then follows from (iii). Since , eventually , so for large , . Fix and choose so gives and . Then .
Theorem (squeeze theorem). If for every and , , then .
Proof. Fix . Choose so gives both and , i.e., and . Sandwiching, , so .
Theorem (monotone convergence theorem). Every bounded monotone sequence of real numbers converges. A bounded-above monotone-increasing sequence converges to ; a bounded-below monotone-decreasing sequence converges to .
Proof. Let be monotone increasing and bounded above. The set is non-empty and bounded above, so by the LUB axiom of 02.02.01 the supremum exists in .
Fix . Because is the least upper bound, is not an upper bound of : some has . By monotonicity, for every , . Because is an upper bound, . Combining, for every . So .
The monotone-decreasing case applies the same argument to , or directly to the greatest lower bound.
Theorem (subsequence characterization). A sequence converges to iff every subsequence of also converges to .
Proof. () If , fix and choose so gives . For any subsequence , the index map is strictly increasing, so ; thus for , and . () The full sequence is a subsequence of itself.
Corollary. If has two subsequences converging to different limits, then diverges.
Theorem (Bolzano-Weierstrass, statement). Every bounded sequence in has a convergent subsequence. The full proof — via interval bisection producing a nested sequence of closed intervals whose lengths shrink to zero — appears in 02.03.02, where the theorem is paired with the Cauchy criterion and shown to be one of the equivalent reformulations of the completeness axiom of 02.02.01.
Bridge. The ε– definition of convergence builds toward 02.03.02 (where the Cauchy criterion and Bolzano-Weierstrass theorem are proved, and convergence is characterised without naming the limit) and appears again in 02.03.03 (where an infinite series is declared convergent exactly when its partial-sum sequence satisfies this definition). The foundational reason the definition is set up this way — naming the limit first, then producing an index for each tolerance — is that it makes the limit laws and the squeeze theorem direct consequences of the triangle inequality of 00.01.02. This is exactly the structural fact that lets later analysis inherit the same toolkit: a function-limit statement reduces to a sequence-limit statement by testing along sequences , and continuity in 02.04.02 becomes "preserve convergent sequences". The central insight is that convergence is preserved under the field operations (the algebraic limit theorem) and under order-sandwiching (the squeeze theorem), and these two preservation principles cover almost every concrete limit computation. Putting these together, the limit laws package the field structure of as a calculus of limits, and the monotone convergence theorem packages the order structure of (via the LUB axiom) as a limit-existence theorem; the two together form the working foundation on which 02.03.02 and 02.03.03 build.
Exercises Intermediate+
Lean formalization Intermediate+
lean_status: none — the ε– definition, the algebraic limit theorem, the squeeze theorem, and the monotone convergence theorem all have Mathlib counterparts. Concretely, Metric.tendsto_atTop unpacks the ε– definition on ℝ; Tendsto.add, Tendsto.mul, Tendsto.const_smul, and Tendsto.div supply the four parts of the algebraic limit theorem; the squeeze_succ lemma family supplies the squeeze theorem; and exists_tendsto_of_monotone_bounded together with the isLUB / csupr machinery supplies the monotone convergence theorem wired to the LUB structure of 02.02.01.
What Mathlib does not package in a single place is the undergraduate-curriculum form of these results side by side: the algebraic limit theorem collected as one named block, the squeeze theorem stated for sequences (rather than filters), and the standard worked estimates — the verification, the limit, the Cesàro mean theorem — gathered for pedagogy. The Codex namespace records this as a packaging task rather than a missing theorem.
Advanced results Master
The ε– definition supports two refinements that turn "does the sequence converge?" into a quantitative theory: the order-theoretic refinement (limsup and liminf) and the subsequence refinement (the set of subsequential limits). Both are grounded in the monotone convergence theorem and lead into the Cauchy and Bolzano-Weierstrass theory of 02.03.02.
Definition (limit superior and limit inferior). For a bounded sequence , set and . The sequence is monotone decreasing and bounded below; is monotone increasing and bounded above. Both converge by the monotone convergence theorem. Define and . Both exist as real numbers by the completeness axiom of 02.02.01.
Theorem (limsup/liminf characterization). Let be a bounded sequence. Then (i) ; (ii) converges iff , in which case equals their common value; (iii) is the largest subsequential limit of and is the smallest.
Proof sketch. (i) For every , ; taking limits preserves the non-strict inequality by Exercise 6. (ii) If , then for every and both are squeezed to , so . Conversely, if , then with both bounds converging to , and the squeeze theorem gives . (iii) is a refinement of Bolzano-Weierstrass: extract a subsequence converging to by choosing indices with close to ; the full construction appears in 02.03.02. [Royden Ch. 2]
Theorem (subsequential limits form a closed set). The set of subsequential limits of a bounded sequence in is a non-empty closed subset of . Its maximum is and its minimum is .
Bolzano-Weierstrass (02.03.02) gives . The order-completeness of gives and by extracting subsequences whose terms approach the supremum and infimum. Closure under limits of sequences in is a diagonal argument: a sequence of subsequential limits, each realised by a subsequence of , has a limit realised by a diagonal subsequence. The details belong with the compactness theory of 02.03.02.
Theorem (completeness equivalences, summary). Over the Archimedean ordered-field axioms of 02.02.01, the following are equivalent: (a) the LUB axiom; (b) the monotone convergence theorem; (c) the nested-interval property; (d) the Cauchy criterion (every Cauchy sequence converges); (e) the Bolzano-Weierstrass theorem.
The monotone convergence theorem implies the LUB axiom by approximating with a monotone-increasing sequence of elements of ; the LUB axiom implies monotone convergence by the proof above; the nested-interval property is an equivalent geometric form; the Cauchy criterion's equivalence with convergence is proved in 02.03.02; and the Bolzano-Weierstrass theorem is shown there to be derivable from any of the other four. The five reformulations are the structural content of completeness on the real line. [Rudin Ch. 3] [Abbott Ch. 2–3]
Theorem (convergence in general metric spaces). The ε– definition specialises to the case where the distance is . In a general metric space from 02.01.05, a sequence converges to iff for every some has for .
The algebraic limit theorem does not generalise to metric spaces (it relies on the field structure of ), but the squeeze theorem generalises in the form: if and , then . The monotone convergence theorem relies essentially on the order structure of and has no metric-space analogue. The Cauchy criterion, by contrast, generalises verbatim and becomes the working definition of completeness for metric spaces, leading to the Banach-space theory of 02.11.04. [Dieudonné Ch. 3]
Synthesis. The convergence theory of real sequences identifies three faces of limit existence on : the algebraic face (the limit laws), the order-theoretic face (the monotone convergence theorem together with limsup and liminf), and the metric face (the ε– definition itself, and the Cauchy criterion of 02.03.02). The foundational reason the three faces cohere is the completeness axiom of 02.02.01: each face reformulates completeness, and each reformulation generalises to a different broader setting — the algebraic face to topological groups and vector spaces, the order-theoretic face to complete lattices and ordered sets, the metric face to complete metric spaces and uniform spaces. This is exactly the structural decomposition that explains why calculus works on but fails on : the field operations are identical on both, but only carries the completeness that turns bounded monotone lists into convergent lists. Putting these together identifies the algebraic limit theorem as the bridge from the field axioms to computable limits, the squeeze theorem as the bridge from the order axioms to inherited convergence, and the monotone convergence theorem as the bridge from the LUB axiom to limit existence. The bridge is the equivalence of the ε– definition, the Cauchy criterion, the monotone convergence theorem, and the LUB axiom — four formulations of one structural fact about , each natural in a different downstream setting.
Full proof set Master
Proposition (uniqueness of limits). Proved in §"Key theorem with proof" above.
Proposition (algebraic limit theorem, product rule, full estimate). If and , then .
Proof. Decompose . Because , the sequence is bounded: choose so gives , and set , so for every . Set . Fix and choose so gives both and . Then
Proposition (convergent sequences are bounded). If , then is bounded.
Proof. Take in the convergence definition: some has for , so for . Set ; then for every .
Proposition (squeeze theorem). Proved in §"Key theorem with proof" above.
Proposition (monotone convergence theorem). Proved in §"Key theorem with proof" above.
Proposition (preservation of non-strict inequalities). If , , and for every , then .
Proof. Suppose . Set . Choose so gives and . Then and , so , contradicting the hypothesis. So .
Proposition (Cesàro mean theorem). If , then .
Proof. Given , choose so implies . Set , a finite constant. Then
Choose . For , and , so .
The converse fails: diverges but its Cesàro means converge to . Cesàro summability is therefore strictly weaker than ordinary convergence, a fact used in the summability theory of Fourier series.
Proposition (subsequence characterization). iff every subsequence of converges to .
Proof. () If , fix and choose so gives . For any subsequence , strict increase of gives , so implies and . () The full sequence is a subsequence of itself.
Connections Master
Real-number axioms
02.02.01. The ε– definition of sequence convergence is the sequential translation of the LUB completeness axiom: every bounded monotone sequence converges because the supremum of its range exists as a real number. The monotone convergence theorem proved in this unit is one of the equivalent reformulations of completeness identified in02.02.01and shown equivalent to the Cauchy criterion in02.03.02. The Archimedean property of02.02.01is the explicit engine behind every concrete ε– estimate, including the computation in the worked example and the argument of Exercise 3.Cauchy sequences and Bolzano-Weierstrass
02.03.02. The Cauchy criterion — convergence characterised without naming the limit — is the metric reformulation of the ε– definition developed here. The Bolzano-Weierstrass theorem — every bounded sequence has a convergent subsequence — is the compactness reformulation. Both are proved in02.03.02, and their equivalence with the monotone convergence theorem of this unit is the structural content of the completeness axiom. The set of subsequential limits studied in the Advanced results above is closed and non-empty by Bolzano-Weierstrass, with and as its extreme points.Infinite series
02.03.03. An infinite series converges iff its sequence of partial sums converges in the sense of this unit. Every convergence test in02.03.03— comparison, ratio, alternating — ultimately reduces to checking that the partial-sum sequence satisfies the ε– definition, usually via the Cauchy criterion of02.03.02or the monotone convergence theorem of this unit. The limit laws proved here are what license termwise algebraic manipulation of convergent series.Continuous functions
02.04.02. A function is continuous at iff for every sequence , the image sequence . This sequential characterization reduces function limits to sequence limits, and every theorem about continuous functions (the intermediate value theorem, the extreme value theorem, uniform continuity) is proved by composing sequences with and applying the limit laws and the squeeze theorem of this unit.Metric spaces
02.01.05. The ε– definition generalises from with absolute value to any metric space by replacing with . The algebraic limit theorem does not generalise (it needs field structure), but the squeeze theorem and the Cauchy criterion do. Metric-space convergence is the natural language for the Banach-space and Hilbert-space theory of02.11.04, where the Cauchy criterion becomes the defining property of completeness.
Historical & philosophical context Master
Augustin-Louis Cauchy's Cours d'analyse of 1821 [Cauchy 1821] gave the first systematic treatment of sequence convergence. Cauchy wrote that a sequence converges to when the differences become "as small as one wishes" for sufficiently large — the informal statement of the ε– definition. Cauchy used this definition to prove the algebraic limit theorem, the squeeze principle, and the convergence of geometric series, establishing the working toolkit that this unit formalises. Cauchy did not separate the tolerance from the cutoff symbolically; that notational step came later.
Bernard Bolzano's 1817 Rein analytischer Beweis [Bolzano 1817], written four years before Cauchy's Cours, contained the bounded-monotone convergence argument as a lemma embedded in the first analytic proof of the intermediate value theorem. Bolzano recognised that a bounded set of real numbers has a least upper bound (his formulation of completeness) and used it to extract convergent subsequences; the monotone convergence theorem of this unit is a direct descendant of Bolzano's lemma. The paper was largely unread outside Prague for half a century.
Karl Weierstrass's Berlin lectures of the 1860s [Weierstrass 1894] standardised the ε– (and ε–) notation that made the limit definition fully rigorous. The notation separates the two quantifiers — "for every " and "there exists an " — that Cauchy had run together, and is the form in which the definition is taught today. Weierstrass's rigorisation is what allowed the late-nineteenth-century unification of sequence convergence, continuous functions, and Riemann integration under a single ε-based framework.
The modern textbook presentation in Rudin's Principles of Mathematical Analysis Ch. 3 [Rudin Ch. 3] and Abbott's Understanding Analysis Ch. 2–3 [Abbott Ch. 2–3] arranges the results in the order: ε– definition, algebraic limit theorem, squeeze theorem, monotone convergence theorem, subsequences, then Bolzano-Weierstrass and the Cauchy criterion (here deferred to 02.03.02). This unit follows that arrangement, with Dieudonné's filter-based treatment [Dieudonné Ch. 3] and Royden's limsup/liminf presentation [Royden Ch. 2] supplying the Master-tier generalisations.
Bibliography Master
@book{Cauchy1821Cours,
author = {Cauchy, Augustin-Louis},
title = {Cours d'analyse de l'{\'E}cole royale polytechnique. 1.re partie. Analyse alg{\'e}brique},
publisher = {Debure fr{\`e}res},
address = {Paris},
year = {1821}
}
@book{Bolzano1817Rein,
author = {Bolzano, Bernard},
title = {Rein analytischer Beweis des Lehrsatzes, da{\ss} zwischen je zwey Werthen, die ein entgegengesetztes Resultat gew{\"a}hren, wenigstens eine reelle Wurzel der Gleichung liege},
publisher = {Gottlieb Haase},
address = {Prag},
year = {1817}
}
@book{Weierstrass1894Werke,
author = {Weierstrass, Karl},
title = {Mathematische Werke},
publisher = {Mayer \& M{\"u}ller},
address = {Berlin},
year = {1894}
}
@book{RudinPrinciples,
author = {Rudin, Walter},
title = {Principles of Mathematical Analysis},
edition = {3rd},
publisher = {McGraw-Hill},
year = {1976}
}
@book{AbbottUnderstanding,
author = {Abbott, Stephen},
title = {Understanding Analysis},
edition = {2nd},
publisher = {Springer},
year = {2015}
}
@book{DieudonneFoundations,
author = {Dieudonn{\'e}, Jean},
title = {Foundations of Modern Analysis},
publisher = {Academic Press},
year = {1960}
}
@book{RoydenRealAnalysis,
author = {Royden, H. L.},
title = {Real Analysis},
edition = {3rd},
publisher = {Macmillan},
year = {1988}
}