Picard-Lindelof existence and uniqueness for ODEs
Anchor (Master): Picard 1890 Memoire sur la methode des approximations successives (originator); Lindelof 1894 Acta Societatis Scientiarum Fennicae (sharp Lipschitz hypothesis); Peano 1890 Demonstration de l'integrabilite des equations differentielles ordinaires (existence without uniqueness); Gronwall 1919 Annals of Mathematics (the inequality bearing his name)
Intuition Beginner
A differential equation tells you the slope of a curve at every point. Add one starting value, and you face a sharp question: is there a curve that obeys those slopes and passes through that start — and is it the only one? This is the question of existence and uniqueness. Most physical models assume the answer is yes: a pendulum released from a known angle with a known speed has exactly one future. But the answer is not automatic. Some slope rules are so badly behaved that many curves fit, or none do. Picard and Lindelof isolated the clean condition that settles the matter.
The condition is a steady-steepness rule: if you nudge the starting value a little, the slope nudges by a proportional amount, never more. Under that rule, a process called Picard iteration builds the answer. You begin with a flat guess (the starting value held constant), feed it into the slope rule to get a better guess, and feed that guess back in. Each pass refines the curve. The guesses settle down to one limit, and that limit is the unique solution. Picture a navigator who keeps correcting a heading against the local compass field until the traced path stops moving.
Why care? Because before solving anything, you want assurance the problem is well-posed: one and only one future flows from each starting state. Without that, a computer simulation could drift between equally valid answers, and predictions would mean nothing. This unit delivers that assurance and names the precise price: continuity of the slope rule buys existence; a Lipschitz bound on steepness buys uniqueness. Drop the bound and existence survives (Peano) but uniqueness can fail — two curves can leave the same start and diverge.
Visual Beginner
The picture shows two panels side by side. The left panel plots the first four Picard iterates for , : a flat line , then a slanted line , then , then , each one hugging the exponential more tightly. The right panel shows the Peano failure: the equation , , carries not one but a whole family of solution curves leaving the origin — a flat curve together with parabolas that branch off at every starting delay.
The contrast is the whole story in one image: a Lipschitz bound (left) funnels the iteration onto a single curve; continuity alone (right) leaves the future underdetermined.
Worked example Beginner
Run Picard iteration for with , and watch the guesses close in on the true curve at .
Step 0. Start with the flat guess — the starting value held constant.
Step 1. The slope rule is "slope ". On the slope is everywhere. Accumulate this slope from to : the improved guess is .
Step 2. On the slope is . Accumulate from to : you add , giving .
Step 3. On the slope is . Accumulate to add , giving .
The exact solution is . At the guesses read , , , , marching toward .
What this tells us: each pass layers one more power of onto the guess, exactly rebuilding the exponential one term at a time. The iteration cannot help but converge, because the slope rule's steepness is bounded.
Check your understanding Beginner
Formal definition Intermediate+
Definition (Initial value problem). Let be open and let be continuous. The initial value problem (IVP) is
A solution on an interval is a map with satisfying the ODE and the initial condition. The vector-valued formulation covers a single higher-order equation after the standard reduction 02.08.02, so the theory below applies to every order at once.
Definition (Lipschitz in ). The function is Lipschitz in on if there exists with
for all . It is locally Lipschitz in if every point of has a neighbourhood on which such a bound holds. A sufficient condition, obtained from the mean value theorem 02.05.02, is that exists and is bounded on .
Definition (Picard operator). Setting the IVP in integral form via the fundamental theorem of calculus 02.04.04,
defines the Picard operator on continuous curves by . A solution of the IVP is precisely a fixed point of .
Counterexamples to common slips
Continuity is weaker than Lipschitz. The map is continuous on but not Lipschitz near : the difference quotient blows up as . The IVP , , has the constant solution and also (and the delayed parabolas for any ).
A finite Lipschitz constant is local, not global. The equation has , which is locally Lipschitz everywhere but not globally Lipschitz on . Existence and uniqueness hold only up to a finite blow-up time; the solution from escapes at .
Existence on a strip is not existence for all time. The Picard-Lindelof theorem is local: it produces a solution on with . Extending to a maximal interval is a separate argument (the blow-up alternative below).
Key theorem with proof Intermediate+
Theorem (Picard-Lindelof: local existence and uniqueness). Let be continuous on the rectangle and Lipschitz in on with constant . Set and (with if ). Then the IVP , , has a unique solution on .
The proof rests on a single abstract fact, which we state as a lemma so the contraction-mapping theorem is visible in the argument 02.11.04.
Lemma (Banach contraction mapping principle). Let be a non-empty complete metric space and a contraction, i.e. for some . Then has a unique fixed point, and the iterates converge to it for every .
Proof of the theorem. By the fundamental theorem of calculus 02.04.04, a curve solves the IVP on an interval if and only if it satisfies the integral equation with the Picard operator above. We exhibit a complete metric space on which is a contraction.
Let and let , a closed ball in the Banach space with the supremum norm 02.11.04; hence is complete.
maps into itself. For and ,
so .
is a contraction in the Bielecki norm with . This norm is equivalent to the supremum norm, so completeness is preserved. For ,
Multiplying by and taking the supremum gives . Since , is a contraction. By the lemma, has a unique fixed point in , and the Picard iterates (with ) converge to it.
The fixed point is the unique solution that stays in the ball . Any solution on a subinterval must stay in (the same estimate applies), so uniqueness holds on all of .
Bridge. This theorem is the foundational reason initial value problems are well-posed under a Lipschitz condition, and this is exactly the bridge from pointwise regularity of the vector field to a globally meaningful solution operator. The central insight is that the Picard operator is a contraction in a weighted norm, so completeness of the function space 02.11.04 alone forces a unique fixed point. The result builds toward the phase-flow picture 02.12.01 where existence and uniqueness promote the solution into a one-parameter group acting on state space, and appears again in 02.12.08 where Gronwall-type estimates convert the very same Lipschitz data into Lyapunov stability of nearby trajectories. Putting these together, the bridge is that one quantitative bound on how fiercely the field can shear neighbouring points is simultaneously what drives the iteration to converge and what bars nearby solutions from tearing apart.
Exercises Intermediate+
Advanced results Master
Theorem (Peano existence). If is continuous on the rectangle (with no Lipschitz hypothesis), then the IVP , , has at least one solution on with . The proof is non-constructive: one builds a sequence of polygonal Euler approximations with step , each uniformly bounded by and equicontinuous (their slopes are bounded by ); the Arzela-Ascoli theorem supplies a uniformly convergent subsequence, and the limit satisfies the integral equation by continuity of . Existence without a uniqueness mechanism is the cost — the Peano example above shows the defect is real, not an artefact of the proof [Peano1890].
Theorem (Gronwall's inequality). Integral form. If is continuous, is non-decreasing, and on , then . Differential form. If is differentiable with , then . The estimate is the workhorse of ODE theory: it converts the integral inequality satisfied by the difference of two solutions into an exponential bound forcing that difference to vanish [Gronwall1919].
Theorem (maximal interval and the blow-up alternative). If is continuous and locally Lipschitz in on , then the solution through extends uniquely to a maximal interval of existence , and this interval is open. The escape criterion states: if , then the solution leaves every compact subset of as ; in the common case this reads . Contrapositively, a solution that stays bounded on a finite time interval can be extended further. This is why escapes at while is global: the former blows up, the latter decays.
Theorem (continuous dependence on initial data). Under the hypotheses of Picard-Lindelof, the solution depends Lipschitz-continuously on the initial value. Concretely, if and are two solutions with the same Lipschitz constant on a common interval , then
The proof applies Gronwall to .
Theorem (continuous dependence on parameters). If is continuous and Lipschitz in (uniformly in ) and Lipschitz in , the solution is continuous — indeed locally Lipschitz — in . This is the theorem that licenses perturbation analysis and numerical simulation: small changes in the model or the data produce small changes in the trajectory.
Theorem (Osgood's uniqueness criterion). Lipschitz is sufficient but not necessary for uniqueness. If for a modulus with and the Osgood condition , then the IVP has a unique solution. The Lipschitz case is ; the borderline still gives uniqueness, while (the Peano scale) does not. This sharpens the existence/uniqueness dichotomy to its precise threshold.
Synthesis. The foundational reason the Picard-Lindelof machinery works is that solving an IVP is secretly a fixed-point problem in a complete function space, and this is exactly the bridge between real analysis (continuity, Lipschitz bounds, the mean value theorem 02.05.02) and the geometric theory of flows. The central insight is that a single quantitative estimate — a Lipschitz bound on the vector field — simultaneously yields existence (the iteration converges), uniqueness (Gronwall forces two solutions to coincide), and continuous dependence (the solution map is Lipschitz in the data). Putting these together, the bridge is that well-posedness is one phenomenon with three faces: existence, uniqueness, and stability. The pattern generalises to abstract evolution equations in Banach spaces 02.11.04 and appears again in the phase flow 02.12.01 and in Lyapunov stability 02.12.08, where Gronwall's estimate is the seed of every stability argument. The result builds toward PDE theory, where the same fixed-point reasoning underlies mild solutions, and the Peano-Osgood dichotomy recurs wherever a vector field is continuous but not Lipschitz.
Full proof set Master
Proposition 1 (Gronwall's inequality, integral form). Let be continuous and non-negative on , continuous, non-decreasing and continuous. If , then .
Proof. Set , so and . Because is non-decreasing and ,
(in the distributional sense; replace by its measure when is merely non-decreasing). Multiply by the integrating factor : , so . Hence , using that is non-decreasing. Since , the claim follows.
Proposition 2 (blow-up alternative). Let be continuous and locally Lipschitz in on , and let be the maximal solution with . Then as .
Proof. Suppose for contradiction that on for some . On the compact rectangle the hypotheses of Picard-Lindelof hold: is bounded by some and Lipschitz in with some constant . Apply the local theorem at the point for small: it returns a solution on an interval of half-width that depends only on , hence is bounded below by a constant independent of . Choosing extends the solution past , contradicting maximality of . Therefore no such exists, i.e. .
Proposition 3 (Lipschitz dependence on initial data). Under the hypotheses of the continuous-dependence theorem, for on the common interval of existence.
Proof. Subtract the integral equations for the two solutions:
This is a Gronwall inequality with and , so Proposition 1 gives the displayed exponential bound.
Connections Master
Banach space fundamentals
02.11.04. The Picard operator acts on the space of continuous curves, and the proof needs this space to be complete in the (equivalent) Bielecki norm so that the contraction mapping principle returns a fixed point. Completeness of the ambient function space is the single structural fact the existence argument consumes; without it the iterates would converge to nothing.Mean value theorem
02.05.02. The Lipschitz-in- hypothesis is most often checked via the mean value theorem: if the partial derivative exists and is bounded by , then pointwise. The MVT is thus the bridge from differentiability of the vector field to the quantitative estimate the contraction needs.Fundamental theorems of calculus
02.04.04. Equivalence of the IVP with the integral equation is the fundamental theorem of calculus, and it is what turns a differential problem into a fixed-point problem. The Picard operator, Gronwall's integrating factor, and the variation-of-constants formula02.12.13are all downstream of this single equivalence.Phase space, vector field, integral curve
02.12.01. Existence and uniqueness through every point are exactly what promote a vector field into a flow , a one-parameter family of maps moving states along integral curves. Without uniqueness there is no well-defined flow map; the Picard-Lindelof theorem is the existence certificate the geometric theory of ODEs stands on.Lyapunov stability, direct method
02.12.08. The continuous-dependence estimate is the prototype stability bound: nearby starts stay nearby, with rate controlled by the Lipschitz constant. Gronwall's inequality, proved here in full, is the engine behind virtually every Lyapunov-function estimate.
Historical & philosophical context Master
Cauchy, in his 1820s lectures on the calculus at the Ecole Polytechnique, gave the first existence theorems for under the hypothesis that be analytic, constructing the solution as a power series. This was the seed, but analyticity is a heavy price. Picard 1890, in his Memoire sur la theorie des equations aux derivees partielles et la methode des approximations successives [Picard1890], replaced analyticity by continuity plus a Lipschitz condition and gave the iteration scheme bearing his name, proving convergence of the successive approximations to the unique solution. Lindelof 1894, in the Acta Societatis Scientiarum Fennicae [Lindelof1894], refined the hypotheses and showed that the Lipschitz condition is the sharp dividing line: it is what one needs for uniqueness, over and above existence.
Peano 1890, in Demonstration de l'integrabilite des equations differentielles ordinaires [Peano1890], proved that continuity alone already guarantees existence, by a compactness argument (the lineage of the modern Euler-polygon and Arzela-Ascoli proof). The equation , , exhibited in the same paper, showed that Peano existence without Lipschitz genuinely permits non-uniqueness — a philosophical puncture in Laplacian determinism: a perfectly continuous law of evolution can fail to determine a unique future. Gronwall 1919, in the Annals of Mathematics [Gronwall1919], introduced the inequality that now bears his name while studying dependence on a parameter, supplying the estimate that welded uniqueness, continuous dependence, and stability into a single quantitative framework.
Bibliography Master
@book{CoddingtonLevinson1955,
author = {Coddington, Earl A. and Levinson, Norman},
title = {Theory of Ordinary Differential Equations},
publisher = {McGraw-Hill},
year = {1955},
}
@book{Hartman1982,
author = {Hartman, Philip},
title = {Ordinary Differential Equations},
edition = {2nd},
publisher = {Birkhauser},
year = {1982},
}
@book{Arnold1992,
author = {Arnold, V. I.},
title = {Ordinary Differential Equations},
publisher = {Springer-Verlag},
year = {1992},
}
@article{Picard1890,
author = {Picard, Emile},
title = {Memoire sur la theorie des equations aux derivees partielles et la methode des approximations successives},
journal = {Journal de Mathematiques Pures et Appliquees},
volume = {4},
year = {1890},
pages = {145--210},
}
@article{Lindelof1894,
author = {Lindelof, Ernst},
title = {Sur l'application de la methode des approximations successives aux equations differentielles ordinaires du premier ordre},
journal = {Acta Societatis Scientiarum Fennicae},
volume = {21},
year = {1894},
}
@article{Peano1890,
author = {Peano, Giuseppe},
title = {Demonstration de l'integrabilite des equations differentielles ordinaires},
journal = {Mathematische Annalen},
volume = {37},
year = {1890},
pages = {182--228},
}
@article{Gronwall1919,
author = {Gronwall, Thomas H.},
title = {Note on the derivatives with respect to a parameter of the solutions of a system of differential equations},
journal = {Annals of Mathematics},
volume = {20},
number = {4},
year = {1919},
pages = {292--296},
}