02.08.01 · analysis / ode

First-order linear and separable ODEs

shipped3 tiersLean: none

Anchor (Master): Leibniz 1676 manuscript on separation of variables (originator); Bernoulli 1695 Acta Eruditorum (Bernoulli equation, originator); Euler 1743 De integratione aequationum differentialium (integrating factor, originator); Picard 1890 Memoires de la Societe des Sciences physiques et naturelles de Bordeaux (Picard iteration); Lindelof 1894 Acta Societatis Scientiarum Fennicae (Lipschitz condition refinement)

Intuition [Beginner]

A differential equation is a puzzle: you know something about the derivative of a function, and you must find the function itself. The simplest version says "the rate of change is proportional to the current value," which describes population growth, radioactive decay, and compound interest.

Some of these puzzles can be solved by moving all the -terms to one side and all the -terms to the other. This is called a separable equation. Other puzzles have a different form — they are linear in and its derivative — and they require a clever multiplying factor (called an integrating factor) to make them solvable.

Why does this concept exist? Because most physical laws are stated as relationships between a quantity and its rate of change, and solving these relationships is the first step to predicting how systems evolve over time.

Visual [Beginner]

The picture shows a slope field for the equation . At each point in the plane, a short line segment is drawn with slope equal to . The segments are flat along the horizontal axis (), get steeper as increases, and point downward below the axis. Several solution curves thread through the field, each an exponential for different starting values .

A slope field for y' = y: short line segments at grid points with slopes equal to the y-coordinate. Solution curves Ce^x pass through the field, tangent to the segments.

Each solution curve is everywhere tangent to the slope field, confirming that its derivative at each point matches the prescribed slope.

Worked example [Beginner]

Solve the equation given that when .

Step 1. Separate the variables: move to the left and to the right. Write .

Step 2. Find the total of each side. The left side gives . The right side gives .

Step 3. Solve for : , so where . Using the initial condition : , so .

What this tells us: the solution grows by a factor of for every unit increase in . The initial value determines the scaling, and the rate determines the growth speed.

Check your understanding [Beginner]

Formal definition [Intermediate+]

Definition (First-order ODE). A first-order ordinary differential equation is an equation of the form

where is a function defined on a domain . A solution on an interval is a differentiable function satisfying for all .

Definition (Separable ODE). The equation is separable if for some functions and . The solution is obtained by writing and antidifferentiating both sides.

Definition (Linear ODE). The equation is linear (first-order). When it is homogeneous; otherwise it is non-homogeneous. The integrating factor is , and multiplying through by gives , which is solved by antidifferentiating.

Counterexamples to common slips

  • Not every first-order ODE is separable. The equation cannot be separated into a product . It requires the integrating factor method for linear equations.

  • Separation requires . When solving (the logistic equation), dividing by excludes the constant solutions and . These must be checked separately.

  • The integrating factor is not itself. The factor is , not . The exponential of the integral is what makes the left side into a perfect derivative.

Key theorem with proof [Intermediate+]

Theorem (Picard-Lindelof existence and uniqueness). Let be continuous on the rectangle and satisfy the Lipschitz condition in : there exists such that

for all . Then the initial value problem , has a unique solution on the interval where and .

Proof (sketch via Picard iteration). Define the Picard iterates

Each is well-defined on (by induction, using ). The key estimate is

This is proved by induction: the base case . For the inductive step, the Lipschitz condition gives

Since , the series converges uniformly by comparison with . Thus converges uniformly to a limit on . Passing to the limit in the Picard recurrence gives , so solves the IVP.

For uniqueness: if is another solution, then . By Gronwall's inequality (or directly by iteration), .

Bridge. This theorem is the foundational reason that initial value problems for ODEs have well-defined solutions under mild conditions, and this is exactly the bridge from local analysis (continuity and Lipschitz bounds) to global existence. The central insight is that Picard iteration is a contraction in the supremum norm, so the Banach fixed-point theorem guarantees convergence. The result builds toward the general theory of second-order ODEs 02.08.02 where existence and uniqueness extend to systems, and appears again in 02.12.01 where the vector field formulation of produces integral curves via Picard iteration. Putting these together with the mean value theorem 02.05.02, the bridge is that Lipschitz continuity — the same condition underlying the MVT — is what makes the iteration contract.

Exercises [Intermediate+]

Advanced results [Master]

Theorem 1 (Exact equations). An ODE is exact if there exists with and . A necessary and sufficient condition (on a simply connected domain) is . The solution is given implicitly by .

The proof of sufficiency constructs and verifies by the fundamental theorem and using the exactness condition .

Theorem 2 (Integrating factors for non-exact equations). If , an integrating factor may exist such that is exact. If depends only on , then works. If depends only on , then works.

Theorem 3 (Bernoulli equation). The equation (with ) is transformed into a linear equation by the substitution . The resulting linear equation is solved by the integrating factor method.

Theorem 4 (Clairaut equation). The equation has general solution (a family of straight lines) and singular solution obtained by eliminating from and . The singular solution is the envelope of the family of lines.

Theorem 5 (Gronwall's inequality). If with continuous, then . This is the workhorse inequality for proving uniqueness of ODE solutions and for estimating the growth of perturbations.

Theorem 6 (Maximal interval of existence). If is locally Lipschitz in and continuous, the solution of , extends uniquely to a maximal interval . If , then as (or leaves the domain of ). This "blow-up criterion" characterises when solutions fail to exist globally.

Synthesis. The foundational reason first-order ODE theory works is that the Picard iteration is a contraction mapping in a suitable function space, and this is exactly the bridge from pointwise conditions (Lipschitz in ) to global existence (solutions on intervals). The central insight is that the three solution methods — separation of variables, integrating factors, and exact equations — are all special cases of finding a function whose level curves are the solution trajectories. Putting these together with Gronwall's inequality, the bridge is that uniqueness (no two solutions cross) and existence (every initial condition generates a solution) together make the solution operator a well-defined flow map, which generalises to systems 02.08.02 and appears again in the phase-space formulation 02.12.01 where the flow map moves points along integral curves. The pattern recurs in 02.12.13 where variation of parameters extends the integrating factor idea to inhomogeneous linear systems.

Full proof set [Master]

Proposition 1 (Solution of the linear ODE via integrating factor). The general solution of on an interval where and are continuous is

Proof. Define . Then

by the product rule and the fact that . Multiplying the ODE by :

Antidifferentiating: , so .

Proposition 2 (Exactness criterion). On a simply connected domain , the equation is exact if and only if on .

Proof. () If exact, there exists with and . By equality of mixed partials (valid since are ), .

() Define where is to be determined. Then by FTC. For : . Using : . Setting makes . The function works.

Proposition 3 (Bernoulli substitution). The substitution transforms into the linear equation .

Proof. Since , we have . Multiply the Bernoulli equation by :

This is , a linear equation in .

Connections [Master]

  • Mean value theorem 02.05.02. The Lipschitz condition is a consequence of having a bounded partial derivative , which in turn follows from the MVT applied to as a function of . The MVT provides the quantitative estimate needed for the Picard iteration to converge.

  • Fundamental theorems of calculus 02.04.04. The Picard iteration is built from the FTC: the solution is constructed as the integral of the right-hand side. The integrating factor method also relies on FTC when computing and .

  • Phase space and integral curves 02.12.01. The first-order ODE defines a vector field on the plane, and solutions are integral curves of this field. The Picard-Lindelof theorem guarantees that through each point passes exactly one such curve, establishing the flow map that moves points along their trajectories.

Historical & philosophical context [Master]

Leibniz 1676, in his unpublished manuscripts on the calculus [Leibniz1676], introduced the method of separation of variables as the first systematic technique for solving differential equations. His approach was purely algorithmic: isolate the variables and antidifferentiate. Bernoulli 1695, in Acta Eruditorum [Bernoulli1695], posed the equation as a challenge problem, now known as the Bernoulli equation. Leibniz himself solved it the following year by the substitution .

Euler 1743, in De integratione aequationum differentialium [Euler1743], systematised the integrating factor method for linear equations and developed the theory of exact equations. Picard 1890, in the Memoires de la Societe des Sciences de Bordeaux [Picard1890], introduced the iteration scheme that bears his name and proved existence and uniqueness under Lipschitz conditions, using the method of successive approximations. Lindelof 1894 refined the existence theory by showing that the Lipschitz condition is the sharp hypothesis for uniqueness, distinguishing it from the weaker continuity hypothesis that guarantees existence alone (Peano's theorem, 1890).

Bibliography [Master]

@article{Bernoulli1695,
  author = {Bernoulli, Jakob},
  title = {Explicationes, annotationes et additiones ad ea quae in Actis superiorum annorum de Curva Elastica, Isochrona Paracentrica, et Caetera sunt prodita},
  journal = {Acta Eruditorum},
  year = {1695},
  pages = {537--553},
}

@article{Euler1743,
  author = {Euler, Leonhard},
  title = {De integratione aequationum differentialium},
  journal = {Novi Commentarii Academiae Scientiarum Petropolitanae},
  year = {1743},
}

@article{Picard1890,
  author = {Picard, Emile},
  title = {Memoire sur la theorie des equations aux derivees partielles et la methode des approximations successives},
  journal = {Journal de Mathematiques Pures et Appliquees},
  year = {1890},
  volume = {4},
  pages = {145--210},
}

@book{Apostol1967,
  author = {Apostol, Tom M.},
  title = {Calculus, Volume 1},
  publisher = {John Wiley \& Sons},
  year = {1967},
}

@book{BoyceDiPrima2008,
  author = {Boyce, William E. and DiPrima, Richard C.},
  title = {Elementary Differential Equations and Boundary Value Problems},
  publisher = {John Wiley \& Sons},
  year = {2008},
  edition = {9th},
}