Lyapunov Exponents: Definition, Computation, and the Chaotic Double Pendulum
Anchor (Master): Barreira & Pesin, Lyapunov Exponents and Smooth Ergodic Theory (2002); Katok & Hasselblatt, Introduction to the Modern Theory of Dynamical Systems (1995); Oseledets 1968
Intuition Beginner
Set up two identical double pendulums. Release the first from an initial angle of 90 degrees for the upper arm and 90 degrees for the lower arm. Release the second from 90.001 degrees and 90 degrees -- a difference of one thousandth of a degree, far smaller than any human can see or any physical apparatus can control. For the first few seconds the two pendulums swing in unison. Then they start to drift. After ten or twenty seconds the motions are completely different: one pendulum spins clockwise while the other flips counter-clockwise. The tiny difference at the start has grown to dominate the entire state of the system.
This is sensitive dependence on initial conditions, the defining feature of deterministic chaos. The Lyapunov exponent is the number that tells you how fast this divergence happens. If the Lyapunov exponent is , then a tiny initial separation between two trajectories grows over time approximately as . When is positive, the separation grows exponentially: the system is chaotic. When is zero or negative, nearby trajectories stay close or converge: the motion is regular.
Think of the Lyapunov exponent as a speedometer for chaos. A larger positive value means faster divergence and more unpredictable dynamics. For the double pendulum at low energy (small swings), the Lyapunov exponent is zero and the motion is regular. At high energy (large swings, flips, and tumbling), the Lyapunov exponent becomes positive and the motion is chaotic. The transition between regular and chaotic motion as you increase the energy is one of the central phenomena in classical mechanics.
An -dimensional system has Lyapunov exponents -- one for each independent direction in phase space. This is the Lyapunov spectrum. The largest one is the maximal Lyapunov exponent (MLE), and it is the single most important number for diagnosing chaos: if the MLE is positive, the system is chaotic. The other exponents tell you about contraction and conservation of volumes in phase space.
Visual Beginner
| Quantity | Symbol | Meaning | Chaos signature |
|---|---|---|---|
| Maximal Lyapunov exponent | Fastest rate of trajectory divergence | ||
| Lyapunov spectrum | Divergence rates in all directions | At least one positive | |
| Lyapunov sum | Volume change rate | Zero (Hamiltonian) | |
| Prediction horizon | Time to lose predictability | Decreases as grows |
Worked example Beginner
The doubling map is the simplest chaotic system with a computable Lyapunov exponent. It acts on numbers between 0 and 1 by doubling and keeping only the fractional part: .
Start two trajectories at and . The initial separation is . After each iteration:
- Step 1: , . Separation: .
- Step 2: , . Separation: .
- Step 3: , . Separation: .
The separation doubles each step. After steps, . The Lyapunov exponent is the exponential growth rate: . This means the separation grows by a factor of per iteration.
The prediction horizon is the time at which the initial uncertainty has grown to the size of the entire system. Starting from and the system size being 1:
After about 20 iterations, the two trajectories are completely unrelated. The Lyapunov exponent sets a hard limit on how far into the future you can predict.
Check your understanding Beginner
Formal definition Intermediate+
Let be a flow on an -dimensional manifold . Fix a trajectory and let be an infinitesimal perturbation to the initial condition, evolved by the linearised equations (the tangent flow ).
The maximal Lyapunov exponent
The maximal Lyapunov exponent (MLE) at is
provided the limit exists and is independent of the initial perturbation (for generic perturbations). This measures the asymptotic exponential rate of stretching along the most expanding direction.
The Lyapunov spectrum
The full Lyapunov spectrum is obtained by considering the growth rates of all -dimensional volume elements (). Equivalently, one tracks the growth of each principal axis of an infinitesimal ellipsoid transported by . The -th Lyapunov exponent is:
where is the -th largest singular value of . The existence of these limits for almost every point (with respect to an ergodic invariant measure) is guaranteed by the Oseledets multiplicative ergodic theorem (see Master section).
Properties of the Lyapunov spectrum
Volume contraction: For a flow that contracts volumes at rate , the sum of all Lyapunov exponents equals : . For a Hamiltonian system, (Liouville's theorem).
Symplectic pairing: For a Hamiltonian system with degrees of freedom, the Lyapunov exponents come in pairs for . There are also two exponents equal to zero (along the flow direction and the energy surface).
Ergodic invariance: If is an ergodic invariant measure, the Lyapunov exponents are constant -almost everywhere. Different ergodic measures can give different Lyapunov spectra.
Numerical computation: the Wolf algorithm
Computing Lyapunov exponents numerically requires care because the tangent vectors grow exponentially and quickly exceed floating-point range. The standard approach (Wolf, Swift, Swinney, and Vastano, 1985) proceeds as follows:
Integrate the trajectory and simultaneously integrate the tangent equations (the variational equations for ) starting from an orthonormal basis .
At regular time intervals , apply Gram-Schmidt orthonormalisation to the evolved basis . This prevents the vectors from collapsing onto the most expanding direction.
Record the logarithms of the normalisation factors at each step. The -th Lyapunov exponent is the long-time average of the logarithm of the -th Gram-Schmidt factor divided by .
where is the length of the -th vector after subtracting its projection onto the previous vectors at the -th renormalisation step.
The double pendulum equations
The double pendulum consists of two rigid rods of lengths and masses , with the upper end of the first rod pivoted at a fixed point and the upper end of the second rod pivoted at the lower end of the first rod. The configuration is described by the angles (first rod from vertical) and (second rod from vertical).
The Lagrangian is:
The equations of motion are a coupled pair of second-order nonlinear ODEs. Setting and for simplicity, and defining the state vector where , the system becomes with given by the Euler-Lagrange equations:
These equations are integrated numerically (e.g. RK4 or adaptive Runge-Kutta) to produce trajectories. The tangent equations are obtained by differentiating with respect to and integrating the resulting linear system alongside the trajectory. For the double pendulum, is a matrix of partial derivatives that depends on the current state. The Lyapunov exponents are extracted from the long-time behaviour of the tangent map using the Wolf algorithm.
Numerical results for the double pendulum
For the standard double pendulum (, ), numerical computation reveals:
- Low energy (): The Lyapunov spectrum is approximately -- all exponents are zero, and the motion is regular (two coupled oscillators).
- Moderate energy (): One pair of exponents becomes nonzero: while . The system is partially chaotic.
- High energy (): The maximal Lyapunov exponent grows with energy. Typical values for give (in units where is measured in ).
The transition from regular to chaotic motion is not sharp: as energy increases, chaotic regions in phase space grow at the expense of regular islands, following the pattern described by KAM theory 09.08.01 and Poincare sections 09.08.02.
Worked examples Intermediate+
Computing the Lyapunov exponent of the logistic map
The logistic map is a one-dimensional map, so it has a single Lyapunov exponent:
For , the logistic map is chaotic. The invariant measure is on . The Lyapunov exponent is:
This can also be verified numerically: iterate starting from any generic , accumulate at each step, and average. After iterations the estimate converges to .
For , the orbit converges to a period-4 cycle. The Lyapunov exponent is , confirming regular (periodic) motion.
The Henon map Lyapunov spectrum
For the Henon map , with , (dissipative), the Lyapunov spectrum has two exponents. The Jacobian determinant is , so . Numerical computation gives and , confirming . The positive confirms chaos.
The double pendulum: a numerical protocol
To compute the Lyapunov spectrum of the double pendulum:
- Choose parameters: , , .
- Set initial conditions: e.g. rad, rad, .
- Compute the total energy: J (well into the chaotic regime).
- Integrate the equations of motion using RK4 with time step s.
- Simultaneously integrate the tangent equations (4 coupled linear ODEs with state-dependent coefficients) starting from a identity matrix.
- Every s, apply Gram-Schmidt to the 4 column vectors and record the logarithms of the normalisation factors.
- Average over renormalisation steps (total integration time: s).
Typical result: , , , . The pairing and is the expected pattern for a Hamiltonian system with 2 degrees of freedom (two symplectic pairs, with one pair at zero corresponding to the energy surface and the flow direction). The positive confirms chaotic dynamics.
Key derivation Intermediate+
Deriving the Lyapunov exponent for a one-dimensional map
For a one-dimensional map , two trajectories starting at and evolve as:
The perturbation after steps is . By the chain rule:
The exponential growth rate of the perturbation is:
For a chaotic system, this limit exists and is positive for almost every initial condition (with respect to the natural invariant measure). The Lyapunov exponent converts the product of derivatives along the orbit into an average of logarithmic derivatives, which is amenable to both analytical and numerical computation.
Bridge
The Lyapunov exponent is the bridge between the geometric picture of chaos (stretching and folding in the horseshoe 09.08.02) and its quantitative measurement. The horseshoe stretches nearby points apart at an exponential rate; the Lyapunov exponent is precisely that exponential rate. The Smale-Birkhoff theorem guarantees the existence of a horseshoe when there is a transverse homoclinic intersection, and the resulting Lyapunov exponent is per horseshoe iterate (the stretching factor of the horseshoe is 2). For physical systems like the double pendulum, the Lyapunov exponent serves as the primary diagnostic: it is positive in the chaotic regime and zero in the regular regime, providing a clear, computable boundary between order and chaos.
Exercises Intermediate+
Lean formalization Intermediate+
Mathlib has no theory of Lyapunov exponents. The closest infrastructure is the derivative of a flow (the tangent map), which exists in the ODE theory within Mathlib/Analysis/ODE/, but the following are all absent:
Oseledets multiplicative ergodic theorem: the existence of Lyapunov exponents as limits, the Oseledets splitting , and the measurability of the Lyapunov filtration.
Pesin stable manifold theorem: the existence of smooth stable manifolds at points with negative Lyapunov exponents, and the local product structure.
Pesin entropy formula: the equality relating the metric entropy to the sum of positive Lyapunov exponents.
Kaplan-Yorke formula: the conjectured relation between Lyapunov exponents and the information dimension of an attractor.
Wolf algorithm: numerical computation of Lyapunov exponents requires verified numerical ODE integration, which Mathlib does not support.
lean_status: none reflects the gap. This unit ships without a Lean module and is reviewer-attested.
Advanced results Master
The Oseledets multiplicative ergodic theorem
The existence of Lyapunov exponents as well-defined limits is guaranteed by one of the deepest results in ergodic theory.
Theorem (Oseledets 1968). Let be a diffeomorphism of a compact Riemannian manifold , and let be an -invariant probability measure. Then for -almost every , there exists a splitting of the tangent space and real numbers such that:
- For every : .
- The splitting is -invariant: .
- The numbers and the dimensions are -measurable and constant on each ergodic component.
For flows , the analogous statement holds with replaced by and by . The Oseledets splitting is sometimes called the Lyapunov filtration and the subspaces are the Oseledets subspaces.
The proof relies on the Furstenberg-Kesten theorem (1960), which establishes that the limits exist almost surely for matrix cocycles over measure-preserving transformations. Oseledets' contribution was to refine this to obtain the full splitting and the individual exponents by applying the Furstenberg-Kesten theorem to the exterior powers .
Pesin's entropy formula
The Kolmogorov-Sinai (KS) entropy measures the rate of information production by the dynamics with respect to the invariant measure . Pesin's formula connects this purely measure-theoretic quantity to the geometric Lyapunov exponents.
Theorem (Pesin 1977). Let be a diffeomorphism () of a compact Riemannian manifold , and let be an -invariant probability measure that is absolutely continuous with respect to the Riemannian volume. Then:
That is, the metric entropy equals the integral of the sum of positive Lyapunov exponents.
The converse direction is the Pesin entropy formula (sometimes called the Ruelle inequality in the forward direction): Ruelle (1978) proved that for any invariant measure, and Pesin proved equality when is absolutely continuous. The Ledrappier-Young theorem (1985) characterises exactly which measures satisfy equality: the SRB (Sinai-Ruelle-Bowen) measures.
For the double pendulum with the Liouville measure on the energy surface, Pesin's formula gives the entropy in terms of the positive Lyapunov exponents computed numerically. The KS entropy quantifies the rate at which the double pendulum generates information about its initial conditions -- the rate at which prediction becomes impossible.
The Kaplan-Yorke conjecture
The Kaplan-Yorke conjecture (1979) relates the Lyapunov spectrum to the fractal dimension of an attractor. Given the ordered Lyapunov exponents , define as the largest integer with . The Lyapunov dimension is:
Conjecture (Kaplan-Yorke). For "typical" attractors, the information dimension equals the Lyapunov dimension .
The conjecture has been proved for uniformly hyperbolic systems (where holds for SRB measures by a result of Ledrappier, 1981) and for certain classes of two-dimensional maps. It remains open in full generality. The physical intuition is that the expanding directions stretch the attractor (contributing to its dimension) while the contracting directions compress it. The Lyapunov dimension interpolates between the integer dimensions by weighting the next direction by the ratio of the remaining expansion to the first contraction.
Relation to Kolmogorov-Sinai entropy
The KS entropy and the Lyapunov exponents are connected through a chain of inequalities and equalities:
- Ruelle inequality: for any invariant measure (1978).
- Pesin equality: for smooth invariant measures (1977).
- Margulis-Ruelle inequality: A refinement that accounts for the multiplicity of exponents.
- Ledrappier-Young theorem: The equality holds if and only if has absolutely continuous conditional measures on the unstable manifolds (i.e., is an SRB measure).
For the double pendulum, the KS entropy (with respect to the Liouville measure on an energy surface) is given by Pesin's formula as the integral of the positive Lyapunov exponents. In the regular regime, all exponents are zero and the entropy is zero: no information is produced. In the chaotic regime, and the entropy is positive: the system generates information at a rate proportional to .
Synthesis
The Lyapunov spectrum provides the quantitative fingerprint of chaotic dynamics. The Oseledets theorem guarantees that the exponents exist as well-defined limits for almost every trajectory. Pesin's formula connects the exponents to the metric entropy, establishing that chaos (positive Lyapunov exponents) is equivalent to information production (positive KS entropy). The Kaplan-Yorke conjecture links the exponents to the fractal geometry of attractors. Together, these results form the quantitative backbone of chaos theory: the horseshoe 09.08.02 provides the geometric mechanism, and the Lyapunov exponents provide the numbers that quantify how fast that mechanism operates.
Full proof set Master
Proposition 1 (Lyapunov exponent of the doubling map). The Lyapunov exponent of the doubling map is for Lebesgue-almost every .
Proof. The map is piecewise linear with at every point where the derivative exists (i.e., all ). The Lyapunov exponent is:
The limit exists immediately (every term is ) at every point whose orbit avoids . The orbit of under is (a finite set), and its preimages are the dyadic rationals , which form a countable (hence measure zero) set. For Lebesgue-almost every , the orbit avoids and .
Proposition 2 (Symplectic pairing of Lyapunov exponents). Let be a Hamiltonian flow on a -dimensional symplectic manifold. Then the Lyapunov exponents satisfy for (when ordered ).
Proof. The tangent map is a symplectic matrix: where is the symplectic form. The symplectic eigenvalues come in reciprocal pairs: if is a singular value of , so is . This follows because if for unit vectors , then by symplecticity (the symplectic adjoint). Taking logarithms and the limit : if the growth rate along is , the growth rate along is . Therefore each exponent is paired with . Combined with Liouville's theorem (), the exponents are .
Proposition 3 (Ruelle inequality). Let be a diffeomorphism of a compact manifold and an -invariant probability measure. Then .
Proof sketch (following Ruelle 1978). The metric entropy is bounded by the volume growth rate of small balls under iteration: , averaged over . The local volume expansion is controlled by the sum of the positive Lyapunov exponents via the Oseledets splitting: in the directions with , the volume of an infinitesimal parallelepiped grows as where is the number of positive exponents. This volume growth bounds the rate at which -measure of neighbourhoods changes, giving the inequality.
Proposition 4 (Lyapunov exponent of the logistic map at ). For the logistic map with the invariant measure , the Lyapunov exponent is .
Proof. The derivative is . The Lyapunov exponent is:
Substitute (so , , and ):
Splitting: .
The integral (a classical result). Therefore .
Connections Master
Hamiltonian mechanics
09.04.01provides the symplectic structure that constrains the Lyapunov spectrum: the exponents come in pairs and their sum is zero (Liouville's theorem). The canonical coordinates define the tangent space in which the Lyapunov exponents are computed.Poincare sections and the horseshoe
09.08.02provide the geometric mechanism (stretching and folding) that generates positive Lyapunov exponents. The horseshoe's stretching factor of 2 per iterate gives a Lyapunov exponent of .KAM theory
09.08.01describes the regular islands where Lyapunov exponents are zero, surrounded by chaotic seas where the MLE is positive. The transition from regular to chaotic as energy increases corresponds to the destruction of KAM tori.Strange attractors
09.08.05in dissipative systems are characterised by a positive MLE combined with a negative sum of exponents (volume contraction). The Kaplan-Yorke formula connects the Lyapunov spectrum to the fractal dimension of the attractor.Ergodic theory
38.03.01develops the measure-theoretic framework (Oseledets theorem, Pesin formula, Ledrappier-Young theorem) that gives the Lyapunov exponents their rigorous meaning. The physics of the double pendulum provides the primary example.
Historical & philosophical context Master
Lyapunov and the stability of motion (1892)
Aleksandr Mikhailovich Lyapunov introduced his characteristic exponents in his 1892 doctoral dissertation "The General Problem of the Stability of Motion" at the University of Kharkov. Lyapunov's original motivation was the stability of rotating fluid masses (the figure of the Earth, studied earlier by Maclaurin, Jacobi, and Poincare). He developed what is now called Lyapunov's first method (or the indirect method): linearise the equations near an equilibrium and study the eigenvalues of the linearised system. For time-dependent or nonlinear systems where the eigenvalues alone do not determine stability, Lyapunov introduced the characteristic numbers (now called Lyapunov exponents) that measure the asymptotic growth rate of solutions.
Lyapunov's work was far ahead of its time. The connection between positive characteristic numbers and chaotic dynamics was not made until the 1960s-1970s, when the theory of dynamical systems matured. The modern definition of the Lyapunov spectrum (as opposed to Lyapunov's original characteristic numbers) is due to Oseledets (1968), who proved the existence of the spectrum for almost every trajectory with respect to an invariant measure.
Oseledets and the multiplicative ergodic theorem (1968)
Valentin Oseledets, a student of Sinai at Moscow State University, proved the multiplicative ergodic theorem in 1968. The theorem establishes that the Lyapunov exponents exist as well-defined limits for almost every point (with respect to an ergodic invariant measure) and that the tangent space splits into invariant subspaces corresponding to each exponent. Oseledets' proof uses the Furstenberg-Kesten theorem on the growth of norms of matrix products and a careful analysis of the exterior algebra of the tangent bundle. The result is one of the pillars of smooth ergodic theory, alongside the Pesin theory that builds on it.
Pesin theory (1977)
Yakov Pesin, working at the University of Syktyvkar and later at Penn State, developed the theory of smooth hyperbolic systems (now called Pesin theory) in a landmark 1977 paper. Pesin proved three fundamental results: (1) the existence of stable and unstable manifolds at almost every point with a nonzero Lyapunov exponent (the Pesin stable manifold theorem), (2) the entropy formula relating the KS entropy to the sum of positive Lyapunov exponents (Pesin's formula), and (3) the equivalence between positive Lyapunov exponents and the "hyperbolicity" of the system in a measure-theoretic sense. Pesin theory extends the classical theory of uniformly hyperbolic systems (Anosov, Smale) to the case of non-uniform hyperbolicity, where the expansion and contraction rates vary from point to point. This is precisely the situation for the double pendulum and most physical systems.
Wolf and the numerical computation (1985)
Alan Wolf and collaborators published their algorithm for computing Lyapunov exponents from time series in 1985, making the Lyapunov exponent a practical tool for experimental physics and engineering. The Wolf algorithm (Gram-Schmidt renormalisation of the tangent vectors) remains the standard method. Its importance is that it works with experimental data, not just equations: given a time series of measurements, one can reconstruct the dynamics (via delay embedding, following Takens 1981) and compute the Lyapunov spectrum, providing a direct experimental test for chaos.
Philosophical implications
The Lyapunov exponent quantifies the tension between determinism and predictability. A deterministic system can have a positive Lyapunov exponent, meaning that exact knowledge of the present state determines the future exactly, but approximate knowledge determines the future approximately only for a finite time proportional to where is the precision of the initial measurement. For the double pendulum, with (in SI units for typical parameters), an initial precision of radians gives a prediction horizon of about seconds. Beyond this time, the motion is unpredictable in practice, even though the equations are deterministic. The Lyapunov exponent converts the philosophical puzzle of deterministic chaos into a concrete, measurable number.
Bibliography Master
Lyapunov, A. M., "The General Problem of the Stability of Motion," doctoral dissertation, University of Kharkov (1892). English translation: Taylor & Francis (1992). The original definition of characteristic numbers (Lyapunov exponents) and the first and second methods of stability analysis.
Oseledets, V. I., "A multiplicative ergodic theorem. Lyapunov characteristic numbers for dynamical systems," Trans. Moscow Math. Soc. 19 (1968), 197-231. The Oseledets theorem establishing the existence and properties of the Lyapunov spectrum for almost every trajectory.
Pesin, Ya. B., "Characteristic Lyapunov exponents and smooth ergodic theory," Russian Math. Surveys 32 (1977), 55-114. The Pesin entropy formula, stable manifold theorem, and the foundations of non-uniform hyperbolicity theory.
Ruelle, D., "An inequality for the entropy of differentiable maps," Bol. Soc. Brasil. Mat. 9 (1978), 83-87. The Ruelle inequality bounding metric entropy by the integral of positive Lyapunov exponents.
Ledrappier, F. & Young, L.-S., "The metric entropy of diffeomorphisms. Part I: Characterization of measures satisfying Pesin's entropy formula," Ann. Math. 122 (1985), 509-539. Characterisation of SRB measures via the equality in Pesin's formula.
Kaplan, J. L. & Yorke, J. A., "Chaotic behavior of multidimensional difference equations," in Functional Differential Equations and Approximation of Fixed Points, Springer Lecture Notes in Mathematics 730 (1979), 204-227. The Kaplan-Yorke conjecture relating Lyapunov exponents to fractal dimension.
Wolf, A., Swift, J. B., Swinney, H. L. & Vastano, J. A., "Determining Lyapunov exponents from a time series," Physica D 16 (1985), 285-317. The Wolf algorithm for numerical computation of the Lyapunov spectrum.
Barreira, L. & Pesin, Ya. B., Lyapunov Exponents and Smooth Ergodic Theory (AMS, 2002). A modern comprehensive treatment of the Oseledets theorem, Pesin theory, and non-uniform hyperbolicity.
Katok, A. & Hasselblatt, B., Introduction to the Modern Theory of Dynamical Systems (Cambridge, 1995). Ch. 6-8: Lyapunov exponents, entropy, and the relation between them.
Strogatz, S. H., Nonlinear Dynamics and Chaos, 2nd ed. (CRC Press, 2015). Ch. 10: Lyapunov exponents for one-dimensional maps.
Taylor, J. R., Classical Mechanics (University Science Books, 2005). Ch. 13: Lyapunov exponents and chaos in Hamiltonian systems.
Goldstein, H., Poole, C. P. & Safko, J., Classical Mechanics, 3rd ed. (Pearson, 2002). Ch. 11: Classical chaos and Lyapunov exponents.
Furstenberg, H. & Kesten, H., "Products of random matrices," Ann. Math. Statist. 31 (1960), 457-469. The Furstenberg-Kesten theorem on growth rates of random matrix products, the foundation of the Oseledets theorem.