Jarzynski equality and Crooks fluctuation theorem
Anchor (Master): Jarzynski 1997 Phys. Rev. Lett. 78, 2690; Crooks 1998 PhD thesis (UC Berkeley) and Crooks 1999 Phys. Rev. E 60, 2721; Evans-Searles 1993 Mol. Phys. 80; Gallavotti-Cohen 1995 J. Stat. Phys. 80; Kawai-Parrondo-van den Broeck 2007 Phys. Rev. Lett. 98, 080602; Seifert 2005 Phys. Rev. Lett. 95, 040602; Liphardt 2002 Science 296, 1832; Collin 2005 Nature 437, 231; Campisi-Hänggi-Talkner 2011 Rev. Mod. Phys. 83, 771
Intuition Beginner
The second law of thermodynamics says no engine extracts more useful work from a heat bath than the free energy allows. Pull a molecule slowly and the work you spend equals the free energy change. Pull it fast and you spend extra, dissipated as heat. Or do you? A single fast pull now and then gives back more than expected. The second law is a statement about averages, and a single measurement can violate it.
Repeating the same fast pull thousands of times produces a spread of work values. Most pulls cost more than the slow limit; a rare few cost less. The Jarzynski equality is the exact recipe for combining these scattered values. Weight each measurement with a decaying exponential of the work, average those weights, and take a logarithm. The answer is the free energy difference, recovered exactly from data that never reached equilibrium.
The Crooks theorem sharpens the picture. Run the protocol forward and then in reverse, collect the two work distributions, and compare. The distributions cross at exactly the free energy value. The further a process sits from reversible, the more lopsided the crossing becomes. This unit develops both relations as the second law lifted to the scale of individual fluctuations.
Visual Beginner
A schematic shows a single RNA hairpin held between an optical trap and a fixed bead. The trap is pulled away from the bead at a chosen speed, unfolding the hairpin. A histogram panel below plots two work distributions side by side: a forward distribution (fast pulling) and a reverse distribution (fast refolding). The two bell-shaped curves overlap and cross at a single work value, marked as the equilibrium free energy . A vertical dashed line at the crossing makes the Crooks relation visible.
The picture captures the essential content: dissipated work measures how distinguishable the forward and reverse distributions are, and the crossing point is the equilibrium quantity recovered from nonequilibrium data.
Worked example Beginner
Consider an RNA hairpin driven out of equilibrium by a fast optical-trap pull. The equilibrium folding free energy is in units of . You repeat the fast pull three times and record the work values , , and (same units).
Step 1. Compute the arithmetic mean of the three work values: . This is greater than , so the second law holds on average, as it must.
Step 2. Compute the Jarzynski average. For each measurement, evaluate : , , . The total of these three numbers is approximately .
Step 3. Divide by three to get the average: . Take the negative of the natural logarithm: .
Step 4. The Jarzynski estimate of the free energy is in units of . The true value is . With only three samples the estimate lands a little low, because the rare small-work events that dominate the exponential average were undersampled. Repeat the pull a thousand times and the estimate converges to .
What this tells us: individual pulls may undershoot the equilibrium limit, the arithmetic mean always respects the second law, and the exponential average recovers the equilibrium free energy exactly once enough samples are collected.
Check your understanding Beginner
Formal definition Intermediate+
Let be a classical system with microstate in a phase space and a Hamiltonian that depends on an externally controllable parameter (trap position, field strength, volume). A protocol drives the system from to . The system is prepared in equilibrium at temperature before the protocol begins, with initial density where and . The dynamics in between may be Hamiltonian, Langevin, or any Markov process satisfying detailed balance with respect to the instantaneous equilibrium distribution.
The work performed on the system along a trajectory is the accumulated change in the Hamiltonian due to the explicit time dependence of the protocol [Jarzynski 1997]:
The heat exchanged with the bath is , and the first law along each trajectory reads .
The equilibrium free energy difference is with . The dissipated work along a trajectory is . A protocol run quasistatically () gives for every trajectory; a finite-time protocol gives on average.
The two principal objects of this unit are the Jarzynski equality [Jarzynski 1997]
where denotes the average over trajectories initiated at equilibrium at and driven by the forward protocol , and the Crooks fluctuation theorem [Crooks 1999]
where is the probability density of work in the forward process and is the density of work in the time-reversed process driving , evaluated at .
Counterexamples to common slips
- Confusing heat and work. The work is the change in due to the protocol's explicit -dependence; heat is the change due to the bath-driven motion of . The Jarzynski equality concerns only, not . Mixing the two is the most common error when first reading trajectory-level thermodynamics.
- Assuming the equality holds without equilibrium initial conditions. The system must begin each repetition in equilibrium at . Start it out of equilibrium and the Jarzynski equality fails; an additional term accounting for the relaxation of the initial state appears. The Crooks ratio also requires the reverse process to begin in equilibrium at .
- Treating as a state function. Work is a functional of the trajectory, not a function of the endpoints. Two repetitions of the same protocol produce different values; only the exponential average is fixed by . The free energy is a state function; the work is not.
- Expecting finite-sample convergence. The estimator is biased by the rare events that dominate the exponential. With finite samples the estimate systematically undershoots ; convergence is slow (the variance of the exponential weight is governed by the dissipated work itself). This is the experimental difficulty addressed by Hummer-Szabo and by the Collin-Ritort protocol.
Key theorem with proof Intermediate+
Theorem (Crooks fluctuation theorem and Jarzynski equality). Let be a system with Hamiltonian driven by a forward protocol over time , with the system initially in equilibrium at temperature . Let denote the time-reversed protocol. Assume the dynamics satisfy microscopic reversibility (detailed balance at the trajectory level). Then for every trajectory with time-reverse ,
and marginalising over all trajectories producing a given work yields
Integrating against gives
By Jensen's inequality applied to the convex function ,
which is the second law of thermodynamics for the average work performed on an isothermal system.
Proof. Decompose the trajectory probability into an initial-condition factor and a dynamical factor. For the forward process,
where is the equilibrium density at and is the conditional probability density of the trajectory given the initial point, generated by the Markov dynamics (Hamiltonian flow, or Langevin/Glauber/Metropolis dynamics satisfying detailed balance with respect to the instantaneous Boltzmann distribution). The reverse trajectory probability is
with .
Take the ratio and split it into an endpoint factor and a dynamical factor:
The endpoint factor evaluates to
using rearranged through , which gives .
The dynamical factor is governed by microscopic reversibility. For Hamiltonian dynamics this is the ratio of phase-space volume elements, which equals by Liouville's theorem. For Langevin or Metropolis dynamics satisfying detailed balance with the instantaneous equilibrium , the ratio of the forward path probability to the reverse path probability is
where is the heat exchanged with the bath along the trajectory (the energy change not due to the explicit -dependence). This is the trajectory form of detailed balance: each infinitesimal transition satisfies , and multiplying over the trajectory gives the path ratio . Substituting both factors,
using . This establishes the trajectory-level Crooks ratio [Crooks 1998 thesis].
To obtain the work-distribution form, collect all forward trajectories with work value into the set and all reverse trajectories with work into . The time-reversal map is a bijection between and , so marginalising the trajectory ratio gives
yielding the Crooks fluctuation theorem [Crooks 1999].
The Jarzynski equality follows on integrating the Crooks relation against :
The final integral equals by normalisation of , giving .
For the second law, apply Jensen's inequality to the convex function : , i.e. , and since the exponential is monotone increasing, . Equality holds if and only if is deterministic, which occurs only for a quasistatic reversible protocol.
Bridge. This builds toward the general theory of nonequilibrium work relations and appears again in 08.12.01 (the fluctuation-dissipation theorem), whose linear-response kernel governs the leading-order dissipation that the present theorem bounds exactly. The foundational reason the exponential average suppresses the rare dissipative trajectories is microscopic reversibility — this is exactly the Crooks trajectory ratio , and putting these together identifies the dissipated work with a Kullback-Leibler divergence. The bridge is that the second law is the Jensen-inequality shadow of an exact identity: the central insight is that fluctuation theorems promote the inequality to an equality at the cost of exponentiating each trajectory.
Exercises Intermediate+
Advanced results Master
Theorem (dissipated work as relative entropy; Kawai-Parrondo-van den Broeck 2007). For a system driven by a protocol with forward phase-space density and its time-reversed counterpart under the reverse protocol, the average dissipated work equals
where is the phase-space point reached by applying the momentum-reversal map to . In particular , with equality only when at every time, which is the condition for a quasistatic reversible protocol [Kawai Parrondo van den Broeck 2007].
The result refines Exercise 5: the work-distribution KL divergence is the data-processing projection of the underlying phase-space relative entropy. Dissipation measures how distinguishable the actual forward evolution is from its time reverse. The bridge to information theory is immediate — a protocol that dissipates does work that is, in bits, distinguishable from its time reverse.
Theorem (stochastic entropy production and Seifert's integral fluctuation theorem; Seifert 2005). For a Markov process with trajectory and instantaneous phase-space density , the total entropy produced along the trajectory is . It satisfies the integral fluctuation theorem
from which and follow by Jensen and the tail bound [Seifert 2005].
Seifert's theorem extends the framework to systems that begin out of equilibrium, where there is no equilibrium free energy to reference. The total entropy production is the log ratio of forward to reverse trajectory probabilities; the Jarzynski equality and the Crooks theorem are the specialisation to the case where the initial and final distributions are equilibrium Boltzmann distributions.
Theorem (transient and steady-state fluctuation theorems; Evans-Searles 1993, Gallavotti-Cohen 1995). Let denote the time-averaged entropy-production rate over a window for an anoergodic system driven by a thermostatted nonequilibrium protocol. The Evans-Searles transient fluctuation theorem gives
for every . For chaotic dynamical systems satisfying the chaotic hypothesis, the Gallavotti-Cohen fluctuation theorem states that the large-deviation rate function for the entropy-production rate satisfies the symmetry [Evans Searles 1993; Gallavotti Cohen 1995].
These theorems precede Jarzynski and Crooks historically and situate them within a broader programme: the second law is one member of a family of exact fluctuation symmetries. The Gallavotti-Cohen symmetry is a statement about the large-deviation rate function (cf. 08.12.02 on Cramér-Sanov theory); the Crooks ratio is its sharp, finite-time form specialised to the work observable.
Theorem (thermodynamic length and minimum dissipation; Salamon-Nulton 1984, Sivak-Crooks 2012-2016). Let be a path in the manifold of equilibrium states parametrised by the control parameter . Equip this manifold with the Fisher-information metric . The thermodynamic length of a protocol over time is
For a protocol with fixed endpoints and total time , the excess dissipation satisfies the lower bound
where is the thermodynamic length of the geodesic connecting the endpoints. The bound is saturated by protocols that traverse the equilibrium manifold at constant thermodynamic speed [Sivak Crooks 2016].
The Fisher metric converts the space of equilibrium states into a Riemannian manifold, and dissipation into a geometric cost. This is the bridge between fluctuation theorems and optimal-control theory: the protocols that minimise dissipation are the geodesics of this manifold, and finite-time thermodynamics becomes a problem in Riemannian geometry.
Theorem (quantum fluctuation theorems; Kurchan 2000, Tasaki 2000). For a quantum system prepared in the Gibbs state , driven by a unitary protocol , the work performed in a single realisation is defined by projective energy measurements at the start and end: where () is the outcome of measuring (). The two-point measurement fluctuation theorem reads
recovering the Jarzynski equality in the quantum regime. Coherences generated between the two measurements do not contribute to the work average in the two-point scheme [Tasaki 2000; Campisi Hänggi Talkner 2011].
The quantum case is subtle: work is not an observable but a property of a pair of measurements. Alternative schemes (full-counting statistics, Bayesian) handle coherence differently; the quantum-classical correspondence is recovered in the limit of commuting Hamiltonians.
Theorem (information-theoretic second law and Maxwell's demon; Sagawa-Ueda 2010). For a protocol with feedback based on a measurement outcome carrying mutual information with the system microstate, the work extractable is bounded by
Acquired information lowers the free-energy bound by per nat; measurement and erasure costs (Landauer's principle) restore the unconditional second law when the demon's memory is reset [Sagawa Ueda 2010].
This theorem closes the loop opened by Maxwell's demon in 1867: information is thermodynamically fungible with work, and the fluctuation-theorem framework quantifies the exchange rate. Single-molecule implementations (Toyabe et al. 2010) verified the bound directly.
Synthesis. The foundational reason the second law survives at the fluctuation scale is microscopic reversibility: the trajectory ratio forces the forward and reverse work distributions to cross at , and this is exactly the Crooks theorem. The central insight is that dissipated work measures how distinguishable the two distributions are — putting these together identifies with , a non-negative quantity that vanishes only for a quasistatic protocol. This builds toward the geometric theory of thermodynamic length, where the Fisher-information metric on the manifold of equilibrium states fixes the minimum dissipation, and appears again in the linear-response regime of 08.12.01 whose kernel governs the leading-order dissipation that the present theorem bounds exactly. The bridge is that every nonequilibrium work relation — Jarzynski, Crooks, Evans-Searles, Gallavotti-Cohen, Seifert, Hatano-Sasa — is a facet of the same trajectory-level detailed balance; the pattern generalises to quantum two-point fluctuation theorems (Tasaki, Kurchan) and to feedback-driven demons (Sagawa-Ueda), where acquired information enters the bound as a negative entropy term.
Full proof set Master
Proposition (Kullback-Leibler identity for dissipated work). Under the Crooks fluctuation theorem, .
Proof. By definition , whenever the integral exists. The Crooks theorem gives for every in the support. Substituting,
using . Non-negativity of relative entropy yields the second law . Equality holds iff almost everywhere, which under Crooks forces on the support, i.e. almost surely, the quasistatic limit.
Proposition (Jarzynski equality via Hamiltonian ergodicity). For an isolated Hamiltonian system initially in equilibrium at and driven by , the Jarzynski equality holds, with the average taken over the equilibrium initial distribution.
Proof. Work equals the change in the Hamiltonian: , since an isolated Hamiltonian system exchanges no heat (). The map generated by Hamilton's equations preserves phase-space volume (Liouville's theorem), so the distribution of is the push-forward of the equilibrium distribution under the Hamiltonian flow. Therefore
Using , the integrand becomes . By Liouville's theorem the change of variables has unit Jacobian, so
The same form holds for systems coupled to a heat bath via a thermostatted or Langevin dynamics that preserves the equilibrium distribution in the adiabatic limit, with an additional Jacobian factor that cancels by microscopic reversibility.
Proposition (thermodynamic-length lower bound on dissipation). For a slow protocol with total time connecting to in the manifold of equilibrium states equipped with the Fisher metric , the excess dissipation satisfies .
Proof sketch. In the slow-protocol regime the system remains near equilibrium, with . Linear response (cf. 08.12.01) gives , and the dissipated power is plus corrections of order (the symmetric Onsager matrix equals the Fisher metric up to a bath factor, by the fluctuation-dissipation relation of 08.12.01). Integrating over gives . By the Cauchy-Schwarz inequality applied with the metric ,
and multiplying by gives the bound up to the bath prefactor; rescaling conventions for yields . Equality is approached by geodesic protocols traversed at constant thermodynamic speed.
Connections Master
Equilibrium fluctuations of thermodynamic quantities
08.12.02. The present unit is the nonequilibrium companion to the equilibrium Gaussian fluctuation theory of the sibling; the equilibrium variances of08.12.02set the Fisher metric that governs the minimum dissipation derived here, and the Einstein formula of the sibling is the static shadow of the trajectory-level Crooks ratio.Fluctuation-dissipation theorem (Landau-Callen-Welton)
08.12.01. Linear response near equilibrium is the leading-order limit of the present theorem: the FDT kernel fixes the dissipated work to first order in the protocol speed, while the Jarzynski equality and Crooks theorem give the exact, all-orders relation. The Fisher metric of thermodynamic length equals the zero-frequency limit of the FDT response function.Free energy
08.01.04. The Helmholtz free-energy difference between equilibrium states is the equilibrium quantity recovered exactly by nonequilibrium work averages; every protocol, however irreversible, encodes in its work distribution through the Jarzynski equality.Partition function
08.01.01. The ratio that defines the free-energy difference in08.01.01is the endpoint factor that enters the trajectory-level Crooks ratio; the partition function is the bridge between the equilibrium thermodynamics of the endpoints and the nonequilibrium work done in between.Boltzmann distribution
08.01.03. The equilibrium initial density of08.01.03is the boundary condition required by both the Jarzynski equality and the Crooks theorem; drop it (start out of equilibrium) and the theorems acquire the Seifert entropy-production correction.
Historical & philosophical context Master
The trajectory from Loschmidt's 1876 Umkehreinwand (reversibility objection) against Boltzmann's -theorem to the modern fluctuation relations took just over a century. Loschmidt observed that Newton's equations are time-reversal symmetric, so any trajectory that decreases the Boltzmann entropy has a time-reversed partner that increases it; Boltzmann's response was probabilistic — the increasing-entropy trajectories overwhelm the decreasing ones statistically. Quantifying that statistical imbalance precisely waited for the work of Denis Evans, Edith Searles, and Giovanni Gallavotti in the 1990s. Evans and Searles established the transient fluctuation theorem in 1993-1994 [Evans Searles 1993]; Gallavotti and Cohen, building on the chaotic hypothesis, proved the steady-state fluctuation theorem for the entropy-production rate function in 1995 [Gallavotti Cohen 1995].
Christopher Jarzynski's 1997 paper Nonequilibrium equality for free energy differences (Phys. Rev. Lett. 78, 2690) [Jarzynski 1997] condensed the programme into a single exact identity. By exponentiating the work performed on a system driven out of equilibrium and averaging over repetitions begun in equilibrium, one recovers the equilibrium free-energy difference exactly: . The equality holds for arbitrary protocol speed and arbitrary distance from equilibrium; the second law drops out as the Jensen-inequality shadow. Gavin Crooks, in his 1998 Berkeley PhD thesis and the 1999 paper Entropy production fluctuation theorem and the nonequilibrium work relation (Phys. Rev. E 60, 2721) [Crooks 1999], supplied the deeper trajectory-level statement: the forward and reverse work distributions satisfy , and the Jarzynski equality is the integral of this ratio. The Crooks theorem makes the role of microscopic reversibility explicit, tracing the second law to a ratio of trajectory probabilities.
Experimental verification came from single-molecule biophysics. Jan Liphardt, Carlos Bustamante and collaborators pulled individual RNA hairpins with optical tweezers and verified the Jarzynski equality on single molecules (Science 296, 1832, 2002) [Liphardt 2002], reconstructing the equilibrium folding free energy from irreversible pulls. Felix Ritort, Bustamante, and collaborators then verified the Crooks fluctuation theorem directly in 2005 (Nature 437, 231) [Collin 2005], showing that the forward and reverse work distributions cross at exactly the equilibrium . Udo Seifert's 2005 stochastic-entropy-production formulation [Seifert 2005] extended the framework to arbitrarily driven systems without an equilibrium reference, and the Sagawa-Ueda information-theoretic second law of 2010 [Sagawa Ueda 2010] closed the loop with Maxwell's demon by pricing information in units of . The Kawai-Parrondo-van den Broeck 2007 identification of dissipated work with Kullback-Leibler divergence [Kawai Parrondo van den Broeck 2007] gave the information-theoretic reframing its sharpest form.
Bibliography Master
@article{Jarzynski1997,
author = {Jarzynski, C.},
title = {Nonequilibrium equality for free energy differences},
journal = {Physical Review Letters},
volume = {78},
number = {14},
year = {1997},
pages = {2690--2693}
}
@article{Crooks1999,
author = {Crooks, Gavin E.},
title = {Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences},
journal = {Physical Review E},
volume = {60},
number = {3},
year = {1999},
pages = {2721--2726}
}
@phdthesis{Crooks1998,
author = {Crooks, Gavin E.},
title = {Nonequilibrium Measurements of Free Energy Differences for Microscopically Reversible {M}arkovian Systems},
school = {University of California, Berkeley},
year = {1998}
}
@article{EvansSearles1994,
author = {Evans, Denis J. and Searles, Debra J.},
title = {Equilibrium microstates which generate second law violating steady states},
journal = {Physical Review E},
volume = {50},
number = {2},
year = {1994},
pages = {1645--1648}
}
@article{GallavottiCohen1995,
author = {Gallavotti, Giovanni and Cohen, E. G. D.},
title = {Dynamical ensembles in nonequilibrium statistical mechanics},
journal = {Physical Review Letters},
volume = {74},
number = {15},
year = {1995},
pages = {2694--2697}
}
@article{KawaiParrondoBroeck2007,
author = {Kawai, Ryoichi and Parrondo, Juan M. R. and van den Broeck, Christian},
title = {Dissipation: The phase-space perspective},
journal = {Physical Review Letters},
volume = {98},
number = {8},
year = {2007},
pages = {080602}
}
@article{Seifert2005,
author = {Seifert, Udo},
title = {Entropy production along a stochastic trajectory and an integral fluctuation theorem},
journal = {Physical Review Letters},
volume = {95},
number = {4},
year = {2005},
pages = {040602}
}
@article{Liphardt2002,
author = {Liphardt, Jan and Dumont, Sophie and Smith, Steven B. and Tinoco, Ignacio and Bustamante, Carlos},
title = {Equilibrium information from nonequilibrium measurements in experimental realizations of the {J}arzynski equality},
journal = {Science},
volume = {296},
number = {5574},
year = {2002},
pages = {1832--1835}
}
@article{Collin2005,
author = {Collin, Damond and Ritort, Felix and Jarzynski, Christopher and Smith, Steven B. and Tinoco, Ignacio and Bustamante, Carlos},
title = {Verification of the {C}rooks fluctuation theorem and recovery of {RNA} folding free energies},
journal = {Nature},
volume = {437},
number = {7056},
year = {2005},
pages = {231--234}
}
@article{HummerSzabo2001,
author = {Hummer, Gerhard and Szabo, Attila},
title = {Free energy reconstruction from nonequilibrium single-molecule pulling experiments},
journal = {Proceedings of the National Academy of Sciences USA},
volume = {98},
number = {7},
year = {2001},
pages = {3658--3661}
}
@article{Tasaki2000,
author = {Tasaki, Hal},
title = {Jarzynski relations for quantum systems and their applications to thermodynamics of quantum states},
journal = {arXiv:cond-mat/0009244},
year = {2000}
}
@article{Kurchan2000,
author = {Kurchan, Jorge},
title = {Quantum detailed balance conditions},
journal = {Physical Review E},
volume = {61},
number = {5},
year = {2000},
pages = {5533--5539}
}
@article{CampisiHanggiTalkner2011,
author = {Campisi, Michele and H{\"a}nggi, Peter and Talkner, Peter},
title = {Colloquium: Quantum fluctuation relations: Foundations and applications},
journal = {Reviews of Modern Physics},
volume = {83},
number = {3},
year = {2011},
pages = {771--791}
}
@article{SagawaUeda2010,
author = {Sagawa, Takahiro and Ueda, Masahito},
title = {Minimal energy cost for thermodynamic information processing: Measurement and memory erasure},
journal = {Physical Review Letters},
volume = {104},
number = {9},
year = {2010},
pages = {090602}
}
@article{SivakCrooks2012,
author = {Sivak, David A. and Crooks, Gavin E.},
title = {Thermodynamic metrics and optimal paths},
journal = {Physical Review Letters},
volume = {108},
number = {19},
year = {2012},
pages = {190602}
}
@book{Sekimoto2010,
author = {Sekimoto, Ken},
title = {Stochastic Energetics},
publisher = {Springer},
series = {Lecture Notes in Physics},
volume = {799},
year = {2010}
}