11.03.01 · stat-mech-physics / ensembles

Microcanonical ensemble

draft3 tiersLean: nonepending prereqs

Anchor (Master): Landau & Lifshitz, *Statistical Physics*, Part 1, §1–4; Huang, *Statistical Mechanics*, 2e, Ch. 6

Intuition [Beginner]

An isolated system has fixed energy , particle number , and volume . Different arrangements of all particle positions and momenta — different microstates — are consistent with these constraints. The microcanonical ensemble postulates that every accessible microstate is equally likely.

The number of accessible microstates is . Boltzmann's entropy is

This is entropy at its root — not "disorder" but a count of possibilities. A system with has . A system with has enormous entropy. More microstates means higher entropy, and high- macrostates dominate: that is why entropy increases.

Visual [Beginner]

Consider two coins. Each can be heads (H) or tails (T). There are four microstates:

Microstate Coin 1 Coin 2
1 H H
2 H T
3 T H
4 T T

The macrostate "both same" (HH or TT) has . The macrostate "one heads, one tails" (HT or TH) also has . With two coins every macrostate is equally likely.

Now scale to coins. The macrostate "all heads" has . The macrostate "half heads" has , which is astronomically larger. For particles the "roughly half heads" macrostate overwhelms everything else — its is so large that any other macrostate is never observed.

Histogram of Omega vs number of heads for N coins. The distribution is sharply peaked around N/2, illustrating that the dominant macrostate has overwhelmingly many microstates. The width grows as sqrt(N) while the peak grows exponentially, so the relative width vanishes as N goes to infinity.

Worked example [Beginner]

A room of students, each holding either a red or blue card. Count the microstates for each macrostate.

Macrostate: 4 red. Only one arrangement: RRRR. So and .

Macrostate: 3 red, 1 blue. The blue card can be with student 1, 2, 3, or 4. So and .

Macrostate: 2 red, 2 blue. Choose any 2 of 4 students for blue: and .

The 2-red-2-blue macrostate is the most likely — it has the most microstates and the highest entropy. Scale to particles and this bias becomes absolute.

Check your understanding [Beginner]

Formal definition [Intermediate+]

The microcanonical ensemble describes an isolated system with fixed total energy , fixed particle number , and fixed volume . The fundamental postulate of statistical mechanics (the equal a priori probability hypothesis) states: every microstate compatible with these constraints is equally probable.

For a classical system of particles in three dimensions, each microstate is a point in the -dimensional phase space . The accessible region is the energy shell

where is the Hamiltonian 09.04.02 pending. The phase-space average of any observable is

where is the surface element on and is the gradient in the -dimensional phase space. The normalisation factor is the density of states:

An equivalent (and for many calculations more convenient) definition uses the phase-space volume enclosed by the energy surface:

The density of states is then .

Boltzmann entropy. The entropy of the microcanonical ensemble is

The logarithm makes entropy extensive (additive for independent subsystems) while is multiplicative: if system has microstates and independent system has , the combined system has and .

Temperature. The thermodynamic temperature is defined by

Pressure.

Chemical potential.

These three relations are the bridge from the microcanonical ensemble to thermodynamics. Given , all thermodynamic quantities follow by differentiation.

The ideal gas. For non-interacting particles of mass in volume , the phase-space volume enclosed by energy is

where is a constant with dimensions of action (setting the phase-space measure; its physical value is Planck's constant) and corrects for indistinguishable particles (Gibbs' correction). Differentiating:

The entropy is

where "const" absorbs all the - and -dependent terms that do not vary with or .

Equipartition theorem (microcanonical derivation). Consider the average of in the microcanonical ensemble. By the spherical symmetry of the momentum integral in , each of the quadratic momentum degrees of freedom contributes equally to the total kinetic energy. Since the total kinetic energy equals (to leading order in ), each degree of freedom carries average energy . Setting from gives the equipartition result: each quadratic degree of freedom has average energy .

The virial theorem. For a system with Hamiltonian , the virial theorem states

where is the force on particle . The proof follows from integrating over the energy shell and applying integration by parts — the boundary term vanishes because is computed on a closed surface. For power-law potentials , the virial theorem gives .

Counterexamples to common slips

  • is not dimensionless. The density of states has dimensions of (energy) (phase-space volume). The entropy requires to be dimensionless, achieved by the factor in the denominator — sets the phase-space unit. Different choices of shift by an additive constant; in the thermodynamic limit () this constant is negligible compared to the terms. The physical value Js (Planck's constant) makes match the experimentally measured Third-Law entropy.

  • The energy shell is not a volume. The density of states is a surface integral on , not a volume integral. The equivalent formulation uses the enclosed volume but the derivative converts it to a surface quantity. Confusing the two leads to wrong powers of .

  • The equal-probability postulate is not derived. It is an axiom of statistical mechanics, justified by the ergodic hypothesis (Master tier) but not provable from mechanics alone. Systems with exactly solvable dynamics (e.g., integrable systems) may violate it.

  • is not the same as the thermodynamic entropy of Clausius. They agree in the thermodynamic limit, but for small systems the Boltzmann entropy can behave differently (e.g., it may be non-concave).

Key theorem with proof [Intermediate+]

Theorem (Ideal gas equation of state from the microcanonical ensemble). For a monatomic ideal gas of particles of mass in volume , the microcanonical entropy

implies the equation of state and the energy relation .

Proof. Start from the density of states derived above:

The entropy is

For large, , so to leading order in :

Temperature. Differentiate with respect to at fixed :

giving

Pressure. Differentiate with respect to at fixed :

giving

Equations () and () are the ideal gas law and the equipartition-based energy formula, derived entirely from counting microstates. No equations of motion were solved; no molecular trajectories were computed. The thermodynamic behaviour of the ideal gas is a consequence of how many microstates exist at each energy and volume. ∎

Corollary (Sackur-Tetrode equation). Evaluating the constant terms in the entropy gives the Sackur-Tetrode formula for the entropy of a monatomic ideal gas:

This is the exact (leading-order-in-) entropy of a classical ideal gas. The term combines the Stirling approximation for and the volume of a -dimensional sphere. The Sackur-Tetrode entropy is extensive (depends on and ), confirming that the Gibbs correction is necessary for consistency with thermodynamics.

Worked example: two-level system

A system of non-interacting particles, each of which can be in a ground state (energy 0) or an excited state (energy ). If particles are excited, the total energy is . The number of microstates is

The entropy is . Using Stirling's approximation for large :

The temperature follows from :

Solving for the excitation fraction:

At low temperature (), nearly all particles are in the ground state (). At high temperature (), both levels are equally populated (). The negative-temperature regime (more particles excited than not) corresponds to , which is hotter than any positive temperature — it occurs in laser gain media and nuclear-spin systems.

Exercises [Intermediate+]

Ergodic hypothesis and its limitations [Master]

The microcanonical ensemble rests on the equal a priori probability postulate: every microstate on the energy surface is equally likely. The standard justification is the ergodic hypothesis: a trajectory in phase space visits every point on the energy surface, so time averages equal ensemble averages.

Definition. A Hamiltonian system on the energy surface is ergodic if the Hamiltonian flow is metrically transitive on : every invariant subset of has either zero or full Liouville measure.

Birkhoff's ergodic theorem (1931). Let be a measure-preserving dynamical system where is the Liouville measure on . For any observable , the time average

exists for almost every . If the system is ergodic, then for almost every — the time average equals the microcanonical ensemble average, independent of the initial condition.

The ergodic theorem does not prove that physical systems are ergodic. It says: if the system is ergodic, then time averages equal ensemble averages. Proving ergodicity for a specific system is extraordinarily difficult. The first rigorous example was Sinai's proof (1963) that the hard-sphere gas is ergodic. For realistic potentials, ergodicity is generally assumed rather than proved.

Limitations.

  1. Integrable systems are not ergodic. A system with independent conserved quantities in involution on a -dimensional phase space is confined to an -dimensional torus, not the full -dimensional energy surface. The harmonic oscillator, the Kepler problem, and the Toda lattice are integrable and hence non-ergodic.

  2. KAM systems are "mostly" non-ergodic. The Kolmogorov-Arnold-Moser theorem 05.09.01 guarantees that sufficiently irrational invariant tori persist under small perturbations. The phase space of a near-integrable system contains both regular (torus-confined) and chaotic regions, so the system is not ergodic on the full energy surface.

  3. The time scale matters. Even if a system is ergodic, the time to explore the energy surface may exceed the age of the universe. Observables on laboratory timescales need not agree with ensemble averages.

  4. Quantum mechanics changes the question. The energy surface is replaced by a finite-dimensional subspace of Hilbert space, and the quantum ergodic hypothesis (quantum chaos, random-matrix theory) takes a different form 12.07.01 pending.

The thermodynamic limit and equivalence of ensembles [Master]

The microcanonical ensemble is the most fundamental of the three standard ensembles (microcanonical, canonical, grand canonical), but it is also the most technically difficult to work with. The canonical and grand canonical ensembles are far more convenient for calculations. Their physical equivalence rests on the thermodynamic limit.

Definition. The thermodynamic limit is the limit , , fixed (and, for the microcanonical ensemble, fixed).

Equivalence of ensembles. In the thermodynamic limit, the microcanonical, canonical, and grand canonical ensembles give identical results for all thermodynamic quantities. The relative fluctuations of energy in the canonical ensemble scale as , and the relative fluctuations of particle number in the grand canonical ensemble scale as . These fluctuations vanish as , and the three ensembles become indistinguishable.

The equivalence breaks down for:

  • Small systems (proteins, nanoclusters): fluctuations are large and ensemble choice matters.
  • Systems with long-range interactions (gravitational systems, plasma): the thermodynamic limit is non-extensive and ensemble inequivalence can occur.
  • First-order phase transitions in the microcanonical ensemble: the microcanonical entropy can be non-concave, leading to negative specific heat, which is impossible in the canonical ensemble. The ensembles disagree in the transition region.

The surface-volume problem and coarse-grained entropy [Master]

The density of states is defined as an integral on the energy surface . A common alternative is to define

the number of states in a thin shell of width . The two definitions agree when is small but large enough to contain many microstates — a physically necessary coarse-graining. The entropy is independent of the choice of to leading order in , because the volume of the shell is dominated by the outer surface.

For continuous classical systems the density of states must be coarse-grained: without a phase-space unit , has dimensions and is undefined. The Planck constant provides the natural unit. The resulting entropy is the coarse-grained Boltzmann entropy, and its independence from the coarse-graining scale (in the thermodynamic limit) is a consistency check.

An alternative definition, the Gibbs entropy (also called the volume entropy),

uses the enclosed volume rather than the surface density. For the ideal gas, , which differs from the Boltzmann entropy by . The difference vanishes in the thermodynamic limit relative to the leading terms, but for small systems it is measurable. The Gibbs entropy is always concave (non-decreasing ), while the Boltzmann surface entropy need not be. The correct choice remains debated in the foundations literature.

Jaynes' maximum-entropy principle [Master]

Jaynes (1957) recast statistical mechanics as an inference problem. Given partial knowledge of a system (fixed , , ), assign probabilities to microstates so as to be maximally non-committal about missing information. The unique solution is the distribution maximising subject to the constraints.

For the microcanonical ensemble the constraint is: unless microstate has energy . Maximising the Shannon entropy under this constraint gives for all accessible microstates — the equal-probability postulate is derived rather than assumed.

Jaynes' framework extends immediately to the canonical ensemble (constraint: fixed mean energy ) and the grand canonical ensemble (constraints: fixed mean and ). The Lagrange multipliers enforcing the constraints are and . This information-theoretic approach bypasses the ergodic hypothesis entirely: statistical mechanics is not about dynamics but about inference under incomplete information. The debate between the dynamical (ergodic) and information-theoretic (Jaynesian) foundations of statistical mechanics remains open.

Lean formalization [Intermediate+]

Mathlib has measure theory (MeasureTheory.Integral.Bochner, MeasureTheory.Measure.Lebesgue) and integration on manifolds. It does not formalise:

  • The density of states as a surface integral on an energy shell.
  • Boltzmann entropy as a physical concept.
  • The microcanonical ensemble average .
  • The thermodynamic limit () and equivalence of ensembles.
  • Birkhoff's ergodic theorem in the specific form used in physics.

The formalisation pathway would start from the Liouville measure on (built on existing Mathlib cotangent-bundle machinery) and proceed to the surface integral on via the coarea formula. lean_status: none reflects this gap.

Connections [Master]

  • Hamilton's equations 09.04.02 pending define the phase-space flow whose energy surface is the arena for the microcanonical ensemble. Liouville's theorem (phase-space volume conservation) is what makes the Liouville measure on the natural one.

  • Maxwell-Boltzmann distribution 11.02.01 pending is recovered from the microcanonical ensemble by integrating out all but one particle's degrees of freedom — the marginal distribution of a single particle's momentum in the microcanonical ensemble is Maxwell-Boltzmann.

  • First and second laws 11.01.01 pending acquire microscopic foundations: the first law is energy conservation under ; the second law is the statement that macroscopic evolution proceeds toward higher- macrostates.

  • Canonical ensemble 11.04.01 pending is derived from the microcanonical ensemble by coupling the system to a large heat bath and tracing out the bath's degrees of freedom. The partition function replaces as the central object.

  • Ising model (math side) 08.06.01 counts microstates of a discrete spin system; the microcanonical density of states for the Ising model is a combinatorial object studied in the math-side treatment.

  • KAM theorem 05.09.01 limits the validity of the ergodic hypothesis: near-integrable systems retain KAM tori that prevent exploration of the full energy surface.

  • Quantum chaos 12.07.01 pending replaces the classical ergodic hypothesis with the quantum eigenstate thermalisation hypothesis (ETH), which asserts that individual energy eigenfunctions reproduce microcanonical expectations.

Historical & philosophical context [Master]

Boltzmann introduced the formula (using for Wahrscheinlichkeit, probability) in 1877, extending his earlier work on the kinetic theory of gases (1868, 1872). The 1877 paper, "Über die Beziehung zwischen dem zweiten Hauptsatze der mechanischen Wärmetheorie und der Wahrscheinlichkeitsrechnung", established that the second law of thermodynamics is a statistical statement: entropy increases not by mechanical necessity but because high-entropy macrostates overwhelm low-entropy ones in number.

Gibbs, in Elementary Principles in Statistical Mechanics (1902), systematised the ensemble approach — the microcanonical, canonical, and grand canonical ensembles — and introduced the phase-space density formalism. Gibbs' "microcanonical" (his term) ensemble was the foundation on which the others were built. The Gibbs paradox (the non-extensivity of entropy for mixing identical gases) was resolved by the correction, which Gibbs introduced ad hoc and which receives its natural justification from quantum indistinguishability.

Ehrenfest and Ehrenfest's 1911 review article, "Begriffliche Grundlagen der statistischen Auffassung in der Mechanik", subjected the ergodic hypothesis to its first rigorous critique, distinguishing the original ergodic hypothesis (the trajectory passes through every point of , which is impossible for a flow on a continuous space) from the quasi-ergodic hypothesis (the trajectory is dense in ). Birkhoff's 1931 ergodic theorem provided the precise mathematical framework; the Ehrenfests' critique made clear that the ergodic hypothesis is a strong assumption, not a theorem.

Sinai proved ergodicity of the hard-sphere gas in 1963 (published 1970), the first physically relevant ergodicity result. The quantum counterpart — the eigenstate thermalisation hypothesis — was proposed by Deutsch (1991) and Srednicki (1994) and remains an active research frontier.

Jaynes' 1957 papers, "Information theory and statistical mechanics" (Phys. Rev. 106, 620 and 108, 171), recast the entire foundation in information-theoretic terms. The Jaynesian programme has been influential but controversial: critics argue it conflates epistemic uncertainty with physical randomness, while proponents argue it provides the cleanest derivation of the ensembles.

Bibliography [Master]

Primary literature (cite when used; not all currently in reference/):

  • Boltzmann, L., "Über die Beziehung zwischen dem zweiten Hauptsatze der mechanischen Wärmetheorie und der Wahrscheinlichkeitsrechnung", Wiener Berichte 76 (1877), 373–435.
  • Gibbs, J. W., Elementary Principles in Statistical Mechanics (Charles Scribner's Sons, 1902).
  • Ehrenfest, P. & Ehrenfest, T., "Begriffliche Grundlagen der statistischen Auffassung in der Mechanik", Encyklopädie der mathematischen Wissenschaften IV 2 II (1911).
  • Birkhoff, G. D., "Proof of the ergodic theorem", Proc. Natl. Acad. Sci. USA 17 (1931), 656–660.
  • Sinai, Ya. G., "On the foundation of the ergodic hypothesis for a dynamical system of statistical mechanics", Dokl. Akad. Nauk SSSR 153 (1963) [Sov. Math. Dokl. 4 (1963), 1818–1822].
  • Jaynes, E. T., "Information theory and statistical mechanics", Phys. Rev. 106 (1957), 620–630; 108 (1957), 171–190.
  • Schroeder, D. V., An Introduction to Thermal Physics (Addison-Wesley, 2000).
  • Reichl, L. E., A Modern Course in Statistical Physics, 2nd ed. (Wiley, 1997).
  • Landau, L. D. & Lifshitz, E. M., Statistical Physics, Part 1, 3rd ed. (Course of Theoretical Physics Vol. 5, Pergamon, 1980).
  • Huang, K., Statistical Mechanics, 2nd ed. (Wiley, 1987).
  • Susskind, L. & Hrabovsky, G., The Theoretical Minimum: Statistical Mechanics (Basic Books, 2013).
  • Tong, D., Statistical Physics (DAMTP Cambridge lecture notes, §3 "Statistical ensembles").

Wave 2 physics unit, produced 2026-05-18 per PHYSICS_PLAN §5. Status: draft pending Tyler's review and the §11 Next-Actions retro.