11.06.05 · stat-mech-physics / phase-transitions

Scaling Hypothesis: Widom Scaling, Kadanoff Block Spins, and Data Collapse

shipped3 tiersLean: none

Anchor (Master): Kardar, Statistical Physics of Fields (2007), Ch. 4–5; Goldenfeld, Lectures on Phase Transitions and the Renormalization Group (1992), Ch. 6–7

Intuition Beginner

Near a critical point, something remarkable happens: the behaviour of a system depends on only one thing — how far you are from the critical temperature . Everything — magnetisation, heat capacity, susceptibility, correlation length — follows power laws in . And these power laws are not independent. If you measure one critical exponent, you can predict the others.

This is the scaling hypothesis, and it is one of the most powerful ideas in statistical physics. It says that near , there is only one relevant length scale in the problem: the correlation length , the typical distance over which fluctuations are correlated. Every other length in the system — the lattice spacing, the system size — is irrelevant as long as is much larger than both. All thermodynamic quantities are governed by , and since diverges as a power of , every observable inherits a power law with an exponent tied to the divergence of .

The consequence is dramatic. Instead of six independent critical exponents (, , , , , ), only two are independent. The remaining four are determined by scaling relations — algebraic identities among the exponents. For example:

If you measure and for the 3D Ising model (as numerical simulations do), the scaling relations predict and . Both match the numerical results.

The scaling hypothesis makes a prediction that can be tested directly in experiment: data collapse. If you measure the magnetisation of a ferromagnet as a function of external field at several temperatures near , the raw curves look different at each temperature. But if you rescale the axes — plot against , where is the reduced temperature — all the curves collapse onto a single universal function. This collapse is strong evidence that scaling is correct.

The physical picture behind scaling was developed by Kadanoff in 1966. Imagine a lattice of spins near . Because the correlation length is very large, spins in a block of size (much smaller than ) are strongly correlated — they behave almost as a single unit. So you can replace each block of spins by a single "block spin." The new lattice has spacing times larger, but the same physics — provided you also rescale the temperature and the magnetic field. This block-spin construction is the intuitive foundation for the scaling hypothesis and, eventually, for the renormalization group.

Visual Beginner

The scaling hypothesis predicts that thermodynamic data measured at different temperatures near should collapse onto a single curve when plotted in rescaled variables.

Consider the magnetic equation of state near . Raw data at temperatures (all close to ) give three distinct curves of vs . After rescaling: vs , the three curves collapse onto one master curve .

Worked example Beginner

The critical exponents for the 3D Ising model are (numerical estimates): , .

Scaling relation check — Widom: predicts .

Scaling relation check — Rushbrooke: predicts .

The numerically measured values are and . The agreement is excellent — the scaling relations are satisfied to the precision of the numerical data.

Check your understanding Beginner

Formal definition Intermediate+

The Widom scaling ansatz

The scaling hypothesis, introduced by Widom (1965), asserts that the singular part of the free energy near a critical point is a generalised homogeneous function of the reduced temperature and the ordering field . That is, there exist exponents and such that:

for any rescaling factor , where is the spatial dimension and is the singular part of the free energy density. This is the Widom scaling ansatz.

The physical content is that the free energy has no scale of its own near — it inherits its scale entirely from the correlation length , and rescaling lengths by a factor rescales and by the appropriate powers.

Choosing (so that ) gives:

where is the gap exponent and is the scaling function for and respectively. The identification follows from the definition of the specific-heat exponent.

Scaling relations from the free energy

Differentiating gives the critical exponents:

Order parameter (, ): , so:

Susceptibility (): , so:

Critical isotherm (): choose in the scaling ansatz: , so , giving:

Specific heat (): , giving:

From these four expressions in terms of two unknowns (, , and ), two independent relations among the exponents follow immediately:

These were originally derived as inequalities (Rushbrooke 1963, Griffiths 1965) from thermodynamic stability. The scaling hypothesis promotes them to equalities.

The Kadanoff block-spin construction

Kadanoff (1966) provided a physical picture for scaling. Consider a -dimensional lattice with lattice spacing , near a critical point where . Define block spins by grouping the spins in a block of linear size ( original spins per block) and assigning each block a single effective spin (by majority rule or some other coarse-graining rule).

The rescaled lattice has spacing . The claim is that the Hamiltonian of the block spins has the same form as the original Hamiltonian, but with rescaled couplings:

where and are the relevant eigenvalues of the rescaling transformation. The word "relevant" means that these couplings grow under rescaling — if you start at and rescale, moves away from zero. (Couplings that shrink are called irrelevant; they do not affect critical behaviour.)

The correlation length transforms as , because lengths are measured in units of the lattice spacing, which has increased by . Since and :

Dividing both sides by gives , so:

This is the correlation-length scaling relation. It connects the thermal eigenvalue to the correlation-length exponent .

Data collapse as experimental test

The Widom scaling ansatz for the equation of state reads:

where applies for and for . Equivalently:

If you plot against for data taken at several temperatures near , all points should lie on a single curve . This is data collapse, and it is the most direct experimental test of the scaling hypothesis.

The quality of the collapse depends on: (1) being close enough to that corrections to scaling (higher-order terms) are negligible; (2) knowing the exponents and accurately; (3) having data that span a wide enough range of to reveal the shape of . The method was used extensively in the 1960s and 1970s to determine critical exponents for fluids, magnets, and binary mixtures.

Summary of scaling relations

The six standard critical exponents are related by four scaling relations. All follow from the Widom ansatz with two independent exponents:

Relation Formula Type
Rushbrooke Thermodynamic
Widom Thermodynamic
Fisher Correlation
Josephson (hyperscaling) Dimension-dependent

The first two are "thermodynamic" — they involve only exponents that can be measured from bulk thermodynamic data (, , , critical isotherm). The third involves the correlation-function exponent . The fourth involves the spatial dimension and is called hyperscaling because it depends on the dimensionality of space.

Rushbrooke and Griffiths inequalities as equalities

Before the scaling hypothesis, Rushbrooke (1963) proved the inequality from thermodynamic stability alone (no microscopic model needed). Griffiths (1965) proved . These are rigorous thermodynamic results. The scaling hypothesis predicts that these inequalities are in fact equalities — the becomes . This prediction has been confirmed by numerical simulations and experiments to within the precision of the data.

The conceptual point is important: thermodynamics constrains the exponents but does not fully determine them. The scaling hypothesis (and, more fundamentally, the renormalization group) provides the additional physical input needed to saturate the inequalities.

Key derivation: All scaling relations from two exponents Intermediate+

Proposition. The Widom scaling ansatz , together with the definitions of the critical exponents and the correlation-length exponent , implies the four scaling relations , , , and .

Proof. From the Widom ansatz, the four thermodynamic exponents are:

Rushbrooke: .

Widom: .

Josephson (hyperscaling): , using .

Fisher: The correlation function at is . The susceptibility is . At , and diverges because the integral has a long-range tail. At , the correlation length cuts off the integral at , giving . Comparing with yields .

Bridge. The Kadanoff block-spin picture gives the same relations from a different starting point: instead of postulating a homogeneous free energy, you postulate that coarse-graining by a factor rescales the couplings as , . The renormalization group 11.07.01 then derives the values of and from the eigenvalues of the linearised RG transformation at the fixed point, making the Kadanoff construction into a systematic calculational tool. The Wilson-Fisher fixed point 11.07.02 gives and as functions of and , reproducing the correct critical exponents for all dimensions .

Exercises Intermediate+

Lean formalization Intermediate+

Formalizing the scaling hypothesis requires: (1) a homogeneous-function framework with two continuous parameters , and an integer dimension ; (2) a proof that differentiation of a generalized homogeneous function yields power-law observables with exponents expressed as rational combinations of , , and ; (3) an algebraic verification that the four scaling relations (Rushbrooke, Widom, Fisher, Josephson) hold identically given the expressions for the exponents. Parts (1) and (3) are within Mathlib's current scope (real analysis, field arithmetic). Part (2) requires a domain-specific construction for thermodynamic derivatives and their asymptotic scaling. The gap is substantial but well-scoped.

Advanced results Master

Derivation of all scaling relations from and

The complete set of critical exponents, expressed in terms of the two independent scaling eigenvalues and and the dimension :

The last expression for follows from the Fisher relation combined with the expression for and : , giving .

The mean-field (Landau) exponents correspond to and (for ). The 2D Ising exponents (, , , , ) correspond to and .

Hyperscaling and the Josephson relation

The hyperscaling relation is special because it is the only scaling relation that involves the spatial dimension . Its physical origin is that the singular part of the free energy scales as the number of correlated volumes: , and also , giving .

Hyperscaling holds for short-range interacting systems in (for the Ising universality class). It has been verified numerically for and Ising models.

Breakdown of hyperscaling above

For , the mean-field exponents are exact: , . Hyperscaling would predict , which gives or . For , , so hyperscaling fails.

The physical reason is that above the upper critical dimension , the dangerous irrelevant variable (the quartic coupling in the Landau-Ginzburg Hamiltonian) modifies the free-energy scaling. The quartic coupling flows to zero under the RG (it is irrelevant), but it cannot be simply set to zero because the free energy is singular at . The rescaling of involves an extra factor from :

where (irrelevant). Setting to its fixed-point value is invalid because depends on in a singular way. The correct procedure is to evaluate at its initial (microscopic) value and carry it through the scaling analysis. This produces a modified scaling form that reproduces the mean-field exponents and explains why hyperscaling breaks down.

This subtlety — the dangerous irrelevant variable — was clarified by Fisher, Ma, and Nickel (1972). It shows that scaling is not simply about discarding irrelevant variables; some irrelevant variables must be retained because the quantity of interest (here, the free energy) is non-analytic in them.

Finite-size scaling

Near a critical point in an infinite system, the correlation length is the only relevant length scale. In a finite system of linear size , provides a cutoff: cannot exceed . The finite-size scaling hypothesis (Fisher, 1971) asserts that the free energy has the scaling form:

At the critical point (, ): , and the specific heat , the magnetisation , and the susceptibility .

The finite-size scaling form provides a practical method for extracting critical exponents from numerical simulations. You simulate systems of different sizes at or near and measure how observables scale with . The ratios , , and itself (from the scaling of the Binder cumulant or from the shift of the pseudo-critical temperature) give the critical exponents. This method was essential for the high-precision determination of 3D Ising exponents.

The crossover between the finite-size regime () and the thermodynamic regime () occurs at . This defines the finite-size scaling window: for , finite-size effects are negligible; for , the system feels its finite extent.

Fisher's scaling law

The Fisher scaling relation connects the susceptibility exponent to the correlation-length exponent and the correlation-function exponent . Its physical origin is in the fluctuation-dissipation theorem, which relates the susceptibility to the integral of the correlation function:

At , the correlation function is . The integral gives (the power of from the exponential cutoff, corrected by the algebraic prefactor). Substituting and yields .

At , the exponential cutoff is absent and . The susceptibility diverges (for , is needed for convergence), which is consistent with .

Historical development

The scaling hypothesis emerged in the mid-1960s from the convergence of several lines of investigation. Widom (1965) proposed the scaling ansatz for the equation of state based on the observation that experimental data for fluids near the critical point could be described by a single scaling function. Independently, Domb and Hunter (1965) analysed high-temperature series expansions for the Ising model and found that the exponents satisfied algebraic relations. Kadanoff (1966) provided the physical picture (block spins) that motivated the scaling hypothesis and pointed the way toward the renormalization group.

The scaling hypothesis was a major conceptual advance: it reduced the description of critical phenomena from a collection of independent exponents to a two-parameter family. But it could not predict the values of the exponents — it could only relate them. The renormalization group (Wilson, 1971) provided the missing ingredient: a systematic method for computing and from the microscopic Hamiltonian.

The passage from scaling to the renormalization group is the central conceptual arc of late-twentieth-century statistical physics. Kadanoff's block-spin construction was the physical intuition; Wilson's RG was the mathematical realisation. The scaling functions that Widom postulated are the renormalization-group eigenfunctions at the critical fixed point. The exponents and are the relevant eigenvalues of the RG linearisation. Scaling is the kinematics; the RG provides the dynamics.

Synthesis. The scaling hypothesis sits between Landau theory 11.06.03 and the renormalization group 11.07.01. Landau theory gives specific (mean-field) exponents; the scaling hypothesis shows that whatever the exponents are, only two are independent; the renormalization group computes those two from first principles. The Ginzburg criterion 11.06.04 tells you when Landau theory is sufficient (); the scaling hypothesis tells you how the exponents are related in all dimensions; the RG tells you what the exponents actually are. Data collapse is the experimental signature that validates this entire framework.

Full proof set Master

Proposition. The Kadanoff block-spin rescaling, iterated times on a system with singular free energy , yields the Widom scaling form with .

Proof. Under a single block-spin transformation by factor , the free energy per original site transforms as:

Iterating times:

Choose so that , i.e., . This is always possible for . Then:

Define and . Using :

Differentiating twice with respect to (at ) recovers the specific heat: . Differentiating once with respect to : . At : . Comparing with gives , so (using Rushbrooke and Widom relations).

Proposition. The hyperscaling relation holds for short-range systems in , and breaks down for when dangerous irrelevant variables are present.

Proof. For : the singular free energy scales as one correlated degree of freedom per correlation volume, . Since by definition of : .

For : the quartic coupling in the Landau-Ginzburg Hamiltonian is a dangerous irrelevant variable. Under RG rescaling by factor : with (irrelevant). The free energy has a singularity at (the Gaussian fixed point gives , but the true for ). Retaining in the scaling form:

Setting and evaluating at its fixed-point value : the -dependence of introduces an extra factor where depends on the singular dependence of on . For the Landau-Ginzburg Hamiltonian, (the quartic coupling scales as near the Wilson-Fisher fixed point). The resulting correction modifies to , giving and (mean-field), which violates for .

Connections Master

  • 11.06.02 Mean-field theory (Curie-Weiss, van der Waals) provides specific values for the critical exponents. The scaling hypothesis shows that these exponents satisfy the scaling relations (as verified in Exercise 7 of 11.06.03) — this is a consistency check on mean-field theory.
  • 11.06.03 Landau theory predicts mean-field exponents. The scaling hypothesis is agnostic about the values of the exponents — it only requires that they satisfy the scaling relations. Landau theory satisfies scaling by construction (all exponents are derived from , ).
  • 11.06.04 The Ginzburg criterion determines the regime of validity of mean-field theory. Within that regime, the mean-field exponents satisfy the scaling relations. Outside that regime (near in ), the scaling relations still hold but the exponents are different.
  • 11.07.01 The renormalization group provides the microscopic foundation for the scaling hypothesis. The Kadanoff block-spin rescaling becomes the RG transformation; the exponents , become the eigenvalues of the RG linearisation at the fixed point; the scaling functions are determined by the RG flow.
  • 11.07.02 Block-spin renormalization of the Landau-Ginzburg Hamiltonian implements the Kadanoff construction explicitly. The RG recursion relations yield and as functions of , , and the coupling constants, providing the critical exponents from first principles.

Historical and philosophical context Master

The scaling hypothesis emerged from a period of intense activity in the study of critical phenomena during the 1960s. By the early 1960s, high-temperature series expansions (developed by Domb, Sykes, Fisher, and others at King's College London) had produced accurate numerical estimates of critical exponents for the 3D Ising model. These estimates did not match the mean-field (Landau) predictions. At the same time, precise experiments on fluids (by Voronel, Levelt Sengers, and others) and magnets (by Kouvel, Comly, and others) revealed that the critical exponents were universal — the same for systems with the same symmetry — but different from mean-field values.

Benjamin Widom at Cornell proposed the scaling ansatz for the equation of state in 1965. His insight was that the equation of state near the critical point should have a universal, homogeneous form: if you rescale the reduced temperature and the field by the right powers, all isotherms should collapse onto a single curve. This was partly motivated by the "law of corresponding states" in van der Waals theory, but Widom's insight was that the rescaling exponents were the critical exponents themselves, not the mean-field values.

Leo Kadanoff, then at the University of Illinois, provided the physical picture in 1966. His block-spin construction was a conceptual breakthrough: it showed that the scaling hypothesis followed from the assumption that the correlation length is the only relevant length scale near . If you coarse-grain by a factor smaller than , the physics is unchanged up to a rescaling of the couplings. This argument was not rigorous (it assumed that the block-spin Hamiltonian has the same form as the original Hamiltonian, which is not exactly true), but it captured the essential physics.

Kadanoff's 1966 paper ends with a remarkably prescient statement: "it is natural to think of the cell-to-cell transformation as a mathematical operation defined upon the set of all Hamiltonians." This sentence contains the seed of the renormalization group — the idea that the rescaling transformation acts on a space of Hamiltonians, and that the fixed points of this transformation determine the critical behaviour. Wilson's 1971 renormalization group was the full realisation of this idea.

The Domb-Hunter program (C. Domb and D. L. Hunter at King's College London, 1965) provided independent evidence for scaling from the analysis of series expansions. By computing the ratios of successive coefficients in high-temperature series and extrapolating, they determined critical exponents with sufficient precision to verify the scaling relations. The convergence of the experimental (Widom), theoretical (Kadanoff), and numerical (Domb-Hunter) evidence for scaling was one of the great episodes in the history of statistical physics.

The scaling hypothesis raised a deep question: what determines the two independent exponents? The renormalization group answered this question by showing that the exponents are eigenvalues of the RG transformation at the critical fixed point, and can be computed systematically (via the epsilon expansion, the high-temperature expansion, or Monte Carlo methods). The scaling hypothesis thus occupies a unique position in the logical structure of critical phenomena: it is the bridge between the phenomenology (power laws, data collapse) and the microscopic theory (the RG).

Bibliography Master

@article{widom1965,
  author = {Widom, Benjamin},
  title = {Equation of state in the critical region. {II}},
  journal = {J. Chem. Phys.},
  volume = {43},
  pages = {3898--3905},
  year = {1965}
}

@article{kadanoff1966,
  author = {Kadanoff, Leo P.},
  title = {Scaling laws for {I}sing models near {$T_c$}},
  journal = {Physics},
  volume = {2},
  pages = {263--272},
  year = {1966}
}

@article{rushbrooke1963,
  author = {Rushbrooke, George S.},
  title = {On the thermodynamics of the critical region for the {I}sing problem},
  journal = {J. Chem. Phys.},
  volume = {39},
  pages = {842--843},
  year = {1963}
}

@article{griffiths1965,
  author = {Griffiths, Robert B.},
  title = {Thermodynamic inequality near the critical point for the lattice gas and the {I}sing model},
  journal = {Phys. Rev. Lett.},
  volume = {14},
  pages = {623--624},
  year = {1965}
}

@article{dombhunter1965,
  author = {Domb, Cyril and Hunter, David L.},
  title = {On the critical behaviour of lattice gas and the {I}sing model},
  journal = {Proc. Phys. Soc.},
  volume = {86},
  pages = {1107--1116},
  year = {1965}
}

@article{fisher1971fss,
  author = {Fisher, Michael E.},
  title = {The theory of critical point singularities},
  journal = {Proc. Enrico Fermi Int. Sch. Phys.},
  volume = {51},
  pages = {1--99},
  year = {1971}
}

@article{fishermanickel1972,
  author = {Fisher, Michael E. and Ma, Shang-keng and Nickel, B. G.},
  title = {Critical exponents for long-range interactions},
  journal = {Phys. Rev. Lett.},
  volume = {29},
  pages = {917--920},
  year = {1972}
}

@article{wilson1971,
  author = {Wilson, Kenneth G.},
  title = {Renormalization group and critical phenomena. {I}. {R}enormalization group and the {K}adanoff scaling picture},
  journal = {Phys. Rev. B},
  volume = {4},
  pages = {3174--3183},
  year = {1971}
}

@book{kardar2007,
  author = {Kardar, Mehran},
  title = {Statistical Physics of Fields},
  publisher = {Cambridge University Press},
  year = {2007}
}

@book{pathria-beale2011,
  author = {Pathria, R. K. and Beale, Paul D.},
  title = {Statistical Mechanics},
  edition = {3rd},
  publisher = {Academic Press},
  year = {2011}
}

@book{goldenfeld1992,
  author = {Goldenfeld, Nigel},
  title = {Lectures on Phase Transitions and the Renormalization Group},
  publisher = {Addison-Wesley},
  year = {1992}
}