28.04.05 · astronomy / cosmology

Large-scale structure formation: the Press-Schechter formalism, dark-matter halos, and the cosmic web

shipped3 tiersLean: none

Anchor (Master): Press-Schechter 1974 ApJ 187:425; Bond-Myers-Szalay 1991 ApJ 379:440 (excursion-set); BBKS 1986 ApJ 304:15 (transfer functions); Navarro-Frenk-White 1997 ApJ 490:493 (NFW profile); Sheth-Tormen 1999 MNRAS 308:119 (ellipsoidal refinement); Springel 2005 Nature 435:629 (Millennium); Eisenstein 2005 ApJ 633:560 (BAO detection); Springel 2018 MNRAS 475:226 (IllustrisTNG)

Intuition Beginner

The universe today is full of structure. Galaxies gather in groups and clusters, in long filaments and thin sheets, with vast near-empty voids between them. But the early universe, just after the Big Bang, was almost perfectly smooth. How did we get from smooth to structured? The answer is gravity. Tiny density variations, set up during cosmic inflation and imprinted on the cosmos at a level of about one part in one hundred thousand, seeded every galaxy and cluster we see. Over billions of years gravity amplified these seeds. Denser regions pulled in more matter, became denser still, and pulled in yet more. The rich pattern of the cosmic web grew from these minute primordial ripples.

This process is called hierarchical structure formation. The smallest objects collapsed first: minihalos of dark matter far smaller than a galaxy. These then merged into larger halos, which pulled in gas and lit up as the first small galaxies. Those galaxies in turn merged to build bigger ones, which gathered into clusters, and the clusters arranged themselves into the largest pattern of all. On the largest scales the universe resembles a three-dimensional spiderweb: galaxies trace thin filaments and curved sheets around voids hundreds of millions of light-years across. The same pattern appears in deep galaxy surveys and in computer simulations of the expanding universe.

Large-scale structure is the main testing ground for cosmological models. Its patterns reveal what the universe is made of, how old it is, and how it has evolved. Competing theories of dark matter, dark energy, and the law of gravity make different predictions for the shape of the cosmic web, and large galaxy surveys measure that shape precisely enough to rule most of them out. This is why astronomy has devoted decades of telescope time and billions of dollars to mapping the positions of millions of galaxies across the sky.

Visual Beginner

The diagram shows the cosmic web: a three-dimensional network of dark-matter halos threading filaments and sheets, surrounding near-empty voids. Within each filament, the halo distribution follows the Press-Schechter mass function , with many small halos and exponentially few massive ones. Superimposed is the baryon acoustic oscillation scale of about 150 Mpc, the standard ruler imprinted on the galaxy correlation function. Along a random line of sight, the Lyman-alpha forest absorption spectrum records the neutral hydrogen in the intergalactic medium at a series of cosmic times.

Each piece — halos, filaments, the acoustic peak, the absorption forest — measures a different aspect of the same underlying density field, and each provides an independent check on the model.

Worked example Beginner

The cosmic microwave background, or CMB, is the afterglow of the Big Bang. It is microwave radiation reaching us from every direction in the sky, with a nearly uniform temperature of Kelvin. In 1992 NASA's COBE satellite measured the CMB temperature across the sky and found that it varies by about one part in one hundred thousand: tiny hot and cold spots that are the imprints of the primordial density fluctuations.

Step 1. The hot spots were regions slightly denser than average at the time of recombination, 380,000 years after the Big Bang. The cold spots were slightly less dense. Gravity later amplified these contrasts: the hot spots collapsed into galaxies and clusters, and the cold spots became the voids.

Step 2. NASA's WMAP satellite, launched in 2001, mapped the spots at higher resolution. The European Space Agency's Planck satellite, launched in 2009, mapped them better still. From the pattern of hot and cold spots — the CMB angular power spectrum — cosmologists extracted the composition of the universe with percent-level precision.

Step 3. The Planck 2013 results give the age of the universe as 13.8 billion years, the Hubble constant as about 67 km/s/Mpc, the spectral index as (slightly below the scale-invariant value of , exactly as inflation predicts), and the composition as percent ordinary matter, percent dark matter, and percent dark energy.

What this tells us: the hot and cold spots of the CMB are the seeds of today's cosmic web. Every galaxy, cluster, and filament grew from these primordial ripples under the action of gravity.

Check your understanding Beginner

Formal definition Intermediate+

The formation of cosmic structure proceeds from primordial density perturbations through gravitational amplification into the non-linear regime of collapsed halos. Following Mo, van den Bosch, and White [Mo-van den Bosch-White 2010], the relevant objects are the density contrast, the matter power spectrum, the halo mass function, the halo density profile, and the baryon acoustic oscillation scale.

Definition (density contrast and matter power spectrum). The cosmological density contrast is , where is the mean matter density. The Fourier-space variance defines the matter power spectrum via . Inflation predicts a near-scale-invariant primordial spectrum with (Planck 2013). The variance of the density field smoothed on scale with window function is , a monotonic function of the smoothing mass .

Definition (dark-matter halo). A dark-matter halo is a gravitationally bound, virialised overdense region that has collapsed along all three principal axes. In the Press-Schechter formalism [PressSchechter1974 ApJ 187:425] a region of the linearly extrapolated density field smoothed on scale is identified with a halo of mass when its density contrast exceeds the critical value , the linear overdensity of a spherical top-hat at the epoch of collapse.

Definition (NFW profile). The universal density profile of collisionless cold-dark-matter halos, discovered by Navarro, Frenk, and White [NavarroFrenkWhite1997 ApJ 490:493] in N-body simulations, is with . The two free parameters are a scale density and a scale radius . The inner asymptotic slope is , the outer slope is , and the total mass diverges logarithmically.

Definition (baryon acoustic oscillations). Before recombination, photons and baryons formed a coupled plasma that supported sound waves. At recombination () the photons decoupled and the sound waves froze, imprinting a characteristic scale on the matter distribution — the sound horizon Mpc comoving. This appears as a peak in the galaxy two-point correlation function at , providing a standard ruler for cosmological distance measurement [Eisenstein2005 ApJ 633:560].

Definition (Lyman-alpha forest). Neutral hydrogen in the intergalactic medium absorbs photons at the Lyman-alpha transition wavelength ( nm rest). Light from a background quasar passing through absorbing clouds at a series of redshifts produces a forest of absorption lines blueward of the quasar's Lyman-alpha emission. The optical depth at each wavelength probes the density and temperature of the intergalactic medium at the corresponding redshift.

Counterexamples to common slips Intermediate+

  • "Structure formation began only after recombination." Partly wrong. Dark-matter perturbations grew via gravitational instability throughout the matter-dominated era, including before recombination. Baryon perturbations could not grow before recombination because radiation pressure opposed compression; they caught up with the dark matter only after photon decoupling. The CMB anisotropies therefore reflect primarily the dark-matter distribution at .

  • "Dark-matter halos are smooth inside." Mostly, but halos host a population of subhalos — smaller bound halos orbiting within the main halo. The number of predicted subhalos exceeds the number of observed satellite galaxies by roughly an order of magnitude (the missing-satellites problem), and the most massive predicted subhalos fail to host the brightest observed satellites in the Local Group (the too-big-to-fail problem).

  • "The Press-Schechter mass function is exact." No. The original Press-Schechter derivation uses spherical collapse and a Gaussian field. Sheth and Tormen [ShethTormen1999 MNRAS 308:119] showed that ellipsoidal collapse (driven by the tidal field of large-scale structure) modifies the collapse barrier and increases the predicted number of low-mass halos by 20 to 50 percent relative to Press-Schechter.

  • "The cosmic web is a unique structure." No. Different random seeds for the initial conditions produce statistically equivalent but topologically distinct cosmic webs. The statistical descriptors — the power spectrum, the two-point correlation function, the distribution of void sizes — are reproducible; the specific locations of individual filaments are not.

  • "Baryon acoustic oscillations are the only cosmological standard ruler." No. Type Ia supernovae are standardisable candles, providing a complementary distance ladder. The sound-horizon ruler and the supernova candle probe different redshift ranges and are subject to different systematics, so they are used in combination.

  • "We know dark matter is cold." Inference, not proof. Hot-dark-matter models fail because free-streaming erases small-scale structure. Warm-dark-matter models remain viable but are constrained by the absence of small-scale power suppression in the Lyman-alpha forest. The cold-dark-matter particle has not been directly detected, and its identity remains open.

Key theorem: Press-Schechter mass function Intermediate+

Theorem (Press-Schechter 1974). Let be the cosmological density contrast smoothed on comoving scale with a spherically symmetric window function of mass . Assume the smoothed field is a Gaussian random variable with zero mean and variance . Let be the critical overdensity for spherical collapse evaluated at the present epoch. The comoving number density of collapsed halos with mass in is

Proof. Model the smoothed density contrast at a randomly chosen comoving position as a Gaussian random variable with probability density

A region smoothed on scale is identified with a collapsed halo of mass whenever . The fraction of the volume (equivalently of the mass, since is the mean) lying in such regions is

This undercounts by a factor of two: mass in underdense regions on scale may still sit inside overdense regions on some larger scale (the cloud-in-cloud problem). Press and Schechter inserted an ad-hoc factor of two, giving

The rigorous justification via the Bond-Myers-Szalay excursion-set formalism [BondMyersSzalay1991 ApJ 379:440] appears in the Full proof set below; the excursion-set derivation reproduces the same factor of two without ad-hoc input.

The number density of halos in is the mass per halo times the rate at which the collapsed fraction drops as the threshold is raised from to ,

Compute the derivative. With and ,

so, taking the absolute value,

Use and substitute,

as required.

Bridge. The Press-Schechter mass function builds toward 28.04.01 cosmology, where it converts the primordial power spectrum into the observed galaxy-cluster mass function, and appears again in 28.07.02, where the same gravitational-instability logic governs the Jeans collapse of molecular clouds on stellar scales. The foundational reason the formalism works is that Gaussian initial conditions remain Gaussian in linear theory, so the collapse threshold maps directly onto a mass fraction, and this is exactly the bridge between the linear power spectrum and the non-linear halo population. Putting these together identifies the dark-matter halo distribution with the galaxy clustering measured by large-scale surveys, and the pattern generalises to the Sheth-Tormen ellipsoidal-collapse refinement that fixes the low-mass end.

Exercises Intermediate+

Advanced results Master

Theorem 1 (Lifshitz 1946: relativistic perturbation growth). Lifshitz [Lifshitz1946 J. Phys. USSR 10:116] gave the first fully relativistic treatment of density perturbations in an expanding universe. In the matter-dominated Einstein-de Sitter era the linear perturbation equation admits two modes, a growing mode and a decaying mode . The proportionality of the growing mode to the scale factor is the central reason that CMB-level perturbations can grow to order-unity contrasts in today's cosmic web.

Theorem 2 (Press-Schechter 1974: the halo mass function). Press and Schechter [PressSchechter1974 ApJ 187:425] derived the comoving number density of halos above mass from a Gaussian random field, , with the spherical-collapse threshold. The differential mass function is derived in the Key Theorem above.

Theorem 3 (Bond-Myers-Szalay 1991: the excursion-set formalism). Bond, Myers, and Szalay [BondMyersSzalay1991 ApJ 379:440] recast the Press-Schechter derivation as a first-passage problem for the smoothing scale: the trajectory of as a function of executes a Brownian random walk, and halo masses are the first crossings of the barrier . This formalism rigorously fixes the cloud-in-cloud problem and extends naturally to moving barriers (Sheth-Tormen).

Theorem 4 (BBKS 1986: the cold-dark-matter transfer function). Bardeen, Bond, Kaiser, and Szalay [BBKS1986 ApJ 304:15] computed the linear transfer function relating the post-inflation primordial power spectrum to the matter power spectrum entering the Press-Schechter formalism. The BBKS transfer function encodes the radiation-to-matter-era transition, the Meszaros-effect horizon-entry suppression, and the small-scale free-streaming cutoff; it is the input shape for .

Theorem 5 (White-Frenk-Davis-Efstathiou 1987: CDM reproduces galaxies). White, Frenk, Davis, and Efstathiou [WhiteFrenkDavis1987 ApJ 313:505] demonstrated that cold-dark-matter N-body simulations, combined with Press-Schechter halo identification and gas-dynamical galaxy formation, reproduce the observed galaxy luminosity function, the two-point correlation function, and the galaxy-cluster mass function. This established the CDM paradigm as the standard structure-formation model.

Theorem 6 (Navarro-Frenk-White 1997: the universal halo profile). Navarro, Frenk, and White [NavarroFrenkWhite1997 ApJ 490:493] showed that dark-matter halos in N-body simulations spanning four decades in mass are fit by a single two-parameter profile, with . The inner asymptotic slope is , the outer slope is , and the scale radius correlates with halo mass via the mass-concentration relation.

Theorem 7 (Sheth-Tormen 1999: ellipsoidal-collapse refinement). Sheth and Tormen [ShethTormen1999 MNRAS 308:119] replaced the constant spherical-collapse barrier with a moving barrier derived from ellipsoidal collapse in a tidal field. The resulting mass function exceeds by 20 to 50 percent at low masses and matches N-body simulations to better than ten percent across the full mass range.

Theorem 8 (Eisenstein 2005 and Springel 2005: BAO detection and the Millennium simulation). Eisenstein et al. [Eisenstein2005 ApJ 633:560] detected the baryon acoustic oscillation peak in the SDSS luminous-red-galaxy correlation function at the predicted sound-horizon scale of about 150 Mpc, opening the BAO standard-ruler era. In the same year, Springel et al. [Springel2005 Nature 435:629] ran the Millennium simulation with roughly ten billion particles, reproducing the observed cosmic web from to within CDM. The IllustrisTNG simulation [Springel2018IllustrisTNG MNRAS 475:226] added magneto-hydrodynamics, radiative cooling, star formation, and black-hole feedback.

Synthesis. The Press-Schechter framework is the foundational reason that the observed cosmic web — galaxies, clusters, filaments, voids — can be predicted ab initio from the primordial power spectrum measured in the CMB, and the central insight is that Gaussian initial conditions combined with spherical-collapse thresholding convert the linear variance into a closed-form halo mass function. This is exactly the bridge between linear perturbation theory and the non-linear galaxy distribution: putting these together identifies the simulated dark-matter halo population of Millennium and IllustrisTNG with the observed galaxy clustering measured by SDSS. The pattern generalises from the constant spherical barrier to the moving ellipsoidal barrier of Sheth-Tormen, and appears again in 28.07.02 where the same Jeans-instability logic operates on stellar scales inside molecular clouds. The bridge is from the BBKS transfer functions of the linear regime to the NFW profile of the non-linear halo, with baryon acoustic oscillations providing the Mpc standard ruler that calibrates the cosmic distance scale and the Lyman-alpha forest probing the intergalactic medium along the line of sight.

Full proof set Master

Proposition 1 (Lifshitz growing mode). In a matter-dominated Einstein-de Sitter universe with scale factor , the growing mode of the density contrast obeys .

Proof. The linearised continuity, Euler, and Poisson equations in comoving coordinates reduce to a single evolution equation for the Fourier-mode density contrast ,

where and . In the matter-dominated era , so and . Seek power-law solutions . Substitution gives

so , equivalently . The roots are (growing) and (decaying). Since , the growing mode is , while the decaying mode becomes negligible.

Two consequences follow. First, growth linear in the scale factor means perturbations have grown by a factor since recombination — insufficient to carry CMB-anisotropy seeds to order unity unless dark matter had begun growing earlier, near matter-radiation equality at . Second, during the radiation era the expansion rate is large relative to , suppressing growth to a logarithmic crawl (the Meszaros effect); only perturbations entering the horizon during matter domination grow at the full rate, which is the origin of the turnover in the BBKS transfer function.

Proposition 2 (NFW enclosed mass). The NFW profile with has enclosed mass , which diverges logarithmically as .

Proof. By definition . Substitute , ,

With , , the integral becomes

as required. As , but , so logarithmically. A finite virial radius truncates the profile where the mean interior density equals a chosen multiple of the critical density, giving a finite halo mass .

Connections Master

  • Cosmology survey 28.04.01. This unit deepens the large-scale-structure introduction of 28.04.01 by deriving the Press-Schechter mass function from the Gaussian random field of primordial perturbations and by connecting the CMB anisotropies to today's galaxy distribution. The CDM composition ( ordinary matter, dark matter, dark energy) fixed in 28.04.01 is the input that fixes the shape and amplitude of the power spectrum consumed here.

  • Cosmology — FLRW, inflation, CMB 13.08.02. The relativistic perturbation theory of 13.08.02 supplies the framework within which the Lifshitz growing mode is derived in the Full proof set. Inflation generates the near-scale-invariant primordial power spectrum with that Press-Schechter takes as its input, and the FLRW expansion history fixes the radiation-to-matter transition encoded in the BBKS transfer function.

  • Galaxies survey 28.03.01. Galaxies are the visible tracers of the dark-matter halo distribution whose mass function is derived here. The Press-Schechter predicts the halo abundance, and galaxy formation efficiency (the stellar-mass-to-halo-mass ratio) maps halos to the galaxy luminosity function of 28.03.01. The halo occupation distribution formalism connects the two and is the standard bridge between simulations and observed galaxy clustering.

  • Molecular clouds and protostellar evolution 28.07.02. The Jeans collapse of 28.07.02 is the baryonic inside-halo complement of the dark-matter halo collapse treated here. Once a dark-matter halo virialises, the baryonic gas within it cools radiatively, falls toward the halo centre, and fragments into molecular clouds where the stellar-scale Jeans collapse of 28.07.02 takes over. The same gravitational-instability logic operates on scales separated by more than fifteen orders of magnitude.

  • Pulsars and neutron stars 28.08.02. Pulsar dispersion measures probe the free-electron density of the intergalactic medium along the line of sight, providing a direct constraint on the baryonic content of the cosmic web's filaments. Together with the Lyman-alpha forest treated here, pulsar observations cross-check the cosmic baryon inventory fixed by Big Bang nucleosynthesis.

Historical & philosophical context Master

Evgeny Lifshitz [Lifshitz1946 J. Phys. USSR 10:116] in 1946 gave the first complete relativistic treatment of cosmological perturbations, deriving the growing and decaying modes and showing that gravitational growth of structure proceeds effectively only in the matter-dominated era. The founding work on the statistical structure of the galaxy distribution — the two-point correlation function and the power spectrum — is due to Jim Peebles over two decades, culminating in his 1980 monograph [Peebles1980 Princeton]. William Press and Paul Schechter [PressSchechter1974 ApJ 187:425] then introduced the halo mass function that bears their names, a short derivation that remains the workhorse of cosmological structure formation. The cloud-in-cloud problem in the original derivation was resolved by J. Richard Bond, S. T. Myers, and Alexander Szalay [BondMyersSzalay1991 ApJ 379:440] via the excursion-set formalism, in which the smoothing scale performs a Brownian random walk and halo mass is identified with the first crossing of the collapse barrier.

The cold-dark-matter transfer functions of Bardeen, Bond, Kaiser, and Szalay (BBKS) [BBKS1986 ApJ 304:15] gave the shape of the linear power spectrum that Press-Schechter consumes. Simon White, Carlos Frenk, Marc Davis, and George Efstathiou [WhiteFrenkDavis1987 ApJ 313:505] showed in 1987 that cold dark matter plus Press-Schechter reproduces the observed galaxy clustering, establishing the CDM paradigm. Julio Navarro, Carlos Frenk, and Simon White [NavarroFrenkWhite1997 ApJ 490:493] discovered that simulated dark-matter halos across four decades in mass obey a universal density profile with inner slope and outer slope . Ravi Sheth and Giuseppe Tormen [ShethTormen1999 MNRAS 308:119] refined the mass function for ellipsoidal collapse, improving the low-mass match. Daniel Eisenstein and the SDSS team [Eisenstein2005 ApJ 633:560] detected the baryon acoustic oscillation peak at the predicted sound-horizon scale, opening the precision standard-ruler era. The Millennium simulation [Springel2005 Nature 435:629] confirmed the full CDM structure-formation picture, and IllustrisTNG [Springel2018IllustrisTNG MNRAS 475:226] added magneto-hydrodynamics and baryonic feedback.

Bibliography Master

@article{Lifshitz1946,
  author  = {Lifshitz, Evgeny M.},
  title   = {On the Gravitational Stability of the Expanding Universe},
  journal = {Journal of Physics (USSR)},
  volume  = {10},
  pages   = {116--122},
  year    = {1946},
}

@article{PressSchechter1974,
  author  = {Press, William H. and Schechter, Paul},
  title   = {Formation of Galaxies and Clusters of Galaxies by Self-Similar Gravitational Condensation},
  journal = {Astrophysical Journal},
  volume  = {187},
  pages   = {425--438},
  year    = {1974},
  doi     = {10.1086/152650},
}

@article{BondMyersSzalay1991,
  author  = {Bond, J. Richard and Myers, S. T. and Szalay, Alexander S.},
  title   = {The Excursion Set Theory and the Cosmic Mass Function},
  journal = {Astrophysical Journal},
  volume  = {379},
  pages   = {440--460},
  year    = {1991},
  doi     = {10.1086/170621},
}

@article{BBKS1986,
  author  = {Bardeen, James M. and Bond, J. Richard and Kaiser, Nick and Szalay, Alexander S.},
  title   = {The Statistics of Peaks of Gaussian Random Fields},
  journal = {Astrophysical Journal},
  volume  = {304},
  pages   = {15--61},
  year    = {1986},
  doi     = {10.1086/164143},
}

@article{WhiteFrenkDavis1987,
  author  = {White, Simon D. M. and Frenk, Carlos S. and Davis, Marc and Efstathiou, George},
  title   = {Clustering of Galaxies in a Cold Dark Matter Dominated Universe},
  journal = {Astrophysical Journal},
  volume  = {313},
  pages   = {505--516},
  year    = {1987},
  doi     = {10.1086/164990},
}

@article{NavarroFrenkWhite1997,
  author  = {Navarro, Julio F. and Frenk, Carlos S. and White, Simon D. M.},
  title   = {A Universal Density Profile from Hierarchical Clustering},
  journal = {Astrophysical Journal},
  volume  = {490},
  pages   = {493--508},
  year    = {1997},
  doi     = {10.1086/304490},
}

@article{ShethTormen1999,
  author  = {Sheth, Ravi K. and Tormen, Giuseppe},
  title   = {Large-Scale Bias and the Peak Background Split in the Object-Mass Correlation},
  journal = {Monthly Notices of the Royal Astronomical Society},
  volume  = {308},
  pages   = {119--126},
  year    = {1999},
  doi     = {10.1046/j.1365-8711.1999.02684.x},
}

@article{Eisenstein2005,
  author  = {Eisenstein, Daniel J. and Zehavi, Idit and Hogg, David W. and Scoccimarro, Roman and others},
  title   = {Detection of the Baryon Acoustic Peak in the Large-Scale Correlation Function of {SDSS} Luminous Red Galaxies},
  journal = {Astrophysical Journal},
  volume  = {633},
  pages   = {560--574},
  year    = {2005},
  doi     = {10.1086/466512},
}

@article{Springel2005,
  author  = {Springel, Volker and White, Simon D. M. and Jenkins, Adrian and Frenk, Carlos S. and others},
  title   = {Simulations of the Formation, Evolution and Clustering of Galaxies and Quasars},
  journal = {Nature},
  volume  = {435},
  pages   = {629--636},
  year    = {2005},
  doi     = {10.1038/nature03597},
}

@article{Springel2018IllustrisTNG,
  author  = {Springel, Volker and Pakmor, R{\"u}diger and Pillepich, Annalisa and Weinberger, Rainer and Nelson, Dylan and Hernquist, Lars and Vogelsberger, Mark and Genel, Shy and Torrey, Paul and Marinacci, Federico},
  title   = {First Results from the {IllustrisTNG} Simulations: Composition of the Low-Redshift Einstein Telescope},
  journal = {Monthly Notices of the Royal Astronomical Society},
  volume  = {475},
  pages   = {226--249},
  year    = {2018},
  doi     = {10.1093/mnras/stx3304},
}

@book{Peebles1980,
  author    = {Peebles, P. J. E.},
  title     = {The Large-Scale Structure of the Universe},
  publisher = {Princeton University Press},
  year      = {1980},
}

@book{MoVanDenBoschWhite2010,
  author    = {Mo, Houjun and van den Bosch, Frank and White, Simon},
  title     = {Galaxy Formation and Evolution},
  publisher = {Cambridge University Press},
  year      = {2010},
}