37.08.08 · probability / 08-random-matrices

Free Probability: Freeness, Free Convolution, and the R-Transform

shipped3 tiersLean: none

Anchor (Master): Voiculescu, Dykema, Nica, Free Random Variables (CRM Monograph 1, AMS, 1992); Nica, Speicher, Lectures on the Combinatorics of Free Probability (LMS Lecture Notes 335, Cambridge, 2006); Anderson, Guionnet, Zeitouni, An Introduction to Random Matrices (Cambridge, 2010) §5; Mingo, Speicher, Free Probability and Random Matrices (Fields Institute Monographs 35, Springer, 2017); Voiculescu, Addition of certain non-commuting random variables, J. Funct. Anal. 66 (1986)

Intuition Beginner

Ordinary probability has a rule for combining two unrelated quantities: if you know the distribution of one die and the distribution of another, and the two are independent, you can read off the distribution of their sum. The recipe is fixed and depends only on the two pieces. Free probability is a second such recipe, built for a different kind of "unrelated" — the kind that shows up when the quantities are large matrices rather than plain numbers, and the order you multiply them in matters.

Two large random matrices, each spun into a random orientation that has nothing to do with the other, are not independent in the ordinary sense; their entries are tangled. But they obey their own clean combination rule, and that rule is called freeness. It is the matrix-world cousin of independence: knowing the eigenvalue histogram of each matrix is enough to predict the eigenvalue histogram of their sum, with no reference to the messy entries. The operation that does this is free convolution.

The payoff is a transform that turns this combination into plain addition. For ordinary independent sums there is a gadget — built from the distribution — that you simply add. Free probability has its own gadget, the R-transform, with the same magic: to add two free quantities, compute each one's R-transform and add them. And just as adding many small independent numbers drives you to the bell curve, adding many small free quantities drives you to the half-circle from the previous units.

Visual Beginner

Picture two eigenvalue histograms side by side, each a cloud of dots on a horizontal line: one a tall narrow bump, the other a wide flat block. Ordinary addition of independent numbers would smear one over the other in the familiar overlapping way. Free addition does something different and tidier: it produces a single new histogram whose shape is dictated by a rule that treats the two clouds as maximally unrelated rotations of each other.

The bottom row is the punchline. Each cloud, fed through the R-transform box, becomes a simple curve. The combined cloud's curve is just the two input curves added height-for-height. So a complicated reshaping of histograms upstairs becomes plain stacking downstairs — the same trick that makes adding independent numbers easy, now working for these unrelated matrices.

Worked example Beginner

We free-add two of the simplest possible quantities — each a fair coin taking the values plus one and minus one — and find the result, watching freeness produce something the ordinary rule never would.

Step 1. Each quantity has two equally likely eigenvalues, and . Its histogram is two spikes of equal height at those two points. We want the histogram of the free sum of two such quantities that are unrelated in the free sense.

Step 2. For ordinary independent coins, the sum -or- plus -or- lands on , , with weights one quarter, one half, one quarter. Free addition gives a different answer because the two quantities do not commute.

Step 3. The free rule spreads the result into a continuous arch rather than three spikes. The free sum of two symmetric coins has eigenvalues filling the whole interval from to , with a density that is tall at the two ends and dips in the middle — the exact opposite of a bump in the center.

Step 4. Concretely, the density at a point between and is one divided by ( times the square root of ). At the center this is one divided by ( times ), about ; near the ends it shoots up. This curved "arcsine" shape is the free sum, and it has the same average squared value, , as the ordinary sum did.

Step 5. What this tells us: free addition is a genuinely new operation. Feeding it two two-point spikes returns a smooth spread-out arch, not the three-spike ordinary answer. The two recipes agree on plain numbers but part ways for these matrix-like quantities, and freeness is the rule that governs the parting.

Check your understanding Beginner

Formal definition Intermediate+

A noncommutative probability space is a pair where is a unital algebra over and is a state: a linear functional with . For the spectral theory of self-adjoint elements one takes a unital -algebra and positive () and tracial (). The state plays the role of expectation: for a self-adjoint with , the are the moments of a compactly supported probability measure on , the spectral distribution (or distribution) of , characterised by for polynomials . The motivating example is with , where is the empirical spectral distribution of 37.08.01.

Subalgebras (each containing the unit) are free (freely independent) if, whenever satisfy

  • for every (each is centred),
  • each lies in some , and
  • consecutive indices differ, (the word is alternating),

then . Elements are free if the unital subalgebras they generate are free. Freeness is not a product rule: from the definition one computes for free , which differs from the classical . Freeness determines all mixed moments of and from the individual moments, but by a recursive centring rule, not by factorisation.

The free additive convolution of two compactly supported probability measures on is the distribution $$ \mu \boxplus \nu := \mu_{a + b}, \qquad a, b \text{ free with } \mu_a = \mu,\ \mu_b = \nu . $$ This is well defined: freeness fixes every moment from the moments of and , so depends only on and , not on the realisation. The operation is commutative and associative, with the point mass as identity.

The linearising transform is built from the Cauchy/Stieltjes transform of 37.08.02. Write for (this is in the sign convention of 37.08.02; here at infinity). Near infinity is invertible: its compositional inverse satisfies as . The R-transform is $$ R_\mu(w) := K_\mu(w) - \frac{1}{w} = \sum_{n \ge 0} \kappa_{n+1}(\mu), w^{n}, $$ a function holomorphic near whose Taylor coefficients are the free cumulants .

Counterexamples to common slips Intermediate+

  • Freeness is not classical independence dressed up. Two commuting elements are free only in the degenerate case where one is a scalar. For genuinely noncommuting , ; the mixed-moment rule is recursive centring, not a product of marginal moments.
  • Centring is mandatory in the freeness condition. The vanishing requires each centred. For non-centred letters one first writes and expands; dropping the centring step gives wrong mixed moments.
  • Free convolution is not the convolution of densities. is not . Two symmetric Bernoulli laws convolve classically to the three-atom law on but free-convolve to the arcsine law on ; only the R-transforms add, never the densities.
  • The R-transform, not the Cauchy transform, is additive. . Additivity holds for after passing to the functional inverse ; forgetting the inversion and adding Cauchy transforms is the most common error.

Key theorem with proof Intermediate+

Theorem (Voiculescu: the R-transform linearises free convolution). Let be compactly supported probability measures on . Then $$ R_{\mu \boxplus \nu}(w) = R_\mu(w) + R_\nu(w) $$ as holomorphic functions near ; equivalently the free cumulants are additive, for all .

Proof. The engine is the moment-cumulant formula over non-crossing partitions together with the vanishing of mixed free cumulants of free elements. For a state and self-adjoint with distribution , define the free cumulants implicitly by $$ m_n := \tau(a^n) = \sum_{\pi \in \mathrm{NC}(n)} \kappa_\pi, \qquad \kappa_\pi := \prod_{B \in \pi} \kappa_{|B|}, $$ where is the lattice of non-crossing partitions of and the sum runs over all such , each block contributing the cumulant of its size. This system is triangular (, since the one-block partition contributes and the rest involve with ), so it has a unique solution and may be inverted by Möbius inversion on ; this defines from and conversely.

First, this combinatorial agrees with the analytic coefficients in . The generating identity with unwinds, after substituting the series and inverting, into precisely the non-crossing moment-cumulant relations: the functional-inverse relation is the generating-function form of , a computation of Speicher [Speicher 1994]. So the two definitions of coincide.

Second, the key structural fact: if and are free, then all mixed free cumulants vanish. Define the multivariate free cumulants by the same non-crossing Möbius inversion applied to mixed moments . The claim is that whenever the arguments are not all from or all from , i.e. whenever at least one comes from the free pair's first element and at least one from the second. This is equivalent to freeness: the alternating-centred-moment vanishing of the freeness definition is, after Möbius inversion over , exactly the statement that cumulants with mixed arguments are zero. (One direction: a mixed cumulant expands through the moment-cumulant formula into alternating centred moments, all forced to zero by freeness; the triangular system then propagates the vanishing to every mixed cumulant. The converse runs the inversion backward.)

Now compute the cumulants of . By multilinearity of , $$ \kappa_n(a+b) = \kappa_n(\underbrace{a+b,\dots,a+b}{n}) = \sum{(x_1,\dots,x_n)\in{a,b}^n} \kappa_n(x_1,\dots,x_n). $$ By the vanishing of mixed free cumulants, the only surviving terms are the all- term and the all- term: $$ \kappa_n(a+b) = \kappa_n(a,\dots,a) + \kappa_n(b,\dots,b) = \kappa_n(\mu) + \kappa_n(\nu). $$ Since has distribution , this is . Summing into the generating series, .

Bridge. This linearisation builds toward the free central limit theorem and the entire algebraic re-reading of random-matrix limits, and it appears again in the deformed-model self-consistent equations of 37.08.02, where the matrix Dyson equation is free additive convolution made matrix-valued. The foundational reason free convolution linearises under is that freeness is exactly the vanishing of mixed free cumulants, so the cumulants of a free sum add term by term — this is exactly the role the classical cumulants (the coefficients of ) play for ordinary convolution, with the non-crossing lattice replacing the full partition lattice. The free cumulant sequence is dual to the moment sequence through Möbius inversion on , and the central insight is that replacing all partitions by non-crossing ones is the single combinatorial substitution that turns classical independence into freeness. Putting these together, the semicircle, whose only nonzero free cumulant is , is the free analogue of the Gaussian, whose only nonzero classical cumulant is the variance, and this is the bridge from the Catalan / non-crossing-pair combinatorics of 37.08.01 to the algebra of free independence.

Exercises Intermediate+

Advanced results Master

The R-transform has a multiplicative partner governing products. For probability measures on the free multiplicative convolution is the distribution of for free positive , and it is linearised by Voiculescu's -transform : . The -transform is built from the moment generating series by with . Free multiplicative convolution is the algebra behind the limiting spectral distribution of products of independent random matrices and of sample-covariance matrices , whose Marchenko-Pastur law of 37.08.02 is the free multiplicative convolution of the law of -building blocks; the deformed and covariance self-consistent equations there are and made matrix-valued.

The non-crossing combinatorics has a self-dual structure. The lattice carries the Kreweras complementation map , an order-reversing involution-like bijection with , where is the number of blocks. The Kreweras complement is what turns the moment-cumulant inversion into a tractable Möbius computation: the Möbius function of factorises over blocks with values , the signed Catalan numbers, and the free cumulant is the leading (-to-) Möbius coefficient. This self-duality is why the same Catalan sequence counts , the semicircle moments, the surviving Wigner walks, and the Möbius function — one combinatorial object seen through four windows.

The analytic theory of extends far beyond compact support via subordination. For arbitrary probability measures there exist analytic subordination functions with and . Subordination, due to Voiculescu and made unconditional by Biane and by Belinschi-Bercovici, replaces the formal R-transform series by a fixed-point equation for valid on all of , and it is the analytic backbone of the proofs that is always a genuine probability measure with at most a single atom and a real-analytic density on the interior of its support. It is the exact analogue, in free probability, of the additivity of classical characteristic functions, with the upper half-plane replacing the real line.

Free probability supplies the algebraic skeleton of the random-matrix self-consistent equations. The deformed Wigner equation of 37.08.02 is the statement computed through subordination: the free additive convolution of the empirical law of the diagonal with the semicircle. The matrix Dyson equation for a general variance profile is operator-valued free convolution, where is the covariance / self-energy operator and the scalar is the constant-variance shadow. The entire stability theory that makes the local laws quantitative is the analytic regularity of the subordination fixed point.

Synthesis. The foundational reason a single linearising transform organises this entire subject is that freeness is precisely the vanishing of mixed free cumulants, so the cumulants of a free sum add and the R-transform is their generating function — this is exactly the role plays for classical convolution, with the non-crossing lattice replacing the full partition lattice . Putting these together, the semicircle is to freeness what the Gaussian is to independence: each is the unique law with a single nonzero cumulant of its kind, and the free CLT, the Catalan moment count, the surviving Wigner walks, and the Kreweras-self-dual Möbius function of are one combinatorial degeneracy seen four ways. The R-transform is dual to the moment sequence through Möbius inversion, and the central insight is that asymptotic freeness makes this algebra concrete — independent matrices in random orientation realise free elements, so the spectral distribution of is , computed by adding R-transforms. The bridge to the frontier is that the deformed, covariance, and band self-consistent equations of 37.08.02 are all and made matrix-valued, generalising the scalar fixed point , and operator-valued free probability with its subordination theory is the universal form whose stability the local-law program quantifies.

Full proof set Master

The R-transform additivity, the free CLT, and the asymptotic-freeness sketch are established above. The remaining Master claims are recorded here.

Proposition (the alternating-centred condition determines all mixed moments). If are free in , then every mixed moment is a universal polynomial in the moments and .

Proof. Proceed by induction on the word length. Centre each letter: write with , and likewise for powers of . Substituting into the word and expanding multilinearly produces a sum of terms, each a product of a scalar (a product of moments ) times a (possibly shorter) word in centred letters . Any term whose centred word is alternating between the two algebras has -value by freeness. Every non-alternating centred word has two adjacent centred letters from the same algebra; their product re-expands as , strictly shortening the word. Iterating, every term is reduced either to (alternating) or to a scalar times , expressing the original mixed moment as a polynomial in the individual moments. Uniqueness is immediate since the reduction is deterministic.

Proposition (moment-cumulant formula and uniqueness of free cumulants). Given a moment sequence there is a unique sequence with for all , and conversely.

Proof. The one-block partition contributes the single term , and every other has all blocks of size , so contributes a product of with . Hence for a polynomial with integer coefficients. This is a triangular system: , and determines from recursively and uniquely. The forward direction (cumulants to moments) is the defining sum. Abstractly the inversion is Möbius inversion in the lattice with its Möbius function : , where , and .

Proposition (semicircle is the unique distribution with for ; and the arcsine free-Bernoulli convolution). The standard semicircle is the unique compactly supported law with and all other free cumulants zero. The free additive convolution of two symmetric Bernoulli laws is the arcsine law with density on .

Proof. For the first claim, if and otherwise, the moment-cumulant formula gives , which is for odd and for even — the Catalan numbers, the semicircle moments of 37.08.01; moment-determinacy of the compactly supported semicircle gives uniqueness. For the arcsine, let . Its Cauchy transform is . Inverting gives , so , whence . Then , so . Setting and solving for : , so and . Stieltjes inversion gives density ... with the sign convention , on , the arcsine law.

Proposition (free cumulants of free elements add; mixed cumulants vanish). If are free, then , and any free cumulant with at least one -argument and at least one -argument vanishes.

Proof. The vanishing of mixed cumulants is the Möbius-inverted form of freeness: by the previous proposition . When the arguments alternate between the free subalgebras, freeness forces the connected (-supported) part to cancel against the disconnected terms in the alternating sum; Speicher's theorem [Speicher 1994] shows this cancellation is exactly the vanishing of every mixed cumulant. Granting that, multilinearity gives , and only the pure- and pure- terms survive, yielding .

Connections Master

The Wigner semicircle law and the moment method 37.08.01 is the combinatorial taproot of this unit. There the surviving closed walks are counted by non-crossing pair partitions and the limiting moments are the Catalan numbers; here that same count is re-read as the moment-cumulant formula of the semicircular element, whose only free cumulant is . Free probability is the statement that the non-crossing combinatorics of 37.08.01 is not an accident of the Gaussian computation but the definition of freeness itself, and asymptotic freeness shows independent Wigner matrices realise free semicircular elements.

The Stieltjes transform and the resolvent 37.08.02 supplies the analytic transform this unit inverts. The Cauchy transform there is the object whose functional inverse, minus , is the R-transform; the self-consistent equation is exactly rearranged, and the deformed-model equation is free additive convolution in analytic dress. This unit is the algebraic explanation of why those resolvent fixed points close.

The characteristic functions and Lévy continuity theorem 37.03.01 are the classical mirror of the whole construction. Classical convolution linearises under , whose Taylor coefficients are the classical cumulants summed over the full partition lattice ; free convolution linearises under the R-transform, whose coefficients are the free cumulants summed over the non-crossing sublattice . The free CLT proved here is the verbatim analogue of the classical CLT there, with the semicircle replacing the Gaussian and replacing .

The QFT large- matrix model and topological expansion 08.14.06 meets free probability through planarity: the non-crossing partitions that index free cumulants are exactly the planar (genus-zero) ribbon-graph contractions of the large- expansion, so free independence is the probabilistic face of the planar limit. The loop equations there are the Schwinger-Dyson form of the moment-cumulant recursion here.

Historical & philosophical context Master

Dan Voiculescu introduced freeness in 1983-1985 [Voiculescu 1985] while studying the von Neumann algebras of free groups, seeking an analogue of independence adapted to the free product of operator algebras; the original motivation was the long-open isomorphism problem for free group factors, not random matrices. The R-transform and the linearisation of free additive convolution appeared in his 1986 paper [Voiculescu 1986], which constructed the additive free convolution and its linearising transform analytically through the Cauchy transform and its functional inverse.

The combinatorial reformulation — that free cumulants are the Möbius transform of moments over the lattice of non-crossing partitions, and that freeness is the vanishing of mixed free cumulants — is due to Roland Speicher [Speicher 1994], building on the non-crossing-partition lattice studied by Germain Kreweras in 1972. This recast Voiculescu's analytic theory in the language that makes the parallel with classical cumulants exact: the full partition lattice gives classical probability, its non-crossing sublattice gives free probability. The bridge back to random matrices was Voiculescu's 1991 asymptotic-freeness theorem [Voiculescu 1991], proving that independent Gaussian (and more generally unitarily invariant) random matrices become free in the large- limit, which made free probability the natural calculus for limiting spectral distributions and connected it to the semicircle law of Wigner and the combinatorics of 37.08.01.

Bibliography Master

@incollection{voiculescu1985,
  author    = {Voiculescu, Dan},
  title     = {Symmetries of some reduced free product {C*}-algebras},
  booktitle = {Operator Algebras and their Connections with Topology and Ergodic Theory},
  series    = {Lecture Notes in Mathematics},
  volume    = {1132},
  pages     = {556--588},
  publisher = {Springer},
  year      = {1985}
}

@article{voiculescu1986,
  author  = {Voiculescu, Dan},
  title   = {Addition of certain non-commuting random variables},
  journal = {Journal of Functional Analysis},
  volume  = {66},
  number  = {3},
  pages   = {323--346},
  year    = {1986}
}

@article{voiculescu1991,
  author  = {Voiculescu, Dan},
  title   = {Limit laws for random matrices and free products},
  journal = {Inventiones Mathematicae},
  volume  = {104},
  number  = {1},
  pages   = {201--220},
  year    = {1991}
}

@article{speicher1994,
  author  = {Speicher, Roland},
  title   = {Multiplicative functions on the lattice of non-crossing partitions and free convolution},
  journal = {Mathematische Annalen},
  volume  = {298},
  number  = {4},
  pages   = {611--628},
  year    = {1994}
}

@book{nicaspeicher2006,
  author    = {Nica, Alexandru and Speicher, Roland},
  title     = {Lectures on the Combinatorics of Free Probability},
  series    = {London Mathematical Society Lecture Note Series},
  volume    = {335},
  publisher = {Cambridge University Press},
  year      = {2006}
}

@book{vdn1992,
  author    = {Voiculescu, Dan V. and Dykema, Ken J. and Nica, Alexandru},
  title     = {Free Random Variables},
  series    = {CRM Monograph Series},
  volume    = {1},
  publisher = {American Mathematical Society},
  year      = {1992}
}

@book{mingospeicher2017,
  author    = {Mingo, James A. and Speicher, Roland},
  title     = {Free Probability and Random Matrices},
  series    = {Fields Institute Monographs},
  volume    = {35},
  publisher = {Springer},
  year      = {2017}
}