46.06.02 · information-theory / network-information

Broadcast Channel: Degraded Broadcast Capacity and Marton's Inner Bound

shipped3 tiersLean: none

Anchor (Master): Cover & Thomas 2006 Elements of Information Theory 2e (Wiley) §15.6-15.7; Bergmans 1973 Random coding theorem for broadcast channels with degraded message sets; Gallager 1974 Capacity and coding for degraded broadcast channels; Marton 1979 A coding theorem for the discrete memoryless broadcast channel; El Gamal & Kim 2011 Network Information Theory Ch. 8

Intuition Beginner

A television tower broadcasts a signal. Some viewers have rooftop antennas (good reception) and others have indoor antennas (poor reception). The tower wants to send different programs to each group. How should it encode the signal?

This is the broadcast channel: one transmitter, multiple receivers with different channel qualities. The transmitter must design a single signal that carries information for all receivers simultaneously.

The key insight is superposition coding. The transmitter sends a "cloud center" codeword that carries the message for the worse receiver. Embedded within each cloud is a "satellite" codeword that carries the additional message for the better receiver. The worse receiver can decode the cloud center but not the satellite (its channel is too noisy). The better receiver can decode both.

Think of it as a two-layer cake. The base layer is coarse information that everyone can receive. The top layer is fine-grained information that only the best receivers can access. The transmitter builds both layers into a single signal, and each receiver extracts what its channel quality allows.

For the degraded broadcast channel — where one receiver's channel is a degraded version of the other's — the capacity region is known exactly. It is achieved by superposition coding, and the converse follows from the degradedness condition.

For the general (non-degraded) broadcast channel, the capacity region is not fully known. Marton's inner bound, based on binning correlated auxiliary codewords, is the best known achievable region, but no matching outer bound has been proved.

Visual Beginner

Figure: superposition coding. A grid of "cloud center" codewords , each surrounded by a cluster of "satellite" codewords . The worse receiver decodes the cloud center . The better receiver decodes both and the satellite index .

Component Encoding Decoded by worse RX? Decoded by better RX?
Cloud center Base-layer message Yes Yes
Satellite Enhancement-layer message No (too noisy) Yes

Worked example Beginner

A binary broadcast channel: the transmitter sends . Receiver 1 sees through a BSC with crossover probability 0.1 (good channel). Receiver 2 sees which is through an additional BSC with crossover probability 0.2 (degraded worse channel).

The degradedness: is a noisier version of . The effective channel to receiver 2 is a BSC with crossover .

Superposition coding: the transmitter chooses an auxiliary (cloud center) at rate for receiver 2, and a refinement (satellite) at rate for receiver 1. The achievable rates satisfy and .

At one extreme: send only to receiver 1 at rate bits/use. At the other: send only to receiver 2 at rate bits/use. The trade-off: more rate to one receiver means less to the other.

Check your understanding Beginner

Formal definition Intermediate+

A two-user discrete memoryless broadcast channel has input alphabet , output alphabets , and transition probabilities .

Definition (Broadcast code). A broadcast code consists of:

  1. An encoder mapping the message pair to a channel input.
  2. Two decoders: and .

Definition (Degraded broadcast channel). A broadcast channel is degraded if there exists a channel such that . Physically: is a noisy version of .

Theorem (Bergmans 1973, Gallager 1974). The capacity region of the degraded broadcast channel is:

Key theorem with proof Intermediate+

Theorem (Degraded broadcast achievability). The superposition coding rate region is achievable.

Proof. Codebook. Fix and . Generate cloud center codewords by drawing i.i.d. from . For each , generate satellite codewords by drawing i.i.d. from for each position, conditioned on .

Encoding. To send messages , transmit .

Decoder 2 (worse receiver). Find such that . This succeeds with high probability if .

Decoder 1 (better receiver). Find such that . This succeeds if (sum-rate) and (identify the correct cloud). Since is better than , , so the binding constraint for the cloud is the worse receiver's: .

The net rate for receiver 1 is . Combined with , this gives the achievable region.

Bridge. The broadcast channel capacity region builds toward the relay channel 46.06.03 by providing the downlink component: the source-to-relay-and-destination link is a broadcast channel, and its capacity region constrains how much information can reach both nodes simultaneously. The result appears again in the interference channel 46.06.04 where dirty-paper coding strategies from the broadcast channel are applied at each transmitter to pre-cancel cross-interference. The foundational reason superposition coding works is that the degradedness condition ensures the worse receiver's optimal strategy (decode the cloud center) is a subset of the better receiver's strategy (decode cloud and satellite). This is exactly the nesting property that makes the achievable region tight: the converse uses the degradedness to establish that no other coding scheme can improve on superposition. Putting these together, the broadcast channel is the dual of the multiple-access channel 46.06.01 and the central insight is that layered encoding matches the layered channel quality, with each receiver extracting the layers its channel can support.

Exercises Intermediate+

Lean formalization Intermediate+

Mathlib does not define broadcast channels, superposition coding, or Marton's inner bound. The degraded broadcast capacity region requires layered codebook structures and the degradedness condition for the converse. Marton's inner bound involves correlated auxiliary variables with binning constraints. None of this is formalized. This unit ships without formalization.

Advanced results Master

The Gaussian broadcast channel

The two-user Gaussian broadcast channel , with is degraded. The capacity region is:

for some . The parameter splits the power: fraction for the cloud center (receiver 2's message) and for the satellite (receiver 1's additional message). The sum-rate is maximized by choosing to balance the two rates.

This extends to users by successive refinement: the transmitter splits power into layers, and each receiver decodes all layers up to its channel quality.

The capacity region for more than two receivers

For the -user degraded broadcast channel , the capacity region is:

where , , and forms a Markov chain. Each carries the message for receiver , and the layered structure ensures each receiver can decode all layers above it.

For non-degraded broadcast channels with more than two receivers, even Marton's inner bound is difficult to compute, and the gap between inner and outer bounds grows with .

The broadcast channel with common and private messages

The broadcast channel can carry both common messages (decoded by all receivers) and private messages (decoded by individual receivers). The capacity region for the degraded case with common message and private messages is:

The common message is encoded in the cloud center, and the private message for receiver 1 is encoded in the satellite. This model captures the scenario where some information must be received by all users (e.g., emergency broadcasts) while other information is user-specific.

Synthesis. The broadcast channel is the dual of the multiple-access channel 46.06.01: one sender to multiple receivers instead of multiple senders to one receiver. The central insight is that superposition coding matches the layered quality structure of degraded channels, with each receiver extracting the layers its channel can support. For the degraded case, the Bergmans-Gallager theorem establishes the exact capacity region via superposition coding with a matching converse that uses the degradedness condition. For the general case, Marton's inner bound using correlated auxiliary codewords with binning provides the best known achievable region, and the foundational reason it exceeds superposition is that correlated (rather than nested) codebooks can exploit the specific structure of non-degraded channels. The result builds toward the relay channel 46.06.03 where the broadcast component constrains information flow, and the interference channel 46.06.04 where dirty-paper coding from the broadcast setting manages cross-interference. Putting these together, the broadcast channel capacity region is the second major multi-user rate region (after the MAC) and the interplay between superposition coding and Marton's binning illustrates the transition from known to unknown capacity regions in network information theory.

Full proof set Master

Proposition (Degraded broadcast converse). For the degraded broadcast channel , any achievable rate pair satisfies and for some .

Proof. Define . By Fano's inequality:

By degradedness, depends on which depends on . Csiszar's identity gives:

Single-letterize with uniform on : where .

For : . By the Markov chain and the independence :

Single-letterize: .

Connections Master

  • 46.06.01 — The broadcast channel is the dual of the MAC: one sender to many receivers versus many senders to one receiver. The capacity regions have complementary structures.
  • 46.03.01 — The point-to-point channel capacity is the broadcast channel with one receiver; superposition reduces to standard channel coding.
  • 46.05.03 — Dirty-paper coding achieves the Gaussian broadcast channel capacity, using the Gelfand-Pinsker binning technique to pre-cancel interference between users.
  • 46.06.03 — The relay channel has a broadcast sub-component (source to relay and destination) whose capacity constrains the overall achievable rate.
  • 46.06.04 — The interference channel uses broadcast-like strategies at each transmitter; the Han-Kobayashi bound combines rate-splitting with dirty-paper coding.

Historical & philosophical context Master

Tom Cover introduced the broadcast channel in "Broadcast Channels" (IEEE Trans. IT-18, 1972, 2-14). Cover conjectured the superposition coding region for the degraded case and posed the general capacity problem. The degraded case was resolved by Bergmans (1973) for achievability and Gallager (1974) for the converse, establishing the superposition coding region as tight.

Katalin Marton established the best known inner bound for the general broadcast channel in "A Coding Theorem for the Discrete Memoryless Broadcast Channel" (IEEE Trans. IT-25, 1979, 306-311). Marton's bound uses correlated auxiliary codewords with binning and remains unimproved after more than four decades, making the general broadcast channel capacity one of the longest-standing open problems in network information theory.

The Gaussian broadcast channel was resolved by Bergmans (1974) and Cover (1972), who showed that superposition coding with power splitting achieves the capacity region. The extension to MIMO broadcast channels via dirty-paper coding was completed by Yu and Cioffi (2004) and Weingarten, Steinberg, and Shamai (2006), establishing DPC as the capacity-achieving strategy.

El Gamal and Kim's 2011 textbook Network Information Theory (Cambridge) provides the definitive treatment, with the broadcast channel occupying an entire chapter.

Bibliography Master

@article{cover1972,
  author  = {Cover, T. M.},
  title   = {Broadcast Channels},
  journal = {IEEE Transactions on Information Theory},
  volume  = {IT-18},
  pages   = {2--14},
  year    = {1972},
}
@article{bergmans1973,
  author  = {Bergmans, P. P.},
  title   = {Random Coding Theorem for Broadcast Channels with Degraded Message Sets},
  journal = {IEEE Transactions on Information Theory},
  volume  = {IT-19},
  pages   = {197--207},
  year    = {1973},
}
@article{marton1979,
  author  = {Marton, K.},
  title   = {A Coding Theorem for the Discrete Memoryless Broadcast Channel},
  journal = {IEEE Transactions on Information Theory},
  volume  = {IT-25},
  pages   = {306--311},
  year    = {1979},
}
@book{cover-thomas2006,
  author    = {Cover, T. M. and Thomas, J. A.},
  title     = {Elements of Information Theory},
  edition   = {2nd},
  publisher = {Wiley},
  year      = {2006},
}
@book{elgamal-kim2011,
  author    = {El Gamal, A. and Kim, Y.-H.},
  title     = {Network Information Theory},
  publisher = {Cambridge University Press},
  year      = {2011},
}