19.06.02 · eco-evo-bio / speciation

Reinforcement, reproductive isolation, and alternatives to the biological species concept

stub3 tiersLean: nonepending prereqs

Anchor (Master): Coyne, J. A. & Orr, H. A. — Speciation (2004)

Intuition Beginner

Speciation is the process by which one species splits into two. For this to happen, reproductive barriers must evolve that prevent the two groups from interbreeding. These barriers can act before mating — different mating seasons, different courtship songs, different habitats — or after mating — hybrid offspring that are sterile or cannot survive.

When two populations that have started to diverge come back into contact, they may produce hybrids. If those hybrids are unfit, natural selection favours individuals that avoid mating with the other group. This process is called reinforcement: selection against hybridisation strengthens the pre-mating barriers, pushing the two groups further apart. The name comes from the idea that selection "reinforces" the separation that geography or ecology started.

Not everyone agrees on what exactly defines a "species." The biological species concept says species are groups that can interbreed and produce fertile offspring. But this does not work for organisms that reproduce asexually, or for fossils. The phylogenetic species concept defines species as the smallest group sharing a unique common ancestor. The ecological species concept defines them by the niche they occupy. Each concept captures something real but none is perfect.

Visual Beginner

Two populations of tree frogs diverge in separate valleys. When a corridor opens and they meet again, their hybrids are unhealthy. Males with calls that are distinctly different from the other species attract more females of their own kind and produce more surviving offspring. Over generations, the calls diverge further — not because of drift, but because natural selection penalises hybridisers.

Worked example Beginner

The Drosophila pseudoobscura and D. persimilis species pair provides one of the clearest demonstrations of reinforcement. These two fruit fly species overlap in western North America. In laboratory experiments, Coyne and Orr (1989, 1997) measured two things for multiple species pairs: the strength of pre-mating isolation (whether females choose conspecific males) and the strength of post-mating isolation (whether hybrids survive and are fertile).

They found a striking pattern. For species pairs that live in the same geographic area (sympatric), pre-mating isolation was much stronger than post-mating isolation at the same genetic distance. For species pairs that live in different areas (allopatric), pre-mating isolation was weaker relative to post-mating isolation. The interpretation: in sympatry, selection against hybridisation has strengthened pre-mating barriers beyond what drift alone would produce. This is the hallmark of reinforcement.

Step 1. Two Drosophila species diverge in allopatry, accumulating post-zygotic incompatibilities through the Dobzhansky-Muller mechanism.

Step 2. They come into secondary contact. Hybrids have reduced fitness.

Step 3. Females that discriminate against heterospecific males produce more viable offspring. Selection favours increased mate discrimination.

Step 4. Over generations, pre-mating isolation increases disproportionately in sympatric populations compared to allopatric ones.

Check your understanding Beginner

Formal definition Intermediate+

Reproductive isolation: classification

Reproductive barriers fall into two classes, each with several subtypes ^{[Coyne & Orr 2004]}.

Prezygotic barriers prevent hybrid zygote formation:

Ecological (habitat) isolation: populations occupy different microhabitats, reducing encounter rates. Rhagoletis flies on different host plants meet predominantly on their own host.
Temporal isolation: populations breed at different times. Hyla tree frog species calling in different months in the same pond.
Behavioural (courtship) isolation: divergent mating signals or preferences prevent cross-attraction. Drosophila species-specific courtship songs and wing vibrations.
Mechanical isolation: reproductive structures are physically incompatible. Lock-and-key genital morphology in many insect groups.
Gametic isolation: sperm and egg are molecularly incompatible. Sea urchin species with species-specific bindin proteins on sperm.

Postzygotic barriers reduce hybrid fitness after zygote formation:

Hybrid inviability: $F_{1}$ zygotes fail to develop or die before reproductive age. Lethal epistatic interactions between parental genomes.
Hybrid sterility: $F_{1}$ adults are viable but sterile. Haldane's rule: when one sex is affected, it is the heterogametic sex (XY in mammals, ZW in birds).
Hybrid breakdown: $F_{2}$ or later-generation hybrids have reduced fitness even when $F_{1}$ hybrids are vigorous. Recessive incompatibilities exposed by segregation.

The total reproductive isolation between two populations is the cumulative product of all barriers acting sequentially:

R I_{total} = 1 - i = 1 \prod n (1 - R I_{i}),

where $R I_{i}$ is the isolation contributed by the $i$ -th barrier in the sequence. A prezygotic barrier acting early in the sequence reduces the number of matings that later barriers need to block.

Reinforcement

Reinforcement (the Wallace-Dobzhansky effect) is the evolution of strengthened prezygotic isolation driven by natural selection against hybridisation ^{[Dobzhansky 1937]}. The conditions for reinforcement are:

Two populations have diverged sufficiently to produce hybrids with reduced fitness.
The populations are in sympatry or parapatry (geographic contact permits hybridisation).
There is heritable variation in mate preference or mating traits.
The fitness cost of hybridisation exceeds any cost of increased choosiness.

Reinforcement predicts reproductive character displacement: greater divergence in mating traits and preferences in sympatric populations than in allopatric populations of the same species pair. This pattern is the primary empirical test of reinforcement.

The biological species concept (BSC)

Mayr (1942): "Species are groups of actually or potentially interbreeding natural populations which are reproductively isolated from other such groups." The BSC defines species by the process of gene exchange — species are dynamic populations maintained by gene flow and separated from other species by reproductive barriers.

Alternative species concepts

The phylogenetic species concept (PSC) defines a species as the smallest diagnosable cluster of organisms within which there is a parental pattern of ancestry and descent, or equivalently, the smallest monophyletic group on a phylogenetic tree. Strengths: applicable to asexual organisms and fossils. Weaknesses: tends to over-split (recognises many "species" that interbreed); monophyly depends on sampling and character choice.

The ecological species concept (Van Valen 1976) defines a species as a lineage occupying a unique adaptive zone — a distinctive ecological niche maintained by stabilising selection against intermediate forms. Strengths: directly connects species identity to natural selection; explains why species persist despite gene flow. Weaknesses: niche boundaries are often unclear; some species occupy broad or overlapping niches.

The cohesion species concept (Templeton 1989) defines a species as the most inclusive group of organisms having the potential for genetic and/or demographic exchangeability. Genetic exchangeability: the ability to share genes through reproduction. Demographic exchangeability: the ability to occupy the same ecological and demographic niche. Strengths: accommodates partial gene flow; explicitly separates genetic from ecological cohesion. Weaknesses: operationalising "exchangeability" is difficult in practice.

The genotypic cluster concept (Mallet 1995) defines species as groups forming distinct clusters in multivariate genetic or phenotypic space, separated by gaps with few individuals. Strengths: operational and testable with genetic data; accommodates hybrid zones. Weaknesses: cluster boundaries depend on the markers and statistical methods used.

Counterexamples to common slips

Reinforcement is not the only process that strengthens prezygotic isolation. Ecological divergence, sexual selection, and drift can all strengthen prezygotic barriers independently. The signature of reinforcement is specifically greater prezygotic isolation in sympatry than allopatry — not just strong prezygotic isolation per se.
The BSC is not universally accepted. It fails for asexual organisms, fossils, partially interbreeding species complexes, and ring species. No single species concept works for all taxa.
Reproductive isolation is not an all-or-nothing property. Partial isolation ( $0 < R I < 1$ ) is the normal condition during speciation. The BSC's requirement of "reproductive isolation" is a continuous threshold, not a discrete boundary.

Evidence pattern Intermediate+

The Coyne-Orr compilation: Drosophila

The most comprehensive test of reinforcement comes from Coyne and Orr's (1989, 1997) analysis of reproductive isolation across over 100 Drosophila species pairs ^{[Coyne & Orr 2004]}. They scored prezygotic isolation (mate discrimination in no-choice and choice trials) and postzygotic isolation (hybrid viability and fertility) for each pair and classified pairs as sympatric or allopatric based on geographic ranges.

The key result: at any given level of genetic distance (measured by allozyme or DNA sequence divergence), sympatric pairs showed significantly stronger prezygotic isolation than allopatric pairs. Postzygotic isolation, by contrast, did not differ between sympatric and allopatric pairs at the same genetic distance. This pattern is exactly what reinforcement predicts: selection in sympatry strengthens pre-mating barriers beyond the baseline set by drift, while post-mating barriers accumulate at the same rate regardless of geography.

The data also revealed that prezygotic isolation in sympatric pairs reaches near-completeness ( $R I > 0.95$ ) at lower genetic distances than postzygotic isolation. In allopatric pairs, postzygotic isolation accumulates first and prezygotic isolation lags behind. This reversal in sympatry is the clearest signature of reinforcement in a comparative dataset.

Reproductive character displacement in tree frogs

Hoskin et al. (2005 Nature 437, 1353-1356) documented reinforcement in Australian rainforest frogs of the genus Litoria. L. genimaculata and L. nannotis co-occur in some rainforest streams but not others. In sympatric populations, male advertisement calls are more divergent in pulse rate and dominant frequency than in allopatric populations. Female preference experiments confirmed that sympatric females are more discriminating — they reject heterospecific calls at higher rates than allopatric females. Critically, the degree of call divergence correlates with the probability of hybridisation: where the species overlap broadly and hybridisation risk is highest, call divergence is greatest.

Dobzhansky-Muller incompatibilities: the genetic substrate

Reinforcement requires postzygotic isolation as its selective driver. The Dobzhansky-Muller model explains how this postzygotic isolation arises ^{[Dobzhansky 1937]}. An ancestral population fixed for alleles $A_{1}$ and $B_{1}$ at two loci splits. Population 1 fixes $A_{2}$ (substituting for $A_{1}$ ); population 2 fixes $B_{2}$ (substituting for $B_{1}$ ). Neither substitution is deleterious in its own genetic background. But the hybrid combination $A_{2} B_{2}$ has never been tested by selection and may be incompatible, causing hybrid dysfunction through negative epistasis.

The fitness decomposition makes the epistatic nature explicit:

w (A_{2} B_{2}) = w (A_{1} B_{1}) + Δ w_{A} + Δ w_{B} + ϵ_{A_{2} B_{2}},

where $Δ w_{A}$ and $Δ w_{B}$ are the individual fitness effects of each substitution (both $\geq 0$ in their own backgrounds) and $ϵ_{A_{2} B_{2}} < 0$ is the epistatic incompatibility term. This term is invisible to selection within either pure population because the $A_{2} B_{2}$ combination never arises there.

The Orr (1995) snowball result shows that if each population accumulates substitutions at rate $α$ per generation and each cross-population pair has probability $c$ of being incompatible, the expected number of incompatibilities grows as $E [I (t)] = c α^{2} t^{2}$ . This quadratic growth provides the substrate upon which reinforcement acts: as incompatibilities accumulate, the fitness cost of hybridisation increases, strengthening selection for prezygotic isolation.

Haldane's rule

Haldane's rule (1922): when in the $F_{1}$ offspring of two animal species one sex is absent, rare, or sterile, that sex is the heterogametic sex (XY males in mammals and Drosophila; ZW females in birds and butterflies).

The dominance theory (Turelli and Orr 1995) explains Haldane's rule through the interaction of DM incompatibilities with sex-chromosome dosage. Many DM incompatibility alleles are partially recessive. In the homogametic sex (XX), a recessive incompatible allele on one X chromosome is masked by the dominant compatible allele from the other species. In the heterogametic sex (XY), the single X chromosome is hemizygous — any incompatible recessive allele is fully exposed. The result is disproportionate hybrid dysfunction in the heterogametic sex.

The dominance theory also predicts the large X effect: the X chromosome contributes disproportionately to reproductive isolation per locus compared to autosomes. In Drosophila, the X chromosome represents approximately 20% of the genome but carries roughly 50% of identified speciation genes. This is because X-linked incompatible alleles are immediately exposed in the heterogametic sex, giving them a larger phenotypic effect per locus.

Exercises Intermediate+

Exercise 3 (medium, multiple choice).

Haldane's rule states that in $F_{1}$ hybrids, if one sex is affected by sterility or inviability, it is the heterogametic sex. The dominance theory explains this through:

A. Mitochondrial-nuclear incompatibilities B. X-linked recessive incompatibilities exposed in the hemizygous sex C. Autosomes evolving faster than sex chromosomes D. Polyploid chromosome missegregation

Hint

Consider what is different about gene expression in XY versus XX genotypes for alleles on the X chromosome.

Answer

B. In the heterogametic sex (XY), the single X chromosome is expressed hemizygously — any recessive incompatible allele on the X is fully exposed without a masking partner. In the homogametic sex (XX), the same allele would be masked by the dominant allele from the other species' X. This asymmetry produces Haldane's rule.

Exercise 4 (medium, short answer).

Explain why reinforcement predicts stronger prezygotic isolation in sympatric populations than in allopatric populations of the same species pair.

Hint

What selective pressure exists in sympatry but not in allopatry?

Answer

In sympatry, individuals that mate with the other species produce unfit hybrids, wasting reproductive effort. Natural selection favours individuals with stronger mate discrimination because they produce more surviving offspring. In allopatry, the two species never meet, so there is no selection against hybridisation — prezygotic isolation evolves only as a byproduct of drift or pleiotropy, not as an adaptation to avoid hybridisation. The prediction of greater prezygotic isolation in sympatry than allopatry is called reproductive character displacement.

Exercise 7 (hard, short answer).

Explain why reinforcement is most effective when postzygotic isolation is moderate ( $R I \approx 0.5 - 0.8$ ) rather than very weak or very strong.

Hint

Consider the selective pressure at each extreme: if hybrids are nearly as fit as pure offspring, what drives selection for assortative mating? If hybrids are already extremely rare, what is there to reinforce?

Answer

When postzygotic isolation is very weak ( $R I \approx 0$ ), hybrids have nearly normal fitness, so the selective advantage of avoiding hybridisation is negligible — there is little fitness benefit to stronger prezygotic isolation. When postzygotic isolation is very strong ( $R I \approx 1$ ), hybrids are already extremely rare, so the opportunity for selection to act on assortative mating is minimal — there are almost no hybridisation events to penalise. Reinforcement is most effective at intermediate levels of postzygotic isolation because the fitness cost of hybridisation is large enough to generate strong selection, and hybridisation is frequent enough for selection to have variation to act upon.

Exercise 8 (hard, symbolic).

In a simple reinforcement model, let $s$ be the selection coefficient against hybrids (measuring postzygotic isolation), $a$ be the strength of assortative mating (where $a = 0$ is random mating and $a = 1$ is complete assortment), and $m$ be the migration rate between populations. The change in assortative mating per generation under selection against hybridisation is approximately

Δ a \approx \frac{s \cdot a ( 1 - a )}{1 - s ( 1 - a ) ^{2}} .

For $s = 0.5$ and $m = 0.01$ , find the equilibrium value of $a$ and determine whether reinforcement can overcome gene flow to maintain prezygotic isolation.

Hint

At equilibrium, $Δ a = 0$ or the increase from reinforcement balances the decrease from gene flow. Solve $Δ a = 0$ for $a$ .

Answer

Setting $Δ a = 0$ : either $a = 0$ (random mating, unstable), $a = 1$ (complete assortment, stable), or we consider the balance with gene flow. The approximate equilibrium accounting for gene flow is where $s \cdot a (1 - a) \approx m \cdot a$ , giving $s (1 - a) \approx m$ , so $a^{*} \approx 1 - m / s = 1 - 0.01/0.5 = 0.98$ . Since $a^{*}$ is close to 1, reinforcement under these parameters nearly completes prezygotic isolation. The condition for reinforcement to overcome gene flow is $s > m$ : selection against hybrids must exceed the homogenising effect of migration. With $s = 0.5 ≫ m = 0.01$ , reinforcement easily prevails.

Exercise 9 (hard, short answer).

Explain the conceptual difference between reinforcement and ecological speciation as mechanisms generating prezygotic isolation. Why might both produce reproductive character displacement, and how could you distinguish their contributions empirically?

Hint

Reinforcement is driven by selection against hybrids. Ecological speciation is driven by adaptation to different niches. Both can strengthen prezygotic barriers in sympatry.

Answer

Reinforcement strengthens prezygotic isolation as a direct adaptation to avoid producing unfit hybrids — selection acts on mate preference because heterospecific matings are wasteful. Ecological speciation strengthens prezygotic isolation as a byproduct of adaptation to different ecological niches — divergent habitat preference, foraging behaviour, or phenology incidentally reduce interbreeding. Both predict greater prezygotic isolation in sympatry, but the traits involved differ. Reinforcement primarily affects mating signals and preferences (courtship songs, colour patterns, pheromones). Ecological speciation primarily affects habitat use, foraging traits, and breeding timing. To distinguish them: (a) test whether mating-trait divergence is correlated with ecological divergence (suggesting ecological speciation) or with hybrid fitness (suggesting reinforcement); (b) compare sympatric and allopatric populations where ecology is similar but hybridisation risk differs — reinforcement predicts divergence only where hybridisation is possible.

Reinforcement theory, speciation genetics, and species concept alternatives Master

Reinforcement theory: population-genetic models

The verbal argument for reinforcement — selection favours assortative mating when hybrids are unfit — is intuitive, but its population-genetic feasibility was debated for decades. The core difficulty is that reinforcement requires the simultaneous evolution of two things: (a) increased assortative mating (a preference trait) and (b) a mating signal on which preference can act. Both must be heritable, and both must evolve together under the indirect selection generated by hybrid unfitness.

Servedio (2004 Evolution 58, 1675-1685) showed that reinforcement can work under realistic parameter values, but its effectiveness depends critically on the genetic architecture of mate choice. If female preference and male signal are controlled by separate loci, reinforcement is effective when the preference locus is linked to a locus under divergent ecological selection — linkage creates a "magic trait" where ecological adaptation and assortative mating co-evolve. If preference and signal are controlled by the same locus (self-referent mate choice, where individuals prefer mates resembling themselves), reinforcement is even more effective because no linkage is required.

Servedio and Noor (2003 Annu. Rev. Ecol. Evol. Syst. 34, 339-364) synthesised theoretical and empirical work on reinforcement and identified three conditions favouring reinforcement: (a) moderate postzygotic isolation — strong enough to generate selection but weak enough that hybrids are still produced; (b) heritable variation in both mating signals and preferences; (c) low to moderate gene flow, so that assortative mating alleles are not swamped by immigration. Reinforcement fails when gene flow is very high ( $m > s$ , where $s$ is selection against hybrids) because migration continually introduces non-assortative mating alleles faster than selection can increase assortative ones.

The mathematical framework for reinforcement dynamics typically models two populations connected by migration at rate $m$ , each with a quantitative mating trait $z$ and a preference function $ψ$ . Hybrids have fitness $1 - s$ relative to pure individuals. The change in mean preference $\overset{ˉ}{ψ}$ under reinforcement is approximately

Δ \overset{ˉ}{ψ} \approx G_{ψ} β_{ψ},

where $G_{ψ}$ is the additive genetic variance in preference and $β_{ψ}$ is the selection gradient on preference generated by the fitness cost of hybrid matings. The gradient $β_{ψ}$ is proportional to $s$ (selection against hybrids) and to the frequency of hybrid matings, which depends on $m$ and the current level of assortment. The dynamics produce a positive feedback: as assortment increases, fewer hybrids are produced, but the fitness cost per hybrid mating remains high. Reinforcement can go to completion ( $a \to 1$ ) if $G_{ψ}$ is maintained and $s > m$ .

Speciation genetics: Dobzhansky-Muller incompatibilities

The Dobzhansky-Muller model is the theoretical backbone of speciation genetics. Its central insight is that reproductive isolation arises from epistatic incompatibilities between loci that diverged independently in allopatric populations. No fitness valley is crossed in either population — each substitution is neutral or beneficial in its own genetic background. The incompatibility appears only in the hybrid combination.

The molecular identity of several DM incompatibility genes has been established. In Drosophila, Hmr (Hybrid male rescue) and Lhr (Lethal hybrid rescue) interact across species to cause hybrid male lethality via misregulation of heterochromatin. OdsH (Odysseus-related homeobox) causes hybrid male sterility between D. simulans and D. mauritiana. In mice, Prdm9 (a meiotic recombination hotspot specifier) is the strongest-acting hybrid sterility gene: alleles from different subspecies interact to cause asymmetric failure of meiotic synapsis in $F_{1}$ males, with the zinc-finger domain evolving under some of the fastest positive selection rates known in mammals.

Haldane's rule and the large X effect

Haldane's rule — the heterogametic sex is disproportionately affected in $F_{1}$ hybrids — is one of the most robust generalisations in speciation genetics. The dominance theory (Turelli and Orr 1995) explains it through the interaction of partially recessive DM incompatibilities with sex-chromosome hemizygosity. In the heterogametic sex (XY males in mammals, ZW females in birds), the single X or Z chromosome is expressed without a masking partner. Any recessive incompatible allele on the X is fully exposed. In the homogametic sex (XX or ZZ), the same allele would be heterozygous and masked.

The large X effect — the X chromosome contributes disproportionately to reproductive isolation per locus — follows directly. X-linked loci have a larger phenotypic effect on hybrid fitness because they are hemizygously expressed in the heterogametic sex. In Drosophila, the X chromosome carries approximately 50% of identified speciation genes despite representing only about 20% of the genome. The large X effect has been confirmed in mice (Mus musculus subspecies), birds (Ficedula flycatchers), and mosquitoes (Anopheles).

Chromosomal speciation

Chromosomal rearrangements — inversions, translocations, fusions, and fissions — can contribute to reproductive isolation by suppressing recombination between arrangements. A paracentric inversion (a chromosome segment flipped 180 degrees) in heterozygous condition produces a crossover suppression loop at meiosis: crossovers within the inverted region generate dicentric and acentric chromatids in gametes, which are inviable. The result is that the inverted and standard arrangements are effectively locked together as a single inheritance unit — genes within the inversion co-segregate and cannot recombine onto the alternative arrangement.

The speciation role of inversions is indirect. Inversions do not themselves cause hybrid sterility or inviability (paracentric inversions in heterokaryotypes produce some aneuploid gametes but many normal ones). Instead, inversions protect groups of co-adapted alleles from being broken up by recombination with the alternative arrangement. When divergent selection acts on multiple loci within an inversion, the suppressed recombination allows the entire block to diverge as a unit, even in the face of gene flow.

Empirical support comes from Drosophila pseudoobscura, where chromosomal inversions are strongly associated with climatic adaptation and reproductive isolation between populations. The third chromosome of D. pseudoobscura carries multiple inversions (Standard, Arrowhead, Chiricahua, Pikes Peak, etc.) that vary in frequency along latitudinal clines. Laboratory populations with different inversions show partial reproductive isolation, and the inversion differences are maintained by selection despite gene flow at collinear regions of the genome. In Anopheles gambiae (the malaria mosquito complex), inversions on chromosome 2L differentiate the M and S molecular forms — partially isolated incipient species that share the same geographic range.

Hybrid zone dynamics and tension zones

Hybrid zones — geographic regions where two genetically distinct populations meet, mate, and produce hybrids — are natural laboratories for studying reinforcement and reproductive isolation ^{[Coyne & Orr 2004]}.

A tension zone (Key 1968 Evolution 22, 252-280) is a hybrid zone maintained by a balance between dispersal (which brings the two forms into contact) and selection against hybrids (which removes them). The width of a tension zone is

w = σ \frac{8}{s},

where $σ$ is the root-mean-square dispersal distance per generation and $s$ is the selection coefficient against hybrids. Tension zones are dynamically stable: they move slowly or not at all, and their width reflects the balance of dispersal and selection. If reinforcement operates within a tension zone, prezygotic isolation should strengthen over time, narrowing the zone beyond what dispersal-selection balance alone predicts.

The Bombina (fire-bellied toad) hybrid zone in Eastern Europe is one of the best-studied tension zones. B. bombina (the fire-bellied toad) and B. variegata (the yellow-bellied toad) meet in a narrow zone (a few kilometres wide) stretching across Central Europe. The zone width is consistent with the tension zone model given measured dispersal rates and hybrid fitness. However, within the zone, assortative mating is stronger than expected from habitat preference alone, suggesting that reinforcement has increased prezygotic isolation beyond the ecological baseline.

Empirical evidence for reinforcement beyond Drosophila

Three-spined sticklebacks (Gasterosteus aculeatus). In BC, Canada, limnetic and benthic stickleback species pairs in postglacial lakes are reproductively isolated by body size, habitat preference, and female preference for male nuptial colour. The two forms evolved within the last 10,000 years from a common marine ancestor. Sympatric populations show stronger assortative mating based on body size than allopatric populations of the same ecotypes, consistent with reinforcement. Rundle et al. (2000 Science 287, 306-308) showed that female benthic sticklebacks from lakes with limnetics are more discriminating than females from allopatric benthic populations, and the degree of discrimination correlates with the risk of hybridisation.

Chrysoperla green lacewings. Henry et al. (1999 Evolution 53, 1165-1178) documented reproductive character displacement in North American lacewings of the Chrysoperla carnea species complex. These insects use species-specific substrate-borne vibration songs for mate attraction. In sympatric populations where multiple species co-occur, songs are more divergent in frequency and duration than in allopatric populations. Playback experiments confirmed that females from sympatric populations are more discriminating, rejecting heterospecific songs at higher rates.

Ring species and the speciation continuum

Ring species provide spatial demonstrations of speciation in progress. The greenish warbler (Phylloscopus trochiloides) forms a ring around the Tibetan Plateau: populations spread northward along two routes and meet in Siberia, where the terminal populations show strong reproductive isolation despite being connected by a chain of interbreeding populations. Irwin et al. (2001) demonstrated that song complexity increases gradually along both branches, driven by sexual selection, and the divergence between terminal populations is sufficient to prevent interbreeding.

Ring species are relevant to species concept debates because they demonstrate that reproductive isolation can be a continuous, cumulative process with no discrete boundary between "same species" and "different species." The BSC struggles with ring species: if adjacent populations interbreed, they are "the same species," but the terminal populations are reproductively isolated and function as separate species. This paradox supports the view that species occupy a continuum of divergence rather than falling into discrete categories.

Cryptic species

Cryptic species are reproductively isolated populations that are morphologically similar or indistinguishable. They are common in groups where mate recognition is based on non-visual cues (song, pheromones, electrosensory signals). The malaria mosquito Anopheles gambiae complex contains at least seven cryptic species that are nearly identical morphologically but reproductively isolated and behaviourally distinct (different breeding habitats, feeding preferences, and biting times). Cryptic species challenge morphological taxonomy and support the BSC's emphasis on reproductive isolation over appearance. They also challenge the ecological species concept, because cryptic species often occupy overlapping niches.

Genomic islands of speciation

Whole-genome sequencing of incipient species pairs reveals genomic islands of divergence: regions of elevated differentiation ( $F_{S T} > 0.5$ ) interspersed with regions of low differentiation ( $F_{S T} < 0.05$ ). This heterogeneous pattern indicates that speciation proceeds via divergence at a subset of loci under strong divergent selection while the rest of the genome homogenises through gene flow.

The width of a genomic island around a selected locus scales as $σ / s$ , where $σ$ is the dispersal distance and $s$ is the selection coefficient. Strong selection produces narrow, sharp islands; weak selection produces broad, shallow ones. In Heliconius butterflies, genomic islands contain the wing-colour-pattern genes (optix, WntA, cortex) that control both predator avoidance (Mullerian mimicry) and mate choice — a "magic trait" architecture where ecological selection and sexual selection act on the same loci. In Ficedula flycatchers, genomic islands are enriched for Z-linked loci (consistent with the large X/Z effect) and for loci involved in plumage colour and song, the primary mating signals.

Species concept synthesis

No single species concept is universally applicable. The BSC works well for sexually reproducing animals but fails for asexual taxa and fossils. The PSC applies universally but tends to over-split. The ecological species concept connects species identity to natural selection but struggles with niche overlap. The cohesion concept is theoretically elegant but operationally difficult.

The speciation-continuum view suggests that "species" is a label applied to a point on a continuous process of divergence, rather than a discrete natural kind. Populations diverge from $R I = 0$ to $R I = 1$ through the progressive accumulation of prezygotic and postzygotic barriers. Partial isolation at intermediate stages is the normal condition. Under this view, the choice of species concept determines where along the continuum the "species" threshold is drawn, but the underlying process is the same regardless of the concept used.

The practical importance of species concepts extends beyond taxonomy. Conservation law (the US Endangered Species Act) defines protection in terms of "species" and "distinct population segments." Different species concepts can lead to different conservation decisions: the BSC might protect two interbreeding populations as one species, while the PSC might recognise them as two, each receiving separate protection. Biological control programmes, biodiversity surveys, and public health (cryptic Anopheles species with different vector competence) all depend on species delimitation, making the choice of concept consequential.

Connections Master

Speciation — allopatric and sympatric 19.06.01. This unit extends the speciation framework by going deeper into reinforcement as a specific mechanism for completing reproductive isolation upon secondary contact. The DM model, Haldane's rule, and the species concept alternatives introduced in 19.06.01 are developed here with greater theoretical and empirical detail.
Natural selection 19.03.01. Reinforcement is natural selection acting on mate preference as a function of hybrid fitness. The selection coefficients, fitness landscapes, and adaptive dynamics of 19.03.01 provide the mechanistic substrate upon which reinforcement operates.
Sexual selection 19.03.02. Reinforcement often acts on the same traits that sexual selection shapes — courtship songs, colour patterns, pheromones. The interaction between sexual selection (which can drive divergence) and reinforcement (which strengthens existing divergence) is central to understanding how prezygotic isolation evolves in sympatry.
Genetic drift 19.04.01. DM incompatibilities accumulate through drift in allopatric populations, providing the postzygotic isolation substrate upon which reinforcement acts. The snowball model's assumption of a neutral molecular clock is a drift-driven substitution process.
Quantitative genetics 19.05.01. Reinforcement models treat mate preference and mating signals as quantitative traits with heritable variation. The breeder's equation predicts the rate at which preference mean shifts under selection against hybridisation.
Phylogenetics 19.07.01. Species concepts determine the operational units that phylogenetic methods reconstruct. The PSC defines species by monophyly, making phylogenetic analysis directly relevant to species delimitation. The timing and mode of speciation events inferred from phylogenies test the predictions of reinforcement theory.

Historical & philosophical context Master

The concept of reinforcement has a complex history. Alfred Russel Wallace (1889 Darwinism) was the first to suggest that natural selection could strengthen reproductive isolation by penalising hybridisation, though he did not develop the idea formally. Dobzhansky (1937 Genetics and the Origin of Species) ^{[Dobzhansky 1937]} articulated the modern concept: when hybrids have reduced fitness, selection favours mechanisms that prevent their formation. He called this process "reinforcement" of isolation.

Blair (1955) provided early empirical support through studies of mating-call divergence in sympatric versus allopatric populations of Microhyla frogs, finding greater call divergence where species co-occurred. But the theoretical feasibility of reinforcement was challenged by Moore (1957 Evolution 11, 443-444) and later by Paterson (1978 Annu. Rev. Ecol. Syst. 9, 429-449), who argued that the genetic correlation between mating signals and preferences was too weak for reinforcement to overcome gene flow. Paterson's alternative — the specific-mate-recognition system — proposed that prezygotic isolation evolves as a byproduct of adaptation to local signalling environments, not as an adaptation to avoid hybridisation.

The theoretical deadlock was broken by Liou and Price (1994 Am. Nat. 144, 311-322) and Servedio (2004), who showed that reinforcement can work under realistic genetic architectures, particularly when mate preference and ecological traits are linked ("magic traits"). Coyne and Orr's (1989, 1997, 2004) comparative studies of Drosophila provided the decisive empirical evidence: sympatric pairs consistently show stronger prezygotic isolation than allopatric pairs at the same genetic distance.

The species problem has deeper philosophical roots. Darwin himself avoided defining "species" precisely, treating species as arbitrarily separated points on a continuum of variation. The Modern Synthesis codified the BSC as the operational standard, but critics noted its limitations from the start. The rise of molecular phylogenetics (1990s-2000s) made the PSC increasingly operational, while genomic data revealed pervasive gene flow between "species," challenging the BSC's assumption of reproductive isolation as an all-or-nothing boundary. The speciation-continuum view, supported by genomic data from Heliconius, Ficedula, and sticklebacks, represents a return to Darwin's insight: species are real but their boundaries are fuzzy, because speciation is a process, not an event.

The species problem remains open in the philosophy of biology. Debates centre on whether "species" is a natural kind (a category with defining properties), an individual (a concrete historical entity), or a pragmatic convention (a useful label for conservation and communication). The BSC treats species as process-defined entities (maintained by gene flow), the PSC treats them as history-defined entities (defined by monophyly), and the ecological concept treats them as selection-defined entities (maintained by niche differentiation). Each captures a real biological property, but none captures all of them simultaneously.

Bibliography Master

@book{Dobzhansky1937,
  author = {Dobzhansky, Theodosius},
  title = {Genetics and the Origin of Species},
  publisher = {Columbia University Press},
  year = {1937},
}

@book{Mayr1942,
  author = {Mayr, Ernst},
  title = {Systematics and the Origin of Species},
  publisher = {Columbia University Press},
  year = {1942},
}

@article{Haldane1922,
  author = {Haldane, J. B. S.},
  title = {Sex Ratio and Unisexual Sterility in Hybrid Animals},
  journal = {Proceedings of the Royal Society of London B},
  volume = {99},
  year = {1922},
  pages = {405--414},
}

@article{TurelliOrr1995,
  author = {Turelli, Michael and Orr, H. Allen},
  title = {The Dominance Theory of Haldane's Rule},
  journal = {Genetics},
  volume = {140},
  year = {1995},
  pages = {389--402},
}

@book{CoyneOrr2004,
  author = {Coyne, Jerry A. and Orr, H. Allen},
  title = {Speciation},
  publisher = {Sinauer Associates},
  year = {2004},
}

@article{Servedio2004,
  author = {Servedio, Maria R.},
  title = {The Evolution of Premating Isolation: Local Adaptation and Natural and Sexual Selection Against Hybrids},
  journal = {Evolution},
  volume = {58},
  year = {2004},
  pages = {1675--1685},
}

@article{ServedioNoor2003,
  author = {Servedio, Maria R. and Noor, Mohamed A. F.},
  title = {The Role of Reinforcement in Speciation: Theory and Data},
  journal = {Annual Review of Ecology, Evolution, and Systematics},
  volume = {34},
  year = {2003},
  pages = {339--364},
}

@article{Hoskin2005,
  author = {Hoskin, Conrad J. and Higgie, Megan and McDonald, Keith R. and Moritz, Craig},
  title = {Reinforcement Drives Rapid Allopatric Speciation},
  journal = {Nature},
  volume = {437},
  year = {2005},
  pages = {1353--1356},
}

@article{Rundle2000,
  author = {Rundle, Howard D. and Nagel, L. and Boughman, Janette W. and Schluter, Dolph},
  title = {Natural Selection and Parallel Speciation in Sympatric Sticklebacks},
  journal = {Science},
  volume = {287},
  year = {2000},
  pages = {306--308},
}

@article{Key1968,
  author = {Key, Kenneth H. L.},
  title = {The Concept of Stasipatric Speciation},
  journal = {Systematic Zoology},
  volume = {17},
  year = {1968},
  pages = {14--22},
}

@article{Irwin2001,
  author = {Irwin, Darren E. and Irwin, Jessica H. and Price, Trevor D.},
  title = {Ring Species as Bridges Between Microevolution and Speciation},
  journal = {Genetica},
  volume = {112--113},
  year = {2001},
  pages = {223--243},
}

@article{VanValen1976,
  author = {Van Valen, Leigh},
  title = {Ecological Species, Multispecies, and Oaks},
  journal = {Taxon},
  volume = {25},
  year = {1976},
  pages = {233--239},
}

@article{Templeton1989,
  author = {Templeton, Alan R.},
  title = {The Meaning of Species and Speciation: A Genetic Perspective},
  journal = {Speciation and Its Consequences},
  year = {1989},
  pages = {3--27},
}

@article{Mallet1995,
  author = {Mallet, James},
  title = {A Species Definition for the Modern Synthesis},
  journal = {Trends in Ecology and Evolution},
  volume = {10},
  year = {1995},
  pages = {294--299},
}

@book{FutuymaKirkpatrick2017,
  author = {Futuyma, Douglas J. and Kirkpatrick, Mark},
  title = {Evolution},
  edition = {4th},
  publisher = {Sinauer Associates},
  year = {2017},
}

@book{HartlClark2007,
  author = {Hartl, Daniel L. and Clark, Andrew G.},
  title = {Principles of Population Genetics},
  edition = {4th},
  publisher = {Sinauer Associates},
  year = {2007},
}