First generation hybrids often exhibit an increase in size, growth rate, and yield. This hybrid vigour or heterosis has been exploited by plant and animal breeders since Darwin’s time, but its genetic basis remains controversial [
37]. The dominance hypothesis, which has enjoyed long theoretical support, posits that deleterious recessive alleles are complemented in hybrids by fitter alleles from the alternate parent, generating an increase in vigour. In contrast, the overdominance hypothesis attributes hybrid vigour to the synergistic interactions of alleles at a heterozygous locus. However, it is difficult to distinguish true overdominance from the reciprocal complementation of deleterious alleles at linked loci (pseudo-overdominance), leading to scepticism about the former’s importance[
38]. More recent hypotheses include the possibility that heterosis is caused by synergistic interactions among alleles at different loci (epistasis) or by non-additive changes in gene expression [
39,
40]. However, the latter hypothesis is best interpreted as a possible molecular mechanism underlying classical genetic models [
41].
Recent gene mapping and expression studies support a pluralist explanation for heterosis. Dominance and overdominance are most frequently implicated by QTL studies, with epistasis reported less frequently [
37]. Although QTL studies cannot rule out pseudo-overdominance, the preferential association of overdominant QTLs with heterotic phenotypes in tomato [
42], and the demonstration of heteroic effects of the
erecta mutant in
Arabidopsis thaliana [
43], are consistent with true overdominance. Less progress has been made toward determining the molecular mechanism(s) underlying heterosis. While non-additive gene expression is common in hybrids, it has not yet been linked to heterotic phenotypes. Also, non-additive gene expression may sometimes result from mis-expression in hybrids rather than synergistic interactions among alleles [
44,
45]. Lastly, studies in maize and rice suggest that small-scale duplications and deletions may contribute to heterosis via the complementation of deleted loci [
46].
Although heterosis may play an important role in the establishment of asexual or allopolyploid hybrids [
47], its effects are diminished in later generation hybrid segregants such as introgressive lineages or homoploid hybrid species due to increasing homozygosity. Here, success depends on the fixation of favourable new gene combinations from the two species [
48]. For example, there are suggestions that new hybrid gene combinations facilitated critical ecological changes in several recently proposed hybrid species, including sculpins [
49],
Rhagoletis flies [
50], and butterflies [
51,
52*]. In these cases, species of hybrid origin have colonized novel habitats, most likely through the expression of transgressive traits. Transgressive segregation, in which hybrids have more extreme trait values than either parent, can occur when parental species contain alleles with opposing effects. For example, a recent study in irises documented that although the upland
Iris brevifolia cannot tolerate flooding, the introgression of its alleles into the flood-tolerant
Iris fulva increases
fulva’s survival [
53].
The most detailed analysis of the evolutionary forces responsible for fixing favored combinations of parental alleles or chromosomal segments in hybrids focused on recombination in the homoploid hybrid sunflowers [
31]. Analysis revealed that selection on ecological traits had slightly higher power than selection for fertility when predicting hybrid genomic composition, although both forms of selection were significant. Also, simulation studies suggest that while reproductive isolation between the recombinant hybrid species and the parental species arose in a few generations, the complete elimination of interspecific chromosomal polymorphism required several hundred generations [
14]. The genomes of animal species of hybrid origin have received little attention as yet, so the factors determining their composition are unknown.
Progress is also being made toward understanding the molecular mechanisms underlying phenotypic variation in hybrids [
54**]. For example, comparison of flowering time in synthetic tetraploids of
Arabidopsis arenosa and
A. thaliana revealed that while the autotraploids flower early, the synthetic allotetraploid plants flower late, mimicking the late flowering of the natural allotetraploid between the same two parents. The late flowering phenotype results from complementation of reciprocally down-regulated loci in the two parental species, as well as epigenetic changes, which in turn correlate with histone acetylation and methylation. These changes brought about by hybridization likely have important fitness consequences. Early flowering plants may escape drought while late flowering plants may be more reliably pollinated and may have more resources to allocate to flowering. In addition, the shift in flowering time results in an immediate reproductive barrier between allotetraploid and its parental species.