Abstract
Comparative genome analyses of eukaryotic pathogens including fungi and oomycetes have revealed extensive variability in genome composition and structure. The genomes of individuals from the same population can exhibit different numbers of chromosomes and different organization of chromosomal segments, defining so-called accessory compartments that have been shown to be crucial to pathogenicity in plant-infecting fungi. This high level of structural variation confers a methodological challenge for population genomic analyses. Variant discovery from population sequencing data is typically achieved using established pipelines based on the mapping of short reads to a reference genome. These pipelines have been developed, and extensively used, for eukaryote genomes of both plants and animals, to retrieve single nucleotide polymorphisms and short insertions and deletions. However, they do not permit the inference of large-scale genomic structural variation, as this task typically requires the alignment of complete genome sequences. Here, we compare traditional variant discovery approaches to a pipeline based on de novo genome assembly of short read data followed by whole genome alignment, using simulated data sets with properties mimicking that of fungal pathogen genomes. We show that the latter approach exhibits levels of performance comparable to that of read-mapping based methodologies, when used on sequence data with sufficient coverage. We argue that this approach further allows additional types of genomic diversity to be explored, in particular as long-read third-generation sequencing technologies are becoming increasingly available to generate population genomic data.
Introduction
Comparative genome studies of fungal and oomycete pathogens have revealed highly variable genome architecture and content [reviewed by Raffaele and Kamoun, 2012; Möller and Stukenbrock, 2017]. The genome size and ploidy level of pathogenic fungi and oomycetes can vary significantly between individuals of the same species. Differences can be attributed to the dynamics of transposable elements, chromosome instability, and genome compartmentalization (Möller and Stukenbrock, 2017). Fungal genomes are known to contain accessory compartments that are thought to be relevant for rapid evolution of phytopathogens [reviewed by Croll and McDonald, 2012; Möller and Stukenbrock, 2017]. Typically, these compartments contain a lower density of genes than the core genome, and have a higher content of repetitive elements (Coleman et al., 2009; Ma et al., 2010). Rapidly evolving genome compartments were shown, in some species, to encode virulence determinants (e.g. Does et al., 2016). However, in spite of their functional importance, it is challenging to analyze genetic variation in these regions due to the high extent of structural variability of the genomic sequences.
Population genomic datasets based on next generation sequencing (NGS) can be used to recover genomic variants such as single nucleotide polymorphisms (SNPs), insertions and deletions (indels), and structural variants (SVs). The latter category includes translocations, inversions, duplications, either tandem or interspersed, deletions, and novel sequence insertions (Alkan et al., 2011). Two different frameworks are traditionally used for the detection of variants (Mahmoud et al., 2019). Firstly, a reference-based approach, whereby short read data generated from NGS is mapped on a reference genome, is used to recover SNPs and short indel variants (Horner et al., 2010; El-Metwally et al., 2013). Secondly, from whole genome alignments based on de novo assembled genomes. The recovery of small structural variants from short read mapping makes use of mapping distance and orientation information of the reads, as well as read depth and pair-end discordance (Chen et al., 2009; Rausch et al., 2012; Layer et al., 2014). State-of-the-art methods further use a local assembly of the identified inserted material (e.g. (McKenna et al., 2010; Rimmer et al., 2014). Conversely, recovery of large-scale structural variants is typically achieved by first assembling individual genomes, which are then combined into a whole genome alignment (WGA) (Tian et al., 2018). The WGA enables the accurate location of large indels (typically larger than 3 kb) (Nattestad and Schatz, 2016; Tian et al., 2018).
While typically used to compare distinct species, if applied at the population level, WGAs potentially provide a crucial resource to conduct population genomic analyses in species with a significant proportion of structural variation since they can, in principle, capture both large and small variants (Faino et al., 2016). However, methods for calling variants in populations from WGAs are currently limited and the available approaches have not been benchmarked with fungal genome data. In this study, we take the first step to compare variant discovery approaches for population genomic analyses of fungal pathogen genomes. We assess the accuracy of a pipeline based on de novo genome assembly followed by whole genome alignment (referred to as dnWGA, Figure 1) to simultaneously recover single nucleotide polymorphisms (SNPs) and large structural variants.
FIGURE 1
Comparisons of methods for genome assembly and variant calling have so far been performed on human data or simulated data sets with human-like properties (Hwang et al., 2015; Wu et al., 2017; Bian et al., 2018). Several studies reported that the performance of SNP callers depends on the sequence complexity, coverage, and read filtering criteria used (Hwang et al., 2015; Sandmann et al., 2017). In particular, most variant calling pipelines have trouble accurately determining variants in repeat rich regions (Krusche et al., 2019). Reference based variant calling and dnWGA approaches can be compared using simulated data sets, for which the “true” set of variants is known (Wu et al., 2017). The resulting called positions can be subsequently classified into one of four categories: (1) correctly identified variant positions [true positives (TP)], (2) correctly identified non-variant positions [true negatives (TN)], (3) variants incorrectly called in non-variant positions [false positives (FP)], and (4) variable positions that were not identified by the calling method [false negatives (FN)] (Rosner, 2006). The proportion of variants falling in each of these categories allows to compute several measures of performance (Goutte and Gaussier, 2005). Hereby “precision” is defined as the proportions of correctly inferred positives (TP/(TP + FP)), while the “recall” measure denotes the proportion of variable positions that were recovered (TP/(TP + FN)). Like many classification procedures, most variant calling methods are subject to a trade-off between precision (the higher the precision value, the more confident we can be in the prediction), and recall (the higher the recall value, the more exhaustive the variant discovery is). The performance of a given method along this trade-off can be captured by the F1 score, defined as the harmonic mean of the precision and recall values:
The F1 score is, therefore, a global measure of the reliability of the variant discovery method (Goutte and Gaussier, 2005).
Several studies have demonstrated that the data used for benchmarking of variant callers is critical (e.g. Hwang et al., 2015; Sandmann et al., 2017; Wu et al., 2017; Bian et al., 2018). Notably, human population genomic data have been considered producing well-defined benchmarking tools, including the “Genome in a Bottle” project that has published a set of high-confidence variants for a reference genome (see1 : Hwang et al., 2015). Since fungal pathogen genomes differ from human genomes in many aspects, we here aimed to compare variant calling approaches on data sets specifically mimicking the characteristics of fungal pathogen genomes, including accessory genome compartments and high nucleotide diversity.
Method Overview
To compare the performance of dnWGA and reference-based mapping for variant calling, we generated population genomic data sets from chromosomal sequences of two fungal plant pathogens, Cercospora beticola and Zymoseptoria tritici using simulations (see Supplementary Methods for a detailed description of methods and materials). We selected these two different species with distinct repeat content, since repeats are known to hamper the variant calling process. While the C. beticola chromosome was virtually deprived of repeats (0.2% of 5.8 Mb) (de Jonge et al., 2018), a comparatively high proportion [11% of 6.2 Mb (Grandaubert et al., 2015)] is annotated in the chromosome of Z. tritici. We employed the chromosomes to simulate a population genomic data set that resembled empirical population genomic data. The genetic diversity of the simulated populations, measured by Watterson’s theta, was 0.0077 and 0.0073 for C. beticola and Z. tritici, respectively (Watterson, 1975). The simulated population data sets comprised SNPs, indels, and accessory genome segments at known positions allowing us to evaluate the variant recovery (Figure 1).
We simulated NGS reads from the simulated genomes with both low (25X) and high (100X) sequencing coverage. To compare the efficacy of SNP discovery methods on each of the four data sets (two species, and two depths of coverage), we computed the recall, precision, and F1 scores in each case. We further assess whether the large SV were properly recovered by the dnWGAs. Details on the data generation and analyses are provided in the Supplementary Text.
Results and Discussion
While WGAs are used to infer structural variation, how well they can recover single-nucleotide variation has not been systematically tested in fungi. We first set out to compare the performance of SNP recovery of dnWGA and reference-based approaches. We specifically ask how the sequencing depth and repeat content of the genomes affect the relative performance of the two methods: the F1 score of the reference-based approach was found to be higher than 99.7% for both Z. tritici and C. beticola, at low (25X) and high (100X) coverage. The F1 score of the dnWGA approach, however, depends on the sequence depth and the species (Figure 2A). When using high coverage data, the F1 score in both species reaches 99.9%. When low coverage sequencing was used, however, the F1 score was found to be similarly high (99.9%) for C. beticola, but only 43% for the Z. tritici data set. This effect is essentially due to the precision getting as low as 28%, while the recall value remains comparatively high (93%), suggesting that the false positive rate is high for the repeat rich chromosome with low sequencing coverage (Supplementary Table S1).
FIGURE 2
We further investigated the drop of performance at low coverage of the dnWGA approach in the repeat-rich Z. tritici data set by comparing the genome assemblies. N50 was equal to 219 kb with the 100X data set, but only 12 kb when using a 25X read depth (Supplementary Tables S2, S3). In comparison, the de novo assemblies of the C. beticola chromosomes showed a comparable N50 of 1.8 Mb and 1.7 Mb at 100X and 25X, respectively (Supplementary Tables S4, S5) underlining the impact of high repeat content in Z. tritici on chromosome assemblies. We used Quast (Gurevich et al., 2013) to further quantify the accuracy of the assembled genomes and identify misassemblies, defined as regions of the de novo assemblies that did not align to the original chromosome at the correct positions. In the repeat poor C. beticola data set, the number of misassemblies remained comparable for both sequencing depths. For the Z. tritici data set, however, we find four times more misassemblies in the 25X than in the 100X data. Therefore, we conclude that the low performance of the dnWGA procedure at low sequencing coverage is essentially due to failure of de novo assembling the chromosome sequences in the presence of a higher repeat content.
We then investigated whether the dnWGA approach could recover the simulated accessory regions. Such regions should appear in the WGA as synteny blocks that do not contain the reference sequence. We extracted such synteny blocks from the WGA and compared their size and sequence to the known introduced regions to identify false and true positives. In the C. beticola alignment, the accessory regions were recovered entirely as single regions and in all the chromosomes they were introduced into (Figure 2B). The accessory regions introduced in the Z. tritici chromosomes could be recovered with a similar level of quality at a depth of 100X. Conversely, at 25X, all recovered insertions were fragmented, but 542 out of the 580 kb inserted (93%) were recovered (Figure 2B). False positive regions (non-reference DNA fragments that did not match with the introduced sequences in all WGA) were also detected in all data sets, with a total size ranging from 15 kb to 116 kb per WGA. These regions were found to be comparatively small, and more abundant in the repeat-rich Z. tritici data set. In summary, we find that dnWGA allows the recovery of accessory regions in population genomic datasets. For genomes with a low frequency of repeats high performance is achieved even with low coverage data, while high coverage data is required in the presence of repeats.
Perspective
The genomes of eukaryote pathogens including fungi and oomycetes can comprise extensive structural variation such as accessory regions, not found in reference genomes. So far, methods to analyze genetic variation in populations of individuals with different genome content and structure are sparse. Whole genome alignment of de novo assembled genomes permits the joint analysis of genetic variation ranging from single nucleotide substitutions to large structural variation. We here show that SNPs can be called from WGAs with a precision similar to that of mapping-based approaches when sufficient sequencing coverage is achieved. We note that with our benchmark based on fungal data, the performance of the dnWGA approach was higher than what was observed in previous comparisons performed on human datasets, where the precision and recall were 87 and 50% at 20X, and 93 and 56% at 50X (Wu et al., 2017). Moreover, the dnWGA approach also allowed us to recover accessory chromosome fragments, genomic features that were shown to occur frequently in fungal genomes. The computational framework based on de novo assembled genomes, therefore, also potentially allows for the analyses of genome segments encoding orphan genes, the comparison of highly dynamic genome compartments, the detection of accessory chromosomes, and the study of repeat dynamics within a population.
In genomes with high frequencies of SVs and accessory regions, the use of dnWGA allows for reference-based mapping to be skipped entirely for variant discovery. However, current methods based on WGA are computationally more demanding than reference-based mapping approaches. As assembly algorithms are improving in quality and efficiency, fostered by the development of long-read sequencing technologies, whole genome alignment constitutes the next methodological challenge. Current state-of-the-art methods are designed for interspecific comparisons and relatively small sample sizes (typically less than 100 genomes). As such, they are not sized to cope with population genomic data sets, for which mechanisms such as recombination can no longer be ignored and prohibits the use of a single guide tree when aligning multiple genomes. The average higher similarity of genomes from a single species, however, should permit more efficient alignment algorithms. A new generation of genome aligners is, therefore, needed to exploit the full potential of long-read sequencing technologies to characterize genome variation in populations.
Statements
Data availability statement
Raw data and scripts necessary to reproduce the analyses are available at https://gitlab.gwdg.de/alice.feurtey/variant-discovery-methods and doi: 10.5281/zenodo.3696563.
Author contributions
LP and AF carried out the implementation of the framework with input from JD. LP analyzed the data and wrote the manuscript with input from all authors. JD and ES conceived the study and were in charge of overall direction and planning.
Funding
This work was supported by the International Max Planck Research School (IMPRS) and the German Research Foundation (DFG) SPP1819. Research of ES is furthermore supported by the Canadian Institute of Advanced Research (CIFAR).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmicb.2020.00626/full#supplementary-material
References
1
AlkanC.CoeB. P.EichlerE. E. (2011). Genome structural variation discovery and genotyping.Nat. Rev. Genet.12363–376.
2
BianX.ZhuB.WangM.HuY.ChenQ.NguyenC.et al (2018). Comparing the performance of selected variant callers using synthetic data and genome segmentation.BMC Bioinformatics19:429. 10.1186/s12859-018-2440-7
3
ChenK.WallisJ. W.McLellanM. D.LarsonD. E.KalickiJ. M.PohlC. S.et al (2009). BreakDancer: an algorithm for high-resolution mapping of genomic structural variation.Nat. Methods6677–681. 10.1038/nmeth.1363
4
ColemanJ. J.RounsleyS. D.Rodriguez-CarresM.KuoA.WasmannC. C.GrimwoodJ.et al (2009). The genome of Nectria haematococca: contribution of supernumerary chromosomes to gene expansion.PLoS Genet.5:e1000618. 10.1371/journal.pgen.1000618
5
CrollD.McDonaldB. A. (2012). The accessory genome as a cradle for adaptive evolution in pathogens.PLoS Pathog.8:e1002608.
6
de JongeR.EbertM. K.Huitt-RoehlC. R.PalP.SuttleJ. C.SpannerR. E.et al (2018). Gene cluster conservation provides insight into cercosporin biosynthesis and extends production to the genus Colletotrichum.Proc. Natl. Acad. Sci. U.S.A.115E5459–E5466.
7
DoesH. C.van der FokkensL.YangA.SchmidtS. M.LangereisL.LukasiewiczJ. M.et al (2016). Transcription factors encoded on core and accessory chromosomes of Fusarium oxysporum induce expression of effector genes.PLoS Genet.12:e1006401. 10.1371/journal.pgen.1006401
8
El-MetwallyS.HamzaT.ZakariaM.HelmyM. (2013). Next-Generation sequence assembly: four stages of data processing and computational challenges.PLoS Comput. Biol.9:e1003345. 10.1371/journal.pcbi.1003345
9
FainoL.SeidlM. F.Shi-KunneX.PauperM.van den BergG. C. M.WittenbergA. H. J.et al (2016). Transposons passively and actively contribute to evolution of the two-speed genome of a fungal pathogen.Genome Res.261091–1100. 10.1101/gr.204974.116
10
GoutteC.GaussierE. (2005). “A probabilistic interpretation of precision, recall and f-score, with implication for evaluation,” in Advances in Information Retrieval, edsLosadaD. E.Fernández-LunaJ. M. (Berlin: Springer), 345–359.
11
GrandaubertJ.BhattacharyyaA.StukenbrockE. H. (2015). RNA-seq-Based gene annotation and comparative genomics of four fungal grass pathogens in the genus Zymoseptoria identify novel orphan genes and species-specific invasions of transposable elements.G351323–1333. 10.1534/g3.115.017731
12
GurevichA.SavelievV.VyahhiN.TeslerG. (2013). QUAST: quality assessment tool for genome assemblies.Bioinformatics291072–1075. 10.1093/bioinformatics/btt086
13
HornerD. S.PavesiG.CastrignanòT.De MeoP. D.LiuniS.SammethM.et al (2010). Bioinformatics approaches for genomics and post genomics applications of next-generation sequencing.Brief. Bioinform.11181–197. 10.1093/bib/bbp046
14
HwangS.KimE.LeeI.MarcotteE. M. (2015). Systematic comparison of variant calling pipelines using gold standard personal exome variants.Sci. Rep.5:17875. 10.1038/srep17875
15
KruscheP.TriggL.BoutrosP. C.MasonC. E.VegaF. M. D. L.MooreB. L.et al (2019). Best practices for benchmarking germline small-variant calls in human genomes.Nat. Biotechnol.37555–560. 10.1038/s41587-019-0054-x
16
LayerR. M.ChiangC.QuinlanA. R.HallI. M. (2014). LUMPY: a probabilistic framework for structural variant discovery.Genome Biol.15:R84. 10.1186/gb-2014-15-6-r84
17
MaL.-J.van der DoesH. C.BorkovichK. A.ColemanJ. J.DaboussiM.-J.Di PietroA.et al (2010). Comparative genomics reveals mobile pathogenicity chromosomes in Fusarium.Nature464367–373. 10.1038/nature08850
18
MahmoudM.GobetN.Cruz-DávalosD. I.MounierN.DessimozC.SedlazeckF. J. (2019). Structural variant calling: the long and the short of it.Genome Biol.20:246. 10.1186/s13059-019-1828-7
19
McKennaA.HannaM.BanksE.SivachenkoA.CibulskisK.KernytskyA.et al (2010). The genome analysis Toolkit: a MapReduce framework for analyzing next-generation DNA sequencing data.Genome Res.201297–1303. 10.1101/gr.107524.110
20
MöllerM.StukenbrockE. H. (2017). Evolution and genome architecture in fungal plant pathogens.Nat. Rev. Microbiol.15756–771. 10.1038/nrmicro.2017.76
21
NattestadM.SchatzM. C. (2016). Assemblytics: a web analytics tool for the detection of variants from an assembly.Bioinformatics323021–3023. 10.1093/bioinformatics/btw369
22
RaffaeleS.KamounS. (2012). Genome evolution in filamentous plant pathogens: why bigger can be better.Nat. Rev. Microbiol.10417–430. 10.1038/nrmicro2790
23
RauschT.ZichnerT.SchlattlA.StützA. M.BenesV.KorbelJ. O. (2012). DELLY: structural variant discovery by integrated paired-end and split-read analysis.Bioinformatics28i333–i339. 10.1093/bioinformatics/bts378
24
RimmerA.PhanH.MathiesonI.IqbalZ.TwiggS. R. F.WilkieA. O. M.et al (2014). Integrating mapping-, assembly- and haplotype-based approaches for calling variants in clinical sequencing applications.Nat. Genet.46912–918. 10.1038/ng.3036
25
RosnerB. A. (2006). Fundamentals of Biostatistics, 6th Edn. Belmont, CA: Thompson-Brooks/Cole.
26
SandmannS.de GraafA. O.KarimiM.van der ReijdenB. A.Hellström-LindbergE.JansenJ. H.et al (2017). Evaluating variant calling tools for non-matched next-generation sequencing data.Sci. Rep.7:43169. 10.1038/srep43169
27
TianS.YanH.KleeE. W.KalmbachM.SlagerS. L. (2018). Comparative analysis of de novo assemblers for variation discovery in personal genomes.Brief. Bioinform.19893–904. 10.1093/bib/bbx037
28
WattersonG. A. (1975). On the number of segregating sites in genetical models without recombination.Theor. Popul. Biol.7256–276.
29
WuL.YavasG.HongH.TongW.XiaoW. (2017). Direct comparison of performance of single nucleotide variant calling in human genome with alignment-based and assembly-based approaches.Sci. Rep.7:10963. 10.1038/s41598-017-10826-9
Summary
Keywords
population genomics, fungal pathogens, next-generation sequencing, genome alignment, variant calling, genome assembly
Citation
Potgieter L, Feurtey A, Dutheil JY and Stukenbrock EH (2020) On Variant Discovery in Genomes of Fungal Plant Pathogens. Front. Microbiol. 11:626. doi: 10.3389/fmicb.2020.00626
Received
01 October 2019
Accepted
19 March 2020
Published
16 April 2020
Volume
11 - 2020
Edited by
James Hane, Curtin University, Australia
Reviewed by
Gwenael Piganeau, UMR 7232 Biologie Intégrative des Organismes Marins (BIOM), France; Anne Genissel, Institut National de la Recherche Agronomique, France
Updates
Copyright
© 2020 Potgieter, Feurtey, Dutheil and Stukenbrock.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Julien Y. Dutheil, dutheil@evolbio.mpg.deEva H. Stukenbrock, estukenbrock@bot.uni-kiel.de; Stukenbrock@evolbio.mpg.de
This article was submitted to Evolutionary and Genomic Microbiology, a section of the journal Frontiers in Microbiology
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.