MINI REVIEW article

Front. Microbiol., 30 March 2023

Sec. Systems Microbiology

Volume 14 - 2023 | https://doi.org/10.3389/fmicb.2023.1163741

Trends in forensic microbiology: From classical methods to deep learning

  • 1. Department of Forensic Analytical Toxicology, China Medical University School of Forensic Medicine, Shenyang, China

  • 2. Liaoning Province Key Laboratory of Forensic Bio-Evidence Science, Shenyang, China

  • 3. Department of Forensic Pathology, China Medical University School of Forensic Medicine, Shenyang, China

Article metrics

View details

28

Citations

14,2k

Views

3,9k

Downloads

Abstract

Forensic microbiology has been widely used in the diagnosis of causes and manner of death, identification of individuals, detection of crime locations, and estimation of postmortem interval. However, the traditional method, microbial culture, has low efficiency, high consumption, and a low degree of quantitative analysis. With the development of high-throughput sequencing technology, advanced bioinformatics, and fast-evolving artificial intelligence, numerous machine learning models, such as RF, SVM, ANN, DNN, regression, PLS, ANOSIM, and ANOVA, have been established with the advancement of the microbiome and metagenomic studies. Recently, deep learning models, including the convolutional neural network (CNN) model and CNN-derived models, improve the accuracy of forensic prognosis using object detection techniques in microorganism image analysis. This review summarizes the application and development of forensic microbiology, as well as the research progress of machine learning (ML) and deep learning (DL) based on microbial genome sequencing and microbial images, and provided a future outlook on forensic microbiology.

Introduction

Microorganisms, including viruses, bacteria, and fungi, are ubiquitously distributed and form diverse and rich communities (Oliveira and Amorim, 2018). Forensic microbiology is a discipline that deals with the study of microbiology in the context of forensic investigation (Kuiper, 2016). Its applications mainly focus on the diagnosis of cause of death, inference of crime location, estimation of postmortem interval (PMI), and individual identification.

Numerous studies have explored the application of microorganisms in forensic practice. Certain specific microorganisms have been proven to contribute to the determination of various causes of death, including drowning (Lucci et al., 2008; Kakizaki et al., 2010; Tie et al., 2010; Huys et al., 2012; Lee et al., 2016, 2017; Rácz et al., 2016; Wang et al., 2020), poisoning (Butzbach, 2010; Skopp, 2010; Grad et al., 2012; Han et al., 2012; Butzbach et al., 2013; Sastre et al., 2017), and hospital-acquired infections (Klevens et al., 2007; Sodhi et al., 2013; Lax et al., 2015; Khan et al., 2017). Considering the distinctive microbial community in soil obtained from a crime scene and other intermediary sites, soil microbiome provides evidence for inferring the geolocation (Meyers and Foran, 2008; Costello et al., 2009; Jesmok et al., 2016; Habtom et al., 2019; Yang et al., 2021). Moreover, since microorganisms contribute to postmortem decomposition and have a succession that follows a predictable pattern (Hauther et al., 2015; Javan et al., 2016; DeBruyn and Hauther, 2017; Lutz et al., 2020; Scott et al., 2020), forensic researchers began to explore the feasibility of microbiome succession for inferring the postmortem interval over the past few years. Some studies used machine learning and other technologies to establish models for PMI estimation based on microorganisms, which actually improve the accuracy of PMI inference (Pechal et al., 2014; Johnson et al., 2016; Liu et al., 2020; Zou et al., 2020). In addition, the microbiome composition in humans varies in body location (Kong and Segre, 2012); host characteristics, such as sex, age, and lifestyle (Ross et al., 2017); and skin care status (Bouslimani et al., 2019). Therefore, individuals may be identified using skin, hair, and body fluid microbiomics (Lax et al., 2014; Bäckhed et al., 2015; Wu et al., 2016; Schmedes et al., 2017; Willis et al., 2018).

In this review, we aim to summarize the developmental progress of forensic microbiology from classical methods to high-throughput data combined with artificial intelligence technologies and discuss the outlook for the future.

Development of forensic microbiology

Forensic microbiology first gained global recognition in 2001 as a result of the Bacillus anthracis attacks through the USA postal service. In previous studies on forensic microbiology, forensic microbiological technologies were not specifically described, except for agar cultures for bacteria and fungi combined with PCR for certain microorganisms (Aoyagi et al., 2009; Huys et al., 2012; Uchiyama et al., 2012; Tuomisto et al., 2013; Can et al., 2014; Hauther et al., 2015; Yu et al., 2021a,b). To date, though more than 2,460 different species are presented in The Ribosomal Database Project stores (Maidak et al., 2000), most microbes in the environment have not been described and accessed for biotechnology. Few viable bacteria can be cultivated on artificial media (Kimura and Nobutada, 2006; Cecchini et al., 2012). Furthermore, traditional microbial culture highly relies on culture conditions and has limitations in the analysis of microbial community composition.

The 16/18S rRNA is the common marker for microbial classification and identification. Fluorescence in situ hybridization (FISH) (Langendijk, 1995) and denaturing gradient gel electrophoresis (DGGE) (Muyzer et al., 1993) are used to detect the specific 16S rRNA and gain access to unculturable microbes. Sanger sequencing technology (Sanger et al., 1977), also known as first-generation sequencing technology, allows for the wide use of 16S rRNA gene sequencing in bacterial taxonomy and leads to the discovery of a large number of new microbial taxa. Next-generation sequencing technology (NGS) can measure tens of thousands to millions of DNA simultaneously and can provide a high-throughput microbiome database (Metzker, 2010). With the development of sequencing technology, third-generation sequencing technology has more advantages in the study of community diversity due to its ultra-long sequencing reading (Franzén et al., 2015). However, the 16S rRNA test results are assembled into operational taxonomic units (OTUs). Most high-throughput sequencing microbiome data could not be identified and classified due to the limitation of the referenced genomes and genetic datasets (Yooseph et al., 2013; Afshinnekoo et al., 2015). Using targeted 16S rRNA with short amplifiers could not achieve reliable resolution at the species level, and full-length 16S rRNA sequences do not necessarily reduce this limitation (Forney et al., 2004). In addition, whole-genome shotgun (WGS) targets all gene content in microbial ecosystems and can differentiate microbial species and taxa to a greater extent than 16S rRNA amplicons (Schloissnig et al., 2013; Franzosa et al., 2015).

Though the expanding role of NGS and WGS combined with artificial intelligence will likely be a routine tool in forensic microbiology, the isolation, detection, and confirmation of specific microbes (pathogens or colonies) and the use of nucleic acid sequencing remain less relevant in resolving forensic challenges. Some investigators suggest the use of nanotechnology to design biosensors for the identification of foreign pathogens. Recently, microbial computer image analysis technology combined with machine learning and deep learning elucidated the identification of specific microbiomes (Ma et al., 2022). Moreover, some challenges related to standardization, validation, and procedural and bioinformatic pipelines persist in the study of forensic microbiology (Roesch et al., 2009; Lauber et al., 2010; Wu et al., 2010). Further advancements in technology will continue to improve the application of microbiology in forensic medicine. The trend in forensic microbiology is summarized in Figure 1.

Figure 1

Applications of machine learning in forensic microbiology

Establishing a prognostic model and predicting the dynamic succession of microbial communities have improved research in forensic microbiology. High-throughput microbiotic datasets combined with machine learning extend the application of microbiomes in forensic issues. Traditional statistical methods could only determine the general composition of a microbial community and its basic succession, whereas machine learning models achieve quantitative analysis and accurate prediction (Zou et al., 2020). Currently, different machine learning models, including random forest (RF), support vector machine (SVM), and AdaBoost, are used in the field of forensic microbiology, and they have become a promising strategy for several forensic events.

One main use of forensic microbiology is human individual identification (Fierer et al., 2010; Lax et al., 2015; Leake et al., 2016; Williams and Gibson, 2017; Yang et al., 2019). In cases without blood or tissue evidence, a microbiological approach provides a breakdown of situations with the detection of the microbiome on skin, saliva, hair, or objects that have been touched. UniFrac metric (Fierer et al., 2010) and hierarchical clustering (Leake et al., 2016) are used in determining skin-associated bacteria and salivary microbiomes. In an RF model used for investigating pubic hair bacteria, the accuracy of individual identification was 2.7 ± 5.8%, and the gender accuracy was 1.7 ± 5.2% (Williams and Gibson, 2017).

In addition, machine learning can be used for PMI estimation in microbial forensics (Johnson et al., 2016; Liu et al., 2020, 2021; Cao et al., 2021; Cartozzo et al., 2021; Randall et al., 2021; Zhang et al., 2021; Kaszubinski et al., 2022; Zhao et al., 2022). RF models are widely used for PMI estimation and postmortem submersion interval (PMSI) diagnosis (Metcalf et al., 2013; Pechal et al., 2014; Cartozzo et al., 2021; Randall et al., 2021; Zhang et al., 2021; Kaszubinski et al., 2022; Zhao et al., 2022). In 2013, Metcalf et al. (2013) first proposed the concept of a “microbial clock” to infer PMI by setting up regression models using an RF. In addition, artificial neural network (ANN) models are used to infer PMI based on the microbiotic OTU data. In 2020, Liu et al. combined microbial community characterization and machine learning algorithms (RF, SVM, and ANN) to investigate microbial succession patterns during corpse decomposition and estimate PMI with a mean absolute error (MAE) of 1.5 ± 0.8 h within 24 h.

Available evidence demonstrates that forensic microbiology with machine learning can be used to infer geolocation to a certain extent (McNulty et al., 2004; Kersulyte et al., 2010; Blaser et al., 2013; Nagasawa et al., 2013; Tyakht et al., 2013; Escobar et al., 2014; Li et al., 2014; Suzuki and Worobey, 2014; Huang et al., 2020). Human gut microbiota plays a significant role in geolocation inference, which is supported by correlations based on traditional statistical methods, such as Wilcoxon's rank-sum test (Suzuki and Worobey, 2014) and analysis of similarities (ANOSIM) (Escobar et al., 2014). In 2014, UniFrac, network, and ANOSIM were used to analyze the human saliva microbiome. The variance between individuals was 6.75–10.21% (Li et al., 2014). In 2020, Huang et al. (2020) applied a machine learning framework to determine geolocations with an accuracy of 86%.

As previously stated, machine learning can be used to establish models for tissue/body fluid identification (Costello et al., 2009; Benschop et al., 2012; Lopez et al., 2019, 2020; Salzmann et al., 2021). Lopez et al. (2019) used ANN to identify different human epithelial biomaterials with AUC values of 0.99, 0.99, and 1 for skin, oral, and vaginal secretions, respectively. Later in 2020, deep neural network (DNN) was additionally used to identify human forensically relevant blood samples successfully (Lopez et al., 2020).

Investigative forensic microbiology with machine learning has practical applications in other aspects. Concerns related to drowning diagnosis (Huys et al., 2012; Wang et al., 2020), postmortem toxicology (Kaszubinski et al., 2020), and disease diagnosis are summarized in Table 1. Although the expanding effect of machine learning on NGS and WGS databases is without much doubt, some models derived from different machine learning models still mean less to the actual situation, which limits their application in forensic practice. The current challenges of machine learning are insufficient training samples and an imperfect microbial databank.

Table 1

Forensic issueAnimal modelSampling locationAI modelModel performanceReferences
Human individual identification
HumanSkin, Keyboard, Smartphone screenRFAccuracy around 90%Yang et al., 2019
HumanShoes and phonesRFError ratio 3.6Lax et al., 2015
HumanSkin, computer keyboardsANOSIMUnweighted PCO1 (17%) PCO2 (6.5%)Fierer et al., 2010
Weighted PCO1 (61%) PCO2 (19%)
HumanSalivaHierarchical clusteringLeake et al., 2016
HumanHairRFIndividual 2.7% ± 5.8%Williams and Gibson, 2017
Gender 1.7% ± 5.2%
Post-mortem interval estimation
MiceCecumRFMAE 20.01 hLiu et al., 2021
MiceBrain, heart, and cecumRF, SVM, ANNMAE within 24 hLiu et al., 2020
SwineBoneRFVariation >80%Kaszubinski et al., 2022
PigBoneRFRMSE ± 104 days RibRandall et al., 2021
RMSE ± 63 days Scapulae
PigBoneRFRMSE ± 27 days RibCartozzo et al., 2021
RMSE ± 29 days Scapulae
RatOralRFR2 = 93.94%Zhao et al., 2022
RatGravesoil, rectum and skinRFMAE 1.82 days in GravesoilZhang et al., 2021
MAE 2.06 days in Rectum
HumanNasal cavity and ear canalK-neighbors regression (KNR), Ridge regression (RR), Lasso regression (LR), Elastic net regression (ENR), Random forest regression (RFR), Bayesian ridge regression (BRR)MAE ± 55ADDJohnson et al., 2016
RatCecumPartial least squares (PLS)RMSE within 9 daysCao et al., 2021
Geolocation inference
HumanGutSpearman's correlationsPositive correlation between Firmicutes abundance and latitude (ρ = 0.857, p < 0.0001)Suzuki and Worobey, 2014
Wilcoxon rank sum testNegative correlation between Bacteroidetes and latitude (ρ = −0.637, p = 0.001)
HumanGutANOSIMADONIS: R2 = 0.22, P = 0.001Escobar et al., 2014
ANOSIM: R = 0.78, P = 0.001
HumanGutANOSIMRussian and the US, Danish and Chinese groups R = 0.74, 0.50 and 0.26, respectively P = 9.999 * 10−5Tyakht et al., 2013
HumanSkinANOVA, ANOSIM, PERMANOVAUS vs. VZ; ANOSIM P < 0.001; PERMANOVA P < 0.001 for both unweighted and weighted measuresBlaser et al., 2013
HumanSalivaUniFrac, network, ANOSIMVariance between individuals: 6.75–10.21% within individuals: 89.79–93.25%Li et al., 2014
ANOSIM statistic: R = −0.0935, P-value = 0.7386
HumanSubways and urban biomesLogistic regression model with L2 regularizationAccuracy 86%Huang et al., 2020
Tissue/body fluid identification
HumanSkin, oral and vaginalANNAUC values of 0.99 for skin, 0.99 for oral, and 1 for vaginal secretionLopez et al., 2019
HumanBloodDNN0.978 for nasal bloodLopez et al., 2020
0.978 for finger-prick blood
HumanVaginaMicroarray analysis121 of the 389 probes detectedBenschop et al., 2012
HumanBlood, menstrual blood, saliva, semen, and vaginal secretionLasso regression analysis26 taxa showed high predictive value for TsDSalzmann et al., 2021
Other forensic application
Drowning diagnosis
RatSkin, cardiac blood, lung, and liverUnweighted UniFrac-based PCoAPCo1 60.27% PCo2 19.15% (skin) PCo1 52.66% PCo2 15.98% (lung) PCo1 50.52% PCo2 18.37% (blood)Wang et al., 2020
Post-mortem toxicology
HumanNose, mouth, rectum, ears, eyesBeta-dispersionCardiovascular disease and drug-related deaths correctly classified in 79%Kaszubinski et al., 2020
Microorganism image analysis
FungusCNNAccuracy 94.8%Tahir et al., 2018
BacteriaCNNAccuracy 96%Treebupachatsakul and Poomrittigul, 2019
ActinoCNN, ResNetAccuracy 80.8% to 80.1%Sajedi et al., 2019
DiatomsR-CNN, YOLOF-measure of YOLO 84%Bueno et al., 2018
DiatomsInception V3Identification rate 89.6%Zhou et al., 2019
DiatomsYOLO, SegNetSpecificity, sensitivity, precisionSalido et al., 2020
DiatomsSegNet, Mask R-CNNPrecision, sensitivity, specificityRuis-Santaquiteria et al., 2020
DiatomsCNNValidation set accuracy 97.33%Zhou et al., 2019
CyanobacteriaFast R-CNNAverage precision 0.929Baek et al., 2020
R2 value of 0.775
Soybean cyst nematode eggsCNNAverage accuracy 94.33%Akintayo et al., 2016
TuberculosisCNNPrecision 78.4%Oomman et al., 2018
Cell in bloodFaster R-CNNTotal accuracy 98%Hung et al., 2017

Applications of artificial intelligence in forensic microbiology.

Deep learning for microorganisms

Compared with machine learning, deep learning can realize automatic feature learning through advanced network structure by combining several simple modules (Lecun et al., 2015; Ma et al., 2022). The deep learning process generally needs a large amount of training data followed by the formation of suitable neural networks. Previous studies have proven that convolutional neural networks (CNNs) and their derivative models allow for accurate tissue-type classification and microbiome identification, which could further extend the diagnosis of microbially caused death and personal identification in forensic science. A recent study constructed a CNN model through micorbiome analysis to classify three different human epithelial materials of skin, oral, and vaginal origins (Lopez et al., 2019). Other researchers proposed and designed the CNN based on a system for detecting fungi, parasite ova, and bacteria (Akintayo et al., 2016; Tahir et al., 2018). The accuracy for identifying fungi, soybean cyst nematode eggs, and bacteria was 94.8% (Tahir et al., 2018), 94.33% (Akintayo et al., 2016), and 96% (Treebupachatsakul and Poomrittigul, 2019), respectively.

Recent studies have demonstrated that CNN models could differentiate bacteria and algae based on microbiome images. The application of microbial computer image analysis mainly focuses on the segmentation, clustering, classification, and counting of microorganisms (Ma et al., 2022). The CNN models based on images for microbiome identification are supported by the study of Panicker (Oomman et al., 2018), which could detect tuberculosis in microscopic sputum smear images with a precision of 78.4%. In addition, deep learning on image analysis is mainly focused on the identification of diatoms and algae, which would provide a potential strategy for the diagnosis of drowning. In 2018, Bueno et al. (2018) compared the functions of R-CNN and you only look once (YOLO) in diatom detection; the F-measure of YOLO was 84%. In 2019, Huang et al. applied and trained a CNN model based on the GoogLeNet Inception V3 architecture to identify diatoms with a validation rate of 97.33% (Zhou et al., 2019, 2020), which indicates that DL is an efficient and low-cost automated diatom detection technology. In 2020, YOLO and SegNet were compared by Salido et al. (2020). In 2020, Ruis-Santaquiteria et al. (2020) found that Mask-RCNN and SegNet models are capable of segment diatoms from the same raw images used for manual identification, without any cropping or preprocessing step. With the assistance of necessary operation systems, such as the Center for Microbial Ecology Image Analysis System (Dazzo and Niccum, 2015), image analysis of microorganisms would contribute more to forensic microbiology due to its convenience and operational speed (Ma et al., 2022).

Future outlook

Forensic microbiology is still in its infancy. Advanced technologies, such as NGS and WGS, have provided a sufficient dataset that could not be imagined previously. Further advancements in technology will continue to improve the capacity for forensic microbial investigations. In addition, artificial intelligence has promoted the technological innovation of forensic microbiology in the past decades. With the accumulation of genomic sequencing datasets and microbial images, deep learning will exert greater power in achieving better prognostic models with higher accuracy. However, there are several issues that deserve further discussion.

1. Advantages and defects of AI

Based on the current microbiota database, ML and DL have the quick and automatic capability of relatively accurate prediction compared with the conditional methods. The “black box” of AI methods would not completely and theoretically characterize the real results. Although the new algorithms of AI will shed light on microbiotic analysis for forensic purposes, the basic strategy is focused on the bigger microbiota database to promote AI to work better.

2. Key points for establishing the forensic microbiota database

Considering the variation of microbial communities, the development of a forensic microbial bank is urgently needed. The sampling and sequencing procedures of forensic microorganisms still need to be further standardized. In addition, due to the complex influence of sample types, locations, environmental factors, and postmortem changes, combining the microbiome data from the experimental animals, human samples, and certain materials from the crime scene should be considered. Investigators should carry out multi-center cooperation.

3. Microbiome combined with other methods to solve forensic problems

The selection of differential microbes by bioinformatic technologies could better disclose microbial markers. AI could establish models for predicting forensic issues. Based on the specific microbes that could characterize the different body fluids and environments, even individual identification, targeted PCR testing of the selected microorganisms could be explored to improve the efficiency and accuracy of forensic problems in future.

Statements

Author contributions

RZ and DG designed the manuscript and edited the manuscript. HY and ZiW wrote the manuscript. ZhW and FZ searched, edited, and reviewed the literature. All authors have read and commented on the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This research was supported by the National Natural Science Foundation of China (Grant No: 81971793), the Natural Science Foundation of Liaoning Province (Grant No: 2022-YGJC-74), and the Development Program of China (Grant No: 2022YFC3302002).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

  • 1

    AfshinnekooE.MeydanC.ChowdhuryS.JaroudiD.BoyerC.BernsteinN.et al. (2015). Geospatial resolution of human and bacterial diversity with city-scale metagenomics. Cell Syst.1, 7287. 10.1016/j.cels.2015.01.001

  • 2

    AkintayoA.LeeN.ChawlaV.MullaneyM.SarkarS. (2016). An end-to-end convolutional selective autoencoder approach to Soybean Cyst Nematode eggs detection. arXiv [Preprint]. arXiv: 1603.07834. 10.48550/arXiv.1603.07834

  • 3

    AoyagiM.IwadateK.FukuiK.AbeS.SakaiK.MaebashiK.et al. (2009). A novel method for the diagnosis of drowning by detection of Aeromonas sobria with PCR method. Leg. Med.11, 257259. 10.1016/j.legalmed.2009.07.003

  • 4

    BäckhedF.RoswallJ.PengY.FengQ.JiaH.Kovatcheva-DatcharyP.et al. (2015). Dynamics and stabilization of the human gut microbiome during the first year of life. Cell Host Microbe17, 690703. 10.1016/j.chom.2015.04.004

  • 5

    BaekS. S.PyoJ. C.PachepskyY.ParkY.ChoK. H. (2020). Identification and enumeration of cyanobacteria species using a deep neural network. Ecol. Indicat.115, 106395. 10.1016/j.ecolind.2020.106395

  • 6

    BenschopC. C. G.QuaakF. C. A.BoonM. E.SijenT.KuiperI. (2012). Vaginal microbial flora analysis by next generation sequencing and microarrays; can microbes indicate vaginal origin in a forensic context?Int. J. Legal Med.126, 303310. 10.1007/s00414-011-0660-8

  • 7

    BlaserM. J.Dominguez-BelloM. G.ContrerasM.MagrisM.HidalgoG.EstradaI.et al. (2013). Distinct cutaneous bacterial assemblages in a sampling of South American Amerindians and US residents. ISME J.7, 8595. 10.1038/ismej.2012.81

  • 8

    BouslimaniA.da SilvaR.KosciolekT.JanssenS.CallewaertC.AmirA.et al. (2019). The impact of skin care products on skin chemistry and microbiome dynamics. BMC Biol.17, 47. 10.1186/s12915-019-0660-6

  • 9

    BuenoG.DénizO.Ruiz-SantaquiteriaJ.OleniciA.Borrego-RamosM. (2018). “Lights and pitfalls of convolutional neural networks for diatom identification,” in Optics, Photonics and Digital Technologies for Imaging Applications (Washington, DC: SPIE). 10.1117/12.2309488

  • 10

    ButzbachD. M. (2010). The influence of putrefaction and sample storage on post-mortem toxicology results. For. Sci. Med. Pathol.6, 3545. 10.1007/s12024-009-9130-8

  • 11

    ButzbachD. M.StockhamP. C.KobusH. J.SimsD. N.ByardR. W.LokanR. J.et al. (2013). Bacterial degradation of risperidone and paliperidone in decomposing blood. J. For. Sci.58, 90100. 10.1111/j.1556-4029.2012.02280.x

  • 12

    CanI.JavanG. T.PozhitkovA. E.NobleP. A. (2014). Distinctive thanatomicrobiome signatures found in the blood and internal organs of humans. J. Microbiol. Methods106, 17. 10.1016/j.mimet.2014.07.026

  • 13

    CaoJ.LiW. J.WangY. F.AnG. S.LuX. J.DuQ. X.et al. (2021). Estimating postmortem interval using intestinal microbiota diversity based on 16S rRNA high-throughput sequencing technology. Fa Yi Xue Za Zhi37, 621626. 10.12116/j.issn.1004-5619.2020.400708

  • 14

    CartozzoC.SinghB.SwallJ.SimmonsT. (2021). Postmortem submersion interval (PMSI) estimation from the microbiome of sus scrofa bone in a freshwater lake. J. For. Sci.66, 13341347. 10.1111/1556-4029.14692

  • 15

    CecchiniF.IacuminL.FontanotM.ComiG.ManzanoM. (2012). Identification of the unculturable bacteria Candidatus arthromitus in the intestinal content of trouts using dot blot and Southern blot techniques. Vet. Microbiol.156, 389394. 10.1016/j.vetmic.2011.11.020

  • 16

    CostelloE. K.LauberC. L.HamadyM.FiererN.GordonJ. I.KnightR. (2009). Bacterial community variation in human body habitats across space and time. Science326, 16941697. 10.1126/science.1177486

  • 17

    DazzoF. B.NiccumB. C. (2015). Use of CMEIAS image analysis software to accurately compute attributes of cell size, morphology, spatial aggregation and color segmentation that signify in situ ecophysiological adaptations in microbial biofilm communities. Computation3, 7298. 10.3390/computation3010072

  • 18

    DeBruynJ. M.HautherK. A. (2017). Postmortem succession of gut microbial communities in deceased human subjects. Peerj5, 3437. 10.7717/peerj.3437

  • 19

    EscobarJ. S.KlotzB.ValdesB. E.AgudeloG. M. (2014). The gut microbiota of Colombians differs from that of Americans, Europeans and Asians. BMC Microbiol.14, 311. 10.1186/s12866-014-0311-6

  • 20

    FiererN.LauberC. L.ZhouN.McDonaldD.CostelloE. K.KnightR. (2010). Forensic identification using skin bacterial communities. Proc. Natl. Acad. Sci. U. S. A.107, 64776481. 10.1073/pnas.1000162107

  • 21

    ForneyL. J.ZhouX.BrownC. J. (2004). Molecular microbial ecology: land of the one-eyed king. Curr. Opin. Microbiol.7, 210220. 10.1016/j.mib.2004.04.015

  • 22

    FranzénO.HuJ.BaoX.ItzkowitzS. H.PeterI.BashirA. (2015). Improved OTU-picking using long-read 16S rRNA gene amplicon sequencing and generic hierarchical clustering. Microbiome3, 43. 10.1186/s40168-015-0105-6

  • 23

    FranzosaE. A.HuangK.MeadowJ. F.GeversD.LemonK. P.BohannanB. J. M.et al. (2015). Identifying personal microbiomes using metagenomic codes. Proc. Natl. Acad. Sci. U. S. A.112, E2930E2938. 10.1073/pnas.1423854112

  • 24

    GradY. H.LipsitchM.FeldgardenM.ArachchiH. M.CerqueiraG. C.FitzGeraldM.et al. (2012). Genomic epidemiology of the Escherichia coli O104:H4 outbreaks in Europe, 2011. Proc. Natl. Acad. Sci. U. S. A.109, 30653070. 10.1073/pnas.1121491109

  • 25

    HabtomH.PasternakZ.MatanO.AzulayC.GafnyR.JurkevitchE. (2019). Applying microbial biogeography in soil forensics. For. Sci. Int. Genet.38, 195203. 10.1016/j.fsigen.2018.11.010

  • 26

    HanE.KimE.HongH.JeongS.KimJ.InS.et al. (2012). Evaluation of postmortem redistribution phenomena for commonly encountered drugs. For. Sci. Int.219, 265271. 10.1016/j.forsciint.2012.01.016

  • 27

    HautherK. A.CobaughK. L.JantzL. M.SparerT. E.DeBruynJ. M. (2015). Estimating time since death from postmortem human gut microbial communities. J. For. Sci.60, 12341240. 10.1111/1556-4029.12828

  • 28

    HuangL. H.XuC. Q.YangW. X.YuR. S. (2020). A machine learning framework to determine geolocations from metagenomic profiling. Biol. Direct15, 278. 10.1186/s13062-020-00278-z

  • 29

    HungJ.RavelD.LopesS. C. P.RangelG.NeryO. A.MalleretB.et al. (2017). Applying faster R-CNN for object detection on malaria images. Confer. Comput. Vis. Pattern Recogn. Workshops2017, 808813. 10.1109/CVPRW.2017.112

  • 30

    HuysG.CoopmanV.Van VarenberghD.CordonnierJ. (2012). Selective culturing and genus-specific PCR detection for identification of Aeromonas in tissue samples to assist the medico-legal diagnosis of death by drowning. For. Sci. Int.221, 1115. 10.1016/j.forsciint.2012.03.017

  • 31

    JavanG. T.FinleyS. J.CanI.WilkinsonJ. E.HansonJ. D.TaroneA. M. (2016). Human thanatomicrobiome succession and time since death. Sci. Rep.6, 598. 10.1038/srep29598

  • 32

    JesmokE. M.HopkinsJ. M.ForanD. R. (2016). Next-generation sequencing of the bacterial 16S rRNA gene for forensic soil comparison: a feasibility study. J. For. Sci.61, 607617. 10.1111/1556-4029.13049

  • 33

    JohnsonH. R.TrinidadD. D.GuzmanS.KhanZ.ParzialeJ. V.DeBruynJ. M.et al. (2016). A machine learning approach for using the postmortem skin microbiome to estimate the postmortem interval. PLoS ONE11, 370. 10.1371/journal.pone.0167370

  • 34

    KakizakiE.KozawaS.MatsudaH.MuraokaE.UchiyamaT.SakaiM.et al. (2010). Freshwater bacterioplankton cultured from liver, kidney and lungs of a decomposed cadaver retrieved from a sandy seashore: possibility of drowning in a river and then floating out to sea. Leg. Med.12, 195199. 10.1016/j.legalmed.2010.03.008

  • 35

    KaszubinskiS. F.PechalJ. L.SmilesK.SchmidtC. J.JordanH. R.MeekM. H.et al. (2020). Dysbiosis in the dead: human postmortem microbiome beta-dispersion as an indicator of manner and cause of death. Front. Microbiol.11, 5347. 10.3389/fmicb.2020.555347

  • 36

    KaszubinskiS. F.ReceveurJ. P.NestleE. D.PechalJ. L.BenbowM. E. (2022). Microbial community succession of submerged bones in an aquatic habitat. J. For. Sci.67, 15651578. 10.1111/1556-4029.15036

  • 37

    KersulyteD.KaliaA.GilmanR. H.MendezM.HerreraP.CabreraL.et al. (2010). Helicobacter pylori from peruvian amerindians: traces of human migrations in strains from remote Amazon, and genome sequence of an amerind strain. PLoS ONE5, 5076. 10.1371/journal.pone.0015076

  • 38

    KhanH. A.BaigF. K.MehboobR. (2017). Nosocomial infections: epidemiology, prevention, control and surveillance. Asian Pac. J. Trop. Biomed.7, 478482. 10.1016/j.apjtb.2017.01.019

  • 39

    KimuraN.NobutadaS. (2006). Metagenomics: access to unculturable microbes in the environment. Microb. Environ.21, 201215. 10.1264/jsme2.21.201

  • 40

    KlevensR. M.EdwardsJ. R.RichardsC. L.HoranT. C.GaynesR. P.PollockD. A.et al. (2007). Estimating health care-associated infections and deaths in US hospitals, 2002. Public Health Rep.122, 160166. 10.1177/003335490712200205

  • 41

    KongH. H.SegreJ. A. (2012). Skin microbiome: looking back to move forward. J. Invest. Dermatol.132, 933939. 10.1038/jid.2011.417

  • 42

    KuiperI. (2016). Microbial forensics: next-generation sequencing as catalyst. Embo Rep.17, 10851087. 10.15252/embr.201642794

  • 43

    LangendijkP. S. (1995). Quantitative fluorescence in situ hybridization of Bifidobacterium spp. with genus-specific 16S rRNA-targeted probes and its application in fecal samples. Appl. Environ. Microbiol.61, 30693075. 10.1128/aem.61.8.3069-3075.1995

  • 44

    LauberC. L.ZhouN.GordonJ. I.KnightR.FiererN. (2010). Effect of storage conditions on the assessment of bacterial community structure in soil and human-associated samples. FEMS Microbiol. Lett.307, 8086. 10.1111/j.1574-6968.2010.01965.x

  • 45

    LaxS.Hampton-MarcellJ. T.GibbonsS. M.ColaresG. B.SmithD.EisenJ. A.et al. (2015). Forensic analysis of the microbiome of phones and shoes. Microbiome3, 82. 10.1186/s40168-015-0082-9

  • 46

    LaxS.SmithD. P.Hampton-MarcellJ.OwensS. M.HandleyK. M.ScottN. M.et al. (2014). Longitudinal analysis of microbial interaction between humans and the indoor environment. Science345, 10481052. 10.1126/science.1254529

  • 47

    LeakeS. L.PagniM.FalquetL.TaroniF.GreubG. (2016). The salivary microbiome for differentiating individuals: proof of principle. Microb. Infect.18, 399405. 10.1016/j.micinf.2016.03.011

  • 48

    LecunY.BengioY.HintonG. (2015). Deep learning. Nature521, 436. 10.1038/nature14539

  • 49

    LeeD.-G.YangK. E.HwangJ. W.KangH.-S.LeeS.-Y.ChoiS.et al. (2016). Degradation of kidney and psoas muscle proteins as indicators of post-mortem interval in a rat model, with use of lateral flow technology. PLoS ONE11, 557. 10.1371/journal.pone.0160557

  • 50

    LeeS. Y.WooS. K.LeeS. M.HaE. J.LimK. H.ChoiK. H.et al. (2017). Microbiota composition and pulmonary surfactant protein expression as markers of death by drowning. J. For. Sci.62, 10801088. 10.1111/1556-4029.13347

  • 51

    LiJ.QuinqueD.HorzH. P.LiM. K.RzhetskayaM.RaffJ. A.et al. (2014). Comparative analysis of the human saliva microbiome from different climate zones: Alaska, Germany, and Africa. BMC Microbiol.14, 316. 10.1186/s12866-014-0316-1

  • 52

    LiuR.GuY.ShenM.LiH.ZhangK.WangQ.et al. (2020). Predicting postmortem interval based on microbial community sequences and machine learning algorithms. Environ. Microbiol.22, 22732291. 10.1111/1462-2920.15000

  • 53

    LiuR.WangQ.ZhangK.WuH.WangG.CaiW.et al. (2021). Analysis of postmortem intestinal microbiota successional patterns with application in postmortem interval estimation. Microb. Ecol. 12, 116. 10.21203/rs.3.rs-411962/v1

  • 54

    LopezC. D.GonzalezD. M.HaasC.VidakiA.KayserM. (2020). Microbiome-based body site of origin classification of forensically relevant blood traces. For. Sci. Int. Genet.47, 2280. 10.1016/j.fsigen.2020.102280

  • 55

    LopezC. D.VidakiA.RalfA.GonzalezD. M.RadjabzadehD.KraaijR.et al. (2019). Novel taxonomy-independent deep learning microbiome approach allows for accurate classification of different forensically relevant human epithelial materials. For. Sci. Int. Genet.41, 7282. 10.1016/j.fsigen.2019.03.015

  • 56

    LucciA.CampobassoC. P.CirnelliA.LorenziniG. (2008). A promising microbiological test for the diagnosis of drowning. For. Sci. Int.182, 2026. 10.1016/j.forsciint.2008.09.004

  • 57

    LutzH.VangelatosA.GottelN.OsculatiA.VisonaS.FinleyS. J.et al. (2020). Effects of extended postmortem interval on microbial communities in organs of the human cadaver. Front. Microbiol.11, 569630. 10.3389/fmicb.2020.569630

  • 58

    MaP.LiC.RahamanM. M.YaoY.ZhangJ.ZouS.et al. (2022). A state-of-the-art survey of object detection techniques in microorganism image analysis: from classical methods to deep learning approaches. Artif. Intell. Rev. 12, 172. 10.1007/s10462-022-10209-1

  • 59

    MaidakB. L.ColeJ. R.LilburnT. G.ParkerC. T.Jr.SaxmanP. R.StredwickJ. M.et al. (2000). The RDP (ribosomal database project) continues. Nucl. Acids Res.28, 173174. 10.1093/nar/28.1.173

  • 60

    McNultyS. L.MoleB. M.DailidieneD.SegalI.AllyR.MistryR.et al. (2004). Novel 180- and 480-base-pair insertions in African and African–American strains of Helicobacter pylori. J. Clin. Microbiol.42, 56585663. 10.1128/JCM.42.12.5658-5663.2004

  • 61

    MetcalfJ. L.ParfreyL. W.GonzalezA.LauberC. L.KnightsD.AckermannG.et al. (2013). A microbial clock provides an accurate estimate of the postmortem interval in a mouse model system. Elife2, 1104. 10.7554/eLife.01104

  • 62

    MetzkerM. L. (2010). Sequencing technologies: the next generation. Nat. Rev. Genet.11, 3146. 10.1038/nrg2626

  • 63

    MeyersM. S.ForanD. R. (2008). Spatial and temporal influences on bacterial profiling of forensic soil samples. J. For. Sci.53, 652660. 10.1111/j.1556-4029.2008.00728.x

  • 64

    MuyzerG.DewaalE. C.UitterlindenA. G. (1993). Profiling of complex microbial populations by denaturing gradient gel electrophoresis analysis of polymerase chain reaction-amplified genes coding for 16S rRNA. Appl. Environ. Microbiol.59, 695700. 10.1128/aem.59.3.695-700.1993

  • 65

    NagasawaS.Motani-SaitohH.InoueH.IwaseH. (2013). Geographic diversity of Helicobacter pylori in cadavers: forensic estimation of geographical origin. For. Sci. Int.229, 712. 10.1016/j.forsciint.2013.02.028

  • 66

    OliveiraM.AmorimA. (2018). Microbial forensics: new breakthroughs and future prospects. Appl. Microbiol. Biotechnol.102, 1037710391. 10.1007/s00253-018-9414-6

  • 67

    OommanP. R.KalmadyK. S.JenyR.SabuM. K. (2018). Automatic detection of tuberculosis bacilli from microscopic sputum smear images using deep learning methods. Biocybernet. Biomed. Eng.38, 691699. 10.1016/j.bbe.2018.05.007

  • 68

    PechalJ. L.CrippenT. L.BenbowM. E.TaroneA. M.DowdS.TomberlinJ. K. (2014). The potential use of bacterial community succession in forensics as described by high throughput metagenomic sequencing. Int. J. Legal Med.128, 193205. 10.1007/s00414-013-0872-1

  • 69

    RáczE.KönczölF.TóthD.PatonaiZ.PorpáczyZ.KozmaZ.et al. (2016). PCR-based identification of drowning: four case reports. Int. J. Legal Med.130, 13031307. 10.1007/s00414-016-1359-7

  • 70

    RandallS.CartozzoC.SimmonsT.SwallJ. L.SinghB. (2021). Prediction of minimum postmortem submersion interval (PMSImin) based on eukaryotic community succession on skeletal remains recovered from a lentic environment. For. Sci. Int.323, 784. 10.1016/j.forsciint.2021.110784

  • 71

    RoeschL. F. W.CasellaG.SimellO.KrischerJ.WasserfallC. H.SchatzD.et al. (2009). Influence of fecal sample storage on bacterial community diversity. Open Microbiol. J.3, 4046. 10.2174/1874285800903010040

  • 72

    RossA. A.DoxeyA. C.NeufeldJ. D. (2017). The skin microbiome of cohabiting couples. mSystems2, 43. 10.1128/mSystems.00043-17

  • 73

    Ruis-SantaquiteriaJ.BuenoG.DenizO.VallezN.CristobalG. (2020). Semantic versus instance segmentation in microscopic algae detection-ScienceDirect. Eng. Appl. Artif. Intell.87, 103271. 10.1016/j.engappai.2019.103271

  • 74

    SajediH.MohammadipanahF.RahimiS. (2019). Actinobacterial strains recognition by machine learning methods. Multimedia Tools Appl.78, 2028520307. 10.1007/s11042-019-7379-9

  • 75

    SalidoJ.SánchezC.Ruiz-SantaquiteriaJ.CristóbalG.BlancoS.BuenoG. (2020). A low-cost automated digital microscopy platform for automatic identification of diatoms. Appl. Sci.10, 6033. 10.3390/app10176033

  • 76

    SalzmannA. P.AroraN.RussoG.KreutzerS.SnipenL.HaasC. (2021). Assessing time dependent changes in microbial composition of biological crime scene traces using microbial RNA markers. For. Sci. Int. Genet.53, 2537. 10.1016/j.fsigen.2021.102537

  • 77

    SangerF.NicklenS.CoulsonA. R. (1977). DNA sequencing with chain-terminating inhibitors. Proc. Natl. Acad. Sci. U. S. A.74, 54635467. 10.1073/pnas.74.12.5463

  • 78

    SastreC.BartoliC.Baillif-CouniouV.LeonettiG.Pelissier-AlicotA. L. (2017). Post mortem redistribution of drugs: current state of knowledge. Curr. Pharm. Des.23, 55305541. 10.2174/1381612823666170622111739

  • 79

    SchloissnigS.ArumugamM.SunagawaS.MitrevaM.TapJ.ZhuA.et al. (2013). Genomic variation landscape of the human gut microbiome. Nature493, 4550. 10.1038/nature11711

  • 80

    SchmedesS. E.WoernerA. E.BudowleB. (2017). Forensic human identification using skin microbiomes. Appl. Environ. Microbiol.83, 1672. 10.1128/AEM.01672-17

  • 81

    ScottL.FinleyS. J.WatsonC.JavanG. T. (2020). Life and death: a systematic comparison of antemortem and postmortem gene expression. Gene731, 144349. 10.1016/j.gene.2020.144349

  • 82

    SkoppG. (2010). Postmortem toxicology. For. Sci. Med. Pathol.6, 314325. 10.1007/s12024-010-9150-4

  • 83

    SodhiK.ShrivastavaA.AryaM.KumarM. (2013). Knowledge of infection control practices among intensive care nurses in a tertiary care hospital. J. Infect. Public Health6, 269275. 10.1016/j.jiph.2013.02.004

  • 84

    SuzukiT. A.WorobeyM. (2014). Geographical variation of human gut microbial composition. Biol. Lett.10, 1037. 10.1098/rsbl.2013.1037

  • 85

    TahirM. W.ZaidiN. A.RaoA. A.BlankR.VellekoopM. J.LangW. (2018). A fungus spores dataset and a convolutional neural network based approach for fungus detection. IEEE Trans. Nanobiosci.17, 281290. 10.1109/TNB.2018.2839585

  • 86

    TieJ.UchigasakiS.HasebaT.OhnoY.IsahaiI.OshidaS. (2010). Direct and rapid PCR amplification using digested tissues for the diagnosis of drowning. Electrophoresis31, 24112415. 10.1002/elps.200900754

  • 87

    TreebupachatsakulT.PoomrittigulS. (2019). “Bacteria classification using image processing and deep learning,” in Proceedings of the 2019 34th International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC) (Jeju: IEEE). 10.1109/ITC-CSCC.2019.8793320

  • 88

    TuomistoS.KarhunenP. J.VuentoR.AittoniemiJ.PessiT. (2013). Evaluation of postmortem bacterial migration using culturing and real-time quantitative PCR. J. For. Sci.58, 910916. 10.1111/1556-4029.12124

  • 89

    TyakhtA. V.KostryukovaE. S.PopenkoA. S.BelenikinM. S.PavlenkoA. V.LarinA. K.et al. (2013). Human gut microbiota community structures in urban and rural populations in Russia. Nat. Commun.4, 3469. 10.1038/ncomms3469

  • 90

    UchiyamaT.KakizakiE.KozawaS.NishidaS.ImamuraN.YukawaN. (2012). A new molecular approach to help conclude drowning as a cause of death: simultaneous detection of eight bacterioplankton species using real-time PCR assays with TaqMan probes. For. Sci. Int.222, 1126. 10.1016/j.forsciint.2012.04.029

  • 91

    WangL. L.ZhangF. Y.DongW. W.WangC. L.LiangX. Y.SuoL. L.et al. (2020). A novel approach for the forensic diagnosis of drowning by microbiological analysis with next-generation sequencing and unweighted UniFrac-based PCoA. Int. J. Legal Med.134, 21492159. 10.1007/s00414-020-02358-1

  • 92

    WilliamsD. W.GibsonG. (2017). Individualization of pubic hair bacterial communities and the effects of storage time and temperature. For. Sci. Int. Genet.26, 1220. 10.1016/j.fsigen.2016.09.006

  • 93

    WillisJ. R.González-TorresP.PittisA. A.BejaranoL. A.CozzutoL.Andreu-SomavillaN.et al. (2018). Citizen science charts two major “stomatotypes” in the oral microbiome of adolescents and reveals links with habits and drinking water composition. Microbiome6, 218. 10.1186/s40168-018-0592-3

  • 94

    WuG. D.LewisJ. D.HoffmannC.ChenY.-Y.KnightR.BittingerK.et al. (2010). Sampling and pyrosequencing methods for characterizing bacterial communities in the human gut using 16S sequence tags. BMC Microbiol.10, 206. 10.1186/1471-2180-10-206

  • 95

    WuJ.PetersB. A.DominianniC.ZhangY.PeiZ.YangL.et al. (2016). Cigarette smoking and the oral microbiome in a large study of American adults. ISME J.10, 24352446. 10.1038/ismej.2016.37

  • 96

    YangJ. Y.TsukimiT.YoshikawaM.SuzukiK.TakedaT.TomitaM.et al. (2019). Cutibacterium acnes (Propionibacterium acnes) 16S rRNA genotyping of microbial samples from possessions contributes to owner identification. Msystems4, 594. 10.1128/mSystems.00594-19

  • 97

    YangT.ShiY.ZhuJ.ZhaoC.WangJ.LiuZ.et al. (2021). The spatial variation of soil bacterial community assembly processes affects the accuracy of source tracking in ten major Chinese cities. Sci. China Life Sci.64, 15461559. 10.1007/s11427-020-1843-6

  • 98

    YoosephS.Andrews-PfannkochC.TenneyA.McQuaidJ.WilliamsonS.ThiagarajanM.et al. (2013). A metagenomic framework for the study of airborne microbial communities. PLoS ONE8, 862. 10.1371/journal.pone.0081862

  • 99

    YuZ.XieQ.ZhaoY.DuanL.QiuP.FanH. (2021a). NGS plus bacterial culture: a more accurate method for diagnosing forensic-related nosocomial infections. Leg. Med.52, 101910. 10.1016/j.legalmed.2021.101910

  • 100

    YuZ.XuQ.XiaoC.LiH.WuW.DuW.et al. (2021b). SYBR green real-time qPCR method: diagnose drowning more rapidly and accurately. For. Sci. Int.321, 720. 10.1016/j.forsciint.2021.110720

  • 101

    ZhangJ.WangM.QiX.ShiL.ZhangJ.ZhangX.et al. (2021). Predicting the postmortem interval of burial cadavers based on microbial community succession. For. Sci. Int. Genet.52, 2488. 10.1016/j.fsigen.2021.102488

  • 102

    ZhaoX.ZhongZ.HuaZ. (2022). Estimation of the post-mortem interval by modelling the changes in oral bacterial diversity during decomposition. J. Appl. Microbiol.133, 34513464. 10.1111/jam.15771

  • 103

    ZhouY.CaoY.HuangJ.DengK.MaK.ZhangT.et al. (2020). Research advances in forensic diatom testing. For. Sci. Rese.5, 98105. 10.1080/20961790.2020.1718901

  • 104

    ZhouY.ZhangJ.HuangJ.DengK.HuangP. (2019). Digital whole-slide image analysis for automated diatom test in forensic cases of drowning using a convolutional neural network algorithm. For. Sci. Int.302, 109922. 10.1016/j.forsciint.2019.109922

  • 105

    ZouY.ZhuangC.FangQ.LiF. (2020). Big data and artificial intelligence: new insight into the estimation of postmortem interval. Fa yi xue za zhi36, 8690. 10.12116/j.issn.1004-5619.2020.01.017

Summary

Keywords

forensic microbiology, forensic medicine, machine learning, deep learning, artificial intelligence

Citation

Yuan H, Wang Z, Wang Z, Zhang F, Guan D and Zhao R (2023) Trends in forensic microbiology: From classical methods to deep learning. Front. Microbiol. 14:1163741. doi: 10.3389/fmicb.2023.1163741

Received

11 February 2023

Accepted

08 March 2023

Published

30 March 2023

Volume

14 - 2023

Edited by

Chen Li, Northeastern University, China

Reviewed by

Dong Zhao, China University of Political Science and Law, China; Libing Yun, Sichuan University, China

Updates

Copyright

*Correspondence: Dawei Guan Rui Zhao

†These authors have contributed equally to this work and share first authorship

This article was submitted to Systems Microbiology, a section of the journal Frontiers in Microbiology

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics