ORIGINAL RESEARCH article

Front. Med., 01 April 2021

Sec. Pulmonary Medicine

Volume 8 - 2021 | https://doi.org/10.3389/fmed.2021.637872

The Diagnostic Yield of the Multidisciplinary Discussion in Patients With COVID-19 Pneumonia

  • 1. Department of Cardiac, Thoracic, Vascular Sciences, and Public Health, University of Padova, Medical School, Padova, Italy

  • 2. Department of Medicine, University of Padova, Medical School, Padova, Italy

  • 3. Department of Molecular Medicine, University of Padova, Medical School, Padova, Italy

Abstract

Purpose: The hypothesis of the study was that a multidisciplinary approach involving experienced specialists in diffuse parenchymal lung disease might improve the diagnosis of patients with COVID-19 pneumonia.

Methods: Two pulmonologists, two radiologists, and two pathologists reviewed 27 patients affected by severe COVID-19 pneumonia as the main diagnosis made by non-pulmonologists. To evaluate whether the contribution of specialists, individually and/or in combination, might modify the original diagnosis, a three-step virtual process was planned. The whole lung examination was considered the gold standard for the final diagnosis. The probability of a correct diagnosis was calculated using a model based on generalized estimating equations. The effectiveness of a multidisciplinary diagnosis was obtained by comparing diagnoses made by experienced pulmonologists with those made by non-pulmonologists.

Results: In 19% of cases, the diagnosis of COVID-19-related death was mainly incorrect. The probability of a correct diagnosis increased strikingly from an undedicated clinician to an expert specialist. Every single specialist made significantly more correct diagnoses than any non-pulmonologist. The highest level of accuracy was achieved by the combination of 3 expert specialists (p = 0.0003).

Conclusion: The dynamic interaction between expert specialists may significantly improve the diagnostic confidence and management of patients with COVID-19 pneumonia.

Introduction

Coronavirus disease 19 (COVID-19) was first identified in Wuhan, China, in December 2019 and is now on its second wave. Genetic sequencing of the virus determined that it is a beta coronavirus named severe acute respiratory syndrome-related coronavirus 2 (SARS-CoV-2) (1). Although most patients have a favorable prognosis, pneumonia, and severe hypoxemia secondary to SARS-CoV-2 infection can lead to acute respiratory failure (ARF) and death (2). Elderly male patients with comorbidities such as obesity, hypertension, diabetes, cardiac disease, and neoplasm also have an increased risk for severe disease and death and need distinct management and higher surveillance levels (36). Management remains suboptimal with high mortality rates, particularly among patients admitted to the intensive care unit (ICU).

The integration of all available data from each patient has proven crucial in the management of diffuse parenchymal lung disease (DPLD). Indeed, the international guidelines suggest health professionals with experience in DPLD be involved in patient diagnosis and management in a multidisciplinary approach to achieve the most confident diagnosis and optimize treatment (7). The sudden onset and rapid spread of the COVID-19 pandemic with the high number of infections and deaths have led to a global health emergency. Since this was an unknown disease, the priority has been stemming the infection, which inevitably has limited interaction among experts. As COVID-19 is an extremely complex disease, it would potentially benefit from a multidisciplinary approach even during the pandemic. The hypothesis of this study was therefore that a multidisciplinary approach involving specialists experienced in DPLD (pulmonologists, radiologists, and pathologists) may improve the diagnosis and management of patients with COVID-19 pneumonia, following a decision-making approach similar to what is used in DPLD.

Materials and Methods

Study Subjects

The present study was a critical re-evaluation of deceased patients by an expert team of specialists (pulmonologists, radiologists, and pathologists) routinely involved in multidisciplinary meetings of mainly DPLD (8) but also with robust experience in COVID-19 diagnosis and management (9, 10). We retrospectively studied 27 patients who consecutively died from March to May 2020 in our hospital whose death certificate indicated SARS-CoV-2 infection (detected at least once on nasopharyngeal swab) and severe COVID-19 pneumonia as the main diagnosis made by non-pulmonologists (i.e., emergency room clinicians, general practitioners, specialists in infectious diseases, and anaesthesiologists).

The autopsy was performed according to national and international protocols, as previously described (11). At autopsy, the whole lungs were macroscopically examined. A small sample was taken from the most representative area of lung injury. The sample was in part preserved in RNA later and processed for molecular analyses (see below for molecular processing details) and in part fixed in formalin for routine histology, before and independently from the other additional fragments. Pathological features suggestive of COVID-19 pneumonia (alveolar injury as well as vascular lesions) were quantitatively described using a scoring system, as previously reported (10). Other associated lesions (neoplasia, infectious diseases, aspiration pneumonia, etc.,) were also reported. To confirm the pathological diagnosis of COVID-19 pneumonia, the fragment preserved in RNA later was also processed by real time reverse transciptase-polymerase chain reaction (RT-PCR) for SARS-CoV-2 [SARS-CoV-2 (2019-nCoV) Centers for Disease Control and Prevention (CDC) Emergency Use Authorized (EUA) Authorized qPCR probe assay primer/probe mix]. An additional fragment was analyzed by culture. Briefly, virus isolation was performed using African green monkey kidney (Vero) cells. When a diffuse, refractile, rounding, cytopathic effect was noted, the Vero cell culture supernatant was passaged to a fresh Vero cell culture tube to ensure reproducibility of the cytopathic effect. SARS-CoV-2 in the supernatant was further confirmed by reverse transcription polymerase chain reaction using primers described previously (12).

In order to define the levels of certainty for a diagnosis of COVID-19 pneumonia, two expert pathologists (FC, FP) scored all cases independently and blinded to clinical and autopsy data. Several parameters, distinguishing distinct anatomic areas (airways, alveolar wall, alveolar space, pleura) and any additional findings were recorded, as previously described (13). Based on morphological/virologic evaluation, four distinct levels of diagnostic certainty were defined: (1) Definite COVID-19 pneumonia: all lung samples showing lesions typical of COVID-19 pneumonia (thrombosis, vascular injury, and/or diffuse alveolar damage/organizing pneumonia), confirmed SARS-CoV-2 lung positivity (both molecular and culture), with no other associated or pre-existing lesions (e.g., foci of bacterial pneumonia, neoplasia), (2) Probable COVID-19 pneumonia: lung samples displaying mainly features of COVID-19 pneumonia (+/– lung SARS-CoV-2 infection) with other associated lesions (e.g., foci of bacterial infection), (3) Possible COVID-19 pneumonia: lung samples showing only focal changes of COVID-19 pneumonia (+/– lung SARS-CoV-2 infection, etc.,) with more extensive features consistent with alternative diagnoses (i.e., lung cancer/metastasis, etc.,), (4) Non-COVID-19 pneumonia: lung samples not showing any typical lesions, no evidence of SARS-CoV2 infection, and presence of features consistent with alternative diagnoses.

During the autopsy, additional fragments were sampled from both lungs (at least 20 samples for each case) and systematically analyzed, as previously described (13, 14).

Clinical evaluation was performed by two experienced pulmonologists (PS, EB) based on the following data: past and recent medical history including comorbidities, respiratory and systemic signs, and symptoms (type and duration) before hospital admission, imaging, laboratory findings, gas exchange values (FiO2, pO2, and pO2/FiO2) and their changes during hospitalization, and oxygen supplementation. Based on this data, patients were classified as follows: (1) Definite COVID-19 pneumonia: clinical findings typical of COVID-19 such as severe acute respiratory illness (i.e., fever, cough, shortness of breath, hypoxemia) in the absence of an alternative diagnosis that could explain the clinical presentation (15, 16), (2) Probable COVID-19 pneumonia: features of COVID-19 pneumonia associated with findings suggestive of alternative diagnoses (e.g., pleural effusion, clinical and laboratory findings in keeping with heart failure, or signs of bacterial pneumonia), (3) Possible COVID-19 pneumonia: features of COVID-19 pneumonia associated with prevalent findings consistent with alternative etiologies (e.g., lung cancer, pulmonary metastases, pulmonary edema, heart failure), (4) Non-COVID-19 pneumonia: absence of typical signs/symptoms and laboratory findings of COVID-19 pneumonia in the presence of features consistent with alternative diagnoses (e.g., neoplasm, interstitial lung disease, ischemic heart disease, pulmonary edema).

With regard to the radiological assessment, all chest X-rays and, when available, chest computed tomography (CT) images were assessed by two expert thoracic radiologists (CG, AF). According to the radiological findings, patients were classified as follows: (1) Definite COVID-19 pneumonia: typical findings of COVID-19 pneumonia, such as bilateral ground-glass opacities and/or consolidations (17), without any signs of alternative diagnoses, (2) Probable COVID-19 pneumonia: features of COVID-19 pneumonia associated with abnormalities such as pleural effusion, cardiomegaly, or Kerley B lines suggestive of cardiac failure, or lobar consolidation suggestive of bacterial pneumonia, (3) Possible COVID-19 pneumonia: features of COVID-19 pneumonia associated with predominant findings of alternative diagnoses (e.g., unilateral pulmonary lesions due to lung cancer, pulmonary bilateral metastatic nodules), (4) Non-COVID-19 pneumonia: no typical signs of COVID-19 with features suggestive of alternative diagnoses (e.g., unilateral pulmonary lesions due to lung cancer, reticular changes secondary to interstitial lung disease).

Data regarding demographics, smoking history, symptoms, comorbidities, treatment, disease duration, serology, radiological, and pathological findings were included in a dedicated database in REDCap. Informed consent was granted by a relative/legal representative of each deceased patient. The study was approved by the local clinical institutional review Board.

Study Designs

To evaluate whether the contribution of pulmonologists, radiologists, and pathologists individually and/or in combination, could change the diagnosis originally made by non-pulmonologists, we planned a three-step process, modifying the methodology previously used in the evaluation of patients with DPLD (18).

Briefly, in the first step, two pulmonologists (PS, EB) and two radiologists (CG, AF) independently reviewed clinical and radiological data for each patient, without pathological data, and recorded their individual diagnoses and confidence levels. In the second step, pulmonologists and radiologists discussed their diagnosis and again recorded their individual or shared (in case of disagreement) confidence level. During the third step, pathologists entered the arena and reported the pathological diagnosis performed on a single lung fragment. The final diagnosis derived from the whole lung examination and full organ autopsy and was considered the diagnostic gold standard. Virtual meetings via the Zoom platform were set to allow pulmonologists, radiologists, and pathologists to discuss their interpretation with mutual collaboration (Figure 1).

Figure 1

Analysis

All patients were evaluated by pulmonologists and pathologists. One case was not evaluated by radiologists due to lack of radiological data. Specialist scores (for single specialist and for combinations of different specialists) were compared with the full autopsy diagnosis, that was considered to be the true diagnosis, and were recorded as “correct” or “wrong”. Probability of a correct diagnosis (95% confidence interval) was calculated with the method of Wilson using the binconf function of the R package {Hmisc} (19). To explore the effectiveness of a multidisciplinary diagnosis we compared specialist diagnoses with the non-pulmonologist using a model based on generalized estimating equations (GEE) (20) which expand the application of generalized linear models, providing a framework for analyzing correlated data, especially from repeated measures studies where multiple observations are collected from a specific sampling unit (21). In particular, we used a first-order autoregressive correlation structure and a robust standard error estimation to fit our small sample size. The R package {geepack} was used for the analysis (20). We exponentiated GEE results to obtain an odds ratio (95% CI) for each specialist (or combination of specialists) on their ability to formulate a correct diagnosis. All analyses and plotting were conducted on R software v.4.0.2 (22). The full code used for the analysis is available upon request.

Results

Study Population

For all patients, demographic, clinical, and laboratory data are summarized in Table 1.

Table 1

IDEpidemiological dataSARS-COV-2-RT-PCRSymptomsLaboratory testsSymptoms before admissionWard
SexAge yrsSmokeNumber of comorbidities*NF SWABFever C°CoughDyspneaWBC 109/LLY 109/LLY %D-D μg/LDays
1M82No2Positive39.5YesYes15.170.795.23115ICU
2F69Na2Positive37.9NoYes8.941.0912.220635ICU
3M76Na3Positive38NoYes9.141.027.97363ICU
4M71No1Positive38YesNo17.981.699.468414ICU
5F87Former4Positive39NoYes13.150.654.929293Non-ICU
6M79Yes3Positive37.6YesYes2.680.6223.14502ICU
7M85Former5Positive38YesYes18.090.794.47724Non-ICU
8M76No2Positive38NoYes5.281.3625.81500ICU
9F86No5Positive<37NoYes12.160.836.8na5Non-ICU
10M96No5Positive<37NoYes4.991.63321502Non-ICU
11M86No4Positive38.6YesYes2.70.414.332503Non-ICU
12M77No3Positive39YesYes4.080.8119.949718ICU
13F90No4Positive39YesYes17.830.774.3Na7Non-ICU
14M80No4Positive38.5YesYes0.99NaNaNa2Non-ICU
15F73Na1Positive37.8NoYes5.520.6712.23452ICU
16M61Yes3Positive<37NoYes3.02NaNaNa5ICU
17M82Former6Positive38YesYes3.720.4612.417113Non-ICU
18M75No0Positive38.5YesYes5.480.499.83707ICU
19M95Former3Positive<37YesYes20.361.246.11762Non-ICU
20F88No5Positive38.5YesYes6.450.9414.62514Non-ICU
21F74Former3Positive38YesYes5.20.815.415010ICU
22F87No3Positive37YesYes2.60.4918.66448Non-ICU
23F92Na2Positive38.5NoNo16.370.955.816602Non-ICU
24F90Na3Positive37.7YesYesNaNaNaNa1Non-ICU
25M83Former1Positive<37YesYes5.780.6110.6Na6Non-ICU
26F97Na3Positive37.9YesNo7.371.4975.4Na0Non-ICU
27F42Na1Positive<37NoYes4.320.7016.2Na33Non-ICU

Main clinical, epidemiological, and laboratory data available for all patients.

Yrs, years; na, not available; WBC, white blood cells; Ly, lymphocytes; D-D, d-dimer; ICU, intensive care unit; RT, reverse transcriptase; PCR, polymerase chain reaction; NF, nasopharyngeal.

*

List of the most common comorbidities detected: Arterial hypertension, cardiovascular diseases (atrial fibrillation, valvular heart disease, cardiac failure, vasculopathy, angiodysplasia, chronic cerebral vasculopathy, pulmonary embolism, aortic aneurysm), kidney diseases (chronic renal failure, kidney transplant), chronic conditions (diabetes, dyslipidemia, dementia, chronic obstructive pulmonary disease, hyperthyroidism, and connective tissue diseases).

The patient population included 15 males (56%) and 12 females (44%) with a median age of 82 years (overall range 42–97 years, interquartile range, 75.5–87.5 years). At disease onset, the main common complaints were dyspnea (89%), fever (74%), and cough (67%). On admission, white blood cells (WBC), and lymphocytes showed a median value of 2 × 109/L (overall range 0.99–20.36 × 109/L, interquartile range 4.14–12.90 × 109/L) and 0.79 × 109/L (overall range 0.4–1.69 × 109/L, interquartile range 0.6425–1.0375 × 109/L), respectively. D-dimer levels were available for 19 patients, with a median value of 497 μg/L (overall range 150–3250 μg/L, interquartile range 281–1216 μg/L). Overall, the radiologists assessed 97 chest X-rays and four CTs. On average, for each patient four chest X-rays were available.

Multistep Process and Interobserver Agreement

During the first step (Individual diagnosis by Radiologists and Pulmonologists), pulmonologists categorized 11 cases as definite (41%), nine cases as probable (33%), three cases as possible (11%), and four as non-COVID-19 pneumonia (15%). Radiologists classified 11 patients as definite (42%), 11 patients as probable (42%), two patients as possible (8%) and two patients as non-COVID-19 pneumonia (8%). The radiological data of one patient was not available. The overall diagnoses with their corresponding level of confidence are reported in Table 2.

Table 2

IDFirst stepSecond stepThird step
Individual diagnosis of pulmonologists and radiologistsGroup discussion between pulmonologists and radiologistsGroup discussion between pulmonologists, radiologists, and pathologists
PulmonologistsRadiologistsPulmonologistsRadiologistsAgreementPulmonologists + RadiologistsPathologistsAgreementMDT confident diagnosisFinal diagnosis (after the evaluation of all lung specimens and full autopsy)
OutputOutputOutputOutputOutputOutput
1DefiniteDefiniteDefiniteDefiniteYesDefiniteDefiniteYesDefiniteCOVID-19 pneumonia
2DefiniteDefiniteDefiniteDefiniteYesDefiniteDefiniteYesDefiniteCOVID-19 pneumonia
3DefiniteDefiniteDefiniteDefiniteYesDefiniteDefiniteYesDefiniteCOVID-19 pneumonia
4OtherProbableOtherProbableNoOther/ProbableOtherYes, partialOtherIatrogenic pneumonia
5ProbableProbableProbableProbableYesProbableDefiniteNoProbableCOVID-19 pneumonia & edema
6DefiniteDefiniteDefiniteDefiniteYesDefiniteDefiniteYesDefiniteCOVID-19 pneumonia
7OtherProbableOtherProbableNoOther/ProbableProbableYes, partialProbableCOVID-19 pneumonia & squamous cell carcinoma
8DefiniteDefiniteDefiniteDefiniteYesDefiniteDefiniteYesDefiniteCOVID-19 pneumonia
9OtherOtherOtherOtherYesOtherProbableNoProbableCOVID-19 pneumonia & bacterial pneumonia
10OtherProbableOtherProbableNoOther/ProbableOtherYes, partialOtherCOVID-19 pneumonia & bacterial pneumonia
11ProbableDefiniteProbableDefinite → ProbYesProbableDefiniteNoDefiniteCOVID-19 pneumonia
12PossiblePossiblePossiblePossibleYesPossiblePossibleYesPossibleSquamous cell carcinoma & foci of COVID-19 pneumonia
13DefiniteProbableDefinite → ProbProbableYesProbableDefiniteNoDefiniteCOVID-19 pneumonia
14ProbableProbableProbableProbableYesProbableProbableYesProbableCOVID-19 pneumonia & bacterial pneumonia
15PossiblePossiblePossiblePossibleYesPossiblePossibleYesPossibleMalignant SFT & foci of COVID-19 pneumonia
16ProbableProbableProbableProbableYesProbableProbableYesProbableCOVID-19 pneumonia & Aspergillus bronchopneumonia
17ProbableProbableProbableProbableYesProbableProbableYesProbableCOVID-19 pneumonia & bacterial pneumonia
18DefiniteDefiniteDefiniteDefiniteYesDefiniteDefiniteYesDefiniteCOVID-19 pneumonia
19DefiniteOtherDefinite → OtherOtherYesOtherOtherYesOtherAspiration and bacterial pneumonia
20ProbableProbableProbableProbableYesProbableProbableYesProbableCOVID-19 pneumonia & necrotizing granulomas
21DefiniteDefiniteDefiniteDefiniteYesDefiniteDefiniteYesDefiniteCOVID-19 pneumonia
22ProbableDefiniteProbableDefinite → ProbYesProbableProbableYesProbableCOVID-19 pneumonia & aspiration pneumonia
23ProbableDefiniteProbableDefinite → ProbYesProbableProbableYesProbableCOVID-19 pneumonia & bacterial pneumonia
24DefiniteNaDefiniteNaNaNaPossibleNaPossibleBacterial pneumonia & foci of COVID-19 pneumonia
25PossibleProbablePossible → ProbProbableYesProbableDefiniteNoDefiniteCOVID-19 pneumonia
26DefiniteDefiniteDefiniteDefiniteYesDefiniteDefiniteYesDefiniteCOVID-19 pneumonia
27ProbableProbableProbableProbableYesProbableProbableYesProbableCOVID-19 pneumonia & breast cancer metastasis

Confident diagnoses achieved step by step.

na, not available; MDT, multidisciplinary team; Prob, probable; SFT, solitary fibrous tumor.

During the second step (Discussion between Radiologists and Pulmonologists), a confident diagnosis was reached in 23 out of 26 cases (88%) with definite COVID-19 pneumonia in eight cases (30%). Following discussion, the diagnosis was changed in six cases, three changes for each specialist group (changes indicated with arrows in Table 2).

In the third step (Group discussion involving Radiologists, Pulmonologists, and Pathologists), the pathologists reported a diagnosis of definite COVID-19 pneumonia in 12 cases (45%), probable COVID-19 pneumonia in nine cases (33%), and possible COVID-19 pneumonia in three cases (11%). Three cases were classified as non-COVID-19 pneumonia (11%) (Table 3). A multidisciplinary discussion led to a confident diagnosis in 18 cases (69%), a partial agreement in three cases (12%), and no agreement in five cases (19%) (Table 2).

Table 3

IDHistological findingsMolecular testsPathological diagnosis
COVID-19 related lesions*Other lesionsTissue real time RT-PCRCulture
1Diffuse alveolar damage/organizing pneumonia and vascular injury++Definite
2Diffuse alveolar damage/organizing pneumonia and vascular injury+NaDefinite
3Diffuse alveolar damage/organizing pneumonia and vascular injury++Definite
4No lesionsIatrogenic paracetamol injuryNaOther
5Diffuse alveolar damage/organizing pneumonia++Definite
6Diffuse alveolar damage/organizing pneumonia++Definite
7Multiple foci of diffuse alveolar damage/organizing pneumonia and vascular injuryBronchial squamous cell carcinoma++Probable
8Diffuse alveolar damage/organizing pneumonia+NaDefinite
9Multiple foci of diffuse alveolar damage/organizing pneumonia and vascular injuryBacterial pneumoniaNaProbable
10No lesionsBacterial pneumonia+NaOther
11Diffuse alveolar damage/organizing pneumonia and vascular injury+NaDefinite
12Foci of diffuse alveolar damage/organizing pneumonia and vascular injuryDiffuse squamous cell carcinoma+NaPossible
13Diffuse alveolar damage/organizing pneumonia and vascular injury+NaDefinite
14Multiple foci of diffuse alveolar damage/organizing pneumonia and vascular injuryBacterial pneumonia++Probable
15Foci of diffuse alveolar damage/organizing pneumonia and vascular injuryMalignant pleural solitary fibrous tumor+Possible
16Multiple foci of diffuse alveolar damage/organizing pneumonia and vascular injuryAspergillus invasive bronchopneumonia++Probable
17Multiple foci of diffuse alveolar damage/organizing pneumonia and vascular injuryBacterial pneumonia+Probable
18Diffuse alveolar damage/organizing pneumonia and vascular injury+Definite
19No lesionsAspiration/bacterial pneumoniaOther
20Multiple foci of diffuse alveolar damage/organizing pneumonia and vascular injuryNecrotizing granulomas++Probable
21Diffuse alveolar damage/organizing pneumonia+Definite
22Multiple foci of diffuse alveolar damage/organizing pneumonia and vascular injuryAspiration pneumonia++Probable
23Multiple foci of diffuse alveolar damage/organizing pneumonia and vascular injuryBacterial pneumonia+Probable
24Foci of diffuse alveolar damage/organizing pneumonia and vascular injuryBacterial pneumonia+Possible
25Diffuse alveolar damage/organizing pneumonia and vascular injury+Definite
26Diffuse alveolar damage/organizing pneumonia and vascular injury++Definite
27Multiple foci of diffuse alveolar damage/organizing pneumonia and vascular injuryBreast cancer metastases/bacterial pneumonia+Probable

Results of lung histological examination, molecular tissue and cultural analyses.

RT, reverse transcriptase; PCR, polymerase chain reaction; na: not available.

*

List of the most common histological findings detected. Diffuse alveolar damage/organizing pneumonia: hyaline membrane, edema, and hemorrhage (acute exudative phase); type 2 pneumocyte hyperplasia, organizing pneumonia, and squamous metaplasia (organizing/proliferative phase). Vascular injury: capillary inflammation, neutrophilic capillaritis, microthrombi and macrothrombi.

Additional data derived from examination of the entire lungs and other organs allowed us to finally reach a shared confident diagnosis in all cases. In two cases (8%), COVID-19 pneumonia was ruled out, while in three cases (11%), COVID-19 pneumonia was only a marginal pathological process compared to other pathological lesions (Table 2). Examples of definite, probable, possible, and non-COVID-19 pneumonia are given in Figure 2.

Figure 2

The comparison between the diagnosis made by each specialist and the diagnosis made by the team following discussion and with the availability of the autopsy data showed that the ability to formulate a correct diagnosis increased strikingly from a non-pulmonologist to expert specialists, becoming progressively more accurate at different steps (Table 4).

Table 4

Overall95% CI
Non-specialist
Wrong16 (59.3%)
Right11 (40.7%)24.5–59.3%
Pulmonologist
Wrong7 (25.9%)
Right20 (74.1%)55.3–86.2%
Radiologist
Wrong6 (23.1%)
Right20 (76.9%)57.9–88.9%
Pathologist
Wrong2 (7.4%)
Right25 (92.6%)76.6–97.9%
Pulmonologist + radiologist
Wrong5 (19.2%)
Right21 (80.8%)62.1–91.5%
Pulmonologist + radiologist + pathologist
Wrong1 (3.8%)
Right25 (96.2%)81.1–99.8%

Right and wrong diagnoses by each individual specialist and their combination.

CI, confidence interval.

The GEE model showed that every single specialist was able to make a significantly more accurate diagnosis than a non-pulmonologist. Hence, a radiologist and pulmonologist were able to make a diagnosis about six times more accurate than a non-pulmonologist [OR: 6.33 (95% CI: 1.63–24.5); p = 0.0075]. Of note, the highest level of accuracy was achieved by the combination of three expert specialists (p = 0.0003) who made diagnoses that were about 35 times more accurate [OR: 35.2 (95% CI: 5.07–244)] than a single non-pulmonologist (Table 5, Figure 3). Indeed, in only one case (4%, case number 10) the multidisciplinary team diagnosis was wrong when compared to the gold standard (full autopsy diagnosis) (Table 5, Figure 3). In contrast, the diagnosis formulated by a non-pulmonologist was incorrect in over half of the cases (59%), whereas, the diagnosis formulated by a pulmonologist or a thoracic radiologist was not correct in seven (26%) and six cases (23%), respectively. After discussion, radiologists and pulmonologists incorrectly diagnosed five cases (19%). After a full autopsy and whole lung examination, pathologists misinterpreted two cases (7%).

Table 5

EstimateStandard errorp-value95% CI
Pulmonologist4.140.5400.00841.44–12.0
Radiologist4.800.5740.00631.56–14.8
Pathologist20.50.8210.00024.09–102
Pulmonologist + radiologist6.330.6910.00751.63–24.5
Pulmonologist + radiologist + pathologist35.20.9890.00035.07–244

GEE model for estimating the relative correctness of specialists in respect to the non-specialist diagnosis.

CI, confidence interval.

Figure 3

Discussion

In this study, we showed that the diagnostic accuracy of a multidisciplinary approach involving dedicated DPLD physicians is significantly higher than that of non-pulmonologists in a subset of patients infected by SARS-CoV-2 who died at the University Hospital of Padova and who underwent autopsy. We demonstrated that the dynamic interaction among DPLD experts influenced the level of confidence for the final diagnosis, which improved step by step. In two cases (8%), the diagnosis of COVID-19-related death was incorrect (final diagnosis: no COVID-19 pneumonia), while in three cases (11%), COVID-19 pneumonia was only a marginal feature compared to other pathological lesions. Thus, in 19% patients the diagnosis was mainly incorrect with consequent inappropriate management. This was the case in two patients, one with severe aspiration pneumonia and the other with carcinomatous lymphangitis who would have required different monitoring and management of care. Inappropriate treatment might have impacted on patient survival and outcome.

The global spread of the SARS-CoV-2 infection was quite unexpected, rapidly leading to a worldwide health emergency. As with any pandemic, patient care has been affected by staffing shortages, a chaotic work environment, and high levels of clinician stress. Clinicians had no choice but to provide care in an extraordinary setting. Moreover, the ICUs rapidly became saturated, and their overcrowding led to the recruitment of non-specialist medical staff, potentially exposing critically ill patients to mismanagement. Based on this distressing experience, COVID-19 health care should be planned adequately during the current second global wave. Today, the challenge is to establish a correct diagnosis taking into consideration several pathological conditions that may mimic and/or overlap with COVID-19 pneumonia, with the aim of optimizing patient management and, consequently, reducing mortality. Although our study consisted of a retrospective analysis (i.e., “a backward path by an expert team”), we believe a multidisciplinary approach involving specialists with experience in DPLD diagnosis and management can be highly beneficial to patient care. The multidisciplinary evaluation has become the diagnostic gold standard for DPLD, as it improves diagnostic confidence and interobserver agreement compared to individual components of the multidisciplinary team in isolation (18, 23), as was the case in our study.

An expert team should be involved in patient evaluation at the very time of hospital admission, particularly when patients are fragile and have severe respiratory failure. The chaotic work environment and the stressful conditions of emergency medical staff, which may make a face-to-face multidisciplinary approach non-realistic, might be successfully overcome by using newer digital technologies. Indeed, during the COVID-19 pandemic, multi-specialist meetings have been suspended and converted into virtual meetings, as occurred in our case.

In the multidisciplinary team of DPLD specialists, radiologists play a key role in that HRCT is largely recognized as a very sensitive and highly specific tool (2325). During the early phase of the pandemic, CT was seldom performed in COVID-19-positive patients for safety reasons (26, 27). Although chest X-ray proved to be an accurate and reliable method to assess patients with COVID-19, even allowing the development of dedicated scores [CARE referral score] (27), CT plays a crucial role in recognizing alternative diagnoses, especially in patients with pre-existing pulmonary diseases (2830). Moreover, as recently demonstrated by Borakati and colleagues, it has a higher sensitivity for COVID-19 and its use should be especially promoted in the initial assessment of suspected cases (31). The use of a diagnostic modality other than the gold standard may account for the higher agreement between pathologists and pulmonologists than radiologists in cases of partial agreement. Learning from the difficulties encountered in the first wave of the pandemic, most hospitals worldwide have recently adopted organizational models, which guarantee safe pathways to CT scanners that will surely increase the use of this technique and are expected to have a significant impact on the quality of the delivered care (32, 33).

After discussion, pulmonologists and radiologists achieved a correct diagnosis in 81% of cases and were about six times more accurate than a single non-pulmonologist emphasizing their acceptable diagnostic yield even when histology is not available. These findings are of particular importance since, in some patients with COVID-19 pneumonia, severe respiratory failure could hamper invasive procedures (such as bronchoscopy) and consequently limit the pathologist's contribution. However, we then demonstrated that radiologists and pulmonologists incorrectly diagnosed five cases (19%) which could have influenced the decision-making process inducing a different treatment approach, monitoring, and setting of care. Indeed, in the scenario of an overcrowded intensive care unit, extra effort should be made to seek additional opinions by MDT to obtain greater confidence in the diagnostic impression and to improve the management and outcome of these patients.

In our study, as expected, pathologists showed the highest level of confidence between the first diagnostic impression on a single lung fragment compared to the final diagnosis on whole lung examination, with an incorrect diagnosis being made in only two cases. The lung fragments used by pathologists to perform the first diagnosis were similar in size to those obtained by video-assisted thoracic surgery (VATS) that is suggested to be the gold standard tool for the histological diagnosis of DPLD/ILD (23). Invasive procedures such as VATS carry a high risk of mortality, particularly in patients with severe respiratory dysfunction and under mechanical ventilation (34). During the SARS-CoV-2 pandemic, invasive diagnostic procedures involving sampling of the lung parenchyma were discouraged. However, given the critically important contribution that pathologists could provide in the diagnosis of COVID-19 pneumonia, minimally invasive procedures, such as transbronchial lung biopsy/cryobiopsy could be reconsidered in the diagnostic work-up of COVID-19 pneumonia in doubtful cases, when radiological and/or clinical findings suggest the existence of an additional or alternative pathological condition. This is in line with recent expert recommendations (35) suggesting that bronchoscopy, if opportune, can be safely performed in patients with COVID-19, prioritizing minimization of the risk of viral transmission.

Information coming from a full autopsy of COVID-19 patients with the evaluation of numerous lung samples was considered the gold standard for final diagnosis in our case series. Data provided by the most recent autopsy studies have been crucial in improving our knowledge of the pathological substrates of COVID-19. Indeed, because of the contribution of autopsy studies, COVID-19 pneumonia is now recognized as a complex disease involving not only the lung parenchyma but also the vascular compartment with features that include vasculitis, angiogenesis, capillaritis, and micro/macrothrombi (10, 14, 36).

The present study has several limitations. First, the study is monocentric, and the study population is relatively small. However, despite this, we were able to implement a GEE model that is robust and provides reliable results even with small sample sizes. Moreover, this is one of the largest monocentric European case series wherein the same lung sampling methodology and analysis was consistently applied.

A multidisciplinary approach to diagnosis and management of patients with COVID-19 requires extra effort by the healthcare providers involved but, if it should be validated, it would have the potential to consistently improve the outcome of this often-fatal disease.

Statements

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving human participants were reviewed and approved by The Local Ethics Committee of the University Hospital of Padova (4853/A0/20). The patients/participants provided their written informed consent to participate in this study.

Author contributions

FC, EB, and PS: conceptualization, writing—reviewing and editing, and supervision. FP, FF, and CG: writing original draft—preparation, visualization, and investigation. FL, EC, LV, SV, CD, and AF: resources and investigation. DG and AC: resources, investigation, visualization, and supervision. All authors have wrote, read, and approved the final version of the manuscript.

Funding

This research was partially supported by a fellowship from the University of Padova/ Intesa San Paolo Vita bank (2020A08).

Acknowledgments

The authors thank Dr. Judith Wilson for English-language revision.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  • 1.

    Coronaviridae Study Group of the International Committee on Taxonomy of Viruses. The species severe acute respiratory syndrome-related coronavirus: classifying 2019-Ncov and naming it SARS-Cov-2. Nat Microbiol. (2020) 5:53644. 10.1038/s41564-020-0695-z

  • 2.

    YangXYuYXuJShuHXiaJLiuHet al. Clinical course and outcomes of critically Ill patients with SARS-Cov-2 pneumonia in Wuhan, China: a single-centered, retrospective, observational study. Lancet Respir Med. (2020) 8:47581. 10.1016/S2213-2600(20)30079-5

  • 3.

    RelloJStortiEBelliatoMSerranoR. Clinical phenotypes of SARS-Cov-2: implications for clinicians and researchers. Eur Respir J. (2020) 55:2001028. 10.1183/13993003.01028-2020

  • 4.

    GrasselliGTonettiTProttiALangerTGirardisMBellaniGet al. Pathophysiology of COVID-19-associated acute respiratory distress syndrome: a multicentre prospective observational study. Lancet Respir Med. (2020) 8:12018. 10.1016/S2213-2600(20)30370-2

  • 5.

    FigliozziSMasciPGAhmadiNTondiLKoutliEAimoAet al. Predictors of adverse prognosis in COVID-19: a systematic review and meta-analysis. Eur J Clin Invest. (2020) 50:E13362. 10.1111/eci.13362

  • 6.

    PorchedduRSerraCKelvinDKelvinNRubinoS. Similarity in case fatality rates (CFR) of COVID-19/SARS-COV-2 in Italy and China. J Infect Dev Ctries. (2020) 14:1258. 10.3855/jidc.12600

  • 7.

    RaghuGRemy-JardinMMyersJLRicheldiLRyersonCJLedererDJet al. Diagnosis of idiopathic pulmonary fibrosis. An official ATS/ERS/JRS/ALAT clinical practice guideline. Am J Respir Crit Care Med. (2018) 198:E4468. 10.1164/rccm.201807-1255ST

  • 8.

    CocconcelliEBalestroEBiondiniDBarbieroGPolverosiRCalabreseFet al. High-resolution computed tomography (HRCT) reflects disease progression in patients with idiopathic pulmonary fibrosis (IPF): relationship with lung pathology. J Clin Med. (2019) 8:399. 10.3390/jcm8030399

  • 9.

    CocconcelliEBiondiniDGiraudoCLococoSBernardinelloNFicheraGet al. Clinical features and chest imaging as predictors of intensity of care in patients with COVID-19. J Clin Med. (2020) 9:2990. 10.3390/jcm9092990

  • 10.

    BorczukACSalvatoreSPSeshanSVPatelSSBusselJBMostykaMet al. COVID-19 Pulmonary pathology: a multi-institutional autopsy cohort from Italy and New York City. Mod Pathol. (2020) 33:215668. 10.1038/s41379-020-00661-1

  • 11.

    BassoCCalabreseFSbaragliaMDel VecchioCCarrettaGSaievaAet al. Feasibility of postmortem examination in the era of COVID-19 pandemic: the experience of a Northeast Italy University Hospital. Virchows Arch. (2020) 477:3417. 10.1007/s00428-020-02861-1

  • 12.

    LavezzoEFranchinECiavarellaCCuomo-DannenburgGBarzonLDel VecchioCet al. Suppression of a SARS-Cov-2 outbreak in the Italian Municipality of Vo'. Nature. (2020) 584:4259. 10.1038/s41586-020-2488-1

  • 13.

    CalabreseFPezzutoFFortarezzaFBoscoloALunardiFGiraudoCet al. Machine learning-based analysis of alveolar and vascular injury in SARS-CoV-2 acute respiratory failure. J Pathol. (2021). [Epub ahead of print]. 10.1002/path.5653

  • 14.

    CalabreseFPezzutoFFortarezzaFHofmanPKernIPanizoAet al. Pulmonary pathology and COVID-19: lessons from autopsy. the experience of European pulmonary pathologists. Virchows Arch. (2020) 477:35972. 10.1007/s00428-020-02886-6

  • 15.

    HuangCWangYLiXRenLZhaoJHuYet al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. (2020) 395:497506. 10.1016/S0140-6736(20)30183-5

  • 16.

    GuanWJNiZYHuYLiangWHOuCQHeJXet al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. (2020) 382:170820. 10.1056/NEJMoa2002032

  • 17.

    KanneJPLittleBPChungJHElickerBMKetaiLH. Essentials for radiologists on COVID-19: an update-radiology scientific expert panel. Radiology. (2020) 296:E1134. 10.1148/radiol.2020200527

  • 18.

    FlahertyKRKingTEJrRaghuGLynchJPIIIColbyTVTravisWDet al. Idiopathic interstitial pneumonia: what is the effect of a multidisciplinary approach to diagnosis?Am J Respir Crit Care Med. (2004) 170:90410. 10.1164/rccm.200402-147OC

  • 19.

    Harrell FE, with contributions from Dupont C and many others. Hmisc: Harrell Miscellaneous. (2020). Available online at: https://CRAN.R-project.org/package=Hmisc

  • 20.

    HøjsgaardSHalekohUYanJ. The R package geepack for generalized estimating equations. J Stat Softw Artic. (2015) 15:111. 10.18637/jss.v015.i02

  • 21.

    HardinJW. Generalized Estimating Equations (GEE). In: EverittBSHowellDC editors. Encyclopedia of Statistics in Behavioral Science (2005). 10.1002/0470013192.bsa250

  • 22.

    R Development Core Team. R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing (2019).

  • 23.

    RaghuGCollardHREganJJMartinezFJBehrJBrownKKet al. An official ATS/ERS/JRS/ALAT statement: idiopathic pulmonary fibrosis: evidence-based guidelines for diagnosis and management. Am J Respir Crit Care Med. (2011) 183:788824. 10.1164/rccm.2009-040GL

  • 24.

    DesaiSRProschHGalvinJR. Plain film and HRCT diagnosis of interstitial lung disease. In: HodlerJKubik-HuchRAVon SchulthessGK, editors. Chapter 4: Diseases of the Chest, Breast, Heart, and Vessels 2019-2022: Diagnostic and Interventional Imaging. Cham: Springer (2019).

  • 25.

    LynchDASverzellatiNTravisWDBrownKKColbyTVGalvinJRet al. Diagnostic criteria for idiopathic pulmonary fibrosis: a fleischner society white paper. Lancet Respir Med. (2018) 6:13853. 10.1016/S2213-2600(17)30433-2

  • 26.

    FicheraGStramareRDe ContiGMottaRGiraudoC. It' s not over until it's over: the chameleonic behavior of COVID-19 over a six-day period. Radiol Med. (2020) 125:5146. 10.1007/s11547-020-01203-0

  • 27.

    GiraudoCCavaliereAFicheraGWeberMMottaRPellosoMet al. Validation of a composed COVID-19 chest radiography score: the CARE project. ERJ Open Res. (2020) 6:00359-2020. 10.1183/23120541.00359-2020

  • 28.

    LariciARCicchettiGMaranoRMerlinoBEliaLCalandrielloLet al. Multimodality imaging of COVID-19 pneumonia: from diagnosis to follow-up. A comprehensive review. Eur J Radiol. (2020) 131:109217. 10.1016/j.ejrad.2020.109217

  • 29.

    RubinGDRyersonCJHaramatiLBSverzellatiNKanneJPRaoofSet al. The role of chest imaging in patient management during the COVID-19 pandemic: a multinational consensus statement from the Fleischner Society. Chest. (2020) 158:10616. 10.1016/j.chest.2020.04.003

  • 30.

    AklEABlazicIYaacoubSFrijaGChouRAppiahJAet al. Use of chest imaging in the diagnosis and management of COVID-19: a WHO rapid advice guide. Radiology. (2020) 30:203173. 10.1148/radiol.2020203173

  • 31.

    BorakatiAPereraAJohnsonJSoodT. Diagnostic accuracy of X-ray versus CT in COVID-19: a propensity-matched database study. BMJ Open. (2020) 10:e042946. 10.1136/bmjopen-2020-042946

  • 32.

    Mossa-BashaMMedverdJLinnauKFLynchJBWenerMHKicskaGet al. Policies and guidelines for COVID-19 preparedness: experiences from the University of Washington. Radiology. (2020) 296:E2631. 10.1148/radiol.2019201326

  • 33.

    CesterGGiraudoCCausinFBoemoDGAnglaniMCapizziAet al. Retrospective analysis of a modified organizational model to guarantee CT workflow during the COVID-19 outbreak in the Tertiary Hospital of Padova, Italy. J Clin Med. (2020) 9:3042. 10.3390/jcm9093042

  • 34.

    GhatolARuhlAPDanoffSK. Exacerbations in idiopathic pulmonary fibrosis triggered by pulmonary and non-pulmonary surgery: a case series and comprehensive review of the literature. Lung. (2012) 190:37380. 10.1007/s00408-012-9389-5

  • 35.

    LuoFDarwicheKSinghSTorregoASteinfortDPGaspariniSet al. Performing bronchoscopy in times of the COVID-19 pandemic: practice statement from an international expert panel. Respiration. (2020) 9:41722. 10.1159/000507898

  • 36.

    CalabreseFFortarezzaFGiraudoCPezzutoFFaccioliEReaFet al. Two sorts of microthrombi in a patient with coronavirus disease 2019 and lung cancer. J Thorac Oncol. (2020) 15:17825. 10.1016/j.jtho.2020.08.008

Summary

Keywords

diagnostic yield, multidisciplinary approach, COVID-19, COVID-19 pneumonia, SARS-CoV-2

Citation

Calabrese F, Pezzuto F, Giraudo C, Vedovelli L, Fortarezza F, Del Vecchio C, Lunardi F, Fraia AS, Cocconcelli E, Vuljan SE, Gregori D, Crisanti A, Balestro E and Spagnolo P (2021) The Diagnostic Yield of the Multidisciplinary Discussion in Patients With COVID-19 Pneumonia. Front. Med. 8:637872. doi: 10.3389/fmed.2021.637872

Received

04 December 2020

Accepted

03 March 2021

Published

01 April 2021

Volume

8 - 2021

Edited by

Reza Lashgari, Institute for Research in Fundamental Sciences, Iran

Reviewed by

Ilias Papanikolaou, General Hospital of Corfu, Greece; Atefeh Abedini, Shahid Beheshti University of Medical Sciences, Iran

Updates

Copyright

*Correspondence: Fiorella Calabrese

This article was submitted to Pulmonary Medicine, a section of the journal Frontiers in Medicine

†These authors share last authorship

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics