Performance of Multiparametric Models in Patients With Brugada Syndrome: A Systematic Review and Meta-Analysis
Hui-ting Wei1† 
Yue-Rong Ma- 1School of Basic Medicine, Chengdu University of Traditional Chinese Medicine, Chengdu, China
- 2West China School of Public Health, Sichuan University, Chengdu, China
- 3Department of Cardiology, West China Hospital, Sichuan University, Chengdu, China
Background: Multiparametric models have shown better risk stratification in Brugada syndrome. Recently, these models have been validated in different populations.
Aims: To perform a systematic review and meta-analysis of the predictive performance of three validated multiparametric models (Delise model, Sieria model, and Shanghai score).
Methods: We searched PubMed, Embase, MEDLINE, Web of Science, and Ovid for studies validating the risk multiparametric model. A Sieria score > 2 and Shanghai score ≥ 4 were considered to indicate higher risk. Performance estimates were summarized using a random-effects model.
Results: Seven studies were included, with sample sizes of 111–1,613. The follow-up duration was 3.3–10.18 years. The Sieria model had a pooled area under the curve (AUC), sensitivity, and specificity of 0.71 [95% confidence interval (CI): 0.67–0.75], 57% (95% CI: 35–76), and 71% (95% CI: 62–79), respectively. The Shanghai score had an AUC of 0.63–0.71, 68.97–90.67% sensitivity, and 43.53–63.43% specificity. The AUC of the Delise model was 0.77–0.87; however, the optimal cut-off was not identified.
Conclusions: The three models exhibited moderate discriminatory ability for Brugada syndrome. The Sieria model has poor sensitivity and moderate specificity, whereas the Shanghai score has poor specificity and moderate sensitivity.
Introduction
Brugada syndrome (BrS) is an inherited heart disease with a typical electrocardiogram (ECG) pattern that carries a risk of ventricular arrhythmias (VAs) and sudden cardiac death (SCD) (1, 2), with initial symptoms ranging from syncope to SCD (3). Currently, implantable cardioverter-defibrillators (ICD) are the only effective treatment for VAs in BrS, but are strongly associated with immediate and long-term risks, are expensive and require long-term intervention, and may reduce the patient's quality of life. Therefore, accurate risk stratification is of critical importance in managing BrS (4).
To date, BrS risk stratification remains challenging (5, 6). Several studies have focused on predicting ventricular fibrillation (VF) occurrence in BrS. Spontaneous type 1 ECG (Sp1) (7), history of syncope caused by VA (8), and family history of SCD (9) are all predictive factors for high-risk patients, but their prognostic power in BrS patients is limited. Some studies that have incorporated multiple predictive factors may be helpful in the risk stratification of BrS patients. Delise et al. (10) reported that patients with a basal type 1 ECG and syncope, family history of SCD, and positive electrophysiological study (EPS) had higher risk of VAs. Sieria et al. (11) reported that comprehensive evaluation of Sp1, sudden cardiac arrest, history of syncope, early familial sudden cardiac arrest, inducible EPS, and sinus node dysfunction are important for stratifying VF risk in BrS patients. The Shanghai score, which includes the presence of Sp1, type 1 ECG due to fever or medication, clinical history of arrhythmia or arrhythmic syncope, family history, and genetic test result, has predictive value for BrS patients (12, 13).
These models have been validated in a small sample size (14) and more recently in independent cohorts (15). To understand the strength and quality of the available evidence of these prognostic multiparametric models, we performed a systematic review and meta-analysis of all relevant articles to summarize the prognostic and discriminatory performance of these models in BrS patients.
Methods
Database Search
This study was conducted in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement-related procedures. Several multiparametric models have been proposed but have not been validated in other cohorts (16, 17). Therefore, we performed a systematic search for published studies evaluating multiparametric models [Delise model (10), Sieria model (11), and Shanghai score (12)]. The brief introduction of Delise model, Sieria model, and Shanghai score models is in Supplementary Table S1. We searched PubMed, Embase, MEDLINE, Web of Science, and Ovid for studies published up to January 6, 2022. The full search strategies are described in Supplemental Material. Abstracts, editorials, letters, case reports, and review papers were excluded from this study. Research manuscripts for which the full text was unavailable or with missing information were also excluded. Only complete analytical studies published in peer-reviewed journals were included.
Study Selection and Data Extraction
Two authors (H.T.W. and W.L.) performed duplicate literature screening based on the titles and abstracts and subsequently screened the records retrieved from the search independently. Then, they performed a full-text review of the screening records. If there was disagreement during this period, a third reviewer (S.C.) joined the discussion and resolved it by consensus. The two investigators extracted the following information independently: general patient information (age, sex, region); number of patients in the study; follow-up duration; number of SCD or SCD-equivalent cases. The outcomes analyzed were SCD, appropriate defibrillator therapy as determined through ICD interrogations and/or ventricular tachycardia/VF by ECG during follow-up. For the meta-analysis, the data for true and false positives and true and false negatives were extracted directly from the article or from data reported in the article, and the summary results were compiled in a 2 × 2 table.
Risk of Bias Assessment
Two investigators (H.T.W. and W.L.) evaluated the risk of bias of the included studies independently using the Newcastle–Ottawa Scale (18). The scale consists of a list of eight items involving patient selection, cohort comparability, and outcome assessment. If there was disagreement between the two investigators, a third reviewer (S.C.) participated in the discussion and negotiated a solution.
Data Analysis
Dichotomous variables are expressed as proportions (percentages), and continuous variables are expressed as the mean ± SD or median (range). Meta-analyses were performed using a random-effects model, the odds ratios (ORs), C-statistics or area under the curve (AUC) with the 95% CI of each study were weighted according to their size. Pooled estimates of sensitivity, specificity, positive predictive value, the positive likelihood ratio (PLR) and negative likelihood ratio (NLR) were pooled using a random-effects model with the using Mantel-Haenszel methods based on inverse variance weighting. Sensitivity analysis used the leave-one-out approach to assess whether the pooled results were influenced by a single study. According to the different types, subgroup meta-analyses are performed by pooling the studies into 2 subgroups: prospective study and retrospective study. A p-value < 0.05 and I2 > 50% are considered to indicate statistical significance. The statistical analyses were performed using RevMan 5.4 and Stata 17.
Results
Study Selection
Figure 1 shows the flow chart of the literature search strategy. The search identified 4,481 citations. Seven observational studies (three prospective and four retrospective) were included, of which four were multicenter. Table 1 presents the characteristics of the seven studies included in the systemic review and meta-analysis. The studies had sample sizes of 111–1,613. The mean patient age was 41.1–47.1 years, and male patients comprised 58.3–95.2% of the sample. The follow-up duration was 3.3–10.18 years. All studies considered a composite arrhythmic endpoint formed by SCD and/or aborted cardiac arrest, ongoing VAs, and/or appropriate ICD therapies. Five studies reported the prognostic performance of the Sieria model, three studies reported the Shanghai score, and three studies reported the Delise model. The methodological quality of the studies based on the Newcastle–Ottawa Scale score is reported in Table 2. The seven studies were graded as good quality.
Figure 1. Flowchart describing the publication search and selection algorithm.
Table 1. Baseline study characteristics of multiparameter-risk-prediction model validation studies in Brugada syndrome.
Table 2. Study quality was assessed using the Newcastle–Ottawa Scale.
Sieria Model
Sieira et al. (11) proposed that patients with a score > 2 points showed significantly higher event probability. Therefore, we evaluated the resolution of the Sieria model using a score of 2 as the cut-off point. The area under the summary receiver operating characteristic (SROC) curve (AUC) was 0.71 (95% CI: 0.67–0.75) (Figure 2A). The pooled sensitivity, specificity, PLR and NLR were 57% (95% CI: 35–76), 71% (95% CI: 62–79), 3.12 (0.81–11.48) and 0.30 (0.09–1.05), respectively (Figure 2B). The pooled OR of Sieira score > 2 points for the prediction of arrhythmic events are reported in Figure 3. Letsas et al. (14) showed that the Sieria model had an AUC of 0.87 (95% CI 0.75–0.99, P = 0.001), 100% sensitivity, and 51.9% specificity without a defined cut-point.
Figure 2. (A) SROC in the Sieria model. (B) Forest plots of sensitivity and specificity.
Figure 3. Meta-analysis results of ORs in the Sieria model.
There was a high level of heterogeneity for the OR between the studies (I2 = 90.0%; P < 0.0001). A one-study-removed approach in the sensitivity analysis was used to assess whether any of the studies would alter the overall results (Figure 4). After the study by Chow et al. (20) had been removed, the sensitivity analysis showed significantly reduced heterogeneity for OR. In the two prospective studies, the presence of Sieria score > 2 points was associated with an increased risk for ventricular arrhythmias and SCD (OR: 8.79; 95% CI: 5.26–14.69; p < 0.001), heterogeneity was not significant. When the studies were retrospective, the pooled OR was 1.19 [95% confidence interval (CI): 0.66–2.14], heterogeneity was high, see in Supplementary Figure S1.
Figure 4. Sensitivity analysis of the extracted C-statistics.
Shanghai Score
The Shanghai score defines people with a score ≥ 4 as high to highest risk. We evaluated Shanghai score discrimination when 4 points was used as the cut-off point. Three studies reported data for the prognostic performance of the Shanghai score. The AUC was 0.626–0.712, sensitivity was 68.97–90.67%, and specificity was 43.53–63.43% (Table 3). The pooled OR was 5.90 (95% CI: 3.72–9.34) and there was no significant heterogeneity (Figure 5).
Table 3. The AUC, sensitivity and specificity of Shanghai score in the different studies.
Figure 5. Meta-analysis results of ORs in the Shanghai score.
Delise Model
Three studies reported the prognostic accuracy of the Delise model, for which the optimal cut-off was not given. Therefore, pooled analysis could not be performed. Delise et al. (10) incorporated syncope, basal type 1 ECG, family history of SCD, and positive EPS as a risk model in 245 BrS patients who underwent EPS, and the risk model yielded a C-statistic of 0.87 (95% CI: 0.82–0.90). Validation by Rodríguez-Mañero et al. (19) showed that this model had an AUC of 0.77 in a total of 831 patients. The Delise model yielded an AUC of 0.87 (95% CI 0.73–1.00; P = 0.002), validated by Letsas et al. (14) in 111 patients, and 71.4% sensitivity and 86.5% specificity.
Discussion
In this meta-analysis of a multiparametric model for prognostic performance in BrS, we determined that binary assessment of a Sieria score > 2 and a Shanghai score ≥ 4, considered higher risk, demonstrated moderate capability for predicting an arrhythmic event in BrS patients. The Sieria model had low sensitivity and moderate specificity; the Shanghai score had moderate sensitivity and lower specificity.
Sieria et al. (11) studied 400 BrS patients via a multiparametric approach that included ECG patterns, early familial SCD antecedents, induced electrophysiology, SCD as manifested by syncope or miscarriage, and sinus node dysfunction, reporting a predictive performance of 0.82 in a single-center consecutive cohort and 0.81 in a validation cohort. Consistent with their findings, validation by Rodríguez-Mañero et al. (19) demonstrated that the AUC was 0.81. In addition, Letsas et al. (14) showed that the Sieria model had an AUC of 0.87. However, validation by Chow et al. (20) demonstrated that in 192 patients from two tertiary institutions in the UK, the Sieria model had an AUC of 0.58. Two important factors generate low prognostic performance: temporal variation in cohort characteristics, and invasive EPS with a total of five possible points is less common in the UK. None of the above studies clearly indicated the AUC cut-off value. Therefore, it is unclear which point can be defined as high-risk. We used 2 points as the cut-off value proposed by Sieira et al. (11) and determined that the predictive performance was moderate, with an AUC of 0.71 (95% CI: 0.62–0.75), whereas the sensitivity was low, with a pooled sensitivity of 57% (95% CI: 35–76). Several factors may be responsible for this, such as the Sieira cohort originating from a single center, and the validation study demonstrating that the proportion of family history of SCD was lower than that of the Sieira cohort.
The Shanghai score for diagnosing BrS was calculated based on several risk factors, and the scoring system also had prognostic value (AUC = 0.759, 71.2% sensitivity, 73.1% specificity) (12). Event-free survival curves showed that patients with 3.5 points had moderate risk for VAs while patients with 4–5 points were at high risk, and patients with >5.5 points were in the highest risk category. Recently, Probst et al. (15) evaluated Shanghai BrS accuracy and reported a predictive power AUC of 0.73 (95% CI: 0.67–0.79). Rodríguez-Mañero et al. (19) reported that the score performance was 0.80 and also did not define an AUC cut-off value. We obtained moderate prognostic accuracy for the Shanghai score because of lower specificity when 3.5 points was used as the cut-off point. A meta-analysis demonstrated that inducible VAs were predictive of arrhythmic events in asymptomatic BrS patients (21) and EPS proved to be a relevant prognostic indicator. This lower specificity may be explained by the Shanghai score without the need for an EPS.
Delise et al. (10) evaluated the risk factors for VA/SCD in a primary prevention BrS cohort, where the presence of a basal type 1 ECG was combined with other clinical risk factors, including syncope, family history of SCD, and positive EPS. No events occurred in patients without any or only one of these risk factors. Letsas et al. (14) assessed the predictive power of the risk scores in 111 consecutive patients and reported that the predictive capacity demonstrated an AUC of 0.87. More recently, Rodríguez-Mañero et al. (19) evaluated the accuracy of the Delise model and estimated that the predictive capacity from the AUC was 0.77. Unlike the Sieria model or the Shanghai score, we were unable to obtain the AUC, sensitivity, and specificity of the Delise model for a given number of risk factors. The predictive power of this risk model for evaluating arrhythmic risk remains uncertain when BrS patients have multiple risk factors. This casts doubt on the utility of this score model for the primary SCD prevention. The Sieria model incorporated the spontaneous type-1 ECG, early familial SCD, positive EPS, syncope, SND and aborted SCD, all the variables had high risk factors. The Shanghai Score System which included electrocardiographic recordings, genetic results, clinical characteristics, and family history was used to diagnosis of BrS, only some of the items were reported to be associated with arrhythmic events alone. So, the Sieria model had higher specificity and lower sensitivity compared with Shanghai Score System.
Limitations
First, we could not include all studies in the meta-analysis due to limitations such as publication in a non-English language. Second, we did not obtain original data from the authors and based our analysis only on the data reported in the studies. Third, the studies we included were predominantly retrospective, and bias and confounding might have been present.
Conclusions
The three models exhibited moderate discriminatory ability for BrS. The Sieria model has poor sensitivity and moderate specificity, whereas the Shanghai score has poor specificity and moderate sensitivity.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Author Contributions
All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fcvm.2022.859771/full#supplementary-material
References
1. Brugada P, Brugada J. Right bundle branch block, persistent ST segment elevation and sudden cardiac death: a distinct clinical and electrocardiographic syndrome. A multicenter report. J Am Coll Cardiol. (1992) 20:1391–96. doi: 10.1016/0735-1097(92)90253-J
2. Martini B, Nava A, Thiene G, Buja GF, Canciani B, Scognamiglio R, et al. Ventricular fibrillation without apparent heart disease: description of six cases. Am Heart J. (1989) 118:1203–9. doi: 10.1016/0002-8703(89)90011-2
3. Marsman EMJ, Postema PG, Remme CA. Brugada syndrome: update and future perspectives. Heart. (2021) heartjnl-2020-318258. doi: 10.1136/heartjnl-2020-318258
4. Brugada J, Brugada R, Brugada P. Pharmacological and device approach to therapy of inherited cardiac diseases associated with cardiac arrhythmias and sudden death. J Electrocardiol. (2000) 33:41–7. doi: 10.1054/jelc.2000.20322
5. Probst V, Veltmann C, Eckardt L, Meregalli PG, Gaita F, Tan HL, et al. Long-term prognosis of patients diagnosed with Brugada syndrome: results from the FINGER Brugada Syndrome Registry. Circulation. (2010) 121:635–43. doi: 10.1161/CIRCULATIONAHA.109.887026
6. Adler A, Rosso R, Chorin E, Havakuk O, Antzelevitch C, Viskin S. Risk stratification in Brugada syndrome: clinical characteristics, electrocardiographic parameters, and auxiliary testing. Heart Rhythm. (2016) 13:299–310. doi: 10.1016/j.hrthm.2015.08.038
7. Eckardt L, Probst V, Smits JP, Bahr ES, Wolpert C, Schimpf R, et al. Long-term prognosis of individuals with right precordial ST-segment-elevation Brugada syndrome. Circulation. (2005) 111:257–63. doi: 10.1161/01.CIR.0000153267.21278.8D
8. Brugada J, Brugada R, Brugada P. Determinants of sudden cardiac death in individuals with the electrocardiographic pattern of Brugada syndrome and no previous cardiac arrest. Circulation. (2003) 108:3092–6. doi: 10.1161/01.CIR.0000104568.13957.4F
9. Rattanawong P, Kewcharoen J, Kanitsoraphan C, Barry T, Shanbhag A, Vutthikraivit W, et al. Does the age of sudden cardiac death in family members matter in brugada syndrome? J Am Heart Assoc. (2021) 10:e019788. doi: 10.1161/JAHA.120.019788
10. Delise P, Allocca G, Marras E, Giustetto C, Gaita F, Sciarra L, et al. Risk stratification in individuals with the Brugada type 1 ECG pattern without previous cardiac arrest: usefulness of a combined clinical and electrophysiologic approach. Eur Heart J. (2011) 32:169–76. doi: 10.1093/eurheartj/ehq381
11. Sieira J, Conte G, Ciconte G, Chierchia GB, Casado-Arroyo R, Baltogiannis G, et al. A score model to predict risk of events in patients with Brugada Syndrome. Eur Heart J. (2017) 38:1756–63. doi: 10.1093/eurheartj/ehx119
12. Kawada S, Morita H, Antzelevitch C, Morimoto Y, Nakagawa K, Watanabe A, et al. Shanghai score system for diagnosis of Brugada Syndrome: validation of the score system and system and reclassification of the patients. JACC Clin Electrophysiol. (2018) 4:724–30. doi: 10.1016/j.jacep.2018.02.009
13. Antzelevitch C, Yan GX, Ackerman MJ, Borggrefe M, Corrado D, Guo J, et al. J-Wave syndromes expert consensus conference report: emerging concepts and gaps in knowledge. Heart Rhythm. (2016) 13:e295–324. doi: 10.1016/j.hrthm.2016.05.024
14. Letsas KP, Bazoukis G, Efremidis M, Georgopoulos S, Korantzopoulos P, Fragakis N, et al. Clinical characteristics and long-term clinical course of patients with Brugada syndrome without previous cardiac arrest: a multiparametric risk stratification approach. Europace. (2019) 21:1911–8. doi: 10.1093/europace/euz288
15. Probst V, Goronflot T, Anys S, Tixier R, Briand J, Berthome P, et al. Robustness and relevance of predictive score in sudden cardiac death for patients with Brugada syndrome. Eur Heart J. (2021) 42:1687–95. doi: 10.1093/eurheartj/ehaa763
16. Honarbakhsh S, Providencia R, Garcia-Hernandez J, Martin CA, Hunter RJ, Lim WY, et al. A primary prevention clinical risk score model for patients with Brugada syndrome (BRUGADA-RISK). JACC Clin Electrophysiol. (2021) 7:210–22. doi: 10.1016/j.jacep.2020.08.032
17. Kawazoe H, Nakano Y, Ochi H, Takagi M, Hayashi Y, Uchimura Y, et al. Risk stratification of ventricular fibrillation in Brugada syndrome using noninvasive scoring methods. Heart Rhythm. (2016) 13:1947–54. doi: 10.1016/j.hrthm.2016.07.009
18. Beaule PE, Shea B, Abedlbary H, Ahmadzai N, Skidmore B, Mallick R, et al. A protocol for a systematic review of the diagnostic accuracy of blood markers, synovial fluid, and tissue testing in periprosthetic joint infections (PJI). Syst Rev. (2015) 4:148. doi: 10.1186/s13643-015-0124-1
19. Rodríguez-Mañero M, Baluja A, Hernández J, Muñoz C, Calvo D, Fernández-Armenta J, et al. Validation of multiparametric approaches for the prediction of sudden cardiac death in patients with Brugada syndrome and electrophysiological study. Rev Esp Cardiol (Engl Ed). (2021) S1885-5857(21)00223-1. doi: 10.1016/j.rec.2021.07.007
20. Chow JJ, Leong KMW, Yazdani M, Huzaien HW, Jones S, Shun-Shin MJ, et al. A multicenter external validation of a score model to predict risk of events in patients with Brugada syndrome. Am J Cardiol. (2021) 160:53–9. doi: 10.1016/j.amjcard.2021.08.035
Keywords: Brugada syndrome, multiparametric models, predictive performance, sudden cardiac death (SCD), implantable cardioverter-defibrillator (ICD)
Citation: Wei H-t, Liu W, Ma Y-R and Chen S (2022) Performance of Multiparametric Models in Patients With Brugada Syndrome: A Systematic Review and Meta-Analysis. Front. Cardiovasc. Med. 9:859771. doi: 10.3389/fcvm.2022.859771
Received: 21 January 2022; Accepted: 04 March 2022;
Published: 14 April 2022.
Edited by:
Alessandro Zorzi, University Hospital of Padua, ItalyReviewed by:
Jizhe Xu, First Hospital of Lanzhou University, ChinaYuan Bai, Changhai Hospital, China
Xiaofei Jiang, Zhuhai People's Hospital, China
Copyright © 2022 Wei, Liu, Ma and Chen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yue-Rong Ma, mayr666@163.com; Shi Chen, chenshi19840920@163.com
†These authors have contributed equally to this work and share first authorship
‡These authors have contributed equally to this work