SYSTEMATIC REVIEW article

Front. Pharmacol., 22 January 2024

Sec. Pharmacology of Anti-Cancer Drugs

Volume 15 - 2024 | https://doi.org/10.3389/fphar.2024.1293039

The efficacy of bevacizumab combined with platinum-containing chemotherapy in the treatment of advanced non-small cell lung cancer in China: a systematic review and meta-analysis of randomized clinical trials

  • 1. Institute of Integrated Traditional Chinese and Western Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China

  • 2. Department of Integrated Traditional Chinese and Western Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China

Abstract

Background: Platinum-based dual-drug first-line chemotherapy is commonly employed in the treatment of patients with advanced non-small cell lung cancer (NSCLC), although its clinical efficacy is limited. Bevacizumab can antagonize vascular endothelial cell growth factor (VEGF), which inhibit tumor angiogenesis and prevent tumor invasion and development. However, a comprehensive meta-analysis evaluating the effectiveness and safety of combining bevacizumab with platinum-based chemotherapy in advanced NSCLC patients is lacking.

Methods: Randomized controlled trials (RCTs) investigating the combination therapy of bevacizumab and platinum-based chemotherapy for treating advanced NSCLC were searched across six databases. Data on objective response rate (ORR), disease control rate (DCR), 1-year survival rate, 2-year survival rate, 3-year survival rate, VEGF levels, and side effects were synthesized. Relative risk degree (RR) along with 95% confidence interval (CI) was used as statistical analysis measures for binary outcomes while continuous variables were analyzed using mean difference (MD) along with 95% CI. Heterogeneity was evaluated by Chi-squared and I2 tests. If there was heterogeneity, subgroup analysis was performed. Sensitivity analysis of the main outcome measures and assessment of publication bias were also performed.

Results: According to our screening criteria, a total of Forty-nine RCTs were included, involving data from 4268 patients. The results of this analysis showed that compared with platinum-containing chemotherapy alone, bevacizumab combined with platinum-containing chemotherapy significantly improved ORR (RR [95% CI], 1.53 [1.44, 1.63], p < 0.00001), DCR (RR [95% CI], 1.24 [1.19, 1.29], p < 0.0001), 1-year survival rate (RR [95% CI], 1.34 [1.15, 1.57], p = 0.0003), 2-year survival rate (RR [95% CI], 2.16 [1.35, 3.43], p = 0.001), 3-year survival rate (RR [95% CI], 2.00 [1.21, 3.30], p = 0.007). In addition, bevacizumab with platinum-containing chemotherapy observably decreased the VEGF levels (RR [95% CI], āˆ’67.35 [āˆ’91.46, āˆ’43.25], p < 0.00001).

Conclusion: Combination therapy involving bevacizumab demonstrated improved antitumor effects compared to chemotherapy alone in terms of ORR, DCR, 1-year survival rate, 2-year survival rate, 3-year survival rate, and VEGF levels without an increased incidence of adverse reactions. These analyses’ results can provide clinicians guidance when selecting appropriate treatments for patients diagnosed with advanced non-small cell lung cancer.

Introduction

Lung cancer is the most common malignancy worldwide and has the highest mortality rate of all cancers. It is estimated that by 2030, it will cause 2 million deaths a year worldwide (Mattiuzzi and Lippi, 2019). Lung cancer can be classified into small-cell lung cancer (SCLC) and non-small cell lung cancer (NSCLC). NSCLC, as a group of histological subtypes, accounts for 80 percent of total lung cancer diagnoses (Thai et al., 2021). In the early stage of non-small cell lung cancer, there is a lack, leading to most diagnosed at an advanced stage and missing the opportunity for radical surgery. In the past 2Ā decades, the emergence of targeted therapy and the application of immunotherapy have made substantial progress in the treatment of NSCLC. Antibodies to CTLA-4, PD-1, PD-L1 and other immune checkpoints have been approved by the US FDA for the treatment of a variety of tumors, including non-small cell lung cancer (Le et al., 2017). It has been included in the latest global cancer treatment guidelines (Planchard et al., 2018). Nevertheless, the existence of drug resistance still makes its accessibility and effectiveness limited (Herbst et al., 2018). Platinum-based dual-drug first-line chemotherapy is commonly used for advanced NSCLC treatment; however, patients exhibit low sensitivity to this approach with an overall effective rate ranging from 25.0% to 35.0% (Chino et al., 2016). Therefore, it has become imperative to identify an efficient comprehensive treatment method for advanced NSCLC from traditional chemotherapy, targeted and immunotherapy have emerged as novel treatment modalities.

The formation of blood vessels plays an important role in the growth and metastasis of tumors, and vascular endothelial growth factor (VEGF) is named for its ability to promote endothelial cell proliferation and lumen formation, and its overexpression is associated with poor prognosis in patients with non-small cell lung cancer (Niki et al., 2017). Bevacizumab, a monoclonal antibody with high affinity towards VEGF, is frequently employed in the management of ovarian cancer, advanced metastatic colorectal cancer, and other diseases (Fan et al., 2019). By competitively binding with by tumor tissues, bevacizumab inhibits angiogenesis within these tissues while preventing tumor cell proliferation. Additionally, bevacizumab improves blood vessel function, microenvironment and enhances drug concentration within cancer tissues thereby achieving favorable therapeutic effects (Zheng et al., 2018). Clinical studies have demonstrated that bevacizumab confers significant survival benefits in patients with advanced NSCLC (Yang et al., 2018). There have been similar meta-analyses of bevacizumab combined with chemotherapy in the treatment of non-small cell lung cancer, but some of them only involved overall survival (OS), progression-free survival (PFS) and side effects (Botrel et al., 2011), and some lacked further verification regarding disease control rate (DCR) which serves as an important indicator (Zhou et al., 2021). The objective of this systematic review and meta-analysis was to comprehensively evaluate the efficacy and safety of bevacizumab and platinum-containing chemotherapy in the treatment of advanced NSCLC by including more recent studies.

Materials and methods

Search strategy

We followed the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) checklist for systematic reviews and meta-analyses (Liberati et al., 2009). We conducted a systematic search for randomized controlled trials investigating the combination of bevacizumab and platinum-containing chemotherapy in patients with advanced NSCLC published in six databases from January 2018 to April 2023, including PubMed, Web of Science, the Cochrane Library, Wan Fang Database, Chinese VIP Information (VIP) and China National Knowledge Infrastructure (CNKI).

The strategy of combining subject words and free words is adopted to search. In the Chinese database, the following words are used in a combination manner: ā€œBei fazhu,ā€ ā€œfeixiao xibao feiaiā€ and ā€œhualiaoā€; for the English databases, the text terms we use include ā€œBevacizumab,ā€ ā€œCarcinoma, Non-Small-Cell Lungā€ and ā€œDrug Therapyā€

Selection criteria

The inclusion criteria were as follows: 1) study design: randomized randomized controlled trials (RCTs). 2) population: pathologically, cytologically or histologically confirmed to have advanced NSCLC. 3) intervention: the control group was treated with platinum-containing chemotherapy and correspondingly, the experimental group was treated with bevacizumab on the basis of the control group. 4) outcome: objective response rate, disease control rate, year survival rate, progression-free survival, overall survival, VEGF levels and treatment-related aside effects.

The exclusion criteria were as follows: 1) non-RCTs including case reports, reviews, animal or cell studies and studies without a control group. 2) The interventions were not bevacizumab and platinum-containing chemotherapy. 3) ambiguous results of statistical methods and research indicators, difficult to extract outcome indicators data, and multiple publications. 4) The patient had small cell lung cancer or early-stage NSCLC.

Data extraction

Data extraction was carried out independently by two reviewers (Guang Su Han and Chen Lu Li) and differences on study eligibility were resolved by consensus. The key information extracted by the evaluators is as follows: the author, year of publication, the number of participants, intervention details, the TNM stage of NSCLC and relevant outcomes.

Methodological quality

Two researchers (Guang Su Han and Chen Lu Li) independently evaluated the quality of the included literature using the Cochrane risk of bias tool. The following six criteria were evaluated: 1) random sequence generation and allocation concealment; 2) blinding of participants and personnel; 3) blinding of outcome assessment; 4) incomplete outcome data; 5) selective reporting; 6) other bias. Differences arising in the process of quality evaluation were resolved through mutual consultation and discussion.

Data synthesis and analysis

In this study, Review Manager (ver. 5.3) and STATA (ver.14) software were used for statistical analysis. RR and 95%CI were used as effect analysis statistics to treat binary outcomes. Continuous variables were analyzed by MD and 95%CI. p < 0.05 means the difference is statistically significant. Heterogeneity was evaluated by Chi-squared and I2 tests. If p > 0.1 and I2 < 50%, indicating that there was no statistical heterogeneity among the studies, and a fixed effect model was used for meta-analysis; If the heterogeneity was moderate or severe (p ≤ 0.1 or I2 ≄ 50%), the factors that might lead to heterogeneity were analyzed by subgroup analysis. If there was heterogeneity between the two studies and the clinical difference was not statistically significant, we choose a random-effect model. Then we performed sensitivity analyses to account for the effect of changing the study mode on the results of the pooled analysis. Since more than 10 studies were included, publication bias was identified using Begg’s tests and p-value > 0.05 was considered as no publication bias.

Results

Study inclusions

734 literatures that meet the screening requirements were initially searched from the database, including 191 repeated records (Figure 1). After that, 330 studies were included by reviewing the titles and abstracts of the remaining 543 studies and removing 213 reviews, animal or cell experiments, case reports, and other inconsistent literature. Finally, studies with no control group or platinum-containing chemotherapy regimen were excluded (n = 281), and 49 RCTs were selected in this systematic analysis (Dang et al., 2018; Ding and Zhu, 2018; Duan et al., 2018; Luo and Liu, 2018; Gui, 2019; Ma, 2019; Chen, 2020; Duan, 2020; Han, 2020; Li, 2020; Liao, 2020; Chang et al., 2021; Dai et al., 2021; Du, 2021; Fan, 2021; Huang and Du, 2021; Mao, 2021; Pan and Xia, 2021; Chen et al., 2022a; Liu et al., 2022a; Chen et al., 2022b; Liu et al., 2022b; He, 2022; Li et al., 2022; Liu, 2022; Ning et al., 2022; Shi, 2022; Song et al., 2019; Sun et al., 2019; Xu, 2019; Zhai et al., 2019; Wang et al., 2020a; Wang et al., 2020b; Song et al., 2020; Wang and Qian, 2020; Wu, 2020; Zhang, 2020; Zhang and Wang, 2020; Song, 2021; Wang, 2021; Wang and Zheng, 2021; Yuan, 2021; Tian and Wang, 2022; Wu et al., 2022; Yang, 2022; Ye et al., 2022; Zeng and Li, 2022; Sun, 2023; Zhou and Rong, 2023).

FIGURE 1

Characteristics of the studies

A total of forty-nine studies were included in the evaluation, and 4268 patients were studied. All RCTs originated from China. The year of publication was between 2018 and 2023. The characteristics of patients in the selected studies include age, gender, clinical stage, chemotherapy regimen, and treatment indicators, which are summarized in Table 1.

TABLE 1

StudySample size (E/C)Sex (male/female) (C E)AgeClinical stageControl group (C)Experiment group (E)First treatmentOutcome
Chang et al., 202160/6034/26 32/2850.22 ± 2.22 50.02 ± 2.19ā…¢b,ā…£TPBevacizumab + TPNO①⑨⑩
Chen 202037/3723/14 24/1355.10 ± 6.82 54.86 ± 7.13ā…¢b,ā…£GPBevacizumab + GPNO③⑨⑩
Chen et al., 202250/5034/16 32/1871.51 ± 7.68 72.46 ± 7.52ā…¢,ā…£APBevacizumab + APYESā‘ ā‘©
Chen hailong et al., 202243/4325/18 23/2060.25 ± 4.06 59.76 ± 4.11ā…¢,ā…£APBevacizumab + APYES①⑨⑩
Dai et al., 202140/4023/17 25/1558.69 ± 4.36 58.57 ± 5.42ā…¢b,ā…£TPBevacizumab + TPYES①⑨⑩
Dang et al., 201831/3117/14 18/1355.17 ± 3.08 54.82 ± 3.49ā…¢b,ā…£APBevacizumab + APNO①⑦⑨⑩
Ding and Zhu 201845/4526/19 27/1855.53 ± 6.26 55.42 ± 6.14ā…¢b,ā…£TPBevacizumab + TPNO⑔⑦⑧⑩
Du 202172/7246/26 45/2752.36 ± 1.38 52.15 ± 1.34advancedAPBevacizumab + APNOā‘ 
Duan 202044/4426/18 27/1761.8 ± 5.7 62.1 ± 5.8advancedTPBevacizumab + TPYESā‘ ā‘©
Duan et al., 201893/9352/41 55/3858.3 ± 10.6 57.9 ± 11.2ā…¢b,ā…£GPBevacizumab + GPYES①⑨⑩
Fan 202119/1912/7 13/660.55 ± 6.74 61.52 ± 6.35advancedTPBevacizumab + TPNO⑔⑩
Gui 201942/4228/14 25/1759.8 ± 5.1 60.8 ± 5.5ā…¢a,ā…¢bTPBevacizumab + TPYES①⑦⑧⑩
Han 202026/2613/13 12/1445.52 ± 4.33 46.21 ± 3.26ā…¢,ā…£APBevacizumab + APYESā‘”
He 202245/4525/20 27/1850.98 ± 3.34 51.06 ± 3.45ā…¢,ā…£TPBevacizumab + TPYES③⑩
Huang and Du 202133/3221/11 21/1245.18 ± 5.34 45.21 ± 5.06advancedAP/DPBevacizumab + AP/DPYES③⑩
Li 202050/5023/27 22/2859.6 ± 10.3 59.6 ± 10.3ā…¢,ā…£TPBevacizumab + TPNOā‘ 
Li et al., 202240/4019/21 22/1846.97 ± 6.71 47.13 ± 6.54ā…¢,ā…£GPBevacizumab + GPYES①⑨⑩
Liao 202040/4030/10 28/1258.69 ± 5.23 58.63 ± 5.24advancedTPBevacizumab + TPNOā‘¢
Liu 202236/3621/15 20/1651/59 ± 9.63 51.56 ± 9.69ā…¢,ā…£APBevacizumab + APNO①⑨⑩
Liu et al., 202236/3620/16 19/1754.89 ± 6.56 54.96 ± 6.68ā…¢b,ā…£GPBevacizumab + GPNO③⑩
Liu zhen et al., 202238/4227/15 25/1363.47 ± 5.15 63.42 ± 5.13ā…¢,ā…£TPBevacizumab + TPNO①⑨⑩
Luo and Liu 201851/5133/18 32/1950.29 ± 8.53 50.83 ± 8.61ā…¢b,ā…£APBevacizumab + APYES①⑦⑩
Ma 201960/6037/23 34/2664.9 ± 4.7 64.2 ± 4.2ā…¢,ā…£TPBevacizumab + TPYESā‘ ā‘©
Mao 202125/2513/12 14/1167.19 ± 3.27 67.43 ± 3.52advancedAPBevacizumab + APNOā‘ ā‘©
Ning et al., 202275/7540/35 43/3258.33 ± 6.45 58.90 ± 7.08ā…¢,ā…£TPBevacizumab + TPYES⑔⑨⑩
Pan and Xia 202140/4026/14 28/1264.85 ± 9.30 65.74 ± 8.28ā…¢,ā…£APBevacizumab + APNOā‘ ā‘©
Shi 202241/4123/18 22/1967.67 ± 4.44 67.20 ± 4.59ā…¢b,ā…£TPBevacizumab + TPNOā‘ ā‘©
Song 202131/3117/14 16/1568.14 ± 3.54 67.54 ± 3.19advancedAPBevacizumab + APNO①④⑄⑧⑩
Song et al., 201930/3017/13 16/1454.18 ± 8.42 54.36 ± 8.38ā…¢,ā…£APBevacizumab + APNO①④⑤⑄⑨⑩
Song et al., 202041/3928/11 26/1553.72 ± 6.48 55.45 ± 7.12ā…¢,ā…£TPBevacizumab + TPNO⑔⑨⑩
Sun 202341/4123/18 22/1966.22 ± 6.82 65.78 ± 7.28ā…¢,ā…£PPBevacizumab + PPNOā‘ ā‘©
Sun et al., 201960/6041/19 39/2160.9 ± 6.8 61.1 ± 6.7ā…¢,ā…£TPBevacizumab + TPNO①⑨⑩
Tian and Wang 202251/5131/20 32/1960.17 ± 10.45 60.29 ± 10.75ā…¢b,ā…£TPBevacizumab + TPYES①⑨⑩
Wang 202143/4323/20 25/1847.79 ± 2.63 47.82 ± 2.59advancedAPBevacizumab + APNOā‘ ā‘©
Wang and Qian 202030/3018/12 19/1161.25 ± 4.87 61.26 ± 4.84ā…¢b,ā…£DPBevacizumab + DPNOā‘ ā‘©
Wang and Zheng 202128/2817/11 18/1057.08 ± 8.48 56.47 ± 8.55ā…¢b,ā…£AP/DP/GPBevacizumab + AP/DP/GPNO③⑩
Wang daofeng et al., 202032/3220/12 21/1157.96 ± 7.94 58.45 ± 7.71ā…¢b,ā…£DDPBevacizumab + DDPNO③⑩
Wang et al., 202036/3625/11 22/1469.13 ± 7.89 68.59 ± 8.65ā…¢b,ā…£DDPBevacizumab + DDPNO③④⑤⑨⑩
Wu 202030/3012/18 14/1642.68 ± 2.62 43.34 ± 2.24ā…¢b,ā…£TPBevacizumab + TPNO③⑩
Wu et al., 202250/5028/22 29/2161.2 ± 4.1 61.8 ± 3.4advancedAPBevacizumab + APYES①⑦⑩
Xu 201933/3318/15 17/1662.34 ± 5.64 61.28 ± 5.34advancedAPBevacizumab + APYES③⑩
Yang 202273/7334/39 36/3763.20 ± 6.55 64.10 ± 6.70ā…¢,ā…£AP/TPBevacizumab + AP/TPNO③⑨⑩
Ye et al., 202250/5035/15 37/1155.62 ± 5.37 54.39 ± 6.21advancedTPBevacizumab + TPYES①⑦⑨⑩
Yuan 2021101/10172/29 75/2655.38 ± 2.61 56.01 ± 4.42ā…¢,ā…£TPBevacizumab + TPNOā‘ ā‘©
Zeng and Li 202225/2514/11 13/1256.45 ± 13.29 45.94 ± 13.41ā…¢,ā…£TPBevacizumab + TPYES①⑨⑩
Zhai et al., 201944/4427/17 29/1571.03 ± 8.11 70.14 ± 9.25ā…¢b,ā…£TPBevacizumab + TPNO①④⑤⑩
Zhang 202030/3017/13 18/1254.73 ± 5.10 54.76 ± 5.15ā…¢,ā…£APBevacizumab + APNOā‘ 
Zhang and Wang 202030/3017/13 16/1446.12 ± 8.01 46.23 ± 7.86ā…¢b,ā…£APBevacizumab + APNO①⑦⑨
Zhou and Rong 202333/3222/10 23/1055.31 ± 3.23 55.52 ± 3.17ā…¢,ā…£TPBevacizumab + TPNO①⑦⑧⑨⑩

Characteristics of RCTs included in the study. (GP, Gemcitabine; AP, Pemetrexed; TP/DDP/PP, Taxol; DP, Docetaxel; ā‘ Efficacy (RECIST); ā‘”Efficacy (WHO); ā‘¢Efficacy (Not mentioned); ā‘£1-year survival; ⑤2-year survival; ā‘„3-year survival; ⑦Progression-free survival; ā‘§Overall survival; ⑨VEGF; ā‘©Adverse reaction).

Quality assessment

The assessment of the bias risk of these 49 RCTs was shown in Figure 2. All of these studies described specific random sequence generation. However, the detailed reporting of allocation, concealment, and blinding of outcome assessment had not been addressed in any studies. As for performance bias, it was mentioned in only two studies. The results of each study had been faithfully reported, so we consider all studies to be free of reporting bias (Figures 2, 3).

FIGURE 2

FIGURE 3

Tumor response

Forty-nine studies reported short-term efficacy of bevacizumab in combination with platinum-containing chemotherapy for advanced NSCLC. As there was no heterogeneity (χ2 = 41.20, p = 0. 75, I2 = 0%; Z = 13.57, p < 0.00001), we chose a fixed effects model for the analysis. As shown in Figure 4, the objective response rate (ORR) was higher in the experimental group than in the control group (RR [95% CI], 1.53 [1.44, 1.63], p < 0.00001). For the disease control rate (DCR), the test of heterogeneity (χ2 = 97.96, p < 0.0001, I2 = 51%; Z = 9.99, p < 0.00001) suggested that there was significant heterogeneity, so the random models were employed to combine effect sizes. Compared with platinum-based chemotherapy alone, the addition of bevacizumab had a better effect in terms of DCR (RR [95% CI], 1.24 [1.19, 1.29], p < 0.0001) (Figure 5). We then performed regression and subgroup analyses, which showed no significant differences in evaluation criteria, chemotherapy agents, and first treatment (Supplementary Figures S1, S2).

FIGURE 4

FIGURE 5

1, 2, and 3-year survival rate

The heterogeneity test suggested that there was no statistical heterogeneity among the studies, so the fixed effects model was selected. Four articles reported 1-year survival rate (χ2 = 1.00, p = 0.80, I2 = 0%; Z = 3.65, p = 0.0003), which showed that bevacizumab plus platinum-based chemotherapy was superior to chemotherapy alone (RR [95% CI], 1.34 [1.15, 1.57], p = 0.0003) (Figure 6). Three studies reported 2-year survival (χ2 = 0.09, p = 0.95, I2 = 0%; Z = 3.24, p = 0.001), which was superior with bevacizumab plus platinum-based chemotherapy (RR [95% CI], 2.16 [1.35, 3.43], p = 0.001) (Figure 7). Two studies reported 3-year survival (χ2 = 1.34, p = 0.25, I2 = 26%; Z = 2.72, p = 0.007), which was also significantly higher in the combination group (RR [95% CI], 2.00 [1.21, 3.30], p = 0.007) (Figure 8).

FIGURE 6

FIGURE 7

FIGURE 8

VEGF levels

Sixteen articles reported changes in serum VEGF levels before and after chemotherapy. The results of heterogeneity test showed that there was statistical heterogeneity among the studies (χ2 = 362.35, p < 0.00001, I2 = 96%; Z = 5.48, p < 0.00001), so a random effects model was chosen to combine effect sizes. The results of the analysis showed that the combination treatment group reduced VEGF levels better than the control group (RR [95% CI], āˆ’67.35 [āˆ’91.46, āˆ’43.25], p < 0.00001) (Figure 9).

FIGURE 9

Side effects

The adverse reactions of chemotherapy involved in this study mainly included gastrointestinal reactions, bone marrow suppression, liver and kidney injury, and hematological toxicity. The results of Meta-analysis showed that there was no significant difference in the incidence of gastrointestinal reactions (RR [95% CI], 0.96 [0.88, 1.05], p = 0.38), myelosuppression (RR [95% CI], 0.95 [0.84, 1.09],p = 0.48), liver and kidney dysfunction (RR [95% CI], 0.92 [0.70, 1.20], p = 0.52) and hematologic toxicity (thrombocytopenia: RR [95% CI], 0.88 [0.72, 1.07], p = 0.20; leukopenia: RR [95% CI], 0.95 [0.81, 1.11], p = 0.49; hemoglobin reduction: RR [95% CI], 0.89 [0.71, 1.12], p = 0.31) between the experimental group and the control group (Supplementary Figures S3–S8).

Publication bias and sensitivity analysis

Begg’s test was used to analyze the publication bias of ORR and DCR, and the results showed that publication bias may have a certain impact on the objective response rate and disease control rate (ORR: p = 0.000; DCR: p = 0.000) (Figure 10). Subsequently, sensitivity analysis was performed on outcome indicators such as objective response rate and disease control rate, and the results showed that the change of effect model had no significant effect on the combined results (Figure 11).

FIGURE 10

FIGURE 11

Discussion

Despite major advances in molecular targeted therapy and immunotherapy in the past few years, platinum regimens remain the most active combination in clinical practice (Watanabe et al., 2017), Combination therapy has gained prominence in clinical practice. This systematic review and meta-analysis aim to assess the efficacy and safety of combining bevacizumab with platinum-containing chemotherapy in advanced NSCLC. The findings demonstrate superior objective response rate, disease control rate, 1/2/3-year survival rates, as well as a greater reduction in VEGF levels when compared to platinum-based chemotherapy alone. Furthermore, the combination therapy does not augment the adverse effects associated with chemotherapy alone while ensuring its safety is maintained.

Response Evaluation Criteria in Solid Tumors (RECIST) reflects the therapeutic effect of clinical tumors by detecting changes in tumor burden, including tumor shrinkage (objective response) and disease progression. ORR was evaluated as complete response (CR) and partial response (PR). DCR included CR or PR in all patients and stable disease (SD) in patients with progressive disease (PD) at the time of chemotherapy (Eisenhauer et al., 2009).

The 49 studies included in this meta-analysis reported ORR and DCR. The results of statistical analysis proved that bevacizumab combined with platinum-based chemotherapy had a significant advantage in improving ORR (RR 1.53) and DCR (RR 1.24) compared with platinum-based chemotherapy alone. The results of the ORR analysis are consistent with those of previous studies (Zhou et al., 2021). However, the significant improvement in DCR outcomes with the bevacizumab-containing therapy in our analysis is inconsistent with this finding. The study did not show significant outcomes with DCR, and the authors suggest that one of the studies may have influenced the results, acknowledging that the limited number of included RCTS limits the positive findings. Then subgroup analysis was performed according to the different chemotherapy drugs and whether they received anti-tumor treatment for the first time. Subgroup analyses showed no statistically significant differences between groups, indicating a significant benefit of bevacizumab-containing chemotherapy in improving DCR regardless of differences in the use of platinum-based chemotherapy agents or whether patients had received prior anticancer therapy.

For patients with advanced cancer, the annual survival rate is an important parameter in evaluating prognosis. In our analysis, the results of 1-year/2-year/3-year survival rates demonstrated a significant improvement in survival time for patients with advanced NSCLC when bevacizumab was combined with platinum compared to chemotherapy alone. However, due to limited literature included in of the evidence is relatively low, necessitating further data analysis to substantiate this conclusion in future studies.

Chemotherapy commonly used in clinical practice for NSCLC patients usually leads to serious adverse reactions, such as gastrointestinal reactions, bone marrow suppression, liver and kidney damage, etc. (Mangal et al., 2017) The results of our analysis show that the addition of bevacizumab to platinum-based chemotherapy does not increase the incidence of side effects of chemotherapy and confirm that bevacizumab has an acceptable safety profile, even when combined with different chemotherapy regimens. This conclusion is consistent with the results of the previous phase 4 study (Crinò et al., 2010).

Currently, extensive research on molecular targeted therapy for malignant tumors is being conducted in clinical practice, leading to of various targeted therapy drugs that have significantly improved the efficacy and control of malignant tumors. Studies have shown that neovascularization is closely related to the formation, development and prognosis of tumors. In the process of solid tumor growth, a variety of vascular growth factors are usually produced to promote the formation of new blood vessels. Among them, VEGF is considered to be the key factor inducing tumor angiogenesis. A number of studies have confirmed that VEGF is highly expressed in lung cancer, gastric cancer, intravascular sarcoma, gastrointestinal tumors and gynecological tumors (Lu et al., 2019). Blocking VEGF signaling can restore the vascular system to a more normal state, and improve the permeability of drugs in the tumor through the decrease of intercellular fluid pressure and the increase of tumor oxygenation, thereby enhancing the efficacy of chemotherapy (Jain, 2005). Bevacizumab can competitively bind to VEGF released by cancer tissues to impede angiogenesis within these tissues and inhibit tumor cell proliferation. Our findings suggest that bevacizumab combined with platinum-based chemotherapy can effectively reduce serum VEGF levels in patients with advanced NSCLC, which is consistent with the results of previous meta-analysis.

In conclusion, this meta-analysis showed that the combination of bevacizumab significantly improved the efficacy of chemotherapy and prolonged survival in patients with advanced non-small-cell lung cancer, without causing an increase in serious adverse effects.

Limitations

All the studies included in this Meta-analysis were Chinese, which may lack sufficient representativeness and generalization across different countries. Further studies on different populations are needed to verify the generalizability of our findings. In addition, the description of distribution concealment and blinding was missing in most of the literature, resulting in a reduction in the quality of the included studies. The diversity of chemotherapeutic drugs also affected the results to a certain extent.

Conclusion

Bevacizumab can enhance drug efficacy and improve the prognosis. In patients with advanced NSCLC, the efficacy of bevacizumab combined with platinum-based chemotherapy is better than that of single chemotherapy, and it does not increase the incidence of side effects of chemotherapy. These findings provide support for clinical treatment, suggesting that bevacizumab combination therapy in the treatment of advanced NSCLC has a significant benefit, with a modest safety profile. Further follow-up in the real world is needed to clarify its long-term benefits.

Statements

Data availability statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.

Author contributions

GH: Writing–original draft, Writing–review and editing. CL: Writing–review and editing. PY: Writing–review and editing.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This article was supported by the National Natural Science Foundation of China (No. 82174457).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fphar.2024.1293039/full#supplementary-material

References

  • 1

    BotrelT. E.ClarkO.ClarkL.PaladiniL.FaleirosE.PegorettiB. (2011). Efficacy of bevacizumab (Bev) plus chemotherapy (CT) compared to CT alone in previously untreated locally advanced or metastatic non-small cell lung cancer (NSCLC): systematic review and meta-analysis. Lung cancer (Amsterdam, Neth.74 (1), 89–97. 10.1016/j.lungcan.2011.01.028

  • 2

    ChangX.PangH.LiuX. (2021). Efficacy of bevacizumab combined with paclitaxel and cisplatin chemotherapy in the treatment of non-small cell lung cancer. Chin J Cancer Clin. Rehabilitation28 (11), 1357–1360. 10.13455/j.cnki.cjcor.2021.11.20

  • 3

    ChenH.XieC.ZhongQ.et al (2022b). Effect of bevacizumab combined with chemotherapy on serum VEGF and bFGF levels in patients with advanced non-squamous carcinoma and non-small cell lung cancer. J. Drug Eval.19 (16), 996–999. 10.19939/j.cnki.1672-2809.2022.16.11

  • 4

    ChenM.LiL.LiaoX.et al (2022a). Effect of bevacizumab combined with pemetrexed plus carboplatin neoadjuvant chemotherapy on immune and cognitive function in elderly patients with non-small cell lung cancer. Big Dr.7 (11), 26–29.

  • 5

    ChenW. (2020). Efficacy of bevacizumab combined with GP chemotherapy in patients with advanced non-small cell lung cancer. Chin. Med. J.32 (8), 13–15. 10.3969/j.issn.1672-0369.2020.08.005

  • 6

    ChinoH.AmanoY.YamauchiY.MatsudaJ.TakedaN.TanakaG.et al (2016). Cardiogenic syncope possibly related to bevacizumab-containing combination chemotherapy for advanced non-small cell lung cancer. J. Thorac. Dis.8 (9), 2646–2650. 10.21037/jtd.2016.08.96

  • 7

    CrinòL.DansinE.GarridoP.GriesingerF.LaskinJ.PavlakisN.et al (2010). Safety and efficacy of first-line bevacizumab-based therapy in advanced non-squamous non-small-cell lung cancer (SAiL, MO19390): a phase 4 study. Lancet. Oncol.11 (8), 733–740. 10.1016/S1470-2045(10)70151-0

  • 8

    DaiL.WangX.YangW.et al (2021). Effects of bevacizumab combined with TP chemotherapy regimen on immune function, quality of life and serum tumor markers in patients with advanced non-squamous carcinoma and non-small cell lung cancer. Adv. Mod. Biomed.21 (11), 2174–2178. 10.13241/j.cnki.pmb.2021.11.038

  • 9

    DangM.XiY.YanL.et al (2018). Efficacy and safety analysis of bevacizumab combined with PC chemotherapy in the treatment of non-small cell lung cancer. Henan Med. Res.27 (7), 1199–1201. 10.3969/j.issn.1004-437X.2018.07.016

  • 10

    DingQ.ZhuS. (2018). Effect of bevacizumab combined with PC chemotherapy on disease control rate and survival cycle of patients with non-small cell lung cancer. J. Med. Forum39 (6), 63–65.

  • 11

    DuW. (2021). Clinical study of bevacizumab in the treatment of advanced EGFR mutated non-small cell lung cancer. Health Must Read. (26), 30.

  • 12

    DuanH. (2020). Clinical study of Bevacizumab combined with TP chemotherapy in the treatment of advanced non-squamous non-small cell lung cancer. Gt. Health129 (17), 131.

  • 13

    DuanJ.YangZ.LiuD.ShiY. (2018). Clinical efficacy of bevacizumab combined with gemcitabine and cisplatin combination chemotherapy in the treatment of advanced non-small cell lung cancer. J. buon23 (5), 1402–1406.

  • 14

    EisenhauerE. A.TherasseP.BogaertsJ.SchwartzL. H.SargentD.FordR.et al (2009). New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). Eur. J. Cancer45 (2), 228–247. 10.1016/j.ejca.2008.10.026

  • 15

    FanC. (2021). Efficacy of bevacizumab combined with chemotherapy in the treatment of advanced non-small cell lung cancer. Electron. J. Clin. Med. Literature8 (30), 21–23.

  • 16

    FanH.YuanJ.WuJ.JiaY. X.MaY. H.LiX. Y. (2019). Influence of polymorphisms of VEGFR2 on clinical outcomes and safety of advanced non-small-cell lung cancer treated by first line Bevacizumab plus chemotherapy regimens. Chin. J. Med.99 (2), 99–104. 10.3760/cma.j.issn.0376-2491.2019.02.005

  • 17

    GuiY. (2019). Efficacy of bevacizumab combined with paclitaxel and carboplatin in the treatment of advanced non-small cell lung cancer. Chin. J. Health Eng.18 (02), 299–301. (in Chinese). 10.19937/j.issn.1671-4199.2019.02.054

  • 18

    HanX. (2020). Application of bevacizumab as an anti-VEGFR pathway drug in the clinical treatment of lung cancer. Med. Food Ther. Health92 (6), 95.

  • 19

    HeJ. (2022). Efficacy of bevacizumab combined with chemotherapy in patients with advanced non-small cell lung cancer (NSCLC). China Sci. Technol. periodical database Med. (5).

  • 20

    HerbstR. S.MorgenszternD.BoshoffC. (2018). The biology and management of non-small cell lung cancer. Nature553 (7689), 446–454. 10.1038/nature25183

  • 21

    HuangG.DuZ. (2021). To investigate the clinical effect of bevacizumab combined with chemotherapy in the treatment of advanced non-small cell lung cancer. Health Must Read. (20), 20.

  • 22

    JainR. K. (2005). Normalization of tumor vasculature: an emerging concept in antiangiogenic therapy. Sci. (New York, N.Y.)307 (5706), 58–62. 10.1126/science.1104819

  • 23

    LeD. T.DurhamJ. N.SmithK. N.WangH.BartlettB. R.AulakhL. K.et al (2017). Mismatch repair deficiency predicts response of solid tumors to PD-1 blockade. Science357 (6349), 409–413. 10.1126/science.aan6733

  • 24

    LiJ.ZhangQ.ZhangL.et al (2022). Effect and safety of Bevacizumab injection on immune function of patients with non-small cell lung cancer. Chin. J. Med. Educ.45 (10), 918–921. 10.3760/cma.J.c.n115455-20210111-00060

  • 25

    LiZ. X. (2020). Effect of bevacizumab combined with paclitaxel and cisplatin in the treatment of non-small cell lung cancer and analysis of the effect on microRNA-99a and miRNA-145. Chin. Pract. Med.15 (6), 99–100. 10.14163/j.cnki.11-5547/r.2020.06.045

  • 26

    LiaoX. (2020). Efficacy of bevacizumab combined with paclitaxel plus cisplatin (TP) in the treatment of advanced non-squamous carcinoma non-small cell lung cancer patients. Health Must-Read (12), 23.

  • 27

    LiberatiA.AltmanD. G.TetzlaffJ.MulrowC.GĆøtzscheP. C.IoannidisJ. P. A.et al (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann. Intern Med.151 (4), W65–W94. 10.7326/0003-4819-151-4-200908180-00136

  • 28

    LiuX.LiuL.ChenL. (2022a). Clinical observation of bevacizumab combined with gemcitabine and cisplatin in the treatment of advanced non-small cell lung cancer. Chin. J. Pract. Med.49 (20), 85–88. 10.3760/cma.J.c.n115689-20220717-03127

  • 29

    LiuZ. (2022). Effect of bevacizumab combined with pemetrexed and cisplatin on vascular endothelial cell growth factor in patients with advanced non-small cell lung cancer. Reflexology Rehabilitation Med.3 (11), 155–157.

  • 30

    LiuZ.DengL.CaoX. (2022b). Clinical efficacy of bevacizumab combined with paclitaxel liposome and cisplatin in patients with non-squamous non-small cell lung cancer. J. Clin. Ration. drug use15 (6).

  • 31

    LuM.ZhouH.ZhouX. G. (2019). Short-term efficacy and toxicity of combination chemotherapy with bevacizumab or angioendostatin in the treatment of locally advanced wild-type non-small cell lung cancer. Chin. J. Tumor Biotherapy26 (4), 67–71. 10.3872/j.issn.1007-385x.2019.04.009

  • 32

    LuoH.LiuK. (2018). Effect of bevacizumab combined with chemotherapy on the expression of vascular endothelial growth factor in advanced non-small cell lung cancer. J. Clin. Pulmonol.23 (2), 220–224. 10.3969/j.issn.1009-6663.2018.02.007

  • 33

    MaC. (2019). Efficacy of bevacizumab combined with paclitaxel and cisplatin in the treatment of non-small cell lung cancer and its effect on microRNA-99a and miRNA-145. J. Clin. Pulmonol.24 (4), 632–636. 10.3969/j.issn.1009-6663.2019.04.012

  • 34

    MangalS.GaoW.LiT.ZhouQ. T. (2017). Pulmonary delivery of nanoparticle chemotherapy for the treatment of lung cancers: challenges and opportunities. Acta Pharmacol. Sin.38 (6), 782–797. 10.1038/aps.2017.34

  • 35

    MaoH. (2021). Efficacy of chemotherapy combined with targeted drugs in advanced non-small cell lung cancer patients. Chin. Sci. Technol. J. Database (full text) Med. Health (7).

  • 36

    MattiuzziC.LippiG. (2019). Current cancer epidemiology. J. Epidemiol. Glob. health9 (4), 217–222. 10.2991/jegh.k.191008.001

  • 37

    NikiM.YokoiT.KurataT.NomuraS. (2017). New prognostic biomarkers and therapeutic effect of bevacizumab for patients with non-small-cell lung cancer. Lung Cancer (Auckl)8, 91–99. 10.2147/LCTT.S138887

  • 38

    NingS.LinC.LuoM.et al (2022). Efficacy of bevacizumab combined with paclitaxel and carboplatin in patients with advanced non-small cell lung cancer. Chin. J. Med. Sci.34 (23), 39–42. 10.3969/j.issn.1672-0369.2022.23.012

  • 39

    PanE.XiaQ. (2021). Effect of bevacizumab combined with chemotherapy in the treatment of non-small cell lung cancer and its effect on T cell subsets and immune function. Chin. Med. Rev.18 (29), 118–121.

  • 40

    PlanchardD.PopatS.KerrK.NovelloS.SmitE. F.Faivre-FinnC.et al (2018). Metastatic non-small cell lung cancer: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann. Oncol.29 (Suppl. 4), iv192–iv237. 10.1093/annonc/mdy275

  • 41

    ShiL. (2022). Effect of bevacizumab combined with chemotherapy in the treatment of advanced non-small cell lung cancer. Clin. Med.42 (8), 103–105. 10.19528/j.iSSN.1003-3548.2022.08.040

  • 42

    SongC.GaoZ.LuG.et al (2019). Effects of anti-VEGF targeted drugs combined with chemotherapy on the incidence, survival time and laboratory indexes of brain metastases in patients with NSCLC. And Clin. Pract. Med.22 (2), 119–122. 10.14053/j.cnki.ppcr.201902002

  • 43

    Songl.HanY.WeiL.et al (2020). Effect of bevacizumab combined with paclitaxel/carboplatin regimen on related cell growth factors and tumor markers in patients with advanced non-squamous non-small cell lung cancer. And Clin. Pract. Med.23 (6). 10.14053/j.cnki.ppcr.202006008

  • 44

    SongZ. J. (2021). Clinical effect of bevacizumab combined with pemetrexed plus cisplatin in advanced non-squamous non-small cell lung cancer. Chin. foreign Med. Res.19 (16), 46–48. 10.14033/j.cnki.cfmr.2021.16.016

  • 45

    SunL.ZhangJ.GeX.et al (2019). Clinical study of bevacizumab combined with TP chemotherapy in the treatment of advanced non-squamous carcinoma non-small cell lung cancer. J. Clin. Exp. Med.18 (15), 1631–1634. 10.3969/j.issn.1671-4695.2019.15.019

  • 46

    SunY. J. (2023). Efficacy of bevacizumab combined with PP in the treatment of non-small cell lung cancer. Diet. Health care (8), 53–56.

  • 47

    ThaiA. A.SolomonB. J.SequistL. V.GainorJ. F.HeistR. S. (2021). Lung cancer. Lancet398 (10299), 535–554. 10.1016/S0140-6736(21)00312-3

  • 48

    TianS.WangJ. (2022). Efficacy of bevacizumab combined with comprehensive nursing in patients with advanced non-squamous carcinoma and non-small cell lung cancer. Mod. Med. Health Res. Electron. Ed.6 (18), 123–125.

  • 49

    WangD.FuJ.FangS. (2020a). Effect of bevacizumab combined with chemotherapy on disease control rate and serum T cell subsets in patients with stage III b/IV non-squamous non-small cell lung cancer. J. Clin. lung25 (8) 10.3969/j.issn.1009-6663.2020.08.022

  • 50

    WangD.FuJ.FangS. (2020b). Efficacy of bevacizumab combined with DDP chemotherapy in patients with non-small cell lung cancer. J. Pract. Clin. Med.24 (22). 10.7619/jcmp.202022002

  • 51

    WangH.QianH. (2020). Clinical observation of bevacizumab combined with chemotherapy in the treatment of advanced non-squamous non-small cell lung cancer. J. Clin. Ration. Drug Use13 (1). 10.15887/j.cnki.13-1389/r.2020.01.030

  • 52

    WangH. L. (2021). Clinical efficacy of bevacizumab combined with chemotherapy in patients with advanced non-small cell lung cancer (NSCLC). Kang Yi (14), 239. 10.12332/j.issn.2095-6525.2021.14.227

  • 53

    WangX.ZhengJ. (2021). Clinical efficacy of bevacizumab combined with chemotherapy in patients with advanced non-small cell lung cancer (NSCLC). Med. Food Ther. Health19 (23), 94–96.

  • 54

    WatanabeS. I.NakagawaK.SuzukiK.TakamochiK.ItoH.OkamiJ.et al (2017). Neoadjuvant and adjuvant therapy for Stage III non-small cell lung cancer. Jpn. J. Clin. Oncol.47 (12), 1112–1118. 10.1093/jjco/hyx147

  • 55

    WuS. Y. (2020). Efficacy of bevacizumab, paclitaxel and cisplatin (TP) chemotherapy in the treatment of advanced non-squamous carcinoma non-small cell lung cancer patients. Chin. J. Health Care38 (10). 10.14033/j.cnki.cfmr.2022.09.007

  • 56

    WuZ.HuangJ.WuY.et al (2022). Clinical effect of bevacizumab combined with chemotherapy in the treatment of advanced non-small cell lung cancer. Med. Res. both A. T. home abroad20 (9). 10.14033/j.cnki.cfmr.2022.09.007

  • 57

    XuJ. (2019). Analysis of the efficacy and safety of bevacizumab in the treatment of advanced non-small cell lung cancer. Chin. J. Pract. Med.14 (34), 116–118. 10.14163/j.cnki.11-5547/r.2019.34.062

  • 58

    YangH.WangC.WangX.et al (2018). Efficacy of bevacizumab in the treatment of elderly non-small cell lung cancer with brain metastases. Southwest Natl. Def. Med.28 (7), 663–665.

  • 59

    YangH. J. (2022). Effect of bevacizumab combined with chemotherapy on the therapeutic efficacy and tumor markers of non-small cell lung cancer. China Prescr. Drugs20 (10).

  • 60

    YeF.HeS.WeiX. M. (2022). Clinical efficacy of TP regimen combined with bevacizumab in the treatment of advanced non-small cell lung cancer and its effect on the expression of programmed T lymphocyte death receptor 1 and cytotoxic T lymphocyte associated antigen 4. Heilongjiang Med. Sci.46 (19), 2323–2326. 10.3969/j.issn.1004-5775.2022.19.005

  • 61

    YuanT. (2021). Effect of chemotherapy with bevacizumab combined with TP regimen in patients with advanced non-small cell lung cancer. Chin. Minkang Med.33 (16), 13–15. 10.3969/j.issn.1672-0369.2021.16.006

  • 62

    ZengH.LiX. (2022). Efficacy of bevacizumab targeted therapy combined with TC chemotherapy in the treatment of advanced non-small cell lung cancer. Chin. J. drug abuse Prev.28 (3), 308–312. 10.15900/j.cnki.zylf1995.2022.03.008

  • 63

    ZhaiZ.YangY.RenZ. (2019). Effects of bevacizumab combined with TC chemotherapy on serum VEGF and bFGF levels and quality of life in elderly patients with advanced NSCLC. Mod. Oncol. Med.27 (9), 1541–1545. 10.3969/j.issn.1672-4992.2019.09.018

  • 64

    ZhangL. (2020). Efficacy of bevacizumab in the treatment of non-small cell lung cancer. Big Dr.5 (24), 56–58.

  • 65

    ZhangQ.WangW. Y. (2020). Efficacy of bevacizumab combined with PC chemotherapy in advanced non-squamous non-small cell lung cancer. Henan Med. Res.29 (13), 2416–2417. (in Chinese). 10.3969/j.issn.1004-437X.2020.13.056

  • 66

    ZhengX.WangH.ZhangG.YanX. (2018). Efficacy and safety of second-line bevacizumab combined with chemotherapy in the treatment of advanced non-squamous non-small cell lung cancer. Chin. J. Lung Cancer21 (7), 513–518. 10.3779/j.issn.1009-3419.2018.07.02

  • 67

    ZhouY.HeM.LiR.PengY.LiF.LiS.et al (2021). The safety and effectiveness of bevacizumab in the treatment of nonsquamous non-small-cell lung cancer: a meta-analysis of randomized controlled trials. BioMed Res. Int.2021, 5537899. 10.1155/2021/5537899

  • 68

    ZhouZ.RongS. (2023). Effects of bevacizumab combined with chemotherapy on immune function and serum CEA, CA125 and CYFRA21-1 levels in patients with advanced non-squamous non-small cell lung cancer. Youjiang Med.51 (3). 10.3969/j.issn.1003-1383.2023.03.013

Summary

Keywords

bevacizumab, non-small cell lung cancer, chemotherapy, meta-analysis, systematic review

Citation

Han G, Li C and Yi P (2024) The efficacy of bevacizumab combined with platinum-containing chemotherapy in the treatment of advanced non-small cell lung cancer in China: a systematic review and meta-analysis of randomized clinical trials. Front. Pharmacol. 15:1293039. doi: 10.3389/fphar.2024.1293039

Received

12 September 2023

Accepted

04 January 2024

Published

22 January 2024

Volume

15 - 2024

Edited by

Qingbin Cui, University of Toledo College of Medicine and Life Sciences, United States

Reviewed by

Ran Wang, Anhui Medical University, China

Melania Rivano, Binaghi Hospital, Italy

Yuyan Wang, New York University, United States

Chen Liang, New York University, United States, reviewed in collaboration with reviewer YW

Updates

Copyright

*Correspondence: Ping Yi,

† These authors have contributed equally to this work

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics