SYSTEMATIC REVIEW article

Front. Public Health, 03 August 2021

Sec. Health Economics

Volume 9 - 2021 | https://doi.org/10.3389/fpubh.2021.706366

Systematic Review and Quality Evaluation of Pharmacoeconomic Studies on Traditional Chinese Medicines

  • 1. West China School of Pharmacy, Sichuan University, Chengdu, China

  • 2. James L. Winkle College of Pharmacy, University of Cincinnati Academic Health Center, Cincinnati, OH, United States

Abstract

Objectives: This study was aimed to find and appraise the available published pharmacoeconomic research on Traditional Chinese Medicine (TCM), to identify related issues and make suggestions for improvement in future research.

Methods: After developing a search strategy and establishing inclusion and exclusion criteria, pharmacoeconomic studies on TCM were sourced from seven Chinese and English databases from inception to April 2020. Basic information about the studies and key pharmacoeconomic items of each study were extracted. The quality of each study was evaluated by using the British Medical Journal economic submissions checklist for authors and peer reviewers, focusing on factors such as study design, research time horizon, sample size, perspective, and evaluation methods.

Results: A total of 431 published pharmacoeconomic articles with 434 studies on topics including cost-effectiveness, cost-benefit, cost-minimization, cost-utility, or combination analyses were identified and included in this review. Of these, 424 were published in Chinese and 7 in English. These studies conducted economic evaluations of 264 Chinese patent medicines and 70 types of TCM prescriptions for 143 diseases, including those of the central nervous, cardiovascular, respiratory, gynecologyical, and other systems. The studied TCMs included blood-activating agents (such as Xuesaitong tablet, Fufant Danshen tablet, and Danhong Injection), blood circulation promoting agents (such as Shuxuetong injection, Rupixiao tablet, and Fufang Danshen injection), and other therapeutic agents. The overall quality score of the studies was 0.62 (range 0.38 to 0.85). The mean quality score of studies in English was 0.72, which was higher than that of studies in Chinese with 0.62.

Conclusions: The quality of pharmacoeconomic studies on TCM was relatively, generally low. Major concerns included study design, inappropriate pharmacoeconomic evaluation, insufficient sample size, or non-scientific assessment. Enhanced methodological training and cooperation, the development of a targeted pharmacoeconomic evaluation guideline, and proposal of a reasonable health outcome index are warranted to improve quality of future studies.

Introduction

Pharmacoeconomics is a complex science that provides evidences for the optimal allocation and efficient utilization of medical resources. Since the 1970s, it has been increasingly accepted and applied by health care providers, health policy makers, and medical insurance institutions. It has also formed part of the basis of new drug applications, drug pricing, drug purchasing by medical institutions, National Essential Medicines List formulation, medical insurance, and post-marketing drug evaluation (13).

With the increasing popularity of and substantial expenditures on complementary and alternative medicine (CAM) therapies globally, the availability of economic evaluations becomes increasingly important (4, 5). However, the quality of those evaluations has significant influence on the popularization and application of the results. A few systematic reviews on economic evaluations of CAM have described findings and quality of available research and have made recommendations for future research (610).

Traditional Chinese Medicine (TCM) as one kind of CAM plays an important role in preventing, treating, and curing disorders and diseases (11, 12). Since 1984, the Drug Administration Law of the People's Republic of China has established the policy governing the development both modern medicines and traditional medicines. In 2020, Chinese patent medicine accounted for more than one third of all the drug approvals in China (13) and for 49.07% of all drugs listed in the National Drug Catalog for Basic Medical Insurance of China (14), equaling the proportion of Western medicines. In recent years, with more attention on economic evaluation of medicines, an increasing amount of pharmacoeconomic research has comprehensively evaluated the efficacy, safety and affordability of TCM. This research provides evidence for the rational use of health resources, essential medicine and state medical insurance catalog selection and national drug price negotiations.

The present study aims to find and appraise the available published pharmacoeconomic studies on TCM, analyze the limitations of the research and make suggestions for improved pharmacoeconomic evaluation on TCM in future.

Materials and Methods

Data Sources

This systematic review was conducteded in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We searched the following databases between their inception (years in parentheses) and April 2020: China National Knowledge Infrastructure(CNKI) (1974), Chongqing VIP Information(VIP) (1989), WanFang Database (1998), Sinomed (1978), Pubmed (1966), Embase (1974), and Cochrane Library (2000).

The search keywords was (“Chinese medicine” OR “Traditional Chinese Medicine” OR “Chinese patent medicine” OR “herbal medicine” OR “natural medicine” OR “Chinese Medicinal Materials” OR “Botanical medicine” OR “Chinese herbal pieces” OR “Chinese medicinal granula”) and (“pharmacoeconomic” OR “economics” OR “Cost Effectiveness Analysis” OR “Cost Utility Analysis” OR “Cost Benefit Analysis” OR “Cost Minimization Analysis” OR “Markov” OR “Decision Tree” OR “Partitioned Survival Model”). Chinese and English terms for search keywords were used when searching the databases. In addition, the references lists of retrieved articles were also searched.

Study Selection

We included the articles describing pharmacoeconomic evaluation articles on TCM, defined as medicines made according to Chinese medicine theory, such as Chinese patent medicine and Chinese medicine prescription or formula. Articles describing research on traditional Chinese treatment or therapy as interventions such as acupuncture, Guasha or massage or theory papers, reviews, reports, protocols, news, and opinion articles, were excluded. Partial economic evaluations, such as outcome, cost, cost-outcome description, effectiveness (or efficacy) evaluation, and cost analysis, quality of life research, and budget impact analysis were also excluded. Besides, the study country was limited in China and study language was limited in Chinese and English.

Data Extraction and Quality Assessment

All articles included in the study were read in full and independently judged against inclusion and exclusion criteria of the individual phase by two authors (HH Zhang and TY Deng). Any difference during assessment between the two reviewers was discussed or resolved by a third dependent reviewer (N Yang). A data extraction table was designed using Excel software, and information extracted from each article including title, first author's name and affiliation, journal and year of publication, information about disease, sample size, study design, intervention, and information related cost, health outcomes, uncertainty analysis, perspective, evaluation techniques, and other factors. The data were descriptively analyzed using Microsoft Excel.

The five most representative checklists or guidelines for evaluation of pharmacoeconomic research are the British Medical Journal (BMJ) checklist (15), Quality of Health Economic Studies (QHES) instrument (16), Consensus Health Economic Criteria (CHEC) (17), Philips guideline (18), and Consolidated Health Economic Evaluation Reporting Standards (CHEERS) (19). Among them, the BMJ checklist was the first to emerge and to be used. Published in 1996, it includes 35 items to assess the quality of articles on economic evaluation, and to date this has been the mostly cited of these appraisal methods (20). Each item of the checklist requires a “yes,” “no,” “unclear,” and “not applicable” response, and this broad form of grading means that the checklist may be used to assess various economic evaluations. Due to its wide application, general recognition in the pharmacoeconomic research field, and flexibility of evaluation items, we used BMJ checklist to evaluate the quality of studies included in this review. The percentage of the applicable items on the BMJ checklist meeting by each study represented the quality score of the study.

The 35 checklist items are organized into 10 sections under three headings including study design, data collection, and analysis and interpretation of results. One mark was awarded for each item with a “yes” response, and a mark of zero for “no” or “unclear.” Each study was scored based on its maximum possible score on the checklist, excluding items irrelevant to the study. The overall quality score was calculated as the mean of the scores of all included studies. A score <0.90 was taken to indicate high quality. Scores of individual items were also recorded.

Results

Study Description

According to the pre-defined search strategy and selection criteria, the databases were searched and identified articles were screened (Figure 1). We eventually included a total of 431 articles including 424 articles in Chinese language and seven articles in English.

Figure 1

The first pharmacoeconomic study on TCM in Chinese was published in Chinese Journal of Pharmacoepidemiology in 1997, and focused on Ahylysantinfarctase and Fufang Danshen injection for cerebral infarction patients (21). The first TCM pharmacoeconomic study in English was published in the Chinese Journal of Integrative Medicine in 2014, and was focusing on Chinese medicine and Western medicine for ischemic stroke patients (22). Since 2002, the number of published pharmacoeconomic studies on TCM has gradually increased (Figure 2).

Figure 2

In addition to 25 dissertations, other pharmacoeconomic evaluation literatures on TCM were published in 173 journals, among which 178 were Chinese journals and 5 English journals.

More than 80.97% of the pharmacoeconomic evaluation studies on TCM were carried out by teams with the first author affiliated with a hospital (349), and the remaining studies' first authors were affiliated with universities or research institutions (n = 72, 16.71%) or enterprises (n = 10, 2.32%). All of the first authors of English articles were affiliated with universities.

Among 431 articles, only 66 (15.56%) were reported as having financial support, including nine nationally funded projects, 22 provincial and ministerial funded projects, 22 municipally funded projects, four university funded projects, four funded projects by the authors' units, three projects supported by a foundation, and two projects supported by Enterprise funding.

Diseases

According to the International Classification of Diseases (ICD-10), the studies focused on a range of 148 kinds of diseases, among which most frequently studied were diseases of the nervous system, cardiovascular system, respiratory system, gynecological, and alimentary systems as shown in Figure 3.

Figure 3

Interventions

The medical interventions involved in the studies were complex and diverse. Nearly half of the studies compared two interventions, while others compared three or more interventions. However, 186 studies did not describe reasons for choosing the specific program or interventions for comparison. More than a third of the studies used TCM as the control group, and in most of these cases the TCM was not recommended by relevant clinical guidelines (Table 1).

Table 1

Treatment comparisonNumber of studiesPercentage
Chinese medicine vs. Chinese medicine16437.79%
Chinese medicine vs. Western medicine15635.94%
Chinese medicine plus western medicine vs. Western medicine7617.51%
Chinese medicine plus Western medicine vs. Chinese medicine plus Western medicine204.61%
Chinese medicine prescriptions153.46%
Chinese medicine plus Western medicine vs. Chinese medicine30.7%

Number of studies making different types of comparisons between Chinese and Western medicine (N = 434).

The studies included 264 types of Chinese patent medicines and 70 types of TCM prescriptions (such as prescription, pieces decoction, powder, extraction, tincture, and pills). Table 2 shows the Chinese patent medicines that were the focus of more than eight pharmacoeconomic studies, in addition to their TCM syndromes and their indications from the perspective of Western medicine.

Table 2

Chinese patent medicinesApplicable TCM SyndromesIndications of Western MedicineNumber of studiesPercentage
Xuesaitong tabletBlood-activating, stasis-dissolvingStroke, hemiplegia and others204.60%
Fufang Danshen tablet/dropping pillBlood-activating, stasis-dissolvingCoronary heart disease, angina pectoris173.92%
Shuxuening injectionBlood vessel-expanding, microcirculation-improvingIschemic cardiovascular, cerebrovascular diseases, coronary heart disease, angina pectoris, cerebral embolism and others163.69%
Danhong injectionBlood-activating, stasis-dissolvingChest pain, chest tightness, palpitation, cerebrovascular diseases, coronary heart disease, angina pectoris and others153.46%
Qingkailing injectionHeat clearing-detoxication, tranquilizing,allaying excitementUpper respiratory tract infection, viral cold and others153.46%
Shuxuetong injectionBlood circulation promoting, blood stasis removing, channels and collaterals dredgingHemiplegia, speech askew, speech astringent, acute cerebral infarction132.99%
Xiyanping injectionHeat clearing-detoxication, relieve diarrheaBronchitis, tonsillitis, bacillary dysentery132.99%
Danshen Chuanxiongqin injectionNot providedOcclusive cerebrovascular diseases132.99%
Rupixiao tabletBlood circulation promoting, blood stasis removing, hard mass softening and resolvingLobular hyperplasia of mammary gland, ovarian cyst, uterine leiomyoma122.76%
Fufang danshen injectionBlood circulation promoting, blood stasis removing, pulse-invigorating, heart-nourishingCoronary heart disease, chest tightness, angina pectoris122.76%
Ciwujia injectionLiver and kidney reinforcing moderately, bone strengtheningTransient ischemic attack, cerebral arteriosclerosis, cerebral thrombosis and cerebral embolism caused by liver and kidney deficiency, coronary heart disease, angina pectoris, neurasthenia, climacteric syndrome112.53%
Shenmai injectionQi-supplementing, yin-nourishing, normal pulse restoring, collapse remedyPalpitation, shortness of breath, limb cold, sweating, pulse loss, myocardial infarction, cardiogenic shock102.30%
Xueshuantong injectionBlood circulation promotingCentral Retinal vein occlusion, sequelae of cerebrovascular disease, internal ophthalmopathy, anterior chamber hemorrhage and others.102.30%
Tanreqing injectionHeat clearing-detoxication, phlegm resolvingFever, cough, expectoration, sore throat, thirst, red tongue, yellow fur; early pneumonia, acute bronchitis, acute attack of chronic bronchitis, upper respiratory tract infection.92.07%
Yinxingdamo injectionNot providedCoronary heart disease, thromboembolic diseases92.07%
Yanhuning injectionNot providedViral pneumonia, upper respiratory tract infection92.07%
Reduning injectionHeat clearing-detoxication, wind dispellingHigh fever, head and body pain, cough, yellow phlegm, upper respiratory tract infection92.07%
Aidi injectionHeat clearing-detoxication, blood stasis eliminatingPrimary liver cancer, lung cancer, rectal cancer, malignant lymphoma, gynecological malignancies, and others81.84%

Chinese patent medicines with more than eight pharmacoeconomic studies, the TCM syndromes to which they apply, and the Western medicine indicators for these (N = 434).

Study Characteristics

Study characteristics of the 434 studies are presented in Table 3 including the study design, duration, sample size, and viewpoint/perspective. While 24 studies were based on data from previous research, most were prospective or retrospective clinical trials. Seventeen studies did not specify the study duration, but of the remainder most were <3 months. Excluding the 27 studies in which data were extracted from previous research, the sample size of included studies ranged from 38 to 2,820 and subjects' age ranged from 0 to 90 years old. Most (n = 377; 86.87%) of the studies did not specify the perspective of their pharmacoeconomic evaluations.

Table 3

Study characteristicsNumber of studiesPercentage
Study design407
   Prospective study24860.93%
   Prospective experimental study23457.49%
   Prospective observational study143.44%
   Retrospective study15939.07%
Study duration407
   <14 d16640.79%
   15 to 30 d10024.57%
   1 to 3 m10024.57%
   4 to 6 m112.70%
   7 to 12 m102.46%
   12 to 24 m40.98%
   Not mentioned163.94%
Sample size407
   <100 subjects15237.35%
   101 to 200 subjects14635.87%
   201 to 500 subjects8621.13%
   501 to 1,000 subjects153.69%
   over 1,000 subjects81.97%
Perspective434
   Medical institutions245.53%
   Patients92.07%
   Whole society112.53%
   Payers112.53%
   Health system20.46%
   Not specified37786.87%
Evaluation Methods434
   CEA36985.02%
   CMA204.72%
   CBA71.61%
   CUA71.61%
   Combination analysis317.14%
Uncertainty analysis variables289
   Drug prices19065.74%
   Drug prices and other cost (such as examination fee, examination fee, bed fee, treatment fee, nursing fee, compensation/fee for absence from work.)6723.18%
   Drug prices and health outcome (such as efficiency rate)196.57%
   Other cost (such as examination fee, examination fee, bed fee, treatment fee, nursing fee, compensation for one's absence from work)72.42%
   Other variables (such as course of medication, discount rate)62.08%

Characteristics and uncertainty analysis variables for included pharmacoeconomic studies (N = 434).

d, day; m, month.

More than 85% of the studies used cost-effectiveness analysis (CEA), and the remainder study used at least one method of cost analysis, such as Cost Minimization Analysis (CMA), Cost Benefit Analysis (CBA), or Cost Utility Analysis (CUA). See Table 3 for details. Among these studies, 28 studies used modeling research, with six studies using Markov model and 22 studies using a decision tree model. Thirty-one studies used combination analyses, with two or more methods such as CEA, CMA, CUA, or CBA used in one study. Other relevant specific information is shown in Table 3.

Cost Scope and Identification

More than 80% of the studies only calculated direct costs, less than one-fifth of the studies included both direct and indirect costs, and the remaining 6% of the studies did not clearly define costs.

Direct costs in these studies were related to the following: drugs (n = 385), examination fee (n = 158), treatment fee (n = 78), hospitalization cost (n = 42), nursing cost (n = 42), bed fee (n = 41), registration fee (n = 32), dispensing fee (n = 27), adverse reaction treatment cost (n = 23), material cost (n = 16 studies), meal (n = 11), surgery cost (n = 9), disposal cost (n = 6), consultation fee (n = 1), blood transfusion cost (n = 1), instrument loss (n = 1), and other expenses (n = 55). Indirect costs were related to time cost (n = 22), compensation (fee) for one's absence from work (n = 18), labor loss (n = 3), and funeral expenses (n = 1).

Health Outcomes

A total of 226 studies used a single end-point, 156 studies used double end-points, 26 studies used three end-points, and the other 26 studies used four or more end-points at the same time. Of 400 CEA studies with a health-related the final end-points, 264 studies included clinical efficiency/improvement rate, 132 included adverse reactions rate, 47 included efficiency rate of TCM syndromes, 11 included recurrence rate, and 16 included disease or drug withdrawal rate, and 5 included death rate. Fourteen percent (n = 61) of studies reported the intermediate end-points as the health-related outcomes, including score/index scale (n = 41), biochemical indicators (n = 22), physiological indices (n = 9), and imaging indices (n = 9). Twenty studies reported quality-adjusted life year as a health outcome and one study reported net benefit as a health outcome.

Uncertainty Analysis and Generalizability

Sixty seven percent of the included studies (n = 289) carried out an uncertainty price analysis, the main variables of which are shown in Table 3. In 220 (76.12%) studies, uncertainty analysis were conducted by using one-way sensitivity analysis with reducing drug prices by 10–20%, while 69 (23.88%) of studies used multi-way sensitivity analysis for uncertainty.

A total of 102 articles (23.67%) discussed the limitations of their studies, and 12 articles discussed the generalizability of their results. Although 66 studies included children under 18 years of age, none of these acknowledged the related ethical issues.

Quality Assessment of Pharmacoeconomic Evaluation Studies on TCM

The average overall quality score of 431 pharmacoeconomics studies on TCM was 0.62.with a range from 0.38 to 0.85. Scores on most of the studies were from 0.5 to 0.7. The distribution is shown in Table 4. On items 2.5, 2.9, 2.12, 3.2, 3.3, 3.4, and 3.5 the score was below 0.1. On items 1.3, 2.7, 2.8, and 3.14 it was no more than 0.5 and on items 1.4, 2.1, 3.6, 3.7, and 3.8 it was no more than 0.7 (Table 4).

Table 4

Evaluation itemsScores of the studiesScores of the studies
published in Chinesepublished in English
Number of studies scoredMean scoreNumber of studies scoredMean score
Study Question1.1 The research question was stated427171
1.2 The economic importance of the research question was stated3100.72640.571
1.3 The viewpoint(s) of the analysis were clearly stated and justified580.13640.571
Selection of Alternatives1.4 The rationale for choosing the alternative programs or interventions compared was stated2410.56430.429
1.5 The alternatives being compared were clearly described3850.90271
Form of Evaluation1.6 The form of economic evaluation used was stated427171
1.7 The choice of form of economic evaluation was justified in relation to the questions addressed427171
Effectiveness Data2.1 The source(s) of effectiveness estimates used were stated2140.50160.857
2.2 Details of the design and results of effectiveness study were given (if based on a single study)2530.81171
2.3 Details of the method of synthesis or meta-analysis of estimates were given (if based on an overview of a number of effectiveness studies)220.88000
Benefit Measurement and Valuation2.4 The primary outcome measure(s) for the economic evaluation were clearly stated427171
2.5 Methods to value health states and other benefits were stated0010.143
2.6 Details of the subjects from whom valuations were obtained were given3920.91860.857
Costing2.7 Productivity changes (if included) were reported separatelyΔ440.10300
2.8 The relevance of productivity changes to the study question was discussedΔ570.13300
2.9 Quantities of resources were reported separately from their unit costsΔ0020.286
2.10 Methods for the estimation of quantities and unit costs were described4020.94160.857
2.11 Currency and price data were recorded4170.97750.714
2.12 Details of currency of price adjustments for inflation or currency conversion were given0000
Modeling2.13 Details of any model used were given200.83341
2.14 The choice of model used and the key parameters on which it was based were justified220.91741
Adjustments for timing of costs and benefits3.1 Time horizon of costs and benefits was stated433160.857
3.2 The discount rate(s) was stated*Δ70.01630.429
3.3 The choice of rate(s) was justified*Δ70.01630.429
3.4 An explanation is given if costs or benefits were not discounted*Δ170.04010.143
Allowance for uncertainty3.5 Details of statistical tests and confidence intervals were given for stochastic data*250.05940.571
3.6 The approach to sensitivity analysis was given2840.66550.714
3.7 The choice of variables for sensitivity analysis was justified2850.66740.571
3.8 The ranges over which the variables were varied are stated2830.66350.714
3.9 Relevant alternatives were compared427171
Presentation of results3.10 Incremental analysis was reported2670.83760.857
3.11 Major outcomes are presented in a disaggregated as well as aggregated form427171
3.12 The answer to the study question was given427171
3.13 Conclusions followed from the data reported427171
3.14 Conclusions were accompanied by the appropriate caveats*770.18071

Quality Evaluation Scoring of Included Pharmacoeconomic Studies on TCM (N = 434).

*

indicates that the score for studies in English was higher than in Chinese; Δ indicates that the score of studies was relatively low both in Chinese and English articles.

The quality of the studies was not significantly improved over the past 20 years, as shown in Table 5. The quality of studies with first authors affiliated with universities researchers was much higher than that of studies with first authors affiliated with hospitals. The mean score of the seven studies in English was 0.72, while that of studies published in Chinese journals was 0.62. The scores of studies in English were higher than those in Chinese on items 3.2, 3.2, 3.4 3.5, and 3.14 and scores were relatively high in the Chinese journals on items 1.2, 2.3, 2.7, and 2.8. However, scores on items 2.7, 2.8, 2.9, 3.2, 3.3, and 3.4 were low in both Chinese and English studies, suggesting a need for improvement (Table 4).

Table 5

ViewpointNumber of studiesScore
Year of publication
Before 2005500.62
2005–20101080.62
2011–20151320.61
After 2015 y1440.63
Language of publication
Studies in Chinese4270.62
Studies in English70.72
First author affiliation
Hospital3490.61
University750.68
Enterprise100.64

Scoring comparison from different viewpoints for included pharmacoeconomic studies (N = 431).

Discussions

Policy orientation and a demand for evidence have influenced a rapid increase over the past decade in number of the published pharmacoeconomic research articles on TCM. However, the volume remains only one tenth of the number of corresponding articles on chemical drugs. Overall, the quality of published pharmacoeconomics evaluation on TCM was relatively and generally low, which was consistent with the results of several studies in 2009 (23), 2015 (24), and 2020 (25). And compared with the studies of Chen (26), Li (27), Lei (28) in 2004, 2008, and 2010 respectively, the quality of pharmacoeconomics research articles on TCM was also lower than that on chemical drugs.

Three main limitations in quality were identified. Firstly, many of the included studies were not well-designed and lacked clear research perspective. Only four studies described the method of sample size estimation based on China guidelines for pharmacoeconomic evaluation, which would affect cost identification and measurement and thereby the integrity and reliability of the studies (29). Many studies did not report the randomization method, and failed to justify the selected intervention.

Many studies with first authors affiliated with a hospital appeared to not fully understand the basic principles of pharmacoeconomics and did not design their clinical trials appropriately, despite pharmacoeconomic data being relatively easy to obtain in a hospital. Some studies failed to implement and apply pharmacoeconomic research methods correctly. There were limitations or errors in cost identification and measurement in some studies, more than half of which included only drug costs. Due to these issues, some researchers misunderstood or were confused about cost assessment in pharmacoeconomic evaluation. Even in the study of chronic diseases, people generally did not pay enough attention to discount. In addition, the choice of discount rate is also based on different countries and different perspectives, which is also a controversial issue in the field of Pharmacoeconomics.

Some studies assessed TCM as an adjunct to Western medicines, which made the cost difficult to calculate. In addition, the lack of a specific and unique pharmacoeconomic evaluation guideline for TCM was also an important limitation. In 2013, Xie et al. published a “technical specification for pharmacoeconomic evaluation on post marketed Chinese patent medicine (Draft)” in the China Journal of traditional Chinese Medicine (30). This guideline considered the basic ideology and characteristics of traditional Chinese medicine to a certain extent, but did not solve the specific problems in the pharmacoeconomic evaluation of TCM, such as how to map the effectiveness and health outcome of TCM and chemical medicines.

Finally, some TCM clinical trials were found to be limited in terms of sample size, comparison type, or the use of non-scientific assessments. The short durations of most studies were not well-aligned with the chronic nature of disease on which they focused, and did not fully reflect the advantages of TCM in improving long-term clinical efficacy and potential safety. Most of the studies were retrospective, with small samples and no follow-up. Common defects were in protocol design, lack of trial registration, study reporting, and quality control. Frequently used outcome indicators were overall efficiency and recurrence rate, and were not sufficiently specific to reflect outcomes of different types of TCM treatment.

There were some limitations in our study. First, the BMJ checklist was published in the 1990s, and its applicability may deviate to some extent from the current research including pharmacoeconomic evaluations on TCM. Second, this study included only published research and not unpublished research reports. Some outcome indicators were not addressed by the included studies, resulting in low scores for those indicators, which may have impacted negatively on the evaluation results of this study.

Conclusions

Although limitations and deficiencies are found in the current pharmacoeconomic evaluation of TCM, the body of research still provides a lot of valuable evidence for the rational use of health resources, essential medicine and state medical insurance catalog selection and national drug price negotiations. The following recommendations may improve the quality of research in this area. In the pharmacoeconomics evaluation of TCM, the following recommendations are made.

With regard to the point discussed above, we call for enhanced methodological training and cooperation to improve the quality of research and reporting quality. A pharmacoeconomic evaluation guideline conforming to the theoretical characteristics of TCM should be established to reflect the economic evaluation results of TCM objectively. In addition, importantly, a reasonable health outcome index for TCM should be developed, balancing between the specificity and quantification of TCM indicators, mapping of indicators between Chinese patent medicine, and Western medicines, and enhancing clinical comparability of health indicators.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Statements

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.

Author contributions

MH and NY conceived the study design. HZ and TD searched and selected the articles, extracted, analyzed, and interpreted the data. NY drafted the manuscript. MH and JG critically reviewed the manuscript. All authors read and approved the final version of the manuscript.

Funding

This research has been supported by National Key R&D Program of China (Grant No. 2019YFC1709804), The 111 Project (Project No.B18035) and Sichuan Administration of Traditional Chinese Medicine (Project Number: 2018ZC004). The funders will not be involved in the analysis and interpretation of data, or in the decision to publish the results.

Acknowledgments

We thank all the researchers who were engaged in pharmacoeconomic evaluation of TCM.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

    Abbreviations

  • CAM

    complementary and alternative medicine

  • TCM

    traditional Chinese medicine

  • PRISMA

    preferred reporting items for systematic reviews and meta-analyses

  • CNKI

    China national knowledge infrastructure

  • VIP

    Chongqing VIP information

  • BMJ

    British medical journal

  • QHES

    quality of health economics studies

  • CHEC

    consensus on health economic criteria

  • ISPOR

    international society of pharmacoeconomics and outputs research

  • CHEERS

    consolidated health economic evaluation reporting standards

  • CEA

    cost-effectiveness analysis

  • CMA

    cost analysis

  • CBA

    cost-benefit analysis

  • CUA

    cost-effectiveness analysis

  • DT

    decision tree.

References

  • 1.

    SunXGuoLPShangHCRenMLeiX. Systematic economic assessment and quality evaluation for traditional Chinese medicines. China J Chin Materia Medica. (2015) 40:20503. 10.4268/cjcmm20151038

  • 2.

    ZhangHB. Systematic evaluation of domestic pharmacoeconomics research literature in recent years. Chin Licensed Pharm. (2010) 7:236. 10.3969/j.issn.1672-5433.2010.12.006

  • 3.

    National Healthcare Security Administration. Announcement on the release of the work plan for the adjustment of the national medical insurance drug catalogue in 2019. (2019). Available online at: http://www.nhsa.gov.cn/art/2019/4/17/art_37_1214.html (accessed March 10, 2020).

  • 4.

    NahinRLBarnesPMStussmanBJBloomB. Costs of complementary and alternative medicine (CAM) and frequency of visits to CAM practitioners: United States, 2007, National Health Statistics Reports. Hyattsville, MA: National Center for Health Statistics (2009).

  • 5.

    ThomasKJNichollJPColemanP. Use and expenditure on complementary medicine in England: a population based survey. Complement Ther Med. (2001) 9:211. 10.1054/ctim.2000.0407

  • 6.

    WhiteARErnstE. Economic analysis of complementary medicine: a systematic review. Complement Ther Med. (2000) 8:1118. 10.1054/ctim.2000.0356

  • 7.

    KennedyDAHartJSeelyD. Cost-effectiveness of natural health products: a systematic review of randomized clinical trials, Evid-Based Complement Altern Med. (2009) 9:279304. 10.1093/ecam/nem167

  • 8.

    DoranCMChangDHKiatHBensoussanA. Review of economic methods used in complementary medicine. J Altern Complement Med. (2010) 16:5915. 10.1089/acm.2008.0404

  • 9.

    HartelUVolgerE. Use and acceptance of classical natural and alternative medicine in Germany—findings of a representative population-based survey. Forsch Komplementarmed Klass Naturheilkd. (2004) 11:32734. 10.1159/000082814

  • 10.

    HermanPMPoindexterBLWittCMEisenbergDM. Are complementary therapies and integrative care cost-effective? A systematic review of economic evaluations, BMJ Open. (2012) 2:e001046. 10.1136/bmjopen-2012-001046

  • 11.

    LiuSHChuangWCLamWJiangZLChengYC. Safety surveillance of traditional chinese medicine: current and future. Drug Safety. (2015) 38:11728. 10.1007/s40264-014-0250-z

  • 12.

    National People's Congress. (2019). Law of the People's Republic of China on Pharmaceutical Administration. Available online at: https://flk.npc.gov.cn/detail2.html?ZmY4MDgwODE2ZjNjYmIzYzAxNmY0NjI0MmQ2MTI3ZWQ%3D (accessed March 17, 2020).

  • 13.

    Center For Information, NMPA. (2020). Annual report on Drug Administration statistics. Available online at: https://www.nmpaic.org.cn/xwtt/202104/t20210421_301292.html [Accessed April 22, 2021].

  • 14.

    National Healthcare Security Administration. (2020). National Healthcare Security Administration and Ministry of Human Resources and Social Security printed and distributed the list of national medical insurance drugs in 2020. Available online at: http://www.nhsa.gov.cn/art/2020/12/28/art_14_4221.html (accessed February 3, 2021).

  • 15.

    DrummondMFJeffersonTO. Guidelines for authors and peer reviewers of economic submissions to the BMJ economic evaluation working party. BMJ. (1996) 313:27583. 10.1136/bmj.313.7052.275

  • 16.

    ChiouCFHayJWWallaceJFBloomBSNeumannPJSullivanSDet al. Development and validation of a grading system for the quality of cost-effectiveness studies. Med Care. (2003) 41:3244. 10.1097/00005650-200301000-00007

  • 17.

    EversSGoossensMVetHDTulderMVAmentA. Criteria list for assessment of methodological quality of economic evaluations: consensus on Health Economic Criteria. Int J Technol Assess Health Care, e. (2005) 21:2405. 10.1017/S0266462305050324

  • 18.

    PhilipsZBojkeLSculpherMKarlClaxtonSuGolder. Good practice guidelines for decision-analytic modelling in health technology assessment: a review and consolidation of quality assessment. Pharmacoeconomics. (2006) 24:35571. 10.2165/00019053-200624040-00006

  • 19.

    HusereauDDrummondMPetrouSCarswellCMoherDGreenbergDet al. Consolidated health economic evaluation reporting standards (CHEERS)-explanation and elaboration: a report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. Value Health. (2013) 16:23150. 10.1016/j.jval.2013.02.002

  • 20.

    ZhangYSMaAXLiHCGuanX. Instruments designed for quality assessment of pharmaceutical economic evaluations: an overview. Chin J Evid Based Med. (2019) 19:84450. 10.7507/1672-2531.201803039

  • 21.

    XiaLSWangRYangZMPharmacoeconomic analysis of four treatments for cerebral infarction. Chin J Pharmacoepidemiol. (1997) 6:1679.

  • 22.

    LiYXiHXZhuSYuNWangJLiYet al. Cost-effectiveness analysis of combined Chinese medicine and Western medicine for ischemic stroke patients. Chinese J Integr Med. (2014) 20:57084. 10.1007/s11655-014-1759-9

  • 23.

    LiMHLiuGE. Significance and characteristics of economic evaluation of traditional Chinese medicine. China J Pharm Econ. (2009) 3:114.

  • 24.

    WuHYTianCL. Quality analysis of pharmacoeconomics evaluation and application literature in China during 2009–2013. China Pharm. (2015) 26:14414. 10.1016/j.jval.2015.09.1779

  • 25.

    SiLJYinMWangJLYangSRZhangJWeiLL. Evaluation of quality of pharmacoeconomic studies involved in traditional Chinese medicine in China. Expert Rev Pharmacoecon Outcomes Res. (2020) 8:212. 10.1080/14737167.2020.1800455

  • 26.

    ChenWBiKNYangLGaoJM. Systematic review of Chinese pharmacoeconomic evaluation literature. China Pharm. (2004)15:2831. 10.1080/13696998.2017.1280501

  • 27.

    LiMHLiHCMaAX. Pharmacoeconomic evaluation studies in china: status quo, problems and suggestions. China Pharm. (2008) 19:610.

  • 28.

    LeiLHuMZhangZ. Systematic evaluation and quality evaluation of domestic pharmacoeconomic evaluation literatures in 2010. China Pharm. (2013) 24:24014.

  • 29.

    LiuGGHuSLWuJHWuJDongZHLiHC. China Guidelines for Pharmacoeconomic Evaluations. Peking: China Market Press. (2020).

  • 30.

    XieYMWangXWangNChangYP. Technical specifications for post-marketing pharmacoeconomic evaluation of Chinese medicine (draft version for comments). China J Chin Materia Medica. (2013) 38:29259. 10.4268/cjcmm20131802

Summary

Keywords

trad. Chinese medicine, Chinese patent medicines, pharmacoeconomic, system review, quality evaluation

Citation

Yang N, Zhang H, Deng T, Guo JJ and Hu M (2021) Systematic Review and Quality Evaluation of Pharmacoeconomic Studies on Traditional Chinese Medicines. Front. Public Health 9:706366. doi: 10.3389/fpubh.2021.706366

Received

07 May 2021

Accepted

07 July 2021

Published

03 August 2021

Volume

9 - 2021

Edited by

Kevin Lu, University of South Carolina, United States

Reviewed by

Jing Yuan, Fudan University, China; Enver Envi Roshi, University of Medicine, Tirana, Albania

Updates

Copyright

*Correspondence: Ming Hu

This article was submitted to Health Economics, a section of the journal Frontiers in Public Health

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics