- West China School of Pharmacy, Sichuan University, Chengdu, Sichuan, China
Objectives: The medical security of orphan drugs faces difficulty in basic medical insurance access in China. Conventional cost-effectiveness analysis in the access process lacks broader value concerns and a value assessment framework is needed. This study aims to construct a multicriteria decision analysis value assessment framework for orphan drugs using the discrete choice experiment method from the perspective of basic medical insurance access in China.
Methods: The attributes and levels of the framework were identified through literature and reports review. An unlabeled discrete choice experiment was employed to determine the relevance and relative importance weight of such attributes for decision-making. Questionnaire was designed based on D-efficient design. Survey was conducted anonymously using an online survey platform. A mixed logit model estimated the DCE responses.
Results: Seven attributes (disease severity, unmet needs, drug efficacy, improvement in health-related quality of life, drug safety, quality of drug evidence, and annual treatment cost per patient reimbursed by basic medical insurance) were selected with three levels for each. It formed three parallel questionnaires, each containing 11 paired choice sets. A total of 84 respondents completed the study, and 69 questionnaires were valid. The results showed that six of the seven attributes were significant, except for ‘Unmet needs’. Among all attributes and levels, the respondents exhibited the highest WTP (567,900 RMB/year) for ‘significant improvement in usual activities’. Based on discrete choice model, the most important attributes measured by their relative importance weights are: improvement in health-related quality of life (23.44%), disease severity (18.65%) and annual treatment cost per patient reimbursed by basic medical insurance (17.34%). Different types of respondents and weighting methods may lead to slight variations in the results.
Conclusion: Our study provides a new research perspective and methodological support for the value assessment of orphan drugs. When establishing a value assessment framework for orphan drugs in China, overall, the medical insurance access prioritized disease severity, and improvement in health-related quality of life. The application of discrete choice experiment proves to be a powerful tool for weighting criteria in healthcare multicriteria decision analysis framework and should be further explored for the value assessment of orphan drugs. Our findings offer a structured, evidence-based framework to support access and reimbursement decisions for orphan drugs.
1 Introduction
Rare diseases are characterized by low incidence rates and high disease burden (Ferreira, 2019). Despite the lack of a universal definition (Gong et al., 2016), they are generally categorized by the number of patients, incidence rate, and the severity of the disease (Ferreira, 2019; Richter et al., 2015). Although the prevalence of rare diseases is low, the accumulated number of affected patients is high. This results in a heavy disease burden, which reflected in high mortality rates, high disability rates (Ferreira, 2019).
Orphan medicinal products, also referred to as orphan drugs, are vital for diagnosing, preventing, and treating rare diseases (Joppi and Garattini, 2013). However, the medical security of orphan drugs still faces barriers including limited market accessibility, high costs exceeding patient affordability, and, especially, difficulty in basic medical insurance access. Generally, the scarce and low-quality evidence and high price of orphan drugs lead to unfavorable incremental cost-effectiveness ratio (ICER) and significant budget impact (Lasalvia et al., 2019), which are considered in the basic medical insurance access. Additionally, the traditional cost-effectiveness analyses (CEA) used in basic medical insurance access were unable to capture broader value concerns (McQueen et al., 2024) vital to orphan drugs. Based on these reasons, conventional health technology assessment (HTA), focusing on the measurement of value as captured by comparative effectiveness (Oliveira et al., 2019), is unsuitable for orphan drugs’ value assessment and access decisions. Establishing a value-based assessment mechanism specific to orphan drugs is therefore essential to support decision-making.
To address increasing healthcare demands under limited resources, health systems are shifting towards value-based reimbursement (Zhang M. et al., 2022). Accordingly, many HTA agencies have developed various value assessment frameworks to support the evaluation of new treatment interventions and optimize coverage decisions. Currently, there are three approaches commonly used to construct value assessment frameworks: deliberation, expanding beyond the traditional CEA, and multi-criteria decision analysis (MCDA) (Zhang M. et al., 2022; Zhang et al., 2024). But the former methods (deliberation and expanding CEA) suffer from a lack of transparency and difficulties in capturing a broader range of value elements (Zhang et al., 2024; Phelps et al., 2018; Angelis and Kanavos, 2017). MCDA, also called multiple criteria decision making (MCDM), refers to formal approaches which seek to take explicit account of multiple criteria in helping individuals or groups explore decisions that matter (Belton and Stewart, 2002). MCDA is widely applied in decision-making across fields such as the environment, energy (Hussain et al., 2025a; Rukhsar et al., 2025; Hussain et al., 2025b; Hussain et al., 2024a), and education (Hussain et al., 2025c), and it has developed advanced decision-making methodologies.Also, it is increasingly being adopted in health systems. It is worth noting that due to different objectives, the specific application methods of MCDA vary across different fields. Due to its unique advantages, MCDA has become an ideal tool for implementing value-oriented health decision-making (Nie et al., 2023). Many studies have adopted the MCDA method to construct the evaluation framework, as this approach stands out due to its flexibility, transparency, and the ability to incorporate the viewpoints of stakeholders (Blonda et al., 2021). This approach can address the shortcomings of the conventional HTA methods for orphan drugs, providing support to medical insurance decision-makers (Sussex et al., 2013; Palaska and Hutchings, 2015; Schey et al., 2017).
Specifically for orphan drugs, a 2021 study systematically summarized six main approaches to construct value assessment frameworks: no economic evaluation, standard economic evaluation, variable ICER thresholds, weighted QALYs, MCDA frameworks, and separate frameworks for ultra-rare diseases (Blonda et al., 2021). Their findings suggest that compared to other types of frameworks, MCDA frameworks are highly flexible, allow stakeholder perspectives to be integrated, and thus provide a promising direction for rare disease value assessment. Several studies further highlight the utility of MCDA in rare disease contexts. Iskrov et al. (2014) demonstrated that MCDA can improve fairness and rigor in orphan drug reimbursement decisions (Iskrov and Stefanov, 2014). García-Diego et al. (2024) applied MCDA to comprehensively evaluate gene therapy for hemophilia, capturing its additional value (García-Diego et al., 2024). Chen et al. (2024) developed an MCDA framework for orphan drugs tailored to the Chinese context (Chen et al., 2024).
Various methods, such as direct rating and choice experiments, were used to determine the weights of attributes in MCDA-based value assessment frameworks. However, the direct weighting methods, which are prevalent among MCDA weighting methods, rely heavily on subjective judgment. Discrete choice experiment (DCE) is a stated preference survey method that reveals individuals’ preferences and decision-making behaviors when faced with multiple alternatives (Tan et al., 2022; Hauber et al., 2016). DCE has become popular among MCDA methods (Tan et al., 2022) and it may result from its flexibility in permitting evaluation of conflicting preferences by MCDA (Byun et al., 2016). Therefore, there is a need to explore ways to optimize weighting methods within MCDA and DCE seems one of the most commonly used methods to conduct further research on the selection and optimization of weighting methods and other key aspects (Tan et al., 2022). Although DCE has seen some application in MCDA, its implementation in MCDA for orphan drugs still needs to be explored.
China has placed significant emphasis on rare diseases in recent policies (Ying et al., 2021). Since initiating national reimbursement drug negotiations based on HTA in 2018, China has expanded coverage for many orphan drugs in National Reimbursement Drug List (NRDL). However, many high-cost orphan drugs are still excluded and the current NRDL access procedures and evaluation methods for orphan drugs are the same as those for common drugs, failing to capture their unique value (Yuan and Wu, 2021). It still faces limitations in evaluating the value of orphan therapies through more domains and criteria beyond the current HTA framework. There is a consensus (Zhang B. et al., 2022) suggesting that MCDA should be used to assess the comprehensive clinical value of orphan drugs in China. Also, the previous study has used DCE methods to explore the societal preferences for orphan drugs in China (Tan et al., 2022). However, from the perspective of China’s basic medical insurance access, there is currently a lack of evidence regarding the combination of DCE and MCDA to establish value attributes and weights.
To fill this gap, our study aims to construct an MCDA framework from the perspective of basic medical insurance access, using the DCE method to assess the value of orphan drugs, specifically (1) determine the most relevant attributes in DCE (i.e., criteria in the MCDA framework): for decision-making; (2) prioritize these value attributes according to their relative importance based on the preferences stated.
2 Methods
2.1 Study design
DCE involves designing a series of hypothetical choice scenarios, where respondents are asked to choose between options with different combinations of attributes. Each of their choices reflects a trade-off between the attributes and levels of the different options and this allows for assessing their relative importance in decision making (Nie et al., 2023; Ryan and Farrar, 2000).
In 2011, the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) developed a detailed checklist to assess the completeness and rigor of DCE studies (Bridges et al., 2011), and provided detailed guidance on experimental designs (Reed Johnson et al., 2013), data analysis methods (Hauber et al., 2016), and the accounting for preference heterogeneity (Vass et al., 2022) in DCE implementation. Following these checklist, our study was structured into four key steps: 1)attributes and levels determining, 2)experimental design, 3) survey administration and data collection, 4)statistical analyses. The flowchart of the study is shown in Figure 1.
2.2 Attributes and levels identification
The domains and attributes were developed by analyzing and integrating the former MCDA-based value assessment framework (Chen et al., 2024). The reason why this study selected the framework is that it is specifically constructed within the Chinese drug access context and serves as a comprehensive value assessment framework applicable to orphan drugs as a whole. Also, this former framework is developed based on EVIDEM, which is an collaborative-development MCDA framework designed to assess the value of interventions. The initial framework included a quantitative and a qualitative criteria part, which were divided into seven domains and 19 criteria. Due to sample size limitations and the potential cognitive burden on respondents, only the most important attributes and levels were selected (Wang et al., 2020). Criteria in the qualitative part were excluded from the final attributes because they mainly discussed compatibility or feasibility. Criteria in the qualitative part were removed, revised and combined through literature review and research team discussion. The process for detailed consideration of the attributes is documented in the Supplementary Material.
Attribute levels were derived from a literature review, some reports and guidelines of rare diseases and orphan drugs in China, such as China rare disease drug accessibility report (2019) (IQVIA, 2019), the Guidelines for the Diagnosis and Treatment of Rare Diseases (2019) (National Health Commission of the People’s Republic of China, 2019), clinical evidence, and global orphan drug preference studies. Level selection criteria ensured: 1) covering most therapeutic methods approved or under consideration for approval in China, 2) ensuring sufficient differentiation and exclusivity between each level, and 3) balancing the total number of levels. The disease-related domain’s levels were established by systematic analysis of classifications, onset ages, and severity of rare disease listed in the first and second ‘List of Rare Diseases’ in China; drug/treatment-related levels were defined based on the extent to which rare disease can be treated (curative, controllable, or symptomatic/supportive treatment) and the efficacy of controlling treatment (significant improvement, partial improvement, or stable control); cost-related levels were determined by an analysis of the inclusion of orphan drugs in the NRDL, drug costs under different medical insurance types, and China’s basic medical insurance policies and current status.
Finally, this DCE includes seven attributes, with three levels for each attribute (Table 1). The specific definitions and explanations of each attribute and level, along with the rationale for each level, can be found in Supplementary Material.
2.3 Experimental design
2.3.1 DCE choice set design
The full factorial design would generate 2187 possible alternatives (37 = 2187) based on seven attributes and three levels for each. Given the practical constraints of the research, a fractional factorial design was employed to select representative experimental programs from the many possible combinations for DCE construction. A D-efficient design was used to obtain 30 paired choice sets using Stata 18. To reduce the burden of respondents and to ensure data quality, these were equally divided into three blocks.
The study employed an unlabeled design for the DCE with alternatives generically labeled ‘Orphan Drug 1’ and ‘Orphan Drug 2’ to avoid comparative superiority between different orphan drug alternatives and focus participant evaluation on the specific drug value attributes. To better align with real-world selection situations, an ‘opt-out option’ was added to each choice set. For quality control, we added a set of repeated choice sets to each questionnaire as a basis for consistency validation to ensure the internal consistency. Hence, each respondent was required to complete 11 DCE choices. An example of DCE questionnaire is shown in Figure 2.
2.3.2 Questionnaire design
The questionnaire included three parts: the DCE questionnaire, perceptions and opinions on each attribute of orphan drugs, and socio-demographic information.
The questionnaire began with a study overview and instructions. In the ‘DCE questionnaire on the assessment of the value of orphan drugs’ part, respondents were given detailed attribute and level explanations and an example choice task. After completing the choice sets, respondents evaluated task clarify and difficulty.
In the ‘perceptions and opinions on each attribute of orphan drugs’ part, Simple Multi-Attribute Rating Technique (SMART), which was a direct scoring method, was used to assess the relative importance of the attributes of orphan drugs. Respondents are asked to: 1)rank the importance of each attribute; 2) assign scores (0–100) to each attributes based on relative importance, and 3) provide additional relevant insights or recommendations.
The final part collected information including gender, age, education level, field of work, place of residence, years of experience, current workplace.
After completing the initial questionnaire design, a small-scale pre-survey was conducted. Based on the feedback from the respondents, the formal research questionnaire was optimized and adjusted.
2.4 Survey administration and data collection
This study administered surveys via the online platform, distributing three randomized questionnaire versions to respondents.
The inclusion criteria for respondents were: (1) invited basic medical insurance experts, including administrators or managers from different levels of government or hospital-based medical insurance departments; (2) invited health economics experts who were scholars specializing in health economics and pharmacoeconomics from universities and research institutions across China; (3) informed consent.
The survey was conducted from January 2025 to April 2025. During the questionnaire survey, quality control strategies were implemented to ensure the reliability of the data, specifically including: (1) electronic data collection with immutable entry upon submission; (2) researchers provided timely support; (3) regular reviews of the collected data.
Valid questionnaire criteria were: (1) Completion time ≥8 min; (2) Passing the DCE internal consistency test; (3) If meeting (1) but failing (2), responses were still deemed valid provided that attribute importance rankings in the SMART part logically aligned with corresponding importance scores.
2.5 Statistical analysis
Microsoft Excel 2019® was used to clean and validate the collected data and exclude unreasonable questionnaires. The statistical analysis included descriptive analysis, discrete choice model analysis, relative importance analysis, and willingness to pay analysis. All data analyses were done by Stata 18.
2.5.1 Descriptive statistical analysis
Descriptive statistics were used for each variable, with frequency and percentage for categorical variables.
2.5.2 Discrete choice model analysis
Based on random utility theory, the study conducted a discrete choice model to reveal the overall preferences of respondents and their heterogeneity. The model assumes that respondent i chooses option j because the utility provided by option j is higher than that of all other options (Mangham et al., 2009). Utility was calculated using the following formula:
Note: where,
The DCE data were analyzed using a mixed logit model. The selection of the model is judged by the Akaike information criterion (AIC) and the Bayesian information criterion (BIC). The significance level for statistical analysis was set at 0.05.
2.5.3 Relative importance analysis
The aim of the relative importance analysis was to weigh and prioritize the attributes. The study conducted both the direct and indirect weighing method.
2.5.3.1 Relative importance analysis based on discrete choice model
Relative importance (RI) refers to the magnitude of an attribute’s preference relative to the other attributes, reflecting the decision maker’s overall preference at the attribute level (Lancsar et al., 2007). In this study, the relative importance of attributes is calculated based on the construction of the discrete choice model to compute the weight of each attribute’s importance (Yang et al., 2025).
The specific formula for calculating the relative importance of attribute one is:
Note: where,
2.5.3.2 Relative importance analysis based on SMART
According to the second part of the questionnaire, the distribution of attribute rankings was analyzed to calculate the average and overall rankings based on the SMART method. Individual-level attribute weights were derived by normalizing the importance scores provided by each respondent, and the average weights across all respondents were then computed to reflect the overall importance scores.
2.5.4 Willingness to pay analysis
Willingness to Pay (WTP) represented the marginal utility respondents were willing to pay for a particular change in attribute level and that represented the relative importance of each attribute level (Tan et al., 2022). Among the seven attributes in this study, the annual treatment cost per patient reimbursed by basic medical insurance was treated as a continuous variable to calculate WTP for each attribute level of orphan drugs using the following formula:
Note: where,
3 Results
3.1 Respondent characteristics and questionnaire response
A total of 84 decision-makers participated in filling out the questionnaires, and 69 (83.3%) valid questionnaires were included, with 37 health economic experts and 32 basic medical insurance experts. Among all included respondents, 60.87% were male, with the majority (75.36%) aged 30–49 years. Half of them (50.72%) held a doctoral degree, and all were health economics experts. Most of them had been in this field for 10–19 years (52.17%) (Table 2).
3.2 Preferences based on mixed logit modeling
3.2.1 Preferences of attributes
Table 3 shows the results of the mixed logit model analysis. Overall, all attribute levels were statistically significant except for the two levels of the attribute ‘Unmet needs’.
The overall results of all the respondents and the subgroup results (basic medical insurance experts and health economics experts) show both consistencies and differences across various attributes. The preference coefficient for the ‘Annual treatment cost per patient reimbursed by basic medical insurance’ was significantly negative for all decision-makers (β = −0.039***) and subgroups (basic medical insurance experts: β = −0.053***; health economics experts: β = −0.067***), indicating that the higher the cost, the lower possibility that this drug included into the NRDL. The preference coefficient for ‘Improvement in health-related quality of life-Significant improvement in usual activity’ was the largest overall (β = 2.204***), and the results were similar for both subgroups. However, there were some differences between the subgroups. In terms of ‘Unmet needs’, health economics experts were nearly 2 times more likely to select ‘No specific treatment available’ orphan drugs for NRDL access compared to drug with ‘Mature treatments available’ (β = 1.917***), while the basic medical insurance experts showed a non-significant trend in preference (β = −1.017).
3.2.2 Willingness-to-pay
The willingness to pay analysis results were shown in Table 4. Among all attributes levels, the decision-makers exhibited the highest WTP for ‘significant improvement in usual activities’ (β = 56.79***). Additionally, decision-makers expressed a high WTP for levels of the severity of the disease. Specifically, compared to orphan drugs for low severe diseases, they preferred to pay 388,900 RMB per year for orphan drugs that treat diseases of moderate severity, and 451,900 RMB per year more for medications that treat diseases of high severity.
In terms of subgroups, regarding disease severity, compared to moderate severity, health economics experts were more concerned about high severity diseases, with their willingness to pay a 32% premium, while basic medical insurance experts did not show a higher preference for high disease severity. For ‘Unmet need’, health economics experts showed a high WTP (288,800 RMB/year **) for diseases with ‘No specific treatment available’ while basic medical insurance experts were significantly opposed to the inclusion (−193,400 RMB/year *). Overall, basic medical insurance experts demonstrated a higher WTP for better drug safety and evidence quality, while health economics experts showed a relatively higher WTP for other attributes.
3.3 Weighting and prioritization of the attributes
3.3.1 Relative importance based on discrete choice modelling
The results were shown in Table 5. For all decision-makers, ‘Improvement in health-related quality of life’ was the most important attribute, with a relative importance weight of 23.44%. This was followed by ‘Disease severity’ (18.65%) and ‘Annual treatment cost per patient reimbursed by basic medical insurance’ (17.34%). ‘Quality of drug evidence’ (10.94%) and ‘Unmet need’ (4.61%) had relatively lower weights and ranks.
It is evident that ‘Improvement in health-related quality of life’ was the highest-weighted attribute in all groups. ‘Disease severity’ (22.57%) was the second most important attribute for the health economics experts group. But the second most important attribute for the basic medical insurance experts was ‘Drug safety’, which was 2.84 times more important than the weight by the health economics experts.
3.3.2 Relative importance based on SMART
It was shown that the order of the average ranking was different from the order of the scoring results, but the top three attributes with higher weights were the same. In terms of average ranking, ‘Disease severity’ had the highest ranking (2.75), followed by ‘Drug efficacy’ (2.80) and ‘Improvement in health-related quality of life’ (3.54). In terms of average scoring, ‘Drug efficacy’ had the highest weight of 16.22%, followed by ‘Improvement in health-related quality of life’ (15.94%) and ‘Disease severity’ (15.18%). The attributes with the lowest weights were ‘Quality of drug evidence’ for both ranking and scoring (Table 6).
4 Discussion
4.1 Discussion of key findings
From the relative importance of the attributes derived from the DCE method, all respondents assigned a higher weight to ‘Improvement in health-related quality of life’, indicating that this attribute holds a central position in the value assessment of orphan drugs. Health-related quality of life (HRQoL) indicators (e.g., ability to usual activities, emotional state, social participation) directly reflect the impact of treatment on patients’ actual lives, integrating multidimensional values that traditional clinical endpoints (e.g., survival rate, laboratory indicators) may fail to capture. Improving HRQoL (as measured by QALY) has now become a core indicator in basic medical insurance assessments, which also contributes to long-term health economic considerations. Additionally, all respondents assigned a high weight to ‘Disease severity’ reflecting the ethical principle of ‘prioritizing urgent needs’ (Grover et al., 2020), which tends to allocate limited resources to populations with the highest disease burden. Furthermore, the moral responsibility towards vulnerable groups in our societal values contributes to public support for prioritizing extreme health conditions (Tan et al., 2022). However, we have also noticed that, compared to health economics experts, basic medical insurance experts tend to prioritize ‘Drug safety’ over ‘Disease severity’. This may reflect the fact that basic medical insurance experts first consider public safety, social stability, and fund stability, and need to guard against the risk of fund depletion caused by adverse reactions. On the other hand, when conducting NRDL access calculations, health economics experts may lack long-term safety evidence for new drugs, and are more concerned with quality of life and long-term benefits, so they place greater emphasis on ‘Disease severity’. Further research is needed to determine the causes of this discover.
The current sample selection and characteristics may influence the results. Regarding education level, 94.59% of health economics experts hold doctoral degrees, whereas basic medical insurance experts have master’s degrees (50%) and bachelor’s degrees (50%) as their highest qualifications, potentially leading to perspective biases. Medical insurance experts are more likely to come from practice-oriented backgrounds, while health economics experts tend to focus on theoretical research, methodological innovation, and long-term health outcomes. Similarly, in terms of age and work experience, the experts in this study are predominantly middle-aged and older with rich experience. This may result in a lack of innovative perspectives from younger generations, making them more conservative in accepting new value elements. Likewise, the absence of physician and patient samples in this study may lead the framework to ignore other crucial value dimensions in the treatment process.
4.2 Discussion of comparative study
The attributes of orphan drugs in this study were based on the MCDA framework established in a previous study (Chen et al., 2024), and the weights of the criteria in the original framework were based on a two-step percentile distribution method obtained from 13 stakeholders (including 3 health economics experts, 3 health insurance decision-makers, 3 clinicians, 2 clinical pharmacists, and 2 patients). Compared with previous study, the relative importance of ‘Disease severity’ was higher in both studies, which can be recognized as the most critical factor in assessing the value of orphan drugs, and is therefore an important factor to consider when NRDL access. However, the discrete choice model in this study yielded the highest weighting for ‘Improvement in health-related quality of life’ compared to the previous framework, whereas the weighting for ‘Comparative patient-perceived health/patient-reported outcomes’ was lower than that for drug benefits and effectiveness. This may reflect a paradigm shift in healthcare assessment from traditional clinical indicators to patient-centered outcomes. The reasons for this change may stem from policy drivers, such as the progressive requirement by medical insurance decision-makers to consider patient-reported outcomes (PROs) and HRQoL. Also, due to the differences in the definition and scope of the attributes, the ‘Improvement in health-related quality of life’ attribute in our study includes the overall impact of the drug on the patients’ health, whereas the ‘Comparative patient-perceived health/patient-reported outcomes’ in the original framework may be limited to symptomatic outcomes and did not adequately cover functional recovery or social participation. On the other hand, in this study, the results of the weighting of ‘Unmet needs’ ranked lower in importance, possibly due to respondents’ preference for easy-to-understand attributes such as ‘Drug efficacy’ and ‘Drug safety’. ‘Unmet need’ involves hypothetical situations and counterfactual thinking and that will cause higher cognitive load and finally lead to lower decision weight. Moreover, this study compared the weights of attributes in this study with those of the orphan drugs’ value assessment framework derived from other studies in China (Yuan and Wu, 2021; Hu et al., 2018). The results showed that there were some differences in the setting of the criteria, and some of the weighting results showed consistency. For instance, the indicators related to therapeutic efficacy were generally regarded as one of the most critical indicators, followed closely by disease severity and drug safety, which were also given higher importance. The differences in the results of different studies not only stem from the heterogeneity of the research objectives and methodologies, but also reflect the lack of a unified and standardized assessment system in the field of drug value assessment for rare diseases.
Also, this study use the SMART method to calculate the relative importance of each attribute. The ranking results derived from the SMART and DCE was inconsistent. For the relative importance for ‘Drug efficacy’, the SMART method produced higher weights compared to DCE. The reason maybe that the SMART method assigns weights through direct scoring (Dwanoko et al., 2018), and efficacy, due to its intuitive clinical significance, is easily overestimated. In contrast, the DCE method can simulate real-life choice scenarios (Wang et al., 2021). When efficacy is bundled with other high-cost or high-risk attributes (e.g., severe side effects), its priority in actual choices may be diluted. The relative importance of ‘Annual treatment cost per patient reimbursed by basic medical insurance’ also varied between the two methods. The SMART method assigned lower importance to this attribute, indicating that respondents may prefer orphan drugs with significant efficacy that greatly improve patients’ quality of life, even if higher treatment costs. In the DCE, since this attribute is a continuous variable, the values between levels may partially influence the weight calculation, leading to differences in the final weight distribution. Overall, the two methods have significant differences in theoretical foundations and operational processes. The SMART method offers simplicity and ease of use but may not capture subtle differences in preferences. While, the DCE method, although more complex, is better at accurately reflecting respondents’ preferences and provides richer information (Whichello et al., 2023).
4.3 Strengths, significance and challenges of the framework
This study established the relative importance of different criteria in MCDA framework for orphan drugs using the DCE method from the perspective of basic medical insurance in China. Our study provides a new research perspective and methodological support for the value assessment of drugs for rare diseases by integrating the strengths of DCE and MCDA. By comparing the weight and prioritization of two different types of respondents, namely, health economics experts and basic medical insurance experts, the framework reveals the core elements of the value assessment of orphan drugs and the heterogeneous concerns of different groups, providing important insights for decision-makers to balance the interests of multiple parties. In health insurance reimbursement or financing decisions, the MCDA method can enhance the transparency of decision-making and value judgments clearer, improving the consistency and repeatability of decisions (Baltussen et al., 2019). When weighting of criteria of MCDA, DCE helps researchers gain a deeper understanding of the individual choice process, revealing how different factors influence decision outcomes. Such insights assist in better understanding individual behaviors and decision-making, thereby providing strong support for decisions. The application of DCE proves to be a powerful tool for weighting criteria in healthcare multicriteria decision analysis framework.
At present, the mechanism of NRDL inclusion in China has established a systematic process of ‘preparation–application–expert review–negotiation/bidding’. The purpose of constructing an MCDA framework is to support decision-making. Therefore, the framework developed in this study can serve as supplementary material during the expert review phase and the final negotiation/bidding phase, helping to clarify the key value elements of the specific orphan drugs and better demonstrate their advantages for NRDL access.
The core dilemma in orphan drugs access lies in the trade-off between affordability for the healthcare system and the incentives for pharmaceutical innovation. Price negotiations can enhance drug accessibility by lowering costs, but may discourage companies from investing in orphan drug research and development. Conversely, inadequate cost control could jeopardize the sustainable operation of basic medical insurance funds. This tension is pronounced in orphan drug access. The value assessment framework of orphan drugs offers a structured solution: affordability considerations are incorporated through the cost-related attributes, while innovation-related social value is reflected in attributes such as disease severity, unmet need, drug efficacy and improvement in health-related quality of life. It enables decision-makers to weigh trade-offs within a more transparent framework.
However, the application of this value framework also faces challenges. First, rare diseases are characterized by small patient populations and uncertain long-term outcomes, often lacking HRQoL or long-term survival evidence. Second, China currently lacks national-level guidelines and toolkits for MCDA and DCE, potentially leading to implementation capacity gaps in practice. In addition, due to the flexibility of the framework, issues such as stakeholder representation and the determination of weights for specific orphan drugs may spark controversy.
4.4 Future study directions
Further research could validate and refine the value assessment framework of orphan drugs based on DCE and apply this framework to real-world decision-making contexts, providing practical evidence and data support for the optimization of the framework. At the same time, we recommended to explore advanced weighting methodologies and data analytics techniques to make the results more scientific and precise.
Also, in other fields, studies have proposed advanced algorithm-based MCDM approaches, aimed at more precisely handling uncertainty and complexity (Hussain et al., 2024b; Zhao et al., 2024; Ullah et al., 2025). Although this study primarily focuses on capturing stakeholders’ value preferences regarding orphan drug access, the above algorithmic approaches can provide new insights by introducing more rigorous mathematical modeling to enhance the robustness of conclusions.
4.5 Limitations
The limitations of this study are as follows. First, the questionnaire survey was conducted online via a web-based platform, rather than the traditional face-to-face method. Face-to-face interviews or surveys allow researchers to comprehensively capture respondents’ feedback and provide immediate assistance.
Second, the relatively small sample size and the current sample selection may affect the generalizability and accuracy of the findings. Future studies could consider expanding the sample scope to include more geographic regions and types of stakeholders, ensuring a balanced representation of respondents.
Third, our study does not cover specific disease types or conditions. Although the study provides useful information and conclusions, it would benefit from the inclusion of more real-world data and pharmacoeconomic evidence to further validate and refine the assessment framework.
Finally, sensitivity analysis was not performed in this study. Although sensitivity analysis is crucial for examining uncertainty in MCDA, few studies applying an MCDA framework using the DCE method in the field of HTA have conducted sensitivity analyses. This is likely because the primary objective of these studies was to construct the value assessment framework and its application remains limited to pilot or exploratory stages.
5 Conclusion
This study explored and compared the results of weighting MCDA criteria for orphan drugs by decision-making experts from basic medical insurance and health economics backgrounds using different methods, such as DCE and SMART. The results showed, from the perspective of basic medical insurance access, different types of decision experts and weighting methods may lead to slight variations in the results. However, disease severity and improvement in health-related quality of life are generally the two most important attributes influencing NRDL inclusion for orphan drugs. The application of the MCDA framework using the DCE method should be further explored for the value assessment of orphan drugs. The current framework still has some limitations in terms of sample selection, applicability, and sensitivity analysis. Future research could explore advanced weighting methodologies and data analytics techniques.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Author contributions
ZZ: Investigation, Writing – review and editing, Software, Writing – original draft, Formal Analysis, Validation, Methodology, Project administration. XT: Software, Writing – review and editing, Writing – original draft, Investigation, Formal Analysis, Project administration, Supervision, Methodology, Validation, Visualization. MH: Writing – review and editing, Conceptualization, Investigation, Writing – original draft, Funding acquisition, Supervision, Validation, Methodology, Project administration.
Funding
The author(s) declare that financial support was received for the research and/or publication of this article. The study was supported by the National Natural Science Foundation of China (No. 72374151).
Acknowledgments
We are especially grateful to stakeholders and respondents who participated in the survey for their understanding, support, and cooperation.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Generative AI statement
The author(s) declare that no Generative AI was used in the creation of this manuscript.
Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fphar.2025.1677627/full#supplementary-material
Abbreviations
MCDA, Multi-criteria Decision Analysis; NRDL, National Reimbursement Drug List; DCE, Discrete choice experiment; SMART, Simple Multi-Attribute Rating Technique; WTP, Willingness to pay; HRQoL, Health-related quality of life.
References
Angelis, A., and Kanavos, P. (2017). Multiple criteria decision analysis (MCDA) for evaluating new medicines in health technology assessment and beyond: the advance value framework. Soc. Sci. and Med. 188, 137–156. doi:10.1016/j.socscimed.2017.06.024
Baltussen, R., Marsh, K., Thokala, P., Diaby, V., Castro, H., Cleemput, I., et al. (2019). Multicriteria decision analysis to support health technology assessment agencies: benefits, limitations, and the way forward. Value Health 22, 1283–1288. doi:10.1016/j.jval.2019.06.014
Belton, V., and Stewart, T. J. (2002). Multiple criteria decision analysis. Boston, MA: Springer US. doi:10.1007/978-1-4615-1495-4
Blonda, A., Denier, Y., Huys, I., and Simoens, S. (2021). How to value orphan drugs? A review of European value assessment frameworks. Front. Pharmacol. 12, 631527. doi:10.3389/fphar.2021.631527
Bridges, J. F. P., Hauber, A. B., Marshall, D., Lloyd, A., Prosser, L. A., Regier, D. A., et al. (2011). Conjoint analysis applications in health—a checklist: a report of the ISPOR good research practices for conjoint analysis task force. Value Health 14, 403–413. doi:10.1016/j.jval.2010.11.013
Byun, J.-H., Kwon, S.-H., Ha, J.-H., and Lee, E.-K. (2016). A benefit-risk assessment model for statins using multicriteria decision analysis based on a discrete choice experiment in Korean patients. Ther. Clin. Risk Manag. 12, 965–974. doi:10.2147/TCRM.S100438
Chen, H., Xiang, Y., Tang, X., and Hu, M. (2024). Establishment of a value assessment framework for orphan medicinal products in China. Orphanet J. Rare Dis. 19, 390. doi:10.1186/s13023-024-03393-6
Dwanoko, Y. S., Habibi, F. Y., Purwanto, H. L., Swastika, I. K., and Hudha, M. N. (2018). The smart method to support a decision based on multi attributes identification. IOP Conf. Ser. Mater Sci. Eng. 434, 012037. doi:10.1088/1757-899X/434/1/012037
Ferreira, C. R. (2019). The burden of rare diseases. Am. J. Med. Genet. A 179, 885–892. doi:10.1002/ajmg.a.61124
García-Diego, D.-A., Badia, X., Benítez-Hidalgo, O., Jiménez, V., Juárez, J. C., Núñez, R., et al. (2024). Value contribution of etranacogene dezaparvovec gene therapy in moderately severe and severe haemophilia B through multi-criteria decision analysis. Haemophilia. doi:10.1111/hae.15096
Gong, S., Wang, Y., Pan, X., Zhang, L., Huang, R., Chen, X., et al. (2016). The availability and affordability of orphan drugs for rare diseases in China. Orphanet J. Rare Dis. 11, 20. doi:10.1186/s13023-016-0392-4
Grover, S., McClelland, A., and Furnham, A. (2020). Preferences for scarce medical resource allocation: differences between experts and the general public and implications for the COVID-19 pandemic. Br. J. Health Psychol. 25, 889–901. doi:10.1111/bjhp.12439
Hauber, A. B., González, J. M., Groothuis-Oudshoorn, C. G. M., Prior, T., Marshall, D. A., Cunningham, C., et al. (2016). Statistical methods for the analysis of discrete choice experiments: a report of the ISPOR conjoint analysis good research practices task force. Value Health 19, 300–315. doi:10.1016/j.jval.2016.04.004
Hu, S., Yang, Y., He, J., Du, L., and Kang, Q. (2018). The selective conditions of orphan drugs by using multiple criteria decision analysis in China. Chin. Health Econ. 37, 67–70. doi:10.7664/CHE20180319
Hussain, A., Yin, S., Ullah, K., Waqas, M., Senapati, T., Esztergár-Kiss, D., et al. (2024a). Enhancing renewable energy evaluation: utilizing complex picture fuzzy frank aggregation operators in multi-attribute group decision-making. Sustain. Cities Soc. 116, 105842. doi:10.1016/j.scs.2024.105842
Hussain, A., Ullah, K., Pamucar, D., and Simic, V. (2024b). Intuitionistic fuzzy Sugeno-Weber decision framework for sustainable digital security assessment. Eng. Appl. Artif. Intell. 137, 109085. doi:10.1016/j.engappai.2024.109085
Hussain, A., Ullah, K., Moslem, S., and Senapati, T. (2025a). Decision algorithms for solar panel selection using T-spherical fuzzy Sugeno-Weber triangular norms. Energy Rep. 13, 6651–6668. doi:10.1016/j.egyr.2025.05.086
Hussain, A., Anwar, H., Ullah, K., Pamucar, D., and Simic, V. (2025b). Computational assessment of energy supply sustainability using picture fuzzy choquet integral decision support system. CMC 85, 1311–1337. doi:10.32604/cmc.2025.066569
Hussain, A., Ullah, K., Ali, Z., Moslem, S., and Senapati, T. (2025c). An enhanced physical education evaluation algorithm for higher education using interval-valued Fermatean fuzzy information. Socio-Economic Plan. Sci. 101, 102280. doi:10.1016/j.seps.2025.102280
IQVIA (2019). China rare disease drug accessibility report 2019. Available online at: https://mp.weixin.qq.com/s/ICZytFVlUcz7euDU0TbxJA (Accessed July 14, 2025).
Iskrov, G., and Stefanov, R. (2014). Post-marketing access to orphan drugs: a critical analysis of health technology assessment and reimbursement decision-making considerations. Orphan Drugs Res. Rev., 1–9. doi:10.2147/ODRR.S43409
Joppi, R., and Garattini, S. (2013). Orphan drugs, orphan diseases. The first decade of orphan drug legislation in the EU. Eur. J. Clin. Pharmacol. 69, 1009–1024. doi:10.1007/s00228-012-1423-2
Lancsar, E., Louviere, J., and Flynn, T. (2007). Several methods to investigate relative attribute impact in stated preference experiments. Soc. Sci. Med. 64, 1738–1753. doi:10.1016/j.socscimed.2006.12.007
Lasalvia, P., Prieto-Pinto, L., Moreno, M., Castrillón, J., Romano, G., Garzón-Orjuela, N., et al. (2019). International experiences in multicriteria decision analysis (MCDA) for evaluating orphan drugs: a scoping review. Expert Rev. Pharmacoeconomics and Outcomes Res. 19, 409–420. doi:10.1080/14737167.2019.1633918
Mangham, L. J., Hanson, K., and McPake, B. (2009). How to do (or not to do). Designing a discrete choice experiment for application in a low-income country. Health Policy Plan. 24, 151–158. doi:10.1093/heapol/czn047
McQueen, R. B., Inotai, A., Zemplenyi, A., Mendola, N., Németh, B., and Kalo, Z. (2024). Multistakeholder perceptions of additional value elements for United States value assessment of health interventions. Value Health 27, 15–25. doi:10.1016/j.jval.2023.09.2910
National Health Commission of the People’s Republic of China (2019). Notice of the general office of the national health commission on issuance of the guidelines for the Diagnosis and treatment of rare diseases. 2019 edition. Available online at: https://www.nhc.gov.cn/yzygj/c100068/201902/073540e8f83b4a54a28684d23e2ae2f5.shtml (Accessed July 14, 2025).
Nie, Z., Tian, X., Wang, Y., Li, W., and Han, S. (2023). Comparison of MCDA weighting techniques in clinical comprehensive evaluation. World Clin. Drug 44, 437–444. doi:10.13683/j.wph.2023.05.007
Oliveira, M. D., Mataloto, I., and Kanavos, P. (2019). Multi-criteria decision analysis for health technology assessment: addressing methodological challenges to improve the state of the art. Eur. J. Health Econ. 20, 891–918. doi:10.1007/s10198-019-01052-3
Palaska, C., and Hutchings, A. (2015). Value assessment and pricing frameworks for rare disease treatments: new approaches from the literature. Value Health 18, A678. doi:10.1016/j.jval.2015.09.2013
Phelps, C. E., Lakdawalla, D. N., Basu, A., Drummond, M. F., Towse, A., and Danzon, P. M. (2018). Approaches to aggregation and decision making—a health economics approach: an ISPOR special task force report [5]. Value Health 21, 146–154. doi:10.1016/j.jval.2017.12.010
Reed Johnson, F., Lancsar, E., Marshall, D., Kilambi, V., Mühlbacher, A., Regier, D. A., et al. (2013). Constructing experimental designs for discrete-choice experiments: report of the ISPOR conjoint analysis experimental design good research practices task force. Value Health 16, 3–13. doi:10.1016/j.jval.2012.08.2223
Richter, T., Nestler-Parr, S., Babela, R., Khan, Z. M., Tesoro, T., Molsen, E., et al. (2015). Rare disease terminology and definitions-A systematic global review: report of the ISPOR rare disease special interest group. Value Health 18, 906–914. doi:10.1016/j.jval.2015.05.008
Rukhsar, M., Hussain, A., Ullah, K., Moslem, S., and Senapati, T. (2025). Intelligent decision analysis for green supplier selection with multiple attributes using circular intuitionistic fuzzy information aggregation and frank triangular norms. Energy Rep. 13, 5773–5791. doi:10.1016/j.egyr.2025.05.011
Ryan, M., and Farrar, S. (2000). Using conjoint analysis to elicit preferences for health care. BMJ 320 (320), 1530–1533. doi:10.1136/bmj.320.7248.1530
Schey, C., Krabbe, P. F. M., Postma, M. J., and Connolly, M. P. (2017). Multi-criteria decision analysis (MCDA): testing a proposed MCDA framework for orphan drugs. Orphanet J. Rare Dis. 12, 10. doi:10.1186/s13023-016-0555-3
Sussex, J., Rollet, P., Garau, M., Schmitt, C., Kent, A., and Hutchings, A. (2013). A pilot study of multicriteria decision analysis for valuing orphan medicines. Value Health 16, 1163–1169. doi:10.1016/j.jval.2013.10.002
Tan, S., Wang, Y., Tang, Y., Jiang, R., Chen, M., Chen, H., et al. (2022). Societal preferences for funding orphan drugs in China: an application of the discrete choice experiment method. Front. Public Health 10, 1005453. doi:10.3389/fpubh.2022.1005453
Ullah, K., Hussain, A., Latif, S., Mahmood, T., and Ali, Z. (2025). Supplier selection based on group decision making using q-rung orthopair fuzzy Aczel Alsina Hamy mean operators. Int. J. Knowledge-Based Intelligent Eng. Syst. 29, 375–403. doi:10.1177/13272314241309034
Vass, C., Boeri, M., Karim, S., Marshall, D., Craig, B., Ho, K.-A., et al. (2022). Accounting for preference heterogeneity in discrete-choice experiments: an ISPOR special interest group report. Value Health 25, 685–694. doi:10.1016/j.jval.2022.01.012
Wang, Q., Zhang, X., Xue, H., Yuan, H., and Peng, Y. (2020). Research progress in developing attributes and levels of discrete choice experiments. Mod. Prev. Med. 47, 2199–2201. doi:10.20043/j.cnki.mpm.2020.12.024
Wang, Y., Wang, Z., Wang, Z., Li, X., Pang, X., and Wang, S. (2021). Application of discrete choice experiment in health care: a bibliometric analysis. Front. Public Health 9, 673698. doi:10.3389/fpubh.2021.673698
Whichello, C., Smith, I., Veldwijk, J., de Wit, G. A., Rutten- van Molken, MPMH, and de Bekker-Grob, E. W. (2023). Discrete choice experiment versus swing-weighting: a head-to-head comparison of diabetic patient preferences for glucose-monitoring devices. PLoS One 18, e0283926. doi:10.1371/journal.pone.0283926
Yang, J., Ma, B., Chen, S., Huang, Y., Wang, Y., Chen, Y., et al. (2025). Nurses’ preferences for working in Uber-style “Internet plus” nursing services: a discrete choice experiment. Int. J. Nurs. Stud. 161, 104920. doi:10.1016/j.ijnurstu.2024.104920
Ying, Z., Gong, L., and Li, C. (2021). An update on China’s national policies regarding rare diseases. Intractable Rare Dis. Res. 10, 148–153. doi:10.5582/irdr.2021.01027
Yuan, S., and Wu, Y. (2021). Construction of an evaluation indicator system for rare disease drug coverage in China’s medical insurance. Health Dev. Policy Res. 24, 646–649. doi:10.13688/j.cnki.chr.2021.201039
Zhang, M., Bao, Y., Lang, Y., Fu, S., Kimber, M., Levine, M., et al. (2022a). What is value in health and healthcare? A systematic literature review of value assessment frameworks. Value Health 25, 302–317. doi:10.1016/j.jval.2021.07.005
Zhang, B., Zhang, S., Qu, J., Liu, X., Shang, J., and Qiao, L. (2022b). Expert consensus on the application of multiple criteria decision analysis in comprehensive clinical evaluation of orphan drugs (2022). J. Rare Dis. 1, 158–177. doi:10.12376/j.issn.2097-0501.2022.02.010
Zhang, M., Yang, Y., Bao, Y., Kimber, M., Levine, M., and Xie, F. (2024). Scoring the value assessment framework for China: a factorial survey. Value Health 27, 330–339. doi:10.1016/j.jval.2023.12.002
Keywords: orphan drugs, basic medical insurance access, value assessment framework, multicriteria decision analysis, discrete choice experiment
Citation: Zhao Z, Tang X and Hu M (2025) Establishment of a value assessment framework for orphan drugs in China: an application of the discrete choice experiment in multicriteria decision analysis. Front. Pharmacol. 16:1677627. doi: 10.3389/fphar.2025.1677627
Received: 01 August 2025; Accepted: 22 September 2025;
Published: 02 October 2025.
Edited by:
Tapan Senapati, Southwest University, ChinaReviewed by:
Qian Jiang, Sichuan Cancer Hospital, ChinaChiranjibe Jana, Vidyasagar University, India
Abrar Hussain, Riphah International University (Lahore), Pakistan
Copyright © 2025 Zhao, Tang and Hu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Ming Hu, aHVtaW5nQHNjdS5lZHUuY24=
†These authors have contributed equally to this work and share first authorship