Development of the Korean Medicine Core Outcome Set for Facial Palsy: herbal medicine treatment of patients with facial palsy in primary clinics

1 Introduction

Facial Palsy (FP) is a medical condition characterized by the sudden onset of unilateral facial muscle weakness or paralysis, often resulting in significant functional and esthetic impairment (1, 2). While there are various causes for FP, including infections, local inflammation, and malignancy, the most common form is idiopathic facial paralysis, known as Bell’s palsy (3). This condition, which can occur at any age, significantly impacts the physical appearance, emotional well-being, and overall quality of life of patients (4, 5). It often leads to difficulties in facial expression, eating, speaking, and, in severe cases, specific dysfunctions such as the inability to blink or close the eye, and difficulty puckering the lips or raising the mouth corner, thereby profoundly affecting daily activities and social interactions (3, 6). The prevalence of FP varies globally, but it is considered a relatively common neurological disorder, affecting approximately 10–40 per 100,000 individuals annually (3, 6, 7). In conventional medicine, the primary treatments for FP typically involve the use of medications such as corticosteroids and antiviral agents, often complemented by surgical interventions like facial nerve decompression when necessary (7, 8). However, these treatments often have limited efficacy, particularly in cases of severe palsy or delayed treatment initiation, and are associated with potential side effects (8–11). These limitations highlight the need for more comprehensive treatment strategies in managing FP (7).

In several Asian countries, where herbal medicine (HM) plays an integral role in national healthcare, HM has emerged as a promising alternative treatment for FP, specifically targeting idiopathic peripheral FP, also known as Bell’s palsy. Research indicates its efficacy in reducing inflammation, improving symptoms, and providing neuroprotective effects, particularly through the use of compounds like Radix saposhnikoviae and Bombyx batryticatus (12, 13). Additionally, a study has shown that patients treated with a combination of acupuncture and HM for Bell’s palsy experienced not only faster overall recovery but also shorter periods of initial recovery (14). However, the integration of HM into clinical practice faces challenges due to methodological inconsistencies, primarily the lack of standardized outcome measures (15). This lack of standardization in research methodologies and assessment scales leads to fragmented understanding, data inconsistency, and potential reporting bias. Such disparities complicate the decision-making process for healthcare practitioners and create uncertainties for patients considering alternative or complementary treatments (16).

While there is suggestive evidence of the benefits of HM in treating FP, there is an obvious need for clinical trials rigorously evaluating its efficacy. In South Korea, most Korean Medicine (KM) facilities are primary clinics (17), where conducting extensive clinical trials is challenging due to limited personnel and resources. Consequently, reported studies may often not meet the highest research standards or focus on outcomes that might not be the most relevant. The Korean Medicine Clinical Practice Guideline for Facial Palsy recommends combining HM with steroid therapy (18), but evidence for the efficacy and safety of HM is still insufficient (19). To address this, the Korean government initiated a pilot project in 2020 to support HM treatment for idiopathic peripheral FP in primary clinics, with health insurance covering the costs for 10 days of HM treatment that meets specific diagnostic and quality standards (20). However, a critical limitation of this project is the lack of a standardized outcome model to evaluate the impact of HM on Bell’s palsy.

A Core Outcome Set (COS) comprises a set of vital outcomes, established through consensus among healthcare professionals and patients, which are essential to be assessed and reported in all clinical trials and practices for a specific medical condition (21). It ensures consistency in data collection and enhances the comparability of research findings across different studies (16). Recognizing the necessity for such standardization in the evaluation of HM treatments for Bell’s palsy, this study aims to develop a Core Outcome Set for Facial Palsy in Korean Medicine (COS-FP-KM). The COS-FP-KM will enable the assessment of the effectiveness of HM in treating Bell’s palsy in patients visiting KM primary clinics, using consistent and appropriate evaluation variables. This effort is crucial for improving the quality and relevance of research in this field, thereby facilitating more informed decision-making in clinical practice.

2 Methods

In this study, we developed a COS following a structured approach tailored to our specific objectives and scope, as outlined in Table 1. An important aspect of this process was the extraction of effect modifiers, key factors that influence outcomes, to aid clinicians in their history-taking and assessment. Our methodology for developing the COS was aligned with the processes established by the Core Outcome Measures in Effectiveness Trials (COMET) initiative and adhered to standard COS guidelines (22). This development involved three distinct phases, consistent with the methods used in previous studies (23, 24). Initially, we formed a Project Management Group (PMG) responsible for overseeing the development process. This group undertook the task of generating and refining an initial list of outcomes through an extensive literature review. The second phase involved a modified Delphi consensus process conducted by experts in the field. Following this, primary clinicians participated in a similar modified Delphi process during the third phase.

Table 1

Table 1. Recommendations of the core outcome set standards for development (COS-STAD).

2.1 Phase 1: establishment of project management group and development of an initial list of outcomes and effect modifiers

A PMG was formed for this study, comprising five expert researchers from the Korea Institute of Oriental Medicine. Their responsibilities included an extensive literature review and extracting crucial outcomes and effect modifiers while ensuring the removal of any redundant results. The scope of the COS was determined, followed by a focused review of literature related to FP (Supplementary material 1).

In our analysis, we concentrated on review papers related to HM trials for patients with FP, with a focus on verifying the inclusion criteria and outcomes of the studies incorporated in these reviews. The review papers included a diverse range of studies, including Randomized Controlled Trials (RCTs), observational studies, and case reports. For each study, we extracted key information, including study design, target disease, sample size, and various outcomes. Outcomes were categorized into doctor-reported and patient-reported outcomes, and outcomes associated with medical devices. The process involved meticulous examination and verification of each study’s design and outcomes. Any discrepancies or disagreements encountered during this analytical stage were resolved through discussion among the research team.

Additionally, we reviewed previously published books and articles pertinent to FP, such as “Korean Medicine Clinical Practice Guideline for Facial Palsy” and other relevant literature on risk factors for FP (18, 25). This review helped us extract recommended outcomes and effect modifiers specific to FP. To streamline our research, duplicate studies and outcomes were removed. The PMG meticulously reviewed and refined the list of outcomes and effect modifiers in alignment with the rationale of this COS, finalizing the list for the next phase of the study.

2.2 Phase 2: expert consensus process through modified Delphi method

In this phase, we collaborated with The Korean Acupuncture & Moxibustion Medicine Society and the Korean Medicine Clinical Practice Guideline for Facial Palsy Development Team for a modified Delphi round. Following a request from the PMG, these organizations recommended a panel of experts, selected for their extensive experience and expertise in the field of facial palsy treatment. Ultimately, five experts agreed to participate after understanding the objectives and scope of the COS.

The modified Delphi round involved distributing materials for review, followed by group feedback sessions and consensus meetings. In the initial round, panel members were presented with the list of outcomes and effect modifiers identified in Phase 1. The process followed a unanimous decision-making approach, where each item was deliberated upon with the option of “consensus in” or “consensus out” to determine its relevance, and conflicts were resolved through discussion, continuing until unanimous agreement was reached. Additionally, panel members had the opportunity to suggest any new outcomes or effect modifiers not previously listed.

In the two following rounds (Rounds 2 and 3), the panel engaged in detailed discussions on all the proposed outcomes and effect modifiers, including those added in the first round. These discussions considered the initial responses from the panel members and were directed toward ensuring alignment with the scope of the COS. The process was iterative, persisting until a collective agreement was achieved on the final compilation of outcomes and effect modifiers to be included in the COS.

2.3 Phase 3: primary clinicians consensus process through modified Delphi method

In this critical phase, primary clinicians, pivotal in the field of FP treatment, were engaged to review the feasibility of previously identified outcomes and effect modifiers. This panel, comprising KM primary clinicians with a minimum of five years of clinical experience, was assembled following recommendations from The Korean Medicine Specialists Association at the request of the PMG. The panel included 11 professionals, with two specializing in facial palsy.

Their task was to assess the practicality of implementing the outcomes and modifiers in KM primary clinic settings. The questionnaire was structured into two sections: the first addressing effect modifiers related to facial palsy, and the second focusing on several distinct outcome measures. These included the House–Brackmann scale, the patient-perceived onset of symptom improvement, the EuroQoL 5-Dimension 5-Level (EQ-5D-5L) & EuroQol Visual Analog Scale (EQ-VAS) assessments for quality of life, and evaluations of patient satisfaction. Each of these outcome measures was rated by the clinicians on a detailed nine-point scale.

Notably, some items such as certain laboratory tests and records of adverse events were not included in this phase. These were deemed essential by the PMG for investigating the safety and effectiveness of herbal medicines in treating facial palsy and were thus considered inherent elements of the COS.

2.4 Data analysis

2.4.1 Expert consensus in phase 2

During the expert-led modified Delphi consensus in Phase 2, we set unanimity as the predefined criterion for achieving consensus on the COS. Decisions were classified as either achieving full consensus “consensus in” or not “consensus out.”

2.4.2 Primary clinician consensus in phase 3

In line with our previously published COS studies (23, 24), we employed the Content Validity Ratio (CVR) alongside measures of consensus and convergence to evaluate content validity and the formation of consensus. For the panel of 11 Delphi participants, the critical values for CVR, consensus degree, and convergence were established at ≥0.636, ≥0.75, and ≤ 0.5, respectively (26, 27).

2.5 Ethics and consent

The study received an exemption from ethical approval by the Institutional Review Board (IRB) of the Korea Institute of Oriental Medicine in Daejeon, Republic of Korea (IRB approval No. I-2203/003-001). Prior to participation, all panel members were required to provide written informed consent, ensuring their voluntary involvement and understanding of the study’s objectives and procedures.

3 Results

3.1 Phase 1: development of an initial list of outcomes and effect modifiers

The initial literature search across databases including PubMed, CENTRAL, OASIS, and Science-On yielded a total of 174 studies. Of these, eight were removed due to duplication. Through the screening of titles and abstracts, an additional 163 studies were excluded for not meeting our inclusion criteria. Following a thorough full-text review for eligibility, no additional studies were excluded, resulting in the inclusion of three review studies for detailed analysis (Figure 1). Among these, one review detailed 14 distinct tools for assessing facial palsy, another encompassed two relevant RCTs and four prospective observational studies, and the third review brought in 37 case reports. Consequently, our analysis incorporated a total of 44 studies that were extracted from selected review articles, as enumerated in Supplementary Table S1.

Figure 1

Figure 1. Flow chart of selection process. RCT, randomized controlled trial.

From the three selected review articles, we extracted 44 individual studies, yielding a diverse array of outcomes and effect modifiers relevant to FP. In this step (Step 1), we identified 22 specific outcomes, including several specific scales and assessments for FP, such as the House–Brackmann scale and Yanagihara’s unweighted grading system. Subsequently, an in-depth examination of related literature, including the “Korean Medicine Clinical Practice Guideline for Facial Palsy” and other studies addressing FP risk factors (Step 2) (18, 25), contributed an additional nine outcomes and 10 effect modifiers. Following these stages, the PMG engaged in comprehensive discussions to evaluate these items, categorizing them as suitable (“in”) or not (“out”) for inclusion in the COS for the next phase of the study. After eliminating duplicates from the initial findings, the refined list for the Phase 2 consensus included a total of 23 outcomes and 10 effect modifiers (Table 2).

Table 2

Table 2. Summary of outcomes and effect modifiers identified in Phase 1.

3.2 Phase 2: expert consensus process through modified Delphi method

In Phase 2, we assembled a panel of five experts, each with a minimum of 10 years of clinical experience in FP and KM, working at facial nerve centers (Supplementary Table S2). These experts actively participated in the initial round of the Delphi process, during which they proposed two new outcomes and six potential effect modifiers. The PMG then evaluated each suggested outcome for potential inclusion in the next round. The questionnaire for the second round included both the newly proposed outcomes and effect modifiers, as well as those carried over from the first round. All participants from Round 1 were invited back. During this round, there was a unanimous agreement to exclude 13 outcomes and nine effect modifiers. Moreover, there was agreement that the items with no consensus would be revisited in Round 3. Accordingly, round 3 questionnaires comprised 12 outcomes and seven effect modifiers without a reached consensus. As in Round 2, all respondents were invited to participate in Round 3. Finally, eight outcomes and six effect modifiers met the consensus inclusion criteria for the COS. Table 3 and Figure 2 present the process involved for each round.

Table 3

Table 3. Summary of the consensus process during the three Delphi rounds in Phase 2.

Figure 2

Figure 2. Overview of the consensus process during the three Delphi rounds in Phase 2. EMs, effect modifiers; SAQ, synkinesis assessment questionnaire; VAS, visual analog scale; NRS, numerical rating scale; MET, myoneural excitability test; DITI, digital infrared thermographic imaging; EMG, electromyography; ENoG, electroneurography; AST, aspartate transaminase; ALT, alanine transaminase; BUN, blood urea nitrogen; Cr, creatinine.

3.3 Phase 3: primary clinicians consensus process through modified Delphi method

In this phase, the panel included 11 clinicians, with two specializing in FP (Supplementary Table S3). Primary clinicians reached a consensus on all proposed items, as evidenced by the CVR surpassing the critical threshold for each question. This consensus affirmed that every item was both pertinent for the COS and practicable for data collection within KM primary clinic settings. The evaluation of effect modifiers and patient satisfaction yielded a high degree of consensus and convergence, reflecting a consistent perspective on the inclusion of these effect modifiers. However, agreement on the practicality of including the EQ-5D-5L and EQ-VAS was less definitive, as indicated by a low level of consensus and convergence, highlighting varying views on their integration (Table 4).

Table 4

Table 4. Results of the consensus process in primary clinicians.

4 Discussion

In the process of creating a COS for HM treatments targeting patients with FP in primary KM clinics, we adhered to the guidelines provided by the COMET initiative (22). This endeavor began with a review of related literature undertaken by the PMG (Phase 1). Subsequent phases involved modified Delphi exercises with experts in FP and KM (Phase 2), and a final phase with clinicians from KM primary clinical settings (Phase 3). These exercises were pivotal in assessing the applicability and feasibility of the COS, culminating in the identification of eight specific outcomes and six effect modifiers for the final COS.

In the development process from Phase 1 to Phase 3, our research was oriented toward understanding the distinct characteristics of FP and its practicality within primary KM clinical settings. FP often manifests suddenly and significantly impacts patient quality of life by affecting facial expressions and functions (1–5). While treatments including corticosteroids, antiviral agents, and HM are typically effective within three weeks to three months (28, 29), around 30% of patients may still suffer from enduring complications such as permanent facial weakness, even after undergoing proper treatment (30). During the consensus process, the PMG and experts agreed on the importance of considering a broad range of physical and psychological factors in the COS for FP. This perspective was crucial, given that FP symptoms can vary widely in severity and impact, and are influenced by an array of external and internal factors.

The applicability of the COS in primary KM clinics was also a key consideration, recognizing that these clinics often have limited resources and personnel for conducting large trials, as previously noted in our studies (23, 24). Therefore, we emphasized the feasibility of implementing the COS in primary KM clinical settings. Drawing from previous studies in KM clinics (7, 29), our goal was to develop a practical and effective COS with simple, accurate outcomes that seamlessly integrate into routine clinical practices without significant disruption. In developing the COS-FP-KM, we paid special attention to selecting outcomes that align with the practical realities of these clinical settings. Considering that a significant portion of KM institutions operates as primary care clinics (17), it was essential to choose outcomes that are feasible to assess within these resource-limited environments.

The COS outcomes for FP, including the House–Brackmann scale, time to first improvement, quality of life scales (EQ-5D-5L and EQ-VAS), and patient satisfaction measures, were selected for their straightforward and efficient applicability. These outcomes were designed to facilitate treatment effectiveness assessments without overburdening clinicians with additional workload or resource demands. Crucially, this approach of reducing clinical workload enhances decision-making quality, as it allows clinicians to concentrate more on essential patient care aspects, thereby streamlining the evaluation process and ultimately leading to better patient outcomes (31, 32). This strategy not only simplifies assessments but also boosts the overall efficacy and efficiency of treatments in KM clinics. Additionally, the inclusion of biochemical parameters such as Aspartate Aminotransferase, Alanine Aminotransferase, Blood Urea Nitrogen, and Creatinine, as well as the monitoring of Western medicine usage, are crucial for evaluating the safety of HM treatments. These outcomes are essential for simultaneously assessing the efficacy and potential side effects of HM, enabling the monitoring of adverse reactions or complications that may arise from HM treatments or their interactions with conventional medications (33, 34). Furthermore, including effect modifiers like postauricular pain, taste disorder, and Ramsay Hunt syndrome in the COS for FP is considered for its potential impact on treatment outcomes and patient prognosis (35). These frequently observed symptoms in FP provide insight into the unique experiences of each patient. This approach leads to the development of tailored and more effective treatment strategies within KM Clinics, acknowledging the diverse manifestations of FP.

While our study is extensive, it faces several limitations impacting the derived outcomes. In the initial literature review (Phase 1), we only included three review papers, potentially overlooking some other relevant trials. This approach might have led to an incomplete coverage of relevant trials, thereby potentially limiting the range of outcomes in our COS for FP. Furthermore, the process of developing the COS encountered a limitation in the panel diversity. Thus, the number of panelists, sourced from a professional society, was relatively smaller than that in comparable studies (36, 37), which could have restricted the variety of insights during the COS development. Additionally, our study primarily involved disease specialists and primary KM clinicians, omitting participation from other vital stakeholders like patients and policy experts. While we attempted to mitigate this shortcoming by having clinicians apply the COS in practical settings and gather patient feedback, a more comprehensive approach involving semi-structured interviews with a broader stakeholder group is recommended for future refinements of the COS.

5 Conclusion

COS-FP-KM is the first COS on FP developed for primary KM care settings. The new tool is expected to standardize outcome selection and reporting, aiding in an efficient evaluation of the therapeutic effects of HM for FP. This COS will be used in the the Korean government HM pilot project, with continuous discussions to enhance the degree of completeness and reliability. Further studies are warranted to involve more relevant stakeholder groups, such as patient representatives and policy experts.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.

Ethics statement

Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. Prior to participation, all panel members were required to provide written informed consent, ensuring their voluntary involvement and understanding of the study's objectives and procedures.

Author contributions

S-DK: Writing – original draft, Writing – review & editing, Formal analysis, Visualization. SK: Writing – original draft, Writing – review & editing, Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation. MJS: Methodology, Resources, Writing – original draft, Writing – review & editing. JC: Methodology, Writing – original draft, Writing – review & editing. P-WK: Methodology, Writing – original draft, Writing – review & editing. MMK: Writing – original draft, Writing – review & editing, Formal analysis. SJ: Writing – original draft, Writing – review & editing, Methodology. CY: Methodology, Writing – original draft, Writing – review & editing, Funding acquisition, Project administration. ML: Methodology, Writing – original draft, Writing – review & editing, Conceptualization, Supervision.

Funding

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This work was funded by the Korea Institute of Oriental Medicine (KSN2121211), supported by the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (HF22C0087). The funders had no role in the design or conduct of the study, in the analysis and interpretation of the data, or in the preparation or approval of the manuscript.

Acknowledgments

The authors thank all the individuals who participated in the Delphi consensus exercise, specially Jong Uk Kim, who provided genuine opinion for the COS. We would also like to thank Editage (www.editage.co.kr) for English language editing.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2024.1391544/full#supplementary-material

References

1. Krane, NA, Genther, D, Weierich, K, Hanseler, H, Liu, SW, Mowery, A, et al. Degree of self-reported facial impairment correlates with social impairment in individuals with facial paralysis and Synkinesis. Facial Plast Surg Aesthet Med. (2020) 22:362–9. doi: 10.1089/fpsam.2020.0082

PubMed Abstract | Crossref Full Text | Google Scholar

2. Newadkar, UR, Chaudhari, L, and Khalekar, YK. Facial palsy, a disorder belonging to influential neurological dynasty: review of literature. N Am J Med Sci. (2016) 8:263–7. doi: 10.4103/1947-2714.187130

PubMed Abstract | Crossref Full Text | Google Scholar

3. Singh, A, and Deshmukh, P. Bell's palsy: a review. Cureus. (2022) 14:e30186. doi: 10.7759/cureus.30186

Crossref Full Text | Google Scholar

4. Finsterer, J . Management of peripheral facial nerve palsy. Eur Arch Otorrinolaringol. (2008) 265:743–52. doi: 10.1007/s00405-008-0646-4

PubMed Abstract | Crossref Full Text | Google Scholar

5. Györi, E, Przestrzelski, C, Pona, I, Hagmann, M, Rath, T, Radtke, C, et al. Quality of life and functional assessment of facial palsy patients: a questionnaire study. Int J Surg. (2018) 55:92–7. doi: 10.1016/j.ijsu.2018.04.061

Crossref Full Text | Google Scholar

6. Ton, G, Lee, LW, Ng, HP, Liao, HY, Chen, YH, Tu, CH, et al. Efficacy of laser acupuncture for patients with chronic Bell's palsy: a study protocol for a randomized, double-blind, sham-controlled pilot trial. Medicine (Baltimore). (2019) 98:e15120. doi: 10.1097/MD.0000000000015120

PubMed Abstract | Crossref Full Text | Google Scholar

7. Jeong, HI, Kim, KH, Oh, YT, Choi, YM, Song, BY, Kim, JU, et al. Korean medicine for treating facial palsy: a literature review of case reports. J Pharmacopunc. (2018) 21:214–25. doi: 10.3831/KPI.2018.21.025

PubMed Abstract | Crossref Full Text | Google Scholar

8. Gagyor, I, Madhok, VB, Daly, F, and Sullivan, F. Antiviral treatment for Bell's palsy (idiopathic facial paralysis). Cochrane Database Syst Rev. (2019) 9:Cd001869. doi: 10.1002/14651858.CD001869.pub9

Crossref Full Text | Google Scholar

9. Kim, Y, Doo, JG, Chon, J, Lee, JH, Jung, J, Lee, JM, et al. Steroids plus antiviral agents are more effective than steroids alone in the treatment of severe Bell's palsy patients over 40 years of age. Int J Immunopathol Pharmacol. (2021) 35:20587384211042124. doi: 10.1177/20587384211042124

Crossref Full Text | Google Scholar

10. Lee, SY, Seong, J, and Kim, YH. Clinical implication of facial nerve decompression in complete Bell's palsy: a systematic review and meta-analysis. Clin Exp Otorhinolaryngol. (2019) 12:348–59. doi: 10.21053/ceo.2019.00535

PubMed Abstract | Crossref Full Text | Google Scholar

11. Mantsopoulos, K, Psillas, G, Psychogios, G, Brase, C, Iro, H, and Constantinidis, J. Predicting the long-term outcome after idiopathic facial nerve paralysis. Otol Neurotol. (2011) 32:848–51. doi: 10.1097/MAO.0b013e31821da2c6

PubMed Abstract | Crossref Full Text | Google Scholar

12. Koo, B-S, An, H-G, Moon, S-K, Lee, Y-C, Kim, H-M, Ko, J-H, et al. Bombycis corpus extract (BCE) protects hippocampal neurons against excitatory amino acid-induced neurotoxicity. Immunopharmacol Immunotoxicol. (2003) 25:191–201. doi: 10.1081/IPH-120020469

PubMed Abstract | Crossref Full Text | Google Scholar

13. Lee, SM, Lee, S, Park, JH, Park, JJ, and Lee, S. A close look at an integrative treatment package for Bell's palsy in Korea. Complement Ther Clin Pract. (2017) 26:76–83. doi: 10.1016/j.ctcp.2016.12.003

PubMed Abstract | Crossref Full Text | Google Scholar

14. Jin, D-E, Jang, S-Y, Jung, Y-S, Choi, G-H, and Shin, H-C. Herbal medicine for treating Bell's palsy: a retrospective chart review. Integr Med Res. (2020) 9:100418. doi: 10.1016/j.imr.2020.100418

PubMed Abstract | Crossref Full Text | Google Scholar

15. Zhang, L, Zhang, J, Chen, J, Xing, D, Mu, W, Wang, J, et al. Clinical research of traditional chinese medicine needs to develop its own system of core outcome sets. Evid Based Complement Alternat Med. (2013) 2013:202703. doi: 10.1155/2013/202703

Crossref Full Text | Google Scholar

16. Williamson, P, Altman, D, Blazeby, J, Clarke, M, and Gargon, E. Driving up the quality and relevance of research through the use of agreed core outcomes. J Health Serv Res Policy. (2012) 17:1–2. doi: 10.1258/jhsrp.2011.011131

Crossref Full Text | Google Scholar

17. Park, JH, Lee, S, Kim, T-H, Kim, S, and Lee, J-H. Current status of case reports and case series reported by Korean medicine doctors in primary clinics: a systematic review. Integrat Med Res. (2020) 9:100417. doi: 10.1016/j.imr.2020.100417

PubMed Abstract | Crossref Full Text | Google Scholar

18. National Institute For Korean Medicine Development . (2019). Korean Medicine Clinical Practice Guideline for Facial Palsy. Available at: https://nikom.or.kr/nckm/module/practiceGuide/view.do?guide_idx=201&menu_idx=14 (Accessed January 30, 2024)

Google Scholar

19. Research Institute for Healthcare Policy of the Korean Medical Association . (2023). Academic review and problem analysis of the "The Korean Medicine Clinical Practice Guideline for Facial Palsy" published in 2019. Available at: https://www.rihp.re.kr/bbs/board.php?bo_table=research_report&wr_id=348 (Accessed January 30, 2024)

Google Scholar

20. Korea Ministry of Health and Welfare . (2020). Guidelines for the Pilot Project on Health Insurance Application for Herbal Medicine. Available at: https://www.mohw.go.kr/board.es?mid=a10501010200&bid=0003&act=view&list_no=361079 (Accessed January 30, 2024)

Google Scholar

21. Williamson, PR, Altman, DG, Bagley, H, Barnes, KL, Blazeby, JM, Brookes, ST, et al. The Comet handbook: version 1.0. Trials. (2017) 18:280. doi: 10.1186/s13063-017-1978-4

PubMed Abstract | Crossref Full Text | Google Scholar

22. Kirkham, JJ, Gorst, S, Altman, DG, Blazeby, JM, Clarke, M, Devane, D, et al. Core outcome set-standards for reporting: the COS-STAR statement. PLoS Med. (2016) 13:e1002148. doi: 10.1371/journal.pmed.1002148

PubMed Abstract | Crossref Full Text | Google Scholar

23. Cha, J, Kim, S, Kim, PW, Lee, H, Ko, MM, Jang, S, et al. Development of the Korean medicine Core outcome set for stroke sequelae: herbal medicine treatment of elderly patients with stroke sequelae in primary clinics. Front Pharmacol. (2022) 13:868662. doi: 10.3389/fphar.2022.868662

PubMed Abstract | Crossref Full Text | Google Scholar

24. Kim, PW, Kim, S, Kim, DI, Cha, J, Lee, HS, Ko, MM, et al. Development of the Korean medicine Core outcome set for primary dysmenorrhea (COS-PD-KM) for herbal medicine treatment of primary dysmenorrhea in primary clinics. Int J Environ Res Public Health. (2022) 19:15321. doi: 10.3390/ijerph192215321

Crossref Full Text | Google Scholar

25. Suk, KH, Ryu, HK, Goo, BH, Lee, JH, Ryu, SH, Lee, SY, et al. A review study and proposal of facial palsy sequelae evaluating scale. J Acupunc Res. (2014) 31:99–108. doi: 10.13045/acupunct.2014057

Crossref Full Text | Google Scholar

26. Ayre, C, and Scally, AJ. Critical values for Lawshe’s content validity ratio. Meas Eval Couns Dev. (2014) 47:79–86. doi: 10.1177/0748175613513808

Crossref Full Text | Google Scholar

27. Jang, S-K, and Kwon, C-S. Setting on aims of elementary science gifted classes and teaching professionalism of elementary science gifted teachers through Delphi method. J Korean Soc Earth Sci Educ. (2014) 7:99–109. doi: 10.15523/JKSESE.2014.7.1.099

Crossref Full Text | Google Scholar

28. Kim, B, Jang, S-I, Park, S-H, and Nam-Hee, K. Refractory Bell’s palsy responding to late treatment with high-dose intravenous steroids. Ann Clin Neurophysiol. (2021) 23:121–5. doi: 10.14253/acn.2021.23.2.121

Crossref Full Text | Google Scholar

29. Park, H, Lee, SH, Lee, Y, Choi, DJ, Lee, J, Jo, H, et al. Integrative Korean medicine treatments for traumatic facial palsy following mandibular fracture: a case report and literature review. Healthcare (Basel). (2023) 11:2546. doi: 10.3390/healthcare11182546

Crossref Full Text | Google Scholar

30. Yoo, MC, Soh, Y, Chon, J, Lee, JH, Jung, J, Kim, SS, et al. Evaluation of factors associated with favorable outcomes in adults with bell palsy. JAMA Otolaryngol Head Neck Surg. (2020) 146:256–63. doi: 10.1001/jamaoto.2019.4312

PubMed Abstract | Crossref Full Text | Google Scholar

31. Byrne, A . Mental workload as a key factor in clinical decision making. Adv Health Sci Educ Theory Pract. (2013) 18:537–45. doi: 10.1007/s10459-012-9360-5

PubMed Abstract | Crossref Full Text | Google Scholar

32. Shamszare, H, and Choudhury, A. Clinicians' perceptions of artificial intelligence: focus on workload, risk, trust, clinical decision making, and clinical integration. Healthcare (Basel). (2023) 11:2308. doi: 10.3390/healthcare11162308

Crossref Full Text | Google Scholar

33. Gouws, C, and Hamman, JH. What are the dangers of drug interactions with herbal medicines? Expert Opin Drug Metab Toxicol. (2020) 16:165–7. doi: 10.1080/17425255.2020.1733969

PubMed Abstract | Crossref Full Text | Google Scholar

34. Nunes, D, Monteiro, CSJ, and Dos Santos, JL. Herb-induced liver injury-a challenging diagnosis. Healthcare (Basel). (2022) 10:278. doi: 10.3390/healthcare10020278

Crossref Full Text | Google Scholar

35. De Seta, D, Mancini, P, Minni, A, Prosperini, L, De Seta, E, Attanasio, G, et al. Bell's palsy: symptoms preceding and accompanying the facial paresis. ScientificWorldJournal. (2014) 2014:801971. doi: 10.1155/2014/801971

Crossref Full Text | Google Scholar

36. Qiu, R, Wan, S, Zhong, C, Han, S, He, T, Huang, Y, et al. Core outcome sets for myocardial infarction in clinical trials of traditional Chinese medicine and Western medicine. J Evid Based Med. (2024) 17:86–94. doi: 10.1111/jebm.12579

PubMed Abstract | Crossref Full Text | Google Scholar

37. Sun, YN, An, Y, Weng, ZW, Zhou, YJ, Wang, XY, and Yu, CH. Development of Core-CM core outcome domain sets for trials of Chinese medicine for lumbar spinal stenosis. BMJ Open. (2023) 13:e075856. doi: 10.1136/bmjopen-2023-075856

PubMed Abstract | Crossref Full Text | Google Scholar