Richard Huan Xu
Ling Ming Zhou2†- 1Centre for Health Systems and Policy Research, Jockey Club School of Public Health and Primary Care, The Chinese University of Hong Kong, Hong Kong, China
- 2School of Health Management, Southern Medical University, Guangzhou, China
Objective: The objective of this study was to evaluate the psychometric properties of the Chinese version of the decision regret scale (DRSc).
Methods: The data of 704 patients who completed the DRSc were used for the analyses. We evaluated the construct, convergent/discriminant, and known-group validity; internal consistency and test–retest reliability; and the item invariance of the DRSc. A receiver operating characteristic (ROC) curve was employed to confirm the optimal cutoff point of the scale.
Results: A confirmatory factor analysis (CFA) indicated that a one-factor model fits the data. The internal consistency (α = 0.74) and test–retest reliability [intraclass correlation coefficient (ICC) = 0.71] of the DRSc were acceptable. The DRSc demonstrated unidimensionality and invariance for use across the sexes. It was confirmed that an optimal cutoff point of 25 could discriminate between patients with high and low decisional regret during clinical practice.
Conclusion: The DRSc is a parsimonious instrument that can be used to measure the uncertainty inherent in medical decisions. It can be employed to provide knowledge, offer support, and elicit patient preferences in an attempt to promote shared decision-making.
Introduction
Effectively engaging patients in medical decision-making is essential for improving their health outcomes, reducing cost and uncertainty, and developing reasonable expectations of the outcome; it can also benefit the clinician’s experience (Brehaut et al., 2003). However, in practice, some medical decisions have to be made on the basis of no clear or clinically preferable options. If the selected decision leads to an unexpected clinical outcome or one that is below expectations, despite the patient’s preferences and needs being respected and considered in the treatment, it is inevitable that patients will experience decisional regret, a very common but negative emotion (Joseph-Williams et al., 2010).
Patients’ decisional regret in the field of healthcare has been only studied during the last few years (Joseph-Williams et al., 2010). The majority have revealed that there is a relationship between medical decisional regret and individual personality, past experience, and the medical professional’s attitude (Tversky and Kahneman, 1981; Zeelenberg et al., 1998; Loewenstein, 2005). For example, Nicolai et al. (2016) found that there is a relationship between the physician’s increased empathy and patient’s reduced decisional regret after treatment. Some other studies discussed the associations between regret and the individual’s quality of life (QoL). For instance, Tanno and Bito (2019) found that, to some extent, the patient’s decision-making depends on his/her perceptions of the QoL after treatment. Clark et al. (2001) also identified a strong relationship between individual regret, treatment choice, and the corresponding QoL. In addition, Feldman-Stewart and Siemens (2015) suggested that decisional regret could be used as a metric to measure the quality of decisions, which could facilitate the performance improvement of the healthcare system. Other studies that have taken a psychological perspective indicated that if regret occurs about a decision, the following “preference reversal” could make the patients favor the other non-chosen option, which might completely counteract their health outcomes (Svenson, 1992; Brehaut et al., 2003). Despite theoretical discussions having resulted in decisional regret being defined in several contexts, the lack of a valid instrument that can be used to measure and quantify medical decisional regret somewhat limits the medical professional’s capability to capture the variations in the patient’s emotions during treatment and to make proper decisions during clinical practice.
Due to the abstract and complex concept of regret, limited instruments have been identified to measure the multiplicity of, and variations in, decisional regret in the field of healthcare; a majority of these have some (or other) methodological concerns, for example, lack of psychometric data, focus only on specific conditions, and assessment of consumer regret rather than patient regret (Joseph-Williams et al., 2010). Among them, the decision regret scale (DRS), which assesses different conceptualizations (e.g., option and outcome regret), is recognized as a valid instrument for measuring the regret of patients who have already made a medical decision (Brehaut et al., 2003). The DRS focuses on patient decisional regret, and it has been translated into several languages and adapted for use in various cultural contexts (Joseph-Williams et al., 2010). However, in China, the measurement of decisional regret in clinical practice is in its infancy (Song et al., 2016). Currently, as few data exist that support studying the influence of regret on patients’ medical decisions, the implementation of patient-centered care (PCC) during clinical practice is negatively affected (Jo Delaney, 2018). Thus, the aim of this study was to evaluate the psychometric properties of the Chinese version of the DRS (DRSc) in order to facilitate the measurement of individual decisional regret in a clinical setting.
Materials and Methods
Data Source and Collection
The data used in this study were obtained from a cross-sectional survey that investigated PCC in public hospitals in China from November 2019 to January 2020. Patients were recruited from the inpatient departments of eight hospitals in five cities (Guangzhou, Shenzhen, Zhanjiang, Meizhou, and Shaoguan) in Guangdong Province. All patients from the target hospitals were invited to participate in the study during the appointed survey period. The inclusion criteria for patients were as follows: (1) ≥18 years old, (2) understood Mandarin, (3) had no cognitive problems, and (4) were able to complete the informed consent form. With the assistance of the ward nurses, all of the eligible patients were asked to complete a structured questionnaire during a face-to-face interview, which gathered information about their demographic characteristics, socioeconomic status (SES), health conditions, well-being, use of health services, lifestyle, and attitudes toward PCC. A total of 704 patients who successfully completed the DRSc were used for our psychometric analyses. The study was approved by the institutional review board of the Second Affiliated Hospital of Guangzhou Medical University (ethical approval ID: 2019-ks-28).
Sample Size
To conduct confirmatory factor analysis (CFA), the minimum sample size that we required was nearly 300 (Floyd and Widaman, 1995; Kline, 2015). For a Rasch analysis, a sample size of 500 is sufficient for analyzing a scale composed of polytomous items (Linacre, 1994). Assuming a Type 1 error of 5% (two−tailed) and a power of 0.80, a total sample size of 704 observations would be able to detect an effect size of r = 0.11 in the Pearson product−moment correlation coefficients.
Instruments
Decisional Regret
The DRS is a five-item unidimensional self-reported scale that assesses the patients’ decisional regret (Brehaut et al., 2003). It uses a five-point Likert scale, ranging from 1 to 5, where 1 represents “strongly agree” and 5 “strongly disagree.” The scores of Items 2 and 4 are reversed. The overall score is transformed from 0 to 100 by subtracting 1 from each item and then multiplying by 25. A lower overall score indicates few regrets, whereas a higher overall score indicates more regrets. The original DRS reported a one-factor structure and showed a good internal consistency (Cronbach’s alpha = 0.81–0.92) (Brehaut et al., 2003). The DRSc was directly provided by the research institute of Ottawa Hospital. Ten individuals from the general public were invited for a face-to-face cognitive debriefing to confirm the content and face validity of the DRSc. No further revisions or modifications were needed.
Subjective Well-Being
The ICEpop CAPability Measure for Adults (ICECAP-A) is a generic and preference-based instrument that evaluates an individual’s well-being (Al-Janabi et al., 2012). The descriptive system of the ICECAP-A has five items (stability, attachment, autonomy, achievement, and enjoyment), and each item has four response options that range from fully capable to not capable. In this study, we used the item-level score to reflect the patients’ well-being, where a higher score indicated a poor subjective well-being. The psychometric property of the Chinese ICECAP-A was reported by Tang et al.’s (2018) study (Cronbach’s alpha = 0.79). In this study, the Chinese ICECAP-A was provided by the University of Birmingham.
Shared Decision-Making (SDM)
The SURE scale (Sure of myself, Understand information, Risk–benefit ratio, and Encouragement) is a four-item questionnaire that screens patients’ decisional conflict during clinical practice (Ferron Parayre et al., 2014). A binary response category is used, with 0 representing “No” and 1 representing “Yes.” The highest overall score of SURE is 4, where less than that indicates the existence of decisional conflict to some extent. The Chinese SURE scale was provided by the research institute of Ottawa Hospital.
The CollaboRATE scale is a three-item questionnaire that measures SDM (Elwyn et al., 2013). The Chinese version of the CollaboRATE contains a scale that ranges from 0 to 10 for each item, where 0 represents “no effort was made” and 10 represents “every effort was made” by the medical professional to promote SDM. The psychometric properties of CollaboRATE have been reported by other studies (Forcino et al., 2018). The Chinese version of CollaboRATE was provided by the developer1.
Physical and Mental Health Status
The patients’ physical health status was evaluated using a visual analog scale (VAS). A scale ranging between 0 and 100, where 0 represents the worst imaginable health status and 100 represents the best imaginable health status, on the surveying day was presented to them. All of the patients were asked to select the number on the scale that best represented their health status on that day.
Patient Health Questionnaire-2 (PHQ-2) was used to measure the patients’ mental health status. The PHQ-2 includes the first two items of the PHQ-9 (Spitzer et al., 1999), which is the depression module from the full PHQ. The patients were asked to recall the frequency of a depressed mood and anhedonia over the past two weeks. A PHQ-2 score ≥ 3 (score range: 0–6) is recognized as depressive. The psychometric properties of the Chinese version of the PHQ-2 have been reported by other studies (Liu et al., 2016).
Statistical Analyses
Confirmatory factor analysis was used to investigate the structural validity of the DRSc. The fit of the model was determined using the root-mean-square error of approximation (RMSEA ≤ 0.06), standardized root-mean-square residual (SRMR < 0.08), comparative fit index (CFI > 0.95), and Tucker–Lewis index (TLI > 0.95) (Hu and Bentler, 1999). The Akaike information criterion (AIC) and Bayesian information criterion (BIC) were also employed to compare the performance of the models, with a smaller value indicating a better fit. We formulated a priori hypotheses about the relationship between the DRSc and other instruments, such as the ICECAP-A and the SURE, to test both the convergent and divergent validity. Pearson’s correlation coefficient was used to assess the relationships, and the strength of the associations was interpreted as weak (<0.3), moderate (0.3–0.5), and strong (≥0.50) (Cohen, 1992). To examine the known-group validity, the analysis of covariance (ANCOVA) adjusted for sex, age, and the duration of disease (dependent variable was the DRSc overall score) was used to evaluate the between-group differences. We assumed that the patients who were sure about their treatment (overall score of SURE = 4) and showed no depressive disorders (PHQ-2 score < 3) would present low decisional regret and vice versa.
The internal consistency of the DRSc was assessed using Cronbach’s alpha (α > 0.7) and McDonald’s omega, which indicates the strength of the association between items and constructs, as well as the item-specific measurement errors (ω > 0.7) (McDonald, 1999). The item-total correlation (>0.5), average inter-item correlation (0.15–0.5), and alpha if an item was deleted were also reported (DeVellis, 2017). The mean score, standard deviation (SD), and ceiling and floor effects of the DRSc scores were calculated. The test–retest reliability was investigated by inviting a minimum of 30 patients to complete the DRSc twice in a 1-week interval period. The intraclass correlation coefficient [ICC (two-way mixed effects model) > 0.7, acceptable] (Fleiss, 1999) and Gwet’s agreement coefficient (Gwet’s AC) were employed to examine the test–retest reliability. Gwet’s AC is used to avoid the “Kappa paradox” (Wongpakaran et al., 2013), which is interpreted as fair (0.21–0.4), moderate (0.41–0.6), good (0.61–0.8), and very good agreement (>0.8) (Landis and Koch, 1977; Wongpakaran et al., 2013).
The partial credit model (PCM), which is a modified Rasch model that can be used with scales that have a polytomous response category, was employed for further analysis. According to the results of CFA, the unidimensional assumption was fulfilled (Pecanac et al., 2018). The Infit and Outfit mean square (MNSQ) statistics, which determine how well each item contributes to defining a single underlying construct, were computed to check whether the items fit the expected model. An MNSQ value ranging between 0.6 and 1.4 indicates adequate item fit (Schumacker and Smith, 2007). The person separation index (PSI > 0.7, acceptable) was calculated to confirm the reliability of the DRSc based on the PCM (Richtering et al., 2017). Differential item functioning (DIF) was employed to check the parameter invariance of the DRSc item performance between the sexes (male vs. female) (Rupp and Zumbo, 2006). It can evaluate the equality of the items and respondent parameters in relation to different populations or measurement conditions (Rupp and Zumbo, 2006). McFadden’s R2 was used to evaluate the strength of the DIF (<0.13 negligible, 0.13–0.26 moderate, and >0.26 large) (Zumbo, 1999).
A receiver operating characteristic (ROC) analysis was used to determine the optimal cutoff point of the DRSc (Haun et al., 2019). The ROC curve graphically presents the test’s ability to correctly identify the “true-positive” and “true-negative” individuals for various test cutoff points (Haun et al., 2019). We estimated the area under the ROC (AUC) and determined the optimal point based on the Youden index. The R software (R foundation, Vienna, Austria) was used for the data analysis, and the Type I error rate (α) was set at.05 (p-value ≤ 0.05).
Results
Demographics
In total, 52% of patients were female and the average age was 49.3 years. Regarding the patients’ families, 63.8% were registered as living in urban areas, and 47.0% of patients lived with chronic conditions. Nearly half of the patients reported having a body mass index over 23. Around 65% indicated that the severity of the disease was moderate or higher (Table 1).
Table 1. Background of respondents (n = 704).
Construct Validity
Exploratory factor analysis was used to confirm that the model was free of common method bias (the primary factor explained 42% of the total variance). The fit measure of the one-factor model (CFA) indicated some misspecification with χ2 (5, N = 704) = 628.8, p < 0.001, CFI = 0.604, TLI = 0.208, SRMR = 0.181, and RMSEA = 0.421. Residual diagnostics traced this misspecification to the relationship between the indicator residual variances for Items 2 and 4. Hence, we assumed that the non-random measurement error was caused by the reversed wording of these two items, which has been reported in previous studies (Hoyle, 2012). We modified the model and specified the error covariance between Item 2 and Item 4. In the updated model, since χ2 (4, N = 704) = 11.46, p = 0.022, CFI = 0.995, TLI = 0.988, SRMR = 0.01, and RMSEA = 0.051, it performed much better than the first model, and the AIC and BIC also supported this conclusion (Table 2). The second model that included the standardized factor loadings for the observed variables, ranging between 0.24 and 0.82, is presented in Figure 1.
Table 2. The CFA result of the DRSc.
Figure 1. Confirmatory factor analysis model with standardized path coefficients.
Item Statistics, Internal Consistency, and Test–Retest Reliability
All of the items showed some floor effects, and these ranged from 27.7% (Item 4) to 47.3% (Item 1). Item 2, which was the “most regrettable” question, had a mean score of 2.34, whereas Item 1, which was the “least regrettable” item, had a mean score of 1.61. The overall mean score was 23.81 (0–100) with an SD of 16.25. DRSc showed acceptable internal consistency with α = 0.74 and ω = 0.76. The results of both the ICC (0.71) and Gwet’s AC (0.66–0.81) reflected a good reproducibility of the DRSc (Table 3).
Table 3. The item statistics and reliability of DRSc.
Known-Group Validity
As expected, patients who were not sure about their treatment (mean = 31.61) or showed depressive disorders (mean = 28.41) obtained a higher DRSc score than the groups who were sure about their treatment or showed no depressive disorders (Table 4). The results of the ANCOVA indicated that all the differences were statistically significant after being adjusted for sex, age, and the duration of disease (F-value = 22.33, p < 0.001; F-value = 15.47, p < 0.001).
Table 4. The results of known-group validity of the DRSc.
Convergent and Discriminant Validity
The associations between the DRSc and the other measures are shown in Table 5. There was a positive relationship between the DRSc results and the ICECAP-A (0.15–0.18, p < 0.001) and PHQ-2 (0.15–0.18, p < 0.001), which indicated that more decisional regret resulted in worse well-being or greater depression. The higher DRSc scores were associated with lower SURE (-0.13 to -0.23, p < 0.001), CollaboRATE (-0.33, p < 0.001), and VAS (-0.17, p < 0.001) scores, which suggested that more decisional regret led to higher uncertainty during SDM and a worse physical health status.
Table 5. The correlation between DRSc and the other measures.
PCM and DIF Analyses
Table 6 shows that Infit and Outfit MNSQs of the DRSc ranged between 0.67 and 0.85, which reflected a good fit of the observed data with the model-expected data. The PSI was 0.84, which indicated the good reliability of the DRSc based on the PCM. However, for Items 1, 3, 4, and 5 of the DRSc, the expected category ordering of category 4 and category 5 was not supported by the data, which the last step calibrations did not increase monotonically with category numbers. No item showed DIF across the sex subgroups.
Table 6. The result of PCM analysis of the DRSc.
Criterion Validity: ROC Analysis and Cutoff Position Confirmation
The ROC analysis confirmed that the cutoff point of clinically significant decisional regret was based on the patients who had a depressive disorder (as indicated by a PHQ-2 score ≥ 3). The AUC for the DRSc was 64.1%, with a 95% confidence interval of 58.4 and 69.9%, which indicated that the cutoff point was able to accurately discriminate patients with clinically significant regret above random chance (Figure 2). The Youden index, which is a measure of overall diagnostic effectiveness that gives equal weight to sensitivity and specificity, indicated that a score of 25 was linked with a positive predictive value of 0.69 and with a negative predictive value of 0.38 for clinically significant decisional regret. In the survey, 39.8% of patients exceeded this score.
Figure 2. Receiver operating characteristic (ROC) curve for the DRSc. AUC, area under the curve.
Discussion
This study evaluated the psychometric properties of the DRSc and confirmed that it is a promising tool for measuring treatment-related decisional regret in China. Overall, the DRSc showed good internal consistency among the patients; it was significantly correlated with other instruments that measure patients’ physical, mental, and social well-being, despite the strength of the correlations not being strong; further, it successfully discriminated between patients who showed different levels of regret about medical decision-making. Therefore, the DRSc could identify a stable construct of regret across a number of different decisions and patients.
The mean score of DRSc was 23.81/100, higher than the average score of 16.5/100 reported in a systematic review of studies that used the DRS (Becerra Pérez et al., 2016). In this study, we used the ROC analysis to determine the clinically meaningful cutoff point of DRSc (25/100). It is the same as the cutoff point between moderate and strong regret as defined by Sheehan et al. (Sheehan et al., 2007), which is accepted by the majority of studies that use DRS. However, given that little clinical evidence exists to support this cutoff point, we suggest interpreting it with caution. Investigations are needed to further confirm the reliability of this cutoff point in different clinical settings and for patients with different medical conditions.
The one-factor structure of DRSc was confirmed, as suggested in the original English version, and this has also been reported by some previous studies, such as the study that assessed the performance of DRS with patients who were receiving an internal cardioverter defibrillator in the United States, and another study that investigated the validity of the Japanese version of DRS (JDRS) (Tanno et al., 2016; Calderon et al., 2019). However, an additional study has indicated that the one-factor structure is unstable because the items of the DRS focus on different concepts; for example, Item 2 appears to target option regret and Item 4 focuses on outcome regret (Joseph-Williams et al., 2010). The measurement of different concepts by the DRS may result in an inconsistency in the explanation and evaluation of regret and this may diminish the power of the measurement. Further explorations are needed. Additionally, although DRSc has an acceptable internal consistency reliability, it is lower than in some other studies that used the DRS. For example, the original DRS study reported that the α value ranges between 0.81 and 0.92 for different patient groups (Brehaut et al., 2003), and the JDRS found an α value of 0.85 (Tanno et al., 2016). However, given that methodologists have suggested that the α value has several limitations when estimating the internal consistency and that it might not be the optimal measure of reliability (Hayes and Coutts, 2020), in this study, we further reported the ω value, which confirmed that the internal consistency of DRSc is acceptable.
While the test–retest reliability of DRS was not considered in the original study, it was tested and confirmed as acceptable in our analysis. In this study, we decided to use a time interval of 1 week, instead of 2 weeks, between the two surveys, which was mainly suggested in previous methodological papers. The first consideration was to avoid the bias created by using different survey methods. In this study, we ensured that the retest survey was conducted in the same way (by the investigator), using the same method (face-to-face interview), and at the same location (ward) as in the first survey, as this could reduce the method effects (DeVellis, 2017). The second consideration in our survey was that more than half of the patients self-reported a poor health status; therefore, a longer time interval may have led to some deterioration in their health and violated the assumption of an unchanged health status that is needed for assessing test–retest reliability, causing inaccuracy in the results (Qian et al., 2020). The previous findings regarding the reproducibility of measuring regret are mixed. Haun et al. (2019) indicated that the reproducibility of DRS was good for caregivers when using an average time interval of 12 weeks. However, another study showed that patients usually change their attitudes toward the original medical decisions (Becerra Pérez et al., 2016). Although regret is an unpleasant emotion, it may result in a positive outcome (Joseph-Williams et al., 2010); for example, it may help to make a better decision in the future. It is necessary to understand the long-term reproducibility of the DRSc to ensure its good capability to measure the consistency of individual decisional regret in different health settings, effectively.
As previous studies indicated, the significant correlations between decisional regret and low QoL and well-being and high depressive disorders were identified in this study (Jokisaari, 2003; Wilson et al., 2016; Xu et al., 2017); however, the strength of correlations was not strong, which indicated a barely satisfactory convergent validity of the DRSc. This finding reflects that regret is a complicated, dynamic psychological process, and a multifaceted concept, which might be strongly affected by the patient’s personality, SES, and health status (Ben-Ezra and Bibi, 2016; Calderon et al., 2019). We found that the patients who reported a high level of regret in decision-making were more likely to have a poor physical and mental health status, which is in line with previous findings. For example, Ratcliff et al. (2013) found that male patients reported greater treatment regret when they had lower sexual and urinary functioning after surgery. Moreover, Becerra-Perez et al. (2016) indicated that a high level of decisional regret was strongly associated with increased decisional conflict. This was also detected in our study as higher DRSc scores were correlated with lower scores in the SDM measures. We further identified a relationship between decisional regret and the patients’ well-being, which has not attracted attention until now. Though a discussion about this relationship was not the aim of this study, it may indicate that evaluation of the treatment outcome should not entirely focus on the physical health gain from curing the disease but also consider the impact of maintaining the patient’s independence, dignity, comfort, and social interaction during their lives. Another reason that the correlations between DRSc and the other measures were not as strong as expected might be that majority of respondents in our study showed a low level of decision regret and the skewness of the DRSc scores might have affected the correlations to some extent.
Overall, the psychometric properties of the DRSc are satisfactory. Nevertheless, there is not without problems. First of all, the performance of Items 2 and 4 needs to be further assessed. Though CFA confirmed a one-factor structure of the DRSc, the lower factor loadings and stronger inter-correlations of these two items than the other three items might imply a two-factor structure of the DRSc. Joseph-Williams et al. (2010) also indicated that Items 2 and 4 focusing on different targets of the regret concept might affect the structure of the DRS. Though limited, the evidence of inconsistencies in measuring decisional regret when using the DRS was also reported by another study (Haun et al., 2019). Additionally, reversed wording might be another reason that affected the construct of the DRS. Considering this was the first study to investigate the performance of the DRS in China, we decided to support the DRSc with one-factor structure and five items with two of them using reversed wording (the results of the two-factor model of the DRSc are presented in the Supplementary Appendix). Further, the results of the Rasch analysis indicated that the order of categories 4 and 5 for four out of five items was inconsistent, which suggested that category 5, i.e., strongly disagree, might not be properly defined for the Chinese population. Remedies such as categorizing the options, collapsing adjacent categories, or removing/revising some items could be considered and evaluated in future studies. Furthermore, despite the DIF analysis showing that the DRSc performed equivalently across the sexes in our sample, a previous study has indicated that males and females tend to show different attitudes toward risk during decision-making (Karakowsky and Elangovan, 2001). Therefore, we suggest that further explorations are required to refine the DRSc using a large sample or for developing a new scale to meet the Chinese population’s preference and needs in measuring the decisional regret in healthcare.
Several limitations should be addressed as well. First, our results might have been affected by some coverage error and potential selection bias due to a non-probability sample being used since all of the patients voluntarily participated in the survey. Second, we did not collect information from non-responding participants, which might have generated selection bias to some extent. Third, all of the information was self-reported, which might have led to some information bias. Fourth, considering the concept of depression is multifaceted, PHQ-2 might not be sensitive enough to measure patients’ mental problems. It might affect the validity of our estimated cutoff point. Fifth, the psychometric properties of the Chinese SURE and CollaboRATE was not assessed, which might affect the convergent validity of the DRSc. Lastly, we did not differentiate between patients with different diseases when they responded to the DRSc, which might have affected the generalizability of our findings.
Implications
Although the measurement of decisional regret in healthcare has received more attention, this topic has rarely been studied in China. In our study, surveying patients about decisional regret was not easily allowed and was even prohibited by some medical professionals. They were worried that such a conversation would result in a harmful doctor–patient relationship. On the contrary, measuring decisional regret is an important way to understand the patients’ feelings, preferences, expectations, and subsequent decisions when using healthcare services and for achieving PCC.
DRSc is a parsimonious instrument that can measure the uncertainty inherent in medical decisions. It can provide knowledge, offer support, and elicit patient preferences in an attempt to promote SDM. It monitors and assesses the quality of healthcare services based on patient’s perceptions, enhances communication, and facilitates the development of a trusting doctor–patient relationship. Given that talking to patients about decisional regret is sensitive in China, instead of directly asking about their feelings about the treatment decision, the DRSc can provide a prudent way to measure the decisional regret and to understand patients’ real expectations from the treatment outcomes.
Conclusion
DRSc is proved to be a reliable measurement that has satisfactory validity. It can effectively discriminate between patients who have high and low levels of decisional regret. In this study, a meaningful cutoff point was provided using an ROC analysis in order to facilitate the measurement of decisional regret in both clinical practice and academic studies. DRSc is a psychometrically robust and an easy-to-complete patient-reported outcome measure capable of providing valuable information for supporting PCC in China.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by the Institutional Review Board of the Second Affiliated Hospital of Guangzhou Medical University (ethical approval ID: 2019-ks-28). The patients/participants provided their written informed consent to participate in this study.
Author Contributions
RX and LZ contributed to conceptualization, methodology, data collection, writing—original draft, and writing—review and editing. DW, EW, and JC contributed to conceptualization, writing—review and editing, and supervision. All authors contributed to the article and approved the submitted version.
Funding
This study was funded by a grant from the Philosophy and Social Sciences of Guangdong College for the project of “Public Health Policy Research and Evaluation” Key Laboratory (2015WSYS0010) and a grant from the Public Health Service System Construction Research Foundation of Guangzhou, China. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2020.583574/full#supplementary-material
Footnotes
References
Al-Janabi, H., Flynn, T. N., and Coast, J. (2012). Development of a self-report measure of capability wellbeing for adults: the ICECAP-A. Qual. Life Res. 21, 167–176. doi: 10.1007/s11136-011-9927-2
Becerra Pérez, M. M., Menear, M., Brehaut, J. C., and Légaré, F. (2016). Extent and predictors of decision regret about health care decisions: a systematic review. Med. Decis. Making 36, 777–790. doi: 10.1177/0272989X16636113
Becerra-Perez, M. M., Menear, M., Turcotte, S., Labrecque, M., and Légaré, F. (2016). More primary care patients regret health decisions if they experienced decisional conflict in the consultation: a secondary analysis of a multicenter descriptive study. BMC Fam. Pract. 17:156. doi: 10.1186/s12875-016-0558-0
Ben-Ezra, M., and Bibi, H. (2016). The association between psychological distress and decision regret during armed conflict among hospital personnel. Psychiatr Q. 87, 515–519. doi: 10.1007/s11126-015-9406-y
Brehaut, J. C., O’Connor, A. M., Wood, T. J., Hack, T. F., Siminoff, L., Gordon, E., et al. (2003). Validation of a decision regret scale. Med. Decis. Making 23, 281–292. doi: 10.1177/0272989X03256005
Calderon, C., Ferrando, P. J., Lorenzo-Seva, U., Higuera, O., Ramon, Y., Cajal, T., et al. (2019). Validity and reliability of the decision regret scale in cancer patients receiving adjuvant chemotherapy. J. Pain Symptom. Manage. 57, 828–834. doi: 10.1016/j.jpainsymman.2018.11.017
Clark, J. A., Wray, N. P., and Ashton, C. M. (2001). Living with treatment decisions: regrets and quality of life among men treated for metastatic prostate cancer. J. Clin. Oncol. 19, 72–80. doi: 10.1200/JCO.2001.19.1.72
Elwyn, G., Barr, P. J., Grande, S. W., Thompson, R., Walsh, T., and Ozanne, E. M. (2013). Developing CollaboRATE: a fast and frugal patient-reported measure of shared decision making in clinical encounters. Patient Educ. Couns. 93, 102–107. doi: 10.1016/j.pec.2013.05.009
Feldman-Stewart, D., and Siemens, D. R. (2015). What if?: regret and cancer-related decisions. Can. Urol. Assoc. J. 9, 295–355. doi: 10.5489/cuaj.3372
Ferron Parayre, A., Labrecque, M., Rousseau, M., Turcotte, S., and Légaré, F. (2014). Validation of SURE, a four-item clinical checklist for detecting decisional conflict in patients. Med. Decis. Making 34, 54–62. doi: 10.1177/0272989X13491463
Floyd, F. J., and Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychol. Assess 7, 286–299. doi: 10.1037/1040-3590.7.3.286
Forcino, R. C., Barr, P. J., O’Malley, A. J., Arend, R., Castaldo, M. G., Ozanne, E. M., et al. (2018). Using CollaboRATE, a brief patient-reported measure of shared decision making: results from three clinical settings in the United States. Health Expect. 21, 82–89. doi: 10.1111/hex.12588
Haun, M. W., Schakowski, A., Preibsch, A., Friederich, H. C., and Hartmann, M. (2019). Assessing decision regret in caregivers of deceased German people with cancer—A psychometric validation of the decision regret scale for caregivers. Health Expect. 22, 1089–1099. doi: 10.1111/hex.12941
Hayes, A. F., and Coutts, J. J. (2020). Use omega rather than Cronbach’s Alpha for estimating reliability. But. Commun. Methods Meas. 14, 1–24. doi: 10.1080/19312458.2020.1718629
Hu, L. T., and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Model. 6, 1–55. doi: 10.1080/10705519909540118
Jo Delaney, L. J. (2018). Patient-centred care as an approach to improving health care in Australia. Collegian 25, 119–123. doi: 10.1016/j.colegn.2017.02.005
Jokisaari, M. (2003). Regret appraisals, age, and subjective well-being. J. Res. Pers. 37, 487–503. doi: 10.1016/S0092-6566(03)00033-3
Joseph-Williams, N., Edwards, A., and Elwyn, G. (2010). The importance and complexity of regret in the measurement of ‘good’ decisions: a systematic review and a content analysis of existing assessment instruments. Health Expect. 14, 59–83. doi: 10.1111/j.1369-7625.2010.00621.x
Karakowsky, L., and Elangovan, A. R. (2001). Risky decision making in mixed-gender teams: whose risk tolerance matters? Small Group Res. 32, 94–111. doi: 10.1177/104649640103200105
Kline, R. (2015). Principles and Practice of Structural Equation Modeling, 4th Edn. New York, NY: The Guilford Press.
Landis, J. R., and Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics 33, 159–174. doi: 10.2307/2529310
Linacre, J. M. (1994). Sample size and item calibration or person measure stability. Rasch. Meas. Trans. 7:328.
Liu, Z. W., Yu, Y., Hu, M., Liu, H. M., Zhou, L., and Xiao, S. Y. (2016). PHQ-9 and PHQ-2 for screening depression in chinese rural elderly. PLoS One 11:e0151042. doi: 10.1371/journal.pone.0151042
Loewenstein, G. (2005). Hot–cold empathy gaps and medical decision making. Health Psychol. 24, S49–S56. doi: 10.1037/0278-6133.24.4.S49
McDonald, R. P. (1999). Test Theory: A Unified Treatment. New Jersey, NJ: Lawrence Erlbaum Associates Publishers.
Nicolai, J., Buchholz, A., Seefried, N., Reuter, K., Härter, M., Eich, W., et al. (2016). When do cancer patients regret their treatment decision? A path analysis of the influence of clinicians’ communication styles and the match of decision-making styles on decision regret. Patient. Educ. Couns. 99, 739–746. doi: 10.1016/j.pec.2015.11.019
Pecanac, K. E., Brown, R. L., Steingrub, J., Anderson, W., Matthay, M. A., and White, D. B. (2018). A psychometric study of the decisional conflict scale in surrogate decision makers. Patient Educ. Couns. 101, 1957–1965. doi: 10.1016/j.pec.2018.07.006
Qian, X., Tan, R. L., Chuang, L. H., and Luo, N. (2020). Measurement properties of commonly used generic preference-based measures in East and South-East Asia: a systematic review. Pharmacoeconomics 38, 159–170. doi: 10.1007/s40273-019-00854-w
Ratcliff, C. G., Cohen, L., Pettaway, C. A., and Parker, P. A. (2013). Treatment regret and quality of life following radical prostatectomy. Support Care Cancer 21, 3337–3343. doi: 10.1007/s00520-013-1906-4
Richtering, S. S., Morris, R., Soh, S. E., Barker, A., Bampi, F., Neubeck, L., et al. (2017). Examination of an eHealth literacy scale and a health literacy scale in a population with moderate to high cardiovascular risk: Rasch analyses. PLoS One 12:e0175372. doi: 10.1371/journal.pone.0175372
Rupp, A. A., and Zumbo, B. D. (2006). Understanding parameter invariance in unidimensional IRT models. Educ. Psychol. Meas. 66, 63–84. doi: 10.1177/0013164404273942
Schumacker, R. E., and Smith, E. V. Jr. (2007). Reliability: a rasch perspective. Educ. Psychol. Meas. 67, 394–409.
Sheehan, J., Sherman, K. A., Lam, T., and Boyages, J. (2007). Association of information satisfaction, psychological distress and monitoring coping style with post-decision regret following breast reconstruction. Psychooncology 16, 342–351. doi: 10.1002/pon.1067
Song, X., Zhu, L., Ding, J., Xu, T., and Lang, J. (2016). Long-term follow-up after LeFort colpocleisis: patient satisfaction, regret rate, and pelvic symptoms. Menopause 23, 621–625. doi: 10.1097/GME.0000000000000604
Spitzer, R. L., Kroenke, K., and Williams, J. B. (1999). Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. JAMA 282, 1737–1744. doi: 10.1001/jama.282.18.1737
Svenson, O. (1992). Differentiation and consolidation theory of human decision making: a frame of reference for the study of pre- and post-decision processes. Acta Psychol. 80, 143–168. doi: 10.1016/0001-6918(92)90044-E
Tang, C., Xiong, Y., Wu, H., and Xu, J. (2018). Adaptation and assessments of the Chinese version of the ICECAP-A measurement. Health Q. Life Outcomes 16:45.
Tanno, K., and Bito, S. (2019). Patient factors affecting decision regret in the medical treatment process of gynecological diseases. J. Patient Rep. Outcomes 3:43. doi: 10.1186/s41687-019-0137-y
Tanno, K., Bito, S., Isobe, Y., and Takagi, Y. (2016). Validation of a Japanese version of the decision regret scale. J. Nurs. Meas. 24, E44–E54. doi: 10.1891/1061-3749.24.1.E44
Tversky, A., and Kahneman, D. (1981). The framing of decisions and the psychology of choice. Science 211, 453–458. doi: 10.1126/science.7455683
Wilson, A., Winner, M., Yahanda, A., Andreatos, N., Ronnekleiv-Kelly, S., and Pawlik, T. M. (2016). Factors associated with decisional regret among patients undergoing major thoracic and abdominal operations. Surgery 161, 1058–1066. doi: 10.1016/j.surg.2016.10.028
Wongpakaran, N., Wongpakaran, T., Wedding, D., and Gwet, K. L. (2013). A comparison of Cohen’s Kappa and Gwet’s AC1 when calculating inter-rater reliability coefficients: a study conducted with personality disorder samples. BMC Med. Res. Methodol. 13:61. doi: 10.1186/1471-2288-13-61
Xu, R. H., Cheung, A. W. L., and Wong, E. L. Y. (2017). The relationship between shared decision-making and health-related quality of life among patients in Hong Kong SAR. China. Int. J. Qual. Health Care 29, 534–540. doi: 10.1093/intqhc/mzx067
Zeelenberg, M., van Dijk, W. W., van der Pligt, J., Manstead, A. S. R., van Empelen, P., and Reinderman, D. (1998). Emotional reactions to the outcomes of decisions: the role of counterfactual thought in the experience of regret and disappointment. Organ. Behav. Hum. Decis. Process. 75, 117–141. doi: 10.1006/obhd.1998.2784
Keywords: decisional regret, confirmatory factor analysis, classical test theory, item response theory, China
Citation: Xu RH, Zhou LM, Wong EL, Wang D and Chang JH (2020) Psychometric Evaluation of the Chinese Version of the Decision Regret Scale. Front. Psychol. 11:583574. doi: 10.3389/fpsyg.2020.583574
Received: 16 July 2020; Accepted: 19 October 2020;
Published: 03 December 2020.
Edited by:
Caterina Primi, University of Florence, ItalyReviewed by:
Giorgia Molinengo, University of Turin, ItalyGiorgio Gronchi, University of Florence, Italy
Copyright © 2020 Xu, Zhou, Wong, Wang and Chang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Dong Wang, dongw96@smu.edu.cn
†These authors have contributed equally to this work