Translation and concurrent validity, sensitivity and specificity of Chinese version of Short Orientation Memory Concentration Test in people with a first cerebral infarction

Introduction

Stroke is one of the leading causes of death and disability worldwide (Stinear et al., 2020), and the number of stroke survivors is increasing as populations increase and age (Li, 2020). Cognitive impairment is a common comorbidity following stroke (Swartz et al., 2016), affecting approximately 20% to 80% survivors (Sun et al., 2014; Zhu et al., 2022). Moreover, up to 78% of acute stroke patients show impairments in at least one cognitive domain after stroke (Lesniak et al., 2008), and subacute and chronic stroke patients commonly show deficits in attention, executive functioning, mental processing speed, visual perception, construction ability, memory, and language expression (Stephens et al., 2004). Post-stroke cognitive impairment directly affects patients’ ability to understand, learn, and implement their rehabilitation treatment plan, resulting in poor recovery of other stroke-affected functions, such as motor function, swallowing function, and speech function (Yuan et al., 2021). Furthermore, post-stroke cognitive impairment often restricts patients’ abilities to perform daily activities and participate in social activities, leading to a reduced quality of life (Ye et al., 2022). Cognitive impairment is also associated with recurrence of ischemic stroke in high-risk patients despite adequate medical therapy, including antiplatelet therapy (Kwon et al., 2020). Consequently, post-stroke cognitive impairment also imposes a heavy burden on families and society (Crichton et al., 2016), underscoring the need for timely detection and symptomatic treatment to aid rehabilitation. Validated screening instruments, such as the Short Orientation-Memory-and Concentration (SOMC) test, can be used for early detection of cognitive impairment, as such brief and easily administered screens are suitable for use with stroke patients (Borson et al., 2003).

Although the Mini Mental State Examination (MMSE) is the most widely known and utilized cognitive impairment instrument, it is time consuming and its acceptability by non-psychiatrists has been questioned (Borson et al., 2003). Furthermore, it contains a drawing task, which is difficult for stroke patients with upper limb paralysis to complete. In contrast, the SOMC test is a brief, verbally administered screen that does not require the patient to write or draw (Goring et al., 2004). As mentioned, this makes the SOMC test suitable for use with stroke patients, and it is also one of the most commonly administered screens for assessing cognitive function in a variety of populations (Fillenbaum et al., 1998), such as healthy older adults (Hanlon et al., 1998; Stutts et al., 1998; Cohen-Mansfield and Perach, 2012), those with dementia (Boucher et al., 1996), Alzheimer’s disease (Mavioglu et al., 2006), hip fracture (Bech et al., 2015), multiple sclerosis (Vlaar and Wade, 2003), people exposed to anesthesia (Bilotta et al., 2009; Bronco et al., 2010; Werner et al., 2015), and older adults with cancer (Jayani et al., 2020). To the best of our knowledge, few studies have assessed the use of the SOMC test in stroke patients. Wade and Vergis (1999) reported that the SOMC test was reasonably effective for screening for major cognitive deficits. Katzman et al. (1983) proved that the SOMC test could discriminate between mild, moderate, and severe cognitive deficits, and Queally et al. (2010) reported that the moderate-impairment cut-off of the SOMC test was scored more accurately than that of the MMSE. Therefore, the SOMC test may have great potential for detecting cognitive impairment in people with stroke.

Brief screening instruments such as the SOMC test are lacking in China, and there has been no report of a translation of the SOMC test into Chinese. Accordingly, the aim of this study was to translate the SOMC test into Chinese and explore its concurrent validity, sensitivity, and specificity in people with stroke.

Materials and methods

Translation process

We employed a forward-backward procedure to translate the SOMC test from English into Chinese (Beaton et al., 2000) and denoted this translation the C-SOMC test. An expert committee comprising the principal investigator, four translators (two Chinese native speaker and two English native speakers), two experienced physiotherapists, two occupational therapists and two rehabilitation physicians reviewed all of the versions of the C-SOMC test to ensure its smooth completion. The committee developed the final version of the C-SOMC test for field testing (Beaton et al., 2000). We revised item 3/7 and 6 to adapt them to suit Chinese culture. Specifically, we replaced names and addresses in item 3/7 with those that are common in Chinese culture, as follows: Arthur/Jones, Joe/Smith, Tom/White, and Philip/Winter were replaced with Li Wei, Wang Jun, Zhang Hua, and Liu Bo, respectively; West Street, Church Road, Station Road, and North Way were replaced with Tian He Road, Hong Qiao Road, He Ping Road, Chang An Street, respectively; and Witney, Banbury, Aylesbury, Oxford were replaced with Guangzhou, Shanghai, Tianjin, and Beijing, respectively. Due to cultural differences, it was challenging to find a task equivalent to that of item 6, which involves speeking the 12 months of the year in reverse order. This is because in Chinese culture, this task involves counting backward from 12 to 1, which is similar to the part of item 5 (which involves counting backward from 20 to 1). Ultimately, as this task needs to be based on stating 12 well-known words in a certain order, we used the twelve Chinese zodiac signs (TCZS) which are familiar to everyone in China as a substitute for the 12 months of the year. The TCZS are, in order, rat, cow, tiger, rabbit, dragon, snake, horse, sheep, monkey, chicken, dog, and pig. Although some people may only know some of the order and cannot quickly state all TCZS, every Chinese person knows all of them. Thus, requiring the TCZS to be spoken in reverse order was the most appropriate substitute for requiring the 12 months of the year to be spoken in reverse order. The C-SOMC test is presented in Supplementary Appendixs 1, 2.

Scoring

The total score of C-SOMC test ranges from 0 to 28, as does that for the SOMC test, which comprises six items and was first reported by Katzman et al. (1983). We scored the C-SOMC test such that compared with lower scores, higher scores indicate better cognitive function (Tieges et al., 2015). For item 1 (“What year is it now?”), 4 points are awarded for a correct answer, while 0 points are awarded for an incorrect answer. For item 2 (“What month is it now?”), 3 points are awarded for a correct answer, while 0 points are awarded for an incorrect answer. For item 4 (“About what time is it? within an hour”), 3 points are awarded for a correct answer, while 0 points are awarded for an incorrect answer. For item 5 (“Count backward 20 down to 1”), 4 points are awarded for completion with no errors, 2 points are awarded completion with one error, and 0 points are awarded for completion with two or more errors. For item 6 (“State the TCZS in reverse order”), 4 points are awarded for completion with no errors, 2 points are awarded completion with one error, and 0 points are awarded for completion with two or more errors. For item 3/7 (“Repeat the address given”), 2 points are subtracted from a score of 10 for each error on a first name, family name, number, road name or city name, so the score ranges from 0 to 10 points. Furthermore, because some people may be unable to state all TCZS in reverse order, we also removed item 6 and treated the remaining five items (i.e., item 1, 2, 4, 5, and 3/7) as a shorter C-SOMC test, denoted the C-SOMC-R6 test.

Subjects

In a previous study with a similar design, a sample size of 38 was sufficient to determine the concurrent validity of the SOMC test (Wade and Vergis, 1999). To draw more robust conclusions, this study enrolled 86 in-patients with a first cerebral infarction in the Department of Rehabilitation Medicine of the First Affiliated Hospital of Sun Yat-sen University in China from August 2015 to July 2019. The inclusion criteria were (Stinear et al., 2020) the occurrence of a first stroke with unilateral hemiparetic lesions confirmed by magnetic resonance imaging or computed tomography; (Li, 2020) an interval of ≥5 days after stroke; (Swartz et al., 2016) age of 18–80 years; (Zhu et al., 2022) a Glasgow Coma Scale ≥ 12; (Sun et al., 2014) no severe deficits in communication; and Lesniak et al. (2008) ability to give informed consent. The exclusion criteria were (1) an inability to complete assessments due to medical instability; (2) diagnosis with other neurological diseases that may affect cognitive function; or (3) a history of medication for mental illness.

The participants’ demographic details and major comorbidity data were collected from medical records. Their demographic information is shown in Table 1. This study was approved by the Human Subjects Ethics Subcommittee of the First Affiliated Hospital of Sun Yat-sen University in China, and informed written consent was obtained from all of the participants.

TABLE 1

Table 1. Characteristics of the study participants.

Procedure

Prior to collecting baseline data, an experienced physiotherapist with more than 10 years of clinical experience in stroke rehabilitation was trained to correctly administer the C-SOMC test and the C-MMSE properly. The two measures were conducted in a certain order which was first the C-MMSE and then the C-SOMC test. A sufficient rest period was provided during the measurement procedure to prevent fatigue affecting the results. The entire procedure took approximately10–15 min.

Outcome measures

SOMC test

The SOMC test is a 6-item orientation–memory-concentration test with a total score that ranges from 0 to 28 (Katzman et al., 1983). The score is highly correlated (r = 0.92) with and nearly as sensitive as the full orientation-memory-concentration test (Nerz et al., 2017). Furthermore, the score on the SOMC test is correlated with the immediate (Pearson’s r = 0.68) and delayed (Pearson’s r = 0.74) recall scores for the paragraph from the Rivermead Behavioral Memory Test (Wade and Vergis, 1999). Compared with lower scores, higher scores on the SOMC test indicate better cognitive function (Tieges et al., 2015). The suggested scores for categorization are as follows: 24–28 = normal cognition; 19–23 = possible impairment; ≤18 = dementia (Morris et al., 1989).

MMSE

The MMSE is the most widely known and utilized cognitive impairment instrument. It consists of 11 questions, takes approximately 10 min to administer, and has a total score ranging from 0 to 30 (Lampley-Dallas, 2001). A normal MMSE score varies depending on whether any adjustments are made for education alone or both education and age (Crum et al., 1993). For instance, without any adjustments, a score of 24 to 30 is considered to be normal, a score of 18 to 23 is considered consistent with mild dementia, and a score of 0 to 17 is considered consistent with severe dementia (Tombaugh and McIntyre, 1992).

Statistical analysis

Participants

The demographic and clinical characteristics of the participants in this study (n = 86) were interpreted using descriptive statistics.

Validity

The concurrent validity of the C-SOMC test was assessed by calculating the correlations between the C-SOMC test scores and the C-MMSE scores. The Spearman’s rank correlation coefficient (ρ) was used to evaluate these correlations. ρ-value from 0 to 0.25, 0.25 to 0.50, 0.50 to 0.75, and >0.75 were considered to indicate weak, fair, moderate-to-good, and good-to-excellent concurrent validity, respectively (Portney, 2009). If there was a significant correlation between items and the total score on the C-SOMC test, linear regression was performed with the “enter” method to examine what proportion of C-SOMC scores could be explained by each item (Seber and Lee, 2012).

True positive and true negative

The number of true positive and true negative cases were calculated using three cut-offs (at 18/19, 17/18, and 16/17) on the C-SOMC test and two cut-offs (at 23/24 and 24/25) on the C-MMSE. The participants who scored below both cut-offs on the C-SOMC test and the C-MMSE were considered true positives, whereas the participants who scored above both cut-offs on the C-SOMC test and the C-MMSE were considered true negatives.

Sensitivity and specificity

The MMSE was used as a comparator to measure the sensitivity and specificity of the C-SOMC test. The area under the receiver operating characteristic (ROC) curve [(area under the curve (AUC)] was calculated for the C-SOMC test. An ROC curve was used to demonstrate the sensitivity and specificity of the C-SOMC test for every possible cut-off value to distinguish cognitive impairment from normal cognition.

All of the statistical analyses were performed using SPSS version 20.0, with all of the tests being two-tailed. The level of significance was set as P < 0.05.

Results

Demographics

Eighty-six participants (67 men and 19 women) with a first cerebral infarction were enrolled in this study. The demographic and clinical characteristics of the participants are provided in Table 1.

Outcome scores

The data in this study were not normally distributed, as determined by the Shapiro–Wilk test. The C-SOMC test and C-MMSE outcome scores are shown in Table 2.

TABLE 2

Table 2. The participants’ scores for the outcome measures.

Concurrent validity

The data of the participants were pooled to calculate the concurrent validity. The total score on the C-SOMC test and the C-MMSE score yielded a moderate-to-good correlation correlation (ρ = 0.636, P < 0.001). The score on item 1 of the C-SOMC test and the C-MMSE score also exhibited a moderate-to-good correlation (ρ = 0.565, P < 0.001). The scores for items 2, 4, 5, 6, and 3/7 of the C-SOMC test each generated a fair correlation with the C-MMSE score (ρ = 0.272– 0.495, P < 0.05), whereas the score for item 6 of the C-SOMC test yielded the lowest ρ-value. Furthermore, the total score for the C-SOMC-R6 test and the C-MMSE score exhibited a moderate-to-good correlation (ρ = 0.624, P < 0.001). The scores for five items on the C-SOMC test (items 1, 2, 5, 6, 3/7) each generated a moderate-to-good correlation with the total score on this test (ρ = 0.501 – 0.795, P < 0.001), whereas the score for item 4 exhibited a fair correlation with the total score on this test (ρ = 0.430, P < 0.001). The total score on the C-SOMC test and the scores for most of its items were good predictors (adjusted R² = 0.214 to 0.615) of the C-MMSE, the exception was the score for item 6 (adjusted R² = 0.049). The scores for each of six items on the C-SOMC test were good predictors of the total score on this test (adjusted R² = 0.134 to 0.795), with the score for item 6 producing the lowest adjusted R² value. Figure 1 shows the relationship between the participants’ performance on the C-SOMC test and their performance on the C-MMSE.

FIGURE 1

Figure 1. Relationship between the participants’ (n = 86) performance in the C-SOMC test and their performance in the C-MMSE.

We next divided the participants into two groups: group 1 comprised 66 participants (54 men and 12 women) with normal cognition (an C-MMSE score ≥ 24), and group 2 comprised 20 participants (13 men and 7 women) with abnormal cognition (0 ≤ C-MMSE score ≤ 23). We separately analyzed the two groups for concurrent validity. The results showed that the group 1 did not exhibit correlations as good as those of the total pool of participants (n = 86), whereas group 2 exhibited similar correlations to those of the total pool of participants.

Detailed results of the validity analyses are summarized in Tables 3, 4.

TABLE 3

Table 3. Correlations between the C-SOMC test scores and the C-MMSE scores in the stroke participants.

TABLE 4

Table 4. Univariate linear regression of the C-SOMC test scores and the C-MMSE scores in the participants.

True positive and true negative

The details of the true positives and true negatives using the three cut-offs (at 18/19, 17/18, and 16/17) for the total scores on the C-SOMC test and the two cut-offs (at 23/24 and 24/25) for the total C-MMSE scores are shown in Table 5. The results indicate that a cut-off at 17/18 for the total C-SOMC test against a cut-off at 23/24 for the C-MMSE score gave optimal performance, with 84.9% (73/86) of the participants’ score on the C-SOMC test classified in agreement with their C-MMSE score.

TABLE 5

Table 5. Performance of the participants’ (n = 86) in the C-SOMC test against their performance in the C-MMSE.

Sensitivity and specificity

The results demonstrated that a cut-off at 17/18 for the total score on the C-SOMC test against a cut-off at 23/24 for the C-MMSE score gave optimal performance, with 75% sensitivity and 87.9% specificity. Table 5 provides details of the performance of the C-SOMC test against the C-MMSE.

The ROC curves for the C-SOMC test using cut-offs at 23/24 and 24/25 for the C-MMSE score are shown in Figures 2, 3, respectively. The AUCs were 0.92 and 0.87, respectively (P < 0.001, 95% confidence interval (CI) = 0.85 to 0.96; P < 0.001, 95% CI = 0.79 to 0.96).

FIGURE 2

Figure 2. Receiver operating characteristic curve for the C-SOMC test using a cut-off at 23/24 on the C-MMSE in the stroke participants (n = 86).

FIGURE 3

Figure 3. Receiver operating characteristic curve for the C-SOMC test using a cut-off at 24/25 on the C-MMSE in the stroke participants (n = 86).

Discussion

This study was the first to translate the SOMC test into Chinese and adapt it to Chinese culture, forming the C-SOMC test. It was also the first study to investigate the concurrent validity, sensitivity, and specificity of the C-SOMC test in a Chinese population with a first cerebral infarction. The results showed that the participants’ performance on the C-SOMC test was well correlated with their performance on the C-MMSE. Additionally, a ROC analysis revealed that the C-SOMC test had good sensitivity and specificity, with a cut-off at 17/18 for the total score on the C-SOMC test against a cut-off at 23/24 for the score of C-MMSE giving optimal performance.

The validation analysis indicated that there was a significant correlation between the participants’ total scores in the C-SOMC test and their scores in the C-MMSE. Their scores for each of the six items in the C-SOMC test were also significantly correlated with their scores in the C-MMSE, with item 1 yielding the highest ρ-value and item 6 exhibiting the lowest ρ-value. The above-described findings suggest that the C-SOMC test is a valid measure for screening cognitive impairment in stroke patients, with validity comparable to that of the C-MMSE. Previous studies involving different populations have come to similar conclusions. For example, Davous et al. (1987) found a high correlation between the SOMC test and the MMSE in neurological, psychiatric, and dementia patients, demonstrating that the SOMC test and the MMSE are equivalently effective for identifying vascular or degenerative dementia. Similarly, Goring et al. (2004) showed that the SOMC test and the MMSE were highly correlated in assessment of patients in acute medical ward. Therefore, our study supports the validity of the C-SOMC test as a tool for screening cognitive impairment in stroke patients.

The total scores on the C-SOMC test and scores for each item in this test were good predictors of the C-MMSE score, except for item 6, which had a lower adjusted R² than the other items. Furthermore, the scores for each of six items of the C-SOMC test were good predictors for the total score on this test, with the score for item 6 being the lowest. This might have been due to item 6 being the most difficult item for the participants to answer, leading to the variability in their responses to this item. That was, although all of the participants were very familiar with the TCZS, some of the participants only knew some of the order of the TCZS and could not state all of them quickly in the correct order.

As mentioned, item 6 of the C-SOMC test was deleted, and the remaining five items (items 1, 2, 4,5, and 3/7) constituted the C-SOMC-R6 test. The total score on the C-SOMC-R6 test was significantly correlated with the total score on the C-SOMC test (ρ = 0.933) and was a strong predictor of the total score on the C-SOMC test (adjusted R² = 0.955). The total score on the C-SOMC-R6 test was also significantly correlated with the C-MMSE score (ρ = 0.624) and was a good predictor (adjusted R² = 0.606) of the C-MMSE score. This suggested that the C-SOMC-R6 test may be a useful alternative to the C-SOMC test for screening cognitive function in stroke patients. However, compared with the corresponding values for correlation between the C-SOMC test and the C-MMSE, the ρ-value and adjusted R² of the correlation between the C-SOMC-R6 test and the C-MMSE were slightly smaller. Therefore, further research is needed to confirm the validity of the C-SOMC-R6 test as a measure for screening cognitive impairment in stroke patients. For now, the C-SOMC test remains the optimal validated measure for this purpose.

We also found that the C-SOMC test had AUCs of 0.92 and 0.87 when using cut-offs at 23/24 and 24/25 on the C-MMSE, respectively. As an AUC of 0.80 or above is considered to indicate good accuracy (Goring et al., 2004), these results suggested that the C-SOMC test was highly accurate at distinguishing between cognitive impairment and normal cognition in the participants. A cut-off at 17/18 on the C-SOMC test against a cut-off at 23/24 on the C-MMSE yielded optimal performance: with 84.9% (73/86) of the participants were classified in agreement with the C-MMSE, with 75% sensitivity and 87.9% specificity. These findings are consistent with those of previous studies (Davous et al., 1987; Goring et al., 2004) and the recommendations from the original validation study (Katzman et al., 1983). In summary, our findings suggest that the C-SOMC test is a useful and sensitive tool for identifying cognitive impairment in patients with stroke.

This study had several limitations. First, the sample size was moderate, which may limit the generalizability of our findings. Second, 66 (76.74%) participants had normal cognition, whereas only 14 (16.28%) participants had a C-MMSE score of 18–23 and only six (6.98%) participants had a C-MMSE score of 0–17, indicating mild and severe cognitive impairment, respectively. This restricted our ability to analyze the C-SOMC test scores across different levels of cognitive impairment. Therefore, future studies should use a larger sample size and a broader range of cognitive impairment levels to further examine the performance of the C-SOMC test. Third, we did not compare the C-SOMC test scores of the participants with those of healthy individuals. Finally, we only assessed the concurrent validity of the C-SOMC test and did not evaluate other psychometric properties such as intra- and inter-rater reliability, responsiveness, and predictive validity. Hence, further research is required to comprehensively evaluate the validity and reliability of the C-SOMC test in stroke patients with varying degrees of cognitive impairment.

Conclusion

The C-SOMC test appears to be a valid tool for assessing cognitive impairment in stroke patients. Our findings also demonstrate that the C-SOMC test is highly sensitive and specific, with performance levels similar to those of the C-MMSE. This suggests that the C-SOMC test can be effectively used in both clinical and research settings to evaluate Chinese stroke patients. However, further research should investigate the comprehensive psychometric properties of the C-SOMC test.

Data availability statement

The original contributions presented in this study are included in the article/Supplementary material, further inquiries can be directed to the corresponding authors.

Ethics statement

The studies involving human participants were reviewed and approved by the Medical Ethical Committee of the First Affiliated Hospital of Sun Yat-sen University [Ethics Number: (2014)88]. The patients/participants provided their written informed consent to participate in this study.

Author contributions

D-FH, Y-RM, and J-LZ designed the experiment. J-LZ performed the experiment. J-LZ and P-MC analyzed the data and interpreted the results. J-LZ, P-MC, and SMN edited and wrote the manuscript. All authors reviewed and approved the final manuscript.

Funding

This work was funded by the National Key Research and Development Program of China (2020YFC2004300 and 2020YFC2004304), the 5010 Planning Project of Sun Yat-sen University of China (No. 2014001), the National Natural Science Foundation of China (No. 82102649), and the Medical Scientific Research Foundation of Guangdong Province (No. A2020426).

Acknowledgments

We would like to acknowledge the individuals for their participating in the study. We also express our gratitude to our expert group who translated the original SOMC from English into Chinese and all the colleagues of the Department of Rehabilitation Medicine of the First Affiliated Hospital, Sun Yat-sen University, China.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnhum.2023.977078/full#supplementary-material

Abbreviations

SOMC, Short Orientation-Memory-Concentration; C-SOMC, Chinese version of the Short Orientation-Memory-Concentration; MMSE, Mini Mental State Examination; ROC, receiver operating characteristic; AUC, area under the curve; TCZS, twelve Chinese zodiac sign; C-SOMC-R6, item 6 was removed from the C-SOMC test and the remaining five items (i.e., item 1, 2, 4, 5, and 3/7) constituted a shorter C-SOMC test.

References

Beaton, D., Bombardier, C., Guillemin, F., and Ferraz, M. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976) 25, 3186–3191. doi: 10.1097/00007632-200012150-00014

PubMed Abstract | CrossRef Full Text | Google Scholar

Bech, R., Lauritsen, J., Ovesen, O., and Overgaard, S. (2015). The verbal rating scale is reliable for assessment of postoperative pain in hip fracture patients. Pain Res. Treat. 2015:676212. doi: 10.1155/2015/676212

PubMed Abstract | CrossRef Full Text | Google Scholar

Bilotta, F., Doronzio, A., Cuzzone, V., Caramia, R., and Rosa, G. (2009). Early postoperative cognitive recovery and gas exchange patterns after balanced anesthesia with sevoflurane or desflurane in overweight and obese patients undergoing craniotomy: A prospective randomized trial. J. Neurosurg. Anesthesiol. 21, 207–213.

Google Scholar

Borson, S., Scanlan, J., Chen, P., and Ganguli, M. (2003). The mini-cog as a screen for dementia: Validation in a population-based sample. J. Am. Geriatr. Soc. 51, 1451–1454. doi: 10.1046/j.1532-5415.2003.51465.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Boucher, L., Renvall, M., and Jackson, J. (1996). Cognitively impaired spouses as primary caregivers for demented elderly people. J. Am. Geriatr. Soc. 44, 828–831. doi: 10.1111/j.1532-5415.1996.tb03742.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Bronco, A., Ingelmo, P., Aprigliano, M., Turella, M., Sahillioglu, E., Bucciero, M., et al. (2010). Xenon anaesthesia produces better early postoperative cognitive recovery than sevoflurane anaesthesia. Eur. J. Anaesthesiol. 27, 912–916. doi: 10.1097/EJA.0b013e32833b652d

PubMed Abstract | CrossRef Full Text | Google Scholar

Cohen-Mansfield, J., and Perach, R. (2012). Sleep duration, nap habits, and mortality in older persons. Sleep 35, 1003–1009. doi: 10.5665/sleep.1970

PubMed Abstract | CrossRef Full Text | Google Scholar

Crichton, S., Bray, B., McKevitt, C., Rudd, A., and Wolfe, C. (2016). Patient outcomes up to 15 years after stroke: Survival, disability, quality of life, cognition and mental health. J. Neurol. Neurosurg. Psychiatry 87, 1091–1098. doi: 10.1136/jnnp-2016-313361

PubMed Abstract | CrossRef Full Text | Google Scholar

Crum, R., Anthony, J., Bassett, S., and Folstein, M. (1993). Population-based norms for the mini-mental state examination by age and educational level. JAMA 269, 2386–2391.

Google Scholar

Davous, P., Lamour, Y., Debrand, E., and Rondot, P. (1987). A comparative evaluation of the short orientation memory concentration test of cognitive impairment. J. Neurol. Neurosurg. Psychiatry 50, 1312–1317. doi: 10.1136/jnnp.50.10.1312

PubMed Abstract | CrossRef Full Text | Google Scholar

Fillenbaum, G., Landerman, L., and Simonsick, E. (1998). Equivalence of two screens of cognitive functioning: The short portable mental status questionnaire and the orientation-memory-concentration test. J. Am. Geriatr. Soc. 46, 1512–1518. doi: 10.1111/j.1532-5415.1998.tb01535.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Goring, H., Baldwin, R., Marriott, A., Pratt, H., and Roberts, C. (2004). Validation of short screening tests for depression and cognitive impairment in older medically ill inpatients. Int. J. Geriatr. Psychiatry 19, 465–471. doi: 10.1002/gps.1115

PubMed Abstract | CrossRef Full Text | Google Scholar

Hanlon, J., Horner, R., Schmader, K., Fillenbaum, G., Lewis, I., Wall, W., et al. (1998). Benzodiazepine use and cognitive function among community-dwelling elderly. Clin. Pharmacol. Ther. 64, 684–692. doi: 10.1016/S0009-9236(98)90059-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Jayani, R., Magnuson, A., Sun, C., Ma, H., Tew, W., Mohile, S., et al. (2020). Association between a cognitive screening test and severe chemotherapy toxicity in older adults with cancer. J. Geriatr. Oncol. 11, 284–289. doi: 10.1016/j.jgo.2019.10.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Katzman, R., Brown, T., Fuld, P., Peck, A., Schechter, R., and Schimmel, H. (1983). Validation of a short orientation-memory-concentration test of cognitive impairment. Am. J. Psychiatry 140, 734–739. doi: 10.1176/ajp.140.6.734

PubMed Abstract | CrossRef Full Text | Google Scholar

Kwon, H., Lee, D., Lee, M., Yu, S., Lim, J., Yu, K., et al. (2020). Post-stroke cognitive impairment as an independent predictor of ischemic stroke recurrence: Picasso sub-study. J. Neurol. 267, 688–693. doi: 10.1007/s00415-019-09630-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Lampley-Dallas, V. (2001). Neuropsychological screening tests in african americans. J. Natl. Med. Assoc. 93, 323–328.

Google Scholar

Lesniak, M., Bak, T., Czepiel, W., Seniow, J., and Czlonkowska, A. (2008). Frequency and prognostic value of cognitive disorders in stroke patients. Dement. Geriatr. Cogn. Disord. 26, 356–363. doi: 10.1159/000162262

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, L. (2020). Support programme for secondary prevention of stroke: Inspiration to continue? Lancet Neurol. 19, 24–25. doi: 10.1016/S1474-4422(19)30410-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Mavioglu, H., Gedizlioglu, M., Akyel, S., Aslaner, T., and Eser, E. (2006). The validity and reliability of the turkish version of Alzheimer’s disease assessment scale-cognitive subscale (adas-cog) in patients with mild and moderate Alzheimer’s disease and normal subjects. Int. J. Geriatr. Psychiatry 21, 259–265. doi: 10.1002/gps.1457

PubMed Abstract | CrossRef Full Text | Google Scholar

Morris, J., Heyman, A., Mohs, R., Hughes, J., van Belle, G., Fillenbaum, G., et al. (1989). The consortium to establish a registry for alzheimer’s disease (cerad). Part i. Clinical and neuropsychological assessment of alzheimer’s disease. Neurology 39, 1159–1165. doi: 10.1212/wnl.39.9.1159

PubMed Abstract | CrossRef Full Text | Google Scholar

Nerz, C., Schwickert, L., Becker, C., Studier-Fischer, S., Mussig, J., and Augat, P. (2017). Effectiveness of robot-assisted training added to conventional rehabilitation in patients with humeral fracture early after surgical treatment: Protocol of a randomised, controlled, multicentre trial. Trials 18:589. doi: 10.1186/s13063-017-2274-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Portney, L. W. (2009). Foundations of clinical research: Applications to practice. London: Pearson.

Google Scholar

Queally, V., Evans, J., and McMillan, T. (2010). Accuracy in scoring vignettes using the mini mental state examination and the short orientation memory concentration test. J. Geriatr. Psychiatry Neurol. 23, 160–164. doi: 10.1177/0891988710363712

PubMed Abstract | CrossRef Full Text | Google Scholar

Seber, G., and Lee, A. (2012). Linear regression analysis. Hoboken, NJ: Wiley.

Google Scholar

Stephens, S., Kenny, R., Rowan, E., Allan, L., Kalaria, R., Bradbury, M., et al. (2004). Neuropsychological characteristics of mild vascular cognitive impairment and dementia after stroke. Int. J. Geriatr. Psychiatry 19, 1053–1057. doi: 10.1002/gps.1209

PubMed Abstract | CrossRef Full Text | Google Scholar

Stinear, C., Lang, C., Zeiler, S., and Byblow, W. (2020). Advances and challenges in stroke rehabilitation. Lancet Neurol. 19, 348–360. doi: 10.1016/S1474-4422(19)30415-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Stutts, J., Stewart, J., and Martell, C. (1998). Cognitive test performance and crash risk in an older driver population. Accid. Anal. Prev. 30, 337–346. doi: 10.1016/s0001-4575(97)00108-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Sun, J., Tan, L., and Yu, J. (2014). Post-stroke cognitive impairment: Epidemiology, mechanisms and management. Ann. Transl. Med. 2:80. doi: 10.3978/j.issn.2305-5839.2014.08.05

PubMed Abstract | CrossRef Full Text | Google Scholar

Swartz, R., Bayley, M., Lanctot, K., Murray, B., Cayley, M., Lien, K., et al. (2016). Post-stroke depression, obstructive sleep apnea, and cognitive impairment: Rationale for, and barriers to, routine screening. Int. J. Stroke 11, 509–518. doi: 10.1177/1747493016641968

PubMed Abstract | CrossRef Full Text | Google Scholar

Tieges, Z., Stiobhairt, A., Scott, K., Suchorab, K., Weir, A., Parks, S., et al. (2015). Development of a smartphone application for the objective detection of attentional deficits in delirium. Int. Psychogeriatr. 27, 1251–1262. doi: 10.1017/S1041610215000186

PubMed Abstract | CrossRef Full Text | Google Scholar

Tombaugh, T., and McIntyre, N. (1992). The mini-mental state examination: A comprehensive review. J. Am. Geriatr. Soc. 40, 922–935. doi: 10.1111/j.1532-5415.1992.tb01992.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Vlaar, A., and Wade, D. (2003). Verbal fluency assessment of patients with multiple sclerosis: Test-retest and inter-observer reliability. Clin. Rehabil. 17, 756–764. doi: 10.1191/0269215503cr674oa

PubMed Abstract | CrossRef Full Text | Google Scholar

Wade, D., and Vergis, E. (1999). The short orientation-memory-concentration test: A study of its reliability and validity. Clin. Rehabil. 13, 164–170. doi: 10.1191/026921599673848768

PubMed Abstract | CrossRef Full Text | Google Scholar

Werner, J., Castellon-Larios, K., Thongrong, C., Knudsen, B., Lowery, D., Antor, M., et al. (2015). Desflurane allows for a faster emergence when compared to sevoflurane without affecting the baseline cognitive recovery time. Front. Med. (Lausanne) 2:75. doi: 10.3389/fmed.2015.00075

PubMed Abstract | CrossRef Full Text | Google Scholar

Ye, M., Zheng, Y., Xiong, Z., Ye, B., and Zheng, G. (2022). Baduanjin exercise ameliorates motor function in patients with post-stroke cognitive impairment: A randomized controlled trial. Complement. Ther. Clin. Pract. 46:101506. doi: 10.1016/j.ctcp.2021.101506

PubMed Abstract | CrossRef Full Text | Google Scholar

Yuan, M., Guo, Y., Han, Y., Gao, Z., Shen, X., and Bi, X. (2021). Effectiveness and mechanisms of enriched environment in post-stroke cognitive impairment. Behav. Brain Res. 410:113357. doi: 10.1016/j.bbr.2021.113357

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhu, Y., Zhao, Y., Lu, Y., Fang, C., Zhang, Q., Zhang, J., et al. (2022). The association between plasma soluble triggering receptor expressed on myeloid cells 2 and cognitive impairment after acute ischemic stroke. J. Affect. Disord. 299, 287–293. doi: 10.1016/j.jad.2021.12.011

PubMed Abstract | CrossRef Full Text | Google Scholar