ORIGINAL RESEARCH article

Front. Neurol., 17 June 2024

Sec. Stroke

Volume 15 - 2024 | https://doi.org/10.3389/fneur.2024.1373306

Development and validation of a nomogram predictive model for cognitive impairment in cerebral small vessel disease: a comprehensive retrospective analysis

  • NL

    Ning Li 1

  • YG

    Yan Gao 2

  • LL

    Li-tao Li 3

  • YH

    Ya-dong Hu 1

  • LL

    Li Ling 1

  • NJ

    Nan Jia 1

  • YC

    Ya-jing Chen 1

  • YM

    Ya-nan Meng 1

  • YJ

    Ye Jiang 1*

  • 1. Department of Neurology, Affiliated Hospital of Hebei University, Baoding, China

  • 2. Department of Neurology, Renmin Hospital of Wuhan University, Wuhan, China

  • 3. Department of Neurology, Hebei General Hospital, Shijiazhuang, China

Abstract

Background:

Cerebral small vessel disease (CSVD) is a common neurodegenerative condition in the elderly, closely associated with cognitive impairment. Early identification of individuals with CSVD who are at a higher risk of developing cognitive impairment is crucial for timely intervention and improving patient outcomes.

Objective:

The aim of this study is to construct a predictive model utilizing LASSO regression and binary logistic regression, with the objective of precisely forecasting the risk of cognitive impairment in patients with CSVD.

Methods:

The study utilized LASSO regression for feature selection and logistic regression for model construction in a cohort of CSVD patients. The model’s validity was assessed through calibration curves and decision curve analysis (DCA).

Results:

A nomogram was developed to predict cognitive impairment, incorporating hypertension, CSVD burden, apolipoprotein A1 (ApoA1) levels, and age. The model exhibited high accuracy with AUC values of 0.866 and 0.852 for the training and validation sets, respectively. Calibration curves confirmed the model’s reliability, and DCA highlighted its clinical utility. The model’s sensitivity and specificity were 75.3 and 79.7% for the training set, and 76.9 and 74.0% for the validation set.

Conclusion:

This study successfully demonstrates the application of machine learning in developing a reliable predictive model for cognitive impairment in CSVD. The model’s high accuracy and robust predictive capability provide a crucial tool for the early detection and intervention of cognitive impairment in patients with CSVD, potentially improving outcomes for this specific condition.

1 Introduction

Cerebral small vessel disease (CSVD) is intricately linked to cognitive decline and represents a critical focus in the study of vascular contributions to cognitive impairment and dementia (1–3). This spectrum of pathological processes has been increasingly recognized for its substantial impact on public health, especially given the aging global population (2, 4–7). Despite its clinical importance, the detection and quantification of cognitive impairment attributable to CSVD remain fraught with complexities. Cognitive symptoms often manifest subtly and progress insidiously, making early diagnosis a formidable challenge in clinical settings (8).

The traditional approach to diagnosing CSVD-related cognitive impairment relies heavily on clinical judgment, which is subject to variability and may fail to capture the nuanced progression of the disease. Consequently, there is a pressing need for objective and reproducible diagnostic tools that can accurately predict the onset and trajectory of cognitive decline in CSVD. Addressing this need, our study introduces a predictive model that synthesizes demographic, clinical, neuroimaging, and biomarker data to objectively assess the risk of cognitive decline. The current models in literature have either not incorporated such a diverse dataset or have not been validated sufficiently for clinical application (9, 10). Our approach utilizes advanced machine learning techniques, including LASSO regression for feature selection and logistic regression for model development, filling a critical gap by providing a tool with both high sensitivity and specificity for CSVD cognitive sequelae.

This study leverages a comprehensive dataset of 377 CSVD patients, encompassing a wide array of variables including demographic details, clinical history, neuroimaging findings, and biomarkers. Through rigorous statistical methodologies, we aim to construct a predictive model that not only distinguishes between patients with and without cognitive impairment but also provides a probabilistic assessment of the risk of cognitive decline. By adopting machine learning techniques, particularly LASSO regression for feature selection followed by logistic regression for model development, we seek to create a model that is both sensitive and specific to the cognitive sequelae of CSVD.

In doing so, our objectives are twofold: firstly, to present a model that can be readily applied in clinical practice for the early identification of patients at risk of cognitive impairment due to CSVD, and secondly, to contribute to the body of knowledge that underpins the intersection of neurovascular pathology and neurodegeneration. It is our anticipation that such a model will not only facilitate early intervention strategies but also spur further research into targeted therapies for this underdiagnosed yet prevalent condition.

2 Materials and methods

2.1 Study population and design

In a cross-sectional study conducted from July 2022 to October 2023 at the Neurology Department of the Affiliated Hospital of Hebei University, we targeted a cohort of patients aged 50 and above. These participants were subjected to comprehensive cranial magnetic resonance imaging (MRI) to confirm CSVD diagnosis. The inclusion criteria mandated completion of a full cranial MRI series, provision of serum samples for ELISA testing to assess inflammatory markers, and undergoing the Montreal Cognitive Assessment (MoCA) to gauge cognitive function. The MoCA, a widely acknowledged tool for detecting mild cognitive impairments, was specifically chosen for its robust validity across diverse age groups and clinical conditions (11, 12), thereby serving as an optimal instrument for assessing CSVD-related cognitive impairments. The scoring of MoCA was conducted by trained personnel, adhering to standardized procedures to ensure consistency and reliability of cognitive function assessment. Exclusion criteria encompassed the presence of neurological conditions other than CSVD that might impair cognitive function, a history of psychiatric disorders or current use of psychoactive drugs, contraindications to MRI such as claustrophobia or presence of metal implants, inadequate quality of cranial MRI for reliable assessment, acute infections and severe systemic illnesses that could impede participation in the study. Participants’ cognitive status was categorized based on MoCA scores, with scores of 25 or below indicating cognitive impairment, and scores of 26 or above denoting normal cognitive function. Alongside MRI diagnostics, participants underwent routine lab tests including complete blood count, renal and liver function tests, and electrolyte panels. Informed consent for serum sample collection for ELISA testing was obtained in line with ethical standards. This study was conducted in strict adherence to ethical guidelines and was approved by the Ethics Committee of the Affiliated Hospital of Hebei University, with the approval number HDFYLL-KY-2023-060. This approval ensures that our study complies with the ethical principles outlined in the 1964 Helsinki Declaration and its subsequent amendments, reaffirming our commitment to the highest standards of research ethics.

2.2 MRI acquisition and assessment in CSVD patients

In our study, all participants were subjected to brain MRI examinations using a state-of-the-art 3.0 T GE scanner. The identification of CSVD was reliant on the detection of specific neuroimaging indicators, which included any combination of lacunes, white matter hyperintensities (WMH), enlarged perivascular spaces (EPVS), and cerebral microbleeds (CMBs). In this context, WMH were defined as regions showing elevated signal intensity on T2-weighted images, often symmetrically distributed across brain hemispheres. Lacunes were described as round or ovoid cerebrospinal fluid-signal lesions with diameters ranging between 3 and 15 mm. Additionally, CMBs manifested as small, round, hypointense areas, 2–10 mm in size, evident in susceptibility-weighted imaging sequences. In line with the comprehensive CSVD scoring methodology initially developed by Wardlaw et al. (5, 11), we evaluated the total CSVD burden employing an ordinal scale that spans from 0 to 4. This evaluation process included assigning one point for each of the following criteria: the severity of WMH, as indicated by a periventricular WMH score of 3 or a deep WMH score between 2 and 3; the presence of lacunes; the existence of CMBs; and the significant presence of basal ganglia EPVS, particularly exceeding a count of 10 (12). For an accurate and unbiased evaluation of these CSVD markers, neuroimaging specialists Yan Hou and Huan Zhou, devoid of access to the participants’ clinical information, undertook the assessment. Their analysis adhered rigorously to the Standards for Reporting Vascular Changes on Neuroimaging (STRIVE) criteria (11, 13), which provided a framework for consistent and reliable interpretation of CSVD-related neuroimaging findings.

2.3 Clinical blood biochemistry assessment

In this study, we performed an extensive assessment of clinical blood biochemistry parameters in patients with CSVD. Our evaluation included a broad spectrum of 44 laboratory markers, categorically divided into routine and specialized tests. Routine assessments comprised complete blood count, renal and liver function tests, electrolyte balance, lipid profiles, and coagulation parameters. In addition to these standard measures, we conducted a detailed analysis of inflammatory markers, crucial in elucidating CSVD’s pathophysiological landscape. These markers encompassed cytokines, acute phase reactants, and specific inflammatory indices, offering insights into the inflammatory status of CSVD patients. Notably, all laboratory data were transformed into binary categorical variables, based on either their median values or clinically established cutoffs. This transformation enabled a nuanced exploration of the potential correlations between these biochemical markers and cognitive impairment in CSVD, forming a critical component of our predictive model development.

2.4 Clinical evaluation

In this study, we conducted a thorough clinical evaluation of 377 patients diagnosed with CSVD. The participants’ demographic information, including age and sex, was meticulously recorded. Medical histories were detailed, focusing on the presence of hypertension, diabetes, and hypercholesterolemia. Hypertension was defined as having a systolic blood pressure ≥140 mmHg, diastolic blood pressure ≥90 mmHg, or being under antihypertensive medication. Diabetes was identified by fasting blood glucose levels ≥7.0 mmol/L, OGTT2h levels ≥11.1 mmol/L, or the use of hypoglycemic medications. Hypercholesterolemia was recognized by total cholesterol or LDL cholesterol levels exceeding normal range limits. Additionally, lifestyle factors such as smoking and alcohol consumption histories were gathered, alongside information on the duration of the disease.

2.5 Statistical methodology

In our investigation involving 377 CSVD patients, the cohort was randomly divided into a training set with 265 participants and a validation set comprising 112 participants, following a 7:3 allocation ratio. This randomization ensured a balanced and unbiased approach to model development. we opted for the stratification of continuous laboratory variables into tertiles. This approach was employed to facilitate a more meaningful interpretation of the data by categorizing it into low, medium, and high ranges. Utilizing tertiles allows for a clear delineation of patient subgroups based on their laboratory values, aligning with the clinical relevance of these categories. The selection of thresholds for continuous variables was informed by clinical expertise and mirrored established norms in contemporary research and statistical methodologies. For categorical data, we presented frequencies and percentages. To ascertain baseline similarities or disparities between the training and validation cohorts, we utilized appropriate statistical tests, opting for the χ2 test or Fisher’s exact test for categorical data.

Within the training dataset, the LASSO regression method was employed to pinpoint crucial risk factors linked to cognitive impairment in CSVD patients. LASSO regression was utilized for its efficacy in both variable selection and regularization, enabling the identification of the most predictive features for cognitive impairment in CSVD while mitigating overfitting. This technique helped in selecting variables with non-zero coefficients for further analysis. These identified variables were then incorporated into a logistic regression model to ascertain independent predictors of cognitive impairment in CSVD. We constructed a nomogram from these identified risk factors, derived from the logistic regression model. The nomogram’s predictive performance was evaluated using the receiver operating characteristic curve (AUC-ROC), and calibration curves were generated to align predicted probabilities with actual outcomes. Furthermore, the clinical utility of the model was assessed using decision curve analysis (DCA). To mitigate overfitting, we employed several strategies. First, we used LASSO regression to perform variable selection and reduce model complexity. Second, we conducted 10-fold cross-validation to determine the optimal regularization parameter (λ), ensuring the model’s performance on multiple data subsets. Finally, we validated the model using an independent dataset to test its generalizability. These combined strategies enhance the model’s robustness and reduce the risk of overfitting. All statistical procedures were carried out using R software (version 4.3.0),1 and a p-value of less than 0.05 (two-tailed) was considered to denote statistical significance.

3 Results

3.1 Baseline characteristics

From July 2022 to October 2023, this investigation initially recruited 427 participants who satisfied the inclusion benchmarks. Subsequent application of exclusion criteria led to the withdrawal of 50 participants, yielding a dataset of 377 individuals for subsequent analyses as depicted in Figure 1. Of these, 265 formed the training cohort, while the remaining 112 were allocated to the validation cohort. Table 1 delineates the demographic and clinical profiles at baseline for both cohorts. This study incorporated the following 52 potential indicators related to cognitive impairment in CSVD: CSVD Burden, Gender, Smoking, Drinking, Hypertension, Diabetes, Hyperlipidemia, Age, White Blood Cell Count, Platelet Count, Neutrophil Count, Lymphocyte Count, Monocyte Count, Urea, Creatinine, Uric Acid, Prothrombin Time, Activated Partial Thromboplastin Time, Thrombin Time, Fibrinogen, Hemoglobin A1c, Total Cholesterol, Triglycerides, High-Density Lipoprotein, Low-Density Lipoprotein, Very Low-Density Lipoprotein, Apolipoprotein A1 (ApoA1), Apolipoprotein B100, ApoA1 to ApoB100 Ratio, Lipoprotein(a), Total Protein, Albumin, Globulin, Albumin to Globulin Ratio, Homocysteine, Systemic Immune-Inflammatory Index, Systemic Inflammation Response Index, Neutrophil-to-Lymphocyte Ratio, Lymphocyte-to-Monocyte Ratio, Neutrophil-to-Monocyte Ratio, Neutrophil-to-HDL Ratio, Lymphocyte-to-HDL Ratio, Monocyte-to-HDL Ratio, IL-6, TNFα, VCAM-1, LP-PLA2, CD40L, E-Selectin, ADMA, vWF, and ICAM-1. The lack of significant disparities in the 52 evaluated variables between the training and validation sets underscores the homogeneity of the study population. This parity is critical as it suggests that the predictive model derived from the training set has the potential for generalizability to other patient cohorts, affirming the robustness of the model’s predictive capacity for cognitive impairment associated with CSVD (Table 1).

Figure 1

Table 1

VariablesTotal (n = 377)training set (n = 265)validation set (n = 112)p-value
Cognitive impairment, n (%)0.438
No132 (35)89 (34)43 (38)
Yes245 (65)176 (66)69 (62)
CSVD.Burden, n (%)0.912
0–1173 (46)120 (45)53 (47)
289 (24)64 (24)25 (22)
3–4115 (31)81 (31)34 (30)
Gender, n (%)0.273
Female183 (49)134 (51)49 (44)
Male194 (51)131 (49)63 (56)
Smoking, n (%)0.8
No261 (69)185 (70)76 (68)
Yes116 (31)80 (30)36 (32)
Drinking, n (%)0.174
No124 (33)81 (31)43 (38)
Yes253 (67)184 (69)69 (62)
Hypertension, n (%)0.3
No103 (27)77 (29)26 (23)
Yes274 (73)188 (71)86 (77)
Diabetes, n (%)0.3
No267 (71)183 (69)84 (75)
Yes110 (29)82 (31)28 (25)
Hyperlipidemia, n (%)0.956
No250 (66)175 (66)75 (67)
Yes127 (34)90 (34)37 (33)
Age, n (%)0.9
≤69249 (66)174 (66)75 (67)
>69128 (34)91 (34)37 (33)
White blood cell count (×109/L), n (%)0.842
<6.04126 (33)91 (34)35 (31)
6.04–7.70128 (34)89 (34)39 (35)
>7.70123 (33)85 (32)38 (34)
Platelet count (×109/L), n (%)0.973
<200126 (33)89 (34)37 (33)
200–250128 (34)89 (34)39 (35)
>250123 (33)87 (33)36 (32)
Neutrophil count (×109/L), n (%)0.581
<3.83127 (34)86 (32)41 (37)
3.83–5.34125 (33)92 (35)33 (29)
>5.34125 (33)87 (33)38 (34)
Lymphocyte count (×109/L), n (%)0.533
<130126 (33)93 (35)33 (29)
1.30–1.74126 (33)85 (32)41 (37)
>1.74125 (33)87 (33)38 (34)
Monocyte count (×109/L), n (%)0.612
<0.40128 (34)87 (33)41 (37)
0.40–0.54128 (34)94 (35)34 (30)
>0.54121 (32)84 (32)37 (33)
Urea (mmol/L), n (%)0.791
<5.00120 (32)87 (33)33 (29)
5.00–6.19120 (32)84 (32)36 (32)
>6.19137 (36)94 (35)43 (38)
Creatinine (μmol/L), n (%)0.482
<57128 (34)88 (33)40 (36)
57–70128 (34)95 (36)33 (29)
>70121 (32)82 (31)39 (35)
Uric acid (μmol/L), n (%)0.301
<260127 (34)89 (34)38 (34)
260–325127 (34)95 (36)32 (29)
>325123 (33)81 (31)42 (38)
Prothrombin time (s), n (%)0.308
<11.1143 (38)94 (35)49 (44)
11.1–11.6111 (29)82 (31)29 (26)
>11.6123 (33)89 (34)34 (30)
Activated partial thromboplastin time (s), n (%)0.273
<27.6126 (33)82 (31)44 (39)
27.6–31.9128 (34)92 (35)36 (32)
>31.9123 (33)91 (34)32 (29)
Thrombin time (s), n (%)0.305
<14.5131 (35)87 (33)44 (39)
14.5–17.4121 (32)91 (34)30 (27)
>17.4125 (33)87 (33)38 (34)
Fibrinogen (g/L), n (%)0.954
<2.68130 (34)91 (34)39 (35)
2.68–3.26122 (32)87 (33)35 (31)
>3.26125 (33)87 (33)38 (34)
Hemoglobin A1c (mmol/L), n (%)0.423
<5.6132 (35)95 (36)37 (33)
5.6–6.2133 (35)88 (33)45 (40)
>6.2112 (30)82 (31)30 (27)
Total cholesterol (mmol/L), n (%)0.874
<3.92128 (34)91 (34)37 (33)
3.92–4.97124 (33)85 (32)39 (35)
>4.97125 (33)89 (34)36 (32)
Triglycerides (mmol/L), n (%)0.24
<1.00128 (34)88 (33)40 (36)
1.00–1.47125 (33)83 (31)42 (38)
>1.47124 (33)94 (35)30 (27)
High-density lipoprotein (mmol/L), n (%)0.124
<1.02129 (34)96 (36)33 (29)
1.02–1.23128 (34)93 (35)35 (31)
>1.23120 (32)76 (29)44 (39)
Low-density lipoprotein (mmol/L), n (%)0.707
<2.39124 (33)86 (32)38 (34)
2.39–3.23127 (34)87 (33)40 (36)
>3.23126 (33)92 (35)34 (30)
Very low-density lipoprotein (mmol/L), n (%)0.983
<0.36127 (34)90 (34)37 (33)
0.36–0.54126 (33)88 (33)38 (34)
>0.54124 (33)87 (33)37 (33)
Apolipoprotein A1 (g/L), n (%)0.083
<0 0.97127 (34)91 (34)36 (32)
0.97–1.12128 (34)97 (37)31 (28)
>1.12122 (32)77 (29)45 (40)
Apolipoprotein B100 (g/L), n (%)0.982
<0.68130 (34)92 (35)38 (34)
0.68–0.88125 (33)88 (33)37 (33)
>0.88122 (32)85 (32)37 (33)
ApoA1 to ApoB100 ratio, n (%)0.394
<1.19126 (33)94 (35)32 (29)
1.19–1.55127 (34)85 (32)42 (38)
>1.55124 (33)86 (32)38 (34)
Lipoprotein(a) (mg/L), n (%)0.675
<121126 (33)89 (34)37 (33)
121–678140 (37)95 (36)45 (40)
>678111 (29)81 (31)30 (27)
Total protein (g/L), n (%)0.361
<62143 (38)95 (36)48 (43)
62–67125 (33)93 (35)32 (29)
>67109 (29)77 (29)32 (29)
Albumin (g/L), n (%)0.424
<35159 (42)110 (42)49 (44)
35–40124 (33)84 (32)40 (36)
>4094 (25)71 (27)23 (21)
Globulin (g/L), n (%)0.272
<26165 (44)109 (41)56 (50)
26–28106 (28)77 (29)29 (26)
>28106 (28)79 (30)27 (24)
Albumin to globulin ratio, n (%)0.653
<1.38134 (36)98 (37)36 (32)
1.38–1.56119 (32)81 (31)38 (34)
>1.56124 (33)86 (32)38 (34)
Homocysteine (μmol/L), n (%)0.505
<15135 (36)94 (35)41 (37)
15–20123 (33)91 (34)32 (29)
>20119 (32)80 (30)39 (35)
Systemic immune-inflammatory index, n (%)0.928
<515.27126 (33)89 (34)37 (33)
515.27–878.63126 (33)87 (33)39 (35)
>878.63125 (33)89 (34)36 (32)
Systemic inflammation response index, n (%)0.761
<1.02126 (33)89 (34)37 (33)
1.02–1.75126 (33)91 (34)35 (31)
>1.75125 (33)85 (32)40 (36)
Neutrophil-to-lymphocyte ratio, n (%)0.918
<2.36126 (33)87 (33)39 (35)
2.36–3.64126 (33)90 (34)36 (32)
>3.64125 (33)88 (33)37 (33)
Lymphocyte-to-monocyte ratio, n (%)0.627
<2.86126 (33)92 (35)34 (30)
2.86–3.93126 (33)85 (32)41 (37)
>3.93125 (33)88 (33)37 (33)
Neutrophil-to-monocyte ratio, n (%)0.942
<8.3126 (33)88 (33)38 (34)
8.3–10.0125 (33)87 (33)38 (34)
>10.0126 (33)90 (34)36 (32)
Neutrophil-to-HDL ratio, n (%)0.411
<3.32126 (33)83 (31)43 (38)
3.32–4.90126 (33)91 (34)35 (31)
>4.90125 (33)91 (34)34 (30)
Lymphocyte-to-HDL ratio, n (%)0.551
<1.10126 (33)91 (34)35 (31)
1.10–1.61126 (33)84 (32)42 (38)
>1.61125 (33)90 (34)35 (31)
Monocyte-to-HDL ratio, n (%)0.551
<0.34126 (33)91 (34)35 (31)
0.34–0.51126 (33)84 (32)42 (38)
>0.51125 (33)90 (34)35 (31)
IL-6 (pg/mL), n (%)0.533
<6.69126 (33)85 (32)41 (37)
6.69–12.99126 (33)93 (35)33 (29)
>12.99125 (33)87 (33)38 (34)
TNF-α (pg/mL), n (%)0.294
<9.17126 (33)89 (34)37 (33)
9.17–16.90126 (33)94 (35)32 (29)
>16.90125 (33)82 (31)43 (38)
VCAM-1 (ng/mL), n (%)0.302
<613.22126 (33)95 (36)31 (28)
613.22–873.64126 (33)86 (32)40 (36)
>873.64125 (33)84 (32)41 (37)
LP-PLA2 (ng/mL), n (%)0.79
<203.60126 (33)90 (34)36 (32)
203.60–307.46126 (33)90 (34)36 (32)
>307.46125 (33)85 (32)40 (36)
CD40L (ng/mL), n (%)0.536
<2.01126 (33)84 (32)42 (38)
2.01–4.54126 (33)90 (34)36 (32)
>4.54125 (33)91 (34)34 (30)
E-selectin (ng/mL), n (%)0.409
<23.75126 (33)87 (33)39 (35)
23.75–48.32126 (33)94 (35)32 (29)
>48.32125 (33)84 (32)41 (37)
ADMA (μmol/L), n (%)0.334
<0.52126 (33)83 (31)43 (38)
0.52–0.73126 (33)89 (34)37 (33)
>0.73125 (33)93 (35)32 (29)
vWF (%), n (%)0.562
<97.47126 (33)85 (32)41 (37)
97.47–149.19126 (33)88 (33)38 (34)
>149.19125 (33)92 (35)33 (29)
ICAM-1 (ng/mL), n (%)0.605
<182.04130 (34)88 (33)42 (38)
182.04–199.6627 (7)18 (7)9 (8)
>199.66220 (58)159 (60)61 (54)

Comparative analysis of potential predictive factors in a cerebral small vessel disease (CSVD) cognitive impairment predictive model between training and validation sets.

This table presents a comprehensive comparison of potential predictive factors for cognitive impairment in a cohort of 377 patients with cerebral small vessel disease (CSVD). Divided into a training set comprising 265 patients for model development and a validation set consisting of 112 patients for efficacy assessment, the data encompass a range of clinical characteristics and inflammatory biomarkers. These include gender, smoking and drinking habits, hypertension, diabetes, hyperlipidemia, along with inflammatory markers like white blood cell count, platelet count, neutrophil count, and specific indicators closely related to CSVD such as IL-6, TNFα, and VCAM-1. The objective of this table is to demonstrate the comparability of the training and validation sets in these potential predictors, ensuring the generalizability and reliability of the predictive model’s outcomes. Statistical differences between the sets are indicated by p-values, with p < 0.05 denoting significant disparities.

3.2 Variable selection

In our endeavor to elucidate the variables significantly associated with cognitive impairment in CSVD, we rigorously analyzed a dataset comprising 52 variables, which spanned demographic information, clinical history, and a wide array of laboratory measurements. Employing LASSO regression, a method recognized for its efficiency in variable selection and overfitting prevention, we utilized the glmnet package in R, integrating a 10-fold cross-validation technique to determine the optimal regularization parameter (λ). The selection of λ was guided by the one standard error rule from the minimum criterion in cross-validation error, ensuring the model’s parsimony without compromising its predictive accuracy (Figures 2A,B).

Figure 2

This meticulous process distilled the multitude of factors down to 4 pivotal indicators that bear a statistically significant relationship with cognitive impairment in CSVD patients. These indicators-Hypertension, CSVD Burden, ApoA1, and Age-demonstrated the strongest associations with cognitive impairment, underscoring their importance in the predictive model (Table 2). During the LASSO regression process, coefficients of less important variables shrink towards zero. We selected features with non-zero coefficients, which ensures that only the most relevant predictors are included in the final model. This approach balances model simplicity and predictive performance, enhancing both interpretability and robustness of the model. Although the coefficient for CSVD Burden is relatively small, it was retained due to its clinical significance in reflecting the overall severity of cerebral small vessel disease.

Table 2

VariableCoefficientsLambda.1SE
Hypertension0.3110.028
CSVD.Burden0.0314
ApoA1−0.008
Age0.3131

Coefficients and lambda.1SE value of the LASSO regression.

This table lists the coefficients and lambda.1SE values for key variables including hypertension, CSVD burden, ApoA1, and age in the LASSO regression model for cognitive impairment prediction in CSVD.

3.3 Multivariable analysis

Our multivariable logistic regression analysis, adjusting for potential confounders, identified significant associations between CSVD-related cognitive impairment and several key factors from the 12 variables initially pinpointed by LASSO regression. Notably, Hypertension (OR: 1.78, 95% CI: 1.32–3.84, p < 0.001) and Age (OR: 1.85, 95% CI: 1.55–3.55, p < 0.001) were potent predictors of impairment, indicating substantially elevated risks. A higher CSVD Burden also heightened the risk (OR: 1.83, 95% CI: 1.23–2.72, p = 0.003), whereas increased ApoA1 levels demonstrated a protective effect (OR: 0.64, 95% CI: 0.43–0.97, p = 0.034). These variables reflect critical demographic and biological aspects influencing CSVD prognosis, as detailed in Table 3.

Table 3

BSEORCIZp-value
Hypertension3.210.5571.781.32–3.843.767<0.001
CSVD.Burden0.6020.2031.831.23–2.722.970.003
ApoA1−0.4430.2090.640.43–0.97−2.1260.034
Age3.7580.6561.851.55–3.553.732<0.001

Binary logistic regression analysis.

This table shows key predictors for cognitive impairment in CSVD, including regression coefficients, odds ratios, and their statistical significance.

3.4 Predictive model development

In this study, a nomogram was developed to predict the probability of cognitive impairment in patients with CSVD, based on four identified predictive factors: Hypertension, CSVD Burden, ApoA1 levels, and Age (Figure 3). Each factor contributes to an individualized risk score, calculated using the nomogram, which correlates with the likelihood of cognitive decline. This tool provides clinicians with a concise and quantifiable method to assess risk and tailor patient management strategies effectively.

Figure 3

3.5 Evaluation of the predictive nomogram

The predictive accuracy of our CSVD cognitive impairment nomogram was assessed using the area under the receiver operating characteristic (AUC-ROC) curve, with the training set demonstrating an AUC of 0.866 (95% CI: 0.823–0.909), and the validation set showing an AUC of 0.852 (95% CI: 0.781–0.923). These results indicate excellent discriminative ability across both datasets (Figures 4A,B). Calibration curves closely align with the ideal line in both training (Figure 5A) and validation (Figure 5B) sets, suggesting that the nomogram’s predicted probabilities of cognitive impairment are accurate. Decision curve analysis (DCA) for both datasets confirms the model’s clinical usefulness, with the net benefit substantially outweighing the treat-all or treat-none strategies (Figures 6A,B). In application, the nomogram showed high sensitivity and specificity, further evidencing its robustness. In the training set, the model exhibited a sensitivity of 75.3% and a specificity of 79.7% (Figure 4A). In contrast, in the validation set, the model showed a sensitivity of 76.9% and a specificity of 74.0% (Figure 4B). For the training set, the nomogram achieved a PPV of 87.32% and an NPV of 63.47%, and for the validation set, the PPV was 84.60% and NPV was 63.30%. These additional metrics further reinforce the nomogram’s strong and consistent performance, advocating its potential utility in clinical practice for risk stratification and management of CSVD-associated cognitive impairment.

Figure 4

Figure 5

Figure 6

4 Discussion

The development of our predictive model for cognitive impairment in CSVD is a significant stride in neurovascular research, bridging a gap in early diagnostic methodologies. By integrating a diverse range of variables-demographic, clinical, neuroimaging, and biomarkers-our study sheds new light on the intricate relationship between CSVD and cognitive decline. This approach not only enhances our understanding of CSVD’s impact on cognitive functions but also introduces a valuable tool for early detection and intervention, marking a crucial step forward in addressing this complex condition.

Our study contributes to the evolving landscape of CSVD research by presenting a comprehensive predictive model for cognitive impairment. This model integrates a wide array of variables, akin to the multifaceted approaches seen in recent literature. The deep learning approach of Duan et al. (14) in segmenting CSVD features on imaging contrasts with our model that combines clinical, biochemical, and imaging data for a more rounded prediction. Egle et al. (15) emphasized diffusion tensor imaging’s role in predicting dementia, a perspective that complements our model’s inclusion of imaging alongside other clinical variables. Our work resonates with the findings of Jiménez-Balado et al. (16) regarding the predictive value of blood pressure monitoring in CSVD. However, our approach is more comprehensive, encompassing a broader range of indicators. Similarly, while Li et al. (17) explored machine learning models for dementia prediction in CSVD, our study adds to this by leveraging both advanced statistical and machine learning techniques, emphasizing the integration of diverse data types. Furthermore, Liu et al. (9) highlighted the combination of Aβ42 levels and total CSVD scores in predicting cognitive impairment. Our model expands upon this by integrating these biomarkers into a broader predictive framework. Lastly, van Uden et al. (18) and Zhang et al. (10) focused on specific imaging and clinical parameters. Our research builds upon these studies by offering a more comprehensive model that incorporates their insights into a broader predictive framework. In summary, our study not only aligns with current research trends in CSVD but also extends them by providing a more holistic approach to the prediction of cognitive impairment. This comprehensive model could significantly enhance clinical decision-making and patient management in CSVD.

Age is acknowledged as a critical predictor for the progression of CSVD and associated cognitive impairments. The study by Hamilton et al. (19) corroborates this, demonstrating a significant correlation between the total burden of CSVD and a decline in cognitive abilities in the elderly. This finding not only validates the importance of age as a predictive factor but also underscores the heightened risk for cognitive health deterioration with advancing age. Hypertension is a primary contributor to the development of CSVD and subsequent cognitive decline. The research conducted by Amier et al. (20) revealed a substantial association between markers of hypertensive exposure, as evident in cardiovascular MRI, and both CSVD and cognitive impairments. Additionally, the study by Hainsworth et al. (21) accentuates the close link between hypertension and small vessel disease, aligning well with our findings and underscoring the necessity to consider hypertension’s role in clinical predictive models. The imaging burden of CSVD is significantly associated with declines in cognitive function. Hosoya et al. (22) observed an independent association between imaging markers of CSVD and reductions in global cognitive function and attention. Our research echoes this observation, highlighting the crucial role of CSVD imaging burden in predicting cognitive impairments. Our study further identifies ApoA1 as a novel negative predictor for cognitive impairment in CSVD, aligning with emerging research in neurodegenerative conditions. Studies by Choi et al. (23) and Slot et al. (24) reported similar associations between ApoA1 levels and cognitive decline, suggesting ApoA1’s potential role in amyloid-independent neurodegeneration. Moreover, research by Das et al. (25) and Deng et al. (26) underscore ApoA1’s neuroprotective effects in Parkinson’s disease, while Rao et al. (27) highlight the complex interaction between ApoA1 levels and genetic factors in cognitive impairment. These findings collectively corroborate our results, emphasizing ApoA1’s significance in diagnosing and treating CSVD-related cognitive impairment.

In our study, we have elucidated several pivotal findings that hold significant implications for understanding the development of cognitive impairment in the context of CSVD. Firstly, we have reaffirmed hypertension and advanced age as the principal risk factors for cognitive impairment in CSVD. Both factors exhibit a substantial association with an increased risk of cognitive impairment, underscoring the imperative need for clinicians to closely monitor cognitive functions in patients exhibiting these characteristics. Additionally, our model underscores the critical importance of the cumulative burden of CSVD-related lesions (CSVD burden) and serum levels of apolipoprotein A1 (ApoA1) in predicting cognitive function. These findings provide valuable clinical cues to assist physicians in identifying high-risk individuals and devising tailored management strategies.

The results of our investigation hold profound clinical utility. The predictive model we have developed, based on CSVD risk factors, serves as a valuable tool for the early identification of individuals at risk of developing cognitive impairment. This not only facilitates timely intervention and treatment but also has the potential to enhance the quality of life for affected individuals. Our model offers a personalized risk assessment tool that guides clinicians in formulating precise treatment plans, while also empowering patients with information about their individual risks. Despite the significant achievements of our study, several avenues for future research merit exploration. Firstly, we advocate for further research into the biomarkers of CSVD-related cognitive impairment to refine risk prediction. Furthermore, as neuroimaging and molecular biology techniques continue to advance, we encourage the integration of these advanced technologies into a more comprehensive predictive model for CSVD. Additionally, longitudinal studies with extended follow-up periods are warranted to gain deeper insights into the progression and trajectory of cognitive impairment in CSVD.

Our study is not without limitations. Firstly, its cross-sectional design precludes the establishment of causal relationships. Although our model demonstrates excellent predictive performance for CSVD-related cognitive impairment, further validation in larger multicenter cohorts is warranted. Additionally, the potential for selection bias may exist, as all participants were sourced from a single hospital. Despite the inclusion of a comprehensive array of clinical, biochemical, and imaging data, there may be other unexplored factors that influence the risk of cognitive impairment in CSVD. Moreover, the sample size of this study is relatively small. Future research should include a larger sample size to enhance the reliability and generalizability of the findings.

In summary, our study presents a comprehensive predictive model that holds significant promise in forecasting the risk of cognitive impairment in the context of CSVD. This model integrates clinical, biochemical, and imaging data, furnishing clinicians with a powerful tool to identify high-risk individuals and devise personalized management strategies. While limitations and avenues for future research exist, we believe that this study marks a pivotal advancement in the early diagnosis and intervention of CSVD-related cognitive impairment.

Statements

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Ethics statement

The studies involving humans were approved by the Ethics Committee of the Affiliated Hospital of Hebei University. The committee is affiliated with Hebei University, located in Baoding, China. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

NL: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing. YG: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Resources, Validation, Visualization, Writing – original draft, Writing – review & editing. L-tL: Conceptualization, Formal analysis, Methodology, Software, Supervision, Writing – review & editing. Y-dH: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Validation, Visualization, Writing – review & editing. LL: Investigation, Methodology, Validation, Writing – review & editing. NJ: Data curation, Software, Writing – review & editing. Y-jC: Formal analysis, Software, Writing – review & editing. Y-nM: Investigation, Methodology, Writing – review & editing. YJ: Conceptualization, Formal analysis, Investigation, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing.

Funding

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This research was supported by the Hospital fund of Affiliated Hospital of Hebei University, Grant/Award Number: 2022QC43 and Hebei Province Medical Science Research Project, Grant/Award Number: 20230200.

Acknowledgments

We extend our heartfelt gratitude to neuroimaging experts Yan Hou and Huan Zhou for their invaluable expertise and contributions to this study. Their insights and assistance were instrumental in the advancement of our research.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

  • 1.

    AzarpazhoohMRAvanACiprianoLEMunozDGSposatoLAHachinskiV. Concomitant vascular and neurodegenerative pathologies double the risk of dementia. Alzheimers Dement. (2018) 14:14856. doi: 10.1016/j.jalz.2017.07.755

  • 2.

    DebetteSSchillingSDuperronM-GLarssonSCMarkusHS. Clinical significance of magnetic resonance imaging markers of vascular brain injury: a systematic review and meta-analysis. JAMA Neurol. (2019) 76:8194. doi: 10.1001/jamaneurol.2018.3122

  • 3.

    PanYLiHWardlawJMWangY. A new dawn of preventing dementia by preventing cerebrovascular diseases. BMJ. (2020) 371:m3692. doi: 10.1136/bmj.m3692

  • 4.

    PantoniL. Cerebral small vessel disease: from pathogenesis and clinical characteristics to therapeutic challenges. Lancet Neurol. (2010) 9:689701. doi: 10.1016/S1474-4422(10)70104-6

  • 5.

    WardlawJMSmithCDichgansM. Mechanisms of sporadic cerebral small vessel disease: insights from neuroimaging. Lancet Neurol. (2013) 12:48397. doi: 10.1016/S1474-4422(13)70060-7

  • 6.

    WardlawJMSmithCDichgansM. Small vessel disease: mechanisms and clinical implications. Lancet Neurol. (2019) 18:68496. doi: 10.1016/S1474-4422(19)30079-1

  • 7.

    KapasiADeCarliCSchneiderJA. Impact of multiple pathologies on the threshold for clinically overt dementia. Acta Neuropathol. (2017) 134:17186. doi: 10.1007/s00401-017-1717-7

  • 8.

    DasASRegenhardtRWVernooijMWBlackerDCharidimouAViswanathanA. Asymptomatic cerebral small vessel disease: insights from population-based studies. J Stroke. (2019) 21:12138. doi: 10.5853/jos.2018.03608

  • 9.

    LiuJZhaoWGuiQZhangYGuoZLiuW. Addition of Aβ42 to total cerebral small vessel disease score improves the prediction for cognitive impairment in cerebral small vessel disease patients. Neuropsychiatr Dis Treat. (2021) 17:195201. doi: 10.2147/NDT.S289357

  • 10.

    ZhangLGaoFZhangYHuPYaoYZhangQet al. Analysis of risk factors for the development of cognitive dysfunction in patients with cerebral small vessel disease and the construction of a predictive model. Front Neurol. (2022) 13:944205. doi: 10.3389/fneur.2022.944205

  • 11.

    WardlawJMSmithEEBiesselsGJCordonnierCFazekasFFrayneRet al. Neuroimaging standards for research into small vessel disease and its contribution to ageing and neurodegeneration. Lancet Neurol. (2013) 12:82238. doi: 10.1016/S1474-4422(13)70124-8

  • 12.

    StaalsJMakinSDJDoubalFNDennisMSWardlawJM. Stroke subtype, vascular risk factors, and total MRI brain small-vessel disease burden. Neurology. (2014) 83:122834. doi: 10.1212/WNL.0000000000000837

  • 13.

    DueringMBiesselsGJBrodtmannAChenCCordonnierCde LeeuwFEet al. Neuroimaging standards for research into small vessel disease-advances since 2013. Lancet Neurol. (2023) 22:60218. doi: 10.1016/S1474-4422(23)00131-X

  • 14.

    DuanYYShanWLiuLYWangQWuZLiuPet al. Primary categorizing and masking cerebral small vessel disease based on “deep learning system”. Front Neuroinform. (2020) 14:17. doi: 10.3389/fninf.2020.00017

  • 15.

    EgleMHilalSTuladharAMPirpamerLHoferEDueringMet al. Prediction of dementia using diffusion tensor MRI measures: the OPTIMAL collaboration. J Neurol Neurosurg Psychiatry. (2022) 93:1423. doi: 10.1136/jnnp-2021-326571

  • 16.

    Jiménez-BaladoJRiba-LlenaIMaisterraOPizarroJPalasíAPujadasFet al. Ambulatory blood pressure levels in the prediction of progression of cerebral small vessel disease. J Am Geriatr Soc. (2020) 68:22329. doi: 10.1111/jgs.16568

  • 17.

    LiRHarshfieldELBellSBurkhartMTuladharAMHilalSet al. Predicting incident dementia in cerebral small vessel disease: comparison of machine learning and traditional statistical models. Cereb Circ Cogn Behav. (2023) 5:100179. doi: 10.1016/j.cccb.2023.100179

  • 18.

    van UdenIWMvan der HolstHMTuladharAMvan NordenAde LaatKFRutten-JacobsLCet al. White matter and hippocampal volume predict the risk of dementia in patients with cerebral small vessel disease: the RUN DMC study. J Alzheimers Dis. (2016) 49:86373. doi: 10.3233/JAD-150573

  • 19.

    HamiltonOKLCoxSROkelyJAConteFBalleriniLBastinMEet al. Cerebral small vessel disease burden and longitudinal cognitive decline from age 73 to 82: the Lothian Birth Cohort 1936. Transl Psychiatry. (2021) 11:376. doi: 10.1038/s41398-021-01495-4

  • 20.

    AmierRPMarcksNHooghiemstraAMNijveldtRvan BuchemMde RoosAet al. Hypertensive exposure markers by MRI in relation to cerebral small vessel disease and cognitive impairment. J Am Coll Cardiol Img. (2021) 14:17685. doi: 10.1016/j.jcmg.2020.06.040

  • 21.

    HainsworthAHMarkusHSSchneiderJA. Cerebral small vessel disease, hypertension, and vascular contributions to cognitive impairment and dementia. Hypertension. (2024) 81:7586. doi: 10.1161/HYPERTENSIONAHA.123.19943

  • 22.

    HosoyaMToiSSekiMSaitoMHoshinoTYoshizawaHet al. Association between total cerebral small vessel disease score and cognitive function in patients with vascular risk factors. Hypertens Res. (2023) 46:132634. doi: 10.1038/s41440-023-01244-8

  • 23.

    ChoiHJSeoEHYiDSohnBKChoeYMByunMSet al. Amyloid-independent amnestic mild cognitive impairment and serum apolipoprotein A1 levels. Am J Geriatr Psychiatry. (2016) 24:14453. doi: 10.1016/j.jagp.2015.06.004

  • 24.

    SlotRERvan HartenACKesterMIJongbloedWBouwmanFHTeunissenCEet al. Apolipoprotein A1 in cerebrospinal fluid and plasma and progression to Alzheimer’s disease in non-demented elderly. J Alzheimers Dis. (2017) 56:68797. doi: 10.3233/JAD-151068

  • 25.

    DasSCharanRSkrinakRTZhuYLeeMKumarS.et al. ApolipoproteinA1 has a protective role in the pathogenesis of Parkinson’s disease. Ann Neurol. (2022) 92:S1567. doi: 10.1002/ana.26484

  • 26.

    DengXSaffariSENgSYEChiaNTanJYChoiXet al. Blood lipid biomarkers in early Parkinson’s disease and Parkinson’s disease with mild cognitive impairment. J Parkinsons Dis. (2022) 12:193743. doi: 10.3233/JPD-213135

  • 27.

    RaoWZhangYLiKZhangXY. Association between cognitive impairment and apolipoprotein A1 or apolipoprotein B levels is regulated by apolipoprotein E variant rs429358 in patients with chronic schizophrenia. Aging. (2021) 13:1635366. doi: 10.18632/aging.203161

Summary

Keywords

cerebral small vessel disease, cognitive impairment, predictive modeling, LASSO regression, logistic regression, nomogram

Citation

Li N, Gao Y, Li L, Hu Y, Ling L, Jia N, Chen Y, Meng Y and Jiang Y (2024) Development and validation of a nomogram predictive model for cognitive impairment in cerebral small vessel disease: a comprehensive retrospective analysis. Front. Neurol. 15:1373306. doi: 10.3389/fneur.2024.1373306

Received

25 January 2024

Accepted

06 June 2024

Published

17 June 2024

Volume

15 - 2024

Edited by

Tarun Singh, University of Michigan, United States

Reviewed by

Cristiano Capurso, University of Foggia, Italy

Mengyang Wang, Capital Medical University, China

Updates

Copyright

*Correspondence: Ye Jiang,

†These authors have contributed equally to this work and share first authorship

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics