Skip to main content


Front. Neurol., 23 April 2018
Sec. Stroke

Impact of Lesion Load Thresholds on Alberta Stroke Program Early Computed Tomographic Score in Diffusion-Weighted Imaging

\r\nJulian Schrder*Julian Schröder1*Bastian ChengBastian Cheng1Caroline Malherbe,Caroline Malherbe1,2Martin Ebinger,Martin Ebinger3,4Martin KhrmannMartin Köhrmann5Ona WuOna Wu6Dong-Wha KangDong-Wha Kang7David S. LiebeskindDavid S. Liebeskind8Thomas TourdiasThomas Tourdias9Oliver C. SingerOliver C. Singer10Bruce CampbellBruce Campbell11Marie LubyMarie Luby12Steven WarachSteven Warach13Jens FiehlerJens Fiehler14Andr KemmlingAndré Kemmling15Jochen B. FiebachJochen B. Fiebach3Christian GerloffChristian Gerloff1Gtz Thomalla the STIRGötz Thomalla1 the STIRVISTA Imaging Investigators&#x;
VISTA Imaging Investigators
  • 1Klinik und Poliklinik für Neurologie, Kopf- und Neurozentrum, Universitätsklinikum Hamburg-Eppendorf, Hamburg, Germany
  • 2Institut für Computational Neuroscience, Universitätsklinikum Hamburg-Eppendorf, Hamburg, Germany
  • 3Centrum für Schlaganfallforschung Berlin, Charité – Universitätsmedizin Berlin, Berlin, Germany
  • 4Klinik für Neurologie, Charité – Universitätsmedizin Berlin, Berlin, Germany
  • 5Klinik für Neurologie, Universität Erlangen-Nürnberg, Erlangen, Germany
  • 6Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, United States
  • 7Department of Neurology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, South Korea
  • 8Neurovascular Imaging Research Core, Department of Neurology, University of California, Los Angeles, Los Angeles, CA, United States
  • 9Service de Neuroimagerie Diagnostique de Thérapeutique, Centre Hospitalier Universitaire de Bordeaux, Université de Bordeaux, Bordeaux, France
  • 10Klinik für Neurologie, Universitätsklinikum Frankfurt, Frankfurt, Germany
  • 11Department of Medicine and Neurology, Melbourne Brain Centre at the Royal Melbourne Hospital, University of Melbourne, Melbourne, VIC, Australia
  • 12National Institute of Neurological Disorders and Stroke (NINDS), National Institutes of Health (NIH), Bethesda, MD, United States
  • 13Department of Neurology, Dell Medical School, University of Texas at Austin, Austin, TX, United States
  • 14Klinik und Poliklinik für Neuroradiologische Diagnostik und Intervention, Universitätsklinikum Hamburg-Eppendorf, Hamburg, Germany
  • 15Institut für Neuroradiologie, Universitätsklinikum Schleswig-Holstein, Lübeck, Germany

Background and aims: Assessment of ischemic lesions on computed tomography or MRI diffusion-weighted imaging (DWI) using the Alberta Stroke Program Early Computed Tomography Score (ASPECTS) is widely used to guide acute stroke treatment. However, it has never been defined how many voxels need to be affected to label a DWI-ASPECTS region ischemic. We aimed to assess the effect of various lesion load thresholds on DWI-ASPECTS and compare this automated analysis with visual rating.

Materials and methods: We analyzed overlap of individual DWI lesions of 315 patients from the previously published predictive value of fluid-attenuated inversion recovery study with a probabilistic ASPECTS template derived from 221 CT images. We applied multiple lesion load thresholds per DWI-ASPECTS region (>0, >1, >10, and >20% in each DWI-ASPECTS region) to compute DWI-ASPECTS for each patient and compared the results to visual reading by an experienced stroke neurologist.

Results: By visual rating, median ASPECTS was 9, 84 patients had a DWI-ASPECTS score ≤7. Mean DWI lesion volume was 22.1 (±35) ml. In contrast, by use of >0, >1-, >10-, and >20%-thresholds, median DWI-ASPECTS was 1, 5, 8, and 10; 97.1% (306), 72.7% (229), 41% (129), and 25.7% (81) had DWI-ASPECTS ≤7, respectively. Overall agreement between automated assessment and visual rating was low for every threshold used (>0%: κw = 0.020 1%: κw = 0.151; 10%: κw = 0.386; 20% κw = 0.381). Agreement for dichotomized DWI-ASPECTS ranged from fair to substantial (≤7: >10% κ = 0.48; >20% κ = 0.45; ≤5: >10% κ = 0.528; and >20% κ = 0.695).

Conclusion: Overall agreement between automated and the standard used visual scoring is low regardless of the lesion load threshold used. However, dichotomized scoring achieved more comparable results. Varying lesion load thresholds had a critical impact on patient selection by ASPECTS. Of note, the relatively low lesion volume and lack of patients with large artery occlusion in our cohort may limit generalizability of these findings.

Introduction and Aims

The Alberta Stroke Program Early Computed Tomography Score (ASPECTS) is widely used in clinical practice to assess the extent of early ischemic changes on brain imaging for acute stroke treatment. Introduced for standardized evaluation of non-contrast computed tomography (CT) the ASPECTS template consists of 10 regions distributed throughout the middle cerebral artery (MCA) territory. For each affected region, the overall score is reduced by 1 from a score of 10 that indicates a normal scan. Originally, a threshold of ASPECTS ≤7 was proposed to identify patients at high risk for intracerebral hemorrhage and poor clinical outcome (1). The template was also applied to diffusion-weighted MRI (2, 3) and perfusion imaging on both CT and MRI (4).

Three of the recently published trials demonstrating efficacy of mechanical thrombectomy for treatment of acute stroke used ASPECTS to exclude patients presumed to have a large ischemic core. The ESCAPE trial excluded patients with ASPECTS <6 (5), the REVASCAT study used a cut-off of ASPECTS <7 (5) to exclude patients based on CT, and of ASPECTS <6 if diffusion-weighted imaging (DWI) was applied. SWIFT-PRIME used NCCT- or DWI-ASPECTS ≤5 as an exclusion threshold (6). Furthermore, interventional treatment was shown to be particularly effective in patients with ASPECTS 8–10 (5, 7). Additionally, clear benefit of endovascular stroke treatment was not observed in patients with a low ASPECTS value between 0 and 5 (8). Based on these results, and inclusion of an ASPECTS ≥6 threshold in the AHA guideline for endovascular thrombectomy (9), expansion of the use of ASPECTS in clinical practice is likely.

However, there are limitations to ASPECTS. Individual ASPECTS regions are not equally weighed, and correlation with stroke lesion volume is low in subcortical regions (10, 11). Latter limitations stem from definition and distribution of ASPECTS regions as well as from the fact that the exact dimensions of each region are rather vaguely defined. Moreover, although originally designed for use with non-contrast CT, ASPECTS is increasingly used to evaluate DWI (2, 3) which poses another challenge. DWI is highly sensitive in the detection of small, even punctuate, ischemic lesions (12). However, there is no guidance as to how many voxels on DWI must be lesioned to classify the region as being affected. As yet, there is no data on how visual rating of ASPECTS on DWI relates to the proportion of individual regions being affected.

In this study, we aimed to assess how different thresholds in quantitative evaluation of DWI-ASPECTS affect the overall score, and how quantitative analysis of DWI-ASPECTS compares to visual rating. For this purpose, we compared visual DWI-ASPECTS rating to different automated approaches based on the overlap of individual DWI lesions with a probabilistic ASPECTS template.


We analyzed data from the predictive value of fluid-attenuated inversion recovery (PRE-FLAIR) study database. PRE-FLAIR was a multicenter retrospective study of patients with acute ischemic stroke who underwent multiparametric MRI within 12 h of symptom onset (13). NCCT was not performed within PRE-FLAIR, thus a comparison to NCCT ASPECTS was not feasible with this dataset.

Predictive value of fluid-attenuated inversion recovery was conducted by an international consortium of researchers within the Stroke Imaging Repository (STIR) and Virtual International Stroke Trials Archive (VISTA) Imaging research groups. PRE-FLAIR included individual datasets from eight participating stroke centers and two studies (13). The study was approved by the local ethics committees at all centers. Either written or verbal informed consent was obtained for all patients, as required by local legislation. PRE-FLAIR was registered with, number NCT01021319 (13).

Demographic data, severity of neurological deficit on admission as assessed by National Institutes of Health Stroke Scale (NIHSS) were collected by individual centers. DWI-ASPECTS was rated by a neurologist with 7 years of experience in stroke imaging research and clinical application.

For the present analysis, we excluded patients with anterior or posterior cerebral artery infarction and bilateral ischemic lesions. Thus, we included only patients with unilateral MCA infarction. Furthermore, patients with insufficient image quality for processing and quantitative analysis were excluded.

A population-based probabilistic ASPECTS atlas was created based on 221 normal non-enhanced CT scans. All CT exams were performed according to the department’s standard protocol on a iCT 256™ scanner (Philips Healthcare, Best, The Netherlands): collimation 64 × 0.625, pitch 0.297, rotation time 0.4 s, FOV 270 mm, tube voltage 120 kV, tube current 300 mA, 4.0 mm slice reconstruction. ASPECTS regions (C, caudate; L, lentiform; IC, internal capsule; I, insular ribbon; M1, anterior MCA cortex, M2, MCA cortex lateral to insular ribbon, M3, posterior MCA cortex, M4, M5, and M6 are anterior, lateral, and posterior MCA territories immediately superior to M1, M2, and M3) were manually segmented on CT images by two raters using all slices covering the entire MCA territory (Analyze 11.0, Analyzedirect) (14). Binary ASPECTS maps based on each exam were then affine registered to standard Montreal Neurologic Institute (MNI) space with 12 degrees of freedom (FLIRT 5.5, FMRIB linear image registration tool) followed by non-linear refinement using a custom CT reference image (FNIRT 1.0, FMRIB non-linear image registration tool) (15).

Based on the individual binary ASPECTS region maps a probabilistic ASPECTS map was calculated. Each voxel within the ASPECTS map is thus characterized by its probability of belonging to any of the 10 ASPECTS regions. Please refer to the Datasheet S1 in Supplementary Material for further details.

Individual DWI lesions for each patient were segmented and lesion volumes calculated by a semiautomatic thresholding approach using an in-house developed software tool (AnToNIa) (16), as described previously (13). DWI lesions were manually surrounded with a generous safety margin at each affected slice. Intensity thresholding was applied to refine the defined lesion area. We retained all voxels that were part of the defined lesion area with a signal intensity exceeding the mean signal intensity of the unaffected hemisphere by more than two SDs and rejected all others.

The individual DWI maps and respective lesion masks were registered to MNI brain atlas space. All masks of individual DWI lesions were binarized (voxels with infarction had a value of 1, all others 0).

The overlap of each individual DWI lesion mask with each single ASPECTS region of the probabilistic template and the respective overlap volumes were calculated using imaging tools from the Functional MRI of the Brain Software Library (FMRIB Software Library;

By use of a probabilistic template, each voxel of the DWI lesion overlapping with an ASPECTS region was corrected for its probability of belonging to that respective region. Thus the resulting volume (of DWI lesion within an ASPECTS region) equals the overlap of a binarized lesion and template multiplied with the probability for the included voxels of belonging to any of the ASPECTS regions. Please refer to the Datasheet S1 in Supplementary Material for further details.

Based on the probabilistic volume of each ASPECTS region we calculated the percentage of lesioned tissue volume in each region, the relative lesion load (RLL) per ASPECTS region.

Therefore, RLL represents the share of infarction within a probabilistic ASPECTS region. For regions containing only healthy tissue the RLL would thus be 0%, for regions completely involved in the ischemic lesion RLL would be 100%.

Then multiple RLL thresholds (>0, >1, >10, and >20% of the respective ASPECTS region) were applied to define whether a region was considered affected. Overall scores were then calculated based on these results.

Median and interquartile range for all ASPECTS values and the agreement κ of visual ASPECTS with the automated assessment were computed. For overall scores weighted κ (κw) with linear weights for each ASPECTS level was used to account for the ordinal nature of the scale. The Mann–Whitney-U-test was used for comparison of means. For correlation analysis, Spearman’s rank correlation coefficient was calculated. Statistical analysis was performed using SPSS 23, weighted κ was calculated with STATA/SE 14.1.


Of the 496 patients with MCA infarction in the PRE-FLAIR database, 181 had to be excluded due to insufficient image quality for registration. Failure of the registration to MNI space accounted for most patients excluded. Thus, we included 315 patients in this study. Mean age was 66 (SD ± 16) years, 146 (46.3%) were female, mean NIHSS was 10 (±7, IQR 11, median 8). Mean DWI lesion volume was 22.1 (±35, IQR 24.7, median 7.3) ml. Data on stroke etiology as assessed by the Trial of Org 10172 in Acute Stroke Treatment classification was available for 256 patients [large artery sclerosis: 78 (24.8%), cardioembolism: 104 (33%), small-vessel occlusion: 15 (5.1%), stroke of other determined cause: 24 (7.6%), and stroke of undetermined cause: 34 (10.8%)].

Median ASPECTS by visual scoring was 9 (range 1–10), 84 (26.7%) patients had ASPECTS ≤7, 31 (9.8%) patients ASPECTS ≤5. The most frequently affected region on visual scoring was the insular ribbon (I) being affected in 53.7%, M4 was least frequently affected (7.6%). Table 1 shows the frequency of lesions for each individual ASPECTS region. Figure 1 illustrates infarct distribution among the 315 patients included in our analysis.


Table 1. Absolute numbers and percentage of all 315 patients with lesions in the respective Alberta Stroke Program Early Computed Tomography Score (ASPECTS) region using visual and automated scoring approaches.


Figure 1. Distribution of ischemic voxels in standard Montreal Neurologic Institute space for all patients studied, displayed as a heat map indicating the number of patients with ischemia in the respective voxel. Only patients with unilateral lesions were included in the study.

The combined volume of all regions of the probabilistic ASPECTS template in MNI space 371 ml. Volumes for subcortical regions were considerably smaller (C: 2.8 ml, IC: 6.7 ml, I: 13.6 ml, and L: 4.8 ml) than for cortical regions (M1: 83.6 ml, M2: 53.4 ml, M3: 52.5 ml, M4: 54.8 ml, M5: 73.9 ml, and M6: 53.4 ml).

Figure 2 displays the mean RLL for all regions, and separately shown the mean RLL for regions labeled positive by visual scoring only.


Figure 2. Mean relative lesion load (RLL) per ASPECTS region for all patients (black) and mean RLL for visually positive regions only (white).

The mean RLL for all ASPECTS regions was 7.7 ± 12.6%, median RLL was 0.9% (IQR 9.634%). For the subcortical regions (C, IC, I, and L), RLL was significantly higher than for the cortical regions (M1–M6): mean 11.4 ± 15.6 vs. 5.2 ± 9.5%, median 2.15 (IQR 20.2%) vs. 0.06% (IQR 5.6%) (p < 0.0001). The mean RLL for all regions rated visually positive was 19.5 ± 16.9%, median RLL for all regions rated visually positive was 15.4% (IQR 31.6%). Again subcortical regions had significantly higher overlap than cortical regions [mean 26.4 ± 17.7 vs. 13.9 ± 14%, median 28 (IQR 35.1%) vs. 8.7% (IQR 22.3%) p < 0.0001].

Table 1 lists the number and percentage of patients with lesions per ASPECTS region for the different thresholds. Figure 3 illustrates the distribution of overall ASPECTS scores for all rating approaches. Table 2 lists descriptive statistics for the distribution of ASPECTS values for the different analysis methods. Additionally, the number of patients below the established exclusion thresholds ≤7 and ≤5 for each rating strategy are listed in Table 2.


Figure 3. Distribution of Alberta Stroke Program Early Computed Tomography scores over the different relative lesion load (RLL) thresholds in automated rating; each bar represents the number of patients allotted the respective overall score; (A) visual rating; (B) automated rating using RLL thresholds.


Table 2. Median, minimum, maximum, interquartile range of Alberta Stroke Program Early Computed Tomography Score, number of patients below ≤7, and ≤5 thresholds values using different rating methods.

Agreement between visual scoring and the automated approach for calculation of total ASPECTS was low for all thresholds applied with κw ranging between 0.020 and 0.386. The agreement κ for the dichotomized score (≤7, ≤5) was better, ranging up to moderate or even substantial for >10 or >20% thresholds. Agreement was different for individual ASPECTS regions with poorest agreement for the internal capsule (IC) (mean agreement across all thresholds 0.005) and best agreement for the insula (I) (0.53) and the central MCA region (M2) (0.424). For a detailed list of κ and κw values over all ASPECTS regions and for thresholds used see Table 3.


Table 3. Agreement between visual and automated scoring for total Alberta Stroke Program Early Computed Tomography Score (ASPECTS) (κw), dichotomized for ≤7, and ≤5 thresholds and each ASPECTS region (κ).

There were significant negative correlations between ASPECTS and NIHSS for visual rating (r = −0.46, p < 0.0001) and automated rating for thresholds applied (>0: r = −0.59, p < 0.0001; ≥1%: r = −0.62, p < 0.0001; ≥10%: r = −0.62, p < 0.0001; ≥20%: r = −0.62, p < 0.0001).

ROC curves for dichotomized visual ASPECTS ≤7 and ≤5 and the threshold-based methods are shown in Figure 4.


Figure 4. ROC curves illustrating the performance of dichotomized Alberta Stroke Program Early Computed Tomography Score (ASPECTS) determined by automated rating approaches for prediction of the respective visual cut-off; (A) for ASPECTS ≤7, AUC was highest for the >10% relative lesion load (RLL) threshold with 0.781, 95% confidence interval of 0.723–0.839; (B) for ASPECTS ≤5, AUC was highest for the 10% RLL threshold with 0.901, 95% confidence interval of 0.845–0.956.


Alberta Stroke Program Early Computed Tomography Score is a widely used tool for assessment of acute stroke lesions on non-contrast or perfusion CT and DWI-MRI. Nevertheless, the usual visual method of rating is ultimately subjective and open questions remain, especially when MRI is used. For application to DWI lesions, clear instructions on how to calculate the score are lacking. We compared an automated quantitative analysis based on the overlap of the individual lesion mask and a probabilistic ASPECTS template with the usual visual analysis.

As a main result, we found low overall agreement between visual ASPECTS scoring and automated scoring no matter which threshold was used. We could not identify an RLL threshold that perfectly matches the visual rating. The average RLL of all visually positive regions was 19.5%. Still even the higher thresholds tested (>10 and >20%) yielded differing results for the individual regions with only fair overall agreement.

The different thresholds of automated ASPECTS computation resulted in largely different numbers of patients below the ASPECTS cut-offs that have been suggested to exclude patients from endovascular treatment, i.e., ASPECTS ≤7 or ≤5 (5, 7).

For the higher RLL thresholds (>10 and >20%) the dichotomized scoring showed at least moderate agreement with visual scoring with regards to ≤7 or ≤5 ASPECTS cut-offs. Thus, automated scoring with higher RLL thresholds appears to be close to visual rating, at least when aiming at dichotomized classification according to ASPECTS. However, our findings highlight the relevance of lesion load thresholds as they have a critical impact on patient selection by ASPECTS.

For the regions labeled affected by visual rating, mean RLL per ASPECTS region varied considerably. Mean RLL of subcortical regions was clearly higher than that of cortical regions. This may to a certain amount reflect the distribution of acute MCA infarction with highest frequency in the basal ganglia, IC, and insula. On the other hand, this imbalance matches with earlier findings describing an imbalance between cortical and subcortical ASPECTS regions (10). Visual rating and automated assessment agreement was worst for IC and superior cortical regions (M4, M5) similar to earlier findings (17). The disparity in agreement between regions further corroborates the hypothesis that ASPECTS regions are unequally weighed, i.e., the same overall score does not necessarily indicate the same lesion load.

Of note, assessment of overall interrater agreement for visual rating of dichotomized ASPECTS on CT and MRI has provided varying results (1, 14, 1719). In patient with large vessel occlusion, recent studies described slight to moderate agreement for NCCT ASPECTS (20) and slight agreement for DWI-ASPECTS (21) when raters from multiple specialties were evaluated.

It is unclear what kind of implicit threshold is applied for visual rating in every day clinical practice. There appears to be a common mechanism which might include implicit application of higher thresholds for certain regions, e.g., subcortical. There have been other attempts to establish an automated ASPECTS rating (22), which demonstrated a higher sensitivity of the automated approach compared to expert reading. This is at least partially in line with our findings of overall lower scores when using low RLL thresholds. Depending on the threshold applied less lesioned tissue per ASPECTS region was required for a “positive” evaluation on automated compared to visual rating. This could explain a higher sensitivity of automated approaches. Furthermore, software solutions may be suitable to overcome limitations stemming from low interrater reliability.

Overall visual rating seems to be an easily applicable, albeit blunt instrument compared to the meticulous voxel-wise automated approach, which in this case was only partially successful in replicating the visual assessment.


There are considerations that limit generalizability of our findings. Some of the issues mentioned above may be inherent to DWI due to its higher sensitivity for even small lesions and thus may not be applicable for ASPECTS on CT. However, an unequal weighing of different ASPECTS regions would also affect scoring on non-contrast CT or CT perfusion imaging (10).

The relatively low mean lesion volume in the sample studied may represent a further limitation to our study. Only a minority of the patients analyzed here presented with large artery occlusion; the sample may thus differ from a population in whom ASPECTS is applied to weigh benefit and risk of endovascular stroke treatment. To better reflect clinical reality, our results require confirmation in a sample of patients with emergent large artery occlusion only.


The results of our study add new insights to the research describing characteristics and limitations of the use of ASPECTS to evaluate acute stroke imaging. ASPECTS is clearly helpful to standardize assessment of infarct core in acute stroke treatment, for patient selection in clinical trials, as well as for guiding treatment decisions in clinical practice. Nevertheless, one should keep in mind the limitations of the scale, such as the unequal weighing of the different regions and the lack of a formal rule as to the when a region should be considered affected. This gets even more important when ASPECTS is used with imaging modalities more sensitive to acute ischemia than non-contrast CT, e.g., DWI or perfusion CT. Our results highlight the relevance of lesion load thresholds as they have a critical impact on the number of patients excluded by ASPECTS cut-offs. The lack of patients with large artery occlusion and low mean lesion volume in this cohort represent relevant limitations.

Finally, these limitations may be of clinical relevance when ASPECTS cut-off values are used to exclude patients from clinical trials or treatment in clinical practice, e.g., mechanical thrombectomy. The REVASCAT trial already attempted to account for this by defining different ASPECTS cut-offs for CT and DWI (6). Further clarification of rating procedures may be necessary to facilitate reliable transfer of cut-offs between different imaging modalities and rating strategies.

Ethics Statement

This study was carried out in accordance with the recommendations of Ethik-Kommission der Ärztekammer Hamburg, Germany. The protocol was approved by the Ethik-Kommission der Ärztekammer Hamburg. All subjects gave written informed consent in accordance with the Declaration of Helsinki. PRE-FLAIR was conducted by an international consortium of researchers within the Stroke Imaging Repository (STIR) and Virtual International Stroke Trials Archive (VISTA) Imaging research groups. PRE-FLAIR included individual datasets from eight participating stroke centers and two studies. The study was approved by the local ethics committees at all centers. Either written or verbal informed consent was obtained for all patients as required by local legislation.

Author Contributions

JS, BC, CM, ME, MK, OW, D-WK, DL, TT, OS, BC, ML, SW, JF, AK, JBF, CG, and GT all contributed to data collection, drafting, and revising of the manuscript. JS, BC, CM, GT, and AK conducted data analysis.

Conflict of Interest Statement

JBF has received fees as a board member, consultant, or lecturer from Boehringer Ingelheim, Lundbeck, Siemens, Sygnis, and Synarc. CG has received fees as a consultant or lecture fees from Bayer Vital, Boehringer Ingelheim, EBS technologies, Glaxo Smith Kline, Lundbeck, Pfizer, Sanofi Aventis, Silk Road Medical, and UCB. DL has received consultant fees for Imaging Core Laboratory for Stryker and Medtronic. TT has received a national grant from the French Government (PHRC). OW was supported in part by grants from the National Institutes of Health (R01NS059775, P50NS051343, R01NS063925), received consulting fees from Penumbra Inc., and received royalties from General Electric, Olea, and Imaging Biometrics. GT, BC, BC, CM, AK, SC, ME, JF, D-WK, MK, ML, JS, OS, and SW have no conflicts of interest to report.


STIR and VISTA Imaging steering committee members: SW (chair), Gregory Albers, Stephen Davis, Geoffrey Donnan, Marc Fisher, Anthony Furlan, James Grotta, Werner Hacke, D-WK, Chelsea Kidwell, Walter Koroshetz, Kennedy R. Lees, Michael Lev, DL, A Gregory Sorensen, Vincent Thijs, Götz Thomalla, Joanna Wardlaw, and Max Wintermark. PRE-FLAIR investigators: GT, BC, ME, Qing Hao, TT, OW, Jong S Kim, Lorenz Breuer, OS, ML, SW, Soren Christensen, Andras Treszl, Nils D. Forkert, Ivana Galinovic, Michael Rosenkranz, Tobias Engelhorn, MK, Matthias Endres, D-WK, Vincent Dousset, A. Gregory Sorensen, DL, JF, JF, and CG. Pre-Flair, and the efforts that led to it, were supported by the Stroke Imaging Repository (STIR) research group including National Institute of Neurological Disorders and Stroke (NINDS) and Department of Neurology, Dell Medical School, University of Texas at Austin.


PRE-FLAIR received funding from the Else Kröner-Fresenius-Stiftung (2009_A36). Funding was provided for central data collection and analysis; there was no funding for inclusion of patients. We thank the EPITHET (Echoplanar Imaging Thrombolysis Evaluation Trial) investigators, the University of California, Los Angeles Stroke investigators, all co-investigators of VIRAGE, and all our colleagues from the Departments of Neurology and Neuroradiology, and medical and technical staff in the participating centers for their support. In Berlin, data were collected within the 1,000+ study, which has received funding from the Federal Ministry of Education and Research via the grant Center for Stroke Research Berlin (01 EO 0801). PRE-FLAIR was further supported by the European Union Seventh Framework Program grant agreement No 202213 and No 223153 (European Stroke Network), the Volkswagen Foundation, and the Deutsche Forschungsgemeinschaft. EPITHET was funded by the National Health and Medical Research Council (Australia), the National Stroke Foundation (Australia), and the Heart Foundation of Australia. VIRAGE is supported by French national grant PHRC. This work was supported by Seton/UT Southwestern Clinical Research Institute of Austin, Department of Neurology and Neurotherapeutics, UT Southwestern Medical Center, Austin, TX, USA, and the National Institute of Neurological Disorders and Stroke (NINDS), Bethesda, MD, USA.

Supplementary Material

The Supplementary Material for this article can be found online at


1. Barber PA, Demchuk AM, Zhang J, Buchan AM. Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. Lancet (2000) 355:1670–4. doi:10.1016/S0140-6736(00)02237-6

CrossRef Full Text | Google Scholar

2. Barber PA, Hill MD, Eliasziw M, Demchuk AM, Pexman JHW, Hudon ME, et al. Imaging of the brain in acute ischaemic stroke: comparison of computed tomography and magnetic resonance diffusion-weighted imaging. J Neurol Neurosurg Psychiatry (2005) 76:1528–33. doi:10.1136/jnnp.2004.059261

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Mitomi M, Kimura K, Aoki J, Iguchi Y. Comparison of CT and DWI findings in ischemic stroke patients within 3 hours of onset. J Stroke Cerebrovasc Dis (2014) 23:37–42. doi:10.1016/j.jstrokecerebrovasdis.2012.08.014

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Aviv RI, Mandelcorn J, Chakraborty S, Gladstone D, Malham S, Tomlinson G, et al. Alberta stroke program early CT scoring of CT perfusion in early stroke visualization and assessment. Am J Neuroradiol (2007) 28:1975–80. doi:10.3174/ajnr.A0689

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Goyal M, Demchuk AM, Menon BK, Eesa M, Rempel JL, Thornton J, et al. Randomized assessment of rapid endovascular treatment of ischemic stroke. N Engl J Med (2015) 372:1019–30. doi:10.1056/NEJMoa1414905

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Saver JL, Goyal M, Bonafe A, Diener H-C, Levy EI, Pereira VM, et al. Stent-retriever thrombectomy after intravenous t-PA vs. t-PA alone in stroke. N Engl J Med (2015) 372:2285–95. doi:10.1056/NEJMoa1415061

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Jovin TG, Chamorro A, Cobo E, de Miquel MA, Molina CA, Rovira A, et al. Thrombectomy within 8 hours after symptom onset in ischemic stroke. N Engl J Med (2015) 372:1–11. doi:10.1056/NEJMoa1503780

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Goyal M, Menon BK, van Zwam WH, Dippel DWJ, Mitchell PJ, Demchuk AM, et al. Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trials. Lancet (2016) 387(10029):1723–31. doi:10.1016/S0140-6736(16)00163-X

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Powers WJ, Derdeyn CP, Biller J, Coffey CS, Hoh BL, Jauch EC, et al. 2015 American Heart Association/American Stroke Association focused update of the 2013 guidelines for the early management of patients with acute ischemic stroke regarding endovascular treatment: a guideline for healthcare professionals from the American. Stroke (2015) 46:3020–35. doi:10.1161/STR.0000000000000074

CrossRef Full Text | Google Scholar

10. Phan TG, Donnan G, Koga M, Mitchell LA, Molan M, Fitt G, et al. The ASPECTS template is weighted in favor of the striatocapsular region. Neuroimage (2006) 31:477–81. doi:10.1016/j.neuroimage.2005.12.059

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Schröder J, Cheng B, Ebinger M, Köhrmann M, Wu O, Kang DW, et al. Validity of acute stroke lesion volume estimation by diffusion-weighted imaging-Alberta stroke program early computed tomographic score depends on lesion location in 496 patients with middle cerebral artery stroke. Stroke (2014) 45:3583–8. doi:10.1161/STROKEAHA.114.006694

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Saur D, Kucinski T, Grzyska U, Eckert B, Eggers C, Niesen W, et al. Sensitivity and interrater agreement of CT and diffusion-weighted MR imaging in hyperacute stroke. Am J Neuroradiol (2003) 24:878–85.

PubMed Abstract | Google Scholar

13. Thomalla G, Cheng B, Ebinger M, Hao Q, Tourdias T, Wu O, et al. DWI-FLAIR mismatch for the identification of patients with acute ischaemic stroke within 4⋅5 h of symptom onset (PRE-FLAIR): a multicentre observational study. Lancet Neurol (2011) 10:978–86. doi:10.1016/S1474-4422(11)70192-2

CrossRef Full Text | Google Scholar

14. Pexman JHW, Barber PA, Hill MD, Sevick RJ, Demchuk AM, Hudon ME, et al. Use of the Alberta stroke program early CT score (ASPECTS) for assessing CT scans in patients with acute stroke. Am J Neuroradiol (2001) 22:1534–42.

PubMed Abstract | Google Scholar

15. Kemmling A, Wersching H, Berger K, Knecht S, Groden C, Nölte I. Decomposing the Hounsfield unit: probabilistic segmentation of brain tissue in computed tomography. Clin Neuroradiol (2012) 22:79–91. doi:10.1007/s00062-011-0123-0

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Forkert ND, Cheng B, Kemmling A, Thomalla G, Fiehler J. ANTONIA perfusion and stroke: a software tool for the multi-purpose analysis of MR perfusion-weighted datasets and quantitative ischemic stroke assessment. Methods Inf Med (2014) 53:469–81. doi:10.3414/ME14-01-0007

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Gupta AC, Schaefer PW, Chaudhry ZA, Leslie-Mazwi TM, Chandra RV, González RG, et al. Interobserver reliability of baseline noncontrast CT Alberta stroke program early CT score for intra-arterial stroke treatment selection. Am J Neuroradiol (2012) 33:1046–9. doi:10.3174/ajnr.A2942

PubMed Abstract | CrossRef Full Text | Google Scholar

18. McTaggart RA, Jovin TG, Lansberg MG, Mlynash M, Jayaraman MV, Choudhri OA, et al. Alberta stroke program early computed tomographic scoring performance in a series of patients undergoing computed tomography and MRI: reader agreement, modality agreement, and outcome prediction. Stroke (2015) 46:407–12. doi:10.1161/STROKEAHA.114.006564

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Mak HKF, Yau KKW, Khong PL, Ching ASC, Cheng PW, Au-Yeung PKM, et al. Hypodensity of >1/3 middle cerebral artery territory versus Alberta sroke programme early CT score (ASPECTS): comparison of two methods of quantitative evaluation of early CT changes in hyperacute ischemic stroke in the community setting. Stroke (2003) 34:1194–6. doi:10.1161/01.STR.0000069162.64966.71

CrossRef Full Text | Google Scholar

20. Farzin B, Fahed R, Guilbert F, Poppe AY, Daneault N, Durocher AP, et al. Early CT changes in patients admitted for thrombectomy: intrarater and interrater agreement. Neurology (2016) 87:249–56. doi:10.1212/WNL.0000000000002860

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Fahed R, Lecler A, Sabben C, Khoury N, Ducroux C, Chalumeau V, et al. DWI-ASPECTS (diffusion-weighted imaging–Alberta stroke program early computed tomography scores) and DWI-FLAIR (diffusion-weighted imaging–fluid attenuated inversion recovery) mismatch in thrombectomy candidates. Stroke (2018) 49:223–7. doi:10.1161/STROKEAHA.117.019508

CrossRef Full Text | Google Scholar

22. Herweh C, Ringleb PA, Rauch G, Gerry S, Behrens L, Möhlenbruch M, et al. Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patients. Int J Stroke (2016) 11:438–45. doi:10.1177/1747493016632244

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: stroke, acute stroke treatment, computed tomography, magnetic resonance imaging, Alberta stroke program early computed tomography score

Citation: Schröder J, Cheng B, Malherbe C, Ebinger M, Köhrmann M, Wu O, Kang D-W, Liebeskind DS, Tourdias T, Singer OC, Campbell B, Luby M, Warach S, Fiehler J, Kemmling A, Fiebach JB, Gerloff C and Thomalla G (2018) Impact of Lesion Load Thresholds on Alberta Stroke Program Early Computed Tomographic Score in Diffusion-Weighted Imaging. Front. Neurol. 9:273. doi: 10.3389/fneur.2018.00273

Received: 24 February 2018; Accepted: 06 April 2018;
Published: 23 April 2018

Edited by:

Jean-Marc Olivot, Center Hospitalier Universitaire (CHU) de Toulouse, France

Reviewed by:

Robert Fahed, Fondation Ophtalmologique Adolphe de Rothschild, France
Nishant K. Mishra, Tulane University, United States

Copyright: © 2018 Schröder, Cheng, Malherbe, Ebinger, Köhrmann, Wu, Kang, Liebeskind, Tourdias, Singer, Campbell, Luby, Warach, Fiehler, Kemmling, Fiebach, Gerloff and Thomalla. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Julian Schröder,

Membership of the STIR and VISTA Imaging Investigators Consortium is provided in the Acknowledgments.

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.