ORIGINAL RESEARCH article

Front. Neurol., 12 September 2022

Sec. Neurological Biomarkers

Volume 13 - 2022 | https://doi.org/10.3389/fneur.2022.919596

Oculomotor, vestibular, reaction time, and cognitive tests as objective measures of neural deficits in patients post COVID-19 infection

  • 1. Neurology Department, Allegheny Health Network, Pittsburgh, PA, United States

  • 2. Neurology Department at Clinical Hospital of Medical School of University of Sáo Paulo, Sáo Paulo, Brazil

  • 3. Medical Department of Athletes Union of Sáo Paulo, Sáo Paulo, Brazil

  • 4. Neurolign USA LLC, A Subsidiary of Neurolign Technologies Inc., Pittsburgh, PA, United States

Abstract

Objective:

An alarming proportion (>30%) of patients affected by SARS-CoV-2 (COVID-19) continue to experience neurological symptoms, including headache, dizziness, smell and/or taste abnormalities, and impaired consciousness (brain fog), after recovery from the acute infection. These symptoms are self-reported and vary from patient to patient, making it difficult to accurately diagnose and initiate a proper treatment course. Objective measures to identify and quantify neural deficits underlying the symptom profiles are lacking. This study tested the hypothesis that oculomotor, vestibular, reaction time, and cognitive (OVRT-C) testing using eye-tracking can objectively identify and measure functional neural deficits post COVID-19 infection.

Methods:

Subjects diagnosed with COVID-19 (n = 77) were tested post-infection with a battery of 20 OVRT-C tests delivered on a portable eye-tracking device (Neurolign Dx100). Data from 14 tests were compared to previously collected normative data from subjects with similar demographics. Post-COVID subjects were also administered the Neurobehavioral Symptom Inventory (NSI) for symptom evaluation.

Results:

A significant percentage of post COVID-19 patients (up to 86%) scored outside the norms in 12 out of 14 tests, with smooth pursuit and optokinetic responses being most severely affected. A multivariate model constructed using stepwise logistic regression identified 6 metrics as significant indicators of post-COVID patients. The area under the receiver operating characteristic curve (AUC) was 0.89, the estimated specificity was 98% (with cutoff value of 0.5) and the sensitivity was 88%. There were moderate but significant correlations between NSI domain key variables and OVRT-C tests.

Conclusions:

This study demonstrates the feasibility of OVRT-C testing to provide objective measures of neural deficits in people recovering from COVID-19 infection. Such testing may serve as an efficient tool for identifying hidden neurological deficits post COVID-19, screening patients at risk of developing long COVID, and may help guide rehabilitation and treatment strategies.

Introduction

Two years into the global SARS-CoV-2 (COVID-19) pandemic, researchers and clinicians have been confronted with the long-term effects of the infection. Consistent with other coronaviruses, there is growing evidence the virus can cause damage to the central nervous system in addition to its well-known respiratory complications [(1, 2), see (3) and (4) for reviews]. This evidence became apparent early in the pandemic when clinicians worldwide reported neurological symptoms in a high proportion of infected patients; for example, up to 80% of hospitalized patients experience neurological manifestations at some point during disease progression (5, 6). Headache, dizziness, smell and/or taste abnormalities, and impaired consciousness (or “brain fog”) are the most reported neurological symptoms of COVID-19 (7).

These symptoms may be consequences of glial and neural cells in the nervous system expressing angiotensin converting enzyme-2 (ACE-2) receptors, through which the virus enters the body, rendering the brain directly vulnerable to the virus during infection (8, 9). Indeed, viral proteins and RNA have been found in the central nervous system (CNS) of deceased patients at autopsy, in additional to neuropathological findings such as notable inflammation of the brainsteam and damage to the medulla [(10, 11); but see (12) for cases of neuropathological findings in deceased patients with no viral RNA in cortical tissue]. COVID-19 infection can also affect the brain indirectly by causing encephalitis, thrombosis, stroke, coma, and/or hypoxia (6, 1315). An emerging theme across multiple studies is that immune system hyperactivation may underly much of COVID-19's neurological effects [see (3) and (16) for reviews].

Data have shown that adverse neurological symptoms persist in a significant proportion of patients following recovery, a condition colloquially referred to as “long COVID” and categorized under names such as “post-acute sequelae of COVID-19 syndrome (PASC),” among others. Some reports put the incidence of PASC at approximately one third of infected patients (1719). In patients that did not require hospitalization, the estimates range from 10–35%; however, in patients that required hospitalization that estimate rises to approximately 85% (20). In one study, the most common enduring symptoms included fatigue, headache, dyspnea, and anosmia (21). Another survey of 3,762 patients, taken 28 days to several months after presumed or confirmed COVID-19 infection, verified these symptoms but also revealed cognitive impairment, memory loss, sleep disruption, and dizziness/vertigo/balance issues as frequent neuropsychiatric symptoms (22).

Much like acute COVID-19 infection, these neurological symptoms of PASC are highly variable among patients, presenting a challenge for precise classification of long COVID as a specific disorder. Additionally, it is possible that neurological damage caused by COVID-19 infection may manifest in subtler neurological deficits of which patients may be unaware. Indeed, as a group, even recovered patients reporting no ongoing COVID-19 symptoms have significant cognitive deficits when compared to healthy controls (23).

As with other fatigue-related syndromes that are identified primarily by patient self-report of symptoms (e.g., chronic fatigue syndrome), objective measures add valuable quantification that otherwise very important symptom profiles lack. To address the need for such measures in COVID-19 survivors, we investigated how recovered patients perform on a comprehensive battery of oculomotor, vestibular, reaction time, and cognitive (OVRT-C) tests, as assessed by high-resolution video oculography (VOG). OVRT-C test metrics are quantifiable and objective proxies and biomarkers of neural function that have been used or investigated in patients with neurological damage due to injury or disease. For example, OVRT-C-based classification models can reliably identify concussion in high school athletes (24), and similar methods have shown promising results in adults with concussion (25). Abnormal oculomotor behaviors have also been proposed as potential biomarkers for several diseases, such as impaired convergence in Parkinson's disease (26), visual paired comparison task performance in patients with mild cognitive impairment (MCI); (27), atypical saccades in preclinical and early-stage Huntington's disease (28, 29), and multiple oculomotor deficits in multiple sclerosis [see (30) for review]. Therefore, OVRT-C testing using eye-tracking technology provides a unique tool to assess overall neural function, while objectively homing in on specific abnormalities that may be affected by COVID-19 infection.

Two recent studies tested the hypotheses that traditional oculomotor and vestibular tests, respectively, can identify neurological abnormalities in recovered COVID-19 (post-COVID) patients. Results of an eye-tracking study suggested that 9 COVID-19-recovered patients exhibited abnormal latency for centrally directed saccades, impaired memory-guided saccades, and increased latencies for antisaccades (31). In the second study, recovered patients had more asymmetries in their vestibular responses, particularly in ocular and cervical vestibular myogenic evoked potentials (oVEMP and cVEMP), and showed a low gain in the video head impulse test (vHIT), suggesting the audio-vestibular system can be damaged, at least temporarily, by COVID-19 infection (32). These reports are consistent with a longitudinal study that detected brain structure changes in previously infected patients compared to controls, including tissue damage in areas associated with the primary olfactory cortex and a greater decrease in overall brain size (33).

In this study we extended these findings, adding measures of pursuit tracking, vergence, optokinetic nystagmus, gaze stability, and reaction time to the investigation of VOG performance in recovered COVID-19 patients. We administered a battery of OVRT-C tests to 77 COVID-19 patients following their recovery from the acute infection stage of the illness. These tests allowed us to identify specific OVRT-C metrics—and the overall pattern of deficits—that are uniquely characteristic to post-COVID patients. During their visit, participants also completed the Neurobehavioral Symptom Inventory (NSI) to assess their current neurological symptoms, and to determine whether any of these symptoms were associated with specific OVRT-C metrics.

Materials and methods

Participants

All research activities were conducted according to the principles expressed in the Declaration of Helsinki and were approved by the Institutional Review Boards (IRB) at the sites where research was performed. Participants were 77 adults aged 18–45 years of age (see demographics in Table 1) from three groups recruited from three testing sites: (a) Allegheny Health Network, Pittsburgh, PA, USA (IRB#2020-367), n = 20; (b) University of São Paulo School of Medicine, São Paulo, Brazil, n = 19 and (c) São Paulo School Athletes Union, Brazil n = 38 (IRB#33787520.4.0000.0068). Subjects tested at the São Paulo School Athletes Union were primarily amateur and professional athletes (n = 38; Cohort 2), while subjects from the Allegheny Health Network and University of São Paulo School of Medicine were patients with no specific athletic categorization (n = 39; Cohort 1).

Table 1

Testing sitesParticipantsNMean ageSex
(years ±SD)(M/F)
post-COVID
Allegheny Health Network, Pittsburgh, PANon-athlete2035.9 ± 6.369/11
University of São Paulo School of Medicine, BrazilNon-athlete1937.3 ± 11.859/10
São Paulo School Athletes Union, BrazilAthletes3829.7 ± 10.1523/15
Total7732.4 ± 9.7240/37
Normative data
Naval Medical Center San Diego, San Diego, CACivilians/Military4828.0 ± 6.1934/14
Madigan Army Medical Center, Fort Lewis, W-tonCivilians/Military25227.3 ± 6.30172/81
Total30027.4 ± 6.28205/95

Demographics of included participants at each testing site and overall.

M, male; F, female; SD, standard deviation; N, number of participants. Post-COVID patients were divided into two cohorts. Cohort 1 consisted of non-athletes (AHN and USP testing sites), while Cohort 2 came from the SPSAU site, where primarily professional and amateur athletes were tested. AHN, Allegheny Health Network, Pittsburgh, PA. USP, University of São Paulo School of Medicine, São Paulo, Brazil. SPSAU, São Paulo School Athletes Union, São Paulo, Brazil. The normative data participants were tested at two sites, and were representative of a healthy population, collected prior to the COVID-19 pandemic.

All participants reported having been diagnosed with and recovered from the acute COVID-19 infection but experienced persistent and function-impairing symptoms at least 4 weeks after initial infection. None of the subjects reported being hospitalized due to their COVID-19 infection. Each participant gave informed consent prior to testing. Exclusion criteria included those conditions and/or diseases that could influence the oculomotor or vestibular systems (e.g., a history of brain injury, vestibular disorders, blurred vision, or seizures). Special populations including children under 18 years of age, pregnant women, and individuals with diminished capacity (e.g., intellectual disability, dementia) were also excluded from this study. All three sites utilized the same inclusion/exclusion criteria, which are described in Table 2.

Table 2

Inclusion criteriaAdults males and females aged 18–45 who have tested positive for SARS-CoV-2 and since recovered.
Exclusion criteria1. Pregnancy, as documented by Last Menstrual Period at study visits. Pregnancy is exclusionary because rapid movements are not recommended for pregnant women, and the device will not be intended for use in pregnancy.
2. Brain injury: a. resulting from a penetrating wound to the head, neck, face or brain (to include gunshot wounds) b. Persons with a previous history of multiple mTBIs in the past. 3. Implants: persons implanted with an electrical and/or neurostimulator device, including but not limited to cardiac pacemaker, defibrillator, vagal neurostimulator, deep brain stimulator, spinal stimulator, bone growth stimulator, or cochlear implant, metal cervical spine hardware. 4. Repeated history of syncope. 5. Presence of severe aphasia. 6. History of chronic vestibular diseases (including Ménière's disease, acute labyrinthitis, vestibular migraine, vestibular neuritis, vestibular schwannoma, sudden sensorineural hearing loss), vestibular dysfunction, previous episode of acute unilateral vestibulopathy or prolonged vertigo. 7. History of prior acute central vestibular lesion. 8. History of prior acute central vestibular lesion. 9. Acute or chronic disease of middle ear (infections, otitis). 10. Past or concomitant treatment with ototoxic chemotherapy. 11. Past history of seizures or convulsions. 12. History of neuropsychiatric disorders antedating the head injury (e.g., hypochondriasis, major depression, schizophrenia). 13. Diagnosed with a learning disability, attention deficit hyperactivity disorder (ADHD), or other neurocognitive or neurobehavioral disorder of childhood (e.g., autism spectrum disorder, major depression, bipolar disorders). 14. Documented neurodegenerative disorders (Multiple sclerosis, Parkinson's, Alzheimer's, Huntington). 15. Neurological disorders including stroke, brainstem or cerebellar dysfunction within the last 3 months. 16. Cerebrovascular disorders. 17. Systemic disorders: e.g., chronic renal failure, cirrhosis of the liver, diabetes, hypertension etc. Version: March 22, 2021 vii. 18. Previous contraindicating surgeries at the discretion of the study physicians or audiologists. 19. Aminoglycosides in the past 6 months given via systemic or transtympanic administration.
20. Concomitant treatment with any of the followings within the last 24 h prior to testing if more than 2 doses have been taken: a. Antihistamines: e.g., diphenhydramine, cyclizine, dimenhydrinate, meclizine, hydroxyzine, promethazine, b. For ADHD and narcolepsy: e.g., Concerta, Daytrana, Methylin, Ritalin, Ritalin LA, Metadate ER, Aptensio XR, Cotempla XR-ODT, QuilliChew ER, and Quillivant XR c. For schizophrenia and other mental diseases: e.g., Phenothiazines d. Specific antibiotics: e.g., ethambutol, gentamycin e. Anticonvulsant medications: e.g., topiramate. 21. Currently suffering from dehydration. 22. History or suspicion of substance abuse or addiction.

Inclusion and exclusion criteria.

For the control population we used previously collected and published data (34, 35).

Battery of tests

Subjects were administered a battery of 20 OVRT-C tests (see Table 3 for a list of tests with output metrics and length for each test). Of these, the Gaze Horizontal, Spontaneous Nystagmus, Subjective Visual Vertical, and Subjective Visual Horizontal tests assess vestibular function. All stimuli were presented at high contrast on a neutral background with no distracting patterns. Tests were presented consecutively and ranged from 7 to 90 seconds in duration, for a total testing time of approximately 15 min. Subjects were seated comfortably adjacent to the test administrator throughout testing and their heads were not stabilized.

Table 3

Tests and parametersMetrics measured for each testTest length (sec)
1Auditory Reaction Time (ART): 20–25 sound stimuli are presented with a random timing. The subject is directed to signal their recognition by pressing a button.Latency (msec) = time difference from stimulus presentation until button is pressed15
2Visual Reaction Time (VRT): 20–25 light stimuli are presented in the center of the screen, with a random timing. The subject is directed to signal their recognition by pressing a button.Latency (msec) = time difference from stimulus presentation until button is pressed15
3Subjective Visual-Vertical (SVV): subject is presented with a non-vertical line and by using the left and right buttons on the handheld control box, orient the line to the vertical (upright) position, and then press the accept button on the control box.Mean error (deg) = difference between subject's orientation angle and true vertical. Data are presented as a mean of errors of all measurements.15
4Self-Paced Saccade (SPS): subject is required to do saccades between two dots for 20–30 s.a) Number of saccades = how many saccades are performed during the test time21
b) Eye velocity consistency – eye velocity for left/right eye during tests; measures consistency and fatigue
c) Interval consistency between saccades – time between the saccades; measures consistency and fatigue
5Saccade and Reaction Time (SRT): 30 visual saccadic stimuli are randomly projected every 1 to 2 s with a displacement of −30 to + 30 degrees. The subjects are directed to gaze at the red dot (saccadic stimulus) and then press either the left or right button to record whether the stimulus was projected to the right or to the left.a) Latency (s)45
b) Accuracy (%)
c) Final Accuracy (%)
Motor reaction time variables:
d) Latency means (s) – for Left Button = time difference from stimulus presentation until the left button is pressed
Latency means (s) – for Right Button= time difference from stimulus presentation until the right button is pressed.
6Saccade-Random, Horizontal (SH): subject follows a dot displayed 30 times at pseudo-randomly distributed times (between 1 to 2 s) and pseudo-random displacements on either a horizontal plane (−30 to +30 degrees).a) Latency (s) = time from stimulus presentation until a saccade is initiated. Data are presented as an average of all saccade onset latencies.22
b) Accuracy (%) = difference between eye position and stimulus position for the main saccade, expressed in percentage relative to stimulus position. Data are presented as an average of all main saccade accuracies.
c) Final Accuracy (%) = difference between eye position and stimulus position for the final position, including corrective saccades, expressed in percentage relative to stimulus position. Data are presented as an average of all saccade accuracies.
d) Area Under Main Sequence Fit (AUF) (deg2/sec). Eye velocity is plotted as a function of saccade displacement and fitted with an exponential function. To evaluate the overall velocity and amplitude relationship, the software computes the area under the curve, out to 30 degrees of eye displacement = AUF.
e) Peak velocity = eye velocity corresponding to each eye displacement in response to a stimulus displacement
7Saccade-Random, Vertical (SV): subject follows a dot displayed 30 times at pseudo-randomly distributed times (between 1 to 2 s) and pseudo-random displacements on either a vertical plane (−20 to +20 degrees).Same variables as above.22
8Smooth Pursuit: subject follows a dot as it displaced (moves) sinusoidally horizontally then vertically at different speeds: Smooth PursuitHorizontal (SPH) 0.1 Hz, 3 cycles; 0.75 Hz 6 cyclesa) Velocity Gain = ratio between the slow phase component of eye velocity and pursuit tracker stimuli. Data are averaged for the leftward and rightward moving stimuli.40
b) Asymmetry = Velocity Gain Asymmetry; represents the difference between gain calculated for leftward and rightward moving stimuli – see calculations below the table
c) Position Gain = ratio between the ratio between the slow phase component of eye velocity and pursuit tracker stimuli - see calculations below
d) Saccadic component (%) = percentage of eye movement spent on a saccadic movement vs. pursuit movement
e) Initiation latency (msec) = time from stimulus presentation until a smooth pursuit movement is initiated.
9Smooth Pursuit-Vertical (SPV) 0.1 Hz, 3 cycles; 0.75 Hz 6 cyclesSame as above.40
10Vergence Pursuit (VP): the subject is required to follow a light stimulus that moves towards and away from the subject in a smooth pursuit pattern, 0.1 Hz 3 cyclesa) Left/Right eye gain = how well the subject tracks the stimulus, calculated for each eye30
b) Left-right eyes correlation = how well left-right eye correlate between each anther
c) Saccadic components (%) = percentage of eye movement spent on a saccadic movement versus pursuit movement
11Vergence Step (VS): the subject is required to follow a light stimulus that moves towards and away from the subject in a saccade (step) pattern (9 cycles).a) Left/Right eye inward and outward time constant = how well the subject tracks the stimulus, calculated for each eye20
b) Left/Right eyes correlation = how well left-right eye correlate between each other in inward and outward directions
c) Saccadic components (%) = percentage of eye movement spent on a saccadic movement
12Optokinetic (OKN) 20 deg/s: subjects see a field of dots moving on the display first to the right, then to the left, with eye tracking throughout the test with a velocity of 40 deg/s. Each test consists of a stimulus rotating for 10 s clockwise (CW) and then 10 s counterclockwise (CCW), with 3 s of rest between CW and CCW rotation.a) Average eye velocity CW and CCW (deg/sec) = eye velocity during the slow phase of nystagmus for stimuli moving in clockwise (CW) and counterclockwise (CCW) direction25
b) Gain = ratio between average eye slow phase velocity and stimulus for CW and CCW segments
c) Gain Asymmetry (%) = represents the difference between gain calculated for CW and CCW segments - see calculations below
d) Area Under Main Sequence Fit (AUF) (deg2/sec). Fast phase of OKN nystagmus beats is plotted as a function of the beats length and fitted with an exponential function. To evaluate the overall velocity and amplitude relationship, the software computes the area under the curve = AUF for CW and CCW stimulus movement.
e) Normalized OKN CW velocity gain (normalized at 20 deg/sec)
f) Normalized OKN CCW velocity gain (normalized at 20 deg/sec)
13Optokinetic (OKN) 60 deg/sSame as above.25
14Predictive Saccades (PS): subject is directed to follow a dot as it is displayed. Subject is presented with 6 pseudo-random saccade stimuli followed by 21 mirrored saccade stimuli with repeated displacement +/-10 degrees, horizontal, at a constant time interval of 0.65 s.First predicted, total number predicted saccades, % of predicted saccades18
15Antisaccades (AS): subject is required to fixate on a central target for 1.5 to 2.5 s. Then the subject is presented with a peripheral target. Subject is required to generate an eye movement in the same distance as the target displacement, but in the exact opposite direction. There are 33 anti-saccades with time between saccades randomly selected from 1 to 2 s and random displacement between −30 to + 30 degrees.Error Rate (%) = percentage of pro-saccade errors, i.e., where the subject looks toward rather than away from the stimulus22
16Spontaneous Nystagmus (SN) – subject fixates a light stimulus placed on the center of the screen for 10 s. The light is turned off and the subject is required to continue to fixate at the spot where the light was for 15 s.Direction and velocity of nystagmus beats and number of square wave jerks for horizontal and vertical nystagmus during fixation and in the dark25
17Gaze Horizontal (GH) -subject fixates a light stimulus placed on 15 deg from the center to the left and then to the right of the screen for 10 s. The light is turned off and the subject is required to continue to fixate at the spot where the light was for 15 s.Direction and velocity of nystagmus beats and number of square wave jerks for horizontal and vertical nystagmus during fixation and in the dark with gaze to the left and right50
18Subjective VisualHorizontal (SVH): subject is presented with a non-horizontal line and by using the left and right buttons on the handheld control box, orient the line to the horizontal (straight across) position, and then press accept button on the control box.Mean error (deg) = difference between subject's orientation angle and true horizontal. Data are presented as a mean of errors of all measurements.15
Testing time~8 min
Set-up time2 min
Test Instructions2 min
Total time12 min

Tests and metrics in the OVRT-C testing protocol.

Hardware and software

OVRT-C tests were delivered via the Neurolign Dx 100 (formerly known as I-Portal Portable Assessment System - Nystagmograph; I-PAS), an FDA-cleared eye-tracking device manufactured by Neurolign USA, LLC (formerly known as Neuro Kinetics, Inc.; Pittsburgh, PA). The Neurolign Dx 100 is a portable and compact head-mounted virtual reality goggle set equipped with high-speed digital infrared cameras (940 nm, sampling rate of 100 frames/second) that capture high-resolution images of eye movements in response to light and auditory stimuli. A hand-held apparatus with response buttons recorded participants' reaction times and/or responses during tests that require manual input (i.e., subjective visual vertical/horizontal, auditory reaction time). Data were collected using Neurolign's I-Portal software, which captures time stamps (necessary for synchronization) and analyzes digital images of the eye to record horizontal and vertical eye movement data. Proprietary VEST™ software was utilized to operate the hardware, create and edit stimulus parameters, integrate I-Portal eye-tracking results, and analyze acquired data to generate a comprehensive set of desired metrics.

Treatment of artifacts and outlying samples

Data were calibrated for position by comparing eye movements to fixation locations that had a known displacement. VEST™ software identified artifacts such as blinks, recording noise, and any temporary failures in eye tracking. Along with other possible artifacts, such as shifting of goggles during testing, incorrect responses, and/or responses not related to the task, all artifacts were evaluated manually to ensure discrimination of eye movement signals from recording noise. In some cases, manual analysis was also necessary to isolate saccadic activity from pursuit activity. VEST™ software automatically reports data validity, i.e., the percentage of acceptable data available from which to calculate results. The software alerted the test administrator if data validity was below 60%, in which case VEST™ only analyzed data from a single eye as long as that eye was above the 60% validity criterion. If validity for both eyes was below 60%, data from that particular test were discarded. For some subjects, results from specific OVRT-C tests were removed from analysis when the data quality was inadequate for accurate measurement or created analytic errors.

Data analysis

Data acquired for each OVRT-C test were reviewed to ensure completion and validity, and analyzed using VEST™ software.

For each completed and validated test for every subject, measures of OVRT-C performance were collected from the VEST™ software. These measures corresponded to the “Metrics measured for each test” in Table 3, and “Metrics” in Table 4. For a given subject, each of their collected metric measurements were compared to the normative range for that metric in a clinical (FDA-approved) normative database (34, 35). We then determined the number of subjects whose measures fell within vs. outside the normative range for that metric. These are reported as percentage (%) abnormalities for each variable. Since the normative ranges were based on a 95th percentile ranking (95% of the normative database subjects were within each range), the expected percentage outside each range (% Abnormalities) would be 5% for an unaffected subject population. Our results are therefore meant to be interpreted relative to this expected 5%.

Table 4

TestMetricsnon-AthletesAthletesp-value11
NMeanSDNMeanSD(Mean Diff)
Auditory RTMean latency382359038210340.116
Visual RTMean latency382505038241360.388
Subjective Visual VerticalOverall error mean390.161.8238−1.342.020.001
Self-paced SaccadesSaccades per second382.000.81382.300.620.073
Position error degrees mean382.070.91381.990.970.717
Saccade and RTRightward latency means380.210.03370.210.060.913
Leftward latency means380.200.05370.190.060.336
Motor resp R button latency means Motor resp right button latency mean380.520.16380.510.140.700
Motor resp L button latency means380.530.15380.470.150.074
Latency grand mean380.210.03370.200.050.658
Accuracy grand mean3889.612.33790.016.30.896
Final accuracy grand mean3896.313.43795.516.40.825
Saccades HorizontalLatency grand mean390.200.03380.190.020.003
Accuracy grand mean3992.411.13891.46.40.608
Final accuracy grand mean3998.811.33896.15.00.186
(RR) Accuracy % of undershoot3921.119.63823.918.40.522
(LL) Accuracy % of overshoot397.811.8388.811.50.720
(RR) Final acc. % undershoot3920.216.63822.216.80.605
(RR) Final acc. % overshoot399.713.2388.814.90.784
Saccades VerticalLatency grand mean390.210.03380.190.020.001
Accuracy grand mean3992.812.23894.410.80.563
Final accuracy grand mean3999.111.43896.910.00.372
(LD) Accuracy % of undershoot3916.716.73813.516.10.392
(LD) Accuracy % of overshoot3912.915.13818.418.20.153
(LD) Final acc. % of undershoot3914.519.43814.116.40.928
(RD) Final acc. % of undershoot3913.018.93816.516.20.381
Smooth Pursuit Horizontal, 0.1 HzVelocity gain rightward390.90.1381.00.10.379
Velocity gain leftward391.00.1380.90.10.408
Velocity saccade, %3929.320.13826.011.60.366
Position gain391.010.02381.000.030.070
Initiation latency msec39268.572.138250.288.60.325
Smooth Pursuit Horizontal, 0.75 HzVelocity gain rightward390.90.2380.90.20.460
Velocity gain leftward390.90.2380.90.10.509
Velocity saccade, %3932.516.23830.216.60.545
Position gain391.010.07381.060.130.063
Initiation latency msec39233.250.138245.357.20.329
Smooth Pursuit Vertical, 0.1 HzVelocity gain up390.890.18380.940.090.079
Velocity gain down390.920.11380.930.100.728
Velocity saccade, %3930.317.93824.914.90.158
Position gain391.060.21381.020.060.311
Initiation latency msec39257.177.737269.9103.00.542
Smooth Pursuit Vertical, 0.75 HzVelocity gain up390.820.22380.840.210.639
Velocity gain down390.690.24380.770.210.161
Velocity saccade, %3938.117.33836.015.80.592
Position gain391.040.15381.060.170.670
Initiation latency msec39207.858.738205.937.60.866
Vergence PursuitLeft eye position gain380.790.19380.860.160.107
Right eye position gain380.790.22380.830.220.418
Eye correlation inward38−0.50.838−0.70.50.184
Eye correlation outward38−0.510.7238−0.650.550.350
Vergence StepMean inward correlation38−0.200.7338−0.510.610.048
Mean outward correlation38−0.070.6138−0.170.570.477
Optokinetic Nystagmus, 20 deg/sAverage gain380.750.17380.670.240.073
Asymmetry386.818.5388.519.90.712
CW Area under fit 30368,2681,974377,7972,2150.340
CCW Area under fit 3038−8,4071,46438−7,1441,8090.001
Mean area under fit 30368,2901,554377,4851,8280.046
Optokinetic Nystagmus, 60 deg/sAverage gain380.350.17380.260.180.031
Asymmetry383.5726.7338−6.0628.560.133
CW Area under fit 30377,6271,916377,1532,0720.310
CCW Area under fit 3037−7,9722,19536−7,6782,4690.592
Mean area under fit 30377,8001,813357,5041,8200.493
Predictive SaccadesLatency grand mean390.120.06380.090.050.013
(L) % of predicted3928.822.43838.522.50.060
(R) % of predicted3928.822.03837.522.80.092
AntisaccadesOverall prosaccade % error3842.229.03836.028.80.354
Accuracy grand mean381739638156670.387
Leftward prosaccade % error3839.631.63830.030.00.576

Comparison of the two COVID-19 cohorts.

1

A p-value from a two-sample (mean difference) t-test that determines whether the two independent samples come from distributions with equal means by assuming unknown and unequal variances. The p-value was calculated under a two-tail hypothesis. For simplicity, RT refers to reaction time.

In some cases, we report % Abnormalities for a whole test (e.g., Optokinetic Nystagmus at 60 deg/sec, see Figure 1), where the whole test consists of multiple metrics. Nonetheless, testing for the significance of differences was performed per metric, not on a whole-test basis.

Figure 1

A Two-sample t-test was used to evaluate the similarity between our two patient cohorts (TTEST2 function in MATLAB). Differences between the observed rate of metric measures that fell outside normative ranges vs. the expected (normative) rate were evaluated using a One-Proportion Z-test. The significances of these differences (given in Table 5) were computed by

where c = 1/(2N) is a correction for continuity and p is the estimated proportion of post-COVID participants whose test value is outside the normative 95% reference interval (RI) limits (column %Abn), N is the total number of post-COVID participants, and P0 = 0.05 is an expected proportion. The corresponding p-value was calculated under a two-tail hypothesis. Because we are performing multiple comparisons, each targeting essentially the same null hypothesis (the proportion of subjects with measures outside the normative range is P0), we have adjusted our acceptable significance threshold to α <0.0009 (Bonferroni correction).

Table 5

TestsMetricsAbnormal rateTwo-samplet-test
95% RI Limitspost-COVIDHealthypost-COVIDp-value (Mean diff)
LowerUpperNAbn%Abnp–valueMeanMean
Auditory RTMean latencyn/a3167667.9%0.370927782342220.184
Visual RTMean latencyn/a3437645.3%0.874539752742460.000
Subjective Visual VerticalOverall error mean−2.962.96771418.2%0.00000045−0.58
Saccade and RTSaccades Rightward latency meann/a0.297522.7%1.000000000.200.210.321
Saccades Leftward latency meann/a0.297522.7%1.000000000.20
Motor Right button latency meann/a0.65761215.8%0.000050640.500.520.250
Motor Left button latency meann/a0.65761317.1%0.000004670.50
Saccade latency grand meann/a0.297522.7%1.000000000.20
Saccades final acc. grand mean79106752128.0%0.0000000095.9
Saccades HorizontalArea under fit mean8,239n/a7733.9%1.000000001,0382
Latency grand meann/a0.2277911.7%0.015039580.180.190.000
Accuracy grand mean811037767.8%0.3882675092.591.90.587
Final acc. grand mean891047767.8%0.3882675096.397.50.272
Accuracy % of undershoot776.622.50.000
Final accuracy % of undershoot772.021.20.000
Saccades VerticalArea under fit mean7,630n/a7767.8%0.388267509,6849,5970.608
Latency grand meann/a0.23771114.3%0.000506680.190.200.000
Accuracy grand mean75109771013.0%0.0031336892.7940.517
Final acc. grand mean79107771316.9%0.0000061094.2980.004
Accuracy % of undershoot7718.619.90.666
Final accuracy % of undershoot778.213.90.025
Smooth Pursuit Horizontal, 0.1 HzVelocity gain rightward0.781.077767.8%0.388267500.950.950.509
Velocity gain leftward0.781.077745.2%0.854789820.95
Velocity gain asymmetry−8.807.5377810.4%0.05632178−0.27
Velocity saccade, %n/a35771722.1%0.0000000018.027.70.000
Position gain0.961.04771013.0%0.003133681.001.010.030
Initiation latency msecn/a335771316.9%0.00000610259
Smooth Pursuit Horizontal, 0.75 HzVelocity gain rightward0.621.08771215.6%0.000063320.950.920.180
Velocity gain leftward0.621.08771418.2%0.000000450.92
Velocity gain asymmetry−8.939.00771823.4%0.00000000−0.04
Velocity saccade, %n/a37772735.1%0.0000000015.831.40.000
Position gain0.791.10771215.6%0.000063320.961.030.000
Initiation latency msecn/a252773140.3%0.00000000239
Smooth Pursuit Vertical, 0.1 HzVelocity gains up0.691.0777911.7%0.015039580.900.910.335
Velocity gains down0.691.077779.1%0.165853650.93
Velocity gain asymmetry−12.3611.46771519.5%0.00000003−1.02
Velocity saccade, %n/a32.00772633.8%0.0000000014.127.660.000
Position gain0.951.07772735.1%0.000000000.991.040.013
Initiation latency msecn/a311761823.7%0.00000000263.3
Smooth Pursuit Vertical, 0.75 HzVelocity gains up0.421.0977911.7%0.015039580.810.830.533
Velocity gain down0.421.09771114.3%0.000506680.73
Velocity gain asymmetry−23.4329.01771722.1%0.000000006.29
Velocity saccade, %n/a52771620.8%0.0000000026.937.00.000
Position gain0.731.11772228.6%0.000000000.911.050.000
Initiation latency msecn/a230772329.9%0.00000000207
Optokinetic Nystagmus, 20 deg/sAverage gain0.660.97762938.2%0.000000000.860.710.000
Asymmetry−7.6610.55763343.4%0.000000007.65
CW area under fit 305,513n/a731013.7%0.00168041808480290.838
CCW area under fit 30n/a−5,956761114.5%0.00042138−8464−77750.002
Mean area under fit 305,735n/a73912.3%0.009199377882
Optokinetic Nystagmus, 60 deg/sAverage gain0.400.90765471.1%0.000000000.610.310.000
Asymmetry−14.5418.10763647.4%0.00000000−1.24
CW area under fit 306,289n/a742128.4%0.00000000810673900.005
CCW area under fit 30n/a−6,235731824.7%0.00000000−8177−78270.222
Mean area under fit 306,262n/a721622.2%0.000000007656
Predictive saccades(L) % of predicted17n/a772431.2%0.0000000065.333.60.000
(R) % of predicted17n/a772431.2%0.0000000065.433.10.000
AntisaccadesOverall prosaccade % error050762228.9%0.0000000016.339.10.000
Acc. grand mean76108.7164.60.000
Leftward prosaccade % error7615.234.80.000

Abnormal rates among post-COVID participants and t-test examine the mean difference between post-COVID and healthy participants.

n/a refers to a situation with no upper or lower RI limit.

A Two-Sample t-test was used to determine whether there is a difference between the mean (test) value of two independent groups – post-COVID 72–77 subjects and 300 healthy (control) participants. The corresponding p-value (mean difference) was calculated under a two-tail hypothesis.

We evaluated the value of our test metrics as predictors of COVID-19 status using a series of univariate and multivariate regression models. A logistic regression model was used to estimate the probability of a binary response (COVID / not COVID) as a function of one or more independent metrics. Models were generated using data from the normative database (300 normative data subjects) and 75 of our 77 subjects. We first fit logistic regression coefficients separately for each of 28 OVRT test metrics (FITGLM function in MATLAB using the method of Maximum Likelihood; see Table 6). A multivariate logistic regression model was generated and tested for its ability to distinguish between post-COVID and healthy control participants (evaluated on training data without a separate validation population). A standard stepwise procedure was used to identify those metrics that best fit the model. To evaluate the diagnostic accuracy, in addition to AUC and Somers' D, sensitivity, specificity and overall accuracy was computed with a logistic function cutoff value of 0.5.

Table 6

TestMetricsNML estimatesDiag. accuracy
Estimatep-valueAUCSomers' D
Saccade and RTRightward latency means3757.9280.0130.580.17
Motor resp R button latency mean3761.3210.1850.530.06
Saccade HorizontalLatency grand mean37731.3890.0000.680.36
Accuracy % of undershoot3770.0700.0000.710.42
Final accuracy % of undershoot3770.2120.0000.790.58
Saccade VerticalLatency grand mean37719.7410.0000.610.22
Final accuracy grand mean3770.0570.0000.580.16
Area under fit 30377−0.00020.0350.550.11
Final accuracy % of undershoot3770.0190.0070.550.10
Smooth Pursuit Horizontal, 0.1 HzVelocity saccade, %3770.0600.0000.650.29
Smooth Pursuit Horizontal, 0.75 HzVelocity saccade, %3770.0750.0000.730.45
Smooth Pursuit Vertical, 0.1 HzVelocity saccade, %3770.0930.0000.710.42
Smooth Pursuit Vertical, 0.75 HzVelocity saccade, %3770.0440.0000.640.29
Optokinetic Nystagmus, 20 deg/sAverage gain376−7.8050.0000.670.34
CW area under fit 30373−0.000020.8150.520.03
CCW area under fit 303760.000270.0010.600.19
Optokinetic Nystagmus, 60 deg/sAverage gain376−9.6900.0000.820.63
CW area under fit 30374−0.000240.0020.590.17
CCW area under fit 303730.000130.1100.550.10
Predictive saccades(L) % of predicted377−0.0510.0000.770.53
(R) % of predicted377−0.0530.0000.770.54
AntisaccadesOverall prosaccade % error3760.0540.0000.690.38
Accuracy grand mean3760.0130.0000.690.37
Leftward prosaccade % error3760.0390.0000.650.30

Univariate logistic regression results across tests and metrics.

N represents the total number of subjects up to a maximum of 77 post-COVID patients and 300 subjects from the normative data set. Table entries are estimated values of the regression coefficients (ML estimates) with corresponding p-values, the estimated value of the area under the receiver operating characteristic curve (AUC) statistics and the related Somers' D statistics (= 2 AUC – 1).

Neurobehavioral symptom inventory

The Neurobehavioral Symptom Inventory (NSI) is a 22-item self-report questionnaire commonly administered to patients following traumatic brain injury (TBI). Each item lists a potential neurological symptom and subjects were asked to rate how much each symptom was disturbing them at time of test on a scale of 0 (none/not at all) to 4 (always/very severe), with a total possible score of 88. A recent factor structure analysis of NSI responses by US military members with mTBI and healthy National Guard members (no mTBI) revealed a 4-factor model was the best fit, grouping responses into 4 neurobehavioral domains: vestibular, somatic, cognitive, and affective (36).

Spearman's rank correlation coefficient (rho) was used to measure the relationship between the test variables and NSI symptoms (CORR function in MATLAB); see Table 8.

Results

Comparison to normative OVRT-C ranges

In this study, we examined the hypothesis that OVRT-C test responses are reliable neurological biomarkers that can be used in the identification and evaluation of post-COVID/PASC patients. Using a clinical (FDA-approved) database of normative OVRT-C values (34, 35) we tested the specific hypothesis that in this population, multiple OVRT-C measures will fall outside established normative ranges.

For each test in our protocol, we identified which subjects had abnormal (outside normative ranges) responses to one or more variables within that test. Figure 1 displays a summary of these abnormality percentages within Cohort 1 (non-athletes), Cohort 2 (athletes), and overall (pooled data). As the figure shows, OVRT-C abnormalities were distributed relatively evenly between the two cohorts. Some tests presented clear challenges for subjects of either cohort. For instance, over half of Cohort 1 and Cohort 2 had impaired (outside norms) performance on the high-speed optokinetic test.

As both cohorts showed deficits, we first evaluated whether there were differences between these two cohorts (Table 4). We found that many metrics were not significantly different (60 out of 68), with the exception of several metrics: overall mean error in the SVV test, saccade latency in all saccade tests, mean inward correlation in the vergence test, clockwise and mean area under the fit in the OKN 20deg/s test, and average gain in the OKN 60 deg/s test. Based on the lack of significant differences, we pooled the two cohorts to further evaluate the deficits by comparing them to normative data. This allowed us to increase the sample size to 77 for a more robust comparison with the 300 controls included in the normative data.

We further examined the individual variables making up each test in more detail in order to highlight where performance difficulties arose (Figure 2, Table 5).

Figure 2

Table 5 provides a list of multiple OVRT-C variables, the observed frequencies of measures outside respective normative ranges for our subject population (pooled data), and an indication of significance based on our acceptance threshold of α <0.0009 (by One-Proportion Z-test). This analysis revealed that a significant percentage of subjects scored outside the norms in 12 out of 14 tests and 41 out of 60 metrics. The tests showing the highest percentage of subjects scoring outside the norms for all or many test metrics were smooth pursuit and OKN. The smooth pursuit tracking function revealed multiple significant differences, especially for higher speeds (SPH, 0.75 Hz) and for vertical pursuit tracking (SPV, 0.1 Hz and 0.75 Hz). Figure 2 shows the saccadic component or the amount of saccadic activity during smooth pursuit horizontal at 0.1 Hz and 0.75 Hz for all subjects. Given that the normative thresholds represent the 95th percentile for the normative population, we would expect that approximately 5% of our subjects would exceed each threshold if patients' post-COVID status had no effect on smooth pursuit activity. However, as shown in Figure 2, the number of subjects with measures beyond the respective thresholds was significantly higher in both cases with 22.1% (N = 17/77) for 0.1 Hz (p < 0.0009 by One-Proportion Z-test) and 35.1% (N = 27/77) for 0.75 Hz (p < 0.0009). These results indicate that a significant number of post-COVID patients have abnormally increased saccadic movement, and therefore less smooth pursuit movement, compared to a normative population.

Optokinetic nystagmus (OKN) responses, which rely on both saccade-like and pursuit-like eye movements, were dramatically affected in our post-COVID subjects (Table 5). Among the OKN responses, 71.1% (N = 54/76; p < 0.0009) had abnormally low gain for the high speed OKN test, meaning that post-COVID patients were impaired in their ability to generate higher speed nystagmus movements (the slow phase of OKN was significantly slower than the normative velocity).

Notably, neither standard horizontal saccade tests nor standard manual reaction time tests revealed large differences, as shown by the low proportions of patients scoring outside normative ranges on the Auditory Reaction Time (ART), Visual Reaction Time (VRT), or Saccades Horizontal tests (Table 5). However, when saccades and manual reaction time were combined within a joint test requiring both responses in conjunction, significant differences in reaction time emerged (Saccades and Reaction Time test, Motor resp R and L button latency, Table 5). Also, in the vertical saccades test, significant differences were seen for latency and for one of the measures of accuracy (Final accuracy grand mean).

Lastly, while standard saccades were not strongly impaired, other tests showed a significantly impaired ability to generate timed, anticipatory saccades (Predictive Saccades, N = 24/77, p < 0.0009), and saccades going in the opposite direction from presented stimuli (Antisaccades, N = 22/76, p < 0.0009).

Predictive metrics

To examine the ability of our testing protocol to identify PASC in a patient population, we constructed several logistic regression models. Some of these were simple regressions of single variables (univariate), followed by a more complex model using multiple metrics as combined predictors of impairment (multivariate). We constructed the models using our combined subject cohorts (n = 77) and the controls (n = 300) from the normative database. As a measure of discriminability, for each model we computed the area under the Receiver Operating Characteristics (ROC) curve (AUC).

Univariate analyses identified 11 metrics that could discriminate between controls (healthy subjects) and post-COVID status (Table 6). These metrics largely agreed with the normative range comparison results (Table 5). As shown in Table 6, high-speed OKN gain was strongly predictive of post-COVID subject status (AUC = 0.82). For both horizontal and vertical slow and fast smooth pursuit, the amount of aberrant saccadic activity was more moderately but still significantly related to post-COVID subject status (AUC values ranging from 0.64 to 0.73). Predictive saccade metrics were also significantly predictive (AUC = 0.77 for our two predicted percent measures), as were antisaccade metrics (e.g., AUC = 0.69 for error percent). One notable difference from our normative range comparison results was that univariate models for horizontal saccade metrics were significantly predictive of subject status with, for example, an AUC of 0.79 for one measure of saccade hypometria (final accuracy % of undershoot, see Table 6), and an AUC of 0.68 for latency. This latency result suggests a correlation between saccadic timing and post-COVID health status, which is significant, but which is not revealed by comparison to normative thresholds alone.

The multivariate model was constructed using stepwise logistic regression (Table 7). The analysis identified six metrics from different tests as significant indicators of post-COVID subjects. Together, the AUC was 0.89, the estimated specificity was 98% (with cutoff value of 0.5) and the sensitivity was 88%.

Table 7

TestMetricsML estimatesDiagnostic accuracy
Estimatep-valueStatisticRate
Intercept5.4690.001AUC0.89
Smooth Pursuit Horizontal, 0.75 HzVelocity saccade, %0.0780.002Somers' D0.79
Smooth Pursuit Vertical, 0.1 HzVelocity saccade, %0.0780.014Accuracy0.96
Optokinetic Nystagmus, 60 deg/sAverage gain−15.6000.000Sensitivity0.88
Predictive Saccades% of predicted−0.1420.000Specificity0.98
AntisaccadesOverall prosaccade % error0.0740.001
AntisaccadesAccuracy grand mean0.0140.008
Number of observations (Healthy/post-COVID)375 (300/75)

Multivariate logistic regression results and corresponding accuracy measures.

The model was generated using data from 300 normative data subjects and 75 post-COVID patients. Table entries are estimated values of the regression coefficients (ML estimates) with corresponding p-value.

Neurobehavioral symptom inventory

Of the 77 participants, 64 completed the NSI. For each NSI domain (i.e., vestibular, somatic, cognitive, and affective), we determined the maximum aggregate score per subject for each domain and overall (e.g., as the maximum score for each NSI item is 4, the aggregate score for each domain is 4*(number of NSI items in domain). We then calculated the mean score per domain for each cohort (athletes, non-athletes) and overall (pooled) (Figure 3).

Figure 3

We then examined the relationship between symptom scores and OVRT-C metrics (Table 8). There were moderate but significant correlations between NSI domain key variables and OVRT-C tests. For example, the NSI cognitive domain correlated with Antisaccade errors (Decisions, rho = 0.36, p = 0.003), Vertical Saccades accuracy (Forgetfulness, rho = −0.33, p = 0.001), and Self-Paced Saccade rate (Decisions, rho = −0.36, p = 0.004). Vertical saccade accuracy was also correlated modestly with the NSI vestibular domain Coordination variable (% saccade undershoot, rho = 0.39, p = 0.001). Spontaneous nystagmus showed correlation with two cognitive domain measures, namely Forgetfulness (rho = −0.41, p = 0.002) and Concentration (e.g., for average slow phase velocity, rho = −0.53, p = 0.002).

Table 8

TestMetricsNrhop-value
(a) Vestibular domain symptoms
Dizzy
Spontaneous nystagmus, in darkNystagmus beats, ASPV480.300.035
Saccade verticalLatency grand mean640.270.029
Smooth pursuit vertical, 0.1 HzVelocity gain up64−0.330.009
Balance
Gaze horizontal, in darkNumber of SWJ35−0.370.029
Smooth pursuit vertical, 0.1 HzVelocity gain up64−0.290.020
Coordination
Saccade verticalAccuracy means64−0.370.002
Accuracy % of undershoot640.390.001
Vergence pursuitLeft/right eye position asymmetry64−0.350.005
Near point asymmetry64−0.340.006
Far point asymmetry64−0.350.005
(b) Somatic domain symptoms
Headaches
Vergence StepLeft inward saccade, %640.400.001
Right inward saccade, %640.380.002
Nausea
Vergence stepLeft inward saccade, %640.320.010
Left outward saccade, %640.280.023
Right inward saccade, %640.300.015
Right outward saccade, %640.330.009
Smooth pursuit horizontal, 0.1 HzNumber of SWJ during left640.330.008
Number of SWJ during right640.370.003
Number of SWJ640.390.001
Vergence pursuitSaccadic component, %640.300.015
Saccade move (left), %640.300.018
Saccade move (right), %640.280.027
Smooth Pursuit Horizontal, 0.1 HzVelocity saccade, %640.360.003
Number of SWJ during left640.320.009
Number of SWJ during right640.360.003
Number of SWJ640.390.002
Vision problem
Smooth pursuit horizontal, 0.1 HzNumber of SWJ during left640.280.025
Gaze horizontal, in darkNystagmus beats, PSPV26−0.410.037
Light sensitivity
Smooth pursuit horizontal, 0.1 HzNumber of SWJ during left640.300.017
Number of SWJ640.270.030
Velocity saccade, %640.250.048
Initiation latency, msec64−0.340.005
Gaze horizontal, in darkNystagmus beats, ASPV29−0.400.034
(c) Cognitive domain symptoms
Concentration
Spontaneous nystagmus, in darkNystagmus beats, ASPV32−0.530.002
Nystagmus beats, PSPV31−0.430.002
Forgetfulness
Spontaneous nystagmus, in darkNystagmus beats, PSPV31−0.410.002
Saccade verticalAccuracy grand mean64−0.330.001
Decisions
AntisaccadesOverall prosaccade errors640.360.003
Self-paced saccadesSaccades per second64−0.360.004
Thinking
AntisaccadesOverall prosaccade errors640.360.018
Self-paced saccadesSaccades per second64−0.270.031
(d) Affective domain symptoms
Fatigue
Gaze horizontal, in darkNumber of nystagmus beats350.380.023
Saccades verticalLatency grand mean640.270.033
Sleep
Saccades vertical(RU) Latency late response, %640.250.050
Anxiety
Gaze horizontal, in darkNumber of nystagmus beats350.420.013
Depressed
Smooth pursuit vertical, 0.1HzInitiation latency, msec64−0.300.018
Irritability
Vergence pursuitSaccade component, %640.340.016
Saccade move (left), %640.310.013
Saccade move (right), %640.270.031
Smooth pursuit horizontal, 0.1 HzNumber of SWJ during left640.350.004
Number of SWJ640.310.012
Smooth pursuit vertical, 0.1HzNumber of SWJ during up640.280.027
Number of SWJ640.250.049
Frustration
Smooth pursuit horizontal, 0.75HzNumber of SWJ during left640.280.023
Smooth pursuit vertical, 0.75HzNumber of SWJ during up640.260.041
Number of SWJ640.270.032

Correlation between the NSI domains and OVRT-C tests.

Spearman's rank correlation coefficient (rho) is used to measure the relationship between test metrics and symptoms using the CORR function in MATLAB software (The MathWorks, Inc. USA, version R2015b). • p-value is calculated under two-tail hypothesis. For simplicity the following acronyms are used: • ASPV, average slow phase velocity; • PSPV, peak slow phase velocity; • SWJ, square wave jerks.

Discussion

The SARS-CoV-2 pandemic has brought public and clinical attention to an area of growing concern regarding viral infections, namely that a patient's emerging from the acute phase of infection and illness does not always imply recovery. This was seen, for instance, with the SARS coronavirus infections of 2002–2004 (SARS-CoV) where a sizeable proportion of patients did not recover their pre-infection health status, and instead entered a chronic period of impairment characterized by fatigue, myalgia, chronic pain, and other factors contributing to significant disability (37). COVID-19 infection has demonstrated a similar pattern where, despite some patients showing complete acute recovery, a significant proportion of patients experience ongoing symptoms months after the acute period of infection (21, 22).

It is now clear that neurological issues feature commonly and prominently in the post-infection period for recovered COVID-19 patients. While fatigue is the most reported symptom, this is followed closely in prevalence by patient-reported impairments in concentration, memory issues, problems with mood and emotion, sleep disruption, “brain fog” and other cognitive disruptions, and dizziness (22). Indeed, our NSI data support these findings, with cognitive (e.g., concentration) and affective (e.g., anxiety) complaints being the most prevalent and severe.

The OVRT-C results reported here reinforce the conclusion that COVID-19—in addition to its post-infection sequelae—is a neurological condition as much as it is a respiratory and autonomic one [see (3, 38) for reviews], and is consistent with two recent studies (31, 32). The most important contribution of VOG measurements is that they do not simply report on the state of oculomotor systems, but rather these metrics are quantifiable and objective proxies and biomarkers for the overall state of brain health. Our results reflect clear CNS impairment in recovered COVID-19 patients and provide support for three important hypotheses. First, we observed that subjects demonstrated a diversity of impairments, for instance in smooth pursuit tracking, saccades, and optokinetic nystagmus responses. Each of these reflect different anatomical substrates, which implies COVID-19 infection can chronically affect a broad range of neuroanatomical territory. Second, there was notable heterogeneity in OVRT-C and NSI data across participants, supporting the hypothesis that chronic COVID-19 neurological effects are themselves heterogeneous, leading to an equally diverse presentation of post-infection symptoms. Lastly, the oculomotor dysfunction we observed implies that COVID-19 infection can lead to significant disability well beyond, and perhaps hidden by, the more prevalent complaints of fatigue, cognitive under-performance, and memory impairment.

A critical finding was that logistic regression analysis using six OVRT-C variables across multiple tests demonstrated excellent discrimination between recovered COVID-19 subjects and controls, with a sensitivity of 88% and specificity of 98%. These data suggest that despite the high degree of heterogeneity of our subjects' reported neurological symptoms following recovery, COVID-19 infection resulted in an identifiable and informative collection of specific OVRT-C deficits in our subjects at the group level. The strength of this pattern may vary based on factors such as disease severity, vaccination status, comorbid disorders, and/or patient age; however, recent evidence suggests that even mild COVID-19 infection is associated with structural abnormalities following recovery (33). This model can be used as a quick screening tool of post-COVID patients to identify who might be at risk of PASC/long COVID and could benefit from immediate treatment.

ME/CFS and syndromes of chronic fatigue

The mechanisms behind neurological effects of COVID-19 infection are unknown. The etiology and symptoms of recovered COVID-19 patients, however, bear a remarkable resemblance to those of another condition; namely, myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS). Not only do the presenting symptoms strongly overlap, such as fatigue, post-exertional malaise (PEM), cognitive and memory difficulties, autonomic issues, among others [see (39), for review], but it has been noted that cases of ME/CFS are frequently preceded by instances of infection (40). Equally important, post-infectious fatigue syndromes can result from several viruses, such as SARS-CoV (37), the Epstein-Barr virus (EBV), Coxiella burnetii, and Ross River virus (41). Evidence is accumulating that post-COVID symptoms and ME/CFS both result from immunological hyperactivation, whereby an overwhelming activation of immune responses during an acute infectious period leaves the immune system chronically damaged, with long-term consequences for multiple systems that are normally dependent upon proper immune system balance (16, 42, 43). Another compatible hypothesis is that both conditions correlate with brainstem dysfunction, e.g., in medullary regions that are normally responsible for respiration, vasoconstriction, and vestibular responses, among many other functions [e.g., (11); see (42) for review]. While the present study did not aim to identify etiological mechanisms or specific impaired neural targets, the similarities between disorders suggest that long COVID may share many physiological mechanisms with, is etiologically related to, or is in fact the same as ME/CFS, which are hypotheses that have been proposed or assumed by a number of researchers familiar with both conditions (39, 44, 45).

Importantly, even if post-COVID sequelae and other fatigue-dominated syndromes are eventually shown to be distinct in some of their physiological details, the results of VOG testing from one condition can still valuably inform the other, particularly with regard to fundamental relationships between fatigue, cognitive impairment, autonomic dysfunction, and quantifiable metrics of detailed brain functioning, such as those that OVRT-C/VOG testing provide (46). This may prove particularly beneficial when attempting to understand virally initiated fatigue syndromes generally. We also believe it worth noting that our results address one of the valuable lessons learned from the clinical history of ME/CFS, namely that objective measurements are a valuable complement to subjective experience in verifying the individual presence of, and even refuting doubts about the reality of, a disorder otherwise defined largely by subjective symptoms (47).

Funding

The authors declare that this study received funding from Neurolign International Inc. The funder was not involved in the study design, collection, analysis, interpretation of data, the writing of this article or the decision to submit it for publication.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Statements

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving human participants were reviewed and approved by Allegheny Health Network Institutional Review Board (IRB#2020-367), University of Sáo Paulo School of Medicine Institutional Review Board (IRB#33787520.4.0000.0068). The patients/participants provided their written informed consent to participate in this study.

Author contributions

KK and AKi: co-principal investigator, study design, and manuscript review. RAn: co-principal investigator, data interpretation, and neuroclinical evaluation. AKu: manuscript review and project design. RAs and LG: wrote manuscript and study design. AS: screened, recruited, and enrolled patients. LM: tested patients. AA: tested patients and organized data. RS: study design and background research. SB and RT: neuroclinical evaluation. AB: statistical analysis. All authors contributed to the article and approved the submitted version.

Conflict of interest

Author AKi is the VP Technology Development, employee of, and shareholder of Neurolign USA LLC. Author RAs is an employee of and shareholder of Neurolign USA LLC. Author LG is an employee of Neurolign USA LLC. Author RAn received funding support from Neurolign USA LLC. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  • 1.

    RogersJPChesneyEOliverDPollakTAMcGuirePFusar-PoliPet al. Psychiatric and neuropsychiatric presentations associated with severe coronavirus infections: a systematic review and meta-analysis with comparison to the COVID-19 pandemic. Lancet Psychiatry. (2020) 7:61127. 10.1016/S2215-0366(20)30203-0

  • 2.

    RománGCSpencerPSReisJBuguetAFarisMEALáinezMet al. The neurology of COVID-19 revisited: a proposal from the environmental neurology specialty group of the world federation of neurology to implement internation neurological registries. J Neurol Sci. (2020) 414:112. 10.1016/j.jns.2020.116884

  • 3.

    Al-RamadanA. Rabab'h O, Shah J, Gharaibeh A. Acute and post-acute neurological complications of COVID-19. Neurol Int. (2021) 13:10219. 10.3390/neurolint13010010

  • 4.

    PetersonCJSarangiABangashF. Neurological sequelae of COVID-19: a review. Egypt J Neurol Psychiatr Neurosurg. (2021) 57:122. 10.1186/s41983-021-00379-0

  • 5.

    LiottaEMBatraAClarkJRShlobinNAHoffmanSCOrbanZSet al. Frequent neurologic manifestations and encephalopathy-associated morbidity in COVID-19 patients. Ann Clin Transl Neurol. (2020) 7:222130. 10.1002/acn3.51210

  • 6.

    ChouSH-YBeghiEHelbokRMoroESampsonJAltamiranoVet al. Global incidence of neurological manifestations among patients hospitalized with COVID-19 – a report for the GCS-NeuroCOVID Consortium and the ENERGY Constortium. JAMA Network Open. (2021) 4:e2112131.

  • 7.

    ChenXLaurentSOnureOAKleinebergNNFinkGRSchweitzerFet al. A systematic review of neurological symptoms and complications of COVID-19. J Neurol. (2021) 268:392402. 10.1007/s00415-020-10067-3

  • 8.

    BaigAMKhaleeqAAliU. Syeda H. Evidence of the COVID-19 virus targeting the CNS: tissue distribution, host-virus interaction, and proposed neurotropic mechanisms. ACS Chem Neurosci. (2020) 11:9958. 10.1021/acschemneuro.0c00122

  • 9.

    SamavatiLUhalBD. ACE2, much more than just a receptor for SARS-CoV-2. Front Cell Infect Microbiol. (2020) 10:19. 10.3389/fcimb.2020.00317

  • 10.

    MatschkeJLütgehetmannMHagelCSperhakeJPSchröderASEdlerCet al. Neuropathology of patients with COVID-19 in Germany: a post-mortem case series. Lancet Neurol. (2020) 19:91929. 10.1016/S1474-4422(20)30308-2

  • 11.

    BulfamanteGBocciTFalleniMCampiglioLCoppolaSTosiDet al. Brainstem neuropathology in two cases of COVID-19: SARS-CoV-2 trafficking between brain and lung. J. Neurol. (2021) 268:448691. 10.1007/s00415-021-10604-8

  • 12.

    JensenMPLe QuesneJOfficer-JonestLTeodòsioAThaventhiranJFickenCet al. Neuropathological findings in two patients with fatal COVID-19. Neuropathol Appl Neurobiol. (2020) 47:1725. 10.1111/nan.12662

  • 13.

    SiowILeeKSZhangJJYSaffariSENgA. Stroke as a neurological complication of COVID-19: a systematic review and meta-analysis of incidence, outcomes and predictors. J Stroke Cerebrovasc Dis. (2021) 30:105549. 10.1016/j.jstrokecerebrovasdis.2020.105549

  • 14.

    HanffTCMoharebAMGiriJCohenJBChirinosJA. Thrombosis in COVID-19. Am J Hematol. (2020) 95:157889. 10.1002/ajh.25982

  • 15.

    CavezziATroianiECorraoS. COVID-19: hemoglobin, iron, and hypoxia beyond inflammation. A narrative review. Clin Pract. (2020) 10:1271. 10.4081/cp.2020.1271

  • 16.

    AndradeBSSiqueiraSde Assis SoaresWRde Souza RangelFSantosNOdos Santos FreitasAet al. Long-COVID and post-COVID health complications: an up-to-date review on clinical conditions and their possible molecular mechanisms. Viruses. (2021) 13:700. 10.3390/v13040700

  • 17.

    TaquetMGeddesJRHusainMLucianoSHarrisonPJ. 6-month neurological and psychiatric outcomes in 236379 survivors of COVID-19: a retrospective cohort study using electronic health records. Lancet Psychiatry. (2021) 8:41627. 10.1016/S2215-0366(21)00084-5

  • 18.

    LogueJKFrankoNMMcCullochDJMcDonaldDMagedsonAWolfCRet al. Sequelae in adults at 6 months after COVID-19 infection. JAMA Network Open. (2021) 4:e210830. 10.1001/jamanetworkopen.2021.0830

  • 19.

    TenefordeMWBillig RoseELindsellCJShapiroNIFilesDCGibbsKWet al. Characteristics of adult outpatients and inpatients with COVID-19. MMWR. (2020) 69:8416. 10.15585/mmwr.mm6926e3

  • 20.

    PavliATheodoridouMMaltezouHC. Post-COVID syndrome: incidence, clinical spectrum, and challenges for primary healthcare professions. Arch Med Res. (2021) 52:57581. 10.1016/j.arcmed.2021.03.010

  • 21.

    SudreCHMurrayBVarsavskyTGrahamMSPenfoldRSBowyerRCet al. Attributes and predictors of long COVID. Nat Med. (2021) 27:62631. 10.1038/s41591-021-01292-y

  • 22.

    DavisHEAssafGSMcCorkellLWeiHLowRJRe'emYet al. Characterizing long COVID in an international cohort: 7 months of symptoms and their impact. EclinicalMedicine. (2021) 38:101019. 10.1016/j.eclinm.2021.101019

  • 23.

    HampshireATrenderWChamberlainSRJollyAEGrantJEPatrickFet al. Cognitive deficits in people who have recovered from COVID-19. EClinicalMedicine. (2021) 39:101044. 10.1016/j.eclinm.2021.101044

  • 24.

    KellyKMKidermanAAkhavanSQuigleyMRSnellEDHappEet al. Oculomotor, vestibular, and reaction time effects of sports-related concussion: video-oculography in assessing sports-related concussion. J Head Trauma Rehabil. (2018) 34:17688. 10.1097/HTR.0000000000000437

  • 25.

    BalabanCHofferMESzczupakMSnappHCrawfordJMurphySet al. Oculomotor, vestibular, and reaction time tests in mild traumatic brain injury. PLoS ONE. (2016) 11:e0162168. 10.1371/journal.pone.0162168

  • 26.

    KangSLShaikhAGGhasiaFF. Vergence and strabismus in neurodegenerative disorders. Front Neurol. (2018) 9:110. 10.3389/fneur.2018.00299

  • 27.

    CrutcherMDCalhoun-HaneyRManzanaresLJJLeveyAIZolaSM. Eye tracking during a visual paired comparison task as a predictor of early dementia. Am J Alzheimers Dis Other Demen. (2009) 24:25866. 10.1177/1533317509332093

  • 28.

    GoldingCVPDanchaivijitrTLHodgsonSJKennardTC. Identification of an oculomotor biomarker of preclinical Huntington disease. Neurology. (2006) 67:4857. 10.1212/01.wnl.0000218215.43328.88

  • 29.

    HicksSLRobertMPAGoldingCVPTabriziSJKennardC. Oculomotor deficits indicate progression of Huntington's disease. Prog Brain Res. (2008) 171:5558. 10.1016/S0079-6123(08)00678-X

  • 30.

    SerraAChisariCGMattaM. Eye movement abnormalities in multiple sclerosis: pathogenesis, modeling, and treatment. Front Neurol. (2018) 9:31. 10.3389/fneur.2018.00031

  • 31.

    CenaCGCostaMCSaltarén PazmiñoRSantosCPGómez-AndrésDBenito-LeónJet al. Eye movement alterations in post-COVID-19 condition: a proof-of-concept study. Sensors. (2022) 22:1481. 10.3390/s22041481

  • 32.

    TanMCengizDUDemirIDemirelSÇolakSCKarakasOet al. Effects of COVID-19 on the audio-vestibular system. Med Surg. (2022) 43:103173. 10.1016/j.amjoto.2021.103173

  • 33.

    DouaudGLeeSAlfar-AlmagroFArthoferCWangCMcCarthyPet al. SARS-CoV-2 is associated with changes in brain structure in UK Biobank. Nature. (2022) 604:697707. 10.1101/2021.06.11.21258690

  • 34.

    KullmanAAshmoreRCBravermanAMazurCSnappHWilliamsEet al. Portable eye-tracking as a reliable assessment of oculomotor, cognitive and reaction time function: normative data for 18-45 year old. PLoS ONE. (2021) 16:e0260351. 10.1371/journal.pone.0260351

  • 35.

    KullmanAAshmoreRCBravermanAMazurCSnappHWilliansBSet al. Normative data for ages 18-45 for ocular and vestibular testing using eye tracking. Laryngoscope Investig Otolaryngol. (2021) 6:111627. 10.1002/lio2.632

  • 36.

    VanderploegRDSilvaMASobleJRCurtissGBelangerHGDonnellAJet al. The structure of postconcussion symptoms on the neurobehavioral symptom inventory: a comparison of alternative models. J Head Trauma Rehabil. (2015) 30:111. 10.1097/HTR.0000000000000009

  • 37.

    LamMHWing YK YuMWLeungCMaRCWKongAPSet al. Mental morbidities and chronic fatigue in severe acute respiratory syndrome survivors: long-term follow-up. Arch Intern Med. (2009) 169:21427. 10.1001/archinternmed.2009.384

  • 38.

    LarsenNWStilesLEMiglisMG. Preparing for the long-haul: autonomic complications of COVID-19. Auton Neurosci. (2021) 235:102841. 10.1016/j.autneu.2021.102841

  • 39.

    WongTLWeitzerDJ. Long COVID and myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS)-a systemic review and comparison of clinical presentation and symptomatology. Medicina. (2021) 57:418. 10.3390/medicina57050418

  • 40.

    ChuLValenciaIJGarvertDWMontoyaJG. Onset patterns and course of myalgic encephalomyelitis/chronic fatigue syndrome. Front Pediatr. (2019) 7:12. 10.3389/fped.2019.00012

  • 41.

    HickieIDavenportTWakefieldDVollmer-ConnaUCameronBVernonSDet al. Post-infective and chronic fatigue syndromes precipitated by viral and non-viral pathogens: prospective cohort study. BMJ. (2006) 333:575. 10.1136/bmj.38933.585764.AE

  • 42.

    YongSJ. Long COVID or post-COVID-19 syndrome: putative pathophysiology, risk factors, and treatments. Infect Dis. (2021) 53:73754. 10.1080/23744235.2021.1924397

  • 43.

    MontoyaJGHolmesTHAndersonJNMaeckerHTRosenberg-HassonYValenciaIJet al. Cytokine signature associated with disease severity in chronic fatigue syndrome patients. Proc Natl Acad Sci USA. (2017) 114:E71508. 10.1073/pnas.1710519114

  • 44.

    KomaroffALBatemanL. Will COVID-19 lead to myalgic encephalomyelitis/chronic fatigue syndrome?Front Med. (2021) 7:606824. 10.3389/fmed.2020.606824

  • 45.

    MirfazeliFSSarabi-JamabAPereira-SanchezVKordiAShariatiBShariatSVet al. Chronic fatigue syndrome and cognitive deficit are associated with acute-phase neuropsychiatric manifestations of COVID-19: a 9-month follow-up study. Neurol Sci. (2022) 43:22319. 10.1007/s10072-021-05786-y

  • 46.

    BadhamSPHutchinsonCV. Characterising eye movement dysfunction in myalgic encephalomyelitis/chronic fatigue syndrome. Graefes Arch Clin Exp Ophthalmol. (2013) 251:276976. 10.1007/s00417-013-2431-3

  • 47.

    RothPHGadebusch-BondioM. The contested meaning of “long COVID” - Patients, doctors, and the politics of subjective evidence. Soc Sci Med. (2022) 292:114619. 10.1016/j.socscimed.2021.114619

Summary

Keywords

oculomotor, COVID-19, biomarker, eye-tracking, Neurobehavioral Symptom Inventory (NSI)

Citation

Kelly KM, Anghinah R, Kullmann A, Ashmore RC, Synowiec AS, Gibson LC, Manfrinati L, Araújo A, Spera RR, Brucki SMD, Tuma RL, Braverman A and Kiderman A (2022) Oculomotor, vestibular, reaction time, and cognitive tests as objective measures of neural deficits in patients post COVID-19 infection. Front. Neurol. 13:919596. doi: 10.3389/fneur.2022.919596

Received

13 April 2022

Accepted

09 August 2022

Published

12 September 2022

Volume

13 - 2022

Edited by

Pedro Gomez-Vilda, Polytechnic University of Madrid, Spain

Reviewed by

Jan Johansson, Karolinska Institutet (KI), Sweden; Abdulmonem Alhayani, King Abdulaziz University, Saudi Arabia; Tommaso Bocci, University of Milan, Italy

Updates

Copyright

*Correspondence: L. C. Gibson A. Kiderman

This article was submitted to Neurological Biomarkers, a section of the journal Frontiers in Neurology

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics