Abstract
Numerous studies have demonstrated the real-time use of visual, vibrotactile, auditory, and multimodal sensory augmentation technologies for reducing postural sway during static tasks and improving balance during dynamic tasks. The mechanism by which sensory augmentation information is processed and used by the CNS is not well understood. The dominant hypothesis, which has not been supported by rigorous experimental evidence, posits that observed reductions in postural sway are due to sensory reweighting: feedback of body motion provides the CNS with a correlate to the inputs from its intact sensory channels (e.g., vision, proprioception), so individuals receiving sensory augmentation learn to increasingly depend on these intact systems. Other possible mechanisms for observed postural sway reductions include: cognition (processing of sensory augmentation information is solely cognitive with no selective adjustment of sensory weights by the CNS), “sixth” sense (CNS interprets sensory augmentation information as a new and distinct sensory channel), context-specific adaptation (new sensorimotor program is developed through repeated interaction with the device and accessible only when the device is used), and combined volitional and non-volitional responses. This critical review summarizes the reported sensory augmentation findings spanning postural control models, clinical rehabilitation, laboratory-based real-time usage, and neuroimaging to critically evaluate each of the aforementioned mechanistic theories. Cognition and sensory re-weighting are identified as two mechanisms supported by the existing literature.
Introduction
Active sensory augmentation (SA) for balance control is the focus of this critical review (). We particularly highlight vibrotactile feedback but include other modalities of SA as well. We define SA as the delivery of additional sensory cues (e.g., via auditory, tactile, or visual modalities) that convey pertinent information about body orientation for balance. Passive forms of SA, such as mirrors, have been used during stroke rehabilitation (, ) and for treating phantom pain in amputees () since the 1990s. The first active form of SA was developed in the 1960s by Bach-y-Rita to provide vibrotactile cues to inform people with visual impairments about the location of an object (). Shortly thereafter, the Naval Aerospace Medical Research Laboratory developed and piloted the Tactile Situation Awareness System (TSAS), an array of vibrotactile actuators worn on the torso, to augment a pilot's situational awareness and provide information about orientation and targeting (). In the 1990's Wall adapted the TSAS concept for people with vestibular deficits () and Allum developed a multimodal feedback display for people with balance impairments ().
SA for balance has been a focus of much research since the 2000's, likely influenced by increased availability of wearable technologies, especially compact, wireless, and accurate inertial measurement units. Various patient populations with primarily sensory-driven balance deficits have been included in research: people with vestibular loss, peripheral neuropathy, mild traumatic brain injury, and older adults, as well as people with stroke, Parkinson's disease, and ataxia.
Despite the recent interest in SA technologies, limited studies have investigated the underlying mechanisms of their effectiveness. However, several hypotheses are conceivable and a few have been historically proposed. These hypotheses can be conceptualized by considering how they influence various aspects of balance as represented by a simple model of balance control (Figure 1). We note that more than one mechanism could occur simultaneously.
Figure 1
“Sensory Restoration” refers to a device that fully restores missing sensory information. In this case, various methods for measuring balance function would show balance control behavior identical to that measured in subjects with normal sensory function. More likely the sensory restoration would be partial or limited. For example, for the foreseeable future a vestibular implant device at best will restore semicircular canal information, but not information from otolith organs (). Examples of sensory restoration include retinal implants (), cochlear implants (), and vestibular implants ().
“Sensory Substitution” refers to a device that acts through an alternative sensory modality (e.g., encoded using patterns of skin vibration) to convey the motion information that is related to that of a damaged sensory source. Ideally, this substituted information could be combined with other naturally available information and recognized by the brain as being equivalent to the damaged sensory source. If the information from the alternative sensory modality differs substantially from the damaged sensory information for which it is meant to substitute, the nervous system may not be able to combine it with other sensory sources in a natural way. In this case, it may be more appropriate to consider that the device is providing “Sensory Addition” (, ). Both sensory substitution and addition mechanisms can be thought of as augmenting balance control by making a “sixth sense” contribution to available sensory cues. Historically, sensory substitution and addition have been proposed as mechanisms when vibrotactile (), auditory (), or tactile () cues have been used to enhance visual inputs.
“Sensory Integration” refers to a mechanism that combines orientation information (often represented as a weighted combination) from various sources to serve as a basis for generating corrective actions that facilitate balance stabilization. Sensory restoration, substitution, and addition alter the available sensory information and are likely to have an impact on sensory integration via sensory reweighting. It has been posited that repeated exposure to an additional “channel” of body motion information provides the CNS with a correlate to the inputs from its intact sensory channels, promoting increased weighting of these intact channels and thereby promoting retentive (i.e., balance improvements are observed for the activities that were practiced/included in the training regime) and/or carryover (i.e., balance improvements are observed for activities that were not practiced/included in the training regime) effects once the additional channel of information is removed (). Longer-term training with SA devices may affect sensory integration and context-specific adaptation by allowing time for the nervous system to develop optimal combinations/weights of sensory cues. Therefore, SA used during balance rehabilitation may lead to beneficial changes in sensory integration that are maintained even without the continued use of an SA device. Other SA benefits might arise from their influence on motor mechanisms. One could imagine that a device might motivate a change in “Control Strategy” that causes an individual to generate more or less corrective torque as a function of available sensory information. This could be represented by modification of neural control parameters where, for example, an increase in corrective torque generated per unit of body sway would cause a reduction in sway evoked by external disturbances even though sensory integration mechanisms remained unchanged. Temporary use of SA during balance rehabilitation may promote long-term changes in control strategy. Control strategy changes have been seen in subjects with Parkinson's Disease when receiving sensory cueing () and are likely influenced by individual motivation as well ().
“Cognitive Processes” could have a role in explaining effects to the extent that subjects use conscious processing to generate voluntary actions to control balance. The TSAS for pilot situational awareness likely mediates cognitive processes and sensory addition (). Finally, a device using functional electrical stimulation provides “Direct Activation” of muscles, thereby bypassing or partially bypassing natural sensory integration and muscle activation processes when they are not available or damaged (e.g., due to spinal cord injury) (, ). The aim of this critical review is to interpret aggregate findings in SA through the lens of several hypothesized mechanisms by first providing a brief overview of SA technologies for balance, then summarizing general outcomes for real-time use, balance rehabilitation, feedback modeling, and neuroimaging.
Sensory augmentation technologies
Visual (e.g., mirrors) and haptic feedback provided through touch (e.g., walking aids such as canes, and real-time extrinsic feedback provided by a treating physical therapist via tactile cues and/or manual assistance to enhance movement, balance, and motor re-learning) are two of the most common forms of passive SA for balance applications. Modern technology-driven active SA devices typically couple inertial measurement units to estimate body kinematics and/or force plates or pressure-sensitive surfaces to estimate body kinetics with a wearable or off-body processor and a display (Figure 2). A variety of displays have been developed and reported in the literature to explore standing and gait-based feedback applications including arrays of vibrating actuators (, ), electrotactile arrays (), televisions, or other various types of screens, headphones, or speakers (, , ), and combinations of multiple feedback modalities (). Processors have included wearable computers, laptops or desktops, gaming systems (e.g., Nintendo Wii, Kinect), and smartphones (). Specific feedback modalities may be preferential for certain patient populations based on compatibility with intact sensory systems (e.g., non-auditory information transfer for people with hearing loss). Likewise, for prolonged use, certain display modalities may pose challenges during activities of daily living. Presently, several devices (e.g., BalanceFreedom™ and SwayStar International™, and Vertiguard™) have been approved for use in Europe and South America. To date, a limited number of active SA devices have been approved by the FDA for use within the U.S. as a real-time balance or rehabilitation tool (e.g., Biodex Vibrotactile™ System). For the purposes of this critical review, we will explore potential general mechanisms of use as opposed to focusing on mechanisms associated with specific feedback modalities.
Figure 2
Real-time use findings
Based on the published studies to date, the most likely dominant mechanism underlying balance benefits with real-time use of SA involves cognition; specifically, real-time SA cues are perceived, cognitively processed, and acted on based on the behavioral instructions assigned to the cues. The cognition hypothesis is supported by data that demonstrates that people's balance improves during the real-time use of SA cues compared to when no cues are provided, people's balance worsens when inaccurate cues are provided, people's balance is further improved when more information about body motion is provided, and people's temporal responses to the cues are on the order of several hundred milliseconds, which is consistent with response times associated with perceiving, processing, and responding to the cue.
To the extent that the effectiveness of an SA device depends on cognitive processing, sensory systems that naturally have good conscious representations, such as the auditory system, may be a better choice for delivering SA cues than sensory systems with poorer conscious representations. However, there is a tradeoff to be considered since the SA cues may interfere with the natural contribution to balance control provided by the sensory system used for SA. The auditory system is a good example since SA based on auditory feedback is commonly employed (
The prominent literature base that supports this interpretation is a collection of numerous studies that have shown that people with vestibular deficits (
When provided with erroneous cues, people with vestibular deficits initially demonstrate increased postural sway (
Continuous visual feedback has been shown to result in better performance than discrete visual or vibrotactile feedback, but some subjects reported dizziness when using continuous visual feedback (
Several studies have explored the effects of balance and gait parameters while simultaneously using an SA device and performing a secondary task; the findings partially support the cognition hypothesis because performance on the primary task generally declines when the secondary task is performed. Young subjects were able to use multimodal SA to reduce their trunk sway while walking and simultaneously counting backwards or carrying a tray of water (
Interestingly, Lin et al. demonstrated that both younger and older adults had slower reaction times when performing an auditory reaction time test while using vibrotactile SA (
Mechanical perturbations of the support surface have been employed to study how balance is affected by the use of vibrotactile SA feedback on the trunk. Significant reductions in falls during computerized dynamic posturography sensory organization test (SOT) conditions 5 and 6, which require more reliance on vestibular inputs, have been observed in people with severe vestibular deficits (
It should be noted that multiple studies have shown no reductions in sway during various gait tasks (
Another potential mechanism that may contribute in a limited manner is the non-volitional response that has been observed when participants were presented with vibrotactile stimuli over the internal oblique and erector spinae locations; in addition to the small magnitude, the timing of the responses are likely too slow to have a significant impact on the initiation of postural corrections. Small, non-volitional sway responses to torso-based vibrotactile stimulation have been demonstrated when vibrations were applied over the internal oblique and erector spinae muscles. In these studies, participants were instructed to maintain an upright posture while standing with their arms at their sides. Movements on the order of approximately one degree were observed in the direction of the applied vibration (i.e., stimulation over the internal right oblique area resulted in a forward right movement), however, no motion was observed when stimuli were applied to the external oblique areas (
Vibration has also been used to improve signal detection in individual sensory channels. This particular use of vibration does not directly fit with our definition of SA because the vibration does not directly “convey pertinent information about body orientation for balance” but rather indirectly provides pertinent information by aiming to improve the detection of information obtained from existing peripheral receptors. This method of vibration has been termed stochastic resonance and relies on the theory that noise can improve the transmission and detection of information in some non-linear systems (61). Stochastic resonance applied as vibration to the bottom of the feet has been shown to reduce posture sway in quiet stance (61), one marker of improved feedback control. Others have applied the concept of stochastic resonance to activate the vestibular system via sub-threshold galvanic vestibular stimulation and also showed improvements in posture sway (62); these researchers also noted that a high noise level actually creates a distortion in vestibular feedback, increasing posture sway. Stochastic resonance could influence multiple mechanisms in the posture system. Clearly, the first mechanism is partial sensory restoration because the goal of stimulation is to improve the transmission of information from the peripheral sensors. With the improved transmission within one sensor, it is likely that sensory reweighting would take place because sensory reweighting is influenced by the accuracy and magnitude of peripheral feedback (63–65). The extent to which stochastic resonance impacts cognitive processes that contribute to balance is not well known.
Rehabilitation using augmented sensory feedback
As a rehabilitation tool, SA can enrich and mimic the tactile and verbal cues provided by a physical therapist, thereby facilitating retraining of postural control for different patient populations, especially those with chronic imbalance (
Preliminary, small-scale studies showing balance improvements following training with SA versus. training alone suggest that augmentation facilitated training improves the utilization of available sensory cues via a sensory reweighting process. Sensory organization is an adaptive CNS regulated process, which enables a person to utilize the available, useful and accurate inputs to maintain balance in changing conditions or environments (66). Persons with compromised sensory systems (visual, vestibular, proprioceptive) may be able to use SA via a rehabilitation device to “upweight” (67) the available accurate information from the non-compromised system(s), or possibly enhance the “weakened signal” resulting in improved postural control. It appears that longer duration training with SA has better potential to enhance sensory reweighting (
Several studies have demonstrated short-term retentive effects (
Several studies have examined the incorporation of the Wii Fit balance board, which provides center of pressure (COP) information to the user, for balance training (74–82). Studies comparing the effectiveness of conventional physical therapy to Wii Fit balance training in older adults and persons with unilateral peripheral vestibular hypofunction found that balance training with virtual reality alone was not superior to traditional balance therapy (83, 84). Based on a recent systematic review, there is moderate evidence that visual feedback is beneficial in older adults with balance impairment (85). One study showed no overall benefit of balance training in healthy older adults when training was performed both with and without multimodal (vibrotactile, auditory, and visual) SA (86). Conversely, in a systematic review of frail older adults, both visual and auditory SA were noted to decrease sway although no large-scale randomized control trials were among the studies included (87).
Overall, there is moderate evidence to support the use of SA to improve postural control and gait during rehabilitation. In these balance-training scenarios, the real-time use of SA most likely involves cognition as described in the real-time use findings section above. Additionally, vibrotactile, visual, and/or auditory cues may simply alert users to momentarily attend to the balance or gait task at hand. There is limited evidence thus far for retention and/or carryover effects when the stimulus is removed following multiple training sessions. Longer use of SA has the potential to promote sensory reweighting and central compensation necessary to translate into longer-term retention and/or carryover, however, observed improvements in both control and intervention groups suggest that context-specific adaptation and/or habituation are also occurring.
Sensory augmentation assessment using balance models
It can be difficult to ascertain causal relationships in standing balance because of complex time-delayed feedback interactions. To help interpret complex balance behavior, feedback models of posture control have been used for nearly two decades. To a remarkable extent, a relatively simple mathematical model of balance control, related to the model shown in Figure 1, has been shown to account very well for the dynamic characteristics of body sway evoked by continuously applied rotations of the stance surface or visual scene (88, 89). In the model, the body is represented by a single-segment inverted pendulum. Sensory integration is represented by a weighted summation of body orientation information derived from sensory cues; proprioception (signaling body sway relative to the surface), vision (signaling body sway relative to the visual scene), and vestibular (signaling body motion in space). Spatial cues derived from auditory information may also contribute to body orientation estimates used for balance control. Sensory-to-motor transformation is represented by a “neural controller” that generates time-delayed corrective ankle torque as a function of the integrated sensory information. The parameters of this model (mainly sensory weights, neural controller parameters, and time delay) can be estimated by optimally accounting for the experimentally observed relationship between a perturbing stimulus and the evoked sway response.
This simple model can serve as a reference for considering how SA devices affect different balance mechanisms. Although feedback modeling of SA for balance has not been widely used, three examples are presented below that provide insight into the mechanisms subjects use.
In one set of studies, vibrotactile feedback was provided to the torso of standing participants with vibration encoding a combination of body sway angle and sway velocity (
A second set of studies demonstrated how the modeling results described above contributed to understanding the limited benefits obtained when the vibrotactile feedback was tested in subjects with bilaterally absent vestibular function (
A third study investigated “Sensory Restoration” provided via galvanic vestibular stimulation (GVS) in a subject with bilaterally absent vestibular function (92). The GVS delivered a current across electrodes applied to the mastoid processes behind the ears. In subjects with normal vestibular function GVS evokes sway in the frontal plane. If a vestibular loss subject retains sensitivity to GVS, the possibility exists that GVS feedback could partially restore a vestibular signal that encodes frontal plane body sway. When GVS was applied as a real-time function of frontal plane sway angle and sway velocity, application of system identification methods demonstrated that GVS feedback caused a reduction in sensitivity to a surface-tilt perturbation performed with eyes closed, consistent with a partial restoration of vestibular information for balance control. Since GVS is considered to have its primary net influence on head velocity information encoded by the semicircular canals, experiments using GVS feedback may be directly relevant to predicting changes in balance control afforded by future vestibular prostheses that target electrical activation of the canals.
It is important to note that the studies described above examined only short-term applications of SA devices. It is entirely possible that sensorimotor learning mechanisms could improve effectiveness over time.
Neuroimaging of sensory augmentation
Functional neuroimaging has provided insight into the neural control of movement in human subjects, and how control networks change in response to a variety of interventions and rehabilitation training programs. Not as much progress has been made in understanding the functional brain networks which contribute to static and dynamic balance, however, because most neuroimaging technologies require subjects to lay supine during brain scanning. Moreover, head movements can result in motion artifacts for neuroimaging data. Therefore, most neuroimaging studies of vestibular function have been conducted while participants passively receive vestibular stimulation laying supine and still.
Given the challenges of using neuroimaging tools to study balance control, it is perhaps not surprising that only a few studies have investigated the neural correlates of SA-induced improvements in balance. One exception is a line of work from Wildenberg et al. (93–95), which extends work by Bach-y-Rita using electrotactile tongue stimulation to convey relative head position information [cf. (96)]. This work provides some insight into the underlying mechanisms of at least one form of SA. Initial studies with this device were focused on real-time benefits; it should be noted, however, that the neuroimaging work has all been conducted using a rehabilitation approach. That is, functional neuroimaging was conducted before and after multiple sessions of SA, and, because participants were supine and still during the imaging, the SA system was not used in the scanner.
Brain changes associated with rehabilitation-based sensory augmentation
Wildenberg and colleagues conducted neuroimaging before and after several sessions in which participants wore an accelerometer on the head and had real-time head position information conveyed to them via electrotactile tongue stimulation. This technique has been shown to improve both objective and subjective measures of gait and balance both during real-time use and also extending beyond the stimulation sessions, in both healthy individuals and those with vestibular or visual deficits (97–101). The initial hypothesis was that this particular form of SA was effective due to “spillover” of neural activity from the tongue afferent pathway to the vestibular nuclei, adjacently located in the brainstem (102). To evaluate this hypothesis, Wildenberg et al. (94, 102) acquired functional MRI while balance impaired subjects passively viewed either static or expanding and retracting visual flow both before and after nine sessions of quiet stance coupled with tongue electrotactile SA. The subjects showed greater activity in response to visual flow patterns in brain regions that process visual motion including in the occipital lobe and cerebellar vermis. Interestingly, after training with this SA, postural sway was less susceptible to disturbance when subjects viewed optic flow stimuli, and the over-activation of visual motion processing regions was reduced. These findings support the notion that balance training coupled with SA acted via a sensory reweighting mechanism to reduce reliance on visual cues in balance impaired subjects who were initially overly reliant on visual inputs. There was also increased activity post training in the brainstem, supporting the possibility that activity in the tongue afferent pathway may have spread to vestibular brainstem regions as well.
These authors have also shown that tongue electrotactile stimulation aids balance even when the stimulation carries no information about body position. That is, the pattern of stimulation does not have to be coupled with head motion in order to result in decreased postural sway (93, 102). Stimulation that is not coupled to body position does not meet our definition of SA; we present the findings here however because the studies are direct follow ups to those described in the preceding paragraph. To more precisely investigate the brainstem changes occurring with stimulation, Wildenberg et al. (93) conducted a high resolution MRI study of changes in brainstem activity from 19 sessions of tongue electrotactile stimulation. Prior to the intervention, optic flow stimuli produced activation in several brainstem regions including the trigeminal and vestibular nuclei as well as the superior colliculus. After the stimulation sessions, there was increased activation in the pons. The authors suggested that this increased activity in the pons was in the trigeminal nucleus, part of the tongue afferent pathway. They further hypothesized that spread of excitation from this region to the vestibular nucleus resulted in enhanced balance.
A recent study that evaluated vibrotactile feedback delivered to the torso as a rehabilitation balance aid, coupled with in-home balance training, found evidence that this form of SA also affected sensory reweighting. The group of healthy older adults that trained with SA showed a greater increase in reliance on vestibular inputs from pre to post training than the group that performed balance exercises alone (
Summary
Current SA applications impact balance control through a variety of mechanisms. Because each mechanism has its own characteristic features, it is worth considering which mechanism applies to a given application in order to anticipate its limitations and potential benefits. Real-time feedback via a sensory restoration mechanism likely has the greatest potential for restoring normal balance function since the sensory information flows through neural channels specifically involved in natural balance control. SA using future vestibular implants, galvanic vestibular stimulation, and foot vibrations to enhance proprioception are sensory restoration applications. For real-time use of SA, results favor a cognitive or sensory addition mechanism, but not a sensory substitution mechanism since substitution implies an equivalency between information provided by the SA and natural sensory systems. A cognitive feedback loop that relies on voluntary commands to control balance could have similar functional characteristics to a sensory addition mechanism (e.g., both having long time delays), but reliance on cognitive control would be inferior to sensory addition as a balance aid due to a need for constant attentiveness. Studies that apply long-term SA are needed to see if a balance aid with features of a sensory addition mechanism can evolve through motor learning to behave as a sensory substitution mechanism where the augmented sensory information is used in a manner that is essentially indistinguishable from natural sensory feedback. Prolonged balance training with SA would ideally improve balance after the augmentation is removed. However, there are mixed results supporting this positive retention and carryover. When retention and carryover are found, evidence supports the notion that SA altered sensory integration via a sensory reweighting mechanism. Finally, application of system identification methods employing model-based interpretation of experimental results can provide detailed quantitative measures of the balance control system to assess the effectiveness of SA technologies and rehabilitation strategies.
Statements
Author contributions
KS, RS, WC, AG, SW, and RP wrote the manuscript. AG and RP created the figures.
Acknowledgments
We thank Catherine Kinnaird and Tian Bao for their assistance with creating a figure.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1.
GrantMJBoothA. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. (2009) 26:91–108. 10.1111/j.1471-1842.2009.00848.x
2.
AltschulerELWisdomSBStoneLFosterCGalaskoDLlewellynDMet al. Rehabilitation of hemiparesis after stroke with a mirror. Lancet (1999) 353:2035–6. 10.1016/S0140-6736(99)00920-4
3.
SathianKGreenspanAIWolfSL. Doing it with mirrors: a case study of a novel approach to neurorehabilitation. Neurorehabil Neural Repair (2000) 14:73–6. 10.1177/154596830001400109
4.
RamachandranVSRogers-RamachandranDCobbS. Touching the phantom limb. Nature (1995) 377:489–90. 10.1038/377489a0
5.
Bach-Y-RitaPCollinsCCSaundersFAWhiteBScaddenL. Vision substitution by tactile image projection. Nature (1969) 221:963–4. 10.1038/221963a0
6.
RupertAH. Tactile situation awareness system: proprioceptive prostheses for sensory deficiencies. Aviat Space Environ Med. (2000) A92–9.
7.
WallCIIIWeinbergMSSchmidtPBKrebsDE. Balance prosthesis based on micromechanical sensors using vibrotactile feedback of tilt. IEEE Trans Biomed Eng. (2001) 48:1153–61. 10.1109/10.951518
8.
HegemanJHoneggerFKupperMAllumJH. The balance control of bilateral peripheral vestibular loss subjects and its improvement with auditory prosthetic feedback. J Vestib Res. (2005) 15:109–17.
9.
LewisRF. Vestibular implants studied in animal models: clinical and scientific implications. J Neurophysiol. (2016) 116:2777–88. 10.1152/jn.00601.2016
10.
ZrennerE. Will retinal implants restore vision?Science (2002) 295:1022–5. 10.1126/science.1067996
11.
RubinsteinJT. How cochlear implants encode speech. Curr Opin Otolaryngol Head Neck Surg. (2004) 12:444–8. 10.1097/01.moo.0000134452.24819.c0
12.
GolubJSLingLNieKNowackAShepherdSJBiererSMet al. Prosthetic implantation of the human vestibular system. Otol Neurotol. (2014) 35:136–47. 10.1097/MAO.0000000000000003
13.
GoodworthADWallCIIIPeterkaRJ. Influence of feedback parameters on performance of a vibrotactile balance prosthesis. IEEE Trans Neural Syst Rehabil Eng. (2009) 17:397–408. 10.1109/TNSRE.2009.2023309
14.
GoodworthADWallCIIIPeterkaRJ. A balance control model predicts how vestibular loss subjects benefit from a vibrotactile balance prosthesis. Conf Proc IEEE Eng Med Biol Soc. (2011) 2011:1306–9. 10.1109/IEMBS.2011.6090307
15.
Bach-Y-RitaP. Tactile sensory substitution studies. Ann NY Acad Sci. (2004) 1013:83–91. 10.1196/annals.1305.006
16.
De VolderAGToyamaHKimuraYKiyosawaMNakanoHVanlierdeAet al. Auditory triggered mental imagery of shape involves visual association areas in early blind humans. Neuroimage (2001) 14:129–39. 10.1006/nimg.2001.0782
17.
CollinsCCBach-Y-RitaP. Transmission of pictorial information through the skin. Adv Biol Med Phys. (1973) 14:285–315. 10.1016/B978-0-12-005214-1.50010-8
18.
SienkoKHWhitneySLCarenderWJWallCIII. The role of sensory augmentation for people with vestibular deficits: Real-time balance aid and/or rehabilitation device?J Vestib Res. (2017) 27:63–76. 10.3233/VES-170606
19.
DibbleLENicholsonDEShultzBMacwilliamsBAMarcusRLMoncurC. Sensory cueing effects on maximal speed gait initiation in persons with Parkinson's disease and healthy elders. Gait Posture. (2004) 19:215–25. 10.1016/S0966-6362(03)00065-1
20.
WulfGLewthwaiteR. Optimizing performance through intrinsic motivation and attention for learning: the OPTIMAL theory of motor learning. Psychon Bull Rev. (2016) 23:1382–414. 10.3758/s13423-015-0999-9
21.
HoCHTrioloRJEliasALKigoreKLDimarcoAFBogieKet al. Functional electrical stimulation and spinal cord injury. Phys Med Rehabil Clin N Am. (2014) 25:631–54. 10.1016/j.pmr.2014.05.001
22.
AuduMLLombardoLMSchnellenbergerJRFoglyanoKMMillerMETrioloRJ. A neuroprosthesis for control of seated balance after spinal cord injury. J Neuroeng Rehabil. (2015) 12:8. 10.1186/1743-0003-12-8
23.
BaoTCarenderWJKinnairdCBaroneVJPeethambaranGWhitneySLet al. Effects of long-term balance training with vibrotactile sensory augmentation among community-dwelling healthy older adults: a randomized preliminary study. J Neuroeng Rehabil. (2018) 15:5. 10.1186/s12984-017-0339-6
24.
SienkoKHBalkwillMDOddssonLIWallCIII. Effects of multi-directional vibrotactile feedback on vestibular-deficient postural performance during continuous multi-directional support surface perturbations. J Vestib Res. (2008) 18:273–85.
25.
DozzaMChiariLHorakFB. Audio-biofeedback improves balance in patients with bilateral vestibular loss. Arch Phys Med Rehabil. (2005) 86:1401–3. 10.1016/j.apmr.2004.12.036
26.
DozzaMHorakFBChiariL. Auditory biofeedback substitutes for loss of sensory information in maintaining stance. Exp Brain Res. (2007) 178:37–48. 10.1007/s00221-006-0709-y
27.
DavisJRCarpenterMGTschanzRMeyesSDebrunnerDBurgerJet al. Trunk sway reductions in young and older adults using multi-modal biofeedback. Gait Posture. (2010) 31:465–72. 10.1016/j.gaitpost.2010.02.002
28.
LeeBCKimJChenSSienkoKH. Cell phone based balance trainer. J Neuroeng Rehabil. (2012) 9:10. 10.1186/1743-0003-9-10
29.
AllumJHHoneggerF. Vibro-tactile and auditory balance biofeedback changes muscle activity patterns: Possible implications for vestibular implants. J Vestib Res. (2017) 27:77–87. 10.3233/VES-170601
30.
LinFRFerrucciL. Hearing loss and falls among older adults in the United States. Arch Intern Med. (2012) 172:369–71. 10.1001/archinternmed.2011.728
31.
CamposJRamkhalawansinghRPichora-FullerMK. Hearing, self-motion perception, mobility, and aging. Hear Res. (2018) 369:42–55. 10.1016/j.heares.2018.03.025
32.
BechlyKECarenderWJMylesJDSienkoKH. Determining the preferred modality for real-time biofeedback during balance training. Gait Posture. (2013) 37:391–6. 10.1016/j.gaitpost.2012.08.007
33.
MaCZLeeWC. A wearable vibrotactile biofeedback system improves balance control of healthy young adults following perturbations from quiet stance. Hum Mov Sci. (2017) 55:54–60. 10.1016/j.humov.2017.07.006
34.
GrewalGSSchwenkMLee-EngJParvanehSBhararaMMenziesRAet al. Sensor-based interactive balance training with visual joint movement feedback for improving postural stability in diabetics with peripheral neuropathy: a randomized controlled trial. Gerontology (2015) 61:567–74. 10.1159/000371846
35.
SchwenkMSabbaghMLinIMorganPGrewalGSMohlerJet al. Sensor-based balance training with motion feedback in people with mild cognitive impairment. J Rehabil Res Dev. (2016) 53:945–58. 10.1682/JRRD.2015.05.0089
36.
JungSLeeKKimMSongC. Audiovisual biofeedback-based trunk stabilization training using a pressure biofeedback system in stroke patients: a randomized, single-blinded study. Stroke Res Treat (2017) 2017:6190593. 10.1155/2017/6190593
37.
DozzaMWallCIIIPeterkaRJChiariLHorakFB. Effects of practicing tandem gait with and without vibrotactile biofeedback in subjects with unilateral vestibular loss. J Vestib Res. (2007) 17:195–204.
38.
SienkoKHBalkwillMDOddssonLIWallCIII. The effect of vibrotactile feedback on postural sway during locomotor activities. J Neuroeng Rehabil. (2013) 10:93. 10.1186/1743-0003-10-93
39.
JanssenLJVerhoeffLLHorlingsCGAllumJH. Directional effects of biofeedback on trunk sway during gait tasks in healthy young subjects. Gait Posture (2009) 29:575–81. 10.1016/j.gaitpost.2008.12.009
40.
WallCIIIWrisleyDMStatlerKD. Vibrotactile tilt feedback improves dynamic gait index: a fall risk indicator in older adults. Gait Posture (2009) 30:16–21. 10.1016/j.gaitpost.2009.02.019
41.
VerhoeffLLHorlingsCGJanssenLJBridenbaughSAAllumJH. Effects of biofeedback on trunk sway during dual tasking in the healthy young and elderly. Gait Posture (2009) 30:76–81. 10.1016/j.gaitpost.2009.03.002
42.
ShullPBLurieKLCutkoskyMRBesierTF. Training multi-parameter gaits to reduce the knee adduction moment with data-driven models and haptic feedback. J Biomech. (2011) 44:1605–9. 10.1016/j.jbiomech.2011.03.016
43.
MaCZZhengYPLeeWC. Changes in gait and plantar foot loading upon using vibrotactile wearable biofeedback system in patients with stroke. Top Stroke Rehabil. (2018) 25:20–7. 10.1080/10749357.2017.1380339
44.
LevinILewekMDFeaselJThorpeDE. Gait training with visual feedback and proprioceptive input to reduce gait asymmetry in adults with cerebral palsy: a case series. Pediatr Phys Ther. (2017) 29:138–45. 10.1097/PEP.0000000000000362
45.
LinCCWhitneySLLoughlinPJFurmanJMRedfernMSSienkoKHet al. The effect of age on postural and cognitive task performance while using vibrotactile feedback. J Neurophysiol. (2015) 113:2127–36. 10.1152/jn.00083.2014
46.
LinCCWhitneySLLoughlinPJFurmanJMRedfernMSSienkoKHet al. The use of vibrotactile feedback during dual-task standing balance conditions in people with unilateral vestibular hypofunction. Otol Neurotol. (2018) 39:e349–56. 10.1097/MAO.0000000000001764
47.
WallCIIIKentalaE. Control of sway using vibrotactile feedback of body tilt in patients with moderate and severe postural control deficits. J Vestib Res. (2005) 15:313–25.
48.
GoebelJASinksBCParkerBEJrRichardsonNTOlowinABCholewiakRW. Effectiveness of head-mounted vibrotactile stimulation in subjects with bilateral vestibular loss: a phase 1 clinical trial. Otol Neurotol. (2009) 30:210–6. 10.1097/MAO.0b013e318194f84d
49.
SienkoKHBalkwillMDWallCIII. Biofeedback improves postural control recovery from multi-axis discrete perturbations. J Neuroeng Rehabil. (2012) 9:53. 10.1186/1743-0003-9-53
50.
LeePYGadarehKNaushahiMJGrestyMBronsteinAM. Protective stepping response in Parkinsonian patients and the effect of vibrotactile feedback. Mov Disord. (2013) 28:482–9. 10.1002/mds.25227
51.
AssemanFBronsteinAMGrestyMA. Using vibrotactile feedback of instability to trigger a forward compensatory stepping response. J Neurol. (2007) 254:1555–61. 10.1007/s00415-007-0587-7
52.
WallCIIIWrisleyDOddssonL. Vibrotactile feedback of mediolateral trunk tilt or foot pressure increases locomotor performance in healthy older adults–a pilot study. Conf Proc IEEE Eng Med Biol Soc. (2012) 2012:6145–8. 10.1109/EMBC.2012.6347396
53.
DeutschJEMeriansASAdamovichSPoiznerHBurdeaGC. Development and application of virtual reality technology to improve hand use and gait of individuals post-stroke. Restor Neurol Neurosci. (2004) 22:371–86.
54.
FungJRichardsCLMalouinFMcfadyenBJLamontagneA. A treadmill and motion coupled virtual reality system for gait training post-stroke. Cyberpsychol Behav. (2006) 9:157–62. 10.1089/cpb.2006.9.157
55.
GentheKSchenckCEicholtzSZajac-CoxLWolfSKesarTM. Effects of real-time gait biofeedback on paretic propulsion and gait biomechanics in individuals post-stroke. Top Stroke Rehabil. (2018) 25:186–93. 10.1080/10749357.2018.1436384
56.
LeeBCHoAMartinBJSienkoKH. Effects of co-vibrotactile stimulations around the torso on non-volitional postural responses. Conf Proc IEEE Eng Med Biol Soc. (2012) 2012:6149–52. 10.1109/EMBC.2012.6347397
57.
LeeBCMartinBJSienkoKH. Directional postural responses induced by vibrotactile stimulations applied to the torso. Exp Brain Res. (2012) 222:471–82. 10.1007/s00221-012-3233-2
58.
LeeBCMartinBJHoASienkoKH. Postural reorganization induced by torso cutaneous covibration. J Neurosci. (2013) 33:7870–6. 10.1523/JNEUROSCI.4715-12.2013
59.
LeeBCMartinBJSienkoKH. The effects of actuator selection on non-volitional postural responses to torso-based vibrotactile stimulation. J Neuroeng Rehabil. (2013) 10:21. 10.1186/1743-0003-10-21
60.
MartinBJLeeBCSienkoKH. A cutaneous positioning system. Exp Brain Res. (2015) 233:1237–45. 10.1007/s00221-014-4194-4
61.
CollinsJJPriplataAAGravelleDCNiemiJHarryJLipsitzLA. Noise-enhanced human sensorimotor function. IEEE Eng Med Biol Mag. (2003) 22:76–83. 10.1109/MEMB.2003.1195700
62.
GoelRKofmanIJeevarajanJDe DiosYCohenHSBloombergJJet al. Using low levels of stochastic vestibular stimulation to improve balance function. PLoS ONE (2015) 10:e0136335. 10.1371/journal.pone.0136335
63.
ErnstMOBanksMS. Humans integrate visual and haptic information in a statistically optimal fashion. Nature (2002) 415:429–33. 10.1038/415429a
64.
MergnerTSchweigartGMaurerCBlumleA. Human postural responses to motion of real and virtual visual environments under different support base conditions. Exp Brain Res. (2005) 167:535–56. 10.1007/s00221-005-0065-3
65.
van der KooijHPeterkaRJ. Non-linear stimulus-response behavior of the human stance control system is predicted by optimization of a system with sensory and motor noise. J Comput Neurosci. (2011) 30:759–78. 10.1007/s10827-010-0291-y
66.
OieKSKiemelTJekaJJ. Multisensory fusion: simultaneous re-weighting of vision and touch for the control of human posture. Brain Res Cogn Brain Res. (2002) 14:164–76. 10.1016/S0926-6410(02)00071-X
67.
UmphredDLazaroR. Chapter 23: Balance and vestibular disorders. In: UmphredDA, editor. Neurological Rehabilitation.5th ed.Maryland Heights, MI: Mosby (2006), p. 732–74.
68.
WallCIIIKentalaE. Effect of displacement, velocity, and combined vibrotactile tilt feedback on postural control of vestibulopathic subjects. J Vestib Res. (2010) 20:61–9. 10.3233/VES-2010-0369
69.
BastaDRossi-IzquierdoMSoto-VarelaAGretersMEBittarRSSteinhagen-ThiessenEet al. Efficacy of a vibrotactile neurofeedback training in stance and gait conditions for the treatment of balance deficits: a double-blind, placebo-controlled multicenter study. Otol Neurotol. (2011) 32:1492–9. 10.1097/MAO.0b013e31823827ec
70.
BrugneraCBittarRGretersMBastaD. Effects of vibrotactile vestibular substitution on vestibular rehabilitation — preliminary study. Braz J Otorhinolaryngol. (2015) 81:616–21. 10.1016/j.bjorl.2015.08.013
71.
Rossi-IzquierdoMErnstASoto-VarelaASantos-PerezSFaraldo-GarciaASesar-IgnacioAet al. Vibrotactile neurofeedback balance training in patients with Parkinson's disease: reducing the number of falls. Gait Posture. (2013) 37:195–200. 10.1016/j.gaitpost.2012.07.002
72.
BaoT. Vibrotactile Sensory Augmentation and Machine Learning Based Approaches for Balance Rehabilitation. Ph.D, University of Michigan (2018).
73.
YenCYLinKHHuMHWuRMLuTWLinCH. Effects of virtual reality-augmented balance training on sensory organization and attentional demand for postural control in people with Parkinson disease: a randomized controlled trial. Phys Ther. (2011) 91:862–74. 10.2522/ptj.20100050
74.
ClarkRABryantALPuaYMccroryPBennellKHuntM. Validity and reliability of the Nintendo Wii Balance Board for assessment of standing balance. Gait Posture. (2010) 31:307–10. 10.1016/j.gaitpost.2009.11.012
75.
MeldrumDHerdmanSMoloneyRMurrayDDuffyDMaloneKet al. Effectiveness of conventional versus virtual reality based vestibular rehabilitation in the treatment of dizziness, gait and balance impairment in adults with unilateral peripheral vestibular loss: a randomised controlled trial. BMC Ear Nose Throat Disord. (2012) 12:3. 10.1186/1472-6815-12-3
76.
FuASGaoKLTungAKTsangWWKwanMM. Effectiveness of exergaming training in reducing risk and incidence of falls in frail older adults with a history of falls. Arch Phys Med Rehabil. (2015) 96:2096–102. 10.1016/j.apmr.2015.08.427
77.
BonnechereBJansenBOmelinaLVan Sint JanS. The use of commercial video games in rehabilitation: a systematic review. Int J Rehabil Res. (2016) 39:277–90. 10.1097/MRR.0000000000000190
78.
GandolfiMGeroinCDimitrovaEBoldriniPWaldnerABonadimanSet al. Virtual reality telerehabilitation for postural instability in parkinson's disease: a multicenter, single-blind, randomized, controlled trial. Biomed Res Int. (2017) 2017:7962826. 10.1155/2017/7962826
79.
IruthayarajahJMcintyreACotoiAMacalusoSTeasellR. The use of virtual reality for balance among individuals with chronic stroke: a systematic review and meta-analysis. Top Stroke Rehabil. (2017) 24:68–79. 10.1080/10749357.2016.1192361
80.
TripetteJMurakamiHRyanKROhtaYMiyachiM. The contribution of Nintendo Wii Fit series in the field of health: a systematic review and meta-analysis. PeerJ. (2017) 5:e3600. 10.7717/peerj.3600
81.
MorrisonSSimmonsRColbergSRParsonHKVinikAI. Supervised balance training and wii fit-based exercises lower falls risk in older adults with type 2 diabetes. J Am Med Dir Assoc. (2018) 19:185.e187–5.e113. 10.1016/j.jamda.2017.11.004
82.
PhillipsJSFitzgeraldJPhillisDUnderwoodANunneyIBathA. Vestibular rehabilitation using video gaming in adults with dizziness: a pilot study. J Laryngol Otol. (2018) 132:202–6. 10.1017/S0022215118000075
83.
AlahmariKASpartoPJMarchettiGFRedfernMSFurmanJMWhitneySL. Comparison of virtual reality based therapy with customized vestibular physical therapy for the treatment of vestibular disorders. IEEE Trans Neural Syst Rehabil Eng. (2014) 22:389–99. 10.1109/TNSRE.2013.2294904
84.
MeldrumDHerdmanSVanceRMurrayDMaloneKDuffyDet al. Effectiveness of conventional versus virtual reality-based balance exercises in vestibular rehabilitation for unilateral peripheral vestibular loss: results of a randomized controlled trial. Arch Phys Med Rehabil. (2015) 96:1319–28.e1311. 10.1016/j.apmr.2015.02.032
85.
AlhasanHHoodVMainwaringF. The effect of visual biofeedback on balance in elderly population: a systematic review. Clin Interv Aging (2017) 12:487–97. 10.2147/CIA.S127023
86.
LimSBHorslenBCDavisJRAllumJHCarpenterMG. Benefits of multi-session balance and gait training with multi-modal biofeedback in healthy older adults. Gait Posture. (2016) 47:10–7. 10.1016/j.gaitpost.2016.03.017
87.
ZijlstraAManciniMChiariLZijlstraW. Biofeedback for training balance and mobility tasks in older populations: a systematic review. J Neuroeng Rehabil. (2010) 7:58. 10.1186/1743-0003-7-58
88.
PeterkaRJ. Sensorimotor integration in human postural control. J Neurophysiol. (2002) 88:1097–118. 10.1152/jn.2002.88.3.1097
89.
PeterkaRJ. Simplifying the complexities of maintaining balance. IEEE Eng Med Biol Mag. (2003) 22:63–8.
90.
GoodworthADWallCIIIPeterkaRJ. Application of optimization methods to predict performance of a vibrotactile balance prosthesis. In: Proceedings of 3rd International IEEE EMBS Conference on Neural Engineering Kohala Coast. (2007). p. 510–3.
91.
PeterkaRJWallCIIIKentalaE. Determining the effectiveness of a vibrotactile balance prosthesis. J Vestib Res. (2006) 16:45–56.
92.
PeterkaRJ. Use of galvanic vestibular feedback for a balance prosthesis. Conf Proc IEEE Eng Med Biol Soc. (2012) 2012:6137–40. 10.1109/EMBC.2012.6347394
93.
WildenbergJTylerMEDanilovYPKaczmarekKAMeyerandME. High-resolution fMRI detects neuromodulation of individual brainstem nuclei by electrical tongue stimulation in balance-impaired individuals. Neuroimage (2011) 56:2129–37. 10.1016/j.neuroimage.2011.03.074
94.
WildenbergJTylerMEDanilovYPKaczmarekKAMeyerandME. Electrical tongue stimulation normalizes activity within the motion-sensitive brain network in balance impaired subjects as revealed by group independent component analysis. Brain Connect (2011) 1:255–65. 10.1089/brain.2011.0029
95.
WildenbergJTylerMEDanilovYPKaczmarekKAMeyerandME. Altered connectivity of the balance processing network after tongue stimulation in balance-impaired individuals. Brain Connect (2013) 3:87–97. 10.1089/brain.2012.0123
96.
TylerMDanilovYPBach-Y-RitaP. Closing an open-loop control system: vestibular substitution through the tongue. J Integr Neurosci. (2003) 2:159–66. 10.1142/S0219635203000263
97.
DanilovYTylerMESkinnerKlBach-Y-RitaP. Efficacy of electrotactile vestibular substitution in patients with bilateral vestibular and central balance loss. In: Conference Proceedings– IEEE Engineering in Medicine and Biology Society New York, NY. (2006). p. 6605–9.
98.
DanilovYTylerMSkinnerKHogleRBach-Y-RitaP. Efficacy of electrotactile vestibular substitution in patients with peripheral and central vestibular loss. J Vesti Res. (2007) 17:119–30.
99.
VuillermeNPinsaultNFleuryAChenuODemongeotJPayanY. Effectiveness of an electro-tactile vestibular substitution system in improving upright postural control in unilateral vestibular-defective patients. Gait Posture. (2008) 28:711–15. 10.1016/j.gaitpost.2008.05.017
100.
RobinsonBCookJLRichburgCMCPriceSE. Use of an electrotactile vestibular substitution system to facilitate balance and gait of an individual with gentamicin-induced bilateral vestibular hypofunction and bilateral transtibial amputation. J Neurol Phys Ther. (2009) 33:150–9. 10.1097/NPT.0b013e3181a79373
101.
VuillermeNCuisinierR. Sensory supplementation through tongue electrotactile stimulation to preserve head stabilitation in space in the absence of vision. Invest Ophthalmol Vis Sci. (2009) 50:476–81. 10.1167/iovs.07-1595
102.
WildenbergJTylerMEDanilovYPKaczmarekKAMeyerandME. Sustained cortical and subcortical neuromodulation induced by electrical tongue stimulation. Brain Imag Behav. (2010) 4:199–211. 10.1007/s11682-010-9099-7
103.
NoohiFKCDediosYKofmanISWoodSBloombergJMulavaraASeidlerR. Functional brain activation in response to a clinical vestibular test correlates with balance. Front Syst Neurosci. (2017) 11:11. 10.3389/fnsys.2017.00011
Summary
Keywords
biofeedback, sensory substitution, sensory augmentation, balance, sensory reweighting, balance prosthesis
Citation
Sienko KH, Seidler RD, Carender WJ, Goodworth AD, Whitney SL and Peterka RJ (2018) Potential Mechanisms of Sensory Augmentation Systems on Human Balance Control. Front. Neurol. 9:944. doi: 10.3389/fneur.2018.00944
Received
01 August 2018
Accepted
22 October 2018
Published
12 November 2018
Volume
9 - 2018
Edited by
Emily Keshner, Temple University, United States
Reviewed by
Robert Francis Burkard, University at Buffalo, United States; L. Eduardo Cofré Lizama, The University of Melbourne, Australia
Updates

Check for updates
Copyright
© 2018 Sienko, Seidler, Carender, Goodworth, Whitney and Peterka.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Kathleen H. Sienko sienko@umich.edu
This article was submitted to Movement Disorders, a section of the journal Frontiers in Neurology
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.