Are Supramodality and Cross-Modal Plasticity the Yin and Yang of Brain Development? From Blindness to Rehabilitation
Luca Cecchetti
Ron Kupers
Maurice Ptito
Pietro Pietrini
Emiliano Ricciardi- 1Department of Surgical, Medical, Molecular Pathology and Critical Care, University of Pisa, Pisa, Italy
- 2Clinical Psychology Branch, Pisa University Hospital, Pisa, Italy
- 3BRAINlab, Department of Neuroscience and Pharmacology, Panum Institute, University of Copenhagen, Copenhagen, Denmark
- 4Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA
- 5Laboratory of Neuropsychiatry, Psychiatric Centre Copenhagen, Copenhagen, Denmark
- 6School of Optometry, Université de Montréal, Montréal, QC, Canada
- 7MOMILab, IMT School for Advanced Studies Lucca, Lucca, Italy
Research in blind individuals has primarily focused for a long time on the brain plastic reorganization that occurs in early visual areas. Only more recently, scientists have developed innovative strategies to understand to what extent vision is truly a mandatory prerequisite for the brain’s fine morphological architecture to develop and function. As a whole, the studies conducted to date in sighted and congenitally blind individuals have provided ample evidence that several “visual” cortical areas develop independently from visual experience and do process information content regardless of the sensory modality through which a particular stimulus is conveyed: a property named supramodality. At the same time, lack of vision leads to a structural and functional reorganization within “visual” brain areas, a phenomenon known as cross-modal plasticity. Cross-modal recruitment of the occipital cortex in visually deprived individuals represents an adaptative compensatory mechanism that mediates processing of non-visual inputs. Supramodality and cross-modal plasticity appears to be the “yin and yang” of brain development: supramodal is what takes place despite the lack of vision, whereas cross-modal is what happens because of lack of vision. Here we provide a critical overview of the research in this field and discuss the implications that these novel findings have for the development of educative/rehabilitation approaches and sensory substitution devices (SSDs) in sensory-impaired individuals.
Preamble
Over the past three decades, thanks to technological advances in sensory substitution (Bach-y-Rita et al., 1969) and functional brain imaging (Veraart et al., 1990; Sadato et al., 1996; Büchel et al., 1998), the study of the “human blind brain” presented neuroscientists with the opportunity to characterize the pivotal role of the (lack of) visual experience in forming a representation of the external world and in shaping brain development.
Sight has always been regarded as the most important sense for humans to interact with the outside world. Nonetheless, adults who are visually deprived since birth show perceptual, cognitive and social capacities that are often similar to those found in sighted individuals.
Historically, the blind brain has been primarily investigated from the perspective of the compensatory ability of early visual areas to process non-visual information (Sadato et al., 1996; for reviews see Frasnelli et al., 2011; Kupers and Ptito, 2011; Renier et al., 2014). At the same time, several experiments have been conducted to understand to what extent visual experience is a mandatory prerequisite for the human brain to develop its morphological and functional architecture (Ricciardi et al., 2014a). So far, several behavioral, structural and functional pieces of evidence have been collected in congenitally, early and late blind populations to characterize the distinct cross-modal plastic adjustments occurring after sensory deprivation on one hand, and the sensory-independent supramodal cortical organization on the other hand.
While supramodality and cross-modal plasticity often are thought of as being competing, mutually excluding explanations for the structural and functional organization in the blind brain, they are likely to represent “two sides of the same coin” or, to better underline their mutual interaction, the “yin and yang” of brain development. As a matter of fact, a great deal of the development of the brain architecture seems programmed to occur despite the absence of any visual experience, leading to a cortical organization able to process specific features of visual as well as of non-visual sensory information. At the same time, the lack of visual experience causes a cross-modal reorganization within portions of those brain areas that are deprived of their normal visual inputs, and start responding to non-visual stimuli.
As detailed below, the fact that brain areas may either respond to a specific information independently from the modality conveying the sensory input (i.e., supramodality) or adapt to respond to alternative non-visual inputs (i.e., cross-modal plasticity) represents the neural mechanism that should be taken into account for the appropriate planning of non-visual educational/rehabilitative programs or for shaping novel sensory-substitution devices (SSDs) in blind individuals.
The Yin of Cross-Modal Plasticity
In cases of congenital absence or late-onset loss of sight, the deafferented subcortical and cortical structures, as well as their constitutive white matter tracts undergo substantial structural and functional reorganization (Ptito et al., 2008; Cecchetti et al., 2016; Reislev et al., 2016). These anatomical modifications are associated with the cross-modal functional recruitment of “visual” cortical areas during several non-visual perceptual (e.g., Watkins et al., 2013) and cognitive (e.g., Bedny et al., 2015) tasks. In addition, congenital, but not late, loss of sight is associated with an increased functional connectivity between primary auditory cortex and “visual” occipital regions, which relies on direct pathways (i.e., heteromodal connections), rather than on feedback inputs from associative brain areas (Collignon et al., 2013).
Interestingly, brain reorganization is not limited to cortical regions. Indeed, congenitally blind subjects encounter significant volumetric reductions of the whole thalamus, and particularly of the lateral geniculate nuclei. In sharp contrast, no volumetric changes were observed in the superior colliculus (Cecchetti et al., 2016). Consistently, congenital and early blind individuals, but not sighted controls, show a crossmodal recruitment of the “visual” midbrain (i.e., superior colliculus) during an auditory task (Coullon et al., 2015).
Early and prolonged lack of visual input leads to an adaptative reshaping of the brain that spreads beyond the visual areas. For instance, Noppeney et al. (2005) found an increase in the size of somatosensory and motor white matter fibers in early blind subjects, whereas others reported a thickening of the cingulate and frontal cortical areas, together with a thinning of the somatosensory and auditory cortex (Park et al., 2009). On the other hand, functional studies revealed a substantial reorganization within primary “non-visual” cortices of blind subjects, such as an expansion of the cochleotopic portion of the auditory cortex (Elbert et al., 2002) and enlarged somatotopic representation of the fingers in multifinger Braille blind readers (Sterr et al., 1998). This form of “intramodal” plasticity may depend on the multisensory tuning that occurs during development and that is shaped by specific perceptual learning and experience (Proulx et al., 2014).
Although a significant number of studies have investigated which mechanisms drive the crossmodal reorganization in the blind brain and to what extent its plastic reshaping has functional and behavioral advantages, an unequivocal answer to these questions is not yet available. For instance, if volumetric properties of the occipital lobe can predict behavioral accuracies in pitch discrimination (Voss and Zatorre, 2012), or if the recruitment of “visual” cortex during Braille reading is modulated by blindness onset (Burton et al., 2002), correlations between performance and crossmodal recruitment of deafferented cortical areas has also been demonstrated in a variety of other tasks, such as olfactory (Renier et al., 2013), auditory (Ross et al., 2003; Voss et al., 2008; Renier et al., 2010) and tactile (Kupers et al., 2006).
The Yang of a “Supramodal Mechanism”
There is now ample evidence that the development of the morphological and functional architecture of the human brain is to a large extent independent from visual experience (Pietrini et al., 2004; Ricciardi and Pietrini, 2011; Ricciardi et al., 2014a,b,c). Supramodal (or metamodal, with a Latin or a Greek root, respectively) responses do not depend on a specific sensory modality, but rather on the distinct content to respond. Some authors therefore refer to “task-specific sensory-independent” activity (e.g., Heimler et al., 2015) to indicate how supramodal brain areas respond to a given perceptual information or task, independently from the sensory modality that conveys the input to the brain.
Supramodal processing within the “visual” extrastriate system has been studied in both sighted and congenitally blind individuals. In particular, research has been conducted on form recognition, motion discrimination, spatial and navigational processing, using visual and non-visual sensory tasks in both congenitally blind and sighted individuals (e.g., Sathian et al., 1997; Zangaladze et al., 1999; Amedi et al., 2001; Hagen et al., 2002; James et al., 2002; Merabet et al., 2004; Pietrini et al., 2004; Cate et al., 2009; Kitada et al., 2009, 2014). These studies have demonstrated that neural responses in “visual” areas during non-visual processing are not merely related to visual imagery, and that visual experience is not a mandatory prerequisite for the functional specialization within the visual system (Pietrini et al., 2004; for a review see Ricciardi and Pietrini, 2011).
The fact that specialized subregions of the “visual” system are supramodally recruited has been confirmed using several protocols that conveyed the same information (i.e., shape form, spatial layout, etc.) across different non-visual sensory modalities and demonstrated overlapping neural responses in both sighted and blind samples. Equally, sensory-independent responses can be impaired by transcranial magnetic stimulation (TMS)-induced lesions in task-specific “visual” areas (e.g., Noppeney, 2007 ; Collignon et al., 2011; Frasnelli et al., 2011; Kupers and Ptito, 2011; Kupers et al., 2011). More recently, the employment of multivariate pattern recognition approaches offered a novel tool to demonstrate a shared coding of specific stimulus content, such as shape, motion and action, in both sighted and congenitally blind individuals across different sensory modalities (Pietrini et al., 2004; Mahon et al., 2009; Ricciardi et al., 2013; Dormal et al., 2016; Handjaras et al., 2016). Noteworthy, the homologies in the neural patterns of stimulus representation obtained with multivariate approaches are not typically limited to a mere overlap in the spatial localization of “activated” regions, but actually do involve the intrinsic content of the neural responses, suggesting that sensory-independent representations are somehow (hard)-coded at a neural level (Ricciardi et al., 2013; Handjaras et al., 2016).
What Did We Learn from Sensory-Substitution Studies?
Recent studies using SSDs also support the concept of supramodality. An SSD typically converts visual into non-visual information, and relies on the response of the same brain region that would have selectively processed that “specific visual information”. Consequently, the sensory content provided through SSDs is processed in a task-specific manner by supramodal cortical areas both in sighted and blind individuals. For instance, SSDs that translate “what” (i.e., shape) and “where” (i.e., location) properties of a visual stimulus into auditory information recruit the ventral and dorsal visual pathways in congenitally blind people, respectively (Striem-Amit et al., 2012b; see also Ptito et al., 2012).
Within the extrastriate “visual” cortex, SSDs recruit functional modules tuned to process motion, body-parts and shape information. The motion-sensitive middle temporal cortex (hMT+) is recruited by motion information conveyed by a visual-to-tactile SSD (VTSSD) in sighted and in congenitally blind individuals (Matteau et al., 2010). Similarly, perception of body shapes through a sensory-substitution algorithm in blind subjects is mediated by recruitment of the extrastriate body area (EBA; Striem-Amit and Amedi, 2014). Likewise, a portion of the lateral occipital complex (LOtv) is activated in a shape recognition task using a visual-to-auditory (VASSD) or a VTSSD (Amedi et al., 2007; Ptito et al., 2012). Blind individuals can even process shape and color features by means of SSD-generated auditory stimuli (Abboud et al., 2014). Also, blind individuals recruit the visual word form area (vWFA), a specific brain region that is thought to process the visual representation of letters, when reading through a visual-to-auditory SSD (Striem-Amit et al., 2012a). Of note, the observation that VWFA is also recruited in blind individuals via tactile recognition (Reich et al., 2011) and by sighted subjects during Braille reading (Siuda-Krzywicka et al., 2016), along with the predetermined cortico-cortical wiring of this region with superior temporal and inferior frontal regions in preschoolers (Saygin et al., 2016) confirms the hypothesis of modality-independent processing of information in supramodal regions.
SSDs have been also employed in blind individuals during more complex tasks such as spatial navigation (Kupers et al., 2010; Chebat et al., 2011, 2015; Proulx et al., 2015; for a review). The ability to navigate the environment is crucial in modern urban life, yet it represents a challenging task for blind subjects, in particular when novel routes have to be learned. In addition, spatial navigation strategies differ between congenitally blind and sighted subjects, since the former rely more on egocentric than allocentric coordinates (Pasqualotto and Proulx, 2012; Pasqualotto et al., 2013). Using a VTSSD (tongue display unit—TDU; Bach-y-Rita, 2004), Chebat et al. (2011) demonstrated that congenitally blind individuals are able to detect and avoid obstacles during a spatial navigation task. The ability of visually-deprived individuals to detect and avoid obstacles has been confirmed in a more recent study using the EyeCane, a VASSD (Maidenbaum et al., 2014). Indeed, after a brief training with the EyeCane, congenitally and late blind subjects demonstrated a number of collisions and time to complete a virtual and a real life-size maze, similar to sighted participants with no blindfold (Chebat et al., 2015). For a proper and autonomous interaction with the surrounding space, the capability to follow a specific route and avoid obstacles should also be associated with an active tracking and reaching of objects. The latter abilities have been tested in blindfolded sighted subjects while using EyeMusic (Abboud et al., 2014), a VASSD that translates the spatial location of a target into the pitch of musical notes. Levy-Tzedek et al. (2012) showed that using EyeMusic, participants performed fast and accurate movements similar to those carried out with visual feedback. Kupers et al. (2010) used fMRI to examine the cerebral correlates of navigation in the absence of vision. These authors reported that congenitally blind subjects recruit the parahippocampal cortex (PHC) during TDU-guided spatial navigation, the same area that is activated when sighted individuals perform the same spatial navigation task under full vision. In addition, several other brain regions that are supramodal in nature (Weeks et al., 2000; Ricciardi et al., 2006; Bonino et al., 2008; Wolbers et al., 2011) and are involved in spatial localization and representation, such as the posterior parietal (PPC) and retrosplenial (RSC) cortices, were activated (Figure 1). Finally, a recent report supported the idea that different sensory modalities can produce very similar spatial representations (i.e., supramodal) through SSDs in sighted subjects (Pasqualotto and Esenkaya, 2016). Taken together, the above data suggest that the recruitment of these regions through SSD depends on sensory-independent task-related activity, which encodes a more abstract representation of information content.
Figure 1. A proof of concept for the synergistic interplay between crossmodal and supramodal brain functioning during the spatial navigation task carried out by means of a sensory substitution device (SSD). The recruitment of both modality-independent brain regions within the “spatial navigation network” (i.e., retrosplenial (RSC), parahippocampal (PHC) and posterior parietal cortex (PPC)) and the crossmodal activation of “visual” cortices in blind individuals contribute to avoidance of obstacles and the identification of the correct route.
On the other hand, stimulation protocols via SSDs provided also a strong support to crossmodal plasticity. Therefore, it should not be surprising that most of these SSD-mediated protocols reported activations in the occipital cortex in blind individuals during the use of VASSDs and VTSSDs. For instance, using positron emission tomography (PET), Ptito et al. (2005) demonstrated recruitment of the occipital cortex after a brief training with TDU for congenitally blind individuals, but not for blindfolded sighted controls (Figure 1). The recruitment of occipital regions in blind participants was confirmed by a later TMS experiment from the same group (Kupers et al., 2006). In this study, it was shown that stimulation of the occipital lobe produced tactile sensations of the tongue in blind individuals who were proficient with the TDU. The evidence for a similar cross-modal recruitment has been reported in studies using VASSD in blind subjects (Arno et al., 2001; Collignon et al., 2007; Merabet et al., 2009), and even in sighted participants after training (Renier et al., 2005). In addition, a more recent report suggests that occipital responses induced by SSD in blind individuals are primarily driven by top-down connectivity, i.e., by a specific task rather than a specific sensory channel, and are modulated by blindness duration (Murphy et al., 2016).
These findings suggest that the recruitment of the occipital cortex in proficient blind SSD users, may be mediated by the “unmasking” or strengthening of pre-existing connections (Kupers et al., 2011).
A Contribution to Visual Rehabilitation and Future Challenges
Several findings indicate that the topographic organization of the brain is largely preserved in congenital blindness, and that distinct cortical areas are able to process information independently from the sensory modality that carries that content to the brain. This supramodal organization is a genuine intrinsic characteristic of the brain, as it is also present in sighted individuals. This has important implications not only for the understanding of how the brain works, but also for how blind individuals form a mental representation of the external world. Indeed, the more abstract nature of mental representations in the brain accounts for the ability of congenitally blind individuals to acquire knowledge and interact efficiently with a world that they have never seen. Thus, the blind brain should not be considered as a “disabled”, but as “differentially abled” brain. Therefore, a “sensory isolation” of visually-deprived individuals, by reducing or limiting the exposure to perceptual, cognitive or social experiences, would likely be one of the worst “educational” choices.
As above-mentioned, the specific content of information could be conveyed through non-visual sensory modalities. More importantly, supramodal organization and crossmodal plasticity following lack of vision may both contribute to the rapid adaptation when using SSDs. On the other hand, the relationship between the proficiency in performing a specific task through the use of SSDs and the crossmodal plastic phenomena described in blind individuals is still to be fully exploited, as some authors found no behavioral differences between sighted and blind individuals (Abboud et al., 2014; Maidenbaum et al., 2014).
From an epidemiologic perspective, it should be pointed out that the increase of life expectancy in Western societies has led to an increase in the number of visual impairments due to chronic eye diseases and aging (World Health Organization, 2007). In light of this, the proportion of people losing sight at later stages of life is growing and the study of rehabilitation protocols tailored to meet the needs of “late-blind” individuals are assuming more and more socioeconomic relevance. The research on rehabilitation and neuroprosthetic tools should seriously account for this. In particular, some authors reported that the degree of compensatory changes following loss of sight is influenced by the age of blindness onset and is reflected by the extent of cross-modal recruitment within “visual” occipital areas (Voss et al., 2008; Bedny et al., 2012; Collignon et al., 2013). Thus, late blind individuals could provide a fundamental model to exploit the potential of SSDs in sighted individuals who lost vision later in their lives.
Which kind of information should future SSDs convey? On the one hand, recent studies demonstrated that object recognition through VASSD is affected by capacity and resolution limitations related to the processing of auditory stimuli (Brown et al., 2014; Brown and Proulx, 2016). On the other hand, the description of supramodal responses recently moved from simpler perceptual to more cognitive stimuli, such as actions or events, to emotion and social functioning (Bedny et al., 2009; Ricciardi et al., 2009; Klinge et al., 2010; Mahon et al., 2010). These more complex cognitive tasks rely on distributed brain networks, and are not limited to functionally specialized cortical clusters involved in processing simple sensory features of stimuli. Consequently, at which level (e.g., localized area or network) and how does the supramodal representation of information occur for more complex cognitive tasks? We recently demonstrated that circumscribed brain areas retain a modality-dependent processing of simple unisensory information, whereas larger networks are able to integrate the semantic content of sensory information and to generate a modality-independent representation that matches language and retains the most precise definition of concepts (Handjaras et al., 2016). This supramodal mechanism of distinct levels of stimulus processing may explain how information progresses from a sensory-based towards a more abstract conceptual representation (Mahon and Caramazza, 2011; Ricciardi and Pietrini, 2011; Ricciardi et al., 2013; Handjaras et al., 2016). From a translational perspective, we can ask how rehabilitative approaches or SSDs (which typically dissect and reproduce definite spatio-temporal features of sensory stimuli) will evolve from processing simple sensory information to processing more complex stimuli, including emotional and affective ones. This would indeed represent a major challenge for future translational research.
To conclude, rehabilitation in visually-deprived individuals should be considered as a complex educational and learning process. Rehabilitation is not limited to the “simple” acquisition of a perceptual/cognitive strategy or of the skills needed to utilize an external aid. An innovative and proper rehabilitation strategy comprehends several intimate and socio-environmental aspects of the blind individual—particularly in late-onset blindness—that aim at an autonomous and efficient interacting with the surrounding world.
Author Contributions
LC, RK, MP, PP and ER contributed to the conception of the work; LC, RK, MP, PP and ER drafted the manuscript; LC, RK, MP, PP and ER critically revised the manuscript; All the authors approved the final version of the manuscript.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Abboud, S., Hanassy, S., Levy-Tzedek, S., Maidenbaum, S., and Amedi, A. (2014). EyeMusic: introducing a “visual” colorful experience for the blind using auditory sensory substitution. Restor. Neurol. Neurosci. 32, 247–257. doi: 10.3233/RNN-130338
Amedi, A., Malach, R., Hendler, T., Peled, S., and Zohary, E. (2001). Visuo-haptic object-related activation in the ventral visual pathway. Nat. Neurosci. 4, 324–330. doi: 10.1038/85201
Amedi, A., Stern, W. M., Camprodon, J. A., Bermpohl, F., Merabet, L., Rotman, S., et al. (2007). Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex. Nat. Neurosci. 10, 687–689. doi: 10.1038/nn1912
Arno, P., De Volder, A. G., Vanlierde, A., Wanet-Defalque, M. C., Streel, E., Robert, A., et al. (2001). Occipital activation by pattern recognition in the early blind using auditory substitution for vision. Neuroimage 13, 632–645. doi: 10.1006/nimg.2000.0731
Bach-y-Rita, P. (2004). Tactile sensory substitution studies. Ann. N Y Acad. Sci. 1013, 83–91. doi: 10.1196/annals.1305.006
Bach-y-Rita, P., Collins, C. C., Saunders, F. A., White, B., and Scadden, L. (1969). Vision substitution by tactile image projection. Nature 221, 963–964. doi: 10.1038/221963a0
Bedny, M., Pascual-Leone, A., Dravida, S., and Saxe, R. (2012). A sensitive period for language in the visual cortex: distinct patterns of plasticity in congenitally versus late blind adults. Brain Lang. 122, 162–170. doi: 10.1016/j.bandl.2011.10.005
Bedny, M., Pascual-Leone, A., and Saxe, R. R. (2009). Growing up blind does not change the neural bases of Theory of Mind. Proc. Natl. Acad. Sci. U S A 106, 11312–11317. doi: 10.1073/pnas.0900010106
Bedny, M., Richardson, H., and Saxe, R. (2015). “Visual” cortex responds to spoken language in blind children. J. Neurosci. 35, 11674–11681. doi: 10.1523/JNEUROSCI.0634-15.2015
Bonino, D., Ricciardi, E., Sani, L., Gentili, C., Vanello, N., Guazzelli, M., et al. (2008). Tactile spatial working memory activates the dorsal extrastriate cortical pathway in congenitally blind individuals. Arch. Ital. Biol. 146, 133–146.
Brown, D. J., and Proulx, M. J. (2016). Audio-vision substitution for blind individuals: addressing human information processing capacity limitations. IEEE J. Sel. Top. Signal Process. 10, 924–931. doi: 10.1109/jstsp.2016.2543678
Brown, D. J., Simpson, A. J., and Proulx, M. J. (2014). Visual objects in the auditory system in sensory substitution: how much information do we need? Multisens. Res. 27, 337–357. doi: 10.1163/22134808-00002462
Büchel, C., Price, C., Frackowiak, R. S., and Friston, K. (1998). Different activation patterns in the visual cortex of late and congenitally blind subjects. Brain 121, 409–419. doi: 10.1093/brain/121.3.409
Burton, H., Snyder, A. Z., Conturo, T. E., Akbudak, E., Ollinger, J. M., and Raichle, M. E. (2002). Adaptive changes in early and late blind: a fMRI study of Braille reading. J. Neurophysiol. 87, 589–607.
Cate, A. D., Herron, T. J., Yund, E. W., Stecker, G. C., Rinne, T., Kang, X., et al. (2009). Auditory attention activates peripheral visual cortex. PLoS One 4:e4645. doi: 10.1371/journal.pone.0004645
Cecchetti, L., Ricciardi, E., Handjaras, G., Kupers, R., Ptito, M., and Pietrini, P. (2016). Congenital blindness affects diencephalic but not mesencephalic structures in the human brain. Brain Struct. Funct. 221, 1465–1480. doi: 10.1007/s00429-014-0984-5
Chebat, D. R., Maidenbaum, S., and Amedi, A. (2015). Navigation using sensory substitution in real and virtual mazes. PLoS One 10:e0126307. doi: 10.1371/journal.pone.0126307
Chebat, D. R., Schneider, F. C., Kupers, R., and Ptito, M. (2011). Navigation with a sensory substitution device in congenitally blind individuals. Neuroreport 22, 342–347. doi: 10.1097/WNR.0b013e3283462def
Collignon, O., Champoux, F., Voss, P., and Lepore, F. (2011). Sensory rehabilitation in the plastic brain. Prog. Brain Res. 191, 211–231. doi: 10.1016/B978-0-444-53752-2.00003-5
Collignon, O., Dormal, G., Albouy, G., Vandewalle, G., Voss, P., Phillips, C., et al. (2013). Impact of blindness onset on the functional organization and the connectivity of the occipital cortex. Brain 136, 2769–2783. doi: 10.1093/brain/awt176
Collignon, O., Lassonde, M., Lepore, F., Bastien, D., and Veraart, C. (2007). Functional cerebral reorganization for auditory spatial processing and auditory substitution of vision in early blind subjects. Cereb. Cortex 17, 457–465. doi: 10.1093/cercor/bhj162
Coullon, G. S., Jiang, F., Fine, I., Watkins, K. E., and Bridge, H. (2015). Subcortical functional reorganization due to early blindness. J. Neurophysiol. 113, 2889–2899. doi: 10.1152/jn.01031.2014
Dormal, G., Rezk, M., Yakobov, E., Lepore, F., and Collignon, O. (2016). Auditory motion in the sighted and blind: early visual deprivation triggers a large-scale imbalance between auditory and “visual” brain regions. Neuroimage 134, 630–644. doi: 10.1016/j.neuroimage.2016.04.027
Elbert, T., Sterr, A., Rockstroh, B., Pantev, C., Müller, M. M., and Taub, E. (2002). Expansion of the tonotopic area in the auditory cortex of the blind. J. Neurosci. 22, 9941–9944.
Frasnelli, J., Collignon, O., Voss, P., and Lepore, F. (2011). Crossmodal plasticity in sensory loss. Prog. Brain Res. 191, 233–249. doi: 10.1016/B978-0-444-53752-2.00002-3
Hagen, M. C., Franzén, O., McGlone, F., Essick, G., Dancer, C., and Pardo, J. V. (2002). Tactile motion activates the human middle temporal/V5 (MT/V5) complex. Eur. J. Neurosci. 16, 957–964. doi: 10.1046/j.1460-9568.2002.02139.x
Handjaras, G., Ricciardi, E., Leo, A., Lenci, A., Cecchetti, L., Cosottini, M., et al. (2016). How concepts are encoded in the human brain: a modality independent, category-based cortical organization of semantic knowledge. Neuroimage 135, 232–242. doi: 10.1016/j.neuroimage.2016.04.063
Heimler, B., Striem-Amit, E., and Amedi, A. (2015). Origins of task-specific sensory-independent organization in the visual and auditory brain: neuroscience evidence, open questions and clinical implications. Curr. Opin. Neurobiol. 35, 169–177. doi: 10.1016/j.conb.2015.09.001
James, T. W., Humphrey, G. K., Gati, J. S., Servos, P., Menon, R. S., and Goodale, M. A. (2002). Haptic study of three-dimensional objects activates extrastriate visual areas. Neuropsychologia 40, 1706–1714. doi: 10.1016/s0028-3932(02)00017-9
Kitada, R., Johnsrude, I. S., Kochiyama, T., and Lederman, S. J. (2009). Functional specialization and convergence in the occipito-temporal cortex supporting haptic and visual identification of human faces and body parts: an fMRI study. J. Cogn. Neurosci. 21, 2027–2045. doi: 10.1162/jocn.2009.21115
Kitada, R., Yoshihara, K., Sasaki, A. T., Hashiguchi, M., Kochiyama, T., and Sadato, N. (2014). The brain network underlying the recognition of hand gestures in the blind: the supramodal role of the extrastriate body area. J. Neurosci. 34, 10096–10108. doi: 10.1523/JNEUROSCI.0500-14.2014
Klinge, C., Röder, B., and Büchel, C. (2010). Increased amygdala activation to emotional auditory stimuli in the blind. Brain 133, 1729–1736. doi: 10.1093/brain/awq102
Kupers, R., Chebat, D. R., Madsen, K. H., Paulson, O. B., and Ptito, M. (2010). Neural correlates of virtual route recognition in congenital blindness. Proc. Natl. Acad. Sci. U S A 107, 12716–12721. doi: 10.1073/pnas.1006199107
Kupers, R., Fumal, A., de Noordhout, A. M., Gjedde, A., Schoenen, J., and Ptito, M. (2006). Transcranial magnetic stimulation of the visual cortex induces somatotopically organized qualia in blind subjects. Proc. Natl. Acad. Sci. U S A 103, 13256–13260. doi: 10.1073/pnas.0607806103
Kupers, R., Pietrini, P., Ricciardi, E., and Ptito, M. (2011). The nature of consciousness in the visually deprived brain. Front. Psychol. 2:19. doi: 10.3389/fpsyg.2011.00019
Kupers, R., and Ptito, M. (2011). Insights from darkness: what the study of blindness has taught us about brain structure and function. Prog. Brain Res. 192, 17–31. doi: 10.1016/B978-0-444-53355-5.00002-6
Levy-Tzedek, S., Hanassy, S., Abboud, S., Maidenbaum, S., and Amedi, A. (2012). Fast, accurate reaching movements with a visual-to-auditory sensory substitution device. Restor. Neurol. Neurosci. 30, 313–323. doi: 10.3233/RNN-2012-110219
Mahon, B. Z., Anzellotti, S., Schwarzbach, J., Zampini, M., and Caramazza, A. (2009). Category-specific organization in the human brain does not require visual experience. Neuron 63, 397–405. doi: 10.1016/j.neuron.2009.10.003
Mahon, B. Z., and Caramazza, A. (2011). What drives the organization of object knowledge in the brain? Trends Cogn. Sci. 15, 97–103. doi: 10.1016/j.tics.2011.01.004
Mahon, B. Z., Schwarzbach, J., and Caramazza, A. (2010). The representation of tools in left parietal cortex is independent of visual experience. Psychol. Sci. 21, 764–771. doi: 10.1177/0956797610370754
Maidenbaum, S., Hanassy, S., Abboud, S., Buchs, G., Chebat, D. R., Levy-Tzedek, S., et al. (2014). The “EyeCane”, a new electronic travel aid for the blind: technology, behavior and swift learning. Restor. Neurol. Neurosci. 32, 813–824. doi: 10.3233/RNN-130351
Matteau, I., Kupers, R., Ricciardi, E., Pietrini, P., and Ptito, M. (2010). Beyond visual, aural and haptic movement perception: hMT+ is activated by electrotactile motion stimulation of the tongue in sighted and in congenitally blind individuals. Brain Res. Bull. 82, 264–270. doi: 10.1016/j.brainresbull.2010.05.001
Merabet, L. B., Battelli, L., Obretenova, S., Maguire, S., Meijer, P., and Pascual-Leone, A. (2009). Functional recruitment of visual cortex for sound encoded object identification in the blind. Neuroreport 20, 132–138. doi: 10.1097/WNR.0b013e32832104dc
Merabet, L., Thut, G., Murray, B., Andrews, J., Hsiao, S., and Pascual-Leone, A. (2004). Feeling by sight or seeing by touch? Neuron 42, 173–179. doi: 10.1016/s0896-6273(04)00147-3
Murphy, M. C., Nau, A. C., Fisher, C., Kim, S. G., Schuman, J. S., and Chan, K. C. (2016). Top-down influence on the visual cortex of the blind during sensory substitution. Neuroimage 125, 932–940. doi: 10.1016/j.neuroimage.2015.11.021
Noppeney, U. (2007). The effects of visual deprivation on functional and structural organization of the human brain. Neurosci. Biobehav. Rev. 31, 1169–1180. doi: 10.1016/j.neubiorev.2007.04.012
Noppeney, U., Friston, K. J., Ashburner, J., Frackowiak, R., and Price, C. J. (2005). Early visual deprivation induces structural plasticity in gray and white matter. Curr. Biol. 15, R488–R490. doi: 10.1016/j.cub.2005.06.053
Park, H. J., Lee, J. D., Kim, E. Y., Park, B., Oh, M. K., Lee, S., et al. (2009). Morphological alterations in the congenital blind based on the analysis of cortical thickness and surface area. Neuroimage 47, 98–106. doi: 10.1016/j.neuroimage.2009.03.076
Pasqualotto, A., and Esenkaya, T. (2016). Sensory substitution: the spatial updating of auditory scenes “Mimics” the spatial updating of visual scenes. Front. Behav. Neurosci. 10:79. doi: 10.3389/fnbeh.2016.00079
Pasqualotto, A., and Proulx, M. J. (2012). The role of visual experience for the neural basis of spatial cognition. Neurosci. Biobehav. Rev. 36, 1179–1187. doi: 10.1016/j.neubiorev.2012.01.008
Pasqualotto, A., Spiller, M. J., Jansari, A. S., and Proulx, M. J. (2013). Visual experience facilitates allocentric spatial representation. Behav. Brain Res. 236, 175–179. doi: 10.1016/j.bbr.2012.08.042
Pietrini, P., Furey, M. L., Ricciardi, E., Gobbini, M. I., Wu, W. H., Cohen, L., et al. (2004). Beyond sensory images: object-based representation in the human ventral pathway. Proc. Natl. Acad. Sci. U S A 101, 5658–5663. doi: 10.1073/pnas.0400707101
Proulx, M. J., Brown, D. J., Pasqualotto, A., and Meijer, P. (2014). Multisensory perceptual learning and sensory substitution. Neurosci. Biobehav. Rev. 41, 16–25. doi: 10.1016/j.neubiorev.2012.11.017
Proulx, M. J., Gwinnutt, J., Dell’Erba, S., Levy-Tzedek, S., de Sousa, A. A., and Brown, D. J. (2015). Other ways of seeing: from behavior to neural mechanisms in the online “visual” control of action with sensory substitution. Restor. Neurol. Neurosci. 34, 29–44. doi: 10.3233/RNN-150541
Ptito, M., Matteau, I., Zhi Wang, A., Paulson, O. B., Siebner, H. R., and Kupers, R. (2012). Crossmodal recruitment of the ventral visual stream in congenital blindness. Neural Plast. 2012:304045. doi: 10.1155/2012/304045
Ptito, M., Moesgaard, S. M., Gjedde, A., and Kupers, R. (2005). Cross-modal plasticity revealed by electrotactile stimulation of the tongue in the congenitally blind. Brain 128, 606–614. doi: 10.1093/brain/awh380
Ptito, M., Schneider, F. C., Paulson, O. B., and Kupers, R. (2008). Alterations of the visual pathways in congenital blindness. Exp. Brain Res. 187, 41–49. doi: 10.1007/s00221-008-1273-4
Reich, L., Szwed, M., Cohen, L., and Amedi, A. (2011). A ventral visual stream reading center independent of visual experience. Curr. Biol. 21, 363–368. doi: 10.1016/j.cub.2011.01.040
Reislev, N. L., Kupers, R., Siebner, H. R., Ptito, M., and Dyrby, T. B. (2016). Blindness alters the microstructure of the ventral but not the dorsal visual stream. Brain Struct. Funct. 221, 2891–2903. doi: 10.1007/s00429-015-1078-8
Renier, L. A., Anurova, I., De Volder, A. G., Carlson, S., VanMeter, J., and Rauschecker, J. P. (2010). Preserved functional specialization for spatial processing in the middle occipital gyrus of the early blind. Neuron 68, 138–148. doi: 10.1016/j.neuron.2010.09.021
Renier, L., Collignon, O., Poirier, C., Tranduy, D., Vanlierde, A., Bol, A., et al. (2005). Cross-modal activation of visual cortex during depth perception using auditory substitution of vision. Neuroimage 26, 573–580. doi: 10.1016/j.neuroimage.2005.01.047
Renier, L., Cuevas, I., Grandin, C. B., Dricot, L., Plaza, P., Lerens, E., et al. (2013). Right occipital cortex activation correlates with superior odor processing performance in the early blind. PLoS One 8:e71907. doi: 10.1371/journal.pone.0071907
Renier, L., De Volder, A. G., and Rauschecker, J. P. (2014). Cortical plasticity and preserved function in early blindness. Neurosci. Biobehav. Rev. 41, 53–63. doi: 10.1016/j.neubiorev.2013.01.025
Ricciardi, E., Bonino, D., Gentili, C., Sani, L., Pietrini, P., and Vecchi, T. (2006). Neural correlates of spatial working memory in humans: a functional magnetic resonance imaging study comparing visual and tactile processes. Neuroscience 139, 339–349. doi: 10.1016/j.neuroscience.2005.08.045
Ricciardi, E., Bonino, D., Pellegrini, S., and Pietrini, P. (2014a). Mind the blind brain to understand the sighted one! Is there a supramodal cortical functional architecture? Neurosci. Biobehav. Rev. 41, 64–77. doi: 10.1016/j.neubiorev.2013.10.006
Ricciardi, E., Handjaras, G., and Pietrini, P. (2014b). The blind brain: how (lack of) vision shapes the morphological and functional architecture of the human brain. Exp. Biol. Med. (Maywood) 239, 1414–1420. doi: 10.1177/1535370214538740
Ricciardi, E., Tozzi, L., Leo, A., and Pietrini, P. (2014c). Modality dependent cross-modal functional reorganization following congenital visual deprivation within occipital areas: a meta-analysis of tactile and auditory studies. Multisens. Res. 27, 247–262. doi: 10.1163/22134808-00002454
Ricciardi, E., Bonino, D., Sani, L., Vecchi, T., Guazzelli, M., Haxby, J. V., et al. (2009). Do we really need vision? How blind people “see” the actions of others. J. Neurosci. 29, 9719–9724. doi: 10.1523/JNEUROSCI.0274-09.2009
Ricciardi, E., Handjaras, G., Bonino, D., Vecchi, T., Fadiga, L., and Pietrini, P. (2013). Beyond motor scheme: a supramodal distributed representation in the action-observation network. PLoS One 8:e58632. doi: 10.1371/journal.pone.0058632
Ricciardi, E., and Pietrini, P. (2011). New light from the dark: what blindness can teach us about brain function. Curr. Opin. Neurol. 24, 357–363. doi: 10.1097/WCO.0b013e328348bdbf
Ross, D. A., Olson, I. R., and Gore, J. C. (2003). Cortical plasticity in an early blind musician: an fMRl study. Magn. Reson. Imaging 21, 821–828. doi: 10.1016/s0730-725x(03)00103-6
Sadato, N., Pascual-Leone, A., Grafman, J., Ibañez, V., Deiber, M. P., Dold, G., et al. (1996). Activation of the primary visual cortex by Braille reading in blind subjects. Nature 380, 526–528. doi: 10.1038/380526a0
Sathian, K., Zangaladze, A., Hoffman, J. M., and Grafton, S. T. (1997). Feeling with the mind’s eye. Neuroreport 8, 3877–3881. doi: 10.1097/00001756-199712220-00008
Saygin, Z. M., Osher, D. E., Norton, E. S., Youssoufian, D. A., Beach, S. D., Feather, J., et al. (2016). Connectivity precedes function in the development of the visual word form area. Nat. Neurosci. 19, 1250–1255. doi: 10.1038/nn.4354
Siuda-Krzywicka, K., Bola, L., Paplińska, M., Sumera, E., Jednoróg, K., Marchewka, A., et al. (2016). Massive cortical reorganization in sighted Braille readers. Elife 5:e10762. doi: 10.7554/eLife.10762
Sterr, A., Müller, M. M., Elbert, T., Rockstroh, B., Pantev, C., and Taub, E. (1998). Perceptual correlates of changes in cortical representation of fingers in blind multifinger Braille readers. J. Neurosci. 18, 4417–4423.
Striem-Amit, E., and Amedi, A. (2014). Visual cortex extrastriate body-selective area activation in congenitally blind people “seeing” by using sounds. Curr. Biol. 24, 687–692. doi: 10.1016/j.cub.2014.02.010
Striem-Amit, E., Cohen, L., Dehaene, S., and Amedi, A. (2012a). Reading with sounds: sensory substitution selectively activates the visual word form area in the blind. Neuron 76, 640–652. doi: 10.1016/j.neuron.2012.08.026
Striem-Amit, E., Dakwar, O., Reich, L., and Amedi, A. (2012b). The large-scale organization of “visual” streams emerges without visual experience. Cereb. Cortex 22, 1698–1709. doi: 10.1093/cercor/bhr253
Veraart, C., De Volder, A. G., Wanet-Defalque, M. C., Bol, A., Michel, C., and Goffinet, A. M. (1990). Glucose utilization in human visual cortex is abnormally elevated in blindness of early onset but decreased in blindness of late onset. Brain Res. 510, 115–121. doi: 10.1016/0006-8993(90)90735-t
Voss, P., Gougoux, F., Zatorre, R. J., Lassonde, M., and Lepore, F. (2008). Differential occipital responses in early- and late-blind individuals during a sound-source discrimination task. Neuroimage 40, 746–758. doi: 10.1016/j.neuroimage.2007.12.020
Voss, P., and Zatorre, R. J. (2012). Occipital cortical thickness predicts performance on pitch and musical tasks in blind individuals. Cereb. Cortex 22, 2455–2465. doi: 10.1093/cercor/bhr311
Watkins, K. E., Shakespeare, T. J., O’Donoghue, M. C., Alexander, I., Ragge, N., Cowey, A., et al. (2013). Early auditory processing in area V5/MT+ of the congenitally blind brain. J. Neurosci. 33, 18242–18246. doi: 10.1523/JNEUROSCI.2546-13.2013
Weeks, R., Horwitz, B., Aziz-Sultan, A., Tian, B., Wessinger, C. M., Cohen, L. G., et al. (2000). A positron emission tomographic study of auditory localization in the congenitally blind. J. Neurosci. 20, 2664–2672.
Wolbers, T., Klatzky, R. L., Loomis, J. M., Wutte, M. G., and Giudice, N. A. (2011). Modality-independent coding of spatial layout in the human brain. Curr. Biol. 21, 984–989. doi: 10.1016/j.cub.2011.04.038
World Health Organization. (2007). Global Initiative for the Elimination of Avoidable Blindness. Geneva: World Health Organization.
Keywords: rehabilitation, blindness, supramodal, crossmodal, sensory substitution, fMRI, MRI
Citation: Cecchetti L, Kupers R, Ptito M, Pietrini P and Ricciardi E (2016) Are Supramodality and Cross-Modal Plasticity the Yin and Yang of Brain Development? From Blindness to Rehabilitation. Front. Syst. Neurosci. 10:89. doi: 10.3389/fnsys.2016.00089
Received: 30 September 2016; Accepted: 27 October 2016;
Published: 08 November 2016.
Edited by:
Chantal Milleret, Collège de France - Interdisciplinary Center for Research in Biology (CIRB), FranceReviewed by:
Michael J. Proulx, University of Bath, UKAnne G. De Volder, Université Catholique de Louvain, Belgium
Copyright © 2016 Cecchetti, Kupers, Ptito, Pietrini and Ricciardi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution and reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Luca Cecchetti, cecchetti.luca@gmail.com