Original Research ARTICLE
Looming sensitive cortical regions without V1 input: evidence from a patient with bilateral cortical blindness
- 1Laboratory of Experimental Neuropsychology, Neurology Clinic, Department of Clinical Neuroscience, University of Geneva, Geneva, Switzerland
- 2Brain and Language Lab, Department of Clinical Neuroscience, University of Geneva, Geneva, Switzerland
- 3Faculty of Psychology and Educational Sciences, University of Geneva, Geneva, Switzerland
- 4Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
- 5Department of Psychology, University of Torino, Torino, Italy
- 6Cognitive and Affective Neuroscience Laboratory, Center of Research on Psychology in Somatic Diseases, Tilburg University, Tilburg, Netherlands
- 7Department of Experimental Psychology, University of Oxford, Oxford, UK
- 8School of Psychology, University of Queensland, Brisbane, QLD, Australia
Fast and automatic behavioral responses are required to avoid collision with an approaching stimulus. Accordingly, looming stimuli have been found to be highly salient and efficient attractors of attention due to the implication of potential collision and potential threat. Here, we address the question of whether looming motion is processed in the absence of any functional primary visual cortex and consequently without awareness. For this, we investigated a patient (TN) suffering from complete, bilateral damage to his primary visual cortex. Using an fMRI paradigm, we measured TN's brain activation during the presentation of looming, receding, rotating, and static point lights, of which he was unaware. When contrasted with other conditions, looming was found to produce bilateral activation of the middle temporal areas, as well as the superior temporal sulcus and inferior parietal lobe (IPL). The latter are generally thought to be involved in multisensory processing of motion in extrapersonal space, as well as attentional capture and saliency. No activity was found close to the lesioned V1 area. This demonstrates that looming motion is processed in the absence of awareness through direct subcortical projections to areas involved in multisensory processing of motion and saliency that bypass V1.
Moving stimuli are thought to be highly salient and several studies have suggested that motion is a powerful attractor of attention. For example, in a visual search paradigm, Franconeri and Simons (2003) showed that moving cues (i.e., looming or translating, but not receding cues) decrease the speed with which participants can detect a target presented immediately afterwards at the same location. In another study, Takeuchi (1997) reported that looming motion captured attention more efficiently, observing that subjects were faster in detecting a looming stimulus within a series of receding ones than the converse condition. Moreover, this facilitation was independent of the number of receding distracters present. Similarly, when participants were required to carry out a reaching task, their movements were more rapid when the targets were preceded by a looming cue, even if this cue did not predict the location of the upcoming target (Franconeri and Simons, 2003; Moher et al., 2014). In addition, von Mühlenen and Lleras (2007) demonstrated that when the effect of abrupt onset, which also captures attention, was canceled out by introducing progressive coherence in a moving random dot pattern, attentional capture occurred only for looming cues. Later, and again using a visual search task, Lin et al. (2009) showed that looming captured attention more efficiently when the stimuli were situated in the peripheral field than when they were placed at the center. Furthermore, they demonstrated that the effect was stronger when the looming movement followed a path that was on a collision course with the viewer, as opposed to trajectories that would not have led to an impact. This latter effect was observed even when the viewer was not aware of the difference between possible collision or not (Lin et al., 2009).
A likely explanation for the heightened attentional capture of looming stimuli may be provided by evolutionary psychology, as the early and rapid detection of looming stimuli appears to be an essential factor for the survival of the individual and, on a larger scale, of the species. Indeed, looming stimuli are highly relevant in that they indicate possible collision with the observer. Stereotypical avoidance behavior, such as head withdrawal and covering of the face with the arms have been observed in monkeys for approaching but not receding or randomly moving stimuli (King and Cowey, 1992). This has also been found in adult humans (King et al., 1992) as well as infants as young as 2–11 weeks of age (Ball and Tronick, 1971). Such defensive behavior and its presence at an early age suggest that this phenomenon is largely automatic and preattentive, and could also operate outside the focus of awareness.
From a general perspective, unconscious processing of visual stimuli has also been observed in patients suffering from cortical blindness. This has been termed “blindsight” and is “a condition in which the sufferer responds to visual stimuli without consciously perceiving them” (Weiskrantz et al., 1974). One patient, DB, who presented right hemianopia, was able to guess correctly if a stimulus was moving in his blind field although he had no conscious experience of “seeing” the stimulus (Weiskrantz, 1986). Subsequently, the neural substrates of motion blindsight were investigated using PET and fMRI imaging techniques, in single cases (Barbur et al., 1993; Zeki and Ffytche, 1998; Goebel et al., 2001; Schoenfeld et al., 2002; Bridge et al., 2010), as well as in group studies (Morland et al., 2004; Barleben et al., 2014; Ajina et al., 2015). The sum of evidence points to the activation of hMT/V5 in response to motion despite the lesions to V1 and in most cases, in the absence of visual awareness.
Less is known about the effects of direction of motion in blindsight, in particular looming motion. In monkeys, looming was investigated after unilateral ablation of the occipital cortex (King and Cowey, 1992). This was experimentally induced with a hoop, the size of a tennis racket that approached the monkeys in their blind, or in their seeing visual half field. Avoidant head movements to the looming stimulus were recorded in two out of three monkeys when presented in their blind (as well as in their seeing) visual half fields. Due to the inability of the primary visual cortex to process visual information, it was hypothesized that this withdrawal response was mediated by the subcortical retinal-superior colliculus (SC) mediated pathway (King and Cowey, 1992).
To the best of our knowledge, no studies have addressed the effect of looming motion in cortical blindness in humans. We therefore examined the response to moving dot patterns in a patient who suffers from complete cortical blindness following bilateral strokes to the posterior cerebral arteries. This patient, TN, has been described elsewhere and was shown to present remarkable residual visual abilities including affective blindsight (Pegna et al., 2005; Burra et al., 2013), as well as relatively preserved navigational abilities (de Gelder et al., 2008) and visuo-motor capacities (Buetti et al., 2013). We investigated TN's BOLD response to dot patterns that were either static, or showed rotational, receding or looming movements. In view of the literature, we expected to observe hMT/V5 activity for motion. Critically, our expectation was that looming motion, in view of its salience, would enhance brain activation, possibly recruiting additional structures that play a part in visual salience.
TN is a well-studied cortically blind patient that we have recently described in detail (Van den Stock et al., 2014). He suffered two consecutive posterior strokes leaving him cortically blind due to extensive damage to the occipital cortex bilaterally (Pegna et al., 2005). More specifically, the damage to the right hemisphere encompasses the occipital lobe with some sparing of the posterior lingual gyrus and part of the precuneus. The left hemispere damage is larger and extends anteriorly to the middle part of the fusiform gyrus, laterally to the medial inferior temporal gyrus and dorsally up until the superior parietal lobe, leaving the medial ventral part of the inferior occipital gyrus and anterior part of the lingual gyrus intact. The visual perimetry (described in Van den Stock et al., 2014) demonstrated complete blindness. As previously described, the assessment was carried out by presenting small white 1° circles that were either flickering (20 Hz) or static (stimulus luminance 95 cd/m2; duration 300 ms; interstimulus interval 3000 ms). Stimuli were presented on a 17-inch computer screen (background luminance of screen: 2 cd/m2) at 64 equally-spaced positions on a grid that spanned 48° horizontally and 40° vertically in front of the patient. TN had been unable to report the presence of any stimulus.
Clinically, TN continues to behave as a blind person, for example using a cane as a tool to guide himself while walking, locating food on his plate with his fingers, etc…When in presence of his wife or friends, he will rely on them for navigation, for example by placing his hand on their shoulder when walking. It should be pointed out that nothing in his behavior suggests the spontaneous use of vision to guide his actions.
Despite these observations, he sporadically claims to “feel” the occurrence of visual movement. Despite his alleged impressions of visual movement, a careful clinical assessment revealed numerous misses and false positives in his responses. For example, when asked to attend to the possible movement of the examiner's (AP) finger, he would frequently signal its occurrence before any motion had occurred, while on other occasions, he would fail to respond to entirely. Subsequently, in order to determine the extent of actual movement perception that was possible, TN was presented with a series of random dot stimuli consisting of 1000 ms video clips of static or random movement stimuli. Each stimulus consisted of 13 light points placed randomly on the screen that could move randomly at different speeds. TN was instructed to respond if he detected movement or not. He was informed of the presence of the stimulus on the screen by a beep indicating onset and offset. This was followed by a verbal prompt by the examiner.
TN's performance on this task revealed a hit rate of 63%. Out of 192 stimuli presented (96 moving and 96 static stimuli), TN responded correctly to 121 stimuli. With respect to a binomial distribution, this rate yields a Z score of 3.61 with a probability of chance occurrence at p < 0.001 (two-tailed). Additionally, a d' was computed which yielded a value of 1.43 with a c criterion of 0, demonstrating that the results were not linked to a bias toward a specific response. Consequently, it appears that TN is above chance when detecting moving stimuli although his awareness of motion appears to fluctuate. Of particular importance in the current investigation, TN was unable to describe the type of stimulation that was presented to him in the scanner.
He participated in the present experiment aged 62, i.e., 10 years after the loss of conscious visual perception. He gave his informed consent to participate in this study that was approved by the Ethics Committee of Geneva University Hospital.
Videos of dot-fields on a black background were generated to mimic various types of motion, namely: looming, receding, rotation (either clockwise or anticlockwise), and a static condition. Stimuli were back-projected onto a screen of size 40.5 × 24.2 cm with a resolution of 1680 × 1050 pixels, placed behind the participant's head. The participant viewed the screen through a mirror attached to the head coil, with a viewing distance of approximately 75 cm. Dots (diameter 0.18° of visual angle) were presented in a neutral gray (defined by RGB values set to 46.7%) on a black background. Stimuli were generated using Matlab 7.14 (The Mathworks, Natick, MA, USA). Video clips lasted 2 s at 30 frames per second.
Dots were distributed placed on the perimeter of three imaginary concentric squares. Eight points were placed in this manner, four on the apices and four on the midpoints of each side, such that all stimuli were composed of 24 dots (see Figure 1 for a schematic illustration of the stimuli). Each of the motion conditions was created with four different velocities. Rotating stimuli were presented at rates of 120, 90, 60, and 30°/s. Looming and receding stimuli expanded and contracted by rescaling of the squares defined by the dots at rates (k) of 1.05, 1.1, 1.15, 1.2 per frame (at 30 frames per second at time t, in seconds, the rate of expansion is defined as k30t). The rate of change of size therefore described an exponential relationship as a function of proximity to the edge of the screen, increasing closer to the edges. The edges of the smallest square subtended 0.60° of visual angle and those of the largest (extending to almost the corners of the screen) 18.33°.
Figure 1. Different types of motion presented in the experiment, illustrating frames from the static, looming, receding, and rotating conditions. Dashed lines and arrows indicate illustrative trajectories of dots for each condition. Equiluminance of the stimuli was preserved by maintaining the number of dots at any time in all conditions. In the looming conditions, dots passing the edge of the screen were replaced by dots at the center while for receding stimuli, dots disappearing to the center of the screen were replaced with dots at the edges.
Equiluminance of the stimuli was preserved by always having the same number of dots present on screen at any time, irrespective of condition (for the looming conditions, dots passing the edge of the screen wrapped around to the center of the screen, and for receding stimuli, dots disappearing to the center of the screen wrapped around to the edges).
A block design was employed in which videos of a given motion type were presented for 16 s (each speed of motion was presented twice in a random sequence, for rotation trials clockwise and anticlockwise stimuli were presented in equal numbers at each speed in a random sequence), followed by a 16 s period of no stimulation (a black screen). Block (i.e., motion condition) sequence was randomized. The fMRI session was divided into four runs, each of which contained two blocks of each motion condition, and the associated null events. Stimulus delivery was controlled using custom routines developed for PsychoPy (Peirce, 2007).
MRI Acquisition, Preprocessing, and Analysis
Anatomical and functional MR images were acquired in Maastricht University, with a 3T whole-body scanner (Magnetom Trio, Siemens, Erlangen, Germany) equipped with a 20-element head-neck coil.
T2*-weighted functional images were acquired using a gradient echo EPI sequence, with 2 × 2 × 2 mm3 resolution, covering the whole brain (75 slices without gaps, TR = 2000 ms, TE = 31 ms, flip angle = 62, multiband acceleration factor = 3, FOV = 172 × 172, matrix size = 96 × 96). Sixteen scans were acquired per condition per session, for a total of 64 per condition over the experiment.
In addition, a T1-weighted anatomical image (1 × 1 × 1 mm3 isotropic) was acquired with using an MPRAGE sequence (TR = 2250 ms, TE = 2.17 ms).
Stimuli were back-projected onto a screen placed behind the participant's head. The participant viewed the screen through a mirror attached to the head coil, with a viewing distance of approximately 75 cm. The patient was asked to keep his eyes open and oriented straight ahead during the experimental presentation. His direction of gaze was monitored with an eye tracker camera, although it was not possible to obtain calibration values due to his inability to see the calibration points.
Preprocessing and analysis of the data was carried out in SPM8 (http://www.fil.ion.ucl.ac.uk/spm/). Data preprocessing proceeded as follows:
(1) Rigid realignment of each EPI volume to the first in the session, using a two-pass procedure in which the images are realigned to the mean image created after a first-pass realignment,
(2) Coregistration of the MPRAGE image to the mean EPI image,
(3) Spatial smoothing using a Gaussian kernel of 8 mm at full-width half-maximum height.
In order to be able to compare the patient's neuroanatomy with that of existing atlases, we normalized the T1 anatomical image to the standard MNI template included in SPM8, using the “unified segment” procedure (Ashburner and Friston, 2005), which is relatively robust in the face of lesions (Crinion et al., 2007). The normalization parameters generated by this process were subsequently applied to the contrast images produced by the functional analysis. Activation co-ordinates are reported in MNI space and region identification was assisted by use of the AAL (automated anatomical labeling, Tzourio-Mazoyer et al., 2002) and Brodmann area templates, both supplied with MRIcroN (Rorden, 2011), more precise denominations were obtained using the Anatomy toolbox (version 20, retrieved from http://www.fz-juelich.de/inm/inm-1/EN/Forschung/_docs/SPMAnatomyToolbox/SPMAnatomyToolbox_node.html Eickhoff et al., 2007).
The preprocessed EPI images were submitted to a GLM analysis, in which each scan was coded for a condition (looming, receding, rotating, static) and null events were left unmodeled (after Josephs and Henson, 1999). Each of the four sessions was modeled separately and the effect of session was coded separately. Each event was modeled using the canonical haemodynamic response function in SPM8. Six parameters were appended in each of the sessions to code for the effects of movement (x, y, and z translations and x, y, and z rotations derived from the rigid realignment step of the pre-processing). A high-pass filter (cutoff 128 s) and AR1 correction for serial autocorrelation were applied. The parameter estimates of the GLM were then compared to obtain contrast images revealing the differences in BOLD response between the various conditions.
A control group, composed of eight right-handed male participants (mean age: 58 years, range: 55–62) with normal or corrected-to-normal vision and no history of head injury was scanned using the same experimental paradigm. Control participants were scanned at Geneva University Hospitals, on a 3T Siemens Prisma, with a 20-channel head-and-neck coil. Screen-size and resolution for stimulus presentation were as for TN. Since, for operational reasons, these participants could not be scanned on the same scanner as TN, only qualitative comparisons of these data will be presented.
The control participants' data was analyzed at the first, fixed-effects level as TN's data. In order to obtain estimates of reliable activity over the group, contrast estimates from each of the participants were subsequently analyzed at the second, random-effects level. Second-level analysis comprised a repeated-measures ANOVA, in which the first-level condition vs. baseline images for each participant were entered into a design matrix to test for between-condition differences. In order to account for between-participant variability, “subject” was included as a factor in the analysis. Analysis was carried out in SPM8, following the methods described by Henson and Penny (2005).
Since the primary focus of this paper is on the detection of looming stimuli by the brain's subcortical pathways, analyses will focus on the areas selectively activated by these stimuli, and particularly in contrast to those engaged by receding stimuli. The effect of speed of movement on BOLD response in each of the different movement conditions was tested and no significant effects were found. As a result, this condition was collapsed.
For completeness, results are presented at a relatively liberal threshold of uncorrected p < 0.0001 with a cluster-extent threshold (K) empirically determined (using a modified script retrieved from: http://www-personal.umich.edu/~nichols/JohnsGems2.html) for each contrast that is presented using a Newton Raphson search procedure to yield clusters significant at p(FWE) < 0.05 at the cluster level. Results that are discussed are significant at p(FWE) < 0.05 either at the voxel level or the cluster level (based on the cluster extents at uncorrected p < 0.0001).
Looming vs. Receding
The subtraction of looming and receding stimuli revealed a difference in BOLD response in a number of areas (see Figure 2; Table 1). A significant increase in activation was found in bilateral posterior middle temporal regions. This cluster was extensive in both hemispheres, covering a large region of the posterior middle temporal gyrus through the inferior temporal cortex. A further substantial cluster of difference in BOLD response was found in the right parietal lobe, centered about the angular gyrus. A cluster of slightly right-lateralised activation difference was observed in the precuneus and the middle cingulate cortex. Finally, a difference in activation for looming vs. receding stimuli was found in the left inferior parietal lobule.
Figure 2. Selected slices of the T1 anatomical scan, upon which are projected the clusters of significant BOLD response difference for the contrast Looming—Receding, thresholded at p (uncorrected) < 0.0001, with a cluster extent threshold (k) of 75 voxels. This value of k was empirically determined to be the level for which clusters composed of voxels at least meeting uncorrected p < 0.0001 would reach familywise-error corrected significance at the cluster level. No co-ordinates are given here as the images are presented in the patient's native space. For comparison with previously published data and atlases, the co-ordinates of the activation differences are presented normalized to MNI-space in Table 1. Graphs indicate the relative activation relative to baseline for each movement condition, error bars indicate 95% confidence intervals.
It can be seen from the plots of relative activation levels presented in Figure 2 that the pattern of responses to the various categories of motion in these regions is broadly similar. In essence, there is an elevated response to looming stimuli, a decrease in BOLD contrast in response to receding stimuli, and a minimal response to rotating or static stimuli. This pattern of responses suggests that the residual visual processing pathways in TN are specifically sensitive to the relatively more-salient looming stimuli. While it can be difficult to interpret decreases in BOLD response meaningfully, they have been demonstrated to index neural deactivation in early visual cortex (Pasley et al., 2007). If this is indeed the case, then it suggests that the areas showing negative BOLD responses here are sensitive to the direction of movement of dot fields, specifically as a function of their apparent looming.
Surprisingly and in sharp contradistinction with TN, control participants did not manifest any significant increase in BOLD response to looming over receding stimuli.
In order to determine whether any differential activation was reliably present for movement and therefore if a differential BOLD response could be observed in comparison with baseline, we examined the main-effect of motion in both TN and the control group. This result is described in the next section.
Main-effect of Movement
The results of this analysis is illustrated in Figure 3A; Table 2A for the control group and in Figure 3B; Table 2B for TN. In controls, significant stimulus-induced differences in BOLD response are seen in extrastriate visual regions, corresponding to the fusiform gyrus on the right and to MT/V5 bilaterally (Figure 3A). In order to compare the locus of differential motion-sensitivity in the controls and TN, the map of the control group's significant activation was warped to TN's native space (Figure 3B). A side-by-side comparison of the controls' and patient's activation patterns indicates that the locus of TN's possibly-equivalent posterior middle temporal response is anterior to that of the controls, and the response observed in the inferior parietal lobe (IPL) is situated dorsal to that of the controls. It is also worth noting that some portions of the control group's response fall inside the region of TN's lesion.
Figure 3. (A) Main effect of condition in the control participants (repeated-measures ANOVA, four levels: Loom, Recede, Rotate, Static), showing significant differences in BOLD response thresholded at p (uncorrected) < 0.0001, with a cluster extent threshold (k) of 70 voxels. This value of k was empirically determined to be the level for which clusters composed of voxels at least meeting uncorrected p < 0.0001 would reach familywise-error corrected significance at the cluster level. Data are projected onto the average T1 structural image of the control participants, normalized to MNI space. Co-ordiantes indicate plane of section of each slice. (B) The main-effect of condition in the control participants as in (A), but projected into TN's native space, displayed upon TN's T1 structural scan, and presented alongside the map of significant main effect of condition for TN (thresholded as for controls, k was determined to be 77).
This study investigated the cerebral response to moving (looming) stimuli in a patient (TN) who became cortically blind after having suffered a bilateral loss of his primary visual cortex. In addition, an age- and gender-matched control group was scanned for comparison purposes. The results in TN showed that looming activated a network that included the posterior middle temporal lobes bilaterally, the left inferior parietal region, the right angular gyrus and the right precuneus. This occurred despite the fact that the patient could not detect the direction of motion of the stimuli or even their presence. Surprisingly, data obtained in the control group failed to produce any significant activation for looming, although motion per se produced a significant effect in areas MT/V5.
The importance of the motion selective region MT/V5 in humans was identified after a patient with bilateral damage to these areas was described. The patient was subsequently impaired in motion processing, suffering from what is known as akinetopsia (Zihl et al., 1983, 1991). In healthy controls, the first brain imaging techniques addressing the question of cerebral specialization for visual processing found activation in the same regions in response to moving stimuli (Zeki et al., 1991), confirming the specificity of this area for motion processing. The activations found in our control group for motion are therefore entirely consistent with the literature and add to the large corpus of existing reports showing an increased response in area MT/V5 for movement.
By contrast, data from TN was slightly more surprising. Indeed, activation for motion in TN was not comparable to controls. The superimposition of the control group's regions of activation onto TN's brain revealed a certain amount of overlap of these clusters with the damaged areas. In TN, regions of significant activation for motion were in fact situated in the left middle temporal gyrus, the right inferior temporal gyrus and the angular gyrus. Furthermore, looming yielded several distinct areas of activation, including two clusters in the posterior middle temporal regions, one of them (on the left) coinciding with the area activated for movement per se.
The activation of these middle temporal areas in TN were rather unexpected. Indeed, we had anticipated the activation of more posterior regions compatible with MT/V5. However, even allowing for the possibility of errors occurring in the normalization and warping procedures, the localization of the middle temporal clusters appears too posterior and therefore do not appear to be compatible with known hMT+ regions in the healthy brain (Watson et al., 1993; Dupont et al., 1994; Goebel et al., 1998; Sunaert et al., 1999). Nevertheless, the fact that the (left) middle temporal region in TN responds to the movement conditions, and that TN's lesion extends toward and partly overlaps with MT/V5 locations in our controls, suggests that cortical plasticity may have led to changes in the regions surrounding the lesion. As a result, more anterior areas may have become involved in motion processing through neural projections from subcortical structures and could thus have partly taken over the functions normally subserved by MT/V5. Further investigation would however be necessary to confirm this suggestion. As noted above, investigations of residual visual motion processing in cases of hemianopia have revealed activation in regions compatible with hMT/V5. Zeki and Ffytche (1998) studied patient GY's response to moving stimuli using PET, and established a response in what appeared to be area hMT/V5. This was subsequently confirmed with fMRI in patient GY, as well as in two other patients with hemianopia (Goebel et al., 2001; Schoenfeld et al., 2002). More recently, Bridge et al. (2010) studied a patient with bilateral partial loss of the striate cortex and found hMT/V5 activation bilaterally, but none in V1, in response to random dot kinematograms. Furthermore, the authors observed intact tracts between LGN and hMT/V5, while those between LGN and V1 showed evidence of degeneration. This finding corroborates the hypothesis that hMT/V5 may receive information through a direct pathway from the LGN. Indeed, one of the two dominant views has suggested that neurons from the LGN may project directly to extrastriate visual cortex, possibly from intralaminar k-cells, allowing information to be processed independently of V1 (Cowey and Stoerig, 1989; Schmid et al., 2010). Alternatively, a second influential view suggests that a subcortical pathway to the SC and pulvinar, and from there to the extrastriate region may be the most likely route allowing V1-independent processing to take place (Rodman et al., 1990; Kato et al., 2011). In line with this hypothesis, in a very recent fMRI study (Barleben et al., 2014), BOLD response (and diffusion tensor imaging –DTI–) was measured in eight hemianopics during stimulation by moving bars. Six out of eight patients showed an hMT response to motion, and both lesional as well as DTI results pointed to the pulvinar as a likely component of the pathway, echoing previous findings in healthy controls (Lanyon et al., 2009).
More recently, another hypothesis has suggested that blindsight may be linked to the transfer of visual information between healthy and lesioned hemispheres (Leh et al., 2006; Bridge et al., 2008; Silvanto et al., 2009). In view of the bilateral lesions in TN, this interpretation cannot be upheld as neither hemisphere is able to process visual information through V1.
Our current findings do not allow us to determine whether the geniculo-extrastriate or colliculo-pulvinar routes are involved in conveying information to the cortical regions activated in TN's brain. Nevertheless, activation was observed in the middle temporal regions (bilaterally for looming and on the left for motion) demonstrating the recruitment of typically non-visual cortex for movement processing and suggesting that cortical reorganization may have led more anterior regions to perform some of the functions usually performed by hMT+/V5, and more importantly, showing a heightened response to radially approaching movement.
The increased sensitivity of modality-specific cortical regions for looming has been observed on different occasions. For example, in a study addressing looming from a multimodal perspective, Tyll et al. (2013) compared auditory and visual looming and receding stimuli in healthy subjects. Looming stimuli enhanced the fMRI signal in both the visual and auditory cortices. Additionally, multisensory audiovisual looming stimuli enhanced the STS region and the visual cortex in a superadditive manner. This cortical coupling effect was explained by a psychophysiological interaction analysis that showed increased connectivity between the seeded STS and the visual cortices during looming compared to receding stimuli (Tyll et al., 2013). Thus, cortical feedback connections were hypothesized to be at play during the processing of these salient stimuli (Tyll et al., 2013).
In another brain imaging study with healthy controls, the existence of a collicular route for processing of looming was evidenced. Billington et al. (2011) compared brain activation in response to a moving ball made of point lights under conditions of looming, receding and random motion. In addition to a large cortical network, looming enhanced the response of the SC, as well as the medial pulvinar, corroborating the view that a collicular pathway might convey information to cortical regions for unconscious processing of motion when V1 is damaged.
The evidence for an enhanced activation of modality-specific cortical regions in response to looming is in line with TN's heightened cortical response. The preference of the sensory system for looming stimuli shows that an organism is biased toward stimuli reflecting possible collisions and thus potential threat. In point of fact, such enhanced processing for threatening stimuli has received much attention in the field of affective science, and findings have revealed that stimuli such as threatening facial expressions enhance stimulus-specific visual cortical areas and can in fact do so both when stimuli are consciously detected or not (Vuilleumier et al., 2004; Rotshtein et al., 2010; Van den Stock et al., 2013, 2014).
Little is known about whether looming may be processed in the absence of awareness. One study addressed this using a binocular rivalry task. In binocular rivalry, the viewer can usually only report the stimulus in one of the two eyes, while the stimulus in the other is not consciously detected. Although the conscious percept shifts from one eye to the other in equal proportions, a more salient stimulus tends to be consciously perceived more often, catching the viewer's awareness. Following this line of reasoning, Parker and Alais (2007) presented receding stimuli to one eye and approaching stimuli to the other. They found that participants reported the looming stimuli for longer durations, demonstrating that they attracted attention and broke into awareness more easily. Consequently, looming must be processed prior to awareness. Similar conclusions have been reached with patients suffering from brain damage. When patients with right parietal lobe lesions and visual extinction are presented with stimuli in the left and right spatial field simultaneously, they cannot report the stimulus in their extinguished (left) field. Dent and Humphreys (2011) showed that during bilateral stimulus presentations, looming overcame extinction. Patients reported the presence of the expanding, but not the contracting stimuli presented on the left, again showing that looming must be processed pre-attentively and prior to awareness. Rather unfortunately, we were unable to test TN behaviorally with looming stimuli. Nevertheless, on the basis of the fMRI results obtained in our study, we hypothesize that the saliency of the looming stimuli and their behavioral relevance form the basis for the heightened response, which must occur through a parallel non-striate route, allowing them to be processed without awareness and without V1.
Consistent with the idea of a saliency-driven response, our findings in TN additionally pointed to an involvement of the IPL, an area that also appears to be strongly linked with both saliency and multisensory processing. Data from the IPL is derived in large part from studies in the ventral inferior parietal area (VIP) of the monkey, which is located in the depth of the intraparietal sulcus (Bremmer et al., 2001; Guipponi et al., 2013). The VIP has been identified as a visual motion processing area, essentially processing visual stimuli, but also possessing neurons that respond to auditory and somatosensory, as well as multimodal stimulation (Hyvärinen, 1981; Duhamel et al., 1998; Bremmer et al., 2001; Guipponi et al., 2013).
Motion selective cells recorded in area VIP appear to be sensitive to the direction of the light points moving across the visual field (expanding/approaching vs. contracting/receding or other movement), and of particular relevance in our study, to stimuli representing real or apparent self-motion (Colby et al., 1993; Bremmer et al., 2002). Even more significant for our purpose, neurons in monkeys' area VIP have been found to be sensitive to the position of the movement relative to the observer, and to respond differentially according to whether the apparent location of the movement is situated in near or far extrapersonal space. Neuronal responses were found to be strongest for close, head-centered, approaching stimuli, in comparison to the responses to stimulation in the more distant extrapersonal space (Colby et al., 1993; Bremmer et al., 2013). The fact that approaching visual stimuli in the near, head-centered, personal space trigger neuronal responses, highlights the role of this area in guiding head movements in space, as well as in assessing the salience of moving stimuli and in preparing for avoidance reactions (Colby et al., 1993; Bremmer et al., 2013). This interpretation is supported by evidence showing that monkeys display defensive behaviors such as protecting the face with their arms following VIP electrical stimulation (Cooke and Graziano, 2004; Graziano and Cooke, 2006). Previous behavioral observations in TN have demonstrated his surprising unconscious ability to navigate through a trajectory while avoiding obstacles (de Gelder et al., 2008). The parietal brain areas activated by the looming stimuli may well provide the cerebral substrate that allowed his navigational abilities to occur.
It has been proposed that a high level, saliency-based motion mechanism may be opposed to low level, luminance-based processes (Cavanagh, 1992) and would be neuroanatomically segregated into saliency-based IPL and low level MT/IPS/STS processing (Claeys et al., 2003). Claeys et al. (2003) investigated visual saliency by creating an oddball paradigm in which stimulus features were manipulated, e.g., by increasing the amount of green contribution to a red and green grating stimulus. Saliency was found to produce IPL activation in support of their hypothesis. In monkeys, single cell recordings from the IPL showed that saliency-based visual information processing depended both on the sudden onset of a stimulus and the behavioral relevance of the stimulus (Gottlieb et al., 1998). Furthermore, the authors discuss that cells in the primary visual cortex always fire when the appropriately-oriented stimulus is present in the receptive field independently of salience, whereas in the IPL, information that is not behaviorally relevant seems to be filtered out before or within the IPL. Our current findings would seem to argue against such an interpretation. Indeed, patient TN lacks both visual cortices yet IPL activation is present for our salient, looming stimuli. This suggests that the saliency of a moving stimulus can be processed in the IPL, independently of prior processing in the primary visual cortex.
Interestingly, a hemispheric specialization dissociation concerning saliency based attentional processes has been put forward (Mevorach et al., 2006b). Whereas, TMS over the right IPL was shown to disrupt attentional engagement toward a salient stimulus while participants made judgments in a compound letter task, left IPL caused participants to be unable to disengage from a salient stimulus. The same authors then replicated their finding with patients suffering from left IPL lesions and found that they were unable to disengage from the salient stimulus in a similar task (Mevorach et al., 2006a). Accordingly, we speculate that our data showing left IPL activation to looming stimuli could reflect TN's attentional capture and inability to disengage from the salient looming stimulus, even though V1 input is lacking.
The presence of middle cingulate activity for looming motion in TN is notable. Several studies in healthy controls have found activity in the posterior cingulate for moving stimuli, in particular when coherent motion was represented (Sunaert et al., 1999; Braddick et al., 2001; Dieterich et al., 2003; Orban et al., 2003; Stebbins et al., 2004; Stiers et al., 2006). Antal et al. (2008) further observed that this region was more strongly activated for what they termed complex coherent motion (i.e., radial and rotational) than simple coherent motion such as horizontal or vertical motion of point lights. In our findings, the posterior cingulate failed to show up in the healthy controls or in TN during motion per se, but in TN, looming produced a greater response in this area than receding and rotational motion. The explanation for this particular pattern of response is unclear, however the posterior cingulate has been implicated as part of a network involved in orientation (Berthoz, 1997; Kataoka et al., 2006; Vogt et al., 2006) and evidence from neuropsychology has shown that damage to the posterior cingulate cortex gives rise to difficulties in spatial navigation and heading (Maguire, 2001). This deficit may result from an inability to integrate egocentric visual stimulation and spatial representations for navigational purposes (Vogt et al., 1992) suggesting that this region constitutes part of a larger neural network playing a role in spatial abilities, in which visual cues indicating the position of the stimulus with respect to the body are essential.
In conclusion, our findings revealed that, despite the absence of a functional primary visual cortex, looming motion activated a neural network that included bilateral clusters in the middle temporal lobes anterior to hMT+/V5 areas in the healthy brain that may have developed through cortical plasticity to respond to motion. In addition, cortical regions that generally participate in the processing of visual saliency (IPL) and visual guidance in space (IPL and cingulate) were found to be active. The fact that looming may continue to be processed without V1 may be due to its high level of salience and the importance of this direction of motion as a signal of imminent collision or threat.
Conflict of Interest Statement
The Review Editor Holly Bridge declares that, despite being affiliated to the same institution as author Marco Tamietto, the review process was handled objectively and no conflict of interest exists. The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
This study was supported by a Swiss National Foundation for Scientific Research (grant 320030-144187) to AP. MT is supported by a Vidi grant from the Netherlands Organization for Scientific Research (NWO; grant 016.125.391) and by a FIRB—Futuro in Ricerca 2012—grant from the Italian Ministry of Education University and Research (MIUR; grant RBFR12F0BD). BG is partly supported by FES and FP7-FET-Open grants and by an Adv ERC grant.
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/article/10.3389/fnint.2015.00051
Ajina, S., Kennard, C., Rees, G., and Bridge, H. (2015). Motion area V5/MT+ response to global motion in the absence of V1 resembles early visual cortex. Brain 138(Pt 1), 164–178. doi: 10.1093/brain/awu328
Antal, A., Baudewig, J., Paulus, W., and Dechent, P. (2008). The posterior cingulate cortex and planum temporale/parietal operculum are activated by coherent visual motion. Vis. Neurosci. 25, 17–26. doi: 10.10170S0952523808080024
Barleben, M., Stoppel, C. M., Kaufmann, J., Merkel, C., Wecke, T., Goertler, M., et al. (2014). Neural correlates of visual motion processing without awareness in patients with striate cortex and pulvinar lesions. Hum. Brain Mapp. 36, 1585–1594. doi: 10.1002/hbm.22725
Bremmer, F., Duhamel, J. R., Ben Hamed, S., and Graf, W. (2002). Heading encoding in the macaque ventral intraparietal area (VIP). Eur. J. Neurosci. 16, 1554–1568. doi: 10.1046/j.1460-9568.2002.02207.x
Bremmer, F., Schlack, A., Shah, N. J., Zafiris, O., Kubischik, M., Hoffmann, K., et al. (2001). Polymodal motion processing in posterior parietal and premotor cortex: a human fMRI study strongly implies equivalencies between humans and monkeys. Neuron 29, 287–296. doi: 10.1016/S0896-6273(01)00198-2
Bridge, H., Hicks, S. L., Xie, J., Okell, T. W., Mannan, S., Alexander, I., et al. (2010). Visual activation of extra-striate cortex in the absence of V1 activation. Neuropsychologia 48, 4148–4154. doi: 10.1016/j.neuropsychologia.2010.10.022
Bridge, H., Thomas, O., Jbabdi, S., and Cowey, A. (2008). Changes in connectivity after visual cortical brain damage underlie altered visual function. Brain 131(Pt 6), 1433–1444. doi: 10.1093/brain/awn063
Buetti, S., Tamietto, M., Hervais-Adelman, A., Kerzel, D., de Gelder, B., and Pegna, A. J. (2013). Dissociation between goal-directed and discrete response localization in a patient with bilateral cortical blindness. J. Cogn. Neurosci. 25, 1769–1775. doi: 10.1162/jocn_a_00404
Burra, N., Hervais-Adelman, A., Kerzel, D., Tamietto, M., de Gelder, B., and Pegna, A. J. (2013). Amygdala activation for eye contact despite complete cortical blindness. J. Neurosci. 33, 10483–10489. doi: 10.1523/JNEUROSCI.3994-12.2013
Claeys, K. G., Lindsey, D. T., De Schutter, E., and Orban, G. A. (2003). A higher order motion region in human inferior parietal lobule: evidence from fMRI. Neuron 40, 631–642. doi: 10.1016/S0896-6273(03)00590-7
Cowey, A., and Stoerig, P. (1989). Projection patterns of surviving neurons in the dorsal lateral geniculate nucleus following discrete lesions of striate cortex: implications for residual vision. Exp. Brain Res. 75, 631–638. doi: 10.1007/BF00249914
Crinion, J., Ashburner, J., Leff, A., Brett, M., Price, C., and Friston, K. (2007). Spatial normalization of lesioned brains: performance evaluation and impact on fMRI analyses. Neuroimage 37, 866–875. doi: 10.1016/j.neuroimage.2007.04.065
de Gelder, B., Tamietto, M., van Boxtel, G., Goebel, R., Sahraie, A., van den Stock, J., et al. (2008). Intact navigation skills after bilateral loss of striate cortex. Curr. Biol. 18, R1128–R1129. doi: 10.1016/j.cub.2008.11.002
Dieterich, M., Bense, S., Stephan, T., Yousry, T. A., and Brandt, T. (2003). fMRI signal increases and decreases in cortical areas during small-field optokinetic stimulation and central fixation. Exp. Brain Res. 148, 117–127. doi: 10.1007/s00221-002-1267-6
Eickhoff, S. B., Paus, T., Caspers, S., Grosbras, M. H., Evans, A. C., Zilles, K., et al. (2007). Assignment of functional activations to probabilistic cytoarchitectonic areas revisited. Neuroimage 36, 511–521. doi: 10.1016/j.neuroimage.2007.03.060
Goebel, R., Khorram-Sefat, D., Muckli, L., Hacker, H., and Singer, W. (1998). The constructive nature of vision: direct evidence from functional magnetic resonance imaging studies of apparent motion and motion imagery. Eur. J. Neurosci. 10, 1563–1573. doi: 10.1046/j.1460-9568.1998.00181.x
Goebel, R., Muckli, L., Zanella, F. E., Singer, W., and Stoerig, P. (2001). Sustained extrastriate cortical activation without visual awareness revealed by fMRI studies of hemianopic patients. Vision Res. 41, 1459–1474. doi: 10.1016/S0042-6989(01)00069-4
Guipponi, O., Wardak, C., Ibarrola, D., Comte, J. C., Sappey-Marinier, D., Pinède, S., et al. (2013). Multimodal convergence within the intraparietal sulcus of the macaque monkey. J. Neurosci. 33, 4128–4139. doi: 10.1523/JNEUROSCI.1421-12.2013
Josephs, O., and Henson, R. N. (1999). Event-related functional magnetic resonance imaging: modelling, inference and optimization. Philos. Trans. R. Soc. Lond. B Biol. Sci. 354, 1215–1228. doi: 10.1098/rstb.1999.0475
Kato, R., Takaura, K., Ikeda, T., Yoshida, M., and Isa, T. (2011). Contribution of the retino-tectal pathway to visually guided saccades after lesion of the primary visual cortex in monkeys. Eur. J. Neurosci. 33, 1952–1960. doi: 10.1111/j.1460-9568.2011.07729.x
King, S. M., Dykeman, C., Redgrave, P., and Dean, P. (1992). Use of a distracting task to obtain defensive head movements to looming visual stimuli by human adults in a laboratory setting. Perception 21, 245–259. doi: 10.1068/p210245
Lanyon, L. J., Giaschi, D., Young, S. A., Fitzpatrick, K., Diao, L., Bjornson, B. H., et al. (2009). Combined functional MRI and diffusion tensor imaging analysis of visual motion pathways. J. Neuroophthalmol. 29, 96–103. doi: 10.1097/WNO.0b013e3181a58ef8
Leh, S. E., Johansen-Berg, H., and Ptito, A. (2006). Unconscious vision: new insights into the neuronal correlate of blindsight using diffusion tractography. Brain 129(Pt 7), 1822–1832. doi: 10.1093/brain/awl111
Mevorach, C., Humphreys, G. W., and Shalev, L. (2006a). Effects of saliency, not global dominance, in patients with left parietal damage. Neuropsychologia 44, 307–319. doi: 10.1016/j.neuropsychologia.2005.04.015
Morland, A. B., Lê, S., Carroll, E., Hoffmann, M. B., and Pambakian, A. (2004). The role of spared calcarine cortex and lateral occipital cortex in the responses of human hemianopes to visual motion. J. Cogn. Neurosci. 16, 204–218. doi: 10.1162/089892904322984517
Orban, G. A., Fize, D., Peuskens, H., Denys, K., Nelissen, K., Sunaert, S., et al. (2003). Similarities and differences in motion processing between the human and macaque brain: evidence from fMRI. Neuropsychologia 41, 1757–1768. doi: 10.1016/S0028-3932(03)00177-5
Pasley, B. N., Inglis, B. A., and Freeman, R. D. (2007). Analysis of oxygen metabolism implies a neural origin for the negative BOLD response in human visual cortex. Neuroimage 36, 269–276. doi: 10.1016/j.neuroimage.2006.09.015
Pegna, A. J., Khateb, A., Lazeyras, F., and Seghier, M. L. (2005). Discriminating emotional faces without primary visual cortices involves the right amygdala. Nat. Neurosci. 8, 24–25. doi: 10.1038/nn1364
Rodman, H. R., Gross, C. G., and Albright, T. D. (1990). Afferent basis of visual response properties in area MT of the macaque. II. Effects of superior colliculus removal. J. Neurosci. 10, 1154–1164.
Rorden, C. (2011). MRIcron. Available online at: http://www.cabiatl.com/mricro/mricro/index.html
Rotshtein, P., Richardson, M. P., Winston, J. S., Kiebel, S. J., Vuilleumier, P., Eimer, M., et al. (2010). Amygdala damage affects event-related potentials for fearful faces at specific time windows. Hum. Brain Mapp. 31, 1089–1105. doi: 10.1002/hbm.20921
Schoenfeld, M. A., Heinze, H. J., and Woldorff, M. G. (2002). Unmasking motion-processing activity in human brain area V5/MT+ mediated by pathways that bypass primary visual cortex. Neuroimage 17, 769–779. doi: 10.1006/nimg.2002.1204
Silvanto, J., Walsh, V., and Cowey, A. (2009). Abnormal functional connectivity between ipsilesional V5/MT+ and contralesional striate cortex (V1) in blindsight. Exp. Brain Res. 193, 645–650. doi: 10.1007/s00221-009-1712-x
Stebbins, G. T., Goetz, C. G., Carrillo, M. C., Bangen, K. J., Turner, D. A., Glover, G. H., et al. (2004). Altered cortical visual processing in PD with hallucinations: an fMRI study. Neurology 63, 1409–1416. doi: 10.1212/01.WNL.0000141853.27081.BD
Stiers, P., Peeters, R., Lagae, L., Van Hecke, P., and Sunaert, S. (2006). Mapping multiple visual areas in the human brain with a short fMRI sequence. Neuroimage 29, 74–89. doi: 10.1016/j.neuroimage.2005.07.033
Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., et al. (2002). Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15, 273–289. doi: 10.1006/nimg.2001.0978
Van den Stock, J., Tamietto, M., Hervais-Adelman, A., Pegna, A. J., and de Gelder, B. (2013). Body recognition in a patient with bilateral primary visual cortex lesions. Biol. Psychiatry 77, e31–e33. doi: 10.1016/j.biopsych.2013.06.023
Van den Stock, J., Tamietto, M., Zhan, M., Heinecke, A., Hervais-Adelman, A., Legrand, L. B., et al. (2014). Neural correlates of body and face perception following bilateral destruction of the primary visual cortices. Front. Behav. Neurosci. 8:30. doi: 10.3389/fnbeh.2014.00030
Vogt, B. A., Finch, D. M., and Olson, C. R. (1992). Functional heterogeneity in cingulate cortex: the anterior executive and posterior evaluative regions. Cereb. Cortex 2, 435–443. doi: 10.1093/cercor/2.6.435-a
Vuilleumier, P., Richardson, M. P., Armony, J. L., Driver, J., and Dolan, R. J. (2004). Distant influences of amygdala lesion on visual cortical activation during emotional face processing. Nat. Neurosci. 7, 1271–1278. doi: 10.1038/nn1341
Watson, J. D., Myers, R., Frackowiak, R. S., Hajnal, J. V., Woods, R. P., Mazziotta, J. C., et al. (1993). Area V5 of the human brain: evidence from a combined study using positron emission tomography and magnetic resonance imaging. Cereb. Cortex 3, 79–94. doi: 10.1093/cercor/3.2.79
Weiskrantz, L., Warrington, E. K., Sanders, M. D., and Marshall, J. (1974). Visual capacity in the hemianopic field following a restricted occipital ablation. Brain 97, 709–728. doi: 10.1093/brain/97.1.709
Keywords: blindsight, motion, looming, fMRI, cortical blindness, hemianopia, MT/V5
Citation: Hervais-Adelman A, Legrand LB, Zhan M, Tamietto M, de Gelder B and Pegna AJ (2015) Looming sensitive cortical regions without V1 input: evidence from a patient with bilateral cortical blindness. Front. Integr. Neurosci. 9:51. doi: 10.3389/fnint.2015.00051
Received: 06 February 2015; Accepted: 25 September 2015;
Published: 22 October 2015.
Edited by:Sharon Gilaie-Dotan, University College London, UK
Reviewed by:Jody C. Culham, University of Western Ontario, Canada
Holly Bridge, University of Oxford, UK
Copyright © 2015 Hervais-Adelman, Legrand, Zhan, Tamietto, de Gelder and Pegna. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Alan J. Pegna, firstname.lastname@example.org
†These authors have contributed equally to this work.