Abstract
Our brains readily decode facial movements and changes in social attention, reflected in earlier and larger N170 event-related potentials (ERPs) to viewing gaze aversions vs. direct gaze in real faces (Puce et al., ). In contrast, gaze aversions in line-drawn faces do not produce these N170 differences (Rossi et al., ), suggesting that physical stimulus properties or experimental context may drive these effects. Here we investigated the role of stimulus-induced context on neurophysiological responses to dynamic gaze. Sixteen healthy adults viewed line-drawn and real faces, with dynamic eye aversion and direct gaze transitions, and control stimuli (scrambled arrays and checkerboards) while continuous electroencephalographic (EEG) activity was recorded. EEG data from 2 temporo-occipital clusters of 9 electrodes in each hemisphere where N170 activity is known to be maximal were selected for analysis. N170 peak amplitude and latency, and temporal dynamics from Event-Related Spectral Perturbations (ERSPs) were measured in 16 healthy subjects. Real faces generated larger N170s for averted vs. direct gaze motion, however, N170s to real and direct gaze were as large as those to respective controls. N170 amplitude did not differ across line-drawn gaze changes. Overall, bilateral mean gamma power changes for faces relative to control stimuli occurred between 150–350 ms, potentially reflecting signal detection of facial motion. Our data indicate that experimental context does not drive N170 differences to viewed gaze changes. Low-level stimulus properties, such as the high sclera/iris contrast change in real eyes likely drive the N170 changes to viewed aversive movements.
Introduction
Successful social behavior requires evaluating incoming sensory information and merging it with situationally relevant behavioral responses. Though a part of our social life may rely on purely reflexive behaviors, specialized neural activity is needed in evaluating social cues (Stanley and Adolphs, ). Over the past two decades social neuroscience, the study of social and cognitive influences on biological processes (Cacioppo, ; Cacioppo et al., ; Ochsner and Lieberman, ), has aimed to generate a brain-based understanding of social behaviors. An individual’s social cognitive understanding of the world is likely to not be context-invariant, however, the effects of task and experimental context on social cognition are seldom studied. In the case of social attention, in daily life a gaze change will occur in the context of directed emotions and actions from not only one’s self, but from others around us. This social environment, with many multisensory cues and continually changing context, is difficult to reproduce in a controlled laboratory setting. However, even in a controlled laboratory setting, experimental context can potentially modulate neural responses to particular stimulus conditions or tasks, and may underlie some of the differences observed between studies in the literature. In a laboratory setting, experimental context can be created within a trial, across trials or conditions, or across experimental sessions. Context effects could potentially be driven by the characteristics of the stimuli (bottom-up), or by task demands/instructions to subjects (top-down).
One particularly striking experimental context effect has been reported to viewing faces. It has long been known that the N170 event-related potential (ERP) is strongly driven by the physical or structural characteristics of a face stimulus (Bentin et al., ). In an elegant experimental manipulation, Bentin and Golland () recorded an N170 ERP evoked to (static) schematic line-drawings of faces, scrambled versions of the same faces, and line-drawings of common objects. In their design different subject groups were exposed to the stimuli with different block orders. The scrambled, or jumbled, versions of the line-drawn face stimuli had recognizable features, whose position relative to the outline of the face was altered. As expected, N170s were elicited to all stimulus categories, and were significantly larger to the intact schematic faces in both experiments. Critical to the current discussion, significantly larger N170s occurred to jumbled schematic faces but only when that stimulus block directly followed the schematic face block (Bentin and Golland, ), indicating how important stimulus-induced context effects can be in a laboratory setting. In a different study, N170 amplitude elicited to Moonee faces decreased by priming with photographic images of the same individuals represented in the Moonee faces (Jemel et al., ). The strongest priming effect occurred to images that were the actual photographic image of the Moonee face stimulus (a bottom-up effect), however, priming was also observed to different real images of the same individual relative to the Moonee faces (top-down effect) (Jemel et al., ). As a third example of the importance of experimental context effects, differences in the lateralization of N170 to faces can occur as a function of stimulus conditions used in the experiment. For example, the classic right lateralization of N170 is seen when faces are randomly presented among other object classes (e.g., Bötzel et al., ; Bentin et al., ; Eimer, ; Itier and Taylor, ) compared to a bilateral or even left-lateralization pattern when faces are presented in series with other faces (Deffke et al., ). These findings caution how important experimental context can be on N170s elicited to faces (Maurer et al., ). Indeed, N170 is larger to ambiguous face-like stimuli that are perceived as faces relative to the same stimuli when they are not seen as faces (George et al., ; Sagiv and Bentin, ; Bentin and Golland, ; Latinus and Taylor, , ). These effects have been proposed to be driven by stimulus context by a number of investigators (Bentin and Golland, ; Latinus and Taylor, ).
Isolated eyes evoke larger and delayed N170s relative to full faces (Bentin et al., ; Jemel et al., ; Puce and Perrett, ). Hence, the context of the face itself (e.g., outline and other face parts) may affect the neural response elicited to the eye stimulus—an effect that does not occur to presenting other face parts in isolation. Due to its sensitivity to dynamic gaze transitions (Puce et al., ; Conty et al., ), N170 has been posited to be a neural marker of communicative intent (Puce, ). Relevant for the present study, N170s to dynamic gaze aversions are larger and earlier than those to gaze transitions looking directly at the observer (Puce et al., ; Watanabe et al., ; but see Conty et al., ). This effect occurs to full images of faces, and isolated eyes (Puce et al., ), suggesting that N170 signals changes in social attention, and reflects the potential salience of gaze direction (Puce and Perrett, ; Conty et al., ).
N170 modulation to dynamic facial movements is not exclusive to eyes: larger N170s occur to mouth opening vs. closing movements—potentially reflecting a response to a pending utterance (Puce et al., ), and this effect occurs in both real and line-drawn faces (Puce et al., ; Rossi et al., ). Unlike in dynamic mouth motion, N170s to gaze aversions are strongly modulated by stimulus type: real faces show N170 differences to averted vs. direct gaze (Puce et al., ), whereas line-drawn faces do not (Rossi et al., ). These differences beg the question about effects of stimulus-driven context effects on the N170 elicited to dynamic facial movements. Hence, here we recorded N170 ERPs to dynamic gaze transitions to both real and line-drawn dynamic face images, and scrambled controls within the same experiment (using an experimental structure similar to that of Puce et al., ). We performed a standard ERP peak analysis, focusing on N170, and reasoned that if stimulus-context effects were driving N170 modulation, we would expect to observe larger N170s to gaze aversion vs. direct gaze for both real and line-drawn faces. In contrast, if the N170 effect was driven by low-level stimulus features only in the eye stimuli e.g., high iris/sclera contrast in the real images of faces, then the N170 effect would be seen only to dynamic images using real faces and not to line-drawn face images. This N170 modulation would not be predicted to occur for real control stimuli, in line with our previous studies. Finally, if the N170 effect was driven by a general low-level effect of local stimulus contrast change (occurring in both face and control stimuli), then we might expect to observe larger N170s to the real faces and their respective controls, relative to the line-drawn stimuli.
As well as examining averaged ERP activity, we also investigated oscillatory electroencephalographic (EEG) behavior post-motion onset to all stimulus types at electrode sited generating maximal N170 activity in a frequency range of 5–50 Hz. Previous studies evaluating facial motion effects have focused exclusively on averaged ERPs, which represent linearly summed EEG trials that are phase-locked to a relevant event (e.g., motion onset), and that are independent of ongoing EEG activity (Jervis et al., ). It has been proposed that the transient phase-resetting of ongoing oscillatory EEG activity underlies ERP generation (Brandt and Jansen, ). However, oscillatory EEG activity that is not phase-locked can also occur to a stimulus event, and will not be seen in an averaged ERP (Makeig et al., ). Oscillatory EEG activity expressed both as a function of EEG frequency and time relative to stimulus onset and/or execution of motor response can be identified using time-frequency decomposition of EEG signals, and displayed as Event-Related Spectral Perturbation (ERSP) plots (Makeig et al., ). Changes in a given EEG frequency band can occur from more than one process or underlying mechanism (e.g., see Sedley and Cunningham, ). Modulation of alpha band (8–12 Hz) power has been linked to changes in attentional state (Worden et al., ; Sauseng et al., ; Thut et al., ; Fries et al., ), and performance on visual perception tasks (Ergenoglu et al., ; Babiloni et al., ; Thut et al., ). Alpha may act as an inhibitory brain signal (Klimesch, ), which might enable timing of processing, and gated access to knowledge, and orientation in time, place, and context (Basar et al., ; Palva and Palva, ; Klimesch, ). Increases in beta band power (12–30 Hz) may reflect maintenance of current behaviorally relevant sensorimotor or cognitive states (Engel and Fries, ), whereas gamma band power (>30 Hz) increases may facilitate cortical processing, cognitive control and perceptual awareness (Ray and Cole, ; Tallon-Baudry and Bertrand, ; Grossmann et al., ; Engel and Fries, ; but see Sedley and Cunningham, ).
Ideally, ERSP and ERP analyses performed in parallel could more completely characterize neural activity to different task demands and conditions. However, the relationship between oscillatory EEG activity and ERP activity complex (see Rossi et al., ) and is not typically studied. Our previous comparisons of ERP and ERSP activity to viewed dynamic eye and mouth movements in dynamic line-drawn faces showed statistically significant differences for apparent motion in the beta and gamma bands between facial motion conditions, which differed timing and frequency content relative to control motion stimuli (Rossi et al., ). Given our previous study, here, we expected to observe oscillatory EEG changes in beta and gamma bands that would occur at different post-motion onset times for facial and control motion stimuli.
Materials and Methods
Participants
Seventeen healthy participants provided written informed consent to participate in the study. All participants had normal or corrected-to-normal vision, and were free of a history of neuropsychiatric disorders. The study protocol was approved by the Institutional Review Board at Indiana University, Bloomington (IRB 1202007935).
High-density (256 channel) EEG and behavioral data were collected from all participants, and data from 1 individual had to be excluded from further analysis due to a large amount of artifactual EEG contamination from facial/neck muscle activity, as well as line noise. Hence, data from 16 participants (7 males, 9 females) with an average age of 26 years (range 21–34 years) were submitted for analysis. The 16 participants were right-handed, as assessed by the Edinburgh Handedness Inventory (mean: R64.6, SD: 19) (Oldfield, ).
Stimuli
Participants viewed four different types of visual displays alternating between natural images of facial motion and respective motion controls, as well as motion of line-drawn faces and their respective motion controls. The real face, with eyes averting and looking directly at the observer, had a respective motion control that consisted of a colored checkerboard with checks moving towards the left and right in the same visuospatial position as the eyes in the real face (similar to that used in Puce et al., ). A line-drawn face, with eyes averting and looking at the observer, had a respective motion control in which line segments in the scrambled stimulus moved with a similar spatial excursion to the eyes, with the same number of pixels contributing to the motion (Figure 1).
Figure 1
Stimulus Creation
Real faces had been originally created from still 8-bit color photographs of posed direct and extreme averted (30 degree) gaze positions in both left and right directions. The stimulus face was superimposed on a background of concentric grayscale circles of different luminance. The images were originally created to be presented sequentially to depict dynamic gaze transitions, and mouth motion (see Puce et al., ). The corresponding non-facial motion controls consisted of a colored checkerboard pattern that was constructed from hues taken from the original head. Separate corresponding control stimuli were created to that sequential presentation resulted in checks alternating their position in the same regions of the visual field as the eyes in the real face (Puce et al., ), and to ensure that subjects did not visualize a “face” in the dynamic control stimulus.
White line-drawn faces on a black background had been originally created from a multimarker recording of facial expressions using specialized biological motion creation software from which lines were generated between some of the point lights [Elite Motion Analysis System (BTS, Milan, Italy)]. The black and white control stimuli had originally been created by extracting line segments from the line-drawn face and spatially re-arranging them in the visual space in an earlier version of Photoshop (Adobe Systems, Inc.), so that the face was no longer recognizable (Puce et al., ). The existing line-drawn faces were modified for Rossi et al. () in Photoshop CS5 (Adobe Systems, Inc.) by adding a schematic iris to the face which when spatially displaced could signal a gaze change on the stimulus face. A direct gaze consisted of a diamond-shaped schematic pupil positioned in the center of each schematic eye. Averted gaze consisted of an arrow-shaped schematic pupil that was moved to the extremity of the schematic eye (Figure 1). Thus, by toggling the two schematic eye conditions, observers reported seeing a convincing “direct” vs. “averted” gaze transition in the line-drawn face. Similarly, line-drawn control stimuli were created, using a rearranged “scramble” of the lines making up the eye movements on the face stimuli, ensuring that all stimuli presented would be equiluminant, and have similar motion excursions, as well as contrast and spatial frequency characteristics (Figure 1A). On debriefing post-experiment, subjects did not report seeing “eye” stimuli in the line-drawn control stimulus.
For all stimulus types, the effect of smooth movement was generated and no side-switch transition was possible (e.g., eyes looking to the right followed by eyes looking to the left). Negative-contrast versions (inverse colors) of all the stimulus versions were constructed to be used as infrequently presented targets (Figure 1B).
Procedure
Participants viewed the stimuli displayed on a 24-inch monitor (Dell Ultra Sharp U2412M, refresh rate of 60 Hz) resulting in an overall visual angle of 5 × 3 (vertical × horizontal) degrees. Participants completed four experimental runs in total; each run lasted approximately 6 min to allow participants to remain still for the EEG recording and maintain their level of alertness. After each run, participants had a self-paced break.
All stimulus types were always presented in each experimental run, with a run consisting of the repeated presentation of the following alternating 20 s stimulus blocks (Figure
1A; following the procedure used in Puce et al.,
):
REAL FACE. Three versions of male face with eyes directly looking at the observer, eyes averted to the left, or eyes averted to the right (Figure 1B) were presented in alternation to produce apparent motion depicting change in gaze position from a direct gaze to an averted gaze position to the left or to the right [gaze aversions: eyes-away] and from an averted gaze back to a direct gaze position [eyes-direct] similar to that used in Puce et al. ().
REAL CONTROL. Checkerboard patterns were alternated to produce an apparent motion stimulus varying in the same part of the visual field as the eyes in the REAL FACE similar to that used in Puce et al. ().
LINE FACE. Three versions of line-drawn face stimuli were alternated to change gaze position to look directly at participants [eyes-direct] or avert gaze either to the left or right [eyes-away] as for the REAL FACE condition, similar to that used in Rossi et al. ().
LINE CONTROL. The spatially “scrambled” versions of the LINE FACE were alternated to produce apparent motion in the same part of the visual field as the eyes in the LINE FACE condition, similar to that used in Rossi et al. ().
Stimulus onset asynchrony was randomly varied between 1000 and 1500 ms on each experimental trial (i.e., between two consecutive apparent motion onsets). A total of 210 trials were acquired per stimulus type (LINE FACE, LINE CONTROL, REAL FACE, REAL CONTROL).
The experiment was run using Presentation Version 14 (NeuroBehavioral Systems, 2010). Participant reaction times and accuracy were logged, and time stamps for different stimulus types (as well as button press responses for detected target stimuli) for each trial were automatically sent to the EEG system and stored in the EEG file.
Participants were instructed to press a button indicating the presence of a target stimulus. Target stimuli were negative-contrast versions of all stimuli used in the experiment (Figure 1B). Targets were randomly assigned to each alternating block (20% of trials). Trials with targets were not included in ERP/EEG analyses. Similarly, so as to remove potential confounds created by changes in stimulus type (i.e., for the first stimulus of each block, as well as for stimuli immediately following targets), trials following a target and the first stimuli of each block were not included in ERP/EEG analyses. The purpose of the target detection task was to keep participants attentive. All participants completed a short practice run (36 trials) at the beginning of the session and were given feedback regarding detection of target stimuli. All participants completed the practice run with 100% accuracy. EEG trials from the practice run were not included in subsequent analyses.
EEG Data Acquisition and Preprocessing
EEG Data Acquisition
A Net Amps 300 high-impedance EEG amplifier and NetStation software (V4.4) were used to record EEG from a 256-electrode HydroCel Geodesic Sensor Net (Electrical Geodesics Inc.) while the participant sat in a comfortable chair and performed the task in a dimly lit, humidified room. Continuous 256-channel EEG data were recorded with respect to a vertex reference using a sampling rate of 500 Hz and bandpass filter of 0.1–200 Hz (the ground electrode was sited on the midline parietal scalp). Stimulus delivery and subject behavioral responses were time-stamped onto all EEG files. Impedances were maintained below 60 kΩ as per the manufacturer’s recommended guidelines. Impedances were tested at the beginning of the experimental session and then once more at the half-way point of the experiment, allowing any high-impedance electrode contacts to be adjusted if necessary.
EEG Data Preprocessing
EEG data were first exported from EGI Net Station software as simple binary files. The same pre-processing procedure was applied to the ERP and ERSP analyses. All EEG pre-processing procedures were performed using functions from the EEGLAB toolbox (Delorme and Makeig, ) running under MATLAB R2010b (The Mathworks, Natick, MA). EEG data were first segmented into 1700 ms epochs: 572 ms pre-stimulus baseline and 1082 ms after apparent motion onset. EEG amplitude at each trial was normalized relative to the pre-stimulus baseline based on the event-markers, identifying each trial type. ERP data were displayed using a 200 ms pre-motion onset and 600 ms after the motion transition—see Figure 3. [A manufacturer-specified latency correction factor was applied to all behavioral data and epoched ERP data. In our case, given a sampling rate of 500 Hz, a correction of 18 ms was made, as per manufacturer guidelines].
EEG epochs were first visually inspected to identify and exclude bad channels from each individual subject EEG dataset. The electrodes identified as bad differed between subjects; average number of “bad” electrodes was 22 ± 2.15 (standard error of mean) out of 256 channels. Epochs with very large artifacts (e.g., very large subject movements and channel drifts) were manually rejected prior to subjecting the EEG data subsequent artifact detection analyses.
Independent Component Analysis (ICA) was used to identify and subtract components representing artifacts such as eye movements, eye blinks, carotid pulse, muscle activity and line-noise (Bell and Sejnowski, ; Delorme and Makeig, ). This allowed trials with eyeblinks to be adequately corrected, and allowed these trials to be included in the analysis. A total of 32 ICA components were generated for each participant’s EEG dataset. Eyeblinks, cardiac artifact and muscle activity were identified in isolated ICA components. Following removal of artifactual ICA components and reconstitution of the EEG signal, interpolation of bad channels was performed to regenerate a 256-channel EEG dataset. Bad channels were interpolated using a spherical interpolation: electrical activity was interpolated with respect to the surrounding nearest neighbor electrodes.
Data were re-referenced to a common average reference. ERP components such as the N170 and the vertex positive potential (VPP) amplitude have previously been shown to be very sensitive to reference location (Joyce and Rossion, ). The average reference has been suggested as being optimal as it captures finer hemispheric differences and shows the most symmetry between positive and negative ERP peaks for face-related stimuli (Joyce and Rossion, ). Only behaviorally correct EEG trials, i.e., no false alarms for targets, were included in subsequent analyses.
EEG/ERP Data Analyses
Two temporo-occipital 9 electrode clusters including equivalent 10–10 system sites P07/P9 and P08/P10 were chosen for further analyses, based on inspection of the grand averaged data from the current study and previously reported maxima in N170 amplitudes that used 4 electrode clusters for 64- and 128-channel EEG derivations, and P09 and P10 for smaller electrode arrays of 10–10 system sites (Puce et al., , ; Carrick et al., ; Brefczynski-Lewis et al., ; Rossi et al., ; Figures 2, 3). Averaged data from the 9 electrodes in each hemispheric cluster were used in all subsequent ERP analyses. Similarly, single-trial EEG data recorded from the same 9 electrodes in each hemispheric cluster were used for ERSP analysis.
Figure 2
Figure 3
Analysis of Event-Related Potentials
A digital 40 Hz infinite impulse response (IIR) low-pass filter was applied to the artifact-free behaviorally correct EEG data. Average ERPs were generated for each of the eight conditions and for each subject (about 200 trials per condition per subject on average). The ERPs from all subjects were averaged to generate a grand-average set of ERP waveforms for each condition and EEG channel.
Data from each 9 electrode temporo-occipital cluster were extracted and the average time-course for each electrode cluster was generated for subject and condition, and was subsequently used for calculating N170 amplitude and latency. In line with previous work (Puce et al., ), we focused on the N170 as a neural marker of the perception of facial motion. In our data, consistent with previous studies, the N170 showed a lateralized posterior scalp distribution (Figure 2). Using an automated peak detection procedure within a search time window of 150–250 ms after apparent motion onset, N170 peak amplitudes and latencies were extracted for each condition, each subject, and each electrode cluster independently.
Analysis of Event-Related Spectral Perturbations
All analyses were performed using custom in-house routines written using the EEGLAB toolbox (Delorme and Makeig, ) running under MATLAB. Artifact-free, behaviorally correct EEG segments were convolved with a linearly increased Morlet-wavelet on a trial-by-trial basis for each condition and subject. Specifically, the length of the wavelet increased linearly from 1 to 12 cycles across the frequency range of 5–50 Hz (theta, alpha, beta, and low-gamma). The linear increment of wavelet cycles is a commonly used practice when calculating spectral components in neurophysiological data, so that temporal resolution can be comparable for lower and higher EEG frequencies (Le Van Quyen et al., ) (for a detailed account on spectral analyses of EEG see Herrmann et al., ). After the EEG signals in each trial were convolved with a Morlet wavelet, they were transformed into power, and the resulting values were then averaged across trials. We analyzed the spectral power of components in the theta (5–8 Hz), alpha (8–12 Hz), beta (12–30 Hz), and low-gamma (30–50 Hz) EEG frequency-bands as they evolved over the post-movement epoch. In order to extract even-related spectral power from raw power, a standard baseline procedure was applied in a trial by trail basis (Grandchamp and Delorme, ). The window used as baseline comprised data points between −200 and 0 ms pre-stimulus range.
Induced activity is defined as EEG activity that is elicited to the stimulus, but may not be precisely time- or phase-locked to the stimulus transition (in this case apparent motion onset). However, each individual EEG epoch will also contain evoked activity, hence a calculation of “total power” (i.e., sum of evoked and induced activity) in each frequency band was made for EEG epochs in our study (see Tallon-Baudry et al., ).
As we have previously noted differences between facial motion stimulus type for eye and mouth movements (Rossi et al., ), we performed a similar analysis and generated differential ERSP plots between pairs of conditions: LINE CONTROL Direct vs. Away, LINE FACE Direct vs. Away, REAL CONTROL Direct vs. Away and REAL FACE Direct vs. Away.
Statistical Testing for Significant Differences
ERP peak analysis
Differences in temporo-occipital N170 peak amplitude and latency were evaluated using a 4-way repeated-measures ANOVA with Hemisphere (Left, Right), Configuration (Face, Control), Stimulus Type (Real, Line) and Motion (Away, Toward) as within-subjects factors using SPSS for MAC 18.0 (SPSS Inc.). Significant main effects were identified at P values of less than 0.05 (after Greenhouse-Geisser correction). Contrasts were evaluated using the Bonferroni criterion to correct for multiple comparisons with P values of less than 0.05 identifying significant effects.
Furthermore, to specifically assess the specificity of the effect to REAL FACE stimuli, we performed paired t-tests between each motion conditions for each stimulus condition. Four t-tests were performed (i.e., REAL FACE AWAY × REAL FACE DIRECT, REAL CONTROL AWAY × REAL CONTROL DIRECT, LINE FACE AWAY × LINE FACE AWAY, LINE CONTROL AWAY × LINE CONTROL DIRECT). The level of statistical significance (a priori two-tailed) was set at p < 0.05.
ERSP analysis
To measure the complete temporal extent of effects over frequency, we used a bootstrap approach (N = 1000 bootstraps), identifying time-frequency data points of statistically significant differences based on data-driven 95% confidence intervals (as described and implemented in Pernet et al., ) from the data of the two 9 electrode clusters. Non-parametric permutation was used to estimate the distribution under the null hypothesis of no differences in oscillatory amplitude between the pair of conditions.
Due to our paired design, when a subject was selected randomly, results from all his or her conditions were included in that sample. For each condition, we averaged the data across (resampled) participants and computed differences between conditions. Thus, for each one of the observed mean differences between conditions for a given frequency at each time-point, a t-statistic was calculated. At this stage, time points were evaluated according to a threshold set if their t-statistic corresponded to a value below 0.05 according to the Student’s t-distribution. This procedure was repeated for all ERSP time-points at each frequency. Temporally contiguous threshold time points were grouped into temporal clusters. At each bootstrap iteration, the temporal cluster mass was computed as the sum of the t-statistics over consecutively significant time-points, with the maximum cluster mass being recorded. Finally, temporal clusters in the observed data were deemed significant if their mass exceeded the maximum cluster mass of 95% of all bootstrap replicates (corresponding to a significance level of 0.05). This method allowed correction for multiple comparisons. Thus, the cluster mass statistic identified temporal regions with significant differences while avoiding false-positives arising from multiple comparisons (Pernet et al., ). This approach is comparable to false-discovery rate (FDR; Benjamini and Hochberg, ).
Results
Behavioral Data
Participants identified the target stimulus (image negative) with 99% accuracy by button press. Mean reaction time for target detection by stimulus type was 557 ± 94 ms (s.d.) for REAL faces, 577 ± 112 ms for REAL controls, 607 ± 113 ms for LINE faces and 560 ± 92 ms for LINE controls. A 2-way (Configuration × Stimulus Type) repeated-measures ANOVA showed a significant main effect of Stimulus Type (F(1,15) = 11.067, P < 0.001) and an interaction effect of Configuration by Stimulus (F(1,15) = 26.24, P < 0.001).
For the significant main effect of Stimulus Type, REAL stimuli (real faces and real controls) generated faster responses relative to LINE stimuli (line-drawn faces and line-drawn scrambled controls, mean difference: 30 ± 9 ms). The significant interaction effect of Configuration by Stimulus type indicated that real faces generated a faster response compared to REAL controls (mean difference: 47 ± 11 ms), while the opposite was seen for line-drawn stimuli, line-drawn controls were identified fastest (mean difference: 47 ± 13).
The current behavioral task was used to help participants pay attention to the display. EEG epochs from these target trials were not included in subsequent analyses.
Peak Analysis of the N170 ERP
N170 amplitudes and latencies were extracted from each of the two temporo-occipital scalp electrode clusters for each participant and condition for subsequent statistical testing. N170 was maximal over the temporo-occipital scalp, as demonstrated by the topographic voltage maps (Figure 2) plotted at the time point at which the N170 was maximal in amplitude. N170 was elicited in all stimulus conditions (Figure 3).
N170 latency and amplitude data for each condition and hemisphere are shown in Table 1. A 4-way repeated-measures ANOVA for N170 peak amplitude differences revealed a significant main effect for hemisphere (F(1,15) = 11.265, P < 0.001) and stimulus type (Real vs. Line; F(1,15) = 46.289, P < 0.001). The main effects for configuration (Face, Control) and motion (Away, Direct) were not significant. A significant interaction effect was observed between stimulus type and motion (F(1,15) = 5.143, P < 0.05).
Table 1
| Hem | Condition | Peak Ampl (μV) | Std | Peak Lat (ms) | Std |
|---|---|---|---|---|---|
| Left | REAL FACE away | −1.45 | 0.24 | 209.68 | 10.97 |
| REAL FACE direct | −1.13 | 0.15 | 216.75 | 8.97 | |
| REAL CTRL away | −0.12 | 0.26 | 207.25 | 10.12 | |
| REAL CTRL direct | −1.14 | 0.20 | 200.87 | 8.91 | |
| LINE FACE away | −1.66 | 0.25 | 236.06 | 8.89 | |
| LINE FACE direct | −1.73 | 0.30 | 232.81 | 6.35 | |
| LINE CTRL away | −1.63 | 0.16 | 234.37 | 9.65 | |
| LINE CTRL direct | −1.87 | 0.24 | 233.18 | 7.28 | |
| Right | REAL FACE away | −2.24 | 0.25 | 218.12 | 7.72 |
| REAL FACE direct | −1.64 | 0.20 | 223.18 | 8.96 | |
| REAL CTRL away | −1.86 | 0.28 | 203.06 | 7.52 | |
| REAL CTRL direct | −1.69 | 0.26 | 200.81 | 7.25 | |
| LINE FACE away | −2.54 | 0.34 | 246.81 | 7.37 | |
| LINE FACE direct | −2.64 | 0.27 | 236.50 | 6.97 | |
| LINE CTRL away | −2.18 | 0.32 | 236.62 | 8.44 | |
| LINE CTRL direct | −2.42 | 0.36 | 231.87 | 5.87 |
Group N170 peak amplitude (μV) and latency (ms) data: Mean and Standard Errors (Std) as a function of hemisphere (Hem) and Condition.
Legend: Ampl = amplitude; Lat = latency.
For the significant main effect of hemisphere, post hoc paired comparisons revealed that N170 amplitude was greater for the Right hemisphere relative to the Left Hemisphere (mean difference: 0.66 ± 0.26 μV). The main effect of stimulus type showed that N170 amplitude was greater for the line-drawn stimuli relative to the real stimuli (mean difference: 0.55 ± 0.08 μV, Figure 3). Post hoc comparisons for the interaction effect between stimulus type and motion revealed that among the REAL stimuli (i.e., real faces and real controls) the N170 for averted gaze was significantly larger than that to direct gaze (mean difference: 0.29 ± 0.13 μV) (Figure 3); an effect not seen for line-drawn stimuli.
One could argue that our 4-way ANOVA would reveal a 3-way interaction between stimulus type, configuration, and motion. This was not the case. When we compare our current data to those of Puce et al. (); we note that the authors also did not find interaction effects on N170 amplitude as assessed by means of 3-way ANOVAs performed at isolated hemispherically homologous electrode sites in a study that was performed using only 22 EEG electrodes. To try and investigate potential differences and similarities between the two studies, we further explored our current high-density EEG data by running paired t-tests on N170 amplitude for the Away and Direct motion transition for each stimulus type and configuration in the right occipitotemporal cluster (given that the main differences in the original study were reported in the right hemisphere). These analyses indicated that N170 amplitude was significantly larger for Away relative to Direct for REAL FACES (t(15) = −2.229, P = 0.04, mean difference = 0.46 μV), consistent with the difference reported in Puce et al., . In contrast, N170 amplitudes for LINE faces were not significantly different [LINE FACE Away relative to LINE FACE Direct (t(0.15) = 0.411, P = 0.69, mean difference = 0.08 μV)]. Similar comparisons across the control conditions were also not significant: REAL controls showed no differences between conditions [REAL CONTROL Away relative to Direct (t(15) = −0.85, P = 0.41, mean difference = −0.11 μV] and LINE controls also showed no significant differences in N170 amplitudes [LINE CONTROL Away relative to Direct (t(15) = 0.241, P = 0.12, mean difference = 1.6 μV].
The 4-way repeated-measures ANOVA for N170 latency revealed a significant main effect of Stimulus type (F(1,15) = 39.49, P < 0.001) and Configuration (F(1,15) = 7.773, P < 0.05). No other statistically significant main effects of hemisphere or motion, or interaction effects were observed for N170 latency. For the significant main effect of Stimulus type, post hoc comparisons indicated that the effect might have been driven by the shorter latencies to REAL faces compared to LINE faces (mean difference: 26 ± 4 ms, Figure 3). For the significant main effect of Configuration, post hoc comparisons suggested that N170s for CONTROL (both REAL and LINE) were shorter compared to FACE stimuli (mean difference: 9 ± 3 ms, Figure 3). To statistically evaluate these differences, four paired t-tests were performed (see Section Materials and Methods). None of these latency differences were found to be statistically significant [REAL FACE Away relative to REAL FACE direct (t(15) = 0.979, P = 0.343, mean difference = 6.06 ms; LINE FACE Away relative to LINE FACE direct (t(15) = 1.563, P = 0.139, mean difference = 6.78 ms; REAL CONTROL away relative to REAL CONTROL direct (t(15) = 1.140, P = 0.272, mean difference 4.31 ms; LINE CONTROL away relative to LINE CONTROL direct (t(15) = 0.457, P = 0.654, mean difference = 2.96 ms)].
Temporal Dynamics: ERSP Plots
ERSP plots demonstrated clear activity in selected EEG bands in all conditions in the post-motion onset period (Figure 4). The activity profile was similar across all conditions, including activity spanning over multiple time points and frequency bands. A common feature across all conditions was a prolonged burst of activity in the theta (5–8 Hz) and alpha (8–12 Hz) frequency bands in both electrode clusters extending from ~100–400 ms. Moreover, a consistent decrease in amplitude in the beta range (12–30 Hz) was also seen for most conditions extending from ~150–400 ms. An additional feature in the ERSP plots was activity in the low-gamma band (30–50 Hz) peaking roughly around 200 ms after apparent motion onset for most conditions (Figure 4).
Figure 4
Statistically significant differences between conditions were seen only in the beta (12–30 Hz) and low-gamma (30–50 Hz) frequency bands. Figure 5 displays masked time-frequency statistically significant differences between facial motion transitions and control motion transitions. We discuss these differences for each stimulus type below.
Figure 5

Group data: Statistically significant ERSP plot differences between stimulus conditions as a function of hemisphere. Left (L) and right (R) occipitotemporal data are presented in left and right columns, respectively. LINE FACE, REAL FACE, LINE CONTROL and REAL CONTROL difference plots appear from top to bottom panels, respectively. For LINE FACE, LINE FACE Away was subtracted from LINE FACE Direct, and for REAL FACE, REAL FACE Away was subtracted from REAL FACE Direct. For LINE CONTROL, the ERSP plot from LINE CONTROL Away has been subtracted from LINE CONTROL Direct. For REAL CONTROL, REAL CONTROL Away was subtracted from REAL CONTROL Direct. Frequency (Hz) is displayed on the y-axis as a function of time (ms). The direction of the difference in spectral power is depicted by the color calibration bar at the right of the figure. Warm colors depict increased power for condition 1 (Direct) whilst cool colors indicate increased power for condition 2 (Away). Gray areas in the plot indicate regions where the differences between conditions were not significant. The vertical broken line at time zero indicates the apparent motion stimulus onset.
Line Face
ERSP comparisons between gaze transitions for LINE FACE stimuli produced statistically significant differences in beta and gamma bands in the interval of 150–300 ms post-motion onset in both electrode clusters (Figure 5). Larger bilateral gamma amplitudes (~30–~40 Hz) were seen to direct gaze transitions (LINE FACE Direct) peaking at around 200 ms relative to gaze aversions (LINE FACE Away) (Figure 5 first row). For the opposite side of the contrast, larger bilateral gamma activity at ~40 Hz occurred at a later point in time (at ~300 ms for LINE FACE Away vs. Direct, Figure 5 first row). Significant differences in beta activity were only observed in the left temporo-occipital electrode cluster, with a relative larger decrement in beta amplitude for Away relative to Direct.
Real Face
REAL FACE stimuli elicited divergent significant differences across hemispheres (as shown in Figure 5 s row) relative to LINE FACES. In the left electrode cluster, statistically significant differences occurred at similar times and were confined to the same frequency range, and were similar for REAL and LINE face stimuli. Direct gaze changes in REAL FACES elicited larger gamma amplitudes peaking at ~200 ms (~30–45 Hz range) relative to gaze aversions, while Away gaze changes elicited stronger gamma power at ~300 ms (~40 Hz), and at ~500 ms (~35–45 Hz range). In the right electrode cluster, a later biphasic difference in gamma amplitude consisted of initial augmentation and then suppression of activity for direct relative to averted gaze. These effects occurred for frequencies ~40 and ~50 Hz and peaked between 400 ms (Figure 5, second row). Unlike in the left hemisphere, effects for REAL FACES occurred at later times relative to LINE FACES: gamma effects for REAL FACES occurred later in time relative to LINE FACES.
Line Control
Unlike for the face stimuli significant effects were effectively confined to the beta range, for LINE CONTROL stimuli identified significant bilateral differences that were confined to the beta band, consisting of brief periods between ~300 to ~400 ms after movement onset were observed bilaterally (Figure 5, third row). This difference was driven by stronger beta suppression in the Away condition in both hemispheres.
Real Control
REAL CONTROL stimuli generated a much more diverse pattern of differences extending between ~100 to ~600 ms after movement onset in beta and gamma activity in the left hemisphere (Figure 5, fourth row) relative to LINE CONTROL stimuli. First, significantly stronger activity for the REAL CONTROL Away condition consisted of an early beta component peaking right before 200 ms (~20–25 Hz), and a gamma component at ~200 ms (~45–50 Hz). In this same time range, gamma at ~35–40 Hz between ~200–300 ms, was significantly larger for Direct condition. Later in time, gamma burst extending from ~40–50 Hz occurred between ~500–600 ms and was stronger for the Away condition, while a lower frequency gamma component extending between ~35–40 Hz was significantly stronger between ~550–600 ms for the Direct condition (Figure 5, fourth row). Unlike the left electrode cluster, the right cluster showed more limited significant differences in oscillatory activity between conditions. Specifically, a very early gamma band response peaked at ~100 ms, being stronger for the Direct condition, and a later higher frequency gamma component at ~45 Hz peaking at ~500 ms was stronger for the Away condition.
Discussion
ERP Data: N170 Effects
Our main purpose for the experiment was to look for stimulus-induced context effects that might produce modulations of the N170 by gaze transition in line-drawn faces, when presented with real images of faces in the same experiment. For a stimulus context effect to be present, we would expect to observe parallel effects in the form of larger N170s to gaze aversions vs. direct gaze for both real and line-drawn faces. Given our experimental design, this would translate to a significant interaction effect of Motion [Away, Direct] × Config [Face, Control]. If, however, N170 modulation occurred only to gaze changes in real faces, then we would expect to see a significant interaction effect of Motion [Away, Direct] × Config [Face, Control] × Stimulus [Real, Line]. Finally, if N170 modulation was driven by general low-level effects of stimulus luminance and contrast, then we might expect to observe a significant main effect of Stimulus type [Real, Line].
Interestingly, our analysis generated effects that were more complex than predicted for N170 amplitude. We observed a significant main effect of Motion [Away, Direct] × Stim [Real, Line]—which was not what we had predicted. The nature of these differences was clarified with paired t-tests, which indicated that N170 was larger for averted vs. direct gaze only for real faces—consistent with our previous study (Puce et al.,
However, relative to our original experimental question, based on the above findings we would argue that, stimulus-context effects from real faces were not present for viewed eye movements in impoverished faces, when both stimulus categories are presented within the same experiment. This suggests that the difference in N170 amplitude gaze changes in real faces might be driven by a different neural mechanism relative to N170 modulation by mouth movements. We previously reported to mouth opening vs. closing movements in both real and line-drawn faces produce N170 amplitude modulations (Puce et al.,
Why would ERPs elicited to impoverished mouth movements behave so differently to those observed to gaze transitions? Bassili (
Other facial movements involving the forehead and eyes do not require the movements of articulated joints, and gaze aversions also fall into this category. Changes in the eyes, either associated with gaze aversions, or with emotions such as fear, surprise, and happiness alter the amount of seen eye white area, which can modulate the brain’s response to these types of stimuli even when these observed changes are task-irrelevant (Whalen et al.,
The lack of demonstrated N170 differences to gaze aversions relative to direct gaze transitions in this and our previous study using line-drawn faces (Rossi et al.,
Viewing the gaze changes of another individual are thought to produce reflexive changes in one’s visuospatial attention (Hietanen et al.,
A further point needs to be made on the issue of the schematic representation of faces. Our participants all reported that they found the gaze transitions in both types of faces to be compelling. However, some interesting differences in behavior and neurophysiology were observed for the impoverished stimulus categories. Subjects detected target stimuli that consisted of image negatives for all presented stimulus types. Participants were slower at detecting impoverished face targets relative to real face targets, and were the slowest for impoverished faces relative to impoverished controls. For real stimuli, face targets were identified faster relative to controls. We cannot directly relate our behavioral data to our ERP findings: the ERPs were recorded to trials where no behavioral response was recorded, so we can only speculate about the potential nature of our ERP findings to the impoverished stimuli. One consideration might be that the impoverished faces in the current study might not be treated as faces by the brain. A stimulus such as an impoverished face might be ambiguous, and would hence take a longer time to be evaluated and might require more detailed processing. This might manifest as increased response time (for the detection of targets), as well as increased N170 latencies (which were seen as a main effect for line-drawn vs. real stimuli). Coupled with the longer latency is also an increased N170 amplitude (seen as a main effect for stimulus type for line faces and controls). The increased N170 latencies and amplitudes observed here might potentially reflect the more effortful processing that might be required of these stimuli.
Some intriguing differences in N170 activity relating to data of our control stimuli need to be addressed. In our original study, the checkerboard controls had movements that were not congruous with one another i.e., checks changed in two locations corresponding to each eye in the real face, but moved in opposite lateral directions (Puce et al.,
The effects that are induced in N170 activity here underscore how important low-level stimulus manipulations related to luminance/contrast and also motion can be, and these have the potential to interact with task-related variables. Hence, control stimuli of multiple types may have to be used in an experiment so as to understand the nature of observed differences in neurophysiological data across different conditions.
EEG Spectral Power
Total EEG spectral power to the very brief apparent motion transition generated consistent prolonged bursts of activity in theta, beta and gamma EEG frequency bands which overall behaved similarly across conditions in a task requiring detecting negatives of the stimuli (see Figure 4). We expected to observe oscillatory EEG changes in beta and gamma bands that would occur at different post-motion onset times for facial and control motion stimuli when statistical comparisons were made between conditions, in line with our previous study where participants detected color changes in line drawn face and control motion stimuli (Rossi et al.,
In our previous study, we examined ERSP changes to impoverished line-drawn faces and controls only, where facial movements included eye and mouth movements in a color detection task that required a behavioral response for all presented stimuli (Rossi et al.,
Caruana et al. (
In our study, it is not entirely clear if the gamma activity could be related to configurality, movement, or a combination of both. However, we believe that the gamma responses at ~200 and ~300 ms present both for LINE and REAL stimuli reflect a preferential response to facial movement. An alternative explanation is that as a gamma response was seen for LINE and REAL faces and controls, albeit at different post-motion onsets, these gamma responses might be correlates of motion perception in the horizontal axis (see Figure 5). However, in our previous study we included mouth movements (with a large vertical component) in an impoverished face, and recorded gamma activity to both stimulus types (Rossi et al.,
As noted earlier, LINE FACES and CONTROLS differ in configuration, but produce identical movements. A common spectral change between LINE FACES and CONTROLS was a decrement in beta power, maximal at ~25 Hz for the conditions producing direct gaze (FACES) and a diamond shape (CONTROLS), albeit at slightly different time intervals (FACES from ~215–300 ms, CONTROLS ~300–400 ms). Since the common feature between these stimulus types is apparent motion of identical numbers of pixels, these beta components might be related to the encoding of the movement. Beta spectral power has been previously associated with the perception and production of movement per se (Pfurtscheller et al.,
General Conclusions
We would advocate that future studies evaluate ERP and ERSP activity in parallel, so that we can develop an understanding of the functional significance of each type of neurophysiological activity, and how one might affect the other. Gaze changes produced gamma activity irrespective of face type: direct gaze elicited more gamma at an earlier latency relative to averted gaze. Overall, our N170 ERP peak analysis argues for the idea that gaze changes/eye movements in impoverished line-drawn faces do not trigger the neural responses that have been associated to the perception of socially relevant facial motion (relevant for communicative behavior), replicating data in an earlier study (Rossi et al.,
Taking together the findings of our previous and current studies, N170s to gaze changes appear to be generated by different processes relative to mouth movements. Eye movements/gaze changes in real faces generate local visuospatial luminance/contrast changes producing an N170 that altered by the luminance/contrast change that occurs between changing gaze conditions. When gaze changes are presented in an impoverished face, there is no differential luminance/contrast change and the N170 does not show modulation across gaze conditions. In contrast, mouth opening and closing movements are a type of articulated biological motion, whose moving form modulates N170 irrespective of whether the movement occurs in a real or an impoverished face (Puce et al.,
Statements
Funding
Acknowledgments
AP, FJP, and AR were supported by NIH grant NS-049436. We also thank our participants, who made this experiment possible.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. The Guest Associate Editor Davide Rivolta declares that, despite having collaborated with author Ania Puce, the review process was handled objectively and no conflict of interest exists.
References
1
BabiloniC.VecchioF.BultriniA.Luca RomaniG.RossiniP. M. (2006). Pre- and poststimulus alpha rhythms are related to conscious visual perception: a high-resolution EEG study. Cereb. Cortex16, 1690–1700. 10.1093/cercor/bhj104
2
BasarE.SchürmannM.Basar-ErogluC.KarakasS. (1997). Alpha oscillations in brain functioning: an integrative theory. Int. J. Psychophysiol.26, 5–29. 10.1016/s0167-8760(97)00753-8
3
BassiliJ. N. (1978). Facial motion in the perception of faces and of emotional expression. J. Exp. Psychol. Hum. Percept. Perform.4, 373–379. 10.1037//0096-1523.4.3.373
4
BassiliJ. N. (1979). Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. J. Pers. Soc. Psychol.37, 2049–2058. 10.1037//0022-3514.37.11.2049
5
BeauchampM. S.LeeK. E.HaxbyJ. V.MartinA. (2002). Parallel visual motion processing streams for manipulable objects and human movements. Neuron34, 149–159. 10.1016/s0896-6273(02)00642-6
6
BellA. J.SejnowskiT. J. (1995). An information-maximization approach to blind separation and blind deconvolution. Neural Comput.7, 1129–1159. 10.1162/neco.1995.7.6.1129
7
BenjaminiY.HochbergY. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. Royal Stat. Soc. Series B Methodological57, 289–300.
8
BentinS.AllisonT.PuceA.PerezE.McCarthyG. (1996). Electrophysiological studies of face perception in humans. J. Cogn. Neurosci.8, 551–565. 10.1162/jocn.1996.8.6.551
9
BentinS.GollandY. (2002). Meaningful processing of meaningless stimuli: the influence of perceptual experience on early visual processing of faces. Cognition86, B1–B14. 10.1016/s0010-0277(02)00124-5
10
BlakeR.ShiffrarM. (2007). Perception of human motion. Annu. Rev. Psychol.58, 47–73. 10.1146/annurev.psych.57.102904.190152
11
BötzelK.SchulzeS.StodieckS. R. (1995). Scalp topography and analysis of intracranial sources of face-evoked potentials. Exp. Brain Res.104, 135–143. 10.1007/bf00229863
12
BrandtM. E.JansenB. H. (1991). The relationship between prestimulus alpha-amplitude and visual evoked-potential amplitude. Int. J. Neurosci.61, 261–268. 10.3109/00207459108990744
13
Brefczynski-LewisJ.BerrebiM. E.McNeelyM. E.PuceA. (2011). In the blink of an eye: neural responses elicited to viewing the eye blinks of another individual. Front. Hum. Neurosci.5:68. 10.3389/fnhum.2011.00068
14
BrignaniD.GuzzonD.MarziC. A.MiniussiC. (2009). Attentional orienting induced by arrows and eye-gaze compared with an endogenous cue. Neuropsychologia47, 370–381. 10.1016/j.neuropsychologia.2008.09.011
15
CacioppoJ. T. (1994). Social neuroscience: autonomic, neuroendocrine and immune responses to stress. Psychophysiology31, 113–128. 10.1111/j.1469-8986.1994.tb01032.x
16
CacioppoJ. T.BerntsonG. G.SheridanJ. F.McClintockM. K. (2000). Multilevel integrative analyses of human behavior: social neuroscience and the complementing nature of social and biological approaches. Psychol. Bull.126, 829–843. 10.1037/0033-2909.126.6.829
17
CarrickO. K.ThompsonJ. C.EplingJ. A.PuceA. (2007). It’s all in the eyes: neural responses to socially significant gaze shifts. Neuroreport18, 763–766. 10.1097/wnr.0b013e3280ebb44b
18
CaruanaF.CantalupoG.Lo RussoG.MaiR.SartoriI.AvanziniP. (2014). Human cortical activity evoked by gaze shift observation: an intracranial EEG study. Hum. Brain Mapp.35, 1515–1528. 10.1002/hbm.22270
19
ContyL.N’DiayeK.TijusC.GeorgeN. (2007). When eye creates the contact! ERP evidence for early dissociation between direct and averted gaze motion processing. Neuropsychologia45, 3024–3037. 10.1016/j.neuropsychologia.2007.05.017
20
DeffkeI.SanderT.HeidenreichJ.SommerW.CurioG.TrahmsL.et al. (2007). MEG/EEG sources of the 170-ms response to faces are co-localized in the fusiform gyrus. Neuroimage35, 1495–1501. 10.1016/j.neuroimage.2007.01.034
21
DelormeA.MakeigS. (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods134, 9–21. 10.1016/j.jneumeth.2003.10.009
22
DupierrixE.de BoisferonA. H.MéaryD.LeeK.QuinnP. C.Di GiorgioE.et al. (2014). Preference for human eyes in human infants. J. Exp. Child Psychol.23, 138–146. 10.1016/j.jecp.2013.12.010
23
EimerM. (1998). Does the face-specific N170 component reflect the activity of a specialized eye processor?Neuroreport9, 2945–2948. 10.1097/00001756-199809140-00005
24
EmeryN. J. (2000). The eyes have it: the neuroethology, function and evolution of social gaze. Neurosci. Biobehav. Rev.24, 581–604. 10.1016/s0149-7634(00)00025-7
25
EngelA. K.FriesP. (2010). Beta-band oscillations–signalling the status quo?Curr. Opin. Neurobiol.20, 156–165. 10.1016/j.conb.2010.02.015
26
EngellA. D.McCarthyG. (2011). The relationship of gamma oscillations and face-specific ERPs recorded subdurally from occipitotemporal cortex. Cereb. Cortex21, 1213–1221. 10.1093/cercor/bhq206
27
ErgenogluT.DemiralpT.BayraktarogluZ.ErgenM.BeydagiH.UresinY. (2004). Alpha rhythm of the EEG modulates visual detection performance in humans. Brain Res. Cogn. Brain Res.20, 376–383. 10.1016/j.cogbrainres.2004.03.009
28
FriesP.WomelsdorfT.OostenveldR.DesimoneR. (2008). The effects of visual stimulation and selective visual attention on rhythmic neuronal synchronization in macaque area V4. J. Neurosci.28, 4823–4835. 10.1523/JNEUROSCI.4499-07.2008
29
GeorgeN.EvansJ.FioriN.DavidoffJ.RenaultB. (1996). Brain events related to normal and moderately scrambled faces. Cogn. Brain Res.4, 65–76. 10.1016/0926-6410(95)00045-3
30
GieseM. A.PoggioT. (2003). Neural mechanisms for the recognition of biological movements. Nat. Rev. Neurosci.4, 179–192. 10.1038/nrn1057
31
GrandchampR.DelormeA. (2011). Single-trial normalization for event-related spectral decomposition reduces sensitivity to noisy trials. Front. Psychol.2:236. 10.3389/fpsyg.2011.00236
32
GrossmannT.JohnsonM. H.FarroniT.CsibraG. (2007). Social perception in the infant brain: gamma oscillatory activity in response to eye gaze. Soc. Cogn. Affect. Neurosci.2, 284–291. 10.1093/scan/nsm025
33
HadjikhaniN.HogeR.SnyderJ.de GelderB. (2008). Pointing with the eyes: the role of gaze in communicating danger. Brain Cogn.68, 1–8. 10.1016/j.bandc.2008.01.008
34
HardeeJ. E.ThompsonJ. C.PuceA. (2008). The left amygdala knows fear: laterality in the amygdala response to fearful eyes. Soc. Cogn. Affect. Neurosci.3, 47–54. 10.1093/scan/nsn001
35
HerrmannC. S.CrigutschM.BuschN. A. (2005). “EEC oscillations and wavelet analysis,” in Event-Related Potentials: A Methods Handbook, ed HandyT. C. (Cambridge, MA: MIT Press), 229–258.
36
HietanenJ. K.LeppänenJ. M.NummenmaaL.AstikainenP. (2008). Visuospatial attention shifts by gaze and arrow cues: an ERP study. Brain Res.1215, 123–136. 10.1016/j.brainres.2008.03.091
37
ItierR. J.BattyM. (2009). Neural bases of eye and gaze processing: the core of social cognition. Neurosci. Biobehav. Rev.33, 843–863. 10.1016/j.neubiorev.2009.02.004
38
ItierR. J.TaylorM. J. (2004). N170 or N1? Spatiotemporal differences between object and face processing using ERPs. Cereb. Cortex14, 132–142. 10.1093/cercor/bhg111
39
JemelB.GeorgeN.ChabyL.FioriN.RenaultB. (1999). Differential processing of part-to-whole and part-to-part face priming: an ERP study. Neuroreport10, 1069–1075. 10.1097/00001756-199904060-00031
40
JemelB.PisaniM.CalabriaM.CrommelinckM.BruyerR. (2003). Is the N170 for faces cognitively penetrable? Evidence from repetition priming of Mooney faces of familiar and unfamiliar persons. Brain Res. Cogn. Brain Res.17, 431–446. 10.1016/s0926-6410(03)00145-9
41
JervisB. W.NicholsM. J.JohnsonT. E.AllenE.HudsonN. R. (1983). A fundamental investigation of the composition of auditory evoked potentials. IEEE Trans. Biomed. Eng.30, 43–50. 10.1109/tbme.1983.325165
42
JoyceC.RossionB. (2005). The face-sensitive N170 and VPP components manifest the same brain processes: the effect of reference electrode site. Clin. Neurophysiol.116, 2613–2631. 10.1016/j.clinph.2005.07.005
43
KlimeschW. (2012). α-band oscillations, attention and controlled access to stored information. Trends Cogn. Sci.16, 606–617. 10.1016/j.tics.2012.10.007
44
LachauxJ. P.GeorgeN.Tallon-BaudryC.MartinerieJ.HuguevilleL.MinottiL.et al. (2005). The many faces of the gamma band response to complex visual stimuli. Neuroimage25, 491–501. 10.1016/j.neuroimage.2004.11.052
45
LatinusM.TaylorM. J. (2005). Holistic processing of faces: learning effects with Mooney faces. J. Cogn. Neurosci.17, 1316–1327. 10.1162/0898929055002490
46
LatinusM.TaylorM. J. (2006). Face processing stages: impact of difficulty and the separation of effects. Brain Res.1123, 179–187. 10.1016/j.brainres.2006.09.031
47
Le Van QuyenM.FoucherJ.LachauxJ.-P.RodriguezE.LutzA.MartinerieJ.et al. (2001). Comparison of Hilbert transform and wavelet methods for the analysis of neuronal synchrony. J. Neurosci. Methods111, 83–98. 10.1016/s0165-0270(01)00372-7
48
MakeigS.DebenerS.OntonJ.DelormeA. (2004). Mining event-related brain dynamics. Trends Cogn. Sci.8, 204–210. 10.1016/j.tics.2004.03.008
49
MaurerU.RossionB.McCandlissB. D. (2008). Category specificity in early perception: face and word n170 responses differ in both lateralization and habituation properties. Front. Hum. Neurosci.2:18. 10.3389/neuro.09.018.2008
50
MüllerG. R.NeuperC.RuppR.KeinrathC.GernerH. J.PfurtschellerG. (2003). Event-related beta EEG changes during wrist movements induced by functional electrical stimulation of forearm muscles in man. Neurosci. Lett.340, 143–147. 10.1016/s0304-3940(03)00019-3
51
Müller-PutzG. R.ZimmermannD.GraimannB.NestingerK.KorisekG.PfurtschellerG. (2007). Event-related beta EEG-changes during passive and attempted foot movements in paraplegic patients. Brain Res.1137, 84–91. 10.1016/j.brainres.2006.12.052
52
OchsnerK. N.LiebermanM. D. (2001). The emergence of social cognitive neuroscience. Am. Psychol.56, 717–734. 10.1037/0003-066x.56.9.717
53
OldfieldR. C. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia9, 97–113. 10.1016/0028-3932(71)90067-4
54
OramM. W.PerrettD. I. (1994). Responses of Anterior Superior Temporal Polysensory (STPa) neurons to “Biological Motion” stimuli. J. Cogn. Neurosci.6, 99–116. 10.1162/jocn.1994.6.2.99
55
OramM. W.PerrettD. I. (1996). Integration of form and motion in the anterior superior temporal polysensory area (STPa) of the macaque monkey. J. Neurophysiol.76, 109–129.
56
PalvaS.PalvaJ. M. (2007). New vistas for alpha-frequency band oscillations. Trends Neurosci.30, 150–158. 10.1016/j.tins.2007.02.001
57
PernetC. R.ChauveauN.GasparC.RousseletG. A. (2011). LIMO EEG: a toolbox for hierarchical LInear MOdeling of ElectroEncephaloGraphic data. Comput. Intell. Neurosci.2011:831409. 10.1155/2011/831409
58
PeuskensH.VanrieJ.VerfaillieK.OrbanG. A. (2005). Specificity of regions processing biological motion. Eur. J. Neurosci.21, 2864–2875. 10.1111/j.1460-9568.2005.04106.x
59
PfurtschellerG.StancákA.Jr.NeuperC. (1996). Post-movement beta synchronization. A correlate of an idling motor area?Electroencephalogr. Clin. Neurophysiol.98, 281–293. 10.1016/0013-4694(95)00258-8
60
PosnerM. I. (1980). Orienting of attention. Q. J. Exp. Psychol.32, 3–25. 10.1080/00335558008248231
61
PuceA. (2013). “Perception of nonverbal cues,” in The Oxford Handbook of Cognitive Neuroscience, Volume 2: The Cutting Edges, eds OchsnerK.KosslynS. M. (Oxford: Oxford University Press), 148–164.
62
PuceA.AllisonT.BentinS.GoreJ. C.McCarthyG. (1998). Temporal cortex activation in humans viewing eye and mouth movements. J. Neurosci.18, 2188–2199.
63
PuceA.PerrettD. (2003). Electrophysiology and brain imaging of biological motion. Philos. Trans. R. Soc. Lond. B Biol. Sci.358, 435–445. 10.1098/rstb.2002.1221
64
PuceA.SmithA.AllisonT. (2000). ERPs evoked by viewing facial movements. Cogn. Neuropsychol.17, 221–239. 10.1080/026432900380580
65
PuceA.SyngeniotisA.ThompsonJ. C.AbbottD. F.WheatonK. J.CastielloU. (2003). The human temporal lobe integrates facial form and motion: evidence from fMRI and ERP studies. Neuroimage19, 861–869. 10.1016/s1053-8119(03)00189-7
66
RayW. J.ColeH. W. (1985). Eeg alpha activity reflects attentional demands and beta-activity reflects emotional and cognitive-processes. Science228, 750–752. 10.1126/science.3992243
67
RosatiA. G.HareB. (2009). Looking past the model species: diversity in gaze-following skills across primates. Curr. Opin. Neurobiol.19, 45–51. 10.1016/j.conb.2009.03.002
68
RossiA.ParadaF. J.KolchinskyA.PuceA. (2014). Neural correlates of apparent motion perception of impoverished facial stimuli: a comparison of ERP and ERSP activity. Neuroimage98, 442–459. 10.1016/j.neuroimage.2014.04.029
69
SagivN.BentinS. (2001). Structural encoding of human and schematic faces: holistic and part-based processes. J. Cogn. Neurosci.13, 937–951. 10.1162/089892901753165854
70
SausengP.KlimeschW.StadlerW.SchabusM.DoppelmayrM.HanslmayrS.et al. (2005). A shift of visual spatial attention is selectively associated with human EEG alpha activity. Eur. J. Neurosci.22, 2917–2926. 10.1111/j.1460-9568.2005.04482.x
71
SchullerA. M.RossionB. (2001). Spatial attention triggered by eye gaze increases and speeds up early visual activity. Neuroreport12, 2381–2386. 10.1097/00001756-200108080-00019
72
SedleyW.CunninghamM. O. (2013). Do cortical gamma oscillations promote or suppress perception? An under-asked question with an over-assumed answer. Front. Hum. Neurosci.7:595. 10.3389/fnhum.2013.00595
73
SrinivasanR.NunezP. L.TuckerD. M.SilbersteinR. B.CaduschP. J. (1996). Spatial sampling and filtering of EEG with spline laplacians to estimate cortical potentials. Brain Topogr.8, 355–366. 10.1007/bf01186911
74
StanleyD. A.AdolphsR. (2013). Toward a neural basis for social behavior. Neuron80, 816–826. 10.1016/j.neuron.2013.10.038
75
StraubeT.DietrichC.Mothes-LaschM.MentzelH. J.MiltnerW. H. R. (2010). The volatility of the amygdala response to masked fearful eyes. Hum. Brain Mapp.31, 1601–1608. 10.1002/hbm.20960
76
Tallon-BaudryC.BertrandO. (1999). Oscillatory gamma activity in humans and its role in object representation. Trends Cogn. Sci.3, 151–162. 10.1016/s1364-6613(99)01299-1
77
Tallon-BaudryC.BertrandO.DelpuechC.PernierJ. (1996). Stimulus specificity of phase-locked and non-phase-locked 40 Hz visual responses in human. J. Neurosci.16, 4240–4249.
78
ThutG.NietzelA.BrandtS. A.Pascual-LeoneA. (2006). α-band electroencephalographic activity over occipital cortex indexes visuospatial attention bias and predicts visual target detection. J. Neurosci.26, 9494–9502. 10.1523/jneurosci.0875-06.2006
79
WatanabeS.MikiK.KakigiR. (2002). Gaze direction affects face perception in humans. Neurosci. Lett.325, 163–166. 10.1016/s0304-3940(02)00257-4
80
WhalenP. J.KaganJ.CookR. G.DavisF. C.KimH.PolisS.et al. (2004). Human amygdala responsivity to masked fearful eye whites. Science306:2061. 10.1126/science.1103617
81
WordenM. S.FoxeJ. J.WangN.SimpsonG. V. (2000). Anticipatory biasing of visuospatial attention indexed by retinotopically specific alpha-band electroencephalography increases over occipital cortex. J. Neurosci.20:RC63.
82
Zion-GolumbicE.BentinS. (2007). Dissociated neural mechanisms for face detection and configural encoding: evidence from N170 and induced gamma-band oscillation effects. Cereb. Cortex17, 1741–1749. 10.1093/cercor/bhl100
Summary
Keywords
N170 ERP, real faces, line-drawn faces, gaze aversion, apparent motion
Citation
Rossi A, Parada FJ, Latinus M and Puce A (2015) Photographic but not line-drawn faces show early perceptual neural sensitivity to eye gaze direction. Front. Hum. Neurosci. 9:185. doi: 10.3389/fnhum.2015.00185
Received
29 April 2014
Accepted
19 March 2015
Published
10 April 2015
Volume
9 - 2015
Edited by
Davide Rivolta, University of East London, UK
Reviewed by
Christine Parsons, University of Oxford, UK; John Towler, Birkbeck, University of London, UK
Copyright
© 2015 Rossi, Parada, Latinus and Puce.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution and reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Alejandra Rossi, Cognitive Science Program, Indiana University, 1900 East Tenth St., Bloomington, IN 47405, USA alejandrarossic@gmail.com
†These authors have contributed equally to this work.
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.