Abstract
Evidence suggests that synchronized brain oscillations in the low gamma range (around 33 Hz) are involved in the perceptual integration of harmonic complex tones. This process involves the binding of harmonic components into “harmonic templates” – neural structures responsible for pitch coding in the brain. We investigated the hypothesis that oscillatory harmonic binding promotes a change in pitch perception style from spectral (frequency) to virtual (relational). Using oscillatory priming we asked 24 participants to judge as rapidly as possible, the direction of an ambiguous target with ascending spectral and descending virtual contour. They made significantly more virtual responses when primed at 29, 31, and 33 Hz and when the first target tone was harmonically related to the prime, suggesting that neural synchronization in the low gamma range could facilitate a shift toward virtual pitch processing.
INTRODUCTION
Processing the pitch of harmonic complex tones represents one of the most important research topics in auditory perception and cognitive neuroscience (e.g., ; ; ; ). There is accumulating evidence that the perceptual integration of disparate harmonic components in primary auditory cortex (PAC) involves the formation of harmonic templates (; ; Shamma and Klein, 2000; ), that is, networks of medium-range connections between topographically non-adjacent neural loci which code harmonically related frequencies (e.g., ). One issue of particular concern is the mechanism which mediates the transformation of spectral (frequency) information into “virtual” Gestalt-like pitch percepts (, 1989). The “Gestaltness” of a virtual pitch percept is reflected in the fact that it arises only when the constituent components are related to each other in a specific way.
The fact that a single stimulus can provide two mutually exclusive forms of pitch information (spectral and virtual) offers a convenient way of investigating the dynamics of harmonic pitch integration. Typically, such stimuli consist of pairs of two-frequency tones (see Figure 1). The frequencies are selected so that the frequencies in the second tone are lower than those in the first. At the same time, the frequency distance between components increases in the second tone () producing two competing contours – a falling spectral (1A) and a rising virtual (1B) contour. The former is extracted from the frequencies of successive components and the latter is defined by the frequency of the missing fundamental – the inaudible first harmonic of a relevant series. The spectral mode relies on the computation of the frequency differences whereas the virtual mode involves abstraction of tonotopic relationships in the sense that harmonic distance becomes the new unit of information for the purposes of computation and comparison.
FIGURE 1
Studies using such ambiguous stimuli reveal considerable inter-individual differences in listening style. While some listeners are capable of hearing virtual pitch, others derive pitch information from the spectral contour (the frequency difference between successive harmonics) and this preference appears to be stable over time (). Moreover, the relationship between the two modes of pitch perception is unidirectional: found that once trained to hear virtual pitch, listeners have difficulty reverting to the spectral listening mode (see also ). According to Winkler et al. (1994), virtual pitch is coded in sensory memory and takes longer to process as compared to spectral pitch. While listeners can be described as adopting either a spectral or a virtual mode, repeated exposure to harmonic tones can lead to an irreversible switch from the former to the latter.
A recent investigation of harmonic pitch integration using a priming paradigm () suggests that priming in the low gamma range (33 Hz) is involved in the synchronization of templates involved in the coding of target frequencies harmonically related to the carrier frequency of the prime. The priming causes an “inharmonic pop-out,” that is, an increased salience of targets that are not harmonically related to the prime. In a second study, (Aksentijevic and Elliott, under revision) the inharmonic pop-out was observed in participants with no musical training but not in musically trained participants. This suggests that prolonged exposure to harmonic input creates permanent connections between harmonic template components. Aksentijevic and Elliott argue that once these connections have been formed, transient oscillatory synchronization becomes less relevant as a mechanism for binding.
Support for this view comes from a study by , in which listeners were exposed to an ambiguous melody over a period of several hours. The melody consisted of a sequence of pairs of pure tones which were arranged such that while their spectral contour produced a descending motif, the virtual melody was that of the well-known folk tune “Frère Jacques.” After several hours of listening to the stimulus, all participants were able to recognize Frère Jacques. This shift to a virtual mode was accompanied by a functional reorganization of the PAC – by the anatomical redistribution of the evoked auditory gamma-band response (aGBR; e.g., ). Following exposure, the aGBR ostensibly migrated away from the core toward the belt area in secondary auditory cortex suggesting that the shift to a virtual mode represents the consolidation of an oscillatory “harmonic memory” in the PAC (; ).
In the current study we employed ambiguous targets to investigate the hypothesis that rate-specific priming in the low gamma range (around 33 Hz) would facilitate a perceptual shift toward the virtual listening mode. Spectral down – virtual up targets (SDVU) consisted of a pair of harmonics of the 500 Hz harmonic series (2500 + 3000 Hz) followed by a pair of harmonics of the 600 Hz series (1800 + 2400 Hz; see Figure 1). An SUVD target represented the reversed arrangement of the SDVU target. We conjectured a shift toward the virtual mode would be one consequence of the binding of components of a relevant harmonic template by means of oscillatory priming, which would promote the salience of the relational (virtual) pitch information relative to that carried by the spectral contour. In order to test this, we initially sought to replicate the original rate-specific priming effect found by at or around 33 Hz.
In the original study, the binding effect was demonstrated indirectly – via the increased salience of inharmonic targets. Here, the two versions of the target stimulus permitted a direct test of the binding hypothesis. In the SUVD condition, the first target tone (2500 + 3000 Hz) is harmonically related to the prime. If the hypothesis that oscillatory priming affects only harmonic loci is correct, the oscillatory binding should facilitate virtual responses to SUVD targets which inherit the harmonic information entrained by the prime.
MATERIALS AND METHODS
PARTICIPANTS
The study was approved by the Ethics Committee of the Department of Psychology, University of Roehampton, and conformed to the Helsinki Declaration on Human Rights. Twenty four undergraduate volunteers (five male) took part in the experiment (mean age 21.71 years, standard deviation 6.7 years, with one participant substantially older than the remaining participants). Two participants were left-handed and one was ambidextrous. Seven participants had received from 2 to 14 years of musical training. All participants reported normal hearing and none possessed absolute pitch. Apart from one drummer, all musically trained participants received training on pitched instruments including voice. All participants provided informed consent and received credits for taking part in the study.
APPARATUS AND STIMULI
Experimental trial and stimulus generation, as well as response timing were controlled by an IBM compatible computer with sound signals generated by an internal stereo sound card. Trial presentation and data collection were implemented using Superlab (v.4, Cedrus). The stimuli were presented diotically via Sennheiser HD 265 linear headphones.
Each trial consisted of two parts (see Figure 2). In the first, a 1000 ms tone-pip train (prime) was presented, designed so as to generate a gamma-band oscillatory steady state response (SSR; ; ; Thut et al., 2011). Presentation rate was defined by the duration of individual tone pips. The prime was presented at 29, 31, 33, 35, or 37 pips-per-second (pps). The individual pips were created using NCH tone generator (Version 3.00; NCH Software) and were onset- and offset-ramped with ramps that were symmetrical and had a plateau of 33% of the overall period (Figure 1A). The trains were created using WavePad sound editor (NCH Software).
FIGURE 2
The prime consisted of a repeating four-pip sequence, with every first pip carrying 1000 Hz, and the remaining three pips carrying 500 Hz. As demonstrated by , this structure was critical in generating an internal oscillatory model responsible for the observed effects. Specifically, the regular reset of the oscillatory representation of the 500 Hz template by a 1000 Hz pip led to a periodic oscillatory model whose temporal properties could be examined very precisely. At 33 pps, the supra-threshold amplitude of the internal oscillatory model (expected to affect participants’ responses) was predicted and confirmed at inter-stimulus intervals (ISIs) of 106 and 256 ms (± 5 ms). Pip duration was a reciprocal of presentation rate (e.g., 30.3 ms at 33 pps). Following an ISI of either 100 or 400 ms, a target was presented consisting of two 250 ms tones separated by an ISI of 100 ms. In the original study, the priming effect was observed at ISIs of 100 and 250 ms. While we estimated the persistence of the oscillatory representation at about 400 ms, we failed to observe any effects at ISIs above approximately 250 ms. Consequently, the two ISIs were chosen a) in order to replicate the original finding of a rate-specific effect at 100 ms ISI and b) confirm the absence of the effect at longer intervals. Each target complex contained two frequencies and was symmetrically ramped (rise and fall time 50 ms). The first tone carried 2500 and 3000 Hz (the fifth and sixth harmonics of the baseline prime frequency of 500 Hz) while the second carried 1800 and 2400 Hz (the third and fourth harmonics of 600 Hz). This produces two perceptual solutions. If listeners derive contour from the spectral information (frequency of successive harmonics), they hear a descending contour. Conversely, if they compute contour from the harmonic relationship between concurrent harmonics (virtual pitch), they hear an ascending contour. This target is labeled SDVU. It should also be noted that the first tone of the SDVU target was harmonically, and the second inharmonically, related to the prime. A reversed version of the target (spectral up – virtual down; SUVD) was presented on 50% of the trials in order to control for the harmonic relationship between the prime and target and increase stimulus variability. To recapitulate, the two target conditions were generated by inverting a single two-tone stimulus. Both versions of the target were presented an equal number of times.
DESIGN
The study employed a within-subjects design with factors ISI (100 ms, 400 ms), rate (29, 31, 33, 35, 37 pps) and target direction (SDVU, SUVD). There were 10 trials per condition resulting in 200 trials per participant. Trials were presented pseudo-randomly for each participant across five blocks of 40 trials per block. Each session commenced with a 40-trial practice block.
PROCEDURE
The experiment was conducted in a sound-attenuated experimental room. Stimulus intensity was held constant throughout [average 60 dB sound pressure level (SPL); A weighting; average error 2 dB SPL], examined using an artificial ear and an Adastra analog sound level meter, (Model 952.422, slow response), with the shape of the stimuli examined using WavePad sound editor. Each trial commenced with a 500 ms cross appearing at the center of the screen. Participants were instructed to focus on the target and indicate as quickly as possible if the target was going up or down by pressing the appropriate keyboard key with a finger of their dominant hand. In conjunction with target configuration, this task would produce response profiles corresponding to individual propensity to hear virtual pitch. Response time was measured from target onset and a new trial was initiated by the response. An individual session lasted approximately 15 min.
RESULTS
Prior to analysis, 43 trials (out of 4800) were removed because they contained task-irrelevant responses. Data were analyzed in two stages. First, an omnibus analysis was performed on response-time (RT) data in order to test against the results of and to establish the presence and frequency of a rate-specific priming effect in the current paradigm. For this, anti-logs of the means of the log-transformed RT distributions were subject to a three-way repeated-measures ANOVA with factors ISI (100, 400 ms), rate (29, 31, 33, 35, and 37 pps) and target direction (SDVU, SUVD). The main effect of target direction was significant [F(1,23) = 10.12, MSE = 14432.1, p < .01; =.31] with SDVU targets being registered more rapidly (mean difference = 39 ms, SEM = 13 ms). The three-way interaction was also significant [F(4,92) = 3.03, MSE = 8011.66, p < .05; =.12 (see Figure 3)], resulting from a significant difference in the effect of rate at the two ISIs as confirmed by the inspection of Bonferroni-adjusted post-hoc comparisons. Specifically, at 100 ms ISI, there was a significant RT advantage for SDVU targets at 31 pps (difference: 64 ms, SEM = 24.47, p < .05), while by contrast at 400 ms ISI, there was a large and significant 118 ms (SEM = 25.82, p < .001) RT advantage for SDVU targets that followed a 33 pps prime consistent with the rate-specific inharmonic pop-out reported by .
FIGURE 3
Our main hypothesis concerned the idea that gamma-band entrainment at specific rates would promote the shift toward virtual perceptual mode. In order to test this, participants’ responses were coded with regard to their listening style. “Down” responses to SUVD targets and “Up” responses to SDVU targets were coded as “virtual”. The opposite, reciprocal combination was coded as “spectral”. Overall, the percentage of virtual responses was 49.7% (2362 out of 4757 responses), suggesting an equal representation of the two listening styles. Three participants made close to 100% virtual responses while three made less than 5% virtual responses. Four participants made an approximately equal number of spectral and virtual responses. This is consistent with the observation of a considerable inter-subject variability with respect to listening mode (e.g.,
A three-way ANOVA with factors ISI (100, 400 ms), rate (29, 31, 33, 35, 37 pps) and target direction (SDVU, SUVD) was performed on the percentages of virtual responses across all conditions (Figure 4). The main effect of target direction was significant [F(1,23) = 5.16, MSE = .137, p < .05; =.18] indicating that more virtual responses were made to SDVU targets (mean difference = 6.8%, SEM = 3.3%). In addition, this effect was influenced by presentation rate as indicated by a significant rate by target direction interaction [F(4,92) = 3.57, MSE = .009, p < .01; =.13]. Inspection with Bonferroni correction revealed this to be caused by a greater proportion of virtual responses to SDVU relative to SUVD targets at 29 (11%, SEM = .04%, p < .01), 31 (7%, SEM = .03%, p < .05) and 33 pps (11%, SEM = .04%, p < .05) but not at higher rates.
FIGURE 4

Mean percentage (± 1 SEM) of virtual responses as a function of rate and target. SDVU = spectral down – virtual up; SUVD = spectral up – virtual down.
To examine the relationship between RT performance and listening style, the RT ANOVA was rerun with listening style as a between-subject factor. “Listening style” was defined in terms of preponderance of virtual or spectral responses. The four listeners who had made between 50 and 55% virtual or spectral responses were removed from analysis and the others were assigned to either a “virtual” or “spectral” condition. Apart from the obvious main effect of listening style [F(1,18) = 93.55, MSE = 20.52, p < .001; =.84], no significant effects of the latter factor were observed suggesting that the relationship between the two tasks was complex and would require further investigation. First, the interaction between listening style and RT facilitation might be observable only in “intermediate” listeners – those who are most likely to be affected by priming. We might not have had enough of these responders to observe the relationship between RTs and listening style and this justifies further experimental investigation. Second, the RT effects of priming might be at least partly independent of the virtual shift. To illustrate, there is evidence that virtual pitch perception requires more time relative to spectral pitch perception (e.g., Winkler et al., 1994). So, the RT effects could be confounded by the slowing down with respect to the virtual responses. It is worth noting that the same result was obtained with a stricter (75%) exclusion criterion.
DISCUSSION
The current study investigated the effects of oscillatory gamma-band priming (
The principal finding was that more virtual responses were made to SDVU relative to SUVD targets when the primes were presented at 29, 31, and 33 pps and this effect was independent of the interval between the prime and the target. The results suggest that the priming in the low gamma range could promote the binding of harmonically related components into a template thereby increasing the perceptual salience of the virtual Gestalt. The observed dependence on the type of target suggests that the presence of the first, harmonically related target tone played a role in the shift by re-establishing the entrained harmonic representation.
Figure 5 illustrates the relationship between harmonic templates activated by the stimuli. The left-hand side illustrates the SDVU condition. The prime (500 + 1000 Hz) activates the 500 Hz template, which in turn results in an oscillatory representation that persists following the prime offset (top left). The first target tone (2500 + 3000 Hz) fits into the active template helping to maintain the representation. The second tone (1800 + 2400 Hz) does not fit into the active template causing a reset in the oscillatory representation. This increases the salience of the conflicting 600 Hz template and facilitates the virtual “up” decision, but only at 29, 31, and 33 pps in broad agreement with
FIGURE 5

Relationship between harmonic templates activated by the stimuli as a function of target type (SDVU = spectral down – virtual up; SUVD = spectral up – virtual down). Thick lines denote presented frequencies and the thin ones the frequencies that were activated by the stimuli.
The absence of ISI effects in direction judgment data could be explained in terms of the difference between RT and direction aspects of the task. As shown by
The importance of priming rate was corroborated by the time-specific RT enhancement mediated by target and ISI. The results indicate that SDVU targets were processed faster while producing more virtual responses when primed in the low gamma range. At the shorter ISI of 100 ms, responding was faster for SDVU targets if they were primed at 31 pps. At the longer ISI, the inharmonic advantage was observed at 33 pps. Given the temporal specificity of the stimuli, this is in agreement with previous findings of an inharmonic RT advantage for stimuli presented at 33 pps (
The current findings of a rate-related shift in listening mode are consistent with an interaction between two (as of now putative) systems, namely, the pitch extraction system located in the PAC (lateral Heschl’s gyrus;
CONCLUSION
The current study provides the first piece of behavioral evidence that synchronized brain oscillations in the low-gamma range could promote the shift toward the virtual listening mode. Our results might have important implications for pitch perception research in two ways. First, the current task appears to represent a simple and useful diagnostic of pitch processing style. Subject to validation, this could be applied in a wide variety of experimental and applied settings in which perception plays an important role (e.g., auditory and musical development, autism, musicianship, hemispheric lateralization). Second, our results suggest that changes in pitch processing can be effected rapidly, without prolonged exposure and/or training. A systematic multi-method investigation of the time course, persistence and reversibility of the observed priming effect would afford important insights into the temporal and spatial parameters of pitch processing.
At the same time, the current design in which virtual responses were reciprocals of spectral responses could not exclude the possibility that gamma priming somehow inhibited spectral responses. While this is not likely, further studies are needed to elucidate this issue. Future research will also seek to corroborate this evidence by combining behavioral and electroencephalography (EEG) data. It will also examine the role of the relationship between spectral and virtual frequencies in modulating the intensity and time course of this virtual shift.
Statements
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
REFERENCES
1
AksentijevicA.BarberP. J.ElliottM. A. (2011). Process timing and its relation to the coding of tonal harmony.J. Exp. Psychol. Hum. Percept. Perform.371628–1642.
2
BendorD. (2011). Understanding how neural circuits measure pitch.J. Neurosci.313141–3142.
3
BendorD.WangX. (2008). Neural response properties of primary, rostral, and rostrotemporal core fields in the auditory cortex of marmoset monkeys.J. Neurophysiol.100888–906.
4
BendorD.WangX. (2010). Neural coding of periodicity in marmoset auditory cortex.J. Neurophysiol.1031809–1822.
5
BrunstromJ. M.RobertsB. (1998). Profiling the perceptual suppression of partials in periodic complex tones: further evidence for a harmonic template.J. Acoust. Soc. Am.1043511–3519.
6
DeutschW.SteegerR. (1978). “Binaurales residuum versus lokalisation,”Mitteilungen der Kommission für Schallforschung, Vol. 5(Österreichische Akademie der Wissenschaften)41–53.
7
GalambosR. (1992). “A comparison of certain gamma-band (40-Hz) brain rhythms in cat and man,” inInduced rhythms in the brain, edsBasarE.BullockT. M. (Boston: Birkhäuser) 201–216
8
GalambosR.MakeigS. (1992). Physiological studies of central masking in man. II: Tone-pip SSRs and the masking level difference.J. Acoust. Soc. Am.922691–2697.
9
GalambosR.MakeigS.TalmachoffP. J. (1981). A 40-Hz auditory potential recorded from the human scalp.Proc. Natl. Acad. Sci. U.S.A.782643–2647.
10
HeadleyD. B.WeinbergerN. M. (2011). Gamma-band activation predicts both associative memory and cortical plasticity.J. Neurosci.3112748–12758.
11
JutrasM. J.BuffaloE. A. (2010). Synchronous neural activity and memory formation.Curr. Opin. Neurobiol.20150–155.
12
KadiaS. C.WangX. (2003). Spectral integration in the A1 of awake primates: neurons with single- and multipeaked tuning characteristics.J. Neurophysiol.891603–1622.
13
LinJ. Y.HartmannW. M. (1998). The pitch of a mistuned harmonic: evidence for a template model.J. Acoust. Soc. Am.1032608–2617.
14
LoftusG. RMassonM. E. J. (1994). Using confidence intervals in within-subject designs.Psychon. Bull. Rev.1476–490.
15
McLachlanN. M. (2011). A neurocognitive model of recognition and pitch segregation.J. Acoust. Soc. Am.1302845–2854.
16
MicheylC.OxenhamA. J. (2007). Across-frequency pitch discrimination interference between complex tones containing resolved harmonics.J. Acoust. Soc. Am.1211621–1631.
17
PantevC.EngeleinA.CandiaV.ElbertT. (2001). “Representational cortex in musicians: plastic alterations in response to musical practice,” inThe Biological Foundations of Music, edsZattoreR. J.PeretzI. (New York: The New York Academy of Sciences) 300–314.
18
PatelA. D.BalabanE. (2001). Human pitch perception is reflected in the timing of stimulus-related cortical activity.Nat. Neurosci.4839–844.
19
PattersonR. D.UppenkampS.JohnsrudeI. S.GriffithsT. D. (2002). The processing of temporal pitch and melody information in auditory cortex.Neuron36767–776.
20
PenagosH.MelcherJ. R.OxenhamA. J. (2004). A neural representation of pitch salience in nonprimary human auditory cortex revealed with functional magnetic resonance imaging.J. Neurosci.246810–6815.
21
PuschmannS.UppenkampS.KollmeierB.ThielC. M. (2010). Dichotic pitch processing activates centre in Heschl’s gyrus.Neuroimage491641–1649.
22
SchneiderP.SlumingV.RobertsN.SchergM.GoebelR.SpechtH. J.et al (2005). Structural and functional asymmetry of lateral Heschl’s gyrus reflects pitch perception preference.Nat. Neurosci.81241–1247.
23
SchulteM.KniefA.Seither-PreislerA.PantevC. (2002). Different modes of pitch perception and learning-induced neuronal plasticity of the human auditory cortex.Neural Plast.9161–175.
24
ShammaS.KleinD. (2000). The case of the missing pitch templates: how harmonic templates emerge in the early auditory system.J. Acoust. Soc. Am.1072631–2644.
25
SmoorenburgG. F. (1970). Pitch perception of two-frequency stimuli.J. Acoust. Soc. Am.4924–942.
26
TerhardtE. (1974). Pitch, consonance, and harmony.J. Acoust. Soc. Am.551061–1069.
27
TerhardtE. (1989). Warum hören wir Sinustöne?Nat. Sci. (Naturwissenschaften)76496–504.
28
ThutG.SchynsP. G.GrossJ. (2011). Entrainment of perceptually relevant brain oscillations by non-invasive rhythmic stimulation of the brain.Front. Psychol. 2:170. 10.3389/fpsyg.2011.00170
29
WinklerI.TervaniemiMNäätänenR. (1994). Sensory memory for virtual pitch (Abstract). 7th IOP Scientific Meeting/International.J. Psychophysiol.18157.
Summary
Keywords
gamma-band, virtual pitch, pitch perception, pitch coding, harmonic templates, oscillatory priming
Citation
Aksentijevic A, Northeast A, Canty D and Elliott MA (2013) The oscillatory entrainment of virtual pitch perception. Front. Psychol. 4:210. doi: 10.3389/fpsyg.2013.00210
Received
23 November 2012
Accepted
05 April 2013
Published
25 April 2013
Volume
4 - 2013
Edited by
Robert J. Zatorre, McGill University, Canada
Reviewed by
Tobias Overath, University College London, UK; Robert J. Ellis, Beth Israel Deaconess Medical Center, USA
Copyright
© Aksentijevic, Northeast, Elliott and Canty.
This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc.
*Correspondence: Aleksandar Aksentijevic, Department of Psychology, Whitelands College, University of Roehampton, Holybourne Avenue, London SW154JD, UK. e-mail: a.aksentijevic@roehampton.ac.uk
This article was submitted to Frontiers in Auditory Cognitive Neuroscience, a specialty of Frontiers in Psychology.
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.