Abstract
Working memory denotes the ability to retain stimuli in mind that are no longer physically present and to perform mental operations on them. Electro- and magnetoencephalography allow investigating the short-term maintenance of acoustic stimuli at a high temporal resolution. Studies investigating working memory for non-spatial and spatial auditory information have suggested differential roles of regions along the putative auditory ventral and dorsal streams, respectively, in the processing of the different sound properties. Analyses of event-related potentials have shown sustained, memory load-dependent deflections over the retention periods. The topography of these waves suggested an involvement of modality-specific sensory storage regions. Spectral analysis has yielded information about the temporal dynamics of auditory working memory processing of individual stimuli, showing activation peaks during the delay phase whose timing was related to task performance. Coherence at different frequencies was enhanced between frontal and sensory cortex. In summary, auditory working memory seems to rely on the dynamic interplay between frontal executive systems and sensory representation regions.
Introduction
Working memory allows the temporary storage of relevant information and its task-dependent manipulation. It is involved in many higher cognitive functions and thus constitutes a fundamental function of our brain. While most previous research has focused on visual working memory (; ), less is known about the neural correlates of auditory working memory (AWM). This brief review summarizes some of the main findings on auditory short-term or working memory (both terms will be used interchangeably) studies in humans. The focus will be on the dynamics of working memory-related processes; therefore the review is limited to studies assessing non-invasive measures of neural activation with a high temporal resolution, i.e., electro- or magnetoencephalography (EEG and MEG). Most of this work has considered event-related potentials (ERPs), but some investigations have looked at spectral activity and at oscillatory coupling between cortical sources.
Evidence from both types of studies speaks against the existence of a single working memory store for auditory information. Instead, activation patterns vary with the type of memorized auditory information, suggesting that working memory involves the same systems that underlie perceptual processing. Sound feature-specific activation differences were particularly obvious for comparisons between sound identity and location, i.e., stimulus parameters that are processed in topographically distinct cortical regions ().
Auditory Working Memory for Non-spatial Sound Features
The short-term retention of pitch elicits a load-dependent frontal negative wave. Using non-verbal, pure-tone stimuli to avoid phonological or semantic processing, memory load effects were tested by presenting either one 200-ms pure tone to both ears or two different stimuli to each ear (). A sustained anterior negative wave (SAN) during the 2-s delay interval showed higher amplitudes for two than one to-be-remembered stimulus. Control experiments confirmed the role of the SAN for short-term memory processing by excluding a mere sensory-driven response or internal rehearsal. Comparison with a visual short-term memory paradigm showed that the SAN during retention was specific to the auditory task (). A memory load-sensitive SAN was also observed during the retention of sounds differing in timbre instead of pitch (). The cortical generators of this wave were assessed with MEG. During AWM for tone sequences, source localization revealed memory load-dependent activations in bilateral superior temporal, superior parietal and frontal cortex (). A study involving the comparison of tone sequences of different lengths identified several brain areas whose activation correlated with the number of successfully memorized items (). These included bilateral superior/middle temporal cortex and several regions in bilateral frontal cortex. This source topography partly overlapped with fMRI results (; ) and suggested that the retention of simple acoustic features involves the sustained activation of sensory representations in addition to frontal executive regions.
The frontal negativity is a robust phenomenon that was also observed in ERP studies employing verbal sounds that may elicit semantic processing beyond low-level acoustic storage. A sustained frontal negative shift was larger for aurally than visually presented digits (). Similarly, a memory load-dependent frontal negativity was larger for spoken than written syllables (), whereas visual stimuli gave rise to a posterior positivity. The role of the prefrontal cortex for AWM was further supported by a study in patients with frontal cortex lesions. They showed reduced activations both in auditory areas and prefrontal cortex and failed to attenuate their responses to distracting tones during the delay period of an AWM task ().
While ERP investigations focus on time-locked broad-band activity, spectral analysis is typically performed on single-trial basis, maintaining activity that is not phase-locked to a defined event. Analyses of spectral activity in different frequency bands may inform about aspects of processing not captured by ERPs. For example, activity in the alpha band (8–12 Hz) has been related to active inhibition of interfering processing (; ), and gamma activity (>30 Hz) has been linked to object representations, attention and memory (; ). Moreover, coherence or phase synchronization calculated on the basis of spectral signals provide information about cortico-cortical interactions.
Increases of spectral power and synchronization over frontal cortex characterized AWM for different types of non-spatial sounds. During the maintenance phase of an AWM task requiring the memorization of sound durations, we found increased gamma activity (70–80 Hz) over prefrontal cortex (). A similar result was obtained for artificial syllables varying in voice onset time and formant structure. Here gamma activity (65–70 Hz) was increased over left anterior temporal/inferior frontal cortex (). Gamma coherence between the putative sensory representation regions and prefrontal cortex showed a sustained increase across the delay phase (), possibly reflecting enhanced cross-talk between storage and executive networks underlying stimulus maintenance. Right frontal alpha and right temporal beta activity correlated positively with memory load during the delay period of a Sternberg-type task using natural syllables (). The alpha increase was consistent with other auditory (; ; ) and visual short-term memory studies (, ) and may have reflected increased executive demands and/or the suppression of irrelevant processing.
Auditory Working Memory for Spatial Sound Features
MEG studies investigating spatial AWM tasks with filtered noise sounds found gamma activity over regions of the putative auditory dorsal space processing stream (). When comparing auditory spatial working memory with a non-memory contral task, both maintenance and retrieval of lateralized sounds were accompanied by increased parietal gamma activity (55–70 Hz) (; ). In addition, enhanced frontal gamma activity was found during the final 100 ms of the maintenance period. As in our study with artificial syllables described above (), gamma coherence between the putative sensory representation regions and frontal cortex was increased during the delay phase.
Inspired by the hypothesized role of gamma activity for sensory representations (), we searched for spectral signatures of the short-term maintenance of individual auditory stimuli by contrasting delay-period activations between individual memory stimuli. We performed Fast Fourier Transforms on single trials for about 1.5 Hz-wide frequency bins across the gamma range. The problem of multiple testing was addressed by applying a statistical probability mapping based on permutation tests. When frequency ranges showing significant differences between stimuli were identified, the data were filtered in these frequencies to assess spectral activity time courses.
We identified stimulus-specific components of gamma activity during the maintenance of different sound lateralization angles (). Sample stimuli were 200-ms noises convoluted with head-related transfer functions to create virtual lateralization angles of either 15° or 45° with respect to the midsagittal plane. After an 800-ms delay period, these stimuli had to be compared with test stimuli that could either be presented with the same, with a more medial or a more lateral angle. Participants were assigned to two groups who were presented with only right- or left-lateralized stimuli, respectively. For both groups, stimulus-specific gamma activity (55–70 Hz) was found over occipito-parietal cortex contralateral to stimulation. This topography could be considered consistent with the auditory dorsal “where” stream, but might also indicate an involvement of visual spatial imagery. Gamma activity was most pronounced at latencies of 200–500 ms after sound offset, i.e., in the middle of the 800-ms delay phase.
This timing of stimulus-specific gamma activity could either have reflected delayed responses to memory sounds or preparatory activations preceding the test stimuli. To decide between these possibilities, a follow-up study used delay durations of either 800 or 1200 ms in separate recording blocks (). The main results of this study are depicted in Figure 1. We replicated stimulus-specific gamma activity (75–100 Hz) over contralateral posterior cortex. For the shorter delay duration, this activity peaked again in the middle of the maintenance phase, i.e., about 400 ms after the offset of the memory stimulus. In contrast, stimulus-specific activity was clearly delayed for the longer delay duration, peaking at around 800 ms after memory stimulus offset. In other words, gamma activity reached its maximum 400 ms before the onset of the test stimulus for both delay durations. The time course of stimulus-specific activity thus seemed to reflect the activation of task-relevant information in preparation for comparison with the test sound.
FIGURE 1
We also examined the relationship between stimulus-specific gamma activity and task performance. If these signals reflect the activation of task-relevant information, they should predict the accuracy of the comparison with the test stimuli. In both studies (
FIGURE 2

Time courses of the differentiation score (see legend to Figure 1) for good and bad performers (in blue and red, respectively) for the short delay duration (A) and the long duration (B) in the study by
Direct Comparisons of Auditory Spatial Versus Non-spatial Working Memory
Studies that compared working memory for sound locations and sound patterns directly supported the notion of dorsal and ventral streams for the processing of auditory spatial and non-spatial information, respectively (
Differences between auditory location and pitch working memory were found also for the N1 component to pure tones serving as test stimuli, suggesting an early onset of segregated processing at about 100 ms (
In line with the studies reported above that used simple sounds, an n-back working memory task with environmental sounds presented at different virtual locations revealed segregation between spatial and non-spatial processing from about 200 ms onwards in auditory association cortex and fronto-parietal cortex (
Following up our studies on stimulus-specific gamma activity by comparing non-spatial and spatial AWM directly, we demonstrated the task-dependence of stimulus-specific activations (
Summary
The present findings are consistent with the notion of working memory as an emergent property relying on the dynamic interplay between attentional and sensory systems (
While the majority of studies have focused on the maintenance aspect of working memory, research on mental operations on stored sounds is very limited. Working memory operations include the selection of one stored item amongst others, updating the focus of attention or the content of working memory with new items, rehearsal and coping with interference (
While we have gained substantial knowledge about EEG/MEG signals sensitive to the number of auditory items held in short-term memory, future studies may focus on the neuronal signature coding the precision of individual items (
Conflict of Interest Statement
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Statements
Acknowledgments
I am grateful to Christoph Bledowski for helpful comments.
Conflict of interest
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AlainC.ArnottS. R.HevenorS.GrahamS.GradyC. L. (2001). “What” and “where” in the human auditory system. Proc. Natl. Acad. Sci. U.S.A.98, 12301–12306. 10.1073/pnas.211209098
2
AlainC.McDonaldK. L.KovacevicN.McIntoshA. R. (2009). Spatiotemporal analysis of auditory “what” and “where” working memory. Cereb. Cortex19, 305–314. 10.1093/cercor/bhn082
3
AnourovaI.NikoulineV. V.IlmoniemiR. J.HottaJ.AronenH. J.CarlsonS. (2001). Evidence for dissociation of spatial and nonspatial auditory information processing. Neuroimage14, 1268–1277. 10.1006/nimg.2001.0903
4
AnurovaI.ArtchakovD.KorvenojaA.IlmoniemiR. J.AronenH. J.CarlsonS. (2003). Differences between auditory evoked responses recorded during spatial and nonspatial working memory tasks. Neuroimage20, 1181–1192. 10.1016/S1053-8119(03)00353-7
5
AnurovaI.ArtchakovD.KorvenojaA.IlmoniemiR. J.AronenH. J.CarlsonS. (2005). Cortical generators of slow evoked responses elicited by spatial and nonspatial auditory working memory tasks. Clin. Neurophysiol.116, 1644–1654. 10.1016/j.clinph.2005.02.029
6
BackerK. C.BinnsM. A.AlainC. (2015). Neural dynamics underlying attentional orienting to auditory representations in short-term memory. J. Neurosci.35, 1307–1318. 10.1523/JNEUROSCI.1487-14.2015
7
BledowskiC.KaiserJ.RahmB. (2010). Basic operations in working memory: contributions from functional imaging studies. Behav. Brain Res.214, 172–179. 10.1016/j.bbr.2010.05.041
8
ChaoL. L.KnightR. T. (1998). Contribution of human prefrontal cortex to delay performance. J. Cogn. Neurosci.10, 167–177. 10.1162/089892998562636
9
DrewT. W.McColloughA. W.VogelE. K. (2006). Event-related potential measures of visual working memory. Clin. EEG Neurosci.37, 286–291. 10.1177/155005940603700405
10
GaabN.GaserC.ZaehleT.JänckeL.SchlaugG. (2003). Functional anatomy of pitch memory—an fMRI study with sparse temporal sampling. Neuroimage19, 1417–1426. 10.1016/S1053-8119(03)00224-6
11
GrimaultS.LefebvreC.VachonF.PeretzI.ZatorreR.RobitailleN.et al (2009). Load-dependent brain activity related to acoustic short-term memory for pitch: magnetoencephalography and fMRI. Ann. N. Y. Acad. Sci.1169, 273–277. 10.1111/j.1749-6632.2009.04844.x
12
GrimaultS.NoldenS.LefebvreC.VachonF.HydeK.PeretzI.et al (2014). Brain activity is related to individual differences in the number of items stored in auditory short-term memory for pitch: evidence from magnetoencephalography. Neuroimage94, 96–106. 10.1016/j.neuroimage.2014.03.020
13
GuimondS.VachonF.NoldenS.LefebvreC.GrimaultS.JolicoeurP. (2011). Electrophysiological correlates of the maintenance of the representation of pitch objects in acoustic short-term memory. Psychophysiology48, 1500–1509. 10.1111/j.1469-8986.2011.01234.x
14
JensenO.KaiserJ.LachauxJ. P. (2007). Human gamma-frequency oscillations associated with attention and memory. Trends Neurosci.30, 317–324. 10.1016/j.tins.2007.05.001
15
JensenO.MazaheriA. (2010). Shaping functional architecture by oscillatory alpha activity: gating by inhibition. Front. Hum. Neurosci.4:186. 10.3389/fnhum.2010.00186
16
KaiserJ.HeideggerT.WibralM.AltmannC. F.LutzenbergerW. (2007a). Alpha synchronization during auditory spatial short-term memory. Neuroreport18, 1129–1132. 10.1097/WNR.0b013e32821c553b
17
KaiserJ.LeibergS.RustH.LutzenbergerW. (2007b). Prefrontal gamma-band activity distinguishes between sound durations. Brain Res.1139, 153–162. 10.1016/j.brainres.2006.12.085
18
KaiserJ.HeideggerT.WibralM.AltmannC. F.LutzenbergerW. (2008). Distinct gamma-band components reflect the short-term memory maintenance of different sound lateralization angles. Cereb. Cortex18, 2286–2295. 10.1093/cercor/bhm251
19
KaiserJ.LeibergS.LutzenbergerW. (2005). Let’s talk together: memory traces revealed by cooperative activation in the cerebral cortex. Int. Rev. Neurobiol.68, 51–78. 10.1016/S0074-7742(05)68003-8
20
KaiserJ.LutzenbergerW. (2003). Induced gamma-band activity and human brain function. Neuroscientist9, 475–484. 10.1177/1073858403259137
21
KaiserJ.LutzenbergerW.DeckerC.WibralM.RahmB. (2009a). Task-and performance-related modulation of domain-specific auditory short-term memory representations in the gamma-band. Neuroimage46, 1127–1136. 10.1016/j.neuroimage.2009.03.011
22
KaiserJ.RahmB.LutzenbergerW. (2009b). Temporal dynamics of stimulus-specific gamma-band activity components during auditory short-term memory. Neuroimage44, 257–264. 10.1016/j.neuroimage.2008.08.018
23
KaiserJ.RipperB.BirbaumerN.LutzenbergerW. (2003). Dynamics of gamma-band activity in human magnetoencephalogram during auditory pattern working memory. Neuroimage20, 816–827. 10.1016/S1053-8119(03)00350-1
24
KawasakiM.KitajoK.YamaguchiY. (2010). Dynamic links between theta executive functions and alpha storage buffers in auditory and visual working memory. Eur. J. Neurosci.31, 1683–1689. 10.1111/j.1460-9568.2010.07217.x
25
KawasakiM.KitajoK.YamaguchiY. (2014). Fronto-parietal and fronto-temporal theta phase synchronization for visual and auditory-verbal working memory. Front. Psychol.5:200. 10.3389/fpsyg.2014.00200
26
KlimeschW.SausengP.HanslmayrS. (2007). EEG alpha oscillations: the inhibition-timing hypothesis. Brain Res. Rev.53, 63–88. 10.1016/j.brainresrev.2006.06.003
27
KoelschS.SchulzeK.SammlerD.FritzT.MullerK.GruberO. (2009). Functional architecture of verbal and tonal working memory: an FMRI study. Hum. Brain Mapp.30, 859–873. 10.1002/hbm.20550
28
KumarS.JosephS.PearsonB.TekiS.FoxZ. V.GriffithsT. D.et al (2013). Resource allocation and prioritization in auditory working memory. Cogn. Neurosci.4, 12–20. 10.1080/17588928.2012.716416
29
LangW.StarrA.LangV.LindingerG.DeeckeL. (1992). Cortical DC potential shifts accompanying auditory and visual short- term memory. Electroencephalogr. Clin. Neurophysiol.82, 285–295. 10.1016/0013-4694(92)90108-T
30
LefebvreC.VachonF.GrimaultS.ThibaultJ.GuimondS.PeretzI.et al (2013). Distinct electrophysiological indices of maintenance in auditory and visual short-term memory. Neuropsychologia51, 2939–2952. 10.1016/j.neuropsychologia.2013.08.003
31
LehnertG.ZimmerH. D. (2006). Auditory and visual spatial working memory. Mem. Cogn.34, 1080–1090. 10.3758/BF03193254
32
LeibergS.KaiserJ.LutzenbergerW. (2006a). Gamma-band activity dissociates between matching and nonmatching stimulus pairs in an auditory delayed matching-to-sample task. Neuroimage30, 1357–1364. 10.1016/j.neuroimage.2005.11.010
33
LeibergS.LutzenbergerW.KaiserJ. (2006b). Effects of memory load on cortical oscillatory activity during auditory pattern working memory. Brain Res.1120, 131–140. 10.1016/j.brainres.2006.08.066
34
LuckS. J.VogelE. K. (2013). Visual working memory capacity: from psychophysics and neurobiology to individual differences. Trends Cogn. Sci.17, 391–400. 10.1016/j.tics.2013.06.006
35
LuoH.HusainF. T.HorwitzB.PoeppelD. (2005). Discrimination and categorization of speech and non-speech sounds in an MEG delayed-match-to-sample study. Neuroimage28, 59–71. 10.1016/j.neuroimage.2005.05.040
36
LutzenbergerW.RipperB.BusseL.BirbaumerN.KaiserJ. (2002). Dynamics of gamma-band activity during an audiospatial working memory task in humans. J. Neurosci.22, 5630–5638.
37
MaW. J.HusainM.BaysP. M. (2014). Changing concepts of working memory. Nat. Neurosci.17, 347–356. 10.1038/nn.3655
38
NoldenS.BermudezP.Alunni-MenichiniK.LefebvreC.GrimaultS.JolicoeurP. (2013). Electrophysiological correlates of the retention of tones differing in timbre in auditory short-term memory. Neuropsychologia51, 2740–2746. 10.1016/j.neuropsychologia.2013.09.010
39
PasternakT.GreenleeM. W. (2005). Working memory in primate sensory systems. Nat. Rev. Neurosci.6, 97–107. 10.1038/nrn1603
40
RauscheckerJ. P.TianB. (2000). Mechanisms and streams for processing of “what” and “where” in auditory cortex. Proc. Natl. Acad. Sci. U.S.A.97, 11800–11806. 10.1073/pnas.97.22.11800
41
RiederM. K.RahmB.WilliamsJ. D.KaiserJ. (2011). Human gamma-band activity and behavior. Int. J. Psychophysiol.79, 39–48. 10.1016/j.ijpsycho.2010.08.010
42
RuchkinD. S.BerndtR. S.JohnsonR.Jr.RitterW.GrafmanJ.CanouneH. L. (1997). Modality-specific processing streams in verbal working memory: evidence from spatio-temporal patterns of brain activity. Cogn. Brain Res.6, 95–113. 10.1016/S0926-6410(97)00021-9
43
SausengP.KlimeschW.HeiseK. F.GruberW. R.HolzE.KarimA. A.et al (2009). Brain oscillatory substrates of visual short-term memory capacity. Curr. Biol.19, 1846–1852. 10.1016/j.cub.2009.08.062
44
SausengP.KlimeschW.SchabusM.DoppelmayrM. (2005). Fronto-parietal EEG coherence in theta and upper alpha reflect central executive functions of working memory. Int. J. Psychophysiol.57, 97–103. 10.1016/j.ijpsycho.2005.03.018
Summary
Keywords
review, event-related potentials, spectral activity, gamma, coupling, spatial processing, non-spatial processing
Citation
Kaiser J (2015) Dynamics of auditory working memory. Front. Psychol. 6:613. doi: 10.3389/fpsyg.2015.00613
Received
26 March 2015
Accepted
25 April 2015
Published
11 May 2015
Volume
6 - 2015
Edited by
Timothy M. Ellmore, The City College of New York, USA
Reviewed by
Jonathan R. Folstein, Florida State University, USA; Christine Lefebvre, Centre de Recherche de L’institut Universitaire de Gériatrie de Montréal, Canada
Copyright
© 2015 Kaiser.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jochen Kaiser, Institute of Medical Psychology, Goethe University, Heinrich-Hoffmann-Strasse 10, 60528 Frankfurt am Main, Germany, j.kaiser@med.uni-frankfurt.de
This article was submitted to Cognition, a section of the journal Frontiers in Psychology.
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.