BRIEF RESEARCH REPORT article

Front. Behav. Neurosci., 16 July 2020

Sec. Learning and Memory

Volume 14 - 2020 | https://doi.org/10.3389/fnbeh.2020.00118

Assessing Rhythmic Visual Entrainment and Reinstatement of Brain Oscillations to Modulate Memory Performance

  • 1. Neural Control of Movement Lab, Department of Health Sciences and Technology, ETH Zürich, Zurich, Switzerland

  • 2. Cognition, Perception and Behaviour in Urban Environments, Future Cities Laboratory, Singapore-ETH Centre, Singapore, Singapore

  • 3. Neuroscience Center Zurich (ZNZ), University and ETH Zürich, Zurich, Switzerland

Abstract

The human brain’s ability to store information and remember past events is thought to be orchestrated by the synchronization of neuronal oscillations in various frequency bands. A vast amount of research has found that neural oscillations in the theta (∼4–7 Hz) and alpha (∼8–12 Hz) bands play an important role in memory formation. More specifically, it has been suggested that memory performance benefits if the same oscillatory pattern is present during encoding and retrieval. However, the causal relevance of these oscillations is not well understood. Rhythmic sensory stimulation is thought to entrain ongoing brain oscillations and modulate associated functions (e.g., memory formation). In the present study, we used rhythmic visual stimulation at 6 and 10 Hz to experimentally modulate the memory encoding process in a recognition memory task. In addition, we reinstated oscillatory activity from the encoding episode during retrieval, which has been hypothesized to result in memory performance improvements compared to non-reinstated conditions and incongruent reinstatement. Contrary to our hypothesis, we find no effect of neural entrainment during encoding on subsequent memory performance. Likewise, memory retrieval does not benefit from neural reinstatement. The results are discussed with respect to methodological challenges of rhythmic sensory stimulation as a means to alter cognitive processes and induce context-dependent memory effects.

Introduction

Memory processes in humans are characterized by the ability to store and mentally reconstruct episodic information. A vast amount of research has found brain activity to be an important mechanism for the formation and reactivation of memories, especially neural oscillations (for reviews, see ; ; ).

The formation of episodic memories has been associated with neuronal oscillatory activity in the theta (∼4–7 Hz), alpha (∼8–12 Hz), beta (∼15–30 Hz), and gamma (>30 Hz) frequency bands (; ; Köster et al., 2018). The encoding of visual information has been specifically linked to increases in theta and gamma power and decreases in alpha power (; ). Theta is known to be enhanced during successful encoding in context-dependent memory tasks (; ; ) because it is believed to facilitate associative binding of perceptual information (; ). Moreover, it has been argued that memory benefits not from enhancing theta amplitude per se but rather from the associated strengthening of theta–gamma phase-amplitude coupling in the human cortex (; ; Köster et al., 2014, ), which is thought to be responsible for ordering and integrating novel perceptual information into existing memory networks (). Reduced alpha power is thought to reflect cognitive and attentional gating processes during encoding by disinhibiting relevant brain areas (; ; ).

Successful remembering not only is determined by neuronal processes during encoding but also depends on how the information is later retrieved. This claim originates from early studies showing that memory performance depends on the overlap of the encoding and retrieval situation (; ; ). This so-called encoding specificity principle states that memory performance is higher if contextual features during retrieval match those of the encoding episode compared to non-matching situations (for a review, see ). Intriguingly, neural activity has been shown to reveal similar patterns during memory tasks. This neural reinstatement hypothesis claims that patterns of cortical activity during encoding are reinstated during successful retrieval (; ). Recent studies using electrophysiological measures of brain activity [electroencephalography (EEG) or magnetoencephalography (MEG)] found evidence for neural reinstatement by demonstrating the reoccurrence of oscillatory patterns present at encoding during retrieval (; ; ). reported that reinstated neural patterns are not restricted to naturally ongoing brain activity but can also represent previously evoked oscillations (). During encoding, participants were exposed to visual flickering (6 or 10 Hz), which is known to produce steady-state visually evoked potentials (SSVEPs) in visual areas of the brain at the same frequency as the visual input (). Intriguingly, during the subsequent recognition task which was performed with a neutral background, the authors found that successful retrieval was accompanied by intrinsically evoked neural activity at the same oscillatory frequency as extrinsically evoked during encoding (). This finding confirms the view that neural reinstatement supports memory recall and provides further evidence for the possibility of tagging memories with rhythmical sensory stimulation.

Although found no effect of visual stimulation on memory performance, others revealed a correlational relationship between neural oscillations and memory processes, with modulated memory performance resulting from experimentally altered neuronal activity. Transcranial alternating current stimulation (tACS) is a common method to alter neuronal activity and has been reported to affect the power, phase, and frequency of ongoing brain oscillations (e.g., ; ). While early research used tACS to target consolidation processes during sleep (), more recent findings aimed to alter neural activity during encoding and retrieval (; ). Applying tACS during a declarative memory task at gamma frequencies (60 and 90 Hz) to the left dorsolateral prefrontal cortex, revealed that applying the same stimulation frequencies during encoding and recognition caused a significant memory improvement relative to sham stimulation ().

An alternative method to entrain brain oscillations is rhythmic sensory stimulation as described above. Compared to tACS, this method has the advantage that no electrical artifacts are induced, thus EEG recording during stimulation is feasible (for a review, see ). Regarding processing of visual stimuli, research using an object-recognition task has shown that SSVEPs in the theta band are increased for unfamiliar stimuli, while SSVEPs in the alpha band revealed a similar increase for familiar stimuli (). Applying audiovisual entrainment, a recent study found that in-phase visual and auditory theta stimulation enhanced associative memory formation (). This finding provides causal evidence that memory formation relies on the synchronization of sensory inputs in the theta band. A similar study was conducted by , who exposed participants to audiovisual theta entrainment during the consolidation phase of an episodic memory task. Confirming the crucial role of theta oscillations in memory formation, they found that entrainment resulted in increased theta power during memory retrieval, which was associated with better memory performance (). In order to modulate memory performance, had visual objects in an object-recognition task flicker at individually adjusted theta and alpha frequencies. In line with the hypothesized effects of the chosen frequency bands, they found that theta enhanced the formation of novel memories, in contrast to alpha stimulation. Their EEG results revealed that this behavioral effect could not be explained by changes in theta power alone but by theta–gamma phase-amplitude coupling in widespread cortical networks (). Regarding the memory effects of theta and alpha entrainment, it has to be noted that encoding without visual stimulation resulted in the best overall memory performance, suggesting that flickering had primarily a disruptive effect, confounding the potential effect of neural entrainment on memory formation.

Taken together, neural oscillations during encoding of new information and the match between oscillatory patterns during encoding and subsequent retrieval play an important role for episodic memory formation and performance. Additionally, rhythmic sensory stimulation is thought to entrain ongoing brain oscillations and modulate associated functions (e.g., memory formation). Building on the abovementioned findings, in the present study, we used rhythmic visual stimulation in the theta (6 Hz) and alpha (10 Hz) frequency bands during encoding to experimentally modulate the memory formation process in a recognition memory task. In addition, we hypothesized that reinstating the same oscillatory activity during encoding and retrieval via sensory stimulation would result in memory performance improvements compared to non-reinstated conditions and incongruent frequency reinstatement.

Materials and Methods

Participants

A total of 34 healthy participants with normal or corrected-to-normal vision were recruited and participated in the experiment. One participant was excluded from the analysis due to technical problems. Three others did not reach the minimum required performance rate of 80% correct responses during the encoding task and were excluded because insufficient attention was suspected. This resulted in a final sample of 30 participants (female: 17; age: M ± SD = 23.8 ± 4.5 years). The study protocol was approved by the local ethics committee of the canton of Zurich and was conducted in accordance with the Declaration of Helsinki. Participants provided informed consent and were briefed on the study procedures. Participants were naive with regard to the hypothesis of the study.

Design and Procedure

Participants were comfortably seated in a dark sound-attenuated room approximately 100 cm away from a (27-inch) computer screen. The experimental procedure was adapted from a previous study () and consisted of two consecutive parts: encoding and retrieval of words presented on a computer screen. For this, 360 German nouns were derived from the Berlin Affective Word List (BAWL-R). Selected words were restricted to consist of one to three syllables, an imageability rating of at least 5.0, and an arousal rating of less than 3.0. Assignment of words to experimental conditions was randomized for each participant.

Encoding

During encoding, 240 words were successively presented in the center of a computer screen with a gray background. Each trial started with the presentation of a fixation cross (0.75–1.25 s), followed by a black-and-white checkerboard (Figure 1). In half of the trials (120 words), the checkerboard flickered at 6 Hz; in the other half, at 10 Hz. The order of the trials was randomized. After 0.5 s, a word appeared in a gray box in front of the flickering checkerboard for 2.5 s. Participants were instructed to count the number of syllables for each word and indicate via a button press during the subsequently presented screen (depicting a question mark for 1 s) whether the number of syllables was odd or even. After the encoding phase of all 240 words, participants were instructed to execute a 5-min distraction task (counting backward) before the retrieval phase started.

FIGURE 1

Retrieval

Retrieval trials consisted of the previously presented 240 words (old words) together with the remaining 120 words that participants had not yet seen (new words). Each trial started with a fixation cross in the center of a gray screen (0.75–1.25 s), followed by a black-and-white checkerboard. After 0.5 s, a word appeared in front of the checkerboard for 2.0 s. The checkerboard flickered in one third of trials consisting of old words (=80 words) at the same frequency as during encoding (congruent trials), in another third at the other frequency (incongruent trials), and finally in the last third of trials without flickering (no flicker trials). In trials consisting of new words, one third (=40 words) was flickering at 6 Hz, another third at 10 Hz, and the last third without flicker. Again, the order of the trials was randomized. After word presentation, a question mark appeared in the center of the screen for 1.5 s, and participants were instructed to indicate with a button press whether the word was old (one that was previously encoded) or new.

Data Analysis and Statistics

Our behavioral outcome measure compared hit rates across different encoding and retrieval conditions (see “Results”). For each condition, hit rates were calculated as the number of correctly remembered old words divided by the total number of presented old words during retrieval. A repeated-measures ANOVA in SPSS Version 25 (IBM, United States) tested for statistical differences in memory performance between entrainment conditions. In addition, Bayes factors (BF10 and BF01) were derived using JASP software Version 0.8.61. The main advantage of Bayes statistics over a frequentist approach is the expression of evidence in favor of the null (H0) or alternative hypothesis (H1) ().

Results

No Effect of Encoding Frequency on Encoding Performance

To rule out differences in recognition based on attentional processes during the encoding phase of the experiment, we first analyzed the encoding performance across both entrainment conditions (6 and 10 Hz). Encoding performance was determined as the rate of correct responses in the syllable counting task. Although on average, accuracy during the 10-Hz flicker was higher (M = 0.95, SD = 0.04) compared to that of the 6-Hz flicker (M = 0.94, SD = 0.04), a paired-sample t-test revealed no statistical difference between the two entrainment frequencies during encoding on syllable counting accuracy [t(29) = −1.366, p = 0.182]. This result suggests comparable levels of attention during both entrainment conditions.

No Effect of Encoding Frequency on Retrieval Performance

With the aim of replicating the previously reported effect of enhanced memory performance after theta entrainment during encoding compared to alpha entrainment (), we analyzed hit rates across old words that were encoded with the 6-Hz flicker and compared them with hit rates for old words that were encoded with the 10-Hz flicker. Note that this analysis included old words regardless of retrieval condition (congruent, incongruent, no flicker). A repeated-measures ANOVA (2 × 3 factors: two encoding frequencies with three retrieval conditions) revealed no main effect of encoding frequency on hit rate [F(1,29) = 0.563, p = 0.459; Figure 2], thus failing to replicate the beneficial effect of theta compared to alpha entrainment. Bayes statistics revealed that the null effect of the encoding frequency was 4.9 times more likely compared to the alternative hypothesis (BF10 = 0.209, BF01 = 4.918), thus suggesting moderate evidence for the null hypothesis (H0) (see ).

FIGURE 2

No Effect of Neural Reinstatement on Memory Performance

To test the hypothesized effect of reinstated neural oscillations on memory performance, we looked at the main effect of retrieval condition in the same ANOVA described in the previous section (2 × 3 factor repeated-measures ANOVA). Contrary to our hypothesis, differences in old word hit rates between retrieval conditions (congruent, incongruent, no flicker) across both entrainment frequencies revealed that reinstatement of neural oscillations did not have a beneficial effect on hit rates [F(2,28) = 0.513, p = 0.604; Figure 2]. Bayes factors confirmed this finding by revealing moderate evidence in favor of the null hypothesis (BF10 = 0.109, BF01 = 9.154). In addition, our analysis revealed no significant interaction effect between encoding frequency and retrieval condition [F(2,28) = 0.398, p = 0.676; BF10 = 0.127, BF01 = 7.862].

Discussion

Previous research has revealed that (i) theta and alpha neural oscillations play an important role in human memory formation, and (ii) reinstating the same oscillatory patterns during retrieval as during encoding improves remembering of stored information (for a review, see ). In addition, a recent study found rhythmic sensory stimulation during encoding to modulate relevant brain oscillations, resulting in altered memory performance (). The aim of the present study was to build on these previous findings and to expand the suggested relevance of rhythmic sensory stimulation as a tool for neural entrainment by revealing the effects of neural reinstatement on memory performance. We used rhythmic visual stimulation in the theta (6 Hz) and alpha (10 Hz) frequency bands during recognition memory task encoding and induced reinstatement of oscillatory activity during retrieval with matching (congruent) or mismatching (incongruent) frequencies. In contrast to our hypotheses, we found no effect of entrainment on memory performance during encoding and no influence of matching entrainment frequencies during encoding and retrieval.

Mixed Findings Regarding Visual Entrainment on Memory Performance

Influencing memory performance by entraining neural oscillations via rhythmic sensory stimulation has been a long-standing idea. For the visual system, reported recently that theta entrainment during encoding enhances subsequent memory retrieval compared to alpha entrainment. However, two other studies following a similar rationale could not reproduce the effect reported by . First, entrained visual theta (6 Hz) or alpha (10 Hz) during encoding but found no difference in recognition performance between words that were encoded at 6 Hz and words that were encoded at 10 Hz. The authors do not report whether such an effect was initially hypothesized, however, the choice of the two stimulation frequencies from well-known memory frequency bands (theta and alpha), which have opposite effects on memory performance, suggests that, at least partly, a behavioral effect was expected. To our knowledge, only one other study used a similar approach of rhythmic visual entrainment in a recognition memory task. used 6- and 15-Hz visual entrainment during word encoding and also found no effect of stimulation frequency on memory performance. The findings of these latter studies are in line with our results which also failed to reveal a significant effect of 6- vs. 10-Hz visual stimulation during encoding. Two main methodological differences between the study from and the others (including our study) need to be pointed out.

First, all studies included theta and alpha (or low beta, see ) stimulation frequencies; however, used individually adjusted stimulation frequencies from theta (3–8 Hz) and alpha (8–13 Hz) ranges. Previous research has shown that neural entrainment is partly dependent on the match of the frequency of the stimulating input and the frequency of endogenous neural oscillations (; ; ). Potentially, our 6- and 10-Hz stimulation rhythms did not have the anticipated entrainment effect on neural oscillations in participants with slightly divergent individual theta and alpha frequencies. Moreover, it has been shown that improved memory performance does not primarily result from reinstating theta and/or gamma band power per se (Köster et al., 2014) but rather from increasing phase-amplitude coupling between the prefrontal theta phase and the posterior gamma amplitude (see ; Köster et al., 2014). Future studies using this paradigm would likely benefit from electrophysiological measurements (e.g., EEG) to target individual peak frequencies in the entrained oscillation bands and from additional analyses testing whether neural entrainment effectively modulated theta–gamma coupling which appears to be a key mechanism in memory formation and retrieval.

The second and possibly crucial difference to was the to-be-learned stimuli. While the present study, , and used words, used colored object pictures (e.g., animals, tools). Early research found that recognition for pictures was enhanced compared to words (e.g., ; ) and elicited different brain regions (Köster et al., 2018) arguably because pictures automatically engage stronger associations with previously stored memories, thus enabling more elaborate encoding (). In a positron emission tomography (PET) study, compared the neural correlates of encoding words vs. pictures. While picture encoding revealed greater activity in the medial temporal cortex, which is known to be a crucial brain region for episodic memory formation, words activated regions in the left hemisphere, known for their involvement in language tasks (). Although differences in the neural processes between encoding words and pictures have been established, how these findings explain the mixed results in our study and remains elusive. On one hand, neural entrainment of pictures possibly induces rhythmic activation not only in primary visual cortex but spreads to higher level processing areas (e.g., the medial temporal lobes which are involved in memory formation). On the other hand, flickering during encoding of words might reveal no spread of activation or only to areas of linguistic processing, thus not modulating memory processes. More research, ideally using invasive electrophysiological measures [e.g., electrocorticography (ECoG)], would be needed to evaluate the rhythmic spreading of steady-state evoked potentials. Köster et al. (2018) found in a recent study that theta–gamma phase-amplitude coupling was observed in memory tasks using picture–color associations, but not when words were used as stimuli, further highlighting the importance of the encoding stimuli (Köster et al., 2018). However, an increase in theta oscillations, as well as a suppression of the alpha rhythm, was found regardless of encoding condition, which would suggest that our null results cannot be solely explained by the use of words as encoding stimuli.

Besides the main differences in the methodologies between the work reported here and , other factors which distinguish the two studies might have led to the mixed results. First, in the present study, participants were asked to count syllables during the encoding of the presented words (adapted from ). In comparison to , which used a dot detection task, this procedure arguably was cognitively more demanding and might have overshadowed the effect of the entrainment by stronger top-down processes (e.g., suppression of alpha oscillations). Second, flickered the to-be-learned objects, while we used a flickering checkerboard in the background of the words. Again, this was adapted from , who provided electrophysiological evidence that this procedure evoked robust SSVEPs.

In addition to methodological differences to previous reports, we acknowledge further limitations in our study. Although our study design was adapted from previous research, we recognize that the high number of experimental conditions led to a reduced number of trials per condition (240/6 = 40). Further, more insight into the quality of the memory processes could have been achieved by using a remember–know study design, which allows participants to state different degrees of (un-)certainty when remembering a stimulus.

Mixed Findings Regarding Neural Reinstatement and Visual Flicker as Contextual Feature During Memory Formation

The fact that contextual features surrounding the encoding event reemerge during later retrieval implies a process at the encoding stage which serves to bind items to their contextual features. This has been suggested to be a key component to form episodic memories (; ). Visual flickering, used in the present study, not only entrains brain oscillations in visual areas but also represents a visual context that arguably would enhance memory performance when later reinstated (for a review on environmental context-dependent memory, see ). This idea stems from previous research showing that even simple visual context modulations (e.g., background color of a computer screen) can produce a context-dependent memory effect in humans (; ). It is also in line with experimental evidence for reactivated neural activity from the encoding period during successful retrieval (for a review, see ). Causal evidence supporting this idea was provided by who externally induced oscillatory rhythms (with tACS) and showed that this neural reinstatement modulated memory performance (). However, a closer exploration of their results suggests that the comparison between active and sham stimulation conditions, which revealed an effect on memory performance for congruent but not for incongruent simulation, was, at least partly, driven by high variability in the sham conditions. In a similar vein, claimed that successful retrieval is associated with reactivating the oscillatory activity of the encoding stage (). However, a later study from was not able to replicate the findings of reinstated SSVEPs during successful retrieval most likely because were too lenient in applying statistical correction for multiple comparisons. They conclude that reinstatement effects of SSVEPs are not robust enough to be used as a reliable index of lexical activation during language processing ().

Is Rhythmic Sensory Stimulation a Feasible Method to Modulate Memory Processes?

A vast amount of research has provided evidence for the involvement of brain oscillations in human memory processes. However, the somewhat naive assumption that single frequency bands in separated brain regions can be causally associated with memory processes has been challenged in recent years. In their review, report that there is evidence for the involvement of each frequency band (from 3 to 100 Hz) with correlations for both increasing and decreasing amplitudes in memory formation (see also ). The authors conclude that brain oscillations during encoding primarily represent cognitive and perceptual processes, i.e., a mix of bottom-up and top-down governed effects. Further, they argue that successful memory retrieval is related mainly to two classical concepts of episodic memory (). First, the level of processing during encoding (), and second, the encoding specificity principle, which states that information is more likely to be retrieved if conditions at the time of retrieval are similar to those at the time of encoding (). In our study, participants were engaged in a syllable-counting task during encoding which led to incidental learning of the presented words and arguably an equivalent level of processing across conditions (6 or 10 Hz encoding). Confirming this assumption, no difference was found between the two encoding conditions in the accuracy in the syllable-counting task. Nonetheless, we found no difference on memory performance between theta and alpha entrainment. A possible reason for this lack of an effect could be an oversimplified understanding of the involvement of brain oscillations in the formation of memories. While most early studies focused on specific frequency bands (e.g., theta, gamma, alpha) and single measurement parameters (e.g., power, coherence), recent studies have revealed more complex mechanisms (e.g., cross-frequency phase-amplitude coupling) (see ; ). These heterogeneous relationships between oscillatory dynamics and various forms of memory formation make modulations with external rhythmic stimulation extremely difficult.

While reinstatement of visual flickering in our studies provides alterations in similarity between the encoding and retrieval situations, such narrow-band neural oscillations in a single sensory system might not be sufficient to reveal the hypothesized effects of encoding specificity. In addition, we found recently that even fully surrounding environments and on-screen presentations of colors or landscape pictures were consistently unable to evoke context-dependent effects on memory (). Taken together, these findings suggest that modulation of visual contexts alone is not sufficient to evoke effects on the formation and retrieval of memories. The process of memorizing information always consists of a variety of sensory, cognitive, and emotional features (). Sensory stimulation would have to be presented to various sensory systems simultaneously, but even then, ongoing cognitive (top-down) processes, as for example individual mnemonic strategies, might overshadow possible effects.

Conclusion

In our study, memory performance was not modulated by visually induced neural entrainment of theta (6 Hz) and alpha (10 Hz) frequencies, and we observed no effect of reinstated entrainment frequencies during retrieval. The heterogeneity of brain oscillations and regions involved in these complex processes makes targeted entrainment via rhythmic sensory stimulation difficult, and further cognitive top-down processes during encoding and retrieval are most likely expected to overshadow entrainment effects. However, more sophisticated approaches of sensory entrainment might reveal more promising results. The use of individually adjusted stimulation signals (e.g., in a closed-loop setup) applied to multiple sensory systems, possibly with cross-frequency coupling, could provide stronger entrainment effects.

Statements

Data availability statement

The datasets generated for this study are available on request to the corresponding authors.

Ethics statement

The studies involving human participants were reviewed and approved by the Kantonale Ethikkommission Zürich. The patients/participants provided their written informed consent to participate in this study.

Author contributions

MW designed and performed the research and analyzed the data. MW, DW, and NW wrote the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This research was funded by the Swiss National Science Foundation (No. 320030_175616).

Acknowledgments

We thank Silvan Büeler for his help with data acquisition, and we also acknowledge the support of the Neuroscience Center Zurich (ZNZ).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

Summary

Keywords

memory, neural reinstatement, steady-state evoked potentials, entrainment, neural oscillations

Citation

Wälti MJ, Woolley DG and Wenderoth N (2020) Assessing Rhythmic Visual Entrainment and Reinstatement of Brain Oscillations to Modulate Memory Performance. Front. Behav. Neurosci. 14:118. doi: 10.3389/fnbeh.2020.00118

Received

26 December 2019

Accepted

15 June 2020

Published

16 July 2020

Volume

14 - 2020

Edited by

Bahar Güntekin, Istanbul Medipol University, Turkey

Reviewed by

Alessandro Tavano, Max Planck Institute, Germany; Moritz Köster, Freie Universität Berlin, Germany

Updates

Copyright

*Correspondence: Michel J. Wälti, ; Nicole Wenderoth,

This article was submitted to Learning and Memory, a section of the journal Frontiers in Behavioral Neuroscience

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics