Original Research ARTICLE
Single-Trial EEG Connectivity of Default Mode Network Before and During Encoding Predicts Subsequent Memory Outcome
- 1Department of Brain and Cognitive Sciences, College of Natural Sciences, Seoul National University, Seoul, South Korea
- 2College of Sungsim General Education, Youngsan University, Yangsan, South Korea
- 3The Research Institute of Basic Sciences, College of Natural Sciences, Seoul National University, Seoul, South Korea
- 4Department of Neurosurgery, Seoul National University Hospital, Seoul, South Korea
- 5Neuroscience Research Institute, College of Medicine, Seoul National University, Seoul, South Korea
The successful memory process produces specific activity in the brain network. As the brain activity of the prestimulus and encoding phases has a crucial effect on subsequent memory outcomes (e.g., remembered or forgotten), previous studies have tried to predict the memory performance in this period. Conventional studies have used the spectral power or event-related potential of specific regions as the classification feature. However, as multiple brain regions work collaboratively to process memory, it could be a better option to use functional connectivity within the memory-related brain network to predict subsequent memory performance. In this study, we acquired the EEG signals while performing an associative memory task that remembers scene–word pairs. For the connectivity analysis, we estimated the cross–mutual information within the default mode network with the time–frequency spectra at the prestimulus and encoding phases. Then, we predicted the success or failure of subsequent memory outcome with the connectivity features. We found that the classifier with support vector machine achieved the highest classification accuracy of 80.83% ± 12.65% (mean ± standard deviation) using the beta (13–30 Hz) connectivity at encoding phase among the multiple frequency bands and task phases. Using the prestimulus beta connectivity, the classification accuracy of 72.45% ± 12.52% is also achieved. Among the features, the connectivity related to the dorsomedial prefrontal cortex was found to contribute to successful memory encoding. The connectivity related to the posterior cingulate cortex was found to contribute to the failure of memory encoding. The present study showed for the first time the successful prediction with high accuracy of subsequent memory outcome using single-trial functional connectivity.
Differences in brain activity between the subsequently remembered and forgotten trials at learning are often referred to as subsequent memory effects (SMEs) (Paller and Wagner, 2002; Klimesch, 2012). As the brain activity during encoding has a crucial effect on subsequent memory outcomes, it is plausible to use it to predict the success of subsequent memory outcomes. A number of studies have successfully established that brain oscillations in multiple EEG frequency bands during the encoding phase can predict subsequently remembered and forgotten trials (Hanslmayr and Staudigl, 2014). In addition to SMEs during the encoding phase, previous studies also showed that prestimulus activities could predict subsequent memory outcome, as anticipatory activity prior to stimulus presentation could play a critical role in how a stimulus will be processed (Otten et al., 2006; Guderian et al., 2009; Addante et al., 2011, 2015; Burke et al., 2014; Cohen et al., 2015; Schneider and Rose, 2016).
In this regard, there have been studies that predicted subsequent memory outcome (e.g., remembered or forgotten) using single-trial EEG SMEs features of prestimulus, and during the encoding phase. By combining the prestimulus and during encoding phase SMEs, a previous study achieved 59.6% classification accuracy (Noh et al., 2014), whereas another study achieved 72.1% classification accuracy (Sun et al., 2016). These studies have used the spectral power or event-related potential (ERP) of specific regions to predict subsequent memory outcome. However, as the brain works collaboratively to process memory, other than features of local signal amplitude, a better option to predict subsequent memory outcome could be to use the functional connectivity between multiple brain regions.
The activities of the medial temporal lobe are well-known to be related to successful memory encoding (Guderian et al., 2009; Lega et al., 2012). In addition, widespread brain area, especially belonging to the default mode network (DMN), which is a common set of brain regions that demonstrate consistently greater activity while resting than while performing cognitively demanding tasks, such as memory task (Buckner et al., 2008), is also known to be related to successful memory function (Kim, 2011). This network includes the medial prefrontal cortex, the posterior parietal cortex, the hippocampus (HC), the precuneus, the inferior parietal lobe, and the lateral temporal lobe. The deactivation of the DMN during encoding is known to reflect successful memory encoding (Anticevic et al., 2010; Chai et al., 2014; Raichle, 2015; Sato and Mizuhara, 2018); meanwhile, the activation of the DMN during encoding is known to be related to subsequent forgetting (Kim, 2011). Specifically, in a previous study, distinct DMN regions were reported to modulate both encoding success and failure. The medial prefrontal cortex, angular gyrus (AG), and lateral temporal cortex were reported to mediate encoding success in a self-referential memory encoding task, whereas the posterior cingulate was reported to be related to both encoding failure and task-unrelated thought (Maillet and Rajah, 2014). In addition, when individuals constructed mental scenes based on memory, a distinct subsystem of the DMN was preferentially engaged (Andrews-Hanna et al., 2010). Additionally, the posterior cingulate, inferior parietal cortex, and lateral temporal cortex were recruited during the construction of the mental scenes, which is the process that could be required in the memory encoding (Hassabis et al., 2007). In summary, previous studies have shown that various brain areas involved in the DMN have an important role in the success and failure of the memory encoding process.
Despite the importance of DMN activity, no studies to date have predicted subsequent memory outcome using the single-trial functional connectivity of DMN regions in prestimulus and during the encoding phase. Here, we hypothesized that connectivity features could predict subsequent memory outcome in single-trials. Therefore, we predicted subsequent memory outcome using features from the frequency specific connectivity within DMN. Here, among the various connectivity measures, we used mutual information (MI) that evaluates the amount of information about one signal that is contained in another signal (Fraser and Swinney, 1986).
Materials and Methods
Twenty-nine right-handed healthy subjects without neurological or psychiatric abnormalities were recruited. The datasets of two participants were excluded from further analysis because of insufficient artifact-free trials. The final study group included 27 participants (11 females; mean age = 26.0 ± 2.1 years, range = 23–31 years; education level = 17.0 ± 1.2 years). As an effort to control the physiological condition of subjects, we instructed the subjects to get enough sleep the day before they participated in the experiment. This study was approved by the institutional review board (IRB) of the Seoul National University Hospital Clinical Research Institute (IRB number: H-1808-098-967).
We applied a subsequent memory paradigm that consisted of scene–word pairs in study and test blocks (Figure 1). Each study and test block had 75 trials. Scene stimuli consisted of 50% indoor images and 50% outdoor images. As word stimuli, concrete nouns of 50% nature objects and 50% manmade objects were used. During the study phase, subjects were instructed to remember scene–word pairs using a strategy that made an imaginary scene associated with the paired word for 3 s. In order to boost subjects’ participation in the experiment, the subjects were instructed to press a button on whether or not the associative imaginary scene in the mind vividly appeared when a red fixation was presented on the screen. To eliminate the residual effect of the previous stimulus, boxes filled diagonally were presented for 1.5 s. The encoding phase of one experimental session lasted about 10 min. After the study block, subjects were instructed to answer as many simple arithmetic problems as possible in 2 min for a distracting task (e.g., alternately subtract 4 and 7 from 100). During the test phase, subjects were instructed to verbally recall the word cued by the scene previously learned at self-paced speed. There was a time limit of up to 20 s, and if exceeded, it was classified as forgotten. To maintain the attention of the participants, the next session went on when the subjects were fully prepared. One session consisted of a block of study, distraction, and test. Three sessions were conducted for each subject. Stimuli were presented using STIM2 presentation software (Compumedics Neuroscan, Australia).
Figure 1. Experimental paradigm. (A) Study block. Subjects were instructed to remember scene–word pairs using a strategy that makes an imaginary associative scene. (B) Test block. Subjects were asked to verbally recall the word cued by the scene at self-paced speed.
EEG Data Acquisition and Preprocessing
EEG was recorded using a Neuroscan EEG recording system (Compumedics Neuroscan, United States) with 64-channel Quick caps (Compumedics Neuroscan, United States) in an electrically shielded cabin. EEG signals were digitized at a sampling frequency of 1,000 Hz with a SynAmps2 amplifier (Compumedics Neuroscan, United States). Preprocessing was conducted using EEGLAB open source toolbox (version 2019.11) and self-written MATLAB scripts (version R2019b; MathWorks Corp.). At the first preprocessing step, the linked ear EEG montage was converted to common average reference. The data were segmented into epochs ranging from -1,000 to 2,000 ms relative to the stimulus onset. Trials that include high noise were manually discarded, and only the remaining artifact-free trials were used for further classification analysis. Table 3 shows the final included number of trials for each individual.
Frequency-Specific EEG Source Connectivity Analysis
For the time–frequency analysis, continuous wavelet transformation was applied. We focused on the theta (3–7 Hz), alpha (8–12 Hz), and beta (13–30 Hz) frequency bands. These power values were then normalized by the baseline activity before the stimulus onset of −1 to −0.8 s. EEG signals at -500 to 0 ms before the stimulus onset were used as a “prestimulus” phase, and EEG signals after the stimulus onset at 0 to 1,000 ms were used as an “encoding” phase for subsequent connectivity analysis. To take into account the time to see and recognize the stimuli, the encoding phase was designated as 1,000 ms. For the source analysis, regions of interest (ROIs) were selected in regions that were representative of the DMN (Raichle, 2015). The ROIs included the dorsomedial prefrontal cortex (DMPFC), posterior cingulate cortex (PCC), AG, middle temporal gyrus (MTG), and HC. Table 1 shows the coordinates of the ROIs. Source activity was extracted using the built-in function of discrete model probing in BESA research 6.0 (GmbH, Germany).
For the source connectivity analysis, we calculated the time–frequency cross-MI (Jeong et al., 2001). After the continuous wavelet transform, the mean value of each frequency band (theta, alpha, and beta) was obtained. Then, cross-MI was calculated using samples from each time interval (prestimulus and encoding phase). MI is a measure of the amount of dependency between two signals. Compared to linear correlation, MI is a more general measurement, because it can measure non-linear dependency. The temporal series of averaged frequency band signals were used to compute the cross-MI between ROIs. MI values between ROIs can be calculated using the probability density function, as follows:
here, p(X, Y) is the joint probability distribution function of variables X and Y, and p(X) and p(Y) are the marginal probability distribution functions of X and Y, respectively.
Then, we investigated the differences in EEG connectivity between subsequently remembered and forgotten trials (during both the Prestimulus and Encoding phases).
Two-Class Classification Using Single-Trial Source Connectivity Features
We used a linear support vector machine (SVM) in MATLAB for the classification of memory success. The most informative connectivity values with the top 20% of the t-statistics were selected as the features in each phase (i.e., the prestimulus and encoding phase) and each frequency band (Figure 2). The classification performance of individual EEG signal was evaluated by fivefold cross-validation with 100 repetitions.
Figure 2. Feature selection of mutual information (remembered–forgotten). For the feature selection, as a result of the t-test for the difference between the remembered and forgotten conditions (left column of each phase), features with the absolute value of the t-value in the top 20% (right column of each phase) were selected in each phase (e.g., prestimulus and encoding phases). DMPFC, dorsomedial prefrontal cortex; PCC, posterior cingulate cortex; ANG, angular gyrus; MTG, middle temporal gyrus; HIP, hippocampus; L, left; R, right.
On average, participants correctly remembered 54.64% ± 18.26% (mean ± standard deviation) trials of the stimulus, indicating that they were able to efficiently encode materials and that we obtained enough trials for both remembered and forgotten conditions.
Figure 2 shows the selected features for each phase and frequency band, and Table 2 presents the t-statistics values (uncorrected) and regions of the selected connectivity. The most informative connectivity values with the top 20% of the t-statistics (uncorrected) were selected as the features in each phase (i.e., the prestimulus and encoding phase) and frequency band. The subsequently remembered condition showed increased connectivity centered on the DMPFC at the prestimulus and the encoding phase. On the other hand, the subsequent forgotten condition showed increased connectivity centered on PCC in the theta and alpha bands at the prestimulus phase.
Table 3 describes the individual classification accuracy in each phase and frequency band. The SVM binary classifier achieved the highest mean classification accuracy of 80.83% ± 12.65% (mean ± standard deviation) using the beta connectivity features at the encoding phase (chance level = 50%). At the encoding phase, an accuracy of 72.79% ± 12.85% was achieved using the alpha connectivity features, and 69.36% ± 11.90% was achieved using the theta connectivity features. Using the prestimulus beta connectivity features, the mean classification accuracy was also 72.45% ± 12.52%. At the prestimulus phase, an accuracy of 66.92% ± 11.93% was achieved using the alpha connectivity features, and 61.15% ± 10.91% was achieved using the theta connectivity features.
The present study showed that subsequent memory outcome (e.g., remembered or forgotten) can be successfully predicted using the functional connectivity within DMN regions.
Subsequent Memory Effects of Functional Connectivity
In the present study, using prestimulus beta band connectivity, we achieved 72.45% average classification accuracy, and using encoding beta band connectivity, we achieved 80.83% prediction accuracy. By using functional connectivity features, we achieved higher classification accuracy than the previous studies that used local brain activities.
Conventional studies have investigated the role of local brain activities in relation to the formation of human memories. Previous studies have consistently reported that successful memory encoding is related to the activation of specific brain regions. In particular, successful memory encoding is related to the medial temporal lobe and prefrontal cortex (Wagner et al., 1998; Paller and Wagner, 2002; Reber et al., 2002; Kim, 2011), whereas the failure of memory encoding is related to PCC and temporoparietal junction (Otten and Rugg, 2001; Kim, 2011). In addition to encoding SMEs, as anticipatory activity prior to stimulus presentation could play a critical role in how a stimulus will be processed, many studies have also investigated prestimulus SMEs (Otten et al., 2006; Guderian et al., 2009; Addante et al., 2011, 2015; Burke et al., 2014; Cohen et al., 2015; Schneider and Rose, 2016). However, recent studies have suggested the involvement of the more widely distributed cortical network and the importance of its collaborative roles in the episodic encoding (Jeong et al., 2015).
Previous studies have predicted subsequent memory outcome based on regional activity. By combining prestimulus and encoding SMEs, one study achieved 59.6% classification accuracy (Noh et al., 2014), whereas another study achieved 72.1% (Sun et al., 2016). They used brain activity in specific areas (e.g., spectral power or ERP of specific regions) as a feature. On the other hand, our results showed that subsequent memory outcome could be better predicted using functional connectivity compared to the local brain activity. Our approach would reflect the way in which the brain regions related to a memory task work together.
Characteristics of a Successful Memory Network at the Prestimulus and Encoding Phases
At the prestimulus phase, to prepare for a successful encoding, it is necessary to maintain top–down attention to task and to suppress task-irrelevant thoughts that occur before the stimulus onset. Therefore, ongoing neural activity occurring before the stimulus onset might play an important role in preparing the brain for successful memory outcome (Otten et al., 2006; Guderian et al., 2009; Addante et al., 2011, 2015; Burke et al., 2014; Cohen et al., 2015; Schneider and Rose, 2016). In our results, the connectivity centered on the DMPFC at the prestimulus phase was related to the subsequently remembered condition. The connectivity of the DMPFC was reported to be related to maintaining top–down attention and focus on task for successful encoding (Miller, 2000).
At the encoding phase, the process of focusing on the task and associating scene and word is required for successful encoding. In our results, the connectivity centered on the DMPFC was maintained, and theta band connectivity between the bilateral MTG and alpha band connectivity between the DMPFC and MTG (R) was increased, compared to the prestimulus phase. The maintained connectivity centered on the DMPFC may reflect top–down attention to the task. For the increased connectivity centered on the MTG, as the MTG is known to be involved in semantic processing (Vandenberghe et al., 1996; Visser et al., 2012), associating scene and word for successful memory formation might reflect semantic processing.
Dissociable Roles of DMN Regions During the Prestimulus and Encoding Phases
Previously, distinct DMN regions have been reported to modulate both encoding success and failure. Medial prefrontal cortex and AG were reported to mediate encoding success, whereas PCC was reported to be related to both encoding failure and task-unrelated thought (Maillet and Rajah, 2014). Similarly, the PCC showed more activity in subsequent forgotten items than the subsequently remembered items (Otten and Rugg, 2001; Wagner and Davachi, 2001; Daselaar et al., 2004, 2009). In our results, the connectivity centered on the DMPFC was found to be related to successful memory encoding, whereas the connectivity centered on the PCC was found to be related to the failure of memory encoding. In particular, the higher connectivity centered on the PCC in the forgotten conditions was obvious in the prestimulus phase. To sum up, successful memory encoding was found to be related to the connectivity of the anterior DMN, whereas the failure of memory encoding was found to be related to the connectivity of the posterior DMN (Figure 3).
Figure 3. Results of the t-test for the difference in mutual information between the remembered and forgotten conditions (p < 0.05). The nodes selected in this study are the midline DMPFC, midline PCC, left and right ANG, right and left MTG, and right and left HIP.
This is the first study in which subsequent memory outcome has been predicted using single-trial functional connectivity in the prestimulus and encoding phases using scalp EEG. In this study, using single-trial EEG connectivity features, we achieved average accuracy of greater than 80% for the prediction of subsequent memory outcome. We found anterior and posterior dissociation of the DMN. In both the prestimulus and encoding phases, in remembered conditions, the connectivity of the anterior DMN was higher, whereas that of the posterior DMN was lower. In the future, these results could be very useful in building a closed-loop brain stimulation system for memory enhancement that could deliver stimulation only when a subsequent memory outcome is predicted to be forgotten (Ezzyat et al., 2018).
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
The studies involving human participants were reviewed and approved by the Seoul National University Hospital Clinical Research Institute (IRB number: H-1808-098-967). The participants provided their written informed consent to participate in this study.
DK, WJ, JK, and CC contributed to the study design and wrote the manuscript. DK and WJ performed the study. DK and JK analyzed the data. JK and CC obtained funding. All authors contributed to the article and approved the submitted version.
This research was supported by a grant from the Basic Science Research Program (Grant No. 2018M3C7A1022317) through the National Research Foundation (NRF), funded by the Ministry of Science and ICT, South Korea.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
We thank Hong Jun Kim for assistance with the EEG experiments.
Addante, R. J., De Chastelaine, M., and Rugg, M. D. (2015). Pre-stimulus neural activity predicts successful encoding of inter-item associations. Neuroimage 105, 21–31. doi: 10.1016/j.neuroimage.2014.10.046
Addante, R. J., Watrous, A. J., Yonelinas, A. P., Ekstrom, A. D., and Ranganath, C. (2011). Prestimulus theta activity predicts correct source memory retrieval. Proc. Natl. Acad. Sci. U S A. 108, 10702–10707. doi: 10.1073/pnas.1014528108
Andrews-Hanna, J. R., Reidler, J. S., Sepulcre, J., Poulin, R., and Buckner, R. L. (2010). Functional-anatomic fractionation of the brain’s default network. Neuron 65, 550–562. doi: 10.1016/j.neuron.2010.02.005
Anticevic, A., Repovs, G., Shulman, G. L., and Barch, D. M. (2010). When less is more: TPJ and default network deactivation during encoding predicts working memory performance. Neuroimage 49, 2638–2648. doi: 10.1016/j.neuroimage.2009.11.008
Buckner, R. L., Andrews-Hanna, J. R., and Schacter, D. L. (2008). The brain’s default network: anatomy, function, and relevance to disease. Ann. N Y. Acad. Sci. 1124, 1–38. doi: 10.1196/annals.1440.011
Burke, J. F., Merkow, M. B., Jacobs, J., Kahana, M. J., and Zaghloul, K. A. (2014). Brain computer interface to enhance episodic memory in human participants. Front. Hum. Neurosci. 8:1055. doi: 10.3389/fnhum.2014.01055
Chai, X. J., Ofen, N., Gabrieli, J. D., and Whitfield-Gabrieli, S. (2014). Development of deactivation of the default-mode network during episodic memory formation. Neuroimage 84, 932–938. doi: 10.1016/j.neuroimage.2013.09.032
Cohen, N., Pell, L., Edelson, M. G., Ben-Yakov, A., Pine, A., and Dudai, Y. (2015). Peri-encoding predictors of memory encoding and consolidation. Neurosci. Biobehav. Rev. 50, 128–142. doi: 10.1016/j.neubiorev.2014.11.002
Daselaar, S. M., Prince, S. E., and Cabeza, R. (2004). When less means more: deactivations during encoding that predict subsequent memory. Neuroimage 23, 921–927. doi: 10.1016/j.neuroimage.2004.07.031
Daselaar, S. M., Prince, S. E., Dennis, N. A., Hayes, S. M., Kim, H., and Cabeza, R. (2009). Posterior midline and ventral parietal activity is associated with retrieval success and encoding failure. Front. Hum. Neurosci. 3:13. doi: 10.3389/neuro.09.013
Guderian, S., Schott, B. H., Richardson-Klavehn, A., and Duzel, E. (2009). Medial temporal theta state before an event predicts episodic encoding success in humans. Proc. Natl. Acad. Sci. U S A. 106, 5365–5370. doi: 10.1073/pnas.0900289106
Hanslmayr, S., and Staudigl, T. (2014). How brain oscillations form memories - a processing based perspective on oscillatory subsequent memory effects. Neuroimage 85, 648–655. doi: 10.1016/j.neuroimage.2013.05.121
Reber, P. J., Siwiec, R. M., Gitleman, D. R., Parrish, T. B., Mesulam, M. M., and Paller, K. A. (2002). Neural correlates of successful encoding identified using functional magnetic resonance imaging. J. Neurosci. 22, 9541–9548. doi: 10.1523/jneurosci.22-21-09541.2002
Sato, N., and Mizuhara, H. (2018). Successful encoding during natural reading is associated with fixation-related potentials and large-scale network deactivation. eNeuro 5., doi: 10.1523/ENEURO.0122-18.2018
Visser, M., Jefferies, E., Embleton, K. V., and Ralph, M. A. L. (2012). Both the middle temporal gyrus and the ventral anterior temporal area are crucial for multimodal semantic processing: distortion-corrected fMRI evidence for a double gradient of information convergence in the temporal lobes. J. Cognit. Neurosci. 24, 1766–1778. doi: 10.1162/jocn_a_00244
Wagner, A. D., Schacter, D. L., Rotte, M., Koutstaal, W., Maril, A., Dale, A. M., et al. (1998). Building memories: remembering and forgetting of verbal experiences as predicted by brain activity. Science 281, 1188–1191. doi: 10.1126/science.281.5380.1188
Keywords: memory, EEG, subsequent memory effects, functional connectivity, default mode network
Citation: Kim D, Jeong W, Kim JS and Chung CK (2020) Single-Trial EEG Connectivity of Default Mode Network Before and During Encoding Predicts Subsequent Memory Outcome. Front. Syst. Neurosci. 14:591675. doi: 10.3389/fnsys.2020.591675
Received: 05 August 2020; Accepted: 19 October 2020;
Published: 19 November 2020.
Edited by:Alessandro E. P. Villa, Neuro-Heuristic Research Group (NHRG), Switzerland
Reviewed by:Takeshi Abe, Yamaguchi University, Japan
Marisa Pedemonte, Centro Latinoamericano de Economía Humana, Uruguay
Copyright © 2020 Kim, Jeong, Kim and Chung. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.