Awareness of Knowledge or Awareness of Processing? Implications for Sleep-Related Memory Consolidation

The present study assessed the effects of awareness at encoding on off-line learning during sleep. A new framework is suggested according to which two aspects of awareness are distinguished: awareness of task information, and awareness of task processing. The number reduction task (NRT) was employed because it has two levels of organization, an overt one based on explicit knowledge of task instructions, and a covert one based on hidden abstract regularities of task structure (implicit knowledge). Each level can be processed consciously (explicitly) or non-consciously (implicitly). Different performance parameters were defined to evaluate changes between two sessions for each of the four conditions of awareness arising from whether explicit or implicit task information was processed explicitly or implicitly. In two groups of subjects, the interval between the pre-sleep and post-sleep sessions was filled either with early-night sleep, rich in slow wave sleep (SWS), or late-night sleep, rich in rapid eye movement (REM) sleep. Results show that implicit processing of explicit information was improved in the post-sleep relative to the pre-sleep session only in the early-night group. Independently of sleep stage, changes between sessions occurred for explicit processing of implicit information only in those subjects who gained insight into the task regularity after sleep. It is concluded that SWS but not REM sleep specifically supports gains in computational skills for the processing of information that was accessible by consciousness before sleep.


INTRODUCTION
There is now increasing evidence that sleep supports memory consolidation (Karni et al., 1994;Maquet, 2001;Walker et al., 2002;Walker and Stickgold, 2004;Born et al., 2006). Consolidation refers to off-line processes leading to enhancement or stabilization of memory representations in the absence of any practice (on-line processing), as demonstrated by performance improvement and resistance to interference after retention intervals. In contrast to practice-based learning during wake, off-line learning can take place during both wake and sleep (Robertson et al., 2004;Cohen et al., 2005;Krakauer and Shadmehr, 2006). Yet, neural networks supporting off-line learning during wake are different from those supporting off-line learning during sleep Peigneux et al., 2006;Diekelmann and Born, 2007;Kirov et al., 2009). Sleep-dependent consolidation is proposed to engage hippocampal-neocortical circuits (McClelland et al., 1995), in contrast to wake-dependent consolidation (Robertson, 2009). The hippocampal-neocortical model (McClelland et al., 1995) assumes that the new information encoded during wake is stored temporarily in an intermediate buffer including the medial temporal lobe and the hippocampus. During sleep this information is transferred to a long-term store in the neocortex. The meaning of this transfer to take place during sleep is that if identical neocortical networks are engaged in encoding, storage and retrieval of information (Damasio, 1989;Khader et al., 2005), these networks are deprived from afferent inputs during sleep so that no interference would (explicit vs. implicit). It was fi rst stressed by Cohen et al. (2005) that a sleep-dependent advantage of procedural memories in the serial reaction time task (SRTT) only occurs if during pre-sleep training, subjects were made explicitly aware of the occurrence of a regular sequence. When, in contrast, pre-sleep training was conducted under implicit conditions, gains at retest were not larger after sleep than after wake (Cohen et al., 2005). Other studies have confi rmed that the information that is consciously (explicitly) processed during encoding is preferentially supported by sleep (Kuriyama et al., 2004;Drosopoulos et al., 2005;Fischer et al., 2006). However, associative knowledge that is acquired implicitly before sleep also can be consolidated (Spencer et al., 2006) or transformed by sleep (Yordanova et al., 2008). It has been further proposed that it is the interaction between different types of memories, either at learning or during sleep, that affects the consolidation process Fischer et al., 2006).
It is recognized, however, that to characterize explicit and implicit memories, it is necessary to address issues related to the nature of the acquired knowledge and its representation (explicit vs. implicit) and issues related to the nature of the acquisition and retrieval processes (explicit vs. implicit, controlled vs. automatic, intentional vs. incidental), and their functional interactions (Forkstam and Petersson, 2005). According to a recent model, explicit and implicit memory systems may not be postulated as independent systems based on consciousness but they may be separated by specifying both a representation and a process that operates on the representation (Reder et al., 2009). For the implicit memory system, distinct sub-systems have been previously suggested depending on the type of information being processed out of awareness (e.g., Willingham, 1997). For the working memory system that integrates consciously processed information at encoding (Baddeley and Hitch, 1974), two components also have been specifi ed: 'the central executive' as a main component of 'fl uid' (or processing-based) capacities such as attention, and 'the episodic buffer' as a main component of 'crystallized ' (or knowledge-based) capacities (Baddeley, 2000). Furthermore, these two components are linked to distinct neural substrates, with the executive control being sub-served by prefrontal-parietal networks, and the episodic buffer being associated with the inferior parietal cortex Vilberg and Rugg, 2008). Given that the parietal cortical regions are elements of a hippocampal-cortical network sub-serving memory (Vincent et al., 2006), it is notable that the off-line memory consolidation at systems level mediated by sleep may involve differentially the systems activated at encoding . Thus, novel frameworks for off-line memory processing consider these knowledge-based and processing-based explicit/ implicit distinctions and give support to new detailed classifi cations of memory (Robertson, 2009).
To shed further light on the role of sleep for off-line learning, the present study accounts for an extended classifi cation of dynamic memory. Specifi cally, we propose that the distinction between 'explicit' and 'implicit' memories may be meaningfully made on two dimensions. The knowledge-based dimension refers to types of information: Explicit knowledge (ExK) denotes consciously perceived task information; Implicit knowledge (ImK) denotes task information that remains out of awareness. The processing-based dimension of the explicit-implicit distinction refers to modes of processing: Explicit processing (ExP) includes perceptual, cognitive, and motor processes such as stimulus selection and search, attention focusing and maintenance, memorization, computation, decision making, response selection and execution, etc., all of which are consciously guided by executive control systems. In contrast, implicit processing (ImP) involves mechanisms such as perceptual and motor proceduralization, statistical and associative learning, etc. Depending on the instructions these processes may occur without awareness and are not guided by executive control systems although they may modify behavioral responses. Each type of task information can be processed in two ways, explicitly and implicitly, and more importantly, these processes may occur in parallel.
Here, data from a previous study of Yordanova et al. (2008) were re-analyzed under the guideline of the outlined 2 × 2 scheme in order to specify the effects of different sleep stages, slow wave sleep (SWS) and rapid eye movement (REM) sleep, on the delineated functional aspects of off-line memory consolidation. The Number Reduction Task (NRT, Woltz et al., 1996;Frensch et al., 2002;Haider and Rose, 2007) provided a condition, in which the knowledge-based and processing-based dimensions of the explicitimplicit distinction could be dissociated. Similar to serial learning tasks, the NRT has two levels of organization, overt and covert. As detailed in Materials and Methods section and illustrated in Figure 1, each trial of the NRT consists of a string of several digits. At the overt level, subjects have to process the digits and produce consecutive responses following two operational rules. The covert level of NRT organization is that unmentioned to the subjects, all strings are generated according to an abstract regularity according to which the last three responses in a string always mirror symmetrically the preceding three responses, so that the second response in each trial is identical to the fi nal solution (Figure 1). If capable of comprehending this regularity, participants could abruptly shortcut sequential responding. This regularity is abstract because the actual digit strings and responses change from trial to trial. The four cells of combinations given by the two dimensions of the explicit-implicit distinction can be defi ned in the NRT as follows (Figure 2).

IMPLICIT PROCESSING OF EXPLICIT KNOWLEDGE (ImP-ExK)
ImP-ExK refers to the procedural gain in instructed performance skills. Automation, proceduralization or operationalization occur implicitly and are generally refl ected by behavioral improvement (decrease in response speed and error rate). As detailed below, several aspects of procedural learning can be distinguished in the NRT (perceptual, cognitive, or motor) by separate analysis of specifi c responses within a trial.
ImP-ImK refers to the acquirement of implicit knowledge about the hidden regularity of the NRT structure. This implicit learning has been verifi ed by the speeding of responses that can be predicted relative to responses that cannot be predicted by that regularity (Frensch et al., 2002;Lang et al., 2006;Haider and Rose, 2007;Yordanova et al., 2008). It has been demonstrated that RT decrease to predictable responses is not due to a fast short-term proceduralization within the string because when the same strings are processed without the mirror regularity being introduced, responses at last positions in the string are not faster (Rose et al., 2005). Therefore, RT decrease to predictable responses that is greater than RT decrease to unpredictable responses, is a reliable quantifi er of ImP-ImK learning in the NRT (Yordanova et al., 2008).

EXPLICIT PROCESSING OF IMPLICIT KNOWLEDGE (ExP-ImK)
ExP-ImK refers to the generation of explicit knowledge (awareness) about the hidden regularity of the NRT. The culmination of that process is the insight, which is marked typically as a sudden awareness of that unobvious regularity (Frensch et al., 2002;Rose et al., 2002). Importantly, activation of explicit mechanisms for processing of covert NRT information can be assessed even before insight, and also in all subjects, irrespective of whether they subsequently will or will not comprehend the hidden regularity. One such marker is an increase in performance variability (Frensch et al., 2002;Rose et al., 2002;Lang et al., 2006;Yordanova et al., 2009). Even in implicit learning conditions, controlled processing may lead to conscious search, task exploration and hypotheses testing, which destabilizes ongoing performance (Frensch et al., 2002;Lang et al., 2006). Therefore, performance variability would refl ect the extent to which covert information is actively searched for by the controlled processing systems.
To summarize, the present study analyzed the effects of specifi c sleep stages on the consolidation of different types of functional knowledge, explicit and implicit, processed either explicitly or implicitly. Relevant parameters of four different knowledge conditions (2 × 2 scheme: ImP-ExK, ExP-ExK, ImP-ImK, ExP-ImK) of NRT performance were measured before and after sleep. One objective was to specify the functional domain of sleep-related memory consolidation by identifying both knowledge and processing mechanisms as explicit and implicit. A second objective was to shed light on the effects of different sleep stages, SWS and REM sleep, on different types of memories and their interactions . It was further aimed to test if sleep-dependent benefi ts of any particular type of functional knowledge may be specifi cally associated with subsequent post-sleep insight to the NRT regularity Yordanova et al., 2008). Although off-line learning of the NRT also takes place during wake , here only the contribution of different sleep stages to these processes were addressed with regard to a detailed classifi cation of dynamic memory.

SUBJECTS
For the current study, data from Yordanova et al. (2008) were reanalyzed. A total of 68 healthy students (18-28 year old) without any history of sleep disturbances or psychiatric or neurological

FIGURE 1 | Schematic presentation of the Number Reduction Task (NRT).
A single representative string is shown. Black arrows present the consecutive steps in NRT task performance (e.g., the fi rst two numbers 1 and 9 in the stimulus string lead to response 4 (R1), then the same response (4) is compared with the next number from the stimulus string (1) leading to response 9 (R2), and so on). On the right, the structure of responses is given by letters showing the mirror structure of the response string (BCD-DCB). The fi nal result is the last response (R7) marked with SOLUTION which has to be confi rmed by pressing ENTER. At the bottom, mean reaction times and their coeffi cients of variance from all conditions and groups are shown for different response numbers (R1 to R7). Standard error bars in the coeffi cient of variance give supportive information about the stability of performance. Additionally, according to their predictability during NRT processing, responses are divided into two response types: R2 to R4 -unpredictable (marked in red), and R5 to R7 -predictable (marked in green).
disorders had participated in that study. All subjects spent an adaptation night in the sleep laboratory including placement of electrodes. Subjects were paid for their participation and gave informed written consent prior to the study, which was approved by the local ethics committee.
Participants who gained explicit knowledge already at initial practice (indicated by short-cut responding in the NRT) were excluded from further analyses (four subjects in the early-night group and fi ve subjects in the late-night group). One more subject was excluded from the early-night group because of staying awake 40% of the time, and one subject from the early-night group and two more subjects from the late-night group were excluded because of low quality of sleep EEG. Thus, 29 subjects (9 females) from the early-night group and 26 subjects (12 females) from the late-night group were used for statistical comparisons.

TASK
The task used by Yordanova et al. (2008) is illustrated in Figure 1 by an example trial. On each trial, a different string of eight digits was presented. Each string was composed of the digits 1, 4, and 9. For each string, subjects had to determine a digit defi ned as the fi nal result (solution) of the task trial. This could be achieved by sequentially processing pairs of digits from left to right according to two simple rules: (1) The 'identity rule' states that the result of FIGURE 2 | Two types of processing (explicit, implicit) vs. two types of knowledge (explicit, implicit) and their measures. ImP-ExK (implicit processing of explicit knowledge measured by RT speeding), ExP-ExK (explicit processing of explicit knowledge measured by RT difference related to the conscious application of two rules, the 'identity' rule and the 'difference' rule, for NRT performance), ImP-ImK (implicit processing of implicit knowledge measured by RT difference for the unpredictable and predictable response types), ExP-ImK (explicit processing of implicit knowledge measured by the number of subjects gaining insight and by the RT variance). R1 to R7response numbers.
(2) The 'difference rule' states that the result of two nonidentical digits is the remaining third digit (e.g., 1 and 9 gives 4, Figure 1 -R1). The 1, 2, and 3 keys on the PC numeric pad were labeled accordingly 1, 4, and 9 and served as response keys. The entered responses appeared on the screen and remained there until the end of the trial, thereby forming a response sequence below the stimulus sequence.
To produce the fi rst response, comparisons are made between the fi rst and the second digits from the stimulus string (Figure 1 -R1). After processing the fi rst two digits, comparisons are made between this result (appearing in the line below the stimulus string) and the next digit from the stimulus string, then between the response digit of this new processing and the next stimulus string digit, and so on. Thus, applying the two rules, subjects generate a string of seven responses, with the last one indicating the fi nal result (solution) to be confi rmed by pressing the 'Enter' key on the numeric pad. The time for any single response was limited to 4 s and to a total of 12 s for all responses until pressing 'Enter' . Pressing the 'Enter' key was followed by a change of color of the entered fi nal response on the screen, from red to blue. After another 1-s period, feedback was provided. In case of a correct fi nal result, all digits on the screen, in addition to the fi nal one, changed their color to blue, whereas the German word for 'Wrong' appeared on the screen in case of an incorrect fi nal result. The screen was cleared after another 0.5 s, and the next trial started. Instructions stated that only the fi nal result was to be determined for each trial and this could be done at any time. Importantly, unmentioned to subjects, all strings were generated according to the same underlying regularity which, if discerned, allowed an early determination of the fi nal result. Specifi cally, all response sequences had the form ABCDDCB (with A, B, C, and D representing one of the digits 1, 4, or 9), i.e., the last three responses always mirrored the preceding three responses, so that the second response in each trial coincided with the fi nal result (Figure 1). Thus, when gaining insight into this regularity, participants abruptly cut short sequential responding by pressing the 'Enter' key already after the second response (R2), whereupon the trial was fi nished and the next trial started. Note that this regularity is abstract because the actual digit strings and responses changed from trial to trial. Thus, discovery of the rule cannot simply be based on repetition of the same fi nger movements in all trials.
Reaction times (RTs) were measured continuously during task performance, separately for each response in the response string. RT of the fi rst response (R1) was measured as the time from string appearance to the fi rst key press. The RTs of the other responses (R2, R3, R4, R5, R6, R7, Enter) were measured as the time between the previous and the current key press.

EXPERIMENTAL PROCEDURE
Subjects were tested individually in a sound-attenuated room. Subjects performed a pre-sleep session of initial practice comprising of 3 task blocks and a post-sleep retest session of 10 task blocks, with 30 trials in each block. Only three blocks were used in the pre-sleep session to enable the initial formation of task representations, and much more (10) blocks were used in the post-sleep session to enable a reliable detection of insight, since in solvers, explicit knowledge generation in this version of the NRT emerges within 10 experimental blocks (Haider and Rose, 2007). Insight was automatically identifi ed by the program when at least 24 correct short-cuts within the same block occurred, in which case the task was terminated. Initial practice was preceded by extensive standardized instructions given by the computer, which included a short practice block of 10 task trials. To assure correct understanding of the 'identity' and 'difference' rule, the practice block was repeated as long as the subject did not perform 10 trials without mistake. To investigate the effects of different sleep phases, the interval between initial practice and retest was fi lled with 3 h of sleep either in the early night, rich in SWS, or in the late night, rich in REM sleep.
In the early-night group (Early-NG), subjects came to the laboratory at about 21:00 h. After placement of electrodes (for EEG and standard polysomnographic recordings), they performed the three blocks of initial practice (including preceding computer-guided instructions) at about 22:00 h and thereafter went to bed at about 23:00 h. After 3 h of sleep in the early night they were awakened to perform the 10 blocks of NRT retesting. Subjects in the late-night group (Late-NG) reported to the laboratory at about 22:00 h and, after placement of electrodes, fi rst slept for 3 h in the early night (to 'consume' SWS) before performing the initial practice at about 2:30 h. Then, they slept again for another 3 h in the late night (about 3:30 h-6:30 h), followed by retesting in the morning. Subjects were only awakened from light sleep stages 1 or 2 to avoid cognitive disturbances that can occur after awakenings from SWS or REM sleep. As an additional control, subjective levels of sleepiness, activation, boredom, concentration, and motivation were assessed on 5-point scales immediately before and after each session of initial practice and retest.
After the NRT retesting session, subjects fi lled in a questionnaire to probe their explicit knowledge related to the hidden task structure (beginning with open questions, followed by closed questions) as well as possible strategies used during task performance. An additional behavioral test comprised a speeded task in which 16 different strings were presented and subjects had to indicate the fi nal result to each string within 2 s after string presentation. This test was performed immediately before administration of the questionnaire.

ASSESSMENT OF EXPLICIT AND IMPLICIT KNOWLEDGE OF THE HIDDEN REGULARITY
Presence of explicit knowledge after sleep was determined from NRT task performance and answers in the post-experimental questionnaire. Questionnaire data confi rmed that all subjects whose insight into the hidden structure had been identifi ed automatically by the task program due to the short-cut in sequential responding in the NRT were also able to verbalize the critical explicit rule knowledge correctly in open questions (i.e., using their own words), and they were also able to give correct solutions to new digit strings within 2 s. Additional participants (three from the Early-NG and one from the Late-NG) were able to exactly verbalize the hidden mirror structure of the response strings in the questionnaire, and were therefore, also treated as ExK subjects although they had not put their explicit knowledge into action. Some questionnaire answers showed that the underlying common structure of all task trials also allowed detecting other short-cut rules than described Yordanova et al.
Modes of memory consolidation in 2.2. These alternative ways of gaining insight into the hidden structure, likewise always associated with the immediate change to short-cut responding in the NRT, were considered as equivalent ways of acquiring explicit knowledge.

SLEEP RECORDING AND ANALYSIS
Sleep was recorded polysomnographically, including EEG recordings from left and right central sites (C3, C4), horizontal and vertical EOG, and EMG from chin electrodes. Sleep stages S1, S2, S3, S4, and REM sleep were classifi ed in 30-s epochs according to Rechtschaffen and Kales (1968). SWS was calculated as the sum of time spent in sleep stages S3 and S4. Sleep parameters were compared by one-way ANOVA between early-and late-night sleep.

PERFORMANCE ANALYSIS
As reported in Yordanova et al. (2008), to evaluate differences between early and late-night sleep in the development of knowledge about the hidden regularity, χ 2 tests were performed. For subjective ratings of sleepiness, activation, boredom, concentration, and motivation, 2 × 2 × 2 ANOVAs were performed with the between-subjects factor Sleep Group (Early-NG vs. Late-NG) and the within-subjects factors Session (pre-sleep vs. post-sleep) and Time within session (beginning vs. end of session).
The following measures of RTs were newly evaluated in the present re-analysis, always taken as averages across trials from the last (third) block of the pre-sleep session and from the fi rst block of the post-sleep session. Only the fi rst block of the post-sleep session was used for two reasons: (1) to avoid any practice effects and assess task performance as a direct consequence of the preceding sleep, and (2) in this fi rst post-sleep block, none of the subjects was aware of the hidden task regularity and the principles of NRT performance were as in the pre-sleep session. These measures are illustrated in Figure 2. RTs were analyzed both as original values and in normalized form, i.e., with RTs expressed as percentage of some specifi c response which was set to 100%. This response was either the one with the maximum RT, in which case the one with the minimum RT was set to 0%, thus producing a min-max normalization, or a specifi c pre-defi ned response, as will be detailed. Parameters were subjected to repeated-measures ANOVA with two between-subjects factors, Sleep Group (Early-NG vs. Late-NG) and Performance Group (Solvers vs. Non-solvers), and two within-subjects variables, Session (pre-sleep vs. post-sleep) and Response (R, depending on the specifi c type of knowledge tested, difference-rule related vs. identity-rule related; unpredictable vs. predictable, or R1 to R7). In separate analyses, relevant parameters were evaluated only for the pre-sleep session, with Sleep Group and Performance Group again included as between-subjects variables, and Response included as a within-subjects variable. When the Response factor had more than two levels, the Greenhouse-Geisser correction procedure was employed, with original degrees of freedom and corrected probabilities (p) being reported.

Implicit Processing of Explicit Knowledge
ImP-ExK refers to the procedural gain in performance skills. In the NRT, RTs are integrative outcomes of perceptual-motor and computational processes since pairs of digits are visually selected from the strings, are compared to one another in order to fi nd a response which is then translated to pressing of the appropriate key. In contrast, the Enter response, with which the fi nal response is confi rmed, is free of this processing and virtually may represent a simple movement speed. Furthermore, in this version of the NRT, the R5 response is always associated with the identity rule requiring minimal computational operations. Thus, changes in RT to the fi nal Enter-press would be able to capture with greatest reliability motor procedural learning, whereas changes in the RT to R5 would be able to isolate primarily perceptual-motor learning. Given that the Enter-response refl ects individual differences in motor speed, ImP-ExK can be evaluated with fi ner precision when individual motor speed is subtracted from the integrative RT to R1-R7 (or when RTs to R1-R7 are normalized according to the Enter-RT). In this way, sleep-dependent implicit learning of explicit information can be analyzed separately for (1) motor processes (as refl ected by Enter-RT), (2) perceptual-motor processes (as refl ected by RT to R5 normalized to Enter-RT) and (3)

Explicit Processing of Explicit Knowledge
ExP-ExK refers to the conscious controlled application of the two instructed rules. The identity rule is computationally simpler than the difference rule and is further facilitated by the response-repetition effect. The conscious application of these principles produces a signifi cant difference in RTs. Figure 1 (bottom) illustrates RTs across groups and blocks in the pre-sleep session and verifi es the ExP-ExK effect. As mentioned above, R5 always followed the identity rule, whereas responses R2, R3, R4, R6, R7 always followed the difference rule. R1 was associated with both rules (30% of the trials followed the identity rule, and 70% followed the difference rule). The ExP-ExK effect is demonstrated by the significantly shorter RTs to R5 relative to the difference-rule responses (R effect, F(6/306) = 47.9, p < 0.0001; for R5 simple contrasts (F(1/51) = 59.8-169.2, p < 0.001), as well as by the signifi cant difference between RT to identity-rule-related and difference-rulerelated R1 responses (F(1/51) = 27.4, p < 0.001). Additionally, Figure 1 shows that Enter-RT was substantially shorter than any of the responses in the string (R effect, F(7/357) = 152.7, p < 0.0001; simple contrasts for Enter-RT, F(1/51) = 138.0-538.4, p < 0.00001) verifying that it virtually represents simple movement speed.
The signifi cance of these effects indicates that changes of the RT difference between R5 and difference-rule responses would index a change in the mode of conscious processing strategy. Here, to measure these relations across sleep, RTs were min/max normalized within the pre-sleep and post-sleep blocks. This normaliza- tion assigns a value of 1 to the maximal RT in a block and a value of 0 to the minimal RT in a block, with other RTs being accordingly re-computed. In this way, the distances among RT to different responses are emphasized, with confounding from absolute response speed being minimized. For analysis of ExP-ExK, original and normalized RTs were subjected to a Sleep Group (Early-NG vs. Late-NG) × Performance Group (Solvers vs. Non-solvers) × Session (pre-sleep vs. postsleep) × Response (R2, R3, R4, R5, R6, R7) ANOVA. To evaluate the relations between identity rule-related R5 response and difference rule-related responses R2, R3, R4, R6 and R7, a min/max normalization was applied separately for the last pre-sleep block and the fi rst post-sleep block. Normalized values (RTnorm) were calculated for each individual according to the equation: where RTi is the actual RT value, RTmax is the maximal individual average RT value within a block, and RTmin is the minimal individual average RT value within a block.

Implicit Processing of Implicit Knowledge
ImP-ImK refers to the acquirement of implicit knowledge about the covert regularity of the NRT structure. A reliable quantifi er of ImP-ImK learning in the NRT is obtained when RT decreases between pre-sleep and post-sleep session more for predictable responses than for unpredictable responses (Yordanova et al., 2008). R5 is not included in this analysis, being exclusively determined by the identity rule. To support a balanced design, R3 and R4 were analyzed as unpredictable responses, and R6 and R7 were analyzed as predictable responses.
Original and min/max normalized RTs were analyzed. The ANOVA design was Sleep Group × Performance Group × Session × Predictability (unpredictable vs. predictable).

Explicit Processing of Implicit Knowledge
ExP-ImK refers to the generation of explicit knowledge (awareness) about the hidden regularity of the NRT (i.e., to the acquisition of explicit knowledge about the predictability of responses R5, R6, R7). While insight is the culmination of that process, activation of explicit mechanisms for processing of covert NRT information can be assessed before insight, because even in implicit learning conditions, controlled processing may lead to conscious search, task exploration and hypotheses testing, which destabilizes ongoing performance. This is refl ected by deviations from straightforward responding. For analysis of ExP-ImK, coeffi cients of variance (CV) of RT were computed according to the equation: where SD is the RT standard deviation and RTmean is the mean RT. Individual CV values were subjected to the Sleep Group × Performance Group × Session × Response ANOVA, with factor Response including the responses from R1 to R7. A relevant constraint of this quantifi er takes into account the fact that RT variability may increase as a function of attentional defi ciency (trait or state dependent), which is accompanied by slower RTs, or higher impulsivity (trait and state dependent), which is accompanied by faster RTs. Therefore, performance variance can be accepted as a measure of ExP-ImK learning (1) when response speed remains within the normal range, and (2) when differences are response-specifi c rather than general (i.e., refer to particular, but not to all response types). In all analyses, the Greenhouse-Geisser correction procedure was applied to variables with more than two levels, with the original df being reported in the results.
Previous studies with the NRT have demonstrated that the transformation of implicit abstract knowledge to explicit is promoted by SWS in the early half of the night (Yordanova et al., 2008) and that implicit abstract task representations are reorganized primarily by the SWS (Yordanova et al., 2009). Also, SWS has been suggested to support declarative (explicit) memory system (Plihal and Born, 1997) or the interaction of implicit and explicit memory systems whereas REM sleep has been associated with implicit/procedural learning (Drosopoulos et al., 2005;Stickgold, 2005;Born et al., 2006;Fischer et al., 2006). Both knowledgebased and processing-based aspects could have contributed to these effects of sleep on memory consolidation, so that fi rm hypotheses cannot be made on the basis of previous results. Here, it was expected that dissociating the functional aspects of memory would help to further specify the role of sleep for memory consolidation mechanisms. Yordanova et al. (2008), sleep recordings confi rmed the differential distribution of SWS vs. REM sleep. Subjects in the Early-NG had substantially more SWS than those in the Late-NG (p < 0.001), and subjects in the Late-NG, conversely, had substantially more REM sleep than those in the Early-NG (p < 0.001). The two groups did not differ in the proportions of other sleep stages (p > 0.2).

As detailed in
Ratings of subjective feelings of sleepiness, activation, tension, boredom, motivation, and concentration were obtained before and after each session of initial practice and retest. As reported in Yordanova et al. (2008), the two experimental groups did not differ on the whole in these variables, as indicated by non-signifi cant main effects of early vs. late night (all p > 0.2). However, subjects felt more sleepy and less activated, motivated and concentrated in task sessions performed in the middle of the night (i.e., initial training for late-night group, retest for early-night group) than in sessions performed in the evening (initial training for early-night group) or in the morning (retest for late-night group) (p < 0.05, for respective night-half × session interactions). A much stronger effect independent of sleep was an activating effect of task performance itself, i.e., subjects felt less sleepy and more activated at the end as compared to the beginning of a task session (p < 0.001).
Nine out of 29 subjects (31.04%) from the Early-NG and 5 out of 26 subjects (19.2%) from the Late-NG group could discover the hidden task regularity after sleep, with the rate of post-sleep solvers not differing between the two sleep groups (χ 2 (1,n = 55) = 1.01, p = 0.32). Importantly, none of the solvers gained explicit knowledge of the NRT hidden structure before the forth (from 10) block of the post-sleep session. Therefore, in the fi rst block after sleep analyzed here, all subjects were unaware of task regularity and processed the task as in the pre-sleep session by following the instructed rules ('identity' rule and 'difference' rule).
Because of the differences in subjective feelings before sleep, to rule out that any changes across sleep could be simply attributable to differences in the mode of processing that were already present before the critical post-learning sleep period, a comparison was performed between the two groups only for the pre-sleep session. Relevant parameters (original and normalized RTs) before sleep were subjected to a Sleep Group × Performance Group analysis. Although solvers and non-solvers were separated only on the basis of their post-sleep performance (gain of insight about NRT regularity) that occurred later than the fi rst post-sleep block, the Performance Group was included in this fi rst analysis of the pre-sleep session to see if individual differences in the mode of task information encoding that might have contributed to the gain of explicit knowledge after sleep in solvers, could have affected the initial pre-sleep learning. As a second step, changes were evaluated between the two sessions, from before sleep to after sleep.

Across sleep analysis
RTs to unpredictable and predictable response types decreased in the post-sleep session (F(1/51) = 39.6, p < 0.001, Figure 3A). But this decrease was greater for predictable than unpredictable responses (Session × Predictability, F(1/51) = 4.27, p < 0.05), which was manifested in a greater difference between sessions for predictable responses ( Figure 3D)

Pre-sleep analysis
In the pre-sleep session, performance variance did not differ between the early-and late-night sleep groups (Sleep Group, F(1/51) = 0.7, p = 0.4), nor between the groups of solvers and non-solvers (Performance Group, F(1/51) = 1.03, p = 0.3). Also, no interactions of between-group variables with response type were observed (F < 1.5, p > 0.2).

Across sleep analysis
Response variance was larger for Solvers than Non-Solvers (Performance Group: (F(1/51) = 8.51, p = 0.005, Figure 3E). Importantly, as shown in According to the results, the effects of SWS and REM sleep on implicit processing of explicit information were different since an improvement in the post-sleep relative to the pre-sleep session was only found in the early-night group, in which SWS dominated. Pre-sleep analyses found no Sleep Group effects, which shows that group-specifi c processing or encoding of task information before sleep might not be the source of group differences after sleep. To provide further evidence that the post-sleep differences between the two sleep groups might not originate from the mode of encoding , correlational analyses were performed for the gain in implicit processing of explicit information and the presleep parameters of the four processing modes. The gain in implicit processing of explicit information was computed as the post-sleep minus pre-sleep difference in RTs normalized to the RT-Enter. The pre-sleep parameters related to the four processing modes were: ImP-ExK -RT, RT normalized to Enter, RT normalized to R5; ExP-ExK -min/max normalized RT to identity rule and difference rule related responses; ImP-ImK -the pre-sleep difference between unpredictable and predictable responses in original and min/max normalized RTs, and ExP-ImK -CV to different response types. None of these correlational analyses yielded signifi cant results (absolute values of Pearson correlation coeffi cients, r = 0.03-2.5, p = 0.1-0.9, n = 55).
A further control analysis aimed at excluding the possibility that the differences in implicit processing of explicit information between the early-and late-night groups might simply refl ect differences in on-line learning abilities between the groups (i.e., speed of performance improvement over time-on-task) that might have affected the results from the blocks included in the present analyses. To control for this effect, the ImP-ExK parameters were analyzed for the three pre-sleep blocks. If the early-and late-night groups originally differed in the speed of learning, this would be evinced already in the pre-sleep session by signifi cant Sleep Group × Block interactions. For none of the analyses of RT, RT to the Enter press, and RT normalized to Enter-RT, was there a signifi cant Sleep Group or Sleep Group × Block (×Response type) effect (F(1/53) = 0.03-0.7, p = 0.4-0.87; F(2/106) = 0.13-0.57, p = 0.53-0.85) - Figures 5A,B. Alternatively, if sleep stages in the early vs. late night modulated the differences in the ImP-ExK parameters, a signifi cant Sleep Group effect would be expected for all blocks after sleep. To test this, data from the 10 post-sleep blocks were analyzed. Subjects who gained insight after sleep and short-cut responses were excluded from these analyses, since they did not have recordings from all 10 post-sleep blocks (see Materials and Methods, 'Assessment of Explicit and Implicit Knowledge of the Hidden Regularity'). Thus,

FIGURE 4 | Coeffi cient of variation (CV) of reaction times for the groups of non-solvers and solvers before (PRE) and after (POST) sleep.
Early-NG, early-night group; Late-NG, late-night group; R1 to R7, response numbers. data of 23 subjects from the Early-NG and 22 subjects from the Late-NG were used. The main effect of Sleep Group was signifi cant for the RT normalized to the Enter-RT (F(1/44) = 4.5, p = 0.05), in contrast to RT and RT to the Enter press (F(1/44) = 0.067-0.62, p = 0.4-0.8) - Figures 5A,B. No differences were found between the two sleep groups in the post-sleep dynamics of RT and RT to Enter (F(9/396) = 0.66-1.3, p = 0.25-0.63) - Figure 5A, while the post-sleep difference in the RT normalized to Enter-RT even increased in the course of task performance (F(9/396) = 2.5, p = 0.03) - Figure 5B.

DISCUSSION
The present study used the number reduction task to assess how two aspects of explicitness, explicitness of task information, and explicitness of task processing may affect off-line learning during sleep.
(1) Based on availability to conscious awareness, the information of the task was divided into its explicit aspects (i.e., task information processed by applying the instructed rules which subjects were aware of: identity rule and difference rule) and its implicit aspects (i.e., task information of the hidden regularity which the subjects were not aware of: symmetric organization of responses).
(2) Based on whether information was under the conscious control of executive systems, processing was regarded as explicit or implicit. Either type of task information, explicit or implicit, could be processed in two ways, explicitly or implicitly. Introducing this distinction of awareness in two dimensions (knowledge-based vs. processing-based) allowed for evaluating the effects of different sleep stages, SWS and REM sleep, on specifi c functional aspects of memory consolidation.
One major result was that the effects of SWS and REM sleep could be separated for one of these functional aspects: Implicit processing of explicit information was improved in the post-sleep relative to the pre-sleep session only in the early-night group, in which SWS dominated. This was demonstrated by the postsleep gain in performance both for the simple computational operation needed to apply the identity-rule and, with an even greater gain in performance for the more complex computational operation needed to apply the difference-rule. These effects may be suspected to stem from the mere duration of the time interval between the pre-sleep and post-sleep sessions leading to consolidation (i.e., to be time-dependent, Robertson et al., 2004), or from the different times of the night when the sessions took place, rather than from the particular intervening sleep. Yet, the time intervals between pre-and post-sleep sessions were equally long in the two sleep groups, and the pre-sleep measures recorded in the evening for the early-night group, and at mid-night for the late-night group did not differ at all, thus indicating that these factors may not be critical determinants of the detected betweengroup differences. Results from correlational analyses also confi rmed that the improvement of implicit processing of explicit information associated with the early-night sleep might not be produced by differences in pre-sleep encoding of task information. It may be also suspected that the post-sleep improvement in ImP-ExK parameters simply refl ects an improvement in performance expected from preceding pre-sleep practice that would be observed in the absence of any off-line consolidation, the effects of which may be differentially modulated by the early-and latenight sleep. Although with the present experimental data it is not possible to address directly this issue, it may be argued that a preceding practice would affect similarly each of the response types. The results showed that the post-sleep speeding was not equal for different response types, being virtually absent for the Enter response type and being signifi cant less expressed for the R5 (identity-rule-related) response type. Control analyses with all blocks further demonstrated a lack of between-group differences in on-line learning (time-on-task dynamics of performance) and a persistence of between-group differences for the whole post-sleep session. Although the present data do not permit fi rm conclusions about how exactly different sleep stages might have mediated effects expected from practice, they do show that the differential effects of early-and late-night sleep on implicit processing of explicit information can be attributed to a specifi c contribution of different sleep stages. It is left to demonstrate how similar intervening periods of wakefulness would affect the implicit processing of explicit information.
Importantly, neither early nor late sleep supported the speeding the Enter response, indicating that sleep did not promote offline procedural effi ciency of simple movement. This result also shows that the post-sleep speeding of computational responses Modes of memory consolidation was probably not due to greater movement effi ciency. Rather, the speeding of these responses refl ects an improvement of computational skills, which can be explained with (a) faster sensorimotor integration, (b) learning of stimulus-stimulus associations, and (c) learning of stimulus-response associations. If sensorimotor integration alone was accelerated by early sleep, RT reductions would be similar for items with simple and complex computational requirements. The additional speeding for complex items therefore indicates that computational skills were facilitated perhaps on the basis of stabilized stimulus and response associations. Yet, this learning effect was only observed for task-instruction elements that were processed consciously in the pre-sleep session. Analysis of the electrophysiological activity recorded from the same data set (Yordanova et al., 2009) revealed that slow cortical potentials indicating the amount of controlled processing did not differ neither between unpredictable and predictable responses nor between early-and late-night sleep groups during implicit learning before sleep. These neurophysiologic observations provide evidence that encoding processes did not account for differences between sleep groups. Additionally, they demonstrated that only after early-night but not after late-night sleep was there a signifi cant decrease in slow cortical potentials at occipito-parietal regions. Since the amount of controlled processing in task-specifi c cortical regions is refl ected by the magnitude of slow cortical potentials at those regions, a facilitation of controlled visual processing was demonstrated (Yordanova et al., 2009). These observations of facilitated visual control provide neurophysiologic support to the notion that early sleep stabilizes stimulus and response associations. The important fi nding here is that only those associations among task elements that were processed consciously before sleep to fulfi ll instructed task goals appear to be strengthened by early night sleep. This result is consistent with previously reported effects of SWS on goal-based rather than on movement-based memories (Robertson, 2009), and additionally indicates that performance improvement of computational skills may not involve explicit processing mechanisms.
The implicit processing of the information having remained implicit (out of awareness) at pre-sleep encoding and being still out of awareness after sleep, was improved after both early and late sleep. Implicit off-line learning of covert task regularities has been reported previously for the serial reaction time task (Maquet, 2001;Peigneux et al., 2003). This effect, however, has been basically associated with the REM sleep dominating in the second half of the night, whereas according to the present observations, early-and late-night sleep did not differ in this respect. Our previous analysis of the same data set has demonstrated that SWS in the early night promotes the covert reorganization of implicit task representations (Yordanova et al., 2009) and facilitates the subsequent transition of implicit knowledge to explicit, whereas REM sleep in the late night preserves the implicit memories in their original form (Yordanova et al., 2008). Thus, different sleep stages may contribute, by means of different mechanisms, to the stronger consolidation of covert implicit information. However, since these effects were similar for the two sleep groups, it cannot be excluded that they were due to the time interval between the pre-sleep and post-sleep sessions (Cohen and Robertson, 2007;Mednick et al., 2009). To address this question, further studies with wake controls are required.
What defi nitely did not differ between sleep stages and did not benefi t from either sleep stage was the explicit processing of either overt or covert information of the task. Although the lack of effect on explicit processing may refl ect a covert compensation from increased cognitive efforts demonstrated previously by enhanced slow negative potentials (Yordanova et al., 2009), the relevant fi nding here is that the two sleep stages did not differ in this respect.
Notably, markers of conscious search (explicit processing) for covert regularities substantially increased in the post-sleep session in those individuals who subsequently gained explicit knowledge about the hidden task structure. This effect occurred equally for the early-night group and the late-night group. So, the effect might be independent of sleep although it cannot be excluded that the current statistical outcome may have been limited by the relatively small number of solvers. Nonetheless, given the existence of differences between solvers and non-solvers in each of the sleep groups, it may be speculated that sleep in general may lead to a strong activation of control processing systems to search for covert (implicit) information patterns.
In terms of interaction between explicit and implicit memory systems in the brain, the present results show that early-but not late-night sleep promotes the implicit access to explicit knowledge accumulated before sleep. Yordanova et al. (2008) have demonstrated that again early-but not late-night sleep promotes the explicit access to implicit knowledge acquired before sleep. Thus, an interaction between explicit and implicit memory systems appears only to occur in relation to early-night sleep, rich in slow wave sleep. A refi ned account of the explicit/implicit distinction of memory systems in terms of information and processes can contribute to clarify the role of sleep for off-line memory consolidation.