The systemic effects of the enriched environment on the conditioned fear reaction

In this review, a hypothesis is proposed to explain the beneficial effect of an enriched environment (EE) on the conditioned fear reaction (CFR) from the perspective of a functional system of behavioral control. According to the hypothesis, the EE affects all behavioral act components, including the processing of sensory information, memory, motivational and reinforcing systems, and motor activities, which weakens the CFR. Animals raised in the EE have effects that are comparable to those of context (CTX) and CS pre-exposures at latent inhibition. An abundance of stimuli in the EE and constant contact with them provide the formation of CS-noUS and CTX-noUS connections that later, during CFR learning, slow down and diminish fear. The EE also contributes to faster processing of information and habituation to it. As a result, many stimuli in the context lose their significance, and subjects simply ignore them. And finally, the EE affects the motivational and reinforcing brain mechanisms, induces an impairment of search activity, and worsens memory consolidation, which leads to a reduction of CFR.


Introduction
Empirical observations on humans and experimental work on animals show that one of the beneficial factors that corrects various psycho-neurological disorders and neurodegenerative pathologies at different ages and in different sexes is long-term exposure to an enriched environment (EE).This refers to emotional (impulsive behavior, anxiety and depressive disorders), cognitive (Alzheimer's disease), motor (Parkinson's disease) and other brain activities.Animal experiments have shown a protective and preventive effect of EE on the development of anxiety-depressive and cognitive disorders (Laviola et al., 2008;Hannan, 2014;Guan et al., 2021;Ji et al., 2022;Xu et al., 2022;Zhang et al., 2022) caused by prenatal and neonatal stressors (e.g., bacterial intoxication, maternal separation, etc.).EE also counteracts the development of negative consequences of severe stress like post-traumatic stress disorder (Imanaka et al., 2006;Smail et al., 2020;Yu et al., 2022).It slows down the development and alleviates the course of Alzheimer's disease (Sommerlad et al., 2019;Li et al., 2021;Liew et al., 2022;Colavitta et al., 2023), Parkinson's disease (Jungling et al., 2017;Alarcón et al., 2023), Huntington's disease (Spires et al., 2004;Novati et al., 2022), autism spectrum disorders (Aronoff et al., 2016) and other pathologies.The beneficial nature of the influence, the wide spectrum of action and the relative simplicity of the procedure makes EE a "miraculous remedy" for many severe and negative consequences of emotional, mental, cognitive and motor disorders.It should be noted that the molecularcellular and biochemical mechanisms of the positive effects of EE on behavior are quite well investigated [see the reviews of Kempermann et al. (1997), Laviola et al. (2008), Grigoryan (2021), Liew et al. (2022), Alarcón et al. (2023), etc.].They are associated with geneenvironment interactions, increased neurogenesis, synaptogenesis, plastic synaptic rearrangements, growth of trophic factors, in particular BDNF and NGF, changes in a number of subunits of NMDA and AMPA receptors, cAMP/PKA signaling pathways, etc.Moreover, the effect of EE on hippocampus-dependent behavior associated with spatial learning and memory is quite well studied.Fewer works are devoted to the study of the influence of EE on behavior based on fear conditioning, or another traumatic event that leaves a long and strong emotionally negative trace in the memory (post-traumatic syndrome).In this review, we will present the literature data on this subject and try to discuss it from the standpoint of the functional behavior control system that we proposed many years ago (Grigoryan, 1990(Grigoryan, , 2006;;Grigoryan and Gulyaeva, 2017).But first, let us briefly recall the main provisions of the operation of this system.

Functional behavioral control system
Behavioral control is carried out through self-organizing functional systems of the brain, which include the mechanisms of the main key components (categories) of an integrated behavioral act.They include the mechanisms of perception of stimuli and events of the external world, the formation of internal motivational states and needs, and the organization of movements and achievement of reinforcement (emotions).All of them are closed up in the memory apparatus, which occupies a central (integrating) place in the functional system of behavior (Figure 1).Traces of stimuli, objects and events of the external world are deposited in the memory in the form of sensory engrams, and traces of motor actions corresponding to the appropriate sensory engrams are deposited as motor engrams.In other words, the sensory engrams represent those stimuli in memory which were in the past related with reinforcement; the motor engrams represent those actions which were in the past related with reinforcement.Generally speaking, sensory engrams constitute the S-S association (memory in classical conditioning), while motor engrams compose the motor part of the S-R association (memory in instrumental conditioning).
The functional system consists of two main subsystemssensory-motivational and motor-reinforcing.Both subsystems are interconnected with each other through the memory apparatus by means of stimulus-motor engrams, which are organized by the complementary principle ("key-lock").The learning process is characterized by the formation of new stimulus-motor and/or stimulus-stimulus associations under the influence of current natural environmental stimuli and internal motivational states (Figure 1).In the sensory-motivational subsystem, which forms the first closed neurofunctional circle, the events are developed by the following scenario: the inflow of current sensory information; trigger, with its assistance, the motivational mechanisms of the brain; actualization through signal and motivational excitations of sensory engrams of memory; comparison and evaluation of matching (or not matching) of the stored engrams with proper incoming environmental stimuli.In short, at the level of the sensory-motivational subsystem, a comparison and evaluation of incoming current information from the outside world with that stored in memory occurs (Gray, 1982).When sensory engrams match their corresponding natural stimuli, then the motor engrams become active and trigger activation of the motor-reinforcing subsystem.In fact, sensory and motor engrams form their own internal subsystem of connections (internal circle) in the memory (stimulus-response, S-R or stimulusstimulus, S-S associations).This subsystem is chronologically constantly updated with new associations with their various and multiple comparisons and matching with the current moment, the formation of new combinations, checking and rechecking of old combinations, etc.
The motor-reinforcing subsystem includes executive mechanisms of actions, mechanisms for evaluation of the results of actions (reinforcement, emotions) and motor engrams (the traces of past motor actions) that form the "motor-reinforcing" part of the memory apparatus (Figure 1).Together, they form the third neurofunctional circle, which closes up in memory apparatus due to feedback from the results of the action (reinforcement) to motor engrams.If the results of actions have a positive adaptive meaning for the organism, then the stimulus-motor engrams get amplification and consolidation.If the results of action do not have a positive value, then the underlying stimulus-motor engrams weaken or completely disintegrate.Thus, the two independent enclosed subsystems are integrated into one holistic functional system through the internal stimulus-motor or stimulus-stimulus associations within the memory apparatus.At the same time, the mechanisms of memory themselves are implemented through three sensory, motivational and reinforcing (emotional) inputs.Due to the first two inputs, the formation and actualization of sensory-motor engrams take place, and, thanks to the third input, their consolidation does occur.

What is enriched environment?
Environmental enrichment has three main components.The first component is sensory enrichment (Cummins et al., 1977;Rosenzweig et al., 1978;Van Praag et al., 2000).It is associated with filling the environment with a variety of objects for sensory perception and subsequent manipulation of them.In real life, animals and humans use environmental objects for orientation in space and formation of sensory engrams in memory, which are used to search for food, water, a sexual partner, avoid an enemy, and execute other adaptive actions.With a lack of sensory stimulation, memory works and develops poorly, the adaptive actions are not performed; life becomes dull, boring and monotonous (Costa-López et al., 2021).For instance, the individuals with a loss of vision showed significant impairment in different cognitive tasks: tactile spatial memory (Vecchi and Girelli, 1998), tactile spatial attention (Forster et al., 2007), and general cognitive skills (Nejati, 2018).More than 100 years ago, I.P. Pavlov drew attention to the impotence and complete indifference of dogs to the outside world after the extirpation of the cerebral cortex where the sensory engrams are represented.This all shows how important the sensory stimulation is or the sensory component of EE for the organism.The functional system of behavioral control-how it works and how the EE has a beneficial impact on its work in the case of fear conditioning.The functional system of behavioral control represents an integrated framework of key components, including memory, sensory information, motivation, actions, and reinforcement.It consists of two main parts: sensory-motivational (orange color) and motor-reinforcing (green color) circuits.They are linked within the memory apparatus by stimulus-motor connections (S-R connections or engrams), which are organized on the complementary ("lock and key") principle.Formation of a new stimulus-motor connection requires, on the one hand, activation of the motivational structures by a proper real stimulus via a forward conditional connection, and, on the other, formation of a trace or sensory engram in the central memory-related structures corresponding to this stimulus.It is also possible to activate the sensory-motivational subsystem from the motivational input.In this case, the motivational excitation, on the one hand, will activate the sensory engrams of different stimuli, and on the other hand, through activation of the backward conditional connection, induce the subject's search for those stimuli that correspond to sensory engrams that led in the past to receiving reinforcement.Thus, in the sensory-motivational subsystem forming the first closed neuro-functional circuit, events develop in the following scenario: the inflow of current sensory information; trigger, with its assistance, the motivational mechanisms of the brain; actualization through signal and motivational excitations of sensory engrams of memory; comparison and evaluation of matching (or not matching) of the stored engrams with proper incoming environmental stimuli.When the sensory engrams coincide with the acting stimuli, the complementary motor engrams are actualized and excitation is transferred to the motor-reinforcement subsystem.The sensory and motor engrams form their own internal subsystem of connections in the memory apparatus, which overall are organized as a second neuro-functional circuit.The motor-reinforcement subsystem includes the executive mechanisms of actions, the mechanisms of reinforcement (emotions), and motor engrams (traces of motor experience) in the motor part of memory (shown by the green color).Overall, these functional blocks form a third neuro-functional circuit, which is closed by feedback connections from the reinforcing structures to the memory engrams.If the result of action has valuable or adaptational significance for the organism, the corresponding stimulus-motor engrams are strengthened and reinforced (Grigoryan, 1990(Grigoryan, , 2006;;Grigoryan and Gulyaeva, 2017).The blue arrows show the influence of the enriched environment on manifestations of the conditioned fear response.As is seen from the figure, the EE affects every link of the functional system.At the level of the memory structures, the EE weakens the formation of conditioned (S-S) connections between the signal and the unconditional stimulus (CS-US) and between the context and the unconditional stimulus (CTX-US).This happens due to the fast adaptation of animals being in the EE to the surrounding world, which promotes an impaired incorporation of sensory stimuli into the contextual fear memory (formation of the sensory engrams).On the other hand, the quick loss of interest in these stimuli in the EE animals weakens the motivational state and, in addition to the weak impact of natural stimuli, further impairs the formation of sensory engrams.The weakening of the S-S associations under the effects of EE during fear conditioning reminds the effects of latent inhibition.Thus, the EE impairs the function of the sensory-motivational circuit and formation of the sensory engrams in the memory structures.But apart from the problems in the sensory part of the memory, the EE affects locomotor activity and reinforcement function, bringing problems with the formation of motor engrams and consolidation of fear memory.Thus, again, this all acts against the conditioned fear response, and promotes the beneficial effects of the EE.More full explanations, supported by the literature data are given in the text.
Procedurally, this component is easily achieved by placing various replaceable items in the home cages of rats and mice: toys, nest building material, polyethylene tubes, rubber pieces, cuttings for burrowing, etc.The second component of EE is social stimulation, or the need to live in a community of conspecific partners (Brenes et al., 2016).The beneficial effect of the social component is especially evident in comparison of animals and humans having been in social isolation (Mora-Gallegos and Fornaguera, 2019;Davim et al., 2021).Prolonged social isolation produces severe stress which leads to strong negative consequences for an organism, from serious diseases with impaired cognitive functions to the development of anxious and depressive disorders.Procedurally, this component is achieved by keeping rats or mice in larger groups compared to standard housing.The third component of the EE is physical activity, or the performance of specific physical actions, which are even more effective in the positive effects of 10.3389/fnbeh.2023.1227575EE, for example, in inducing neurogenesis and synaptic plasticity, than the other EE components (Duman et al., 2008;Campeau et al., 2010;Rabadán et al., 2019).Physical actions represent an integral part of the formation of stimulus-motor associations, which ultimately lead to the getting of reinforcement.Procedurally, this EE component is achieved by using ladders, a treadmill for running, hammocks, and other devices for motor actions.Thus, the EE activates and stimulates the key components of the entire functional system -from the perception and processing of sensory information, to the actualization of stimulus-motor or stimulusstimulus engrams stored in the memory, and triggering motor actions for achievement of the final positive result (reinforcement).In this sense, the EE acts as a very valuable activator of the functional system that switches over the subject from a sluggish, boring condition to an active and workable state.

Influence of enriched environment on the conditioned fear reaction
In accordance with the functional system considered above, the influence of the EE on behavior is complex and multilateral, involving simultaneously all the key components of this system.However, for convenience of presentation, we will focus on each of them separately.But first, let's move on to a brief description of the methodology for studying conditioned fear reaction (CFR).

Fear conditioning model
The most convenient model for studying CFR is the Pavlovian classical defensive conditioned reflex (CR), well known in the literature as fear conditioning.A pairing of a conditional (cue) stimulus, CS (for instance, a tone) with an US stimulus (electroshock) produces a CFR, which is estimated by the percentage of the freezing time followed by 24 h (retention test) in the same context (CTX) and in response to the cue stimulus (CS).During the acquisition of the CFR, several associations are formed in the brain: between CS and US, between context and US (CTX-US), and between context and cue stimulus (CTX-CS) (Grahame et al., 1994;Escobar et al., 2002).The degree and strength of these associations depend on the magnitude and number of CS and US pairings, and the loads and presentations of environmental stimuli.With regard to the effects of EE on the CFR, many factors should be taken into account, such as the duration of staying in the EE, the age of the animal from which EE is started, features of the EE procedure (for example, its application before the onset of stress or after it); the character of the assessment tests and models used (Clemenson et al., 2015;Hegde et al., 2017;Cavalcante, 2019;O'Leary et al., 2019;Cavalcante et al., 2020;Cheng S. T. et al., 2022) and so on.Of particular interest is the effect of EE on the developing brain.The use of enriched environment as a developmental intervention was investigated in laboratory animals as a modulator of developmental trajectories (Ball et al., 2019).This intervention is especially effective during critical or sensitive periods, when brain plasticity is affected by a new experience.It was shown that the EE improves synaptogenesis and the survival of neurons during early development (Van Praag et al., 2000).The EE speeds up the development of the visual system (Sale et al., 2009), affects an increase of BDNF, which promotes neuron growth and maturation, and accelerates development of the GABA system in the visual cortex of normal rat pups, which affects visual system development.It also provides the increased sensory stimulation needed to recover from age-related decline and improve cognitive abilities (Leon and Woo, 2018).
According to our hypothesis, the EE, having general beneficial (positive) effects, should modify the work of the functional system in a way to ameliorate the CFR.The weakening of conditioned fear under the influence of the EE can be carried out through various mechanisms, which will be considered below.

Enriched environment and memory
Acquisition of the conditioned fear reaction Barbelivien et al. (2006) studied the effects of EE on CFR in rats under different conditions of CS-US pairings.At first, the authors trained the rats to the classical Pavlovian CR by 4-fold pairings of CS (tone, 15 s) and US (electrical shock, 0.6 mA, 0.8 s).They also used the procedure of pseudo-conditioning, in which US was also presented 4 times, but tone was not associated with US; it was applied 2 times before and 2 times after the presentation of US with an average interval between trials of 202 s.In the case of the classical fear conditioning, the contextual memory of the EE group 24 h later in the retention test was significantly improved.The percentage of freezing time was substantially higher in the EE rats in the same context compared with the standard (STAND) housed group.The cue memory of the EE group was weaker than in the STAND group.In the case of the pseudo-conditioning, on the contrary, the contextual fear memory in rats of the EE group was substantially impaired compared to the control group; the cue memory was not changed.So, it looks like there is a link between the strength of the CS-US associations and the effects of the EE.If the conditioned associations are weak or not presented at all, as in the case of pseudo-conditioning, then the EE ameliorates the contextual fear memory.And, vice versa, if the associations are strong, then the EE strengthens the contextual fear memory.Perhaps the reverse is also true, i.e., being in the EE weakens the CS-US associations compared to the standard conditions.And, vice versa, housing in a poor environment (for instance, in social isolation) makes these associations stronger.Apparently, the EE somehow modifies the processing of sensory information, and provides a specific perception and evaluation of this information relative to other environmental conditions.It is well known from the Pavlovian laboratories and western literature (Rescorla and Wagner, 1972;Mackintosh, 1975) that the formation of conditioned associations occurs as a result of a complex conditioned stimulus, which includes a specially selected cue stimulus (CS) and contextual (CTX) stimuli paired with an unconditioned stimulus (US).The magnitude and stability of the conditioned associations depend on the strength and temporal relationships of these stimuli.For establishing a stable association, not only is the value of the US important, but also the ratio of the intensity of CS and CTX.When the CS is strong, then the effects of the context are overshadowed, 10.3389/fnbeh.2023.1227575and vice versa, when the context is well pronounced and filled with well expressed object-stimuli, the association between CS and US becomes weaker.It seems that a long stay in the EE adapts animals to the environmental stimuli and impairs the incorporation of these stimuli (formation of sensory engrams) into contextual memory.This can occur either directly through the mechanisms of rapid habituation to the contextual stimuli, or indirectly, through the increased activity of CS.Facilitation of CFR due to increased activity of CS under the EE conditions has not been manifested in many experiments (Rampon et al., 2000;Duffy et al., 2001;Tang et al., 2001;Barbelivien et al., 2006;Pavlova et al., 2023).At the same time, a lot of data demonstrating a link between the effects of EE and contextual fear memory were obtained, although these data had contradictory results (Rampon et al., 2000;Benaroya-Milshtein et al., 2004;Hendriksen et al., 2010;Lee and Noh, 2016;Sun et al., 2016;Sukegawa et al., 2022;Yu et al., 2022).For example, the percentage of freezing time of rats housed in the EE was much less in a neutral context than in the context where animals were experienced with the paired CS-US stimulations (Barbelivien et al., 2006).These experiments were carried out twice a day for 9 days, with alternately testing rats in a neutral setting and in a context where they received paired CS-US.In a neutral environment, where the conditioned associations were weak (due to generalization of fear transferred from the "dangerous" context), the rats of the EE group expressed the conditioned fear in a less extent than the rats of the STAND group.Moreover, the freezing time in rats of the STAND group, in contrast to the animals of the EE group, was approximately the same in the neutral and "dangerous" contexts.Similar data was obtained by Hegde et al. (2017).In their experiments, the rats were trained for CFR in the context of chamber 1, and CFR was tested in the other, albeit very similar context, chamber 2. The rats housed in the EE froze significantly less time in chamber 2 compared to the rats of the STAND group, though no differences were observed between both groups in chamber 1.In our experiments (Pavlova et al., 2023), in the retention test 24 h after fear conditioning learning, the male rats of the EE group froze significantly less time in the same context and in response to CS than the rats of the STAND groups.In the females of the EE group, the freezing time in the context, but not for CS, was shorter than in the rats of the STAND group.The interesting results on mice were obtained by Yu et al. (2022).The EE groups were subjected to the enrichment procedure on days 0-17.The other groups were housed in the standard cage.On day 17, mice were placed in the footshock box for 2 min, and then subjected to footshock treatment (2 mA, 10 s).On days 18-20, all mice were given a situational reminder procedure in the same footshock box for 2 min with the cue ball but no footshock.All mice were assigned to the no EE/no cue, no EE/cue, EE/no cue, and EE/cue groups.Mice housed in the EE had much less freezing than those housed in the STAND conditions.The cue ball which was placed into the home cages for 17 days also affected the CFR, making it weaker in the EE group compared with STAND housed animals.Interestingly, the combination of EE and cue revealed the highest reduction in footshock-induced fear behavior.Apart from the fear conditioning the EE improved memory of aversive stimuli also in the passive avoidance (Leger et al., 2015) and active avoidance learning in mice (Pietropaolo et al., 2014) and also facilitated shuttle chamber avoidance responses in rats in a PTSD model (Takahashi et al., 2014;Tanichi et al., 2018).

Extinction of the conditioned fear reaction
During the CFR extinction, the conditioned associations between CS and US become weaker.According to our hypothesis, the animals housed in the EE should extinguish the CFR faster than the animals housed in the STAND environment.This was confirmed in many experiments (Hunter, 2015;Lach et al., 2016;Hegde et al., 2017;Cavalcante et al., 2020;on others).In particular, Lach et al. (2016) showed that the extinction of CFR in context occurs faster in rats housed in the EE (2 weeks) compared to the STAND group.The percentage of freezing time in the EE group decreased from 60 to 20-25% in the 2nd extinction session and continued to decrease in the 3rd session, while in the STAND group, a significant drop in the percentage of freezing time occurred only in the 3rd session.After 4 extinction sessions, the rats were regrouped again into three groups (STAND-STAND, EE-EE, and STAND-EE).The 1st and 2nd groups were housed under the same conditions as before, but the 3rd group of animals was replaced from the STAND environment to the EE.The lowest percentage of freezing time was seen in the EE-EE group (1%), then in the STAND-EE group (2%), while in the STAND-STAND group the freezing time was much higher (12%).In the study of Yu et al. (2022), mice exposed to the EE (from birth to PND 17) showed a significant decrease of CFR in the context where they received a single CS-US pairing with a strong US (2 mA, 10 s).In three successive extinction trials (PNDs 18-20), all mice showed a progressive decrease in CFR, but the mice housed in the EE extinguished the CFR much quicker than animals of the STAND group.Tang et al. (2001) examined the effects of EE on control and transgenic (NR2B) mice with enhanced NMDA receptor function.According to the authors, the increased activities of NMDA receptors are provided by the EE effects.Of the three extinction trials, in trial 1, no differences in freezing time were seen between the groups.But in the 2nd, and especially in the 3rd trial, the freezing time of transgenic mice of the STAND group, as well as control and transgenic mice of the EE group, compared with control naive animals was significantly shorter both in the context and to presentation of CS.Cavalcante et al. (2020) found that a 2week stay in the EE caused a significant decrease in the freezing time during extinction of CFR compared to control animals, while a 4-week stay in the EE reduced the freezing time only in the last session.In our work (Pavlova et al., 2023), the percentage of the freezing time decrease during extinction in the EE group in context was greater than in rats of the STAND group.Thus, the extinction of contextual CFR in rats and mice occurs much faster in the EE group compared to the STAND group.

Reconsolidation of the conditioned fear reaction
Memory reconsolidation occurs when a previously consolidated memory is reactivated (recalled) by placing the animal in the same context in which the original memory was formed, or by applying a cue stimulus without reinforcement.As a result of this procedure, the memory undergoes destabilization, becomes labile and weaker than the original memory (Lewis, 1979; 10.3389/fnbeh.2023.1227575Nader et al., 2000;Grigoryan and Markevich, 2015).Since the conditioned association is getting weaker during the memory reconsolidation procedure, then the EE, according to our hypothesis, would have a stronger effect on fear memory reconsolidation than the STAND conditions.We were able to find only one work in the literature that studied the influence of housing conditions on the reconsolidation of CFR memory (Schroyens et al., 2023).In this work, the rats were placed in different living conditions (EE, social isolation, SI and STAND), starting from the 26th until the 68th PND.The acquisition of CFR was established in the context without application of CS (3 electrical shocks were given with an interval of 30 s). 24 h later, the contextual fear memory was reactivated by placing the animals in the same environment for 5 min without a shock.24 h later, in the retention test (10 min) the percentage of freezing time was measured in rats of different groups.The results obtained did not confirm the prediction of the hypothesis, since no differences were seen in the freezing time of the EE and STAND groups neither during reactivation nor retention tests.At the same time, the rats that were subjected to SI froze to a less extent than animals of the other groups.

The enriched environment and conditioned fear reaction caused by other stresses
The hypothesis predicts that the EE should counteract the increase of CFR under the influence of additional stresses, i.e., reduce the total freezing time and conditioned fear.Novaes et al. (2021) housed the animals in the EE and STAND conditions for 2 weeks and then divided each group into two subgroups, one of which was subjected to a single restrictive stress for 2 h, and the other was not subjected to it.After 10 days, the CFR was elaborated in each group and then it was extinguished for 6 days.Stressed rats of the STAND group showed the highest percentage of freezing time during the acquisition and extinction of CFR.The rats that were housed in the EE before receiving the restrictive stress froze to a less extent than the stressed rats of the STAND group.In other words, the 2-week pre-exposure of rats in the EE prevented the increase in CFR caused by the 2h restrictive stress.It has been suggested that EE counteracts the strengthening of conditioned fear by increasing phosphorylation of the GluA1 subunit of AMPA receptors in the hippocampus induced by restrictive stress.In another study (Imanaka et al., 2006), the effect of EE (PNDs 22-49) on the contextual fear memory was studied in rats: (1) receiving neonatal isolation (PNDs 2-9) 1 h a day, (2) receiving single strong restrictive stress on PND 56 for 2 h followed by forced swimming for 20 min, (3) receiving neonatal isolation + stress, and (4) control animals.The control group, the rats subjected to severe single restrictive stress and stress combined with neonatal isolation, had the highest percentage of freezing time in the retention test 24 h after the CFR training.The EE rats showed a significant decrease in freezing time compared to the STAND group.The freezing time decreased substantially in the rats that received a severe single stress and a combination of a single stress and neonatal isolation.The EE impaired the CFR in these rats to the level of fear of the STAND group.Pavlova and Broshevitskaya (2021) studied the effect of EE (from 45 to 105 PNDs) on the contextual and cue fear memories in rats injected with a bacterial toxin, lipopolysaccharide, LPS on 3rd and 5th PNDs.Two other groups of animals were housed under SI and STAND conditions.The greatest attenuation of CFR was seen in rats subjected to SI and early life stress, both in males and females, in context and in response to CS.The EE caused a decrease of CFR during the retention test in the context compared to STAND conditions.Weakening of CFR also occurred when animals were transferred from SI to EE conditions (Mora-Gallegos and Fornaguera, 2019).

The conditioned fear reaction in the presence of a conspecific partner
A lot of evidence testifies that EE through social communication with a conspecific partner has a beneficial effect on the organism.Staying together reduces the reaction to stress, alleviates anxiety, improves the process of wound healing, getting rid of other troubles and so on.This phenomenon, known as a "social buffer, " facilitates coping with the consequences of negative events (Glasper and Devries, 2005;Hennessy et al., 2009).It has been shown in experiments on rodents, that the presence of a conspecific partner reduces CFR and impairs the activity of the amygdalar complex in a dangerous environment and under the action of a cue stimulus (Kiyokawa et al., 2004(Kiyokawa et al., , 2007;;Fuzzo et al., 2015;Lee and Noh, 2016).Kiyokawa et al. (2004) divided the rats into two groups; one was the "experimental" (subject group) and the other -partner group.On the first day, the experimental rats and half of the partner rats learned the CFR (by use of 9 electroshocks, 55 V, 2 s) for 15 min with a random interval, while the other half of the partner rats did not learn the CFR, but the animals were placed in the same environment for 15 min.A total of 24 h later in the retention test the CFR of the experimental group were evaluated for 10 min, taking into account whether the rats were placed in the context one by one, together with a trained or untrained partner.The experimental rats froze the least time when they were in the context together with an untrained partner (about 100 s).The freezing time of rats tested alone was about 700 s, and tested together with a trained partner about 400 s.So, the partner rats significantly reduced the level of fear in experimental rats, acting as a social buffer (Kiyokawa et al., 2004).In another study (Fuzzo et al., 2015), rats were also exposed to CFR either alone or with a social partner placed on the other half of the chamber, divided in two parts by a transparent partition.After 24 h in the retention test, the rats that received CS-US pairings alone froze significantly longer than the rats being trained to CFR under conditions of visible social partner (170 s vs. 20 s, respectively).The presence of a conspecific partner significantly reduced the peak amplitude of auditory evoked potentials, gamma oscillations (25-75 Hz) and high-frequency oscillations (100-300 Hz) in the lateral amygdalar nucleus.The amplitude of the EP correlated with the duration of freezing response in rats trained to CFR (Fuzzo et al., 2015).In another study (Lee and Noh, 2016), in a chamber divided into two compartments, on one halve, the CFR was trained in rats placed singly or in two placed together at the same time.After 24 h in the retention test, the rats that learned the CFR together entered the dangerous compartment much earlier than those that were trained singly (about 70 and 150 s, respectively).

Enriched environment and information processing
In the previous section, we have already marked the role of context and signal in the manifestations of CFR.Although memory represents the central core of a functional system, without the active work of the other key components of this system, the formation of memory, its retrieval (actualization) and consolidation is impossible.The information component, which includes the signal and the environmental stimuli (context), is an important part of the functional system which participates in the formation of sensory engrams of memory.Woodcock and Richardson (2000) conducted experiments on rats, which, from their point of view, reflect the speed and complicated character of the processing of sensory contextual information in rats housed in the EE and STAND environments.To study this, they used different times for rats to stay in the context (4, 16, and 120 s) before the onset of the electroshock.Rats were placed in the EE, starting from the 2nd PND until weaning from their mother (21st PND), and then continued to be housed in the EE until the 54-60th PNDs, before the start of behavioral experiments.The EE before weaning from a mother was induced by exposure to rat pups for 1 h with stimuli of various sensory modalities, and after weaning by placing them in a cage with tunnels, running wheels, etc.After exposure to the context for 4, 16, and 120 s, the rats received a single electroshock (0.5 mA, 1 s).24 h later in the retention test, they were examined for the total freezing time.Being in the context of 4 and 120 s prior to the onset of the shock did not cause differences in the freezing time between the rats housed in the EE and STAND conditions, but the difference was significant at an interval of 16 s.The rats housed in the EE froze a significantly higher percentage of time than the rats of the STAND group (approximately 40% vs. 20%).On this basis, the authors concluded that the processing of contextual information passes faster in the EE group than in the STAND group.In their opinion, 4 s was insufficient time to process information about the environment in rats of both groups, while 120 s, on the contrary, was too long for both groups to process information about the context in full.The interval of 16 s was enough to discover the differential influence of the EE and STAND conditions on the processing of contextual information (Woodcock and Richardson, 2000).The faster information processing by rats of the EE group was testified by their ability to differentiate between neutral and "dangerous" contexts, whereas the STAND group could not do it.The increase of CFR in the EE rats could also be as a result of the sensitization of the fear system by the first stress produced by weaning rat pups from their mothers (Rosen and Schulkin, 1998).Clemenson et al. (2015) showed that pre-exposure of mice in context A for 10 min 24 h prior to CFR training caused different freezing times in contexts A and B 30 min after CFR acquisition.In control mice, the percentage of freezing time in the "dangerous" context A was higher than in the neutral context B. But the difference between the contexts disappeared in mice housed in the EE.Here again there was an important time given to mice for examining the context before switching on an electroshock.The mice of the EE group froze for a smaller percentage of time in context B than in context A at 5 and 15 s intervals, but the differences disappeared at an interval of 25 s (Clemenson et al., 2015).
We suppose that the correlation between the EE effects and strength of the conditioned fear association may be similar to the mechanisms of the latent inhibition.The latent inhibition is related with multiple pre-exposures of CS and CTX before CR learning.These pre-exposures slow down the acquisition of a conditioned reflex.It happens due to weakening of attention to the CS; a subject simply ignores it, considering it as an insignificant stimulus (Mackintosh, 1975).Lubow et al. (1981) think that the slowdown in CR learning happens due to formation of a link between the repeated preexposures of future CS and no presentations of US.Because a future CS is always set up in a certain context, along with a loss of attention to CS, also takes place a loss of interest to the surrounding context.There are a number of hypotheses that explain the role of context in slowing down the development of conditioned associations.In particular, Lubow and Gewirtz (1995) consider context as an occasion-setter or as a "modulator" in a complex conditional stimulus.The signal (cue) and CTX are incorporated into this complex in such a way that, unreinforced presentations of CS and CTX form the CS-noUS and CTX-noUS associations before the development of CR.When CS-US pairings are presented in the same context where the CS pre-exposes (CS-noUS) and CTX preexposures (CTX-noUS) were used, then the context acquires a role of an occasion-setter (Fraser and Holland, 2019), which primarily affects the CS-noUS association and slows down a formation of a CS-US and CTX-US associations.It is possible that the mechanism of weakening the conditioned association by the EE is the same or similar as in latent inhibition.It is possible, that a long-term stay of animals in the EE creates similar to the effects of pre-exposures of CS and CTX, the strong connections of CS-noUS and CTX-noUS types, which in the future, during the CFR learning, significantly slow down and reduce fear, in contrast to the animals of the STAND group.

Enriched environment and reinforcement (emotions)
If the signal and contextual stimuli, together with motivational excitation (will be discussed below), are associated with the formation and actualization of conditioned associations (sensory engrams), then the reinforcement function is more related with the consolidation of these associations.The hypothesis suggests that, in addition to the weakening of conditional associations during their formation under the influence of EE, there may also be a weakening of the consolidation of these associations as a result of a weakening of the reinforcement function.Many years ago, Fessler and Beatty (1976) discovered that rats housed in the EE (8-10 per cage), from 21 to 45 PND, showed higher thresholds of sensitivity to electroshock, than the animals of the STAND group.Both males and females had high thresholds for all behavioral responses (flinch, shuffle, and jump) caused by painful electrical stimulation.Later, this data was confirmed in other studies (Rocinholi et al., 1997;Cavalcante, 2019).Interestingly, only the 2-week, but not 4-week stay of rats in the EE caused an increase in thresholds and a decrease in the percentage of freezing time of animals in response to a 6-fold presentation of US during the learning phase.When tested after 24 h, CFR, in contrast to the unconditioned response, was approximately the same in the EE and STAND groups (Cavalcante, 2019).In a subsequent work (Cavalcante et al., 2020), the authors found an increase in dopaminergic neurons in the ventral tegmental area (VTA) under the influence of 2-and 4weeks stay of animals in the EE.Coppens et al. (2010) suggested that EE affects dopamine release in the mesocorticolimbic pathways.Aumann et al. (2013) showed that the EE leads to an increase in the number of tyrosine hydroxylase immunoreactive neurons in the VTA and the nucleus accumbens.According to the authors, the housing conditions of animals affect the ratio of dopaminergic and non-dopaminergic neurons in VTA.The housing of rats for 6 weeks in the EE did not significantly influence the frequency of self-stimulation from electrodes located in the MFB near the VTA.However, the frequency of pedal pressing in this group tended to decrease (90 vs. 130), and the thresholds for frequency stimulation were higher (40 vs. 30 Hz) than in control animals (Konkle et al., 2010).It was shown that mice housed in the EE were less sensitive to the reinforcing effects of heroin, assessed by the conditioned place preference, than mice of the STAND group (El Rawas et al., 2009).Animals housed in the EE were less active on repeated injections of cocaine and less responsive to the cocaine challenge (Solinas et al., 2009).They were also less sensitive to the reinforcing effects of amphetamine, especially at low doses (Green et al., 2002).In vivo microdialysis, the positive effects of EE were independent of reduced dopamine levels in the ventral and dorsal striatum, but were associated with a reduction in the expression of the fast zif-268 gene in the nucleus accumbens.
Thus, the EE, on one hand, increases the threshold of sensitivity to the pain effects of electroshock, and on another hand, reduces the reinforcing properties of emotionally positive brain structures.These findings are consistent with our hypothesis that predicts a weakening of the brain's reinforcing mechanisms responsible for consolidation of the conditioned fear memory in conditions of the EE.

Enriched environment and motivation
The formation of CS-US associations requires the involvement of motivational mechanisms, which actively participate in the actualization of sensory engrams and triggering of the motor mechanisms for obtaining reinforcement.The hypothesis predicts that the EE should somehow impair the motivational state and ameliorate the actualization of S-S or S-R engrams (see Figure 1).Barbelivien et al. (2006) in Exp. 3 measured the extinction of exploratory activity in a new context for 30 min in blocks of 5 min in the EE and STAND groups of rats.The decrease in total activity was more pronounced in the EE rats compared to the STAND group, starting from the 4th block.A comparison of exploratory activity within the EE group revealed a significant decrease in this activity already in the 2nd and the 3rd blocks.The authors suggested that the processing of sensory information in rats of the EE group occurs faster than in control rats.This accelerates the habituation of rats to the environment and the formation of indifference (familiarization) to the stimuli presented in it.These results have been confirmed in a number of other studies (Woodcock, 1994;Zimmermann et al., 2001;Schrijver et al., 2002).In particular, Schrijver et al. (2002) showed that rats housed in the EE had less exploratory activity in the object recognition test after moving the objects, than rats of the STAND group.In addition, they demonstrated a faster loss of interest in examining a new object by replacing an old one.In another experiment, the authors found a faster exit of rats of the EE group into the light section of the light-dark chamber, after the first entry into the dark section, compared with animals of the STAND group.The authors suggested that this occurs due to a faster examination of the dark compartment of the chamber by the EE group and habituation to it, similar to the behavior in the new object recognition test.Zimmermann et al. (2001) found that the EE group investigated more quickly, but also more quickly habituated to 4 new objects in an open field, than control animals.It was also shown that the EE mice better manifest a processing of new information than the STAND group, but the speed of information processing by animals of both groups did not depend on the complexity of this information (Cheng S. T. et al., 2022).Woodcock and Richardson (2000) measured the number of rats approaching to 12 focal points of an experimental chamber for 16 s preceding the electroshock.The EE rats did not differ from the STAND group either in the total number of focal points visited or in the number of visits to specific points.Since the EE rats froze significantly more time with this interval before shock presentation than the rats of the STAND group, the authors assumed that the EE group process contextual information faster than control animals.It should be noted that in a number of studies, the rats housed in the EE showed an increase in exploratory activity (Studelska and Kemble, 1979;Van Waas and Soffie, 1996;Brillaud et al., 2005;Pavlova et al., 2022Pavlova et al., , 2023)).For example, in our work (Pavlova et al., 2022), males of the EE group traveled a greater distance and had a higher movement speed compared to males of the STAND group.They also had more hanging down in the elevated plus maze than males of the control group, while females of the EE group had more peeking into open arms.However, in these experiments, the EE procedure was short-term with placing the animals in it for 20 min, every second day.Van Waas and Soffie (1996), compared the effects of EE with standard conditions in young and old rats in models of spontaneous alternation and a new object recognition test, while Brillaud et al. (2005) in a radial-arm maze.In both studies, different results were obtained depending on the animal's age and the models applied.

Enriched environment and motor activity
Motor activity itself is one of the important components of the EE, since physical exercise (for example, running on a wheel) has a significant effect on plastic rearrangements in many brain structures.In particular, they have been shown to enhance the synaptic plasticity of the hippocampus (Patten et al., 2013), the density of dendritic spines (Dostes et al., 2016), the regulation of immediate fast genes (Simon et al., 2006), the activity of transcriptional genes (Chen and Russo-Neustadt, 2009) et al., 2019).Specifically, these changes could be associated with increased activity of a number of genes that influence hippocampal plasticity, including genes for BDNF, synaptophysin, CREB, PSD-95, Arc, TLX, DCX, and others.Thus, physical exercise during the development of an organism through a sequence of molecularcellular transformations may have a positive beneficial effect on the CFR manifestation.Concerning the motor activity in the EE, the hypothesis predicts its weakening or inadequate character (for example, impulsive behavior), since the motor component of the motor-reinforcing subsystem provides achievement of reinforcement and consolidation of CS-US associations.Rats housed in the EE showed significantly lower spontaneous motor activity in the open field compared to the SI animals (Del Arco et al., 2007).Administration of the D1 agonist SKF38393 in the PFC produced long lasting increases in spontaneous motor activity but increases were significantly lower in the EE rats compared to the SI animals.Moreover, the density of D1 receptors in the PFC was significantly reduced in animals housed in the EE.Zambrana et al. (2007) showed that the EE animals spent less percentage of time in the open arms of an elevated plus maze and had much fewer entries than animals housed in the standard conditions.The authors suggested that the decreased percentage of time and number of entries in the open arms reflects a decreased novelty seeking in the EE mice, as a result of the abundant sensory stimulation in their housing conditions.EE has been shown to disrupt amphetamine-induced behavioral sensitization in motor activity without changing dopamine levels in the NAc and striatum (Bardo et al., 1995;Cheng C. N. et al., 2022).Mice raised in the EE showed less locomotor activity in response to an injection of cocaine than mice raised in a standard environment (Bezard et al., 2003).Sudo et al. (2018), in contrast, discovered that the EE enhances locomotor activity and leads to muscle hypertrophy without inducing physiological stress in rats.However, an increase in locomotor activity in the rats housed in the EE was observed only during the dark time of the day but not in the light time.The EE also affects impulsive behavior.Perry et al. (2008) showed that the EE rats had higher baseline MADs (a mean adjusted delay) (were less impulsive) than SI rats.In the study of Pattison et al. (2013), the pigeons were exposed to a version of the suboptimal choice task involving choice between an alternative that 50% of the time signaled 100% reinforcement, and 50% of the time signaled no food (the suboptimal alternative), and an alternative that 100% of the time signaled 75% reinforcement (the optimal alternative).The control group quickly showed a strong preference for the suboptimal alternative, whereas the EE group chose optimal for many training sessions, before eventually choosing the suboptimal alternative (Pattison et al., 2013;Zentall, 2021).In the experiments of Kirkpatrick et al. (2014), SI rats were more impulsive in delay-discounting schedule than the rats socially and sensory enriched, but they did not differ in risky choice behavior (a choice between a small constant reward versus large reward with low probability).

Conclusion
In this review, a hypothesis explaining the positive (beneficial) effects of the EE on the CFR from the perspective of a functional behavioral control system is proposed.The central part in the functional system belongs to the memory apparatus, where the other key components of behavioral control (sensory information, motivation, motor actions and reinforcement) are linked.Memory represents the storage of sensory and motor engrams, which are formed and updated with the help of the sensory-motivational subsystem, while the other, motor-reinforcing subsystem controls the memory consolidation.Both subsystems interact through the inner functional circle of memory (see Figure 1).Housing in the EE changes the activity of all key components of the functional system in such a way that leads to a weakening of the CFR.First of all, the EE alters information processing, by promoting the fast habituation to the contextual stimuli and impairs incorporation (formation of sensory engrams) of these stimuli into the contextual memory.The weakening of the CS-US association under the effects of EE seems like the effects of latent inhibition.When animals are housed in the EE for a long time, similar to the effects of pre-exposures to CS and CTX at the latent inhibition, the associations of CS-noUS and CTX-noUS are formed.These [inhibitory] connections slow down the formation of CS-US and CTX-US associations and reduce the CFR, unlike animals of the STAND group, that have no EE experience.As in the case of CS pre-exposures (CS-noUS) during latent inhibition, the EE plays a role of the occasion-setter, primarily affecting the CS-noUS connection and, through it, promotes slowing down the formation of a CS-US association.The data collected in the literature shows that animals housed in the EE encounter a large amount of information, process and habituate to it faster.The fast information processing and its habituation, plus a weakening of the motivational mechanisms in the EE, impairs the CS-US associations (formation of sensory and motor engrams).The hypothesis predicts a weakening of the motivational mechanisms in the effects of the EE on CFR.It was shown in a number of tests (the open field, the elevated plus and radial-arm mazes, in the dark-light chamber, etc.) that EE promotes a more rapid decrease in exploratory activity and loss of interest in examining the environment compared with the control animals.The EE also affects the reinforcing brain mechanisms.According to the functional system of behavioral control, the reinforcement system plays an important role in consolidation of the CS-US associations.The EE impairs the reinforcing effects, which is proved by the increase of thresholds for pain sensitivity and self-stimulation, and decreases the sensitivity to the drugs of abuse (cocaine and amphetamine).
In conclusion, it should be noted that, of course, not all existing facts regarding the influence of the EE on the CFR are consistent with the predictions of the hypothesis.There are many reasons for this, which may be related to technical, procedural and methodological differences in the conduct of experiments.In recent years, a number of attempts have been made to create a more or less unified protocol for investigating the effects of an enriched environment on various forms of emotional and cognitive behavior (Harland and Dalrymple-Alford, 2020;Love et al., 2022).No doubt that it is very hard (if possible at all) to unify the characteristics of an enriched environment, the training methods (even within the same behavioral model), age, kind, genetic line of animals, etc.We did not aim in this review to consider a large number of variables affecting the EE influences on behavioral responses.But we tried to find a general (integrative) rule, a link between the influence of EE and the strength of the conditional (S-S) connection.The main outcome is that the EE has a beneficial effect on the fear response (weakens it).All other variables (like age of animal, type of enrichment, duration of stay in the EE, etc.) simply follow or should follow this rule.The hypothesis proposed and the available literature data on the example of a single neurobiological reaction, the CFR, provide conceptual justification for the influence of an enriched environment.
FIGURE 1 (O'Leary et al., 2019)al., 2012).This all leads to improved learning, better attention and spatial hippocampal-dependent memory.It is important at what age physical exercise starts.For example, in relation to the CFR, it was shown(O'Leary et al., 2019)that exercise in adult rats (8 weeks) for 7 weeks leads to an increase of conditioned fear in context and in response to a cue presentation.In adolescence (4 weeks), physical exercise did not affect the CFR, either in the context or on the cue, compared with control animals.Since the development of brain structures and functions continues during adolescence, one would expect that increased motor activity will produce more pronounced changes in CFR.However, physical exercise during adolescence did not affect the CFR.This could occur due to a number of specific molecular and cellular changes that are not manifested in adult animals (O'Leary