Abstract
Chronotherapy is a treatment for mood disorders, including major depressive disorder, mania, and bipolar disorder (BD). Neurotransmitters associated with the pathology of mood disorders exhibit circadian rhythms. A functional deficit in the neural circuits related to mood disorders disturbs the circadian rhythm; chronotherapy is an intervention that helps resynchronize the patient's biological clock with the periodic daily cycle, leading to amelioration of symptoms. In previous reports, Hadaeghi et al. proposed a non-linear dynamic model composed of the frontal and sensory cortical neural networks and the hypothalamus to explain the relationship between deficits in neural function in the frontal cortex and the disturbed circadian rhythm/mood transitions in BD (hereinafter referred to as the Hadaeghi model). In this model, neural activity in the frontal and sensory lobes exhibits periodic behavior in the healthy state; while in BD, this neural activity is in a state of chaos-chaos intermittency; this temporal departure from the healthy periodic state disturbs the circadian pacemaker in the hypothalamus. In this study, we propose an intervention based on a feedback method called the “reduced region of orbit” (RRO) method to facilitate the transition of the disturbed frontal cortical neural activity underlying BD to healthy periodic activity. Our simulation was based on the Hadaeghi model. We used an RRO feedback signal based on the return-map structure of the simulated frontal and sensory lobes to induce synchronization with a relatively weak periodic signal corresponding to the healthy condition by applying feedback of appropriate strength. The RRO feedback signal induces chaotic resonance, which facilitates the transition to healthy, periodic frontal neural activity, although this synchronization is restricted to a relatively low frequency of the periodic input signal. Additionally, applying an appropriate strength of the RRO feedback signal lowered the amplitude of the periodic input signal required to induce a synchronous state compared with the periodic signal applied alone. In conclusion, through a chaotic-resonance effect induced by the RRO feedback method, the state of the disturbed frontal neural activity characteristic of BD was transformed into a state close to healthy periodic activity by relatively weak periodic perturbations. Thus, RRO feedback-modulated chronotherapy might be an innovative new type of minimally invasive chronotherapy.
1. Introduction
Mood disorders, including major depressive disorder, mania, and bipolar disorder (BD), exhibit high morbidity, high suicide rates, and multiple relapses during long-term treatment; effective treatments and diagnostic methods are long-standing unmet needs (reviewed in Drevets, 2000; Kessler et al., 2003; The Wellcome Trust Case Control Consortium, 2007; Price and Drevets, 2010). Accumulating neuroimaging evidence reveals the multiple and complex pathologies of mood disorders (reviewed in Baskaran et al., 2012; Vargas et al., 2013; Chiapponi et al., 2016; Arnone, 2019). Particularly, functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) have revealed region-specific enhancements and depressions in neural activity in regions such as the amygdala, hippocampus, and prefrontal cortex associated with major depressive disorder (reviewed in Baskaran et al., 2012; Arnone, 2019) and BD (Vargas et al., 2013). Furthermore, deficits in the excitatory and inhibitory neural pathways, typified as employing the neurotransmitters glutamic acid and gamma-aminobutyric acid (GABA), respectively, and abnormal cortical neural networks are reportedly also associated with mood disorders (Brambilla et al., 2003; Hasler et al., 2007; Sanacora et al., 2012; Schloesser et al., 2012; reviewed in Chiapponi et al., 2016). For the treatment of mood disorders, antidepressants (e.g., selective serotonin reuptake inhibitors, serotonin, and norepinephrine reuptake inhibitors) and mood stabilizers (e.g., lithium carbonate and clozapine) are widely used (Hirschfeld et al., 2003; López-Muñoz et al., 2006; Tobe et al., 2017). However, in the treatment of BD, mood stabilizers in particular exhibit troublesome side effects, such as progressive renal failure and a narrow therapeutic index (Hirschfeld et al., 2003; López-Muñoz et al., 2006). Therefore, alternative treatments are needed, either to relieve symptoms directly or to enhance the effects of conventional pharmacological therapy, allowing dosages to be minimized.
As an alternative treatment, chronotherapy has been garnering research attention (reviewed in Abreu and Bragança, 2015). The release of neurotransmitters associated with the pathology of mood disorders, such as serotonin, noradrenaline, glutamic acid, GABA, and dopamine, exhibits circadian rhythms (Weiner et al., 1992; Castaneda et al., 2004; Weber et al., 2004; Hampp et al., 2008; Cain et al., 2017). In mood disorders, dysregulated neural circuits disturb these circadian rhythms (Yeragani et al., 2003; Glenn et al., 2006; Bonsall et al., 2011; Moore et al., 2014; reviewed in Albrecht, 2013). Chronotherapy promotes the transition of the disturbed circadian rhythms to periodic ones, consequently leading to the improvement of symptoms (Abreu and Bragança, 2015). Chronotherapies include light therapy and combination therapy (light therapy with drugs; Leibenluft et al., 1995; Terman and Terman, 2005). However, light therapy must be individualized, and customization of the luminance and wavelength of the light for each patient is difficult. Moreover, the use of inappropriate parameters in light therapy carries a risk of inducing mixed states, hypomania, and autonomic hyperactivation in cases of BD (Terman and Terman, 2005; Sit et al., 2007; Abreu and Bragança, 2015).
Circadian rhythms are a phenomenon in which biological signals exhibiting oscillations synchronize with the daily cycle; to describe these temporal behaviors at multiple hierarchical levels, from the molecular to the synaptic network, non-linear dynamic models have been proposed (Pavlidis, 1969; Goldbeter, 1995; Kurosawa et al., 2006; reviewed in Pikovsky et al., 2003; Herzog, 2007; Pavlidis, 2012). In addition to circadian rhythms, non-linear dynamic modeling has been considered key for understanding the pathology of the transition of mood between mania and depression with a view to treatment (Daugherty et al., 2009; reviewed in Hadaeghi et al., 2013a,b). Daugherty et al. and Hadaeghi et al. have demonstrated that the mood transition is caused by the phenomenon of chaos-chaos intermittency, in which the orbit of an oscillator in the phase plane hops between separated chaotic attractor regions. Hadaeghi et al. demonstrated the effect using the forced Duffing oscillator and the Liénard oscillator (Daugherty et al., 2009; Hadaeghi et al., 2013a). Furthermore, to explain the relationships between deficits in neural networks in the frontal cortex and disturbances of circadian rhythm/mood transitions in BD, Hadaeghi et al. and Bayani et al. proposed a non-linear dynamic model (referred to as the Hadaeghi model in this study) composed of frontal and sensory cortical neural networks interacting with the hypothalamus (Hadaeghi et al., 2016; Bayani et al., 2017). In this model, activity in the neural networks of the frontal and sensory cortices exhibits periodicity in the healthy state but is transferred to a state of chaos-chaos intermittency in patients with BD. The temporal fluctuation based on the healthy periodic state reflects the controlling parameter of the circadian pacemaker in the hypothalamus (Hadaeghi et al., 2016). Consequently, disturbances in the circadian rhythm, which are observed in BD because of mood transitions, appear (Hadaeghi et al., 2016; Bayani et al., 2017). The circadian rhythms reproduced by the model are highly congruent with actual clinically observed disturbances of circadian rhythms (Hadaeghi et al., 2016).
Accumulating research on the effect of fluctuations on synchronization phenomena in non-linear systems reveals that fluctuations induce many types of synchronization, such as chaos synchronization, coherence resonance, stochastic resonance, and chaotic resonance (reviewed in Pikovsky et al., 2003; Anishchenko et al., 2007; Rajasekar and Sanjuán, 2016). The mechanism of stochastic resonance in particular, in which synchronization to a weak input signal is enhanced by additive noise, has biomedical applications, such as the development of devices and methods for enhancing human tactile sensory performance (Enders et al., 2013; Kurita et al., 2013, 2016; Seo et al., 2014). Similar to the synchronization phenomenon of stochastic resonance, in chaotic resonance, the synchronization to a weak input signal is enhanced by the internal chaotic dynamics instead of additive noise (reviewed in Anishchenko et al., 2007; Rajasekar and Sanjuán, 2016). Chaotic resonance has been widely studied in many types of systems, including neural systems (Nishimura et al., 2000; Nobukawa and Nishimura, 2016; Nobukawa et al., 2016, 2017; Baysal et al., 2019; reviewed in Nobukawa and Nishimura, 2020). In these fluctuation-enhanced synchronization phenomena, the strength of the external perturbation required for the development of a periodic state is weaker than that required for forced oscillations (Sinha, 1999; reviewed in Pikovsky et al., 2003; Anishchenko et al., 2007; Rajasekar and Sanjuán, 2016). Therefore, using these synchronization phenomena may be a strategy for administering minimally invasive chronotherapy.
According to the Hadaeghi model, in patients with BD, the presence of chaos-chaos intermittency in the neural activity of the frontal cortex disturbs the circadian rhythm (Hadaeghi et al., 2016; Bayani et al., 2017). Therefore, methods that promote the transition from chaos-chaos intermittency to periodic behavior may stabilize the disturbed circadian rhythm. As the best candidate, we proposed a chaos controlling method known as the “reduced region of orbit” (RRO) method, in which chaos-chaos intermittency is synchronized to an external, weak periodic signal using a feedback principle (Nobukawa et al., 2018b). The RRO feedback signals reduce the absolute values of local maximum and minimum values of the return-map functions, causing a bifurcation called attractor merging, which underlies the chaos-chaos intermittency (Nobukawa et al., 2018b). Because the synchronization of chaos-chaos intermittency is maximally facilitated around the attractor-merging bifurcation (review in Anishchenko et al., 2007; Rajasekar and Sanjuán, 2016), an appropriate strength of the RRO feedback signal can induce synchronization, i.e., RRO feedback signals induce chaotic resonance (Nobukawa et al., 2018b). Initially, the RRO feedback signal was applied to simple cubic map systems to induce chaotic resonance (Nobukawa et al., 2018b). Subsequently, the use of an RRO feedback signal has been applied to several types of systems, such as coupled cubic maps (Nobukawa et al., 2019a) and Chua's circuit (Nobukawa et al., 2020). These studies revealed that chaotic resonance induced by RRO feedback possesses advantages over other forms of synchronization induced by fluctuations (Nobukawa et al., 2019b, 2020). Particularly, the chaotic resonance induced by the RRO feedback method exhibits higher sensitivity than stochastic resonances induced by additive noise and are more adaptable to various types of attractor conditions (Nobukawa et al., 2019b). Studies on chaotic resonance induced by the RRO feedback method have been applied to neural systems (Nobukawa and Shibata, 2019; Nobukawa et al., 2019b). Therefore, in addition to stochastic resonance controlled by additive noise in neural systems (Enders et al., 2013; Kurita et al., 2013, 2016; Seo et al., 2014), chaotic resonance controlled by RRO feedback is at the stage where biomedical applications can be considered.
In this context, we hypothesized that the chaotic resonance induced by RRO feedback will facilitate chronotherapy by adapting to the daily neural activity of each patient, allowing for minimally invasive treatments. To verify this hypothesis, we applied chaotic resonance induced by RRO feedback signals to a model of a patient with BD based on the Hadaeghi model and evaluated the transition to periodic behavior of the disturbed frontal cortical neural activity. In detail, we first developed the RRO feedback method using the Hadaeghi model from the return-map structure of the frontal and sensory cortical neural system. Second, the chaotic resonance induced by an RRO feedback signal in combination with a weak periodic signal was evaluated. Third, the amounts of perturbation required for entrainment were compared between chaotic resonance induced by RRO feedback and synchronization induced by the application of a periodic signal alone, i.e., a forced oscillation.
2. Materials and Methods
2.1. Neural System Composed of the Frontal and Sensory Cortices
The pathology of BD involves multiple complex neural pathways (Sanacora et al., 2012; Schloesser et al., 2012; Tobe et al., 2017). Hadaeghi et al. (2016) focused on the pathological consequences of competition between excitatory (glutamatergic) and inhibitory (GABAergic) neurons in the frontal cortex (Tretter et al., 2011; Montague et al., 2012) as major etiological factors in BD. They constructed a neural system composed of the frontal and sensory cortices to reproduce healthy and disturbed BD-associated neural activities on a diurnal timescale (Hadaeghi et al., 2016; Bayani et al., 2017). Figure 1 shows an overview of this system. This neural system has two neural pathways, excitatory and inhibitory, from the sensory cortex to the frontal cortex; the neural activity produced by the interaction between these pathways is fed back to the sensory cortex (Hadaeghi et al., 2016).
Figure 1
The daily neural activity of the frontal cortex x(n) (n = 1, 2, … days), which represents the long-term firing rate dynamics, is controlled by the competition of the excitatory and inhibitory neural populations (Hadaeghi et al., 2016):
where w1 and w2 are the synaptic weights of inputs to the inhibitory and excitatory neural populations, respectively. A and B correspond to the synaptic weights of the outputs of the inhibitory and excitatory neural populations, respectively, as overall neurotransmitter levels. The parameters used in this study were determined by previous research (Hadaeghi et al., 2016; Bayani et al., 2017) as follows: w1 = 0.2223, w2 = 1.487, and B = 5.82. In this study, as well as in the previous research, A is the main bifurcation parameter (Hadaeghi et al., 2016; Bayani et al., 2017).
2.2. Controlling Frontal Cortical Neural Activity by RRO Feedback
Hadaeghi et al. demonstrated that healthy circadian rhythms and the disturbed circadian rhythms associated with BD are produced by a period-p state in the periodic window and a chaos-chaos intermittency state in the frontal cortical neural activity, respectively (Hadaeghi et al., 2016). The concrete behaviors of frontal neurons x(n) given by Equations (1) and (2) corresponding to healthy and BD states are demonstrated in section 3.1. In this study, we developed a feedback signal to facilitate the transition of the chaos-chaos intermittency of x(n) to the period-p state using an RRO-type chaotic resonance. An overview of the system for this control method is presented in Figure 2. The daily neural activity of the frontal cortex x(n) is controlled by RRO feedback signals Ku(x) and a periodic input signal S(n) = αsin(2πn/p), as follows:
Here, K, xd, and σ represent the RRO feedback strength, the merging point of two chaotic attractors, and a parameter to determine the region of the RRO feedback effect, respectively. In this study, xd = 0 and σ = 1.0 were used, because the return-map structure has a point symmetry at around x = 0 with local maximum and minimum values of the map function located within the region −σ < x < σ (σ = 1.0) (Nobukawa et al., 2018b). We used four values, 4, 8, 16, and 32, for the period p.
Figure 2
To explain the effect of the RRO feedback signal Ku(x) in the absence of the periodic input signal (α = 0), Figure 3A shows the map function of F(x) + K(u(x)) and the orbit x(n) in the presence/absence of RRO feedback signals. Attractor merging (chaos-chaos intermittency) occurs if F(fmax) + Ku(fmax) < 0 and F(fmin) + Ku(fmin) > 0, where fmax and fmin are the local maximum and minimum of the map function, respectively. For an inhibitory synaptic weight A = 9.8, 12.0 in the absence of feedback (K = 0), the attractor merging conditions are satisfied (left graph in Figure 3A). The orbit x(n) hops between positive and negative x regions, i.e., chaos-chaos intermittency arises. With positive feedback (K = 0.2 in the A = 9.8 case and K = 0.7 in the A = 12.0 case, Figure 3B), the absolute values of fmax and fmin are reduced, and the attractor merging conditions are not satisfied; the orbit x(n) is constrained to lie within either the positive or negative x region, depending on the initial value of x(0), as shown in the right graph of Figure 3A.
Figure 3
2.3. Evaluation Indices
For the evaluation of the attractor-merging bifurcation, the conditions F(fmax) + Ku(fmax) and F(fmin) + Ku(fmin) were utilized. F(fmax,min) + Ku(fmax,min) = 0 corresponds to the attractor-merging bifurcation point. To judge the chaotic state of frontal cortical neural activity x(n), the Lyapunov exponent was calculated as (Parker and Chua, 2012):
Here, (k = 1, 2, …, M) denotes M perturbed initial conditions to x(n) applied at n = n0 + (k − 1)τ. Their time evolution for tl ∈ [0:τ] is . Furthermore, x′(n) is a perturbation applied to the orbit. λ > 0 and λ < 0 correspond to the chaotic and periodic states, respectively.
The synchronization between x(n) and S(n) was evaluated using their correlation coefficient at time delay τ as follows:
where 〈·〉 denotes the average in n. In this study, τ is set to the value for in each time series of x(n). The values for are measured against ten trials with different initial values of x(0).
To evaluate the amount of the perturbation due to the RRO feedback signal Ku(x) plus the periodic input signal S(n), we used the temporal mean value of the squared perturbations:
where 〈·〉 denotes the average in n. The values for Ξ are measured against ten trials with different initial values of x(0).
3. Results
3.1. Frontal Cortical Neural Activity on a Diurnal Timescale
We demonstrated activity in a neural system composed of the frontal and sensory cortices. Figure 4 shows the bifurcation diagram of the frontal neural activity x(n), Lyapunov exponent λ, and F(fmin,max) + Ku(fmin,max) as functions of synaptic weights from the inhibitory neural population A in the absence of a feedback or periodic signal (K = 0, α = 0). With an increase in the A value, x(n) exhibits a period-doubling bifurcation and enters a chaotic state A ≳ 8.1 (λ > 0). In 8.1 ≲ A ≲ 9.8, x(n) is trapped in either the negative or the positive region, depending on the initial values of x(0), F(fmin) + Ku(fmin) < 0, and F(fmax) + Ku(fmax) > 0. The attractor merging conditions F(fmin) + Ku(fmin) > 0 and F(fmax) + Ku(fmax) < 0 are satisfied in A ≳ 9.8; consequently, x(n) hops back and forth between negative and positive regions, which is known as chaos-chaos intermittency. This effect corresponds with the merger of attractors in the negative and positive regions of the bifurcation diagram. The window of periodicity is 12.5 ≲ A ≲ 13.5. Hadaeghi et al. considered that frontal neural activity in the periodic window corresponds to that of healthy subjects (healthy control [HC]), whereas chaos-chaos intermittent activity corresponds to that of patients with BD (Hadaeghi et al., 2016). Figure 5 shows typical examples of the frontal neural activity x(n) governed by Equation (1) in HCs and in patients with BD. At A = 13.0, corresponding with typical HC behavior, x(n) exhibits the periodic-4 state, where the parameter set is located in the periodic window in the top part of Figure 4. In this periodic window, various period-p states exist through period-doubling bifurcation; therefore, as healthy period-p states, we used p = 4, 8, 16, 32 in this study. At A = 9.8, 12.0, corresponding to BD behavior, x(n) exhibits chaos-chaos intermittency. In both HC and BD cases, the attractor merging condition is satisfied with F(fmax) + Ku(fmax) < 0 and F(fmin) + Ku(fmin) > 0.
Figure 4
Figure 5
3.2. Transition From Disturbed Neural Activity to a Periodic State by RRO Feedback Plus Periodic Input Signal
To enhance synchronization to weak input signals, the system parameters must be adjusted to those of the attractor-merging bifurcation (Nobukawa et al., 2018b). Figure 6 shows the behavior of the neural system composed of the frontal and sensory cortices as a function of RRO feedback strength K, in the absence of a periodic signal (α = 0), for BD (A = 9.8, 12.0). Shown are the bifurcation diagram of the frontal neural activity x(n) given by Equation (3), the Lyapunov exponent λ, and F(fmin,max) + Ku(fmin,max). The separation of merged chaotic attractors (λ > 0) into positive and negative regions arises at the region for F(fmin) + Ku(fmin) < 0, F(fmax) + Ku(fmax) > 0 in K ≳ 0.1 for the A = 9.8 case and in K ≳ 0.7 for the A = 12.0 case.
Figure 6
Subsequently, synchronization of x(n) to a weak periodic input signal S(n) (α = 0.01, 0.15, 0.3 and p = 4, 8, 16, 32) and the evaluated perturbations of the RRO feedback and periodic signals are shown. Here, the p values are chosen based on the healthy periodic-p states locating at the periodic window in 12.5 ≲ A ≲ 13.5. Figure 7 shows the dependence of and Ξ on the RRO feedback strength K. In the case with α = 0.15 and p = 32, exhibits a unimodal maximum ( in A = 9.8 and in A = 12.0) at around the attractor-merging bifurcation defined as F(fmin,max) + Ku(fmin,max) = 0 at K ≈ 0.06 in A = 9.8 and K≈0.63 in A = 12.0 (see Figure 6), i.e., chaotic resonance is induced by the RRO feedback signal. Therefore, applying the RRO feedback signal together with a weak periodic signal brings the neural activity x(n) of BD close to the healthy periodic state. This chaotic resonance is induced when the perturbation Ξ = 0.012, 0.049, at A = 9.8, 12.0, respectively. This perturbation is relatively small in comparison to the variation range: −2.5 ≲ x(n) ≲ 2.5, as shown in the bifurcation diagram of Figure 6. Under conditions of higher input frequency (p = 2, 4, 8, 16) or weaker signal strength (α = 0.01), the values of are significantly reduced. At stronger signal strength (α = 0.3), the values of exhibit a tendency to decrease monotonically with increasing K. Thus, chaotic resonance can be induced by RRO feedback signals at an appropriate signal strength and frequency. Figure 8 shows a typical time series of frontal neural activity x(n) in synchronization with a weak periodic input signal S(n) under conditions that induce chaotic resonance in Figure 7, i.e., p = 32, α = 0.15, and K = 0.06 in the A = 9.8 case; and K = 0.63 in the A = 12.0 case. The result shows synchronization between the chaos-chaos intermittency of x(n) and the periodic input signal S(n), with hopping between positive and negative x(n) regions. Additionally, Figure 9 shows the bifurcation diagram of x(n) represented by Equation (3) as a function of K under a weak periodic input signal S(n) (p = 32, α = 0.15) in BD, in (A = 9.8, 12.0) cases. The chaos-chaos intermittency between positive and negative x(n) regions is maintained until around the peak of (represented in Figure 7) in K ≲ 0.18 for the A = 9.8 case and in K ≲ 0.79 for the A = 12.0 case. Therefore, the chaotic resonance confirmed in Figure 7 produces synchronization of the chaos-chaos intermittency with the periodic input signal S(n).
Figure 7
Figure 8
Figure 9
To evaluate the effect of the RRO feedback signal on synchronization, we compared the synchronization induced by RRO feedback with that in its absence (K = 0). Figure 10 shows the dependence of and Ξ on the signal strength α in the case of no RRO feedback under the condition where chaotic resonance is induced by the RRO feedback signal at p = 32 in Figure 7. In the A = 9.8 case with α ≳ 0.22, exceeds 0.3, which corresponds to the maximum value of under RRO feedback presented in Figure 7. Moreover, the perturbation amount Ξ at α≈0.22 required for accomplishing is approximately 0.025; however, under RRO feedback, it is Ξ≈0.012 at K≈0.06 for a peak correlation of . Therefore, the RRO feedback signal reduces the amount of perturbation needed for the transition to the periodic state. In the A = 12.0 case, the same tendency seen in the A = 9.8 case is confirmed. That is, the perturbation amount Ξ at α≈0.95 required for accomplishing is approximately 0.41; however, under RRO feedback, it is Ξ≈0.049 at K≈0.63 for a peak correlation of .
Figure 10
4. Discussion and Conclusions
In this study, we verified our hypothesis that chaotic resonance induced by RRO feedback signals can enable the delivery of chronotherapy by minimally invasive treatments. In a simulation based on the Hadaeghi model, we evaluated the transition of the disturbed frontal cortical neural activity corresponding to BD to the periodic behavior found in the HCs that was induced by RRO feedback signals. We found that the RRO feedback signal, which is based on the return-map structure of the modeled frontal and sensory cortical neural system, induced synchronization to weak, periodic signals corresponding to the healthy condition at appropriate feedback strength, although this synchronization was restricted to a relatively low frequency of the input signal. Thus, the chaotic resonance induced by the RRO feedback signal facilitates the transition to a state that is close to healthy, periodic frontal neural activity in the case where this activity has a relatively low frequency. Additionally, the combined amount of perturbation due to the RRO feedback signal and the periodic input signal was significantly smaller than that required for inducing a synchronous state by applying only the periodic signal.
First, we must consider the reason the RRO feedback signal facilitates synchronization by small perturbations. Over the past few decades, studies of non-linear control aimed at stabilizing chaotic activity have proposed many methods such as the Ott-Grebogi-Yorke method, the delay feedback method, and the H∞ method (Ott et al., 1990; Pyragas, 1992; Nakajima, 1997; Jiang et al., 2005; reviewed in Schöll and Schuster, 2008). These conventional chaos control methods stabilize the chaotic orbit to equilibrium points and periodic orbits. In contrast, the RRO feedback method does not eliminate chaotic behavior but adjusts local maximum and minimum values of the map function; consequently, the feedback strength at which chaotic behavior is maintained in RRO is smaller than that of conventional chaos control methods, in which chaotic behavior is completely suppressed (Nobukawa et al., 2018b). Moreover, by virtue of chaotic resonance at around the attractor-merging bifurcation induced by the RRO feedback signal, chaos-chaos intermittency synchronizes with input signals even at low input-signal strength (Sinha, 1999; Nishimura et al., 2000; reviewed in Anishchenko et al., 2007; Rajasekar and Sanjuán, 2016). Utilizing these advantages of the RRO feedback method and of chaotic resonance should facilitate the transition of the disturbed neural activity of BD to a healthy periodic state.
Furthermore, the application of RRO feedback signals with periodic input signals shows great promise for actual chronotherapy practice. In current chronotherapy, the administration of the light stimulus and the medication occurs at a fixed time each day to enable the transition of neural activity to a periodic state with a circadian period (Yeragani et al., 2003; Glenn et al., 2006; Bonsall et al., 2011; Moore et al., 2014; reviewed in Albrecht, 2013). This treatment may correspond to the case we consider here, in which neural activity is stabilized by applying only a periodic input signal (see Figure 10). The application of the light stimulus and medication on a schedule modulated by the daily frontal neural activity of each patient would correspond to the application of RRO feedback signals in combination with the periodic input signal, in which the amount of perturbation needed for the transition to the periodic state is expected to be significantly reduced. That is, this strategy may lead to a reduction in the amounts of stimulus and medication necessary to transition from a disturbed frontal neural activity to a healthy periodic state. Furthermore, this effect might also contribute to a reduction in mixed states, hypomania, and autonomic hyperactivations that can occur in BD chronotherapy due to overapplication of light stimuli and medication. Additionally, methods for measuring the daily variation of frontal neural activity are now under development, with a focus on EEG approaches (Croce et al., 2018; González et al., 2019). These methods might contribute to the realization of a form of chronotherapy modulated by RRO feedback.
The following limitations of this study must be considered. First, only the neural system composed of frontal and sensory cortices was considered. However, the circadian rhythms targeted in chronotherapy are produced not only by the frontal and sensory cortices but also by the hypothalamus (Hadaeghi et al., 2016; Bayani et al., 2017). Therefore, the evaluation of chaotic resonance induced by the RRO feedback method in a neural system comprising both the frontal/sensory cortex and the hypothalamus is important for evaluating its applicability to chronotherapy. Second, we used competition between excitatory and inhibitory neurons in this study to describe long-term neural dynamics in the frontal cortex. However, the questions of what reflects the long-term dynamics of brain activity and what mechanism produces it are currently controversial (Croce et al., 2018; González et al., 2019). Therefore, it is important that our proposed method be verified with models based on other neural mechanisms for producing long-term neural dynamics in the frontal cortex. In such evaluations, the use of spiking neuron models, which exhibit highly realistic neurodynamics (Nobukawa et al., 2017, 2018a, reviewed in Ma and Tang, 2017), would enhance the pathological validity of the neural network used to simulate BD (Brambilla et al., 2003; Hasler et al., 2007; Sanacora et al., 2012; Schloesser et al., 2012; reviewed in Chiapponi et al., 2016). Third, from the viewpoint of chaotic resonance, the disturbed neural activity described as chaotic dynamics in this study was close to the healthy periodic state. However, to stabilize more challenging forms of chaotic behavior, other candidate chaos control methods must be considered; we plan to research these points in the future. In addition to model-based studies, the methods of measuring the daily-timescale variation in the frontal neural activity that have recently been proposed (Croce et al., 2018; González et al., 2019) will be crucial for applications and will aid in the estimation of the controlling parameters required by RRO feedback methods.
In conclusion, in this simulation study, chaotic resonance induced by the RRO feedback method enabled the disturbed frontal neural activity characteristic of BD to be transitioned close to a healthy periodic state by relatively weak perturbations. Despite its limitations, this study demonstrated that chronotherapy modulated by the RRO feedback method might be a new type of minimally invasive therapy for BD.
Statements
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Author contributions
SN, HN, and TT conceived the methods. SN and NW analyzed the results, wrote the main text, and prepared all figures. SN and HD conducted the experiments. All authors have reviewed the manuscript.
Funding
This work was supported by JSPS KAKENHI for Scientific Research (C) [grant number 20K11976] to HN. It was partially supported by JST CREST [grant number JPMJCR17A4].
Acknowledgments
The authors would like to thank Dr. Fatemeh Hadaeghi for useful discussion of the numerical simulations.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AbreuT.BragançaM. (2015). The bipolarity of light and dark: a review on bipolar disorder and circadian cycles. J. Affect. Disord.185, 219–229. 10.1016/j.jad.2015.07.017
2
AlbrechtU. (2013). Circadian clocks and mood-related behaviors, in Circadian Clocks, eds KramerA.MerrowM. (Berlin; Heidelberg: Springer), 227–239. 10.1007/978-3-642-25950-0_9
3
AnishchenkoV. S.AstakhovV.NeimanA.VadivasovaT.Schimansky-GeierL. (2007). Nonlinear Dynamics of Chaotic and Stochastic Systems: Tutorial and Modern Developments.Berlin; Heidelberg: Springer Science & Business Media.
4
ArnoneD. (2019). Functional MRI findings, pharmacological treatment in major depression and clinical response. Prog. Neuro Psychopharmacol. Biol. Psychiatry91, 28–37. 10.1016/j.pnpbp.2018.08.004
5
BaskaranA.MilevR.McIntyreR. S. (2012). The neurobiology of the eeg biomarker as a predictor of treatment response in depression. Neuropharmacology63, 507–513. 10.1016/j.neuropharm.2012.04.021
6
BayaniA.HadaeghiF.JafariS.MurrayG. (2017). Critical slowing down as an early warning of transitions in episodes of bipolar disorder: a simulation study based on a computational model of circadian activity rhythms. Chronobiol. Int.34, 235–245. 10.1080/07420528.2016.1272608
7
BaysalV.SaraçZ.YilmazE. (2019). Chaotic resonance in Hodgkin–Huxley neuron. Nonlinear Dyn.97, 1275–1285. 10.1007/s11071-019-05047-w
8
BonsallM. B.Wallace-HadrillS. M.GeddesJ. R.GoodwinG. M.HolmesE. A. (2011). Nonlinear time-series approaches in characterizing mood stability and mood instability in bipolar disorder. Proc. R. Soc. B Biol. Sci.279, 916–924. 10.1098/rspb.2011.1246
9
BrambillaP.PerezJ.BaraleF.SchettiniG.SoaresJ. (2003). Gabaergic dysfunction in mood disorders. Mol. Psychiatry8, 721–737. 10.1038/sj.mp.4001362
10
CainS. W.RawashdehO. A.SiuM.KimS. C.RalphM. R. (2017). Dopamine dependent setting of a circadian oscillator underlying the memory for time of day. Neurobiol. Learn. Memory141, 78–83. 10.1016/j.nlm.2017.03.015
11
CastanedaT. R.de PradoB. M.PrietoD.MoraF. (2004). Circadian rhythms of dopamine, glutamate and GABA in the striatum and nucleus accumbens of the awake rat: modulation by light. J. Pineal Res.36, 177–185. 10.1046/j.1600-079X.2003.00114.x
12
ChiapponiC.PirasF.PirasF.CaltagironeC.SpallettaG. (2016). Gaba system in schizophrenia and mood disorders: a mini review on third-generation imaging studies. Front. Psychiatry7:61. 10.3389/fpsyt.2016.00061
13
CroceP.QuerciaA.CostaS.ZappasodiF. (2018). Circadian rhythms in fractal features of EEG signals. Front. Physiol.9:1567. 10.3389/fphys.2018.01567
14
DaughertyD.Roque-UrreaT.Urrea-RoqueJ.TroyerJ.WirkusS.PorterM. A. (2009). Mathematical models of bipolar disorder. Commun. Nonlinear Sci. Num. Simul.14, 2897–2908. 10.1016/j.cnsns.2008.10.027
15
DrevetsW. C. (2000). Neuroimaging studies of mood disorders. Biol. Psychiatry48, 813–829. 10.1016/S0006-3223(00)01020-9
16
EndersL. R.HurP.JohnsonM. J.SeoN. J. (2013). Remote vibrotactile noise improves light touch sensation in stroke survivors' fingertips via stochastic resonance. J. Neuroeng. Rehabil.10:105. 10.1186/1743-0003-10-105
17
GlennT.WhybrowP. C.RasgonN.GrofP.AldaM.BaethgeC.et al. (2006). Approximate entropy of self-reported mood prior to episodes in bipolar disorder. Bipolar Disord.8, 424–429. 10.1111/j.1399-5618.2006.00373.x
18
GoldbeterA. (1995). A model for circadian oscillations in the drosophila period protein (per). Proc. R. Soc. Lond. Ser. B Biol. Sci.261, 319–324. 10.1098/rspb.1995.0153
19
GonzálezJ.CavelliM.MondinoA.PascovichC.Castro-ZaballaS.TorteroloP.et al. (2019). Decreased electrocortical temporal complexity distinguishes sleep from wakefulness. Sci. Rep.9, 1–9. 10.1038/s41598-019-54788-6
20
HadaeghiF.Hashemi GolpayeganiM. R.GharibzadehS. (2013a). What is the mathematical description of the treated mood pattern in bipolar disorder?Front. Comput. Neurosci.7:106. 10.3389/fncom.2013.00106
21
HadaeghiF.Hashemi GolpayeganiM. R.JafariS.MurrayG. (2016). Toward a complex system understanding of bipolar disorder: a chaotic model of abnormal circadian activity rhythms in euthymic bipolar disorder. Austral. N. Z. J. Psychiatry50, 783–792. 10.1177/0004867416642022
22
HadaeghiF.Hashemi GolpayeganiM. R.MoradiK. (2013b). Does crisis-induced intermittency explain bipolar disorder dynamics?Front. Comput. Neurosci.7:116. 10.3389/fncom.2013.00116
23
HamppG.RippergerJ. A.HoubenT.SchmutzI.BlexC.Perreau-LenzS.et al. (2008). Regulation of monoamine oxidase a by circadian-clock components implies clock influence on mood. Curr. Biol.18, 678–683. 10.1016/j.cub.2008.04.012
24
HaslerG.van der VeenJ. W.TumonisT.MeyersN.ShenJ.DrevetsW. C. (2007). Reduced prefrontal glutamate/glutamine and γ-aminobutyric acid levels in major depression determined using proton magnetic resonance spectroscopy. Arch. Gen. Psychiatry64, 193–200. 10.1001/archpsyc.64.2.193
25
HerzogE. D. (2007). Neurons and networks in daily rhythms. Nat. Rev. Neurosci.8, 790–802. 10.1038/nrn2215
26
HirschfeldR.CalabreseJ. R.WeissmanM. M.ReedM.DaviesM. A.FryeM. A.et al. (2003). Screening for bipolar disorder in the community. J. Clin. Psychiatry64, 53–59. 10.4088/jcp.v64n0111
27
JiangW.Guo-DongQ.BinD. (2005). H8 variable universe adaptive fuzzy control for chaotic system. Chaos Solitons Fractals24, 1075–1086. 10.1016/j.chaos.2004.09.056
28
KesslerR. C.BerglundP.DemlerO.JinR.KoretzD.MerikangasK. R.et al. (2003). The epidemiology of major depressive disorder: results from the national comorbidity survey replication (NCS-R). JAMA289, 3095–3105. 10.1001/jama.289.23.3095
29
KuritaY.ShinoharaM.UedaJ. (2013). Wearable sensorimotor enhancer for fingertip based on stochastic resonance effect. IEEE Trans. Hum. Mach. Syst.43, 333–337. 10.1109/TSMC.2013.2242886
30
KuritaY.SuedaY.IshikawaT.HattoriM.SawadaH.EgiH.et al. (2016). Surgical grasping forceps with enhanced sensorimotor capability via the stochastic resonance effect. IEEE/ASME Trans. Mechatron.21, 2624–2634. 10.1109/TMECH.2016.2591591
31
KurosawaG.AiharaK.IwasaY. (2006). A model for the circadian rhythm of cyanobacteria that maintains oscillation without gene expression. Biophys. J.91, 2015–2023. 10.1529/biophysj.105.076554
32
LeibenluftE.TurnerE. H.Feldman-NaimS.SchwartzP. J.WehrT. A.RosenthalN. E. (1995). Light therapy in patients with rapid cycling bipolar disorder: preliminary results. Psychopharmacol. Bull.31, 705–710.
33
López-MuñozF.VietaE.RubioG.García-GarcíaP.AlamoC. (2006). Bipolar disorder as an emerging pathology in the scientific literature: a bibliometric approach. J. Affect. Disord.92, 161–170. 10.1016/j.jad.2006.02.006
34
MaJ.TangJ. (2017). A review for dynamics in neuron and neuronal network. Nonlinear Dyn.89, 1569–1578. 10.1007/s11071-017-3565-3
35
MontagueP. R.DolanR. J.FristonK. J.DayanP. (2012). Computational psychiatry. Trends Cogn. Sci.16, 72–80. 10.1016/j.tics.2011.11.018
36
MooreP. J.LittleM. A.McSharryP. E.GoodwinG. M.GeddesJ. R. (2014). Mood dynamics in bipolar disorder. Int. J. Bipolar Disord.2:11. 10.1186/s40345-014-0011-z
37
NakajimaH. (1997). On analytical properties of delayed feedback control of chaos. Phys. Lett. A232, 207–210. 10.1016/S0375-9601(97)00362-9
38
NishimuraH.KatadaN.AiharaK. (2000). Coherent response in a chaotic neural network. Neural Process. Lett.12, 49–58. 10.1023/A:1009626028831
39
NobukawaS.DohoH.ShibataN.NishimuraH.YamanishiT. (2020). Chaos-chaos intermittency synchronization controlled by external feedback signals in Chua's circuits. IEICE Trans. Fundamentals Electron. Commun. Comput. Sci. (Cham), 103, 303–312. 10.1587/transfun.2019EAP1081
40
NobukawaS.NishimuraH. (2016). Chaotic resonance in coupled inferior olive neurons with the Llinás approach neuron model. Neural Comput.28, 2505–2532. 10.1162/NECO_a_00894
41
NobukawaS.NishimuraH. (2020). Synchronization of chaos in neural systems. Front. Appl. Math. Stat.6:19. 10.3389/fams.2020.00019
42
NobukawaS.NishimuraH.YamanishiT. (2016). Evaluation of chaotic resonance by Lyapunov exponent in attractor-merging type systems, in International Conference on Neural Information Processing (Springer), 430–437.
43
NobukawaS.NishimuraH.YamanishiT. (2017). Chaotic resonance in typical routes to chaos in the Izhikevich neuron model. Sci. Rep.7, 1–9. 10.1038/s41598-017-01511-y
44
NobukawaS.NishimuraH.YamanishiT. (2018a). Routes to chaos induced by a discontinuous resetting process in a hybrid spiking neuron model. Sci. Rep.8, 1–11. 10.1038/s41598-017-18783-z
45
NobukawaS.NishimuraH.YamanishiT.DohoH. (2018b). Controlling chaotic resonance in systems with chaos-chaos intermittency using external feedback. IEICE Trans. Fundamentals Electron. Commun. Comput. Sci.101, 1900–1906. 10.1587/transfun.E101.A.1900
46
NobukawaS.NishimuraH.YamanishiT.DohoH. (2019a). Induced synchronization of chaos-chaos intermittency maintaining asynchronous state of chaotic orbits by external feedback signals. IEICE Trans. Fundamentals Electron. Commun. Comput. Sci.102, 524–531. 10.1587/transfun.E102.A.524
47
NobukawaS.ShibataN. (2019). Controlling chaotic resonance using external feedback signals in neural systems. Sci. Rep.9:4990. 10.1038/s41598-019-41535-0
48
NobukawaS.ShibataN.NishimuraH.DohoH.WagatsumaN.YamanishiT. (2019b). Resonance phenomena controlled by external feedback signals and additive noise in neural systems. Sci. Rep.9, 1–15. 10.1038/s41598-019-48950-3
49
OttE.GrebogiC.YorkeJ. A. (1990). Controlling chaos. Phys. Rev. Lett.64:1196. 10.1103/PhysRevLett.64.1196
50
ParkerT. S.ChuaL. (2012). Practical Numerical Algorithms for Chaotic Systems.New York, NY: Springer Science & Business Media.
51
PavlidisT. (1969). Populations of interacting oscillators and circadian rhythms. J. Theoret. Biol.22, 418–436. 10.1016/0022-5193(69)90014-9
52
PavlidisT. (2012). Biological Oscillators: Their Mathematical Analysis.Amsterdam: Elsevier.
53
PikovskyA.RosenblumM.KurthsJ. (2003). Synchronization: A Universal Concept in Nonlinear Sciences, Vol. 12. Cambridge: Cambridge University Press.
54
PriceJ. L.DrevetsW. C. (2010). Neurocircuitry of mood disorders. Neuropsychopharmacology35, 192–216. 10.1038/npp.2009.104
55
PyragasK. (1992). Continuous control of chaos by self-controlling feedback. Phys. Lett. A170, 421–428. 10.1016/0375-9601(92)90745-8
56
RajasekarS.SanjuánM. A. F. (2016). Nonlinear Resonances.Cham: Springer.
57
SanacoraG.TreccaniG.PopoliM. (2012). Towards a glutamate hypothesis of depression: an emerging frontier of neuropsychopharmacology for mood disorders. Neuropharmacology62, 63–77. 10.1016/j.neuropharm.2011.07.036
58
SchloesserR. J.MartinowichK.ManjiH. K. (2012). Mood-stabilizing drugs: mechanisms of action. Trends Neurosci.35, 36–46. 10.1016/j.tins.2011.11.009
59
SchöllE.SchusterH. G. (2008). Handbook of Chaos Control. Vol. 2. Weinheim: Wiley Online Library.
60
SeoN. J.KosmopoulosM. L.EndersL. R.HurP. (2014). Effect of remote sensory noise on hand function post stroke. Front. Hum. Neurosci.8:934. 10.3389/fnhum.2014.00934
61
SinhaS. (1999). Noise-free stochastic resonance in simple chaotic systems. Phys. A Stat. Mech. Appl.270, 204–214. 10.1016/S0378-4371(99)00136-3
62
SitD.WisnerK. L.HanusaB. H.StullS.TermanM. (2007). Light therapy for bipolar disorder: a case series in women. Bipolar Disord.9, 918–927. 10.1111/j.1399-5618.2007.00451.x
63
TermanM.TermanJ. S. (2005). Light therapy for seasonal and nonseasonal depression: efficacy, protocol, safety, and side effects. CNS Spectrums10, 647–663. 10.1017/S1092852900019611
64
The Wellcome Trust Case Control Consortium (2007). Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls. Nature447:661. 10.1038/nature05911
65
TobeB. T.CrainA. M.WinquistA. M.CalabreseB.MakiharaH.ZhaoW.-N.et al. (2017). Probing the lithium-response pathway in hipscs implicates the phosphoregulatory set-point for a cytoskeletal modulator in bipolar pathogenesis. Proc. Natl. Acad. Sci. U.S.A.114, E4462–E4471. 10.1073/pnas.1700111114
66
TretterF.Gebicke-HaerterP.An der HeidenU.RujescuD.MewesH.TurckC. (2011). Affective disorders as complex dynamic diseases–a perspective from systems biology. Pharmacopsychiatry44, S2–S8. 10.1055/s-0031-1275278
67
VargasC.López-JaramilloC.VietaE. (2013). A systematic literature review of resting state network-functional MRI in bipolar disorder. J. Affect. Disord.150, 727–735. 10.1016/j.jad.2013.05.083
68
WeberM.LauterburgT.ToblerI.BurgunderJ.-M. (2004). Circadian patterns of neurotransmitter related gene expression in motor regions of the rat brain. Neurosci. Lett.358, 17–20. 10.1016/j.neulet.2003.12.053
69
WeinerN.ClementH.-W.GemsaD.WesemannW. (1992). Circadian and seasonal rhythms of 5-ht receptor subtypes, membrane anisotropy and 5-ht release in hippocampus and cortex of the rat. Neurochem. Int.21, 7–14. 10.1016/0197-0186(92)90062-V
70
YeraganiV. K.PohlR.MallavarapuM.BalonR. (2003). Approximate entropy of symptoms of mood: an effective technique to quantify regularity of mood. Bipolar Disord.5, 279–286. 10.1034/j.1399-5618.2003.00012.x
Summary
Keywords
bipolar disorder, neural network, chaotic resonance, feedback control, chaos-chaos intermittency, chronotherapy
Citation
Doho H, Nobukawa S, Nishimura H, Wagatsuma N and Takahashi T (2020) Transition of Neural Activity From the Chaotic Bipolar-Disorder State to the Periodic Healthy State Using External Feedback Signals. Front. Comput. Neurosci. 14:76. doi: 10.3389/fncom.2020.00076
Received
16 May 2020
Accepted
20 July 2020
Published
28 August 2020
Volume
14 - 2020
Edited by
Tianyi Yan, Beijing Institute of Technology, China
Reviewed by
Ergin Yilmaz, Bulent Ecevit University, Turkey; Adam Ponzi, Okinawa Institute of Science and Technology Graduate University, Japan
Updates
Copyright
© 2020 Doho, Nobukawa, Nishimura, Wagatsuma and Takahashi.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Sou Nobukawa nobukawa@cs.it-chiba.ac.jp
†These authors have contributed equally to this work
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.