Abstract
This paper investigates the Hamiltonian energy of a modified Hindmarsh–Rose (HR) model to observe its effect on short-term memory. A Hamiltonian energy function and its variable function are given in the reduced system with a single node according to Helmholtz’s theorem. We consider the role of the coupling strength and the links between neurons in the pattern formation to show that the coupling and cooperative neurons are necessary for generating the fire or a clear short-term memory when all the neurons are in sync. Then, we consider the effect of the degree and external stimulus from other neurons on the emergence and disappearance of short-term memory, which illustrates that generating short-term memory requires much energy, and the coupling strength could further reduce energy consumption. Finally, the dynamical mechanisms of the generation of short-term memory are concluded.
1 Introduction
Short-term memory is a primary cognitive function of the brain. The transitions between the spontaneous and persistent states could lead to the emergence and disappearance of short-term memory in a bistable system (. Continuous neural activity without external inputs was deemed an expression of short-term memory (. A phenomenological model of spatial working memory was developed to examine the dynamical interactions of multiple feedback mechanisms (. A growing body of evidence suggests memories may be kept through the mutual effect of persistent neural activity and activity-silent dynamics (; . Gaussian noise was treated as an essential factor in neuronal activity and its toggle switch (memory maintenance) (Zheng et al., 2020b). Memory maintenance through persistent neural activity and a synaptic mechanism was compared in mice and two types of artificial neural networks to show their differences (. Then, computational modeling was constructed to prove how the circuits and networks affect working memory, which provides a novel theory for memory maintenance (. In addition, the encoding style of the input information of the short-term memory was investigated to illustrate the dynamical mechanisms of short-term memory (; ; Zhou et al., 2023). Hamilton energy, representing the utilization of energy (actual energy in the generation of short-term memory), should be considered to illustrate the dynamic mechanism of the generation of short-term memory.
Hindmarsh–Rose (HR) model (1) (x is the membrane potential, y is the recovery variable of the fast current of K+ or Na+, and z is the adaptation variable of the slow current of Ca+ or other ions) was proposed to show the membrane potential of neuronal activity (, which has rich dynamical behaviors (; ; ).
The synchronization and bifurcation (; ; ; Zheng et al. 2020a; Zheng et al. 2024; Zheng et al. 2023) of the HR model were often studied to demonstrate the dynamical mechanism of chaotic bursting or spikes (; Wu et al., 2016; You, 2023a). The interplay between neurons was analyzed to present the effect of the parameters and coupling strength on the appropriate functioning of the system (; ; You, 2023b). Energy is necessary for neuron activity (. The Hamiltonian energy function is a vital tool to evaluate energy consumption when neurons are active (. The average energy consumption of the HR model was given to display the energy consumption ratio in different situations, which could help optimize energy use (; ; . The Hamilton energy balance of different functional neurons was discussed through the coupling strength, which contributes to designing functional assistive devices (Zhang et al., 2022; Yu et al., 2023). Although the HR model could explain the generation of short-term memory (Zheng et al., 2022), the utilization of energy should be further stated in short-term memory.
Short-term memory results from neuronal activity coming with a change in energy, and a physical neuron circuit plays a vital role in the synergistic effect of neurons and the generation of short-term memory. In this paper, the pattern formation of a modified HR model is investigated to find the dynamical mechanism of how the coupling strength and links (degree) affect the generation of short-term memory. The Hamiltonian energy function is derived in the HR model with a single node, which means the energy consumption varies at different states of neuronal activity. Then, the degree and stimuli from other neurons are studied through bifurcation, which means the energy is necessary to generate short-term memory. Finally, the related dynamical and biological mechanisms are obtained.
2 Model description
As the membrane potential of neurons is often coupled with others, the following network-organized HR model is introduced:
where xi is the membrane potential, I represents the ith neuron and i = 1, … , n, yi is the recovery variable of the fast current of K+ or Na+, and zi is the adaptation variable of the slow current of Ca+ or other ions. D1 is the coupling strength between neurons. Lij(t) = Aij – δijki, where Aij is the adjacent matrix and ki is the degree of the ith node.
In order to obtain the Hamiltonian energy function of system (2), we consider a simplified model with a single node through the mean-field approach (. The reduced system is
where (x0, y0, z0) (Zheng et al., 2022) is the equilibrium point of system (2) without a network, and x0 makes Iext = f(x) = −c + dx2 + ax3 − bx2 + s (x − xr) + Iext + d1ki (x0 − xi) hold. In addition, x0 is the external stimulus from other neurons.
In this paper, we mainly investigate the dynamical behaviors of system (3) and its Hamiltonian equation. According to Helmholtz’s theorem (, an autonomous ordinary differential equation (F(X) can be treated as the velocity vector field) can be described in the usual forms of a Hamiltonian equation:
where G(X) is a skew-symmetric matrix in the Hamiltonian system. If G(X) is not a skew-symmetric matrix in a generalized Hamiltonian system, G(X) can be divided into two parts G(X) = G1(X) + G2(X): a skew-symmetric matrix G1(X) and a symmetric matrix G2(X) (. H(X) is an energy function. Then, we have
For the network-organized HR model (3), it can be written as (; ; ; whereFurthermore, we obtain the Hamiltonian energy function as (Zhang et al., 2022)Namely,where a general solution can be expressed asand
3 Numerical results and discussion
In this section, the finite difference method is applied to find numerical solutions for the network-organized HR model (3) with time step dt = 0.01. These parameters a = 1, b = 3, c = 1, d = 5, r = 0.01, s = 4 are set (Zheng et al., 2022). The small-world network is constructed with W (n, K, p) (the number of node n, nearest neighbor K, and reconnection probability p), which can be found can be found at https://github.com/zhengqianqian35/network-code. We give the concept of the average Hamiltonian energy for time and nodes:
where the integration period is set at T = 5,000 time units. In order to exclude the influence of initial conditions, t0 is the starting time of the cycle after the system tends to a stable state. In addition, we assume H = H (xi, yi, zi)/100. From Figure 1, only one real equilibrium point (x0, y0, z0) exists in system (1) when a = 1, b = 3, c = 1, d = 5, r = 0.01, s = 4, which guarantees the uniqueness of system (3).
FIGURE 1
In general, the generation of neural function results from the collaboration of multiple neurons. Therefore, we consider the strength d1 of the coupling between neurons and the number of links K. First, a small-world network with W (100, 8, 0.01) is given. The pattern formation is chaotic (Figure 2A) when the strength d = 0.01 is weak, which means the nervous system does not work. The pattern formation starts to become clear and tends to sync with the increase of d1 (Figure 2b,c). Ultimately, the pattern formation becomes synchronized; namely, all the neurons become completely phase synchronized (Figure 2D). The short-term memory needs to be clarified when d1 is weak. Only when all the neurons work perfectly together is a clear short-term memory formed (Figure 2), which is also the mechanism by which adequate short-term memory is produced.
FIGURE 2
Then, the number of cooperative neurons will be considered to generate short-term memory. The links between neurons can be treated as the number of collaborative neurons in our analysis, which could be measured by K. When K is small, the pattern formation is chaotic, and every neuron is relatively independent (Figure 3A). This condition is not suitable for the generation of short-term memory. When K = 2, the pattern formation shows some neurons are in sync (Figure 3B); namely, multiple short-term memories are produced simultaneously. In this case, short-term memory is often fuzzy. The short-term memory gradually becomes clear when K becomes large (Figure 3C). Eventually, multiple neurons work together to form a clear short-term memory when all the neurons are in sync (Figure 3D).
FIGURE 3
Finally, it is found that the link probability does not work because p cannot change the number of cooperative neurons and the coupling strength.
3.1 Hamiltonian energy with external stimulus
System (3) can be written as
where Di = d1ki (d1 = 0.01), and the effect of x0 is similar to Iext when Di is a constant. Iext and the coupling strength play a vital role in the electrical activity, which is the basis of the generation of fire. Therefore, we consider the role of Iext and Di in the Hamiltonian energy, change in Hamiltonian energy, and membrane potential when x0 = 1.
It is well known that the coupling between neurons is necessary for generating fire or short-term memory (Figure 2). Because only the ith neuron evolutes with system (4), and other neurons are fixed at (x0, y0, z0), Di can also be regarded as the size of the network degree. When the coupling strength is small, or the number of links is few, no spike or memory is generated; namely, the neurons are resting (Figure 4A). The membrane potential began to change periodically with the increase in Di, which means the emergence and disappearance of short-term memory (Figure 4B). Meanwhile, the Hamiltonian energy and change in Hamiltonian energy change with the membrane potential, which means the generation of the short-term memory takes more energy. However, short-term memory is the result of multiple neurons working together. If one neuron is very tightly connected to other neurons, all the neurons will tend to be in one state because other neurons are fixed at (x0, y0, z0). Namely, system (4) of a neuron will tend to a stable state when Di is larger (Figure 4C).
FIGURE 4
Next, we show the continuous changes in x, H1, H2 with Di (Figure 5). From Figure 5A, the bifurcation occurs with the increase in Di. The average Hamiltonian energy decreases gradually at the beginning because the utilization of energy is relatively low when the neuron is in a resting state (Figure 5B). When the membrane potential is periodic, the average Hamiltonian energy will be a sudden increase (Figure 5B). Meanwhile, the rise of coupling strength also reduces the consumption of Hamiltonian energy, which is why the average Hamiltonian energy decreases with Di (Figure 5B). It is found that the max–min value of Hamiltonian energy (Figure 5C) and its variation (Figure 5D) is significantly associated with the bifurcation, which is essential to show the relationship between the consumption of energy and the membrane potential (the generation of short-term memory). In a word, generating short-term memory will take a lot of energy, and the coupling strength could further reduce energy consumption.
FIGURE 5
The role of x0 from other neurons’ external stimulus (; ; is the same as Iext when other parameters are fixed. When the external stimulation of other neurons contributing to the ith neuron is weak, system (4) (the Hamiltonian energy, change in Hamiltonian energy, and membrane potential) is stable (Figure 4A). The periodical spike occurs (Figure 6A) in the membrane potential when x0 increases, which corresponds to the emergence and disappearance of short-term memory. It is found that energy consumption is relatively large in preparation for the spike, and the energy varies significantly in the spike (Figure 6A), which can be treated as an indicator of the generation of the spike (short-term memory). The frequency of spikes will increase (Figure 6B) when external stimuli are enhanced. However, it is insufficient to support two identical spikes of membrane potential x (Figure 6B) due to the lack of external stimulus or the Hamiltonian energy H (Figure 6B). Therefore, the formation of short-term memory requires a process of accumulating energy, and the energy breaks out when a spike occurs. The more energy accumulates, the greater the energy change (Ht). If x0 continues to increase, there will be more spikes, but their intensity is different (Figure 6C). A constant spike is created when x0 is very large (Figure 6D), which is also the ordinary emergence and disappearance of short-term memory. However, the external stimulus from other neurons will inhibit the generation of the spike and put the ith neuron in a resting state (Figure 7A). From Figure 7, the spike is impossible without extensive external energy input, and it has excellent fluctuations at the beginning (Figure 7A). We find the average Hamiltonian energy increases with x0 (Figure 7B). The max–min value of Hamiltonian energy (Figure 7C) and the max–min value of Hamiltonian energy variation (Figure 7D) are consistent with the bifurcation of x.
FIGURE 6
FIGURE 7
Finally, we conclude the dynamical mechanism of the generation of short-term memory: the energy from other neurons is necessary for short-term memory, proving that short-term memory results from multiple neuronal activities. Energy requires a process of accumulation to maintain a complete spike. The excessive influence of other neurons can make the ith neurons lose their dominance and align with the dynamic behaviors of other neurons.
4 Conclusion
Energy plays a vital role in neuronal activity, which is the basis of the generation of short-term memory. In this paper, the pattern formation could represent the collecting dynamics of short-term memory through the Hamiltonian energy, showing the neuronal activity in generating short-term memory. Therefore, the interplay between neurons is considered through a simple network to show the effect of the external stimulus and coupling strength (degree) on the dynamical behaviors. It is found that the Hamiltonian energy, change in the Hamiltonian energy, and membrane potential are consistent. The excessive influence of other neurons can make the ith neurons lose their dominance and align with the dynamic behaviors of other neurons, which could show the synergistic effect of neurons through a physical neuron circuit. In addition, the energy from other neurons is necessary for short-term memory, proving that short-term memory results from multiple neuronal activities. Generating short-term memory requires much energy, and energy requires a process of accumulation to maintain a complete spike. Meanwhile, the coupling strength could further reduce energy consumption, which provides a novel way to reduce the energy consumption in information storage and processing. However, more short-term memory descriptions should be completed next.
Statements
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material; further inquiries can be directed to the corresponding authors.
Author contributions
QZ: writing–original draft and writing–review and editing. YX: writing–original draft and writing–review and editing. JS: writing–original draft and writing–review and editing.
Funding
The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This work was supported by the National Natural Science Foundation of China (12002297 and 12272135), Basic Research Project of Universities in Henan Province (21zx009), Program for Science & Technology Innovation Talents in Universities of Henan Province (22HASTIT018), Funding of Henan Province for merit-based overseas students (2023), Outstanding Young Backbone Teacher of Xuchang University (2022), and Training Program for Young Key Teachers in Colleges and Universities of Henan Province (2023GGJS144). Natural Science Foundation of Henan (242300421396).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1
AmitD. J.BrunelN. (1997). Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cereb. Cortex7, 237–252. 10.1093/cercor/7.3.237
2
AttwellD.LaughlinS. B. (2001). An energy budget for signaling in the grey matter of the brain. J. Cerebr. Blood F. Mater.21, 1133–1145. 10.1097/00004647-200110000-00001
3
BarbosaJ.SteinH.MartinezR. L.Galan-GadeaA.LiS.DalmauJ.et al (2020). Interplay between persistent activity and activity-silent dynamics in the prefrontal cortex underlies serial biases in working memory. Nat. Neurosci.23, 1016–1024. 10.1038/s41593-020-0644-4
4
CarterE.WangX. (2007). Cannabinoid-mediated disinhibition and working memory: dynamical interplay of multiple feedback mechanisms in a continuous attractor model of prefrontal cortex. Cereb. Cortex17, 16–26. 10.1093/cercor/bhm103
5
DonaldH.RoseR. (1986). Helmholtz’s theorem revisited. Am. J. Phys.54, 552–554. 10.1119/1.14562
6
DuX.XuY.LiuQ.LiuC.YueX.LiuX.et al (2024). Shimmy dynamics in a dual-wheel nose landing gear with freeplay under stochastic wind disturbances. Nonlinear Dynam112, 2477–2499. 10.1007/s11071-023-09182-3
7
GhazizadehE.ChingS. (2020). Slow manifolds within network dynamics encode working memory efficiently and robustly. PLoS Comput. Biol.17, e1009366. 10.1371/journal.pcbi.1009366
8
HindmarshJ.RoseR. (1982). A model of the nerve impulse using two first-order differential equations. Nature296, 162–164. 10.1038/296162a0
9
HuB.GarrettM. E.GroblewskiP. A.OllerenshawD. R.ShangJ.RollK.et al (2021). Adaptation supports short-term memory in a visual change detection task. PLoS Comput. Biol.17, e1009246. 10.1371/journal.pcbi.1009246
10
IchikawaK.KanekoK. (2021). Short-term memory by transient oscillatory dynamics in recurrent neural networks. Phys. Rev. Res.3, 033193. 10.1103/physrevresearch.3.033193
11
JonesB.ChingS. (2022). Synthesizing network dynamics for short-term memory of impulsive inputs. Proc. IEEE Conf. Decis. Control2022, 6836–6841. 10.1109/cdc51059.2022.9993238
12
KumarR. S.SugumaranG.RajaR.ZhuQ.RajaU. K. (2016). New stability criterion of neural networks with leakage delays and impulses: a piecewise delay method. Cogn. Neurodynamics10, 85–98. 10.1007/s11571-015-9356-y
13
LepekM.FronczakP. (2018). Spatial evolution of hindmarsh-rose neural network with time delays. Nonlinear Dyn.92, 751–761. 10.1007/s11071-018-4088-2
14
LiY.SuleimanK.XuY. (2024a). Anomalous diffusion, non-gaussianity, nonergodicity, and confinement in stochastic-scaled brownian motion with diffusing diffusivity dynamics. Phys. Rev. E109, 014139. 10.1103/PhysRevE.109.014139
15
LiY.ZhuQ.XuY.TianR. (2024b). Enhanced fault diagnosis via stochastic resonance in a piecewise asymmetric bistable system. Chaos34, 011101. 10.1063/5.0188335
16
LiebovitchL. S.NormanM. D.SuJ.GottmanJ. M. (2011). Mathematical model of the dynamics of psychotherapy. Cogn. Neurodynamics5, 265–275. 10.1007/s11571-011-9157-x
17
McCullenN.WagenknechtT. (2016). Pattern formation on networks: from localised activity to turing patterns. Sci. Rep.-UK6, 27397–27398. 10.1038/srep27397
18
RajagopalK.KhalafA. J.ParasteshF.MorozI.KarthikeyanA.JafariS. (2019). Dynamical behavior and network analysis of an extended hindmarsh-rose neuron model. Nonlinear Dyn.98, 477–487. 10.1007/s11071-019-05205-0
19
SarasolaC.TorrealdeaF. J.d’AnjouA.MoujahidA.GranaM. (2004). Energy balance in feedback synchronization of chaotic systems. Phys. Rev. E69, 011606. 10.1103/PhysRevE.69.011606
20
ShiX.WangZ. (2012). Adaptive synchronization of time delay hindmarsh-rose neuron system via self-feedback. Nonlinear Dyn.69, 2147–2153. 10.1007/s11071-012-0415-1
21
SongX.JinW.MaJ. (2015). Energy dependence on the electric activities of a neuron. Chin. Phys. B24, 128710. 10.1088/1674-1056/24/12/128710
22
SongZ. G.XuJ. (2013). Stability switches and double hopf bifurcation in a two-neural network system with multiple delays. Cogn. Neurodynamics3, 505–521. 10.1007/s11571-013-9254-0
23
StokesM. (2015). Activity-silent working memory in prefrontal cortex: a dynamic coding framework. Trends Cogn. Sci.19, 394–405. 10.1016/j.tics.2015.05.004
24
TorrealdeaF. J.d AnjouA.GranaM.SarasolaC. (2006). Energy aspects of the synchronization of model neurons. Phys. Rev. E74, 011905. 10.1103/PhysRevE.74.011905
25
TorrealdeaF. J.SarasolaC.d AnjouA. (2009). Energy consumption and information transmission in model neurons. Chaos Solit. Fract.40, 60–68. 10.1016/j.chaos.2007.07.050
26
UshaK.SubhaP. A. (2019). Energy feedback and synchronous dynamics of hindmarsh-rose neuron model with memristor. Chin. Phys. B28, 020502. 10.1088/1674-1056/28/2/020502
27
WangX. (2001). Synaptic reverberation underlying mnemonic persistent activity. Trends Neurosci.24, 455–463. 10.1016/s0166-2236(00)01868-3
28
WangZ.LiY.XuY.KapitaniakT.KurthsJ. (2022). Coherence-resonance chimeras in coupled hr neurons with alpha-stable levy noise. J. Stat. Mech-Theory E.2022, 053501–053515. 10.1088/1742-5468/ac6254
29
WangZ.XuY.LiY.KapitaniakT.KurthsJ. (2021a). Chimera states in coupled hindmarsh-rose neurons with α-stable noise. Chaos Solit. Fract.148, 110976. 10.1016/j.chaos.2021.110976
30
WangZ.XuY.LiY.KurthsJ. (2021b). The probability density function of interspike intervals in an fhn model with α-stable noise. Eur. Phys. J. Plus136, 299–314. 10.1140/epjp/s13360-021-01245-x
31
WuK.LuoT.LuH.WangY. (2016). Bifurcation study of neuron firing activity of the modified hindmarsh-rose model. Neural comput. applic.27, 739–747. 10.1007/s00521-015-1892-1
32
YouY. (2023a). Exponential synchronization of memristive hindmarsh-rose neural networks. Nonlinear Anal-Real73, 103909. 10.1016/j.nonrwa.2023.103909
33
YouY. (2023b). Global dynamics of diffusive hindmarsh-rose equations with memristors. Nonlinear Anal-Real71, 103827. 10.1016/j.nonrwa.2022.103827
34
YuX.BaoH.ChenM.BaoB. (2023). Energy balance via memristor synapse in morris-lecar two-neuron network with fpga implementation. Chaos Solit. Fract.171, 113442. 10.1016/j.chaos.2023.113442
35
ZhangL.XiongL.AnX.ShiQ. (2022). Hamilton energy balance and synchronization behaviors of two functional neurons. Cogn. Neurodynamics2022, 1683–1702. 10.1007/s11571-022-09908-w
36
ZhengQ.ShenJ.PandeyV.GuanL.GuoY. (2023). Turing instability in a network-organized epidemic model with delay. Chaos Solit. Fract.168, 113205. 10.1016/j.chaos.2023.113205
37
ZhengQ.ShenJ.PandeyV.YuanX.GuanL. (2024). Pattern selection mechanism from the equilibrium point and limit cycle. Chaos32, 023124. 10.1063/5.0187810
38
ZhengQ.ShenJ.XuY. (2020a). Turing instability in the reaction-diffusion network. Phys. Rev. E102, 062215. 10.1103/PhysRevE.102.062215
39
ZhengQ.ShenJ.XuY. (2020b). Spontaneous activity induced by Gaussian noise in the network organized fitzhugh-nagumo model. Nat. Neurosci.2020, 1–12. 10.1155/2020/6651441
40
ZhengQ.ShenJ.ZhangR.GuanL.XuY. (2022). Spatiotemporal patterns in a general networked hindmarsh-rose model. Front. Physiol.13, 1–9. 10.3389/fphys.2022.936982
41
ZhouS.SeayM.TaxidisJ.GolshaniP.BuonomanoD. V. (2023). Multiplexing working memory and time in the trajectories of neural networks. Nat. Hum. Behav.7, 1170–1184. 10.1038/s41562-023-01592-y
Summary
Keywords
HR, pattern formation, network, matrix, Turing instability, delay
Citation
Zheng Q, Xu Y and Shen J (2024) Hamiltonian energy in a modified Hindmarsh–Rose model. Front. Netw. Physiol. 4:1362778. doi: 10.3389/fnetp.2024.1362778
Received
29 December 2023
Accepted
04 March 2024
Published
26 March 2024
Volume
4 - 2024
Edited by
Eckehard Schöll, Technical University of Berlin, Germany
Updates
Copyright
© 2024 Zheng, Xu and Shen.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yong Xu, hsux3@nwpu.edu.cn; Jianwei Shen, xcjwshen@gmail.com
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.