ORIGINAL RESEARCH article

Front. Appl. Math. Stat., 15 July 2021

Sec. Dynamical Systems

Volume 7 - 2021 | https://doi.org/10.3389/fams.2021.714978

Synchronization in Networks With Heterogeneous Adaptation Rules and Applications to Distance-Dependent Synaptic Plasticity

  • 1. Institut für Mathematik, Technische Universität Berlin, Berlin, Germany

  • 2. Institut für Theoretische Physik, Technische Universität Berlin, Berlin, Germany

Article metrics

View details

15

Citations

4,1k

Views

669

Downloads

Abstract

This work introduces a methodology for studying synchronization in adaptive networks with heterogeneous plasticity (adaptation) rules. As a paradigmatic model, we consider a network of adaptively coupled phase oscillators with distance-dependent adaptations. For this system, we extend the master stability function approach to adaptive networks with heterogeneous adaptation. Our method allows for separating the contributions of network structure, local node dynamics, and heterogeneous adaptation in determining synchronization. Utilizing our proposed methodology, we explain mechanisms leading to synchronization or desynchronization by enhanced long-range connections in nonlocally coupled ring networks and networks with Gaussian distance-dependent coupling weights equipped with a biologically motivated plasticity rule.

1 Introduction

In nature and technology, complex networks serve as a ubiquitous paradigm with a broad range of applications from physics, chemistry, biology, neuroscience, socioeconomic, and other systems [1]. Dynamical networks consist of interacting dynamical units, such as neurons or lasers. Collective behavior in dynamical networks has attracted much attention in recent decades. Depending on the network and the specific dynamical system, various synchronization patterns with increasing complexity were explored [25]. Even in simple models of coupled oscillators, patterns such as complete synchronization [6, 7], cluster synchronization [811], and various forms of partial synchronization have been found, such as frequency clusters [12], solitary [1315], or chimera states [1620]. In particular, synchronization is believed to play a crucial role in brain networks, for example, under normal conditions in the context of cognition and learning [21, 22], and under pathological conditions, such as Parkinson’s disease [2325], epilepsy [2629], tinnitus [30, 31], schizophrenia, to name a few [32].

The powerful methodology of master stability function [33] has been a milestone for the analysis of synchronization phenomena. This method allows for the separation of dynamic and structural features in dynamical networks. It greatly simplifies the problem by reducing the dimension and unifying the synchronization study for different networks. Since its introduction, the master stability approach has been extended and refined for various complex systems [3442], and methods beyond the local stability analysis have been developed [4347]. More recently, the master stability approach has been extended to another class of oscillator networks with high application potential, namely adaptive networks [48].

Adaptive networks are commonly used models for various systems from nature and technology [4957]. A prominent example are neuronal networks with spike-timing dependent plasticity, in which the synaptic coupling between neurons changes depending on their relative spiking times [5861]. There are a large number of studies investigating the dynamic properties induced by this form of synaptic plasticity [62]. However, analysis is usually limited to only one or two forms of spike timing-dependent plasticity within a neuronal population. On the other hand, experimental studies indicate that different forms of spike timing-dependent plasticity may be present within a neuronal population, where the form depends on the connection structure between the axons and dendrites [63]. Among all structural aspects, an important factor for the specific form of the plasticity rule is the distance between neurons [6466]. More specifically, it has been found that the plasticity rule between proximal or distal neurons, respectively, can change from Hebbian-like to anti-Hebbian-like [67, 68].

This work introduces a methodology to study synchronization in adaptive networks with heterogeneous plasticity (adaptation) rules. As a paradigmatic system, we consider an adaptively coupled phase oscillator network [6975], which is proven to be useful for predicting and describing phenomena occurring in more realistic and detailed models [7679]. More specifically, in the spirit of the master stability function approach, we consider the synchronization problem as the interplay between network structure and a heterogeneous adaptation rule arising from distance- (or location-)dependent synaptic plasticity. For a given heterogeneous adaptation rule, our master stability function provides synchronization criteria for any coupling configuration. As illustrative examples, we consider a nonlocally coupled ring with biologically motivated plasticity rule, and a network with a Gaussian distance-dependent coupling weights. We explained such intriguing effects as synchronization or desynchronization by enhancement of long-distance links.

We introduce the model in Section 2. Building on findings from [48], we develop a master stability approach in Section 3 that takes a heterogeneous adaptation rule in account. In Section 4.1, we provide an approximation of the structural eigenvalues that determine the stability of the synchronous state. We then consider two different setups: a nonlocally coupled ring in Section 4.2 and a weighted network with Gaussian distance distribution of coupling weights in Section 4.3. Both systems are equipped with a biologically motivated plasticity rule. In Section 5, we summarize the results.

2 Model

In this work, we study the synchronization on networks with adaptive coupling weights, where the adaptation (plasticity) rule depends on the distance between oscillators (neurons). We consider the model of adaptively coupled phase oscillators, which has proven to be useful for understanding dynamics in neuronal systems with spike timing-dependent plasticity [77, 79, 48]. The model reads as follows:where () is the phase of the ith oscillator, () is the dynamical coupling weight from oscillator j to i, ω denotes the natural frequency of each oscillator, and are the entries of the weighted adjacency matrix A describing the network connectivity. The time scales of the “fast” phase oscillators and “slow” coupling weights are separated by the parameter ϵ, which we assume to be small . The functions g and denote the coupling and the plasticity functions, respectively. For illustrative purposes, the coupling function is set throughout the paper to with the phase lag parameter α [80]. Such a phase lag can account for a small synaptic propagation delay [81, 48]. For formal derivations, however, a generic coupling function is used. Note that the system Eqs. 1, 2 is shift-symmetric, i.e., invariant under the transformation for any . This allows us to restrict our consideration to the case by introducing a new “co-rotating” coordinate system .

The main difference of system Eqs. 1, 2 from the models considered previously in the literature [40, 70, 71, 74, 82], is that the plasticity functions can be different for each network connection .

A solution to Eqs. 1, 2 is called phase-locked if, for all , the phases evolve as with some collective frequency and . If for all , the phase-locked state is called in-phase synchronous or, short, synchronous state.

In the case of in-phase synchronous state, we can set for each oscillator due to the shift symmetry of Eqs. 1, 2. The in-phase synchronous state is given aswhere we assume that the weighted row sum is constant for all. Such an assumption of constant row sum is necessary for the existence of the synchronous state. Moreover, it is satisfied for commonly considered cases of global or nonlocal shift-invariant coupling.

In the following section, we show how the stability of the synchronous state is determined in a master-stability-like approach.

3 Master Stability Approach

In Section 2, we have introduced a general class of models and the synchronous state, that are considered throughout this paper. In this section, we derive a framework for the local stability analysis of the synchronous states. We note that the master stability approach for homogeneous adaptations was introduced in [48, 83]. Here we extend the methodology to heterogeneous adaptation rules.

To describe the local stability, we introduce the variations and . The linearized equations for these variations can be written in the following matrix formwhere is N-dimensional vector containing the perturbations of the phases and are - dimensional vectorized perturbations of coupling weights , respectively. The weighted Laplacian matrix has the following elements

The time-independent matrices B and C arewhere , , and

Note that due to the shift symmetry of Eqs. 1, 2, the Jacobian J in Eq. 5 is time independent. Therefore, the real parts of the eigenvalues λ of J are the Lyapunov exponents of the synchronous state and hence determine its local stability. In the following proposition, we exploit the fact that J contains a large diagonal block to reduce the dimension of the eigenvalue problem for J.

P

roposition

1. Supposeis an in-phase synchronous state ofEqs. 1, 2. Then its linear stability is determined by the-dimensional linear systemwhereandare as inEq. 5and theweighted Laplacian matrixpossesses the following elements

P

roof

. We remind that system Eq. 5 determines the spectrum (Lyapunov exponents) of the synchronous state. The Jacobian matrix in Eq. 5 is sparse with a large block given by the simple diagonal matrix . This implies that Eq. 5 possess stable directions with Lyapunov exponents . To find these directions, we substitute into Eq. 5 and obtain the linear systemThis system has at least linearly independent solutions, since the matrix in Eq. 9 is degenerate due to the large zero block. The structure of the invariant subspaces in system Eq. 5 allows for introducing new coordinates, which separate the stable directions (corresponding to the eigenvalues ) from the remaining directions. Explicitly, this transformation is given bywith matrix R. Here K is an orthogonal matrix with . Applying this transformation, we obtain the following systemwhere with and are an N and -dimensional vectors, respectively, and the weighted Laplacian matrix as given in Eq. 8. For more details on the transformation, we refer the reader to [48, 83]. We observe that the variables are independent on . Hence, separating the master from the slave system, the resulting coupled differential equations that determine the stability of the synchronous state are given by system Eq. 7. This concludes the proof.Proposition 1 reduces the problem’s dimension significantly from to . In the spirit of the master stability approach [33], we aim for further decomposition of the - dimensional coupled system Eq. 7 into dynamically independent blocks of dimension 2. For this, we restrict our consideration to the case when can be diagonalized by a nonsingular complex-valued matrix Q. Note that the eigenvalues of lie on the diagonal of . In general, the matrices and do not commute. Therefore, is not necessarily of upper triangular shape. Regardless of this fact, the following proposition provides an explicit form for the eigenvalues of J in Eq. 5 in the limit of slow adaptation, i.e., .

P

roposition

2. Assume thatis diagonalizable, withbeing the associated diagonal matrix and Q the corresponding transformation. Letbe an in-phase synchronous state ofEqs. 1, 2Then, the local stability of this state is determined by the solutions of N quadratic equations, which are given up to the first order in ϵ aswhereare the eigenvalues oflocated on the diagonal ofandare the corresponding diagonal elements of. Ifandcommute, thenEq. 11is exact, andare the eigenvalues of.P

roof

. Due to Proposition 1, the eigenvalues of the Jacobian in Eq. 5 are given bywhere we have used the transformation Q that brings to the diagonal form . Making further use of the Schur complement [84], we obtainThe latter equation is almost diagonal. The only off-diagonal components remain from and scale with ϵ. Let us consider the Leibniz formula for the determinant of an matrix F with entries , that reads . In the latter expression denotes the set of all permutations σ of the integer numbers and is the sign of the permutation. Since all off-diagonal terms of the matrix considered in Eq. 12 scale with ϵ, for any but the identical permutation each term scales with or higher. Hence, we are left with and findwhere are the eigenvalues of , are the diagonal elements of and denotes higher order terms (). If and commute, both matrices share the same set of eigenvectors and hence they can be brought to the diagonal form with the same transformation Q. In this case, the diagonal elements are the eigenvalues of and the higher order terms in Eq. 13 vanish.The solutions of the NEq. 11 determine the stability of the synchronous state. More precisely, the real parts of theses solutions determine the Lyapunov exponents. If , then the synchronous state is locally stable, while for it is locally unstable. The case provides the stability boundary.Note that for a fixed time scale parameter , the Eq. 11 and hence its solutions depend on the coupling function g, the connectivity, and the adaptation structure. This dependence, however, is only encoded in the two complex parameters and . Therefore, we define the master stability function with that maps each pair of parameters to the corresponding Lyapunov exponent.For an illustration, we consider a cross-section of - space by setting and . This cross-section is of particular interest in cases of symmetric matrices and since their eigenvalues are real. In Figure 1, we present the master stability function for the coupling function and different values of the parameter α. In case of real μ and ν, we obtain two explicit stability conditions from Eq. 11: The synchronous state is locally stable () ifThese conditions agree with the black dashed lines in Figure 1 and are used subsequently to describe stability for certain network models.

FIGURE 1

FIGURE 1

The master stability function for the coupling function and real μ and ν (, ). The values of the master stability function are color-coded in all panels (A–E). The dashed black line describes the border between regions corresponding to local stability and instability, respectively. Parameters: , (A), (B), (C), (D), and (E).

4 Synchronization on Networks With Distance-Dependent Plasticity

In the previous section, we established a generic analytic tool for studying stability of synchronous states. In this section, we focus on the application of the tool to certain network models. For the rest of the work, we restrict our attention to the following generalization of the Kuramoto-Sakaguchi system with distance-dependent synaptic plasticity

The plasticity function h depends on the phase difference and on the distance . In this work, we associate the distance to the difference of indices by . For the plasticity function, we consider

With this form of the adaptation function, we have a symmetric and a circulant structure of the corresponding matrix with entries . Particularly, for the numerical analysis, we usewhere the distance dependence is encoded in the phase shift function

In Figure 2A, we illustrate the distance-dependent plasticity function Eqs. 1820 for a network of nodes. The illustration shows the different plasticity functions depending on the distance between the nodes . The plasticity function changes from a Hebbian to anti-Hebbian rule for proximal and distal node, respectively. This change, particularly in the proximity of , is in qualitative agreement with the experimental findings in [67]. Note the symmetry of the plasticity function that renders the matrix with elements circulant.

FIGURE 2

FIGURE 2

Panel (A) shows the plasticity function given in Eqs. 1820 depending on the distance exemplified for node in a network with nodes. Note that the colors of the links in the network (left) correspond to the colors of the depicted plasticity function (right). Panel (B) displays the connectivity structure of a nonlocally coupled ring network with nodes and a coupling range . Panel (C) displays the weighted connectivity structure of a network with nodes (left) with distance-dependent Gaussian weight distribution (right). Note that the colors of the links in the network (left) correspond to the colors of the bars in the weight distribution (right).

If not indicated differently, we consider the coupling structure given bywhere is a bounded and piece-wise continuous function. This corresponds to a distant-dependent coupling, and it results to a dihedral symmetry in the coupling structure (ring-like).

In the following section, we provide an approximation for the eigenvalues of and for large networks with circulant connectivity and plasticity structure. Using this approximation, we subsequently analyze the stability of the synchronous state on nonlocally coupled networks and on isotropic networks with Gaussian weight distribution.

4.1 Approximation of the Eigenvalues for Large Systems With Circulant Structure

In the previous part, we have defined the plasticity functions in such a way that the structures of and inherit important properties from the underlying network structure . In particular, assuming that the adjacency matrix is circulant, renders and to be circulant, as well.

In this section, we briefly recall how one can derive the eigenvalues and () in case of a circulant structure. It is well-known that for a circulant matrix the eigenvalues are determined by applying a discrete Fourier approach [85]. More precisely, suppose L is a circulant matrix where the elements of the first row are given by the entries with . Then the kth eigenvalue is explicitly given by

For the case of as in Eq. 6, and as in Eqs. 18 and 21, we obtainwith and . Since the adjacency matrix A is assumed to be symmetric, the eigenvalues of are real. Therefore, we omit considering the imaginary part of . Eq. 22 provides exact expressions for the eigenvalues. However, the values depend on the total number of oscillators N that makes it harder to study the influence of other system properties, such as the coupling structure or the plasticity function. To remove this N-dependence, we consider the continuum limit (compare with [86]) and obtain

Due to the definition of h and the symmetry of , we findfor any k. This explicit expression allows studying the distribution of the eigenvalues for a given plasticity function h and coupling structure a. Note that a similar expression as (23) can be analogously derived for the eigenvalues of and reads

We note that due to the Laplacian structure of and .

The results from Eqs. 23 and 24 are applied in the next sections to analyze different networks.

4.2 Synchronization on Nonlocally Coupled Ring Networks

In this section, we analyze the effect of long distance connections on the stability of synchronous states in nonlocally coupled ring networks. We consider the coupling structure given by

This means that any two oscillators are coupled if they are separated at most by the coupling range P. The coupling Eq. 25 defines a nonlocal ring structure with coupling range p to each side and two special limiting cases: local ring for and globally coupled network for (if N is even, else ). The matrix of the form Eq. 25 is circulant [85] and has constant row sum, i.e., for all . An illustration for adn is presented in Figure 2B.

In order to study the influence of the coupling range, we use the approximations for the eigenvalues and derived in Section 4.1. The nonlocally coupled ring structure is expressed by the piecewise continuous function for and otherwise with relative coupling range . Thus, for a nonlocally coupled ring Eq. 25 and plasticity function Eqs. 1820, we findfor the eigenvalues of . Analogously, we obtainfor of .

In Figure 3A, we provide an error analysis of the approximations Eqs. 26 and 27 compared to the exact eigenvalues given by Eq. 22. As expected, the errors tend to zero as the number of oscillators increases. Additionally in Figures 3B,C, we display and for several values of k depending on the relative coupling range p. We observe that for all k. This is due to given plasticity function Eqs. 1820, for which the update is positive (or equal to zero) for all distances at , i.e., for all .

FIGURE 3

FIGURE 3

Panel (A) shows the errors (black) and (blue) with of the approximations Eqs. 26, 27, respectively, where are the exact eigenvalues derived by a discrete Fourier transformation, see Eq. 22. The errors are displayed in dependence of the system size N (number of oscillators). The relative coupling range is set to . Panel (B) and (C) show the approximated eigenvalues given by Eqs. 26, 27, respectively, depending on the relative coupling range p for different values of k.

It is important to note, that our choice of the circulant adaptation functions imply that the matrices and are diagonalizable and commute. Hence, Proposition 2 holds with the master stability Eq. 11 being exact. Therefore, the stability criterium Eq. 14 is also exact.

Combining the fact with the stability criterium Eq. 14, we find as a necessary condition for the stability of the synchronous state for . This yields, that the synchronous state can be stable only for . In contrast to , the is in general neither positive nor negative definite, hence the eigenvalues may take positive or negative values. This is due to the fact that the plasticity function may change sign at the origin, i.e., may change signs depending on the distance . In particular, we find that only the eigenvalue changes the sign, see Figure 3C. This change may lead to a destabilization of the synchronous states as we show in the subsequent analysis. Finally, note that there exist and to which the eigenvalues converge for large values of k. These limits are displayed in Figures 3B,C as black lines.

In Figure 4, we show different scenarios for the stability of the synchronous state depending on the phase lag parameter α and the coupling range p. Due to the necessary condition as , we consider only. Figures 4A,B show that for , the second stability condition Eq. 15 is only fulfilled for p larger than a critical value of the coupling range . In these cases, a higher coupling range stabilizes the synchronous state. Note that as with . The results seen in Figures 4A,B are in agreement with the results for a network of coupled phase oscillators. For this network, we calculate the Laplacian eigenvalues and plot them along with the master stability function in Figures 4E,F. The outcomes from numerical simulations are presented in Figures 4I,J.

FIGURE 4

FIGURE 4

Stability analysis of the synchronous state of system Eqs. 16, 17 with plasticity rule Eqs. 1820 and coupling structure Eq. 25. Panels (A–D) show the function for different α, see Eq. 15, calculated with the approximations Eqs. 26, 27 depending on the relative coupling range p. In each panel, is displayed for different values of k. The gray shaded regions refer to unstable synchronous states. Panels (e,f,g,h) show the master stability function for the cross-section and for different values of α with color code as in Figure 1. The crosses and dots correspond to two sets of eigenvalue pairs () for relative coupling range (blue crosses) and (black points), respectively. Panels (I–L) show the synchronization error for simulations with relative coupling range (blue) and (black). Each simulation is initialized at a slightly perturbed synchronous state. Parameters: , , (A, E, I), (B, F, J), (C, G, K), (D, H, L).

The situation changes for , as shown in Figures 4C,D. Here, for a large range of α, all nonlocally coupled networks lead to a stable synchronous state. However, closer to , long distance connections destabilize the synchronous state. In particular, this destabilization can be traced back to the single negative eigenvalue of the Laplacian , see Figure 4H. Hence, the unstable manifold of the synchronous state is only one-dimensional. This finding is in agreement with the example of phase oscillators presented in Figures 4G,H,K, L. Particularly in Figure 4L, the low dimension of the unstable manifold manifests itself as follows: The black trajectory first tends to the synchronous state along the stable directions before it is repelled along the direction corresponding to .

We have shown that long distance interactions may stabilize or destabilize the synchronous state depending on the phase lag parameter α. In this section, all links have the same weight independent of the corresponding distance. In the next section, we analyze a network with a more realistic structure with a distance-dependent distribution of weights.

4.3 Synchronization on Isotropic and Homogeneous Network With Gaussian Distance Distribution

In the previous section, we used the prototypical example of a nonlocally coupled rings to study the effects of long-range interaction on synchronization. In this setup, however, all links are equally weighted. In realistic systems, in contrast, the number of links with a certain distance are distributed, see [67] for details. To incorporate this into our network model, we weight the links with respect to a distance distribution. Measurements suggest that the distance distribution can be estimated by a mean and a distribution width [67]. The Gaussian distributions is a paradigmatic distribution that allows for studying effects emanating from the mean and the distribution width. For the remainder of the section, we consider the link distance distribution given by a Gaussian distribution, and weight the links of the network connectivity structure A accordingly, i.e.where ξ and σ are the mean value and the standard deviation, respectively. Note that the standard deviation characterizes the width of the distribution. For the numerical simulations, we normalize each row of A by . Here, we further make the assumption that the network is homogeneous and isotropic. This means that in any direction from a node and at each node the network looks the same. Hence, we obtain a circulant connectivity structure. An illustration of the weight distribution for is presented in Figure 2C.

As we know from Eqs. 14 and 15, for , the values of determine the stability of the synchronous state. In particular, the synchronous state is stable if for a given N and unstable otherwise. In Figure 5A, we display for and different mean values ξ and standard deviations σ of the weight distribution. In agreement with the finding in Section 4.2, the synchronized state stabilizes due to an increase of long distance interaction expressed by an increase of σ. Complementing the finding in Section 4.2, here, we note that the stability can be also achieved by distributions with peaks at long distance links alone. In this case, the width of the distribution is not important. Figure 5B shows how the boundary between regions corresponding to stable and unstable synchronization change for different values of α. As in the case of nonlocally coupled ring networks, with (with ) the boundary tends to the limiting point . On the contrary, if (with ), the width of the distribution has to increase to have stable synchronization for small values of the mean ξ.

FIGURE 5

FIGURE 5

Stability analysis of the synchronous state of system Eqs. 16, 17 with plasticity rule Eqs. 1820 and coupling structure Eq. 28. Panels (A, C) show the minimum over all of , se Eq. 15, for two different values of α depending on the mean value ξ and the standard deviation σ of the weight distribution. The minima are displayed in color code. Panels (B, D) show the boundaries between stable and unstable regions in - plane for different values of α as given in the figure. Parameters: (A), , (C), , (B, C).

An opposite scenario is shown in Figure 5C for . Here, an increase of the weights for long distance links destabilizes the synchronous state, as in Figures 4D,H,L. We also note that for small values α, the synchronous state is stable for almost all values of σ and ξ, see Figure 5D. Only in cases of distribution sharply peaked at long distances, i.e., ξ close to and σ close to 0, the synchronous state is unstable. This effect could not be found in networks with nonlocally coupled rings, see Section 4.2.

5 Conclusion

In summary, we have investigated the phenomenon of synchronization on adaptive networks with heterogeneous plasticity rules. In particular, we have modeled systems with distance-dependent plasticity as they have been found in neuronal networks experimentally [6467] as well as computational models [68]. For the realization, we have used a ring-like network architecture and associated the distance of two nodes with the distance of their placement on the ring.

In Section 3, we have developed a generalized master stability approach for phase oscillator models that are adaptively coupled and where each link has its own adaptation rule (plasticity). By using an explicit splitting of the time scales between fast dynamics of the phase oscillators and slow dynamics of the link weights, we have established an explicit stability condition for the synchronous state. More precisely, we found that the stability is governed by the coupling function and the eigenvalues of two structure matrices. These structure matrices and are determined by the connectivity of the network and the plasticity rules of the link weights. Note that for the structural matrices, the plasticity rule needs only to be known in the vicinity of 0, which greatly facilitates the application of the approach to realistic forms of synaptic plasticity. Thus, we have extended previous work on the master stability function of adaptive networks [48, 83] and broaden the scope of potential future applications for this methodology.

In Section 4, we applied the novel technique to a system of adaptively coupled oscillators with distance-dependent plasticity. Here, we have used a ring-like network structure to study the impact of long- and short-distance connections on the stability of synchronization. For this purpose we introduced an approximation of the eigenvalues for the structure matrices in Section 4.1. This approximation allows for a comprehensive analysis of the stability as a function of various system parameters. Moreover, it enables us to identify critical eigenvalues that govern the stability of the synchronous state. In Sections 4.2 and 4.3, we have brought together all methodological findings and applied them to systems with a nonlocally coupled ring structure and with a Gaussian distribution of link weights. The latter structure accounts for the fact that in realistic neuronal populations the number of links with different distances are not uniformly distributed [67]. We found that long-distance connections can stabilize or destabilize the synchronous state, depending on the coupling function between the oscillators. A remarkable fact with respect to neuronal applications relates to the destabilization scenario. Here we observed that the destabilization can be attributed to the pronounced change of the plasticity rule from Hebbian to anti-Hebbian. For more realistic connectivity structures, we found that weight distributions of the connectivity structure with sharp peaks at long distances lead to destabilization for a wide range of the coupling function.

All in all, in this article, we have provided a general framework to study the emergence of synchronization in neuronal system with a heterogeneous plasticity rule. The developed methodology is not limited to distance-dependent types of plasticity and can also be used for non-symmetric setups. For the latter case, we have provided the necessary analytical result. In this work, we have restricted our attention to the case of phase oscillators, but the methods can be extended to more realistic neuron models by using techniques established, for example, in [48]. Moreover, techniques are available that allow for further generalization toward systems with slightly different local dynamics at each node [87]. On the one hand, the master stability approach offers a great tool to study the stability of the synchronous state depending on the networks structure. On the other hand, this approach allows for characterizing the network structures that are, in some sense, optimal for synchronization [88, 89]. In this regard, it remains an open question as to how plasticity optimizes the synchronizability of the network in a self-organized way. In addition, recent studies have shown that there is a great interest in synchronization phenomena to understand diseases such as Parkinson’s disease [9092] or epilepsy [29, 93] for the development of proper therapeutic treatments. We believe that our work provides an important step toward understanding synchronization under realistic conditions.

Statements

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Author contributions

RB designed the study and did the numerical simulations. RB and SY developed the analytical results. Both authors contributed to the preparation of the manuscript. Both authors read and approved the final manuscript.

Funding

This work was supported by the German Research Foundation DFG, Project Nos. 411803875 and 440145547, and the Open Access Publication Fund of TU Berlin.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  • 1.

    NewmanMEJ. The Structure and Function of Complex Networks. SIAM Rev (2003) 45:167256. 10.1137/s003614450342480

  • 2.

    PikovskyARosenblumMKurthsJ. Synchronization: A Universal Concept in Nonlinear Sciences. 1st ed.Cambridge: Cambridge University Press (2001).

  • 3.

    StrogatzSH. Exploring Complex Networks. Nature (2001) 410:26876. 10.1038/35065725

  • 4.

    ArenasADíaz-GuileraAKurthsJMorenoYZhouC. Synchronization in Complex Networks. Phys Rep (2008) 469:93153. 10.1016/j.physrep.2008.09.002

  • 5.

    BoccalettiSPisarchikANdel GenioCIAmannA. Synchronization: From Coupled Systems to Complex Networks. Cambridge: Cambridge University Press (2018).

  • 6.

    KuramotoY. Chemical Oscillations, Waves and Turbulence. Berlin: Springer-Verlag (1984).

  • 7.

    PecoraLMCarrollTLJohnsonGAMarDJHeagyJF. Fundamentals of Synchronization in Chaotic Systems, Concepts, and Applications. Chaos (1997) 7:52043. 10.1063/1.166278https://doi.org/10.1063/1.166278

  • 8.

    YanchukSMaistrenkoYMosekildeE. Partial Synchronization and Clustering in a System of Diffusively Coupled Chaotic Oscillators. Mathematics Comput Simulation (2001) 54:491508. 10.1016/S0378-4754(00)00276-7

  • 9.

    ChoeC-UDahmsTHövelPSchöllE. Controlling Synchrony by Delay Coupling in Networks: from In-phase to Splay and Cluster States. Phys Rev E (2010) 81:025205. 10.1103/physreve.81.025205

  • 10.

    BelykhIHaslerM. Mesoscale and Clusters of Synchrony in Networks of Bursting Neurons. Chaos (2011) 21:016106. 10.1063/1.3563581

  • 11.

    ZhangYMotterAE. Symmetry-independent Stability Analysis of Synchronization Patterns. SIAM Rev (2020) 62:81736. 10.1137/19m127358x

  • 12.

    BernerRSchöllEYanchukS. Multiclusters in Networks of Adaptively Coupled Phase Oscillators. SIAM J Appl Dyn Syst (2019) 18:222766. 10.1137/18m1210150

  • 13.

    JarosPBrezetskySLevchenkoRDudkowskiDKapitaniakTMaistrenkoY. Solitary States for Coupled Oscillators with Inertia. Chaos (2018) 28:011103. 10.1063/1.5019792

  • 14.

    TeichmannERosenblumM. Solitary States and Partial Synchrony in Oscillatory Ensembles with Attractive and Repulsive Interactions. Chaos (2019) 29:093124. 10.1063/1.5118843

  • 15.

    BernerRPolanskaASchöllEYanchukS. Solitary States in Adaptive Nonlocal Oscillator Networks. Eur Phys J Spec Top (2020) 229:2183203. 10.1140/epjst/e2020-900253-0

  • 16.

    KuramotoYBattogtokhD. Coexistence of Coherence and Incoherence in Nonlocally Coupled Phase Oscillators. Nonlin Phen Complex Sys (2002) 5(4):3805.

  • 17.

    AbramsDMStrogatzSH. Chimera States for Coupled Oscillators. Phys Rev Lett (2004) 93:174102. 10.1103/physrevlett.93.174102

  • 18.

    SchöllE. Synchronization Patterns and Chimera States in Complex Networks: Interplay of Topology and Dynamics. Eur Phys J Spec Top (2016) 225:891919. 10.1140/epjst/e2016-02646-3

  • 19.

    Omel’chenkoOE. The Mathematics behind Chimera States. Nonlinearity (2018) 31:R121. 10.1088/1261-6544/aaaa07

  • 20.

    Omel’chenkoOEKnoblochE. Chimerapedia: Coherence-Incoherence Patterns in One, Two and Three Dimensions. New J Phys (2019) 21:093034. 10.1088/1367-2630/ab3f6b

  • 21.

    SingerW. Neuronal Synchrony: A Versatile Code for the Definition of Relations?Neuron (1999) 24:4965. 10.1016/s0896-6273(00)80821-1

  • 22.

    FellJAxmacherN. The Role of Phase Synchronization in Memory Processes. Nat Rev Neurosci (2011) 12:10518. 10.1038/nrn2979

  • 23.

    HammondCBergmanHBrownP. Pathological Synchronization in Parkinson's Disease: Networks, Models and Treatments. Trends Neurosciences (2007) 30:35764. 10.1016/j.tins.2007.05.004

  • 24.

    GorielyAKuhlEBickC. Neuronal Oscillations on Evolving Networks: Dynamics, Damage, Degradation, Decline, Dementia, and Death. Phys Rev Lett (2020) 125:128102. 10.1103/physrevlett.125.128102

  • 25.

    PfeiferKJKromerJACookAJHornbeckTLimEAMortimerBJPet alCoordinated Reset Vibrotactile Stimulation Induces Sustained Cumulative Benefits in Parkinson's Disease. Front Physiol (2021) 12:624317. 10.3389/fphys.2021.624317

  • 26.

    JiruskaPde CurtisMJefferysJGRSchevonCASchiffSJSchindlerK. Synchronization and Desynchronization in Epilepsy: Controversies and Hypotheses. J Physiol (2013) 591(4):78797. 10.1113/jphysiol.2012.239590

  • 27.

    JirsaVKStaceyWCQuilichiniPPIvanovAIBernardC. On the Nature of Seizure Dynamics. Brain (2014) 137:221030. 10.1093/brain/awu133

  • 28.

    AndrzejakRGRummelCMormannFSchindlerK. All Together Now: Analogies between Chimera State Collapses and Epileptic Seizures. Sci Rep (2016) 6:23000. 10.1038/srep23000

  • 29.

    GersterMBernerRSawickiJZakharovaAŠkochAHlinkaJet alFitzHugh-Nagumo Oscillators on Complex Networks Mimic Epileptic-Seizure-Related Synchronization Phenomena. Chaos (2020) 30:123130. 10.1063/5.0021420

  • 30.

    TassPAAdamchicIFreundH-Jvon StackelbergTHauptmannC. Counteracting Tinnitus by Acoustic Coordinated Reset Neuromodulation. Restor Neurol Neurosci (2012) 30:13759. 10.3233/rnn-2012-110218

  • 31.

    TassPAPopovychOV. Unlearning Tinnitus-Related Cerebral Synchrony with Acoustic Coordinated Reset Stimulation: Theoretical Concept and Modelling. Biol Cybern (2012) 106:2736. 10.1007/s00422-012-0479-5

  • 32.

    UhlhaasPPipaGLimaBMelloniLNeuenschwanderSNikolicDet alNeural Synchrony in Cortical Networks: History, Concept and Current Status. Front Integr Neurosci (2009) 3:17. 10.3389/neuro.07.017.2009

  • 33.

    PecoraLMCarrollTL. Master Stability Functions for Synchronized Coupled Systems. Phys Rev Lett (1998) 80:210912. 10.1103/physrevlett.80.2109

  • 34.

    FlunkertVYanchukSDahmsTSchöllE. Synchronizing Distant Nodes: a Universal Classification of Networks. Phys Rev Lett (2010) 105:254101. 10.1103/physrevlett.105.254101

  • 35.

    DahmsTLehnertJSchöllE. Cluster and Group Synchronization in Delay-Coupled Networks. Phys Rev E (2012) 86:016202. 10.1103/physreve.86.016202

  • 36.

    KeaneADahmsTLehnertJSuryanarayanaSAHövelPSchöllE. Synchronisation in Networks of Delay-Coupled Type-I Excitable Systems. Eur Phys J B (2012) 85:407. 10.1140/epjb/e2012-30810-x

  • 37.

    KyrychkoYNBlyussKBSchöllE. Synchronization of Networks of Oscillators with Distributed Delay Coupling. Chaos (2014) 24:043117. 10.1063/1.4898771

  • 38.

    LehnertJ. Controlling Synchronization Patterns in Complex Networks. Springer Theses. Heidelberg: Springer (2016).

  • 39.

    TangLWuXJLuJAD'SouzaRM. Master Stability Functions for Complete, Intralayer, and Interlayer Synchronization in Multiplex Networks of Coupled Rössler Oscillators. Phys Rev E (2019) 99:012304. 10.1103/PhysRevE.99.012304

  • 40.

    BernerRSawickiJSchöllE. Birth and Stabilization of Phase Clusters by Multiplexing of Adaptive Networks. Phys Rev Lett (2020) 124:088301. 10.1103/physrevlett.124.088301

  • 41.

    BörnerRSchultzPÜnzelmannBWangDHellmannFKurthsJ. Delay Master Stability of Inertial Oscillator Networks. Phys Rev Res (2020) 2:023409. 10.1103/physrevresearch.2.023409

  • 42.

    MulasRKuehnCJostJ. Coupled Dynamics on Hypergraphs: Master Stability of Steady States and Synchronization. Phys Rev E (2020) 101:062313. 10.1103/physreve.101.062313

  • 43.

    BelykhVNBelykhIVHaslerM. Connection Graph Stability Method for Synchronized Coupled Chaotic Systems. Physica D: Nonlinear Phenomena (2004) 195:15987. 10.1016/j.physd.2004.03.012

  • 44.

    BelykhIde LangeEHaslerM. Synchronization of Bursting Neurons: What Matters in the Network Topology. Phys Rev Lett (2005) 94:188101. 10.1103/physrevlett.94.188101

  • 45.

    BelykhIBelykhVHaslerM. Generalized Connection Graph Method for Synchronization in Asymmetrical Networks. Physica D: Nonlinear Phenomena (2006) 224:4251. 10.1016/j.physd.2006.09.014

  • 46.

    BelykhIBelykhVHaslerM. Synchronization in Asymmetrically Coupled Networks with Node Balance. Chaos (2006) 16:015102. 10.1063/1.2146180https://doi.org/10.1063/1.2146180

  • 47.

    DaleyKZhaoKBelykhIV. Synchronizability of Directed Networks: The Power of Non-existent Ties. Chaos (2020) 30:043102. 10.1063/1.5134920

  • 48.

    BernerRVockSSchöllEYanchukS. Desynchronization Transitions in Adaptive Networks. Phys Rev Lett (2021) 126:028301. 10.1103/physrevlett.126.028301

  • 49.

    JainSKrishnaS. A Model for the Emergence of Cooperation, Interdependence, and Structure in Evolving Networks. Proc Natl Acad Sci (2001) 98:5437. 10.1073/pnas.98.2.543

  • 50.

    ProulxSPromislowDPhillipsP. Network Thinking in Ecology and Evolution. Trends Ecol Evol (2005) 20:34553. 10.1016/j.tree.2005.04.004

  • 51.

    GrossTD’LimaCJDBlasiusB. Epidemic Dynamics on an Adaptive Network. Phys Rev Lett (2006) 96:208701. 10.1103/physrevlett.96.208701

  • 52.

    MartensEAKlemmK. Transitions from Trees to Cycles in Adaptive Flow Networks. Front Phys (2017) 5:62. 10.3389/fphy.2017.00062

  • 53.

    KuehnC. Multiscale Dynamics of an Adaptive Catalytic Network. Math Model Nat Phenom (2019) 14:402. 10.1051/mmnp/2019015

  • 54.

    HorstmeyerLKuehnC. Adaptive Voter Model on Simplicial Complexes. Phys Rev E (2020) 101:022305. 10.1103/physreve.101.022305

  • 55.

    MeiselCGrossT. Adaptive Self-Organization in a Realistic Neural Network Model. Phys Rev E (2009) 80:061917. 10.1103/physreve.80.061917

  • 56.

    MikkelsenKImparatoATorciniA. Emergence of Slow Collective Oscillations in Neural Networks with Spike-Timing Dependent Plasticity. Phys Rev Lett (2013) 110:208101. 10.1103/physrevlett.110.208101

  • 57.

    MikkelsenKImparatoATorciniA. Sisyphus Effect in Pulse-Coupled Excitatory Neural Networks with Spike-timing-dependent Plasticity. Phys Rev E (2014) 89:062701. 10.1103/physreve.89.062701

  • 58.

    MarkramHLübkeJFrotscherMSakmannB. Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs. Science (1997) 275:2135. 10.1126/science.275.5297.213

  • 59.

    AbbottLFNelsonSB. Synaptic Plasticity: Taming the Beast. Nat Neurosci (2000) 3:117883. 10.1038/81453

  • 60.

    CaporaleNDanY. Spike Timing-dependent Plasticity: A Hebbian Learning Rule. Annu Rev Neurosci (2008) 31:2546. 10.1146/annurev.neuro.31.060407.125639

  • 61.

    PopovychOVYanchukSTassPA. Self-organized Noise Resistance of Oscillatory Neural Networks with Spike Timing-dependent Plasticity. Sci Rep (2013) 3:2926. 10.1038/srep02926

  • 62.

    ZenkeFAgnesEJGerstnerW. Diverse Synaptic Plasticity Mechanisms Orchestrated to Form and Retrieve Memories in Spiking Neural Networks. Nat Commun (2015) 6:6922. 10.1038/ncomms7922

  • 63.

    TazerartSMitchellDEMiranda-RottmannSArayaR. A Spike-timing-dependent Plasticity Rule for Dendritic Spines. Nat Commun (2020) 11:4276. 10.1038/s41467-020-17861-7

  • 64.

    FroemkeRCPooM-m.DanY. Spike-timing-dependent Synaptic Plasticity Depends on Dendritic Location. Nature (2005) 434:2215. 10.1038/nature03366

  • 65.

    SjöströmPJHäusserM. A Cooperative Switch Determines the Sign of Synaptic Plasticity in Distal Dendrites of Neocortical Pyramidal Neurons. Neuron (2006) 51:22738. 10.1016/j.neuron.2006.06.017

  • 66.

    FroemkeRCLetzkusJJKampaBMHangGBStuartGJ. Dendritic Synapse Location and Neocortical Spike-timing-dependent Plasticity. Front.Syna.Neurosci. (2010) 2:29. 10.3389/fnsyn.2010.00029

  • 67.

    LetzkusJJKampaBMStuartGJ. Learning Rules for Spike Timing-dependent Plasticity Depend on Dendritic Synapse Location. J Neurosci (2006) 26:104209. 10.1523/jneurosci.2650-06.2006

  • 68.

    Meissner-BernardCTsaiMCLogiacoLGerstnerW. Dendritic Voltage Recordings Explain Paradoxical Synaptic Plasticity: A Modeling Study. Front Synaptic Neurosci (2020) 12:585539. 10.3389/fnsyn.2020.585539

  • 69.

    AokiTAoyagiT. Co-evolution of Phases and Connection Strengths in a Network of Phase Oscillators. Phys Rev Lett (2009) 102:034101. 10.1103/physrevlett.102.034101

  • 70.

    KasatkinDVYanchukSSchöllENekorkinVI. Self-organized Emergence of Multilayer Structure and Chimera States in Dynamical Networks with Adaptive Couplings. Phys Rev E (2017) 96:062211. 10.1103/physreve.96.062211

  • 71.

    KasatkinDVNekorkinVI. The Effect of Topology on Organization of Synchronous Behavior in Dynamical Networks with Adaptive Couplings. Eur Phys J Spec Top (2018) 227:105161. 10.1140/epjst/e2018-800077-7

  • 72.

    BernerRFialkowskiJKasatkinDNekorkinVYanchukSSchöllE. Hierarchical Frequency Clusters in Adaptive Networks of Phase Oscillators. Chaos (2019) 29:103134. 10.1063/1.5097835

  • 73.

    BernerRYanchukSSchöllE. What Adaptive Neuronal Networks Teach Us about Power Grids. Phys Rev E (2021) 103:042315. 10.1103/physreve.103.042315

  • 74.

    FeketaPSchaumAMeurerT. Synchronization and Multi-Cluster Capabilities of Oscillatory Networks with Adaptive Coupling. IEEE Trans Automat Control (2020) 66(7):3084. 10.1109/tac.2020.3012528

  • 75.

    FranovićIYanchukSEydamSBačićIWolfrumM. Dynamics of a Stochastic Excitable System with Slowly Adapting Feedback. Chaos (2020) 30:083109. 10.1063/1.5145176

  • 76.

    PopovychOVXenakisMNTassPA. The Spacing Principle for Unlearning Abnormal Neuronal Synchrony. PLoS ONE (2015) 10:e0117205. 10.1371/journal.pone.0117205

  • 77.

    LückenLPopovychOVTassPAYanchukS. Noise-enhanced Coupling between Two Oscillators with Long-Term Plasticity. Phys Rev E (2016) 93:032210. 10.1103/physreve.93.032210

  • 78.

    ChakravartulaSIndicPSundaramBKillingbackT. Emergence of Local Synchronization in Neuronal Networks with Adaptive Couplings. PLoS ONE (2017) 12:e0178975. 10.1371/journal.pone.0178975

  • 79.

    RöhrVBernerRLameuELPopovychOVYanchukS. Frequency Cluster Formation and Slow Oscillations in Neural Populations with Plasticity. PLoS ONE (2019) 14:e0225094. 10.1371/journal.pone.0225094

  • 80.

    SakaguchiHKuramotoY. A Soluble Active Rotater Model Showing Phase Transitions via Mutual Entertainment. Prog Theor Phys (1986) 76:57681. 10.1143/ptp.76.576

  • 81.

    Madadi AslMValizadehATassPA. Dendritic and Axonal Propagation Delays Determine Emergent Structures of Neuronal Networks with Plastic Synapses. Sci Rep (2017) 7:39682. 10.1038/srep39682

  • 82.

    Madadi AslMValizadehATassPA. Dendritic and Axonal Propagation Delays May Shape Neuronal Networks with Plastic Synapses. Front Physiol (2018) 9:1849. 10.3389/fphys.2018.01849

  • 83.

    VockSBernerRYanchukSSchöllE. Effect of Diluted Connectivities on Cluster Synchronization of Adaptively Coupled Oscillator Networks. Scientia Iranica D (2021) 28(3):1669.

  • 84.

    LiesenJMehrmannV. Linear Algebra. Cham: Springer (2015). 10.1007/978-3-319-24346-7

  • 85.

    GrayRMToeplitz and Circulant Matrices: A Review. Found. Trends Commun. Inf. Theory, Hanover, MA, USA: Now Publishers Inc. (2006). p. 155239.

  • 86.

    AokiTAoyagiT. Self-organized Network of Phase Oscillators Coupled by Activity-dependent Interactions. Phys Rev E (2011) 84:066109. 10.1103/physreve.84.066109

  • 87.

    SunJBolltEMNishikawaT. Master Stability Functions for Coupled Nearly Identical Dynamical Systems. Europhys Lett (2009) 85:60011. 10.1209/0295-5075/85/60011

  • 88.

    SkardalPSTaylorDSunJ. Optimal Synchronization of Complex Networks. Phys Rev Lett (2014) 113:144101. 10.1103/physrevlett.113.144101

  • 89.

    AcharyyaSAmritkarRE. Synchronization of Nearly Identical Dynamical Systems: Size Instability. Phys Rev E (2015) 92:052902. 10.1103/physreve.92.052902

  • 90.

    KromerJATassPA. Long-lasting Desynchronization by Decoupling Stimulation. Phys Rev Res (2020) 2:033101. 10.1103/physrevresearch.2.033101

  • 91.

    KromerJAKhaledi-NasabATassPA. Impact of Number of Stimulation Sites on Long-Lasting Desynchronization Effects of Coordinated Reset Stimulation. Chaos (2020) 30:083134. 10.1063/5.0015196

  • 92.

    Khaledi-NasabAKromerJATassPA. Long-Lasting Desynchronization of Plastic Neural Networks by Random Reset Stimulation. Front Physiol (2021) 11:622620. 10.3389/fphys.2020.622620

  • 93.

    OlmiSPetkoskiSGuyeMBartolomeiFJirsaV. Controlling Seizure Propagation in Large-Scale Brain Networks. Plos Comput Biol (2019) 15:e1006805. 10.1371/journal.pcbi.1006805

Summary

Keywords

synaptic plasticity, adaptive networks, phase oscillator, synchronization, distance-dependent synaptic plasticity, nonlocally coupled rings, master stability approach

Citation

Berner R and Yanchuk S (2021) Synchronization in Networks With Heterogeneous Adaptation Rules and Applications to Distance-Dependent Synaptic Plasticity. Front. Appl. Math. Stat. 7:714978. doi: 10.3389/fams.2021.714978

Received

26 May 2021

Accepted

21 June 2021

Published

15 July 2021

Volume

7 - 2021

Edited by

Jun Ma, Lanzhou University of Technology, China

Reviewed by

Syamal Kumar Dana, Jadavpur University, India

Gopal R., SASTRA University, India

Updates

Copyright

*Correspondence: Rico Berner,

This article was submitted to Dynamical Systems, a section of the journal Frontiers in Applied Mathematics and Statistics

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics