Entrainment is sparse
Eric Barnhill1,2*- 1Clinical Research Imaging Centre, Department of Clinical Sciences and Community Health, College of Medicine and Veterinary Medicine, The University of Edinburgh, Edinburgh, UK
- 2Institute for Music in Human and Social Development, Reid School of Music, Edinburgh College of Art, The University of Edinburgh, Edinburgh, UK
1. Introduction
Entrained behavior coordinates, predicts, and modulates multi-scale rhythmic gestures with high spatio-temporal precision even as it shows flexible adaptation in response to perturbation (Clayton et al., 2005; Altenmüller et al., 2006; Phillips-Silver et al., 2010). The capacity for this split-second, multi-scale timing is often viewed as a highly-complex, specialized virtuosity that emerged in the forges of natural selection for evolutionary advantage (Mithen, 2005; Knoblich and Sebanz, 2008; Merker et al., 2009). Entrainment has found compelling mathematical models in the interaction of multiple dynamic oscillators (Large, 2010) and convincing neurological substrata in the electrophysiological resonance patterns that support cognition (Nozaradan et al., 2011; Schaefer et al., 2011). Further, entrainment-based therapeutic interventions have been validated in both quantative (Thaut and Abiru, 2010) and qualitative (Aigen, 2008) studies.
This paper aims to bolster the theoretical case for the transformational potential of entrainment therapy by casting it in the framework of contemporary engineering mathematics, in particular applying the concepts of change of basis, Fourier transform, and most importantly, the growing body of work on Joint Sparse Representation (JSR) (Bruckstein et al., 2009). The paper aims to be a conceptual introduction in the hopes of reaching a wider audience that may want to make use of the relationship between entrainment and sparsity, and apply more engineering mathematics to their analyses of entrainment in therapy and performance.
2. Three Key Concepts
2.1. Change of Basis
Many of the engineering marvels around us have, as a keystone of their mathematical foundations, a change of basis (Kreyszig, 2007). A technical definition of a mathematical basis is a set of linearly independent vectors within a space that, in combination, can span the entirety of that space. For example, the Cartesian basis for three-dimensional real space (aka R3) is a set of three orthogonal (perpendicular) unit (length of one) vectors, pointing along the x, y, and z axes respectively. In vector notation the orthonormal Cartesian R3 vectors are [1 0 0], [0 1 0] and [0 0 1]. We say these vectors span R3, as any point in R3, for which we have the coordinates [x y z], can be reached from the origin using the vectors [x 0 0] + [0 y 0] + [0 0 z]. The Cartesian R3 basis is, in other words, the way we might account for spatial activity using rulers or graph paper. Add a fourth dimension for time, to span spatio-temporal activity, and the same rules apply for any vector [x y z t].
2.2. The Fourier Basis and the Frequency Domain
This spatio-temporal Cartesian basis is our most intuitive approach to representing the world around us, but also a very poor representation for solving many engineering problems. One of the most commonly used changes of basis is the family of Fourier or frequency-domain transforms, in which a function is represented on a basis of sinusoidal periodic functions rather than units of Cartesian distance. In its discrete form, a signal is transformed from a series of consecutive sampled values into a combination of sinusoids of different amplitudes and frequencies.
While conceptually cumbersome at first, Fourier transformation has many advantages for not only the analysis, but the storing and compression, of many kids of data. Take, for example, a sample of a single musical note, vibrating at a particular frequency, that would appear on an oscilloscope as a complex periodic waveform. In the time domain, this signal will be dense, that is, it will contain few if any zeros and most of the signal will be required for its reconstruction as specified by the the Nyquist-Shannon sampling theorem (Shannon, 1949). If, however, the signal is like most signals coming from a musical instrument—a combination of a fundamental frequency and a small number of overtone frequencies—then it can be represented in the Fourier domain with a small number of values, one for each component frequency, leaving the rest of the basis vectors at zero magnitude. The signal vector thus meets the mathematical definition of sparse—most of its coefficients are zero—and its representation can be efficiently compressed, requiring far less data for its representation than the Nyquist theorem specifies. Figure 1A illustrates the relationship between a complex periodic waveform and its sparse Fourier transformation.
Figure 1. (A) A dense periodic discrete signal may have a sparse representation when transformed into the Fourier domain (DCT-II transform). (B) Image of Edinburgh Castle, with Spatial (Cartesian basis), Discrete Cosine Transform (frequency domain basis) and Singular Value Decomposition (least-squares optimal basis) compression applied at decreasing compression rates. Source: Stuart Caie, CC BY 2.0 license. Reproduced grayscale with described modifications.
Mathematically, a signal and its Fourier transform are one-to-one mappings. The frequency-domain representation of the signal is often much more efficient, however, in the sense that far more of the signal information is packed into a small subset of the vectors that span the basis. JPEG (Skodras et al., 2001) and MPEG (Le Gall, 1991) compression schemes, for example, discard well over 90% of the information within a signal in part by transforming that image into the frequency domain (DCT in the case of MPEG and Daubechies wavelet in the case of JPEG 2000) and eliminating the many frequency bands of near-zero magnitude. The resulting compressed data formats still retain enough of the significant information to have become the lingua franca of images and music, respectively. An example of data compression in the spatial frequency domain is seen in Figure 1B.
Frequency-domain transform is hard-wired into the anatomy of the cochlea, whose hair cells of varying stiffness resonate with stimuli of specific frequencies, triggering action potentials via auditory transduction. The inner ear thus performs a frequency transform of incoming auditory information across a small temporal window, known in its simplest form as a short-time Fourier transform (STFT), though actual observed performance resembles a somewhat more complex transform known as time-frequency reassignment (Auger et al., 2013).
2.3. Sparse Overcomplete Coding
If sufficient information about the signal can be deduced from a small portion of a signal via a mathematical transform, then the benefits to the actor are obvious. Both computationally and metabolically, the organism that can reduce processing demands by such a large amount can expect to reap benefits. If frequency-domain and similar bases yield such improvements in information coding efficiency, the key question for modeling neural coding is to ask how that information might be coded to its optimum.
The optimal basis for a signal in a least-squares sense is its Singular Value Decomposition (SVD) (Strang, 2007). A comparison of spatio-temporal, frequency-domain and SVD data compression is shown in Figure 1B. The frequency-domain images show many more features at each level of compression than the Cartesian (nearest-neighbor) compression, while the SVD images show substantially more than either.
However, the SVD of a single signal is not necessarily the sparsest representation of that signal in the context of a set of signals such as that encoded in neural memory. Much greater compression can be attained through the re-use of common basis vectors to transform many signals. In this approach the process of neural memory is modeled as manipulation of a set of learned basis vectors known as a “dictionary,” in which incoming signals are decomposed in the sparsest possible way using the atomic vectors or “atoms” that make up the dictionary (Rubinstein et al., 2010). This operation is non-linear but many efficient algorithms have been developed for sparse dictionary coding, primarily through L1-norm minimization (Donoho and Elad, 2003). The most efficient dictionary systems are found to be “sparse overcomplete,” that is, they consist of many more basis vectors than necessary for the set of signals, but have great flexibility to maximize the sparsity with which an incoming signal is encoded (Bruckstein et al., 2009; Rubinstein et al., 2010).
Finally the atoms of the dictionary must adapt to the new signals in accordance with the principles of Hebbian and Bayesian learning. Efficient algorithms have been discovered for this process as well, whether the classic K-SVD (Aharon et al., 2006) or more recent parametric or multiscale dictionary updating algorithms (Rubinstein et al., 2010).
Perhaps unsurprisingly, there is abundant experimental evidence for such sparse coding in human and animal brains (Olshausen and Field, 2004). Evidence supporting a sparse coding model has been found in studies of visual (Olshausen and Field, 1997; Vinje and Gallant, 2000), auditory (Hromádka et al., 2008), olfactory (Ito et al., 2008; Poo and Isaacson, 2009), haptic (Jadhav et al., 2009; Crochet et al., 2011) and motor (Hahnloser et al., 2002) processing. Sparse coding models relate to the neuroanatomical observation that progressive stages in signal processing have increasingly redundant amounts of neurons that each fire increasingly rarely (Olshausen and Field, 2004). This is no longer projected to lead to signal-specific “grandmother cells” but rather to a maximally sparse and overcomplete representation of the world given metabolic constraints.
3. Putting it All Together: The Sparsity of Entrainment
The sparsity argument for entrainment is then as follows: Phenomena that contain regularities are more efficiently encoded in the frequency domain. We can therefore expect that the optimal basis, such as that obtained through SVD, would be much more similar to the frequency-domain mapping of signal, by a common similarity measure such as tangent distance (Simard et al., 1998), than the spatiotemporal mapping of the signal. Finally, over time we can expect the atoms in the brain's sparse overcomplete dictionary to minimize metabolic and computational costs by reconstructing signals along bases that are closer in tangent distance to the frequency domain than the spatiotemporal.
Returning to the descriptions of entrainment in the literature, many of the characteristic behaviors found in entrainment can be accounted for with greater conceptual economy by applying sparsity-related concepts. Entrained movement is not necessarily more skillful than rhythmically independent movement, but rather entrained movement is more efficiently coded and less computationally demanding when projected onto a frequency-domain basis. Entrainments across multiple time scales (Large, 2010) can be represented sparsely when transformed, and therefore does not necessarily pose much more computational challenge than a single-scale behavior. Non-linear coupled oscillators, such as those hypothesized to underlie entrainment (Large, 2010), have been shown to be more efficiently coded and tracked in the frequency domain (Buchli et al., 2008; Orchard et al., 2013). Perceived persistence of rhythmic structures in the absence of updated information (Large and Palmer, 2002) is explained by pursuit of the sparsest basis for the signal. Similarly, the error minimization driving predictive coding (Vuust et al., 2009) is accounted for by the least-squares optimization properties inherent in SVD diagonalization. Finally, the long tradition of fascinating studies showing that humans, while in communication with each other, synchronize from head to toe (Condon and Ogston, 1966; Trevarthen, 1979; Bernieri et al., 1988; Couper-Kuhlen, 1993; Shockley et al., 2003) is not necessarily describing a behavior of great sophistication as much as a process of economy: whatever information is being communicated between subjects is mapped internally, for each participant, onto a mathematical basis that has transformed space and time into multi-scale frequency. Entraining together allows this communication to take a more efficient form than when the subjects retain rhythmic independence. Entrainment is not virtuosity, it is sparsity.
4. Validating the Sparsity Model
What experiment might validate the hypothesis that entrainment facilitates sparse coding? While we cannot observe information coding directly, we can observe behavior, and while we do not have access to the atomic dictionaries within a subject, we can determine the SVD of a subject's actions. The singular values of the SVD further provide an effective measurement tool for how sparsely the information is encoded known as singular value entropy (SVE). If most of the information is sparsely packed into a small number of basis vectors, the entropy of the singular value set will be low, as some vectors will have very high singular values and most will be very low. On the other hand, if the information is encoded less sparsely, the information will be spread diffusely among the basis vectors, increasing the entropy. If entrainment aids the neurally coded JSR of a movement, than the distribution of values within the SVD of the behavior is likely to shift. In particular, entropy of the singular values can be expected to decrease, with increasing dominance of the loadings of the first singular values. If SVE of the kinematic vectors of a behavior decreases while entrained, it may be taken as evidence for a cognitive re-mapping of the action.
From this hypothesis for the cognitive impact of entrainment, a second hypothesis for entrainment-based therapy may be additionally derived: if the lasting result of a repeated entrainment-based intervention is a persistent shift in kinematic SVE of a behavior, even independent of the intervention, the SVE alteration is evidence of entrainment-driven neuroplastic change.
5. Conclusion
As the presence of the cochlea has long suggested to anatomists, and as neural coding theory now asserts, the brain is much more aligned to the frequency domain than our everyday, spatio-temporal accounts of the world might lead us to think. Consequently, the impact of entrainment-based instruction and therapy is likely much greater than that which can be forecasted by spatiotemporal analysis of actions. Entrainment is everywhere; entrainment is powerful; but perhaps most importantly, entrainment is sparse. A sparsity model of entrainment therapy suggests that entrainment therapy is much more than a way to scaffold the re-learning of movements: it is potentially one of the most powerful approaches to the changing of behavior in the contemporary repertoire.
Conflict of Interest Statement
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgment
The author would like to gratefully acknowledge discussions with Dr. Katie Overy, University of Edinburgh.
References
Aharon, M., Elad, M., and Bruckstein, A. (2006). K-svd: An algorithm for designing overcomplete dictionaries for sparse representation. Signal Process. IEEE Trans. 54, 4311–4322. doi: 10.1109/TSP.2006.881199
Aigen, K. (2008). An analysis of qualitative music therapy research reports 1987–2006: articles and book chapters. Arts Psychother. 35, 251–261. doi: 10.1016/j.aip.2008.05.001
Altenmüller, E., Wiesendanger, M., and Kesselring, J. (2006). Music, Motor Control and the Brain. Oxford, UK: Oxford University Press. doi: 10.1093/acprof:oso/9780199298723.001.0001
Auger, F., Flandrin, P., Lin, Y.-T., McLaughlin, S., Meignen, S., Oberlin, T., et al. (2013). Time-frequency reassignment and syncchrosqueezing: an overview. IEEE Sig. Proc. Magaz. 30, 32–41. doi: 10.1109/MSP.2013.2265316
Bernieri, F. J., Reznick, J. S., and Rosenthal, R. (1988). Synchrony, pseudosynchrony, and dissynchrony: measuring the entrainment process in mother-infant interactions. J. Pers. Soc. Psychol. 54, 243. doi: 10.1037/0022-3514.54.2.243
Bruckstein, A. M., Donoho, D. L., and Elad, M. (2009). From sparse solutions of systems of equations to sparse modeling of signals and images. SIAM Rev. 51, 34–81. doi: 10.1137/060657704
Buchli, J., Righetti, L., and Ijspeert, A. J. (2008). Frequency analysis with coupled nonlinear oscillators. Physica D 237, 1705–1718. doi: 10.1016/j.physd.2008.01.014
Clayton, M., Sager, R., and Will, U. (2005). “In time with the music: the concept of entrainment and its significance for ethnomusicology,” in European Meetings in Ethnomusicology, Vol. 11 (Bucharest), 3–142.
Condon, W. S., and Ogston, W. D. (1966). Sound film analysis of normal and pathological behavior patterns. J. Nerv. Ment. Dis. 143, 338–347. doi: 10.1097/00005053-196610000-00005
Couper-Kuhlen, E. (1993). English Speech Rhythm: Form and Function in Everyday Verbal Interaction, Vol. 25. Amsterdam: John Benjamins Publishing. doi: 10.1075/pbns.25
Crochet, S., Poulet, J. F., Kremer, Y., and Petersen, C. C. (2011). Synaptic mechanisms underlying sparse coding of active touch. Neuron 69, 1160–1175. doi: 10.1016/j.neuron.2011.02.022
Donoho, D. L., and Elad, M. (2003). Optimally sparse representation in general (nonorthogonal) dictionaries via 1 minimization. Proc. Natl. Acad. Sci. U.S.A. 100, 2197–2202. doi: 10.1073/pnas.0437847100
Hahnloser, R. H., Kozhevnikov, A. A., and Fee, M. S. (2002). An ultra-sparse code underliesthe generation of neural sequences in a songbird. Nature 419, 65–70. doi: 10.1038/nature00974
Hromádka, T., DeWeese, M. R., and Zador, A. M. (2008). Sparse representation of sounds in the unanesthetized auditory cortex. PLoS Biol. 6:e16. doi: 10.1371/journal.pbio.0060016
Ito, I., Ong, R. C.-y., Raman, B., and Stopfer, M. (2008). Sparse odor representation and olfactory learning. Nat. Neurosci. 11, 1177–1184. doi: 10.1038/nn.2192
Jadhav, S. P., Wolfe, J., and Feldman, D. E. (2009). Sparse temporal coding of elementary tactile features during active whisker sensation. Nat. Neurosci. 12, 792–800. doi: 10.1038/nn.2328
Knoblich, G., and Sebanz, N. (2008). Evolving intentions for social interaction: from entrainment to joint action. Philos. Trans. R. Soc. B Biol. Sci. 363, 2021–2031. doi: 10.1098/rstb.2008.0006
Large, E. W. (2010). “Neurodynamics of music,” in Music Perception, eds M. R. Jones, R. R. Fay, and A. N. Popper (New York, NY: Springer), 201–231. doi: 10.1007/978-1-4419-6114-3-7
Large, E. W., and Palmer, C. (2002). Perceiving temporal regularity in music. Cogn. Sci. 26, 1–37. doi: 10.1207/s15516709cog2601-1
Le Gall, D. (1991). Mpeg: a video compression standard for multimedia applications. Commun. ACM 34, 46–58. doi: 10.1145/103085.103090
Merker, B. H., Madison, G. S., and Eckerdal, P. (2009). On the role and origin of isochrony in human rhythmic entrainment. Cortex 45, 4–17. doi: 10.1016/j.cortex.2008.06.011
Mithen, S. J. (2005). The Singing Neanderthals: The Origins of Music, Language, Mind, and Body. Cambridge, UK: Harvard University Press.
Nozaradan, S., Peretz, I., Missal, M., and Mouraux, A. (2011). Tagging the neuronal entrainment to beat and meter. J. Neurosci. 31, 10234–10240. doi: 10.1523/JNEUROSCI.0411-11.2011
Olshausen, B. A., and Field, D. J. (1997). Sparse coding with an overcomplete basis set: a strategy employed by v1? Vision Res. 37, 3311–3325. doi: 10.1016/S0042-6989(97)00169-7
Olshausen, B. A., and Field, D. J. (2004). Sparse coding of sensory inputs. Curr. Opin. Neurobiol. 14, 481–487. doi: 10.1016/j.conb.2004.07.007
Orchard, J., Yang, H., and Ji, X. (2013). Does the entorhinal cortex use the fourier transform? Front. Comput. Neurosci. 7:179. doi: 10.3389/fncom.2013.00179
Phillips-Silver, J., Aktipis, C. A., and Bryant, G. A. (2010). The ecology of entrainment: foundations of coordinated rhythmic movement. Music Percept. 28, 3. doi: 10.1525/mp.2010.28.1.3
Poo, C., and Isaacson, J. S. (2009). Odor representations in olfactory cortex:sparse coding, global inhibition, and oscillations. Neuron 62, 850–861. doi: 10.1016/j.neuron.2009.05.022
Rubinstein, R., Bruckstein, A. M., and Elad, M. (2010). Dictionaries for sparse representation modeling. Proc. IEEE 98, 1045–1057. doi: 10.1109/JPROC.2010.2040551
Schaefer, R. S., Vlek, R. J., and Desain, P. (2011). Decomposing rhythm processing: electroencephalography of perceived and self-imposed rhythmic patterns. Psychol. Res. 75, 95–106. doi: 10.1007/s00426-010-0293-4
Shannon, C. E. (1949). Communication in the presence of noise. Proc. IRE 37, 10–21. doi: 10.1109/JRPROC.1949.232969
Shockley, K., Santana, M.-V., and Fowler, C. A. (2003). Mutual interpersonal postural constraints are involved in cooperative conversation. J. Exp. Psychol. Hum. Percept. Perform. 29, 326. doi: 10.1037/0096-1523.29.2.326
Simard, P. Y., LeCun, Y. A., Denker, J. S., and Victorri, B. (1998). “Transformation invariance in pattern recognition tangent distance and tangent propagation,” in Neural Networks: Tricks of the Trade, eds G. B. Orr and K. -R. Müller (Heidelberg: Springer), 239–274.
Skodras, A., Christopoulos, C., and Ebrahimi, T. (2001). The jpeg 2000 still image compression standard. Sig. Proc. Magaz. IEEE 18, 36–58. doi: 10.1109/79.952804
Thaut, M. H., and Abiru, M. (2010). Rhythmic auditory stimulation in rehabilitation of movement disorders: a review of current research. Music Percept. 27, 263–269. doi: 10.1525/MP.2010.27.4.263
Trevarthen, C. (1979). “Communication and cooperation in early infancy: a description of primary intersubjectivity,” in Before Speech The Beginning of Interpersonal Communication, ed M. Bullowa (Cambridge, UK: Cambridge University Press), 321–347.
Vinje, W. E., and Gallant, J. L. (2000). Sparse coding and decorrelation in primary visual cortex during natural vision. Science 287, 1273–1276. doi: 10.1126/science.287.5456.1273
Keywords: entrainment, joint sparse representation, neuromusic, music therapy, music, music cognition, neural coding
Citation: Barnhill E (2014) Entrainment is sparse. Front. Hum. Neurosci. 8:618. doi: 10.3389/fnhum.2014.00618
Received: 02 June 2014; Accepted: 23 July 2014;
Published online: 11 August 2014.
Edited by:
Jessica Phillips-Silver, Georgetown University Medical Center, USAReviewed by:
Petri Toiviainen, University of Jyväskylä, FinlandCopyright © 2014 Barnhill. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: e.barnhill@sms.ed.ac.uk