PERSPECTIVE article

Front. Integr. Neurosci., 05 February 2019

Volume 13 - 2019 | https://doi.org/10.3389/fnint.2019.00002

Multimodal Integration and Phenomenal Spatiotemporal Binding: A Perspective From the Default Space Theory

  • Charitable Medical Healthcare Foundation, Augusta, GA, United States

Article metrics

View details

14

Citations

10,9k

Views

1,2k

Downloads

Abstract

How does the integrated and unified conscious experience arise from the vastly distributed activities of the nervous system? How is the information from the many cones of the retina bound with information coming from the cochlea to create the association of sounds with objects in visual space? In this perspective article, we assert a novel viewpoint on the “binding problem” in which we explain a metastable operation of the brain and body that may provide insight into this problem. In our view which is a component of the Default Space Theory (DST), consciousness arises from a metastable synchronization of local computations into a global coherence by a framework of widespread slow and ultraslow oscillations coordinated by the thalamus. We reinforce a notion shared by some consciousness researchers such as Revonsuo and the Fingelkurts that a spatiotemporal matrix is the foundation of phenomenological experience and that this phenomenology is directly tied to bioelectric operations of the nervous system. Through the oscillatory binding system we describe, cognitive neuroscientists may be able to more accurately correlate bioelectric activity of the brain and body with the phenomenology of human experience.

Introduction

Phenomenology is the reflection on and analysis of the essential structure and form of conscious experience (Husserl, 1952; Menon et al., 2013). An understanding of the structure and dynamics of the phenomenology of consciousness offers constraints on the search for its explanatory mechanisms in the brain and potentially the body (Revonsuo, 2003). In this article, we assert a viewpoint on not only the phenomenology, but the physiological underpinnings of consciousness which may bridge the gap in understanding the connection between the material and experiential components of it. We propound that a subconscious, virtual, space-time matrix is the foundation of animal experience and continuously exists in the conscious mind as a coordinate system for a recreation or simulation of the material world. Additionally, this matrix is physically created by a global, unified, bioelectric oscillatory structure that spans the brain and body.

The Default Space Theory (DST; Jerath et al., 2015; Jerath and Beveridge, 2018) is a novel, metastable, embodied theory of consciousness which is unique in its holistic description of the body as an integral component of perception. Metastable models such as the Operational Architectonics Theory (Fingelkurts and Fingelkurts, 2001; Fingelkurts et al., 2010, 2013) and Global Workspace Theory (Edelman et al., 2011) show promise in revealing the nature of consciousness. Theories of metastability propose that consciousness arises from the global integration and coordination of distinct mesoscopic neural modules that while perform their own innate functions, couple together to form a large-scale coherence (Freeman and Holmes, 2005; Kelso and Tognoli, 2007; Fingelkurts and Fingelkurts, 2017). The DST extends this metastable architecture to the sensory receptors themselves (Jerath and Beveridge, 2018), thus extending the science of embodied cognition into consciousness. Embodied cognition is a radical field in that diverts from the prevailing view that cognition is a sole processes of the brain by asserting the body plays a crucial role in our psychology (Foglia and Wilson, 2013).

There still exists a debate as to whether neural oscillations play a functional role in cognition and consciousness, if they arise simply as a epiphenomenal byproduct of spiking activity, or even if they interfere with normal processing (Koepsell et al., 2010; Chalk et al., 2016). We share the prevailing perspective that bioelectric oscillations play a variety of key roles in neural processes responsible for cognition (Fries, 2005, 2009; Cole and Voytek, 2017; Wutz et al., 2018) as well as the unified nature of consciousness (Fingelkurts et al., 2010). Increasing evidence supporting this perspective reveal that neural oscillations are a powerful means to transfer and encode information (Cheong and Levchenko, 2010). Oscillations may provide a necessary low-energy mechanism for local and distant communication lost in mere action potential signaling (Buzsáki and Draguhn, 2004) which in larger brains would have severe spatial and metabolic constraints (Knyazev, 2012). The fact that the full frequency spectrum of oscillations is phylogenetically preserved strongly suggests they serve important functional purposes (Buzsáki and Draguhn, 2004).

The Binding Problem

The binding problem is a considerable mystery in cognitive science which ponders how a unified experience could arise from the distributed and disparate activities of the nervous system (Revonsuo and Newman, 1999). There are many aspects of binding including property, part, location, and temporal binding and sub-problems such as how certain stimuli are bound to discrete objects in perceptual space (Revonsuo and Newman, 1999). Perceptual representations depend on neural codes that constitute the parts and properties of physical objects perceptually recreated (Treisman, 1996). Due to the fact that only a fraction of all neural processing enters consciousness, there must be some mechanism for dynamic selection of neural assemblies that enter awareness (Engel and Singer, 2001). We support the well-supported notion that achieving such selection along with cross-modal coherence requires mechanisms for binding neural information (Singer et al., 1997). An effective theory on multisensory integration must answer at least two pivotal problems: how is information integrated across distal cortical and subcortical regions, and how are unrelated signals within the same processing modules segregated. We believe an underlying oscillatory architecture coordinated by the thalamus binds and segregates such streams of activity based on the spatial and temporal locations of each stimulus in external and thus phenomenal space.

The temporal binding model proposes neurons responding to identical sensory objects or scenes in space synchronize in the millisecond range while this synchronization does not exist between neurons representing separate objects in external space (Singer and Gray, 1995; Engel and Singer, 2001). We further this concept by suggesting the sensory receptors themselves are synchronized with associated cortical areas. Consciousness has been argued to result from thalamocortical circuits which bind sensory contents encoded by thalamocortical loops (Llinás and Ribary, 1994) which become globally available (Baars et al., 2013), and we stress the important of the thalamus in global binding. Many authors have proposed that electrical thalamocortical coherence is the functional basis for binding (Llinás et al., 1998, 2002) and that coupled oscillatory activity may serve to link simultaneous neural activity across multisensory regions (Senkowski et al., 2008). We support this perspective and describe a global, underlying oscillatory structure into which all activity potentially producing sensory qualia are dynamically bound.

A Phenomenological Space-Time Matrix

In our perspective shared by a subset of consciousness researchers, the most fundamental aspect of human experience is a subconscious (Damasio, 1999), unifying, empty, spatial coordinate matrix in which all qualia must be embedded in order to come into conscious awareness. In everyone’s experience, we perceive the world from the center or mathematical origin of this externalized space (Revonsuo, 2006). This center provides a spatial sense of first-person self (Metzinger, 2003; Trehub, 2007; Blanke and Metzinger, 2009). This concept of a phenomenological space-time has been supported by neurophysiological and cognitive research (Weiskrantz, 1997), such as investigation into contralateral neglect syndrome (Driver and Vuilleumier, 2001; Figure 1), as well as our own everyday personal experience, and has been most thoroughly explored by the Fingelkurts in their Operational Architectonics Theory (Fingelkurts et al., 2010). Revonsuo has termed this space “virtual space,” and identified it as responsible for the global unity of consciousness (Revonsuo, 2006). Tononi et al. (2016) has described structure as an axiom of all consciousness, not just human.

Figure 1

Figure 1

The existence of an essential phenomenal space revealed by contralateral neglect syndrome. Contralateral Neglect is a condition resulting often from damage the right parietal lobe (Kerkhoff, 2001). Not only do the neglected side of space and all sensation within it disappear from consciousness in this condition, but these patients are not aware of any “missing” space and experience the right side as the full external world. They may eat from one side of their plate or dress one side of their body. Two main theories exist at as why this may occur, both supporting the existence of an unconscious virtual coordinate matrix as the basis of consciousness. In the first theory, as illustrated in the top image, the parietal brain area maps percepts spatially. The right lobe maps both sides of the perceptual field while the left only one side, thus, lesions of the right side lead to a lack of mapping of the left perceptual field (Iachini et al., 2009). The necessity of spatial mapping of percepts into a 3D coordinate matrix for experience is revealed by the loss of perception of the entire left side of space for these patients (Jerath and Crawford, 2014), illustrated by the bottom image. Recent findings have stimulated the second theory which focuses on disturbed resting brain oscillation networks of Alpha frequency is supported by the fact that neglect can occur from damage to numerous right-side cortical and sub-cortical areas (Corbetta and Shulman, 2011), and that unconscious processing of the neglected stimuli still occur. In this theory, lesions damage these networks which are responsible for spatial attention. This supports our view that Alpha coherence brings the unconscious virtual space to awareness and that a spatial component to qualia must exist for it to enter consciousness (figure by Lynsey Ekema, MSMI). Previously Published in Jerath and Beveridge (2018). Permission obtained by Creative Commons.

We share the view that consciousness is an emergent phenomenon resulting from a functional representation or simulation of the external world and that the ontology of our phenomenological space-time is a direct replication of the dimensional nature of the physical universe (Siegel, 2006). This allows us the survival benefit of interacting optimally with our environment. Although phenomenal contents may be representations of the external world, they are never experienced as such, instead giving the impression that they are actual objects or scenes in the physical world (Metzinger, 2003). Support is given by the nature of dreams which reveal that experiences outside of perception of the external world are spatially structured (Strauch and Meier, 1996) and experienced as real the majority of the time (Farthing, 1992).

An Underlying Cognitive Architecture

While there is significant support for a phenomenological space-time coordinate matrix as a foundation of experience, not much research has been invested in how this is reflected neurophysiologically. Our novel interpretation of this bridge between the material and experiential may provide great insight into binding and multisensory integration. This interpretation includes the notion that this subconscious space-time matrix is isomorphic to an ongoing, global, dynamic architecture of harmonious oscillatory activity (Jerath and Beveridge, 2018) upon which activity generating percepts build and bind upon (Freeman and Vitiello, 2006; Fingelkurts et al., 2010, 2013). In our view, the bioelectric structure responsible for this matrix is the most basic and important layer of a greater cognitive architecture spanning the entire body which produces consciousness. We assert that this phenomenal space and its isomorphic bioelectric structure are crucial to solving the binding problem as the objects and scenes upon which various modes of stimuli are bound (Singer and Gray, 1995) are in turn bound to this greater coordinate matrix.

We propose this underlying, global, operational structure provides a coherence mechanism for all sensory modalities to unify based upon their spatial coordinates in external space and may provide an explanation for baseline neural activity. Baseline activity was traditionally considered noise (Emadi et al., 2014), but has been realized at minimum to play an important role in perception and behavior (Supèr et al., 2003). Its incessant activity utilizes the majority of the brain’s energy (Raichle and Gusnard, 2002), but its exact function is still mysterious (Balduzzi et al., 2008). Ultraslow (<0.1 Hz) oscillations are known to be an intrinsic component of brain activity (Birn et al., 2006; Raichle and Snyder, 2007). Baseline activity has been found to interact with activity induced by an external stimulus in creating the overall response (Fox et al., 2005; Liu et al., 2011). According to our view, this subconscious, baseline, oscillatory layer of oscillations in neuronal membrane potential as well as at the macroscopic level operate at an ultraslow frequency while higher frequency oscillations responsible for qualia are bound to its virtual coordinate matrix via synchronization. Other theories of consciousness have also correlated higher frequency activity with consciousness and lower frequency with unconsciousness such as the Dynamic Core Hypothesis (Murphy and Brown, 2007).

Our perspective that the global cognitive architecture consists of multiple oscillatory layers (Jerath and Crawford, 2015) and that the most fundamental layer is global and responsible for producing the phenomenal coordinate matrix is supported by significant research. Oscillatory patterns have been shown to be hierarchically organized by frequency with the lower frequency activity underlying and correlating with high frequency activity (Monto et al., 2008; Yuan et al., 2012). In addition this lower frequency activity has been demonstrated to modulate (Lakatos et al., 2005), group (Steriade et al., 2001; Vanhatalo et al., 2004), organize, and entrain higher frequencies (Herrero et al., 2018) as well as be effective in facilitating long-range communication (Hyafil et al., 2015). We assert the fundamental low frequency layer is in part maintained and coordinated by cardiorespiratory activity (Tong et al., 2013; Heck et al., 2017; Varga and Heck, 2017; Herrero et al., 2018) and the modules of the Default Mode Network (Buckner et al., 2008; Fingelkurts et al., 2016). This coordination of the lowest layer provides a mechanism for global entrainment and harmony needed to create a unified and integrated experience.

According to most perspectives in phenomenology, qualia must have structure, composed of several experiential distinctions such as visual color, a location, or sound (Husserl, 1952; Brown, 2005; Menon et al., 2013; Oizumi et al., 2014). The lowest layer of ultra-slow oscillations creating the virtual coordinate matrix provides the global foundation for qualia to be built and bound both electrophysiologically and phenomenally. We believe the substance of frameworks for the diverse sensory modalities that fill this space in various forms consist largely of circuits bound by Alpha oscillations which provide the next level of structure required for qualia emerge. Just as the virtual matrix, sensory frameworks are continuously active in the awake state even with a lack of stimuli which is revealed by the presence of Alpha baseline activity (Iemi et al., 2017). We propose these frameworks in their empty form are significantly more conscious than the 3D matrix upon which they are bound, commonly demonstrated by the experience of complete darkness. Continentally blind people do not experience darkness as someone with eyes closed would; however, they have a complete lack of visual experience all together (Bryan Magee, 1995; Koster-Hale et al., 2014). Thus, we hold that while sensory frameworks are created through dynamic neural circuits and oscillatory networks, the type of sensation it creates is dependent upon the processing mechanisms of the system.

Synchrony of Alpha oscillations in addition may mediate the rise of these frameworks into conscious awareness via spatial attention (Sasaki et al., 2013; Fingelkurts and Fingelkurts, 2015). Recent findings on the diversity of brain areas that when damaged lead to the condition of contralateral neglect we mentioned suggests structural damage to specific brain areas may not significantly explain the condition. Instead, disruptions of resting Alpha networks that control spatial attention via inter-hemispheric connectivity provide a more sound explanation (Corbetta, 2012; Sasaki et al., 2013). We interpret these findings as evidence for our view that in addition to playing a major role in the formulation of sensory frameworks, Alpha rhythms bring the unconscious virtual space into awareness through further baseline functional connectivity needed for large-scale integration of local computations, and that spatial awareness is a fundamental prerequisite to any other type of awareness.

Multimodal Integration

Imagine yourself along a busy street while you attempt to cross. Auditory and visual stimuli from passing cars provide reciprocal information on passing cars allowing you to safely cross, however these distinct categories of information must be integrated and unified for effective perception of crossing safety. Research has shown that different sensory modalities are indeed spatially and temporally integrated so that different qualities belonging to the same object are registered in the same space and time (Treisman, 1999; Watt and Phillips, 2000). Although it is still not well understood how this multisensory integration occurs, coherence in oscillatory activity is thought to be an essential mechanism (Fingelkurts et al., 2003; Senkowski et al., 2008). In the perspective we put forth here, distinct sensory frameworks substantiated by oscillatory systems of lower frequency such as alpha are integrated via the base oscillatory layer ultra-slow oscillations responsible for the spatial coordinate matrix we have described. The integration is primarily accomplished by binding and entrainment through similarity in space and time (Molholm et al., 2002; Talsma and Woldorff, 2005), which is facilitated by such a basal, oscillatory space-time structure. We also hold the opinion that qualia are integrated into the sensory frameworks via synchrony and filled into their respective phenomenological frameworks which are themselves filled into the 3D coordinate virtual matrix.

The dynamic nature and functional importance of audiovisual integration is demonstrated in a pioneering study showing incongruent auditory-visual speech signals result in a fused speech percept (Mcgurk and Macdonald, 1976). Responses to cross-modal stimuli are superior to uni-modal stimuli (Wang et al., 2013). The multitude of benefits from the combination of sensory modalities includes improved orientation (Stein et al., 1989), target detection (Frassinetti et al., 2002; Lovelace et al., 2003), and response times (Amlôt et al., 2003; Diederich et al., 2003). A large fraction of cortical activities are indeed formed from inputs of multiple sensory types, even the early, primary sensory sites (Ghazanfar and Schroeder, 2006; Kayser and Logothetis, 2007). Support for the modern hypothesis that dynamic, coherent oscillations play a key role in multisensory integration and in the selection of sensory information that matches across different sensory modalities has gained significant support in recent years (Fingelkurts et al., 2003; Herrmann et al., 2004; Fries, 2005). Bioelectric coherence provides a mechanism for specific patterns of functionally connectivity which would be required for the sensory frameworks we describe to hold.

Gamma band activity is shown to increase when auditory and visual signals are presented close in time (~25 ms; Senkowski et al., 2007). Greater Gamma band activity was also seen in audiovisual processing when semantically congruent stimuli were presented vs. incongruent stimuli (image of dog with a bark vs. a meow; Yuval-Greenberg and Deouell, 2007). In general, audiovisual Gamma activity appears to be enhanced when the auditory stimulus matches some visual pattern (Widmann et al., 2007). All levels of multisensory interactions are characterized by oscillatory responses most often in this Gamma band (Senkowski et al., 2008). This activity may reflect the formation of a unitary event representation (Widmann et al., 2007). In our perspective, higher frequency activity such as Gamma represent higher order qualia which are bound to subconscious frameworks which create large-scale networks needed for an integrated experience. The tightly localized activity of high frequency activity coordinate computations of specific sites while the global integration of these computations are achieved by the widespread slower oscillations (Singer, 2011).

In our view, the thalamus and the thalamocortical oscillations are additional key coordinators of oscillatory activity among the cortex and among the cortex and sensory receptors [our novel proposition (Jerath et al., 2016)], serving to coordinate the binding of multi-modal qualia to the sensory frameworks and these frameworks to the underlying virtual space. In this way, expectations may directly modulate the activity of sensory receptors (Jerath and Beveridge, 2018). There is increasing evidence that the thalamus may integrate different sensory stimuli and influence cortical multimodal processing via corticothalamic connections (Tyll et al., 2011). The sensory specific nuclei of the thalamus have also been evidenced to integrate different modalities and feed this multisensory information to primary sensory specific-cortices (Noesselt et al., 2007; Kayser et al., 2008). As the thalamus has vast reentrant and resonant connections with the cortex (Jones, 2007), it is a prime candidate for an integrator of diverse information across widely dispersed cortical sites (Cappe et al., 2012) providing a means of large-scale, simultaneous synchronized events which may conjoin in time all sensory inputs (Llinás et al., 2002). We assert the thalamus in tandem with the ultra-slow oscillations provide the means for metastable operations of binding and global unity of neural activity to occur by coordinating the integration of the vast and varied mental operations creating qualia into the virtual 3D matrix.

Conclusions

In asserting our perspective on phenomenal space-time and its isomorphic bioelectric structure, we have endeavored to provide insight into the binding problem regarding multimodal integration. We have focused on audiovisual integration in this article to provide an important instance of how this underlying oscillatory structure may entrain and organize multisensory streams into a unified whole resulting in the integrated experience. We have put forth a hierarchical view on oscillatory cognitive frameworks which include a basal, unconscious virtual coordinate matrix characterized by slow oscillations and the subconscious sensory frameworks characterized largely by Alpha oscillations. The sensory frameworks are bound to the space-time framework upon which qualia are further bound represented by even higher frequency oscillations. This hierarchy is supported by research revealing functional baseline activity and the fact that slow oscillations underlie and entrain faster ones. By describing how the slow oscillations produce a virtual space-time matrix, we describe a means for disparate sensory modalities to be integrated. In addition to empirically identifying a global oscillatory framework underlying sensory frameworks, further research should investigate the role of different frequencies in multisensory integration.

Statements

Author contributions

Theory developed by RJ with some writing with majority of the manuscript written by CB.

Funding

All funding provided by the Charitable Medical Healthcare Foundation.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  • 1

    AmlôtR.WalkerR.DriverJ.SpenceC. (2003). Multimodal visual-somatosensory integration in saccade generation. Neuropsychologia41, 115. 10.1016/s0028-3932(02)00139-2

  • 2

    BaarsB. J.FranklinS.RamsoyT. Z. (2013). Global workspace dynamics: cortical “binding and propagation” enables conscious contents. Front. Psychol.4:200. 10.3389/fpsyg.2013.00200

  • 3

    BalduzziD.RiednerB. A.TononiG. (2008). A BOLD window into brain waves. Proc. Natl. Acad. Sci. U S A105, 1564115642. 10.1073/pnas.0808310105

  • 4

    BirnR. M.DiamondJ. B.SmithM. A.BandettiniP. A. (2006). Separating respiratory-variation-related fluctuations from neuronal-activity-related fluctuations in fMRI. Neuroimage31, 15361548. 10.1016/j.neuroimage.2006.02.048

  • 5

    BlankeO.MetzingerT. (2009). Full-body illusions and minimal phenomenal selfhood. Trends Cogn. Sci.13, 713. 10.1016/j.tics.2008.10.003

  • 6

    BrownS. R. (2005). Structural Phenomenology: An Empirically-Based Model of Consciousness.New York, NY: Peter Lang.

  • 7

    Bryan MageeM. M. (1995). On Blindness: Letters Between Bryan Magee and Martin Milligan.Oxford: Oxford University Press.

  • 8

    BucknerR. L.Andrews-HannaJ. R.SchacterD. L. (2008). The brain’s default network: anatomy, function and relevance to disease. Ann. N Y Acad. Sci.1124, 138. 10.1196/annals.1440.011

  • 9

    BuzsákiG.DraguhnA. (2004). Neuronal oscillations in cortical networks. Science304, 19261929. 10.1126/science.1099745

  • 10

    CappeC.RouillerE. M.BaroneP. (2012). “Cortical and thalamic pathways for multisensory and sensorimotor interplay,” in The Neural Bases of Multisensory Processes, eds MurrayM.WallaceM. (Boca Raton, FL: CRC Press/Taylor & Francis), 1530.

  • 11

    ChalkM.GutkinB.DenèveS. (2016). Neural oscillations as a signature of efficient coding in the presence of synaptic delays. eLife5:e13824. 10.1101/034736

  • 12

    CheongR.LevchenkoA. (2010). Oscillatory signaling processes: the how, the why and the where. Curr. Opin. Genet. Dev.20, 665669. 10.1016/j.gde.2010.08.007

  • 13

    ColeS. R.VoytekB. (2017). Brain oscillations and the importance of waveform shape. Trends Cogn. Sci.21, 137149. 10.1016/j.tics.2016.12.008

  • 14

    CorbettaM. (2012). Functional connectivity and neurological recovery. Dev. Psychobiol.54, 239253. 10.1002/dev.20507

  • 15

    CorbettaM.ShulmanG. L. (2011). Spatial neglect and attention networks. Annu. Rev. Neurosci.34, 569599. 10.1146/annurev-neuro-061010-113731

  • 16

    DamasioA. R. (1999). The Feeling of What Happens: Body and Emotion in the Making of Consciousness.Orlando, FL: Harcourt.

  • 17

    DiederichA.ColoniusH.BockhorstD.TabelingS. (2003). Visual-tactile spatial interaction in saccade generation. Exp. Brain Res.148, 328337. 10.1007/s00221-002-1302-7

  • 18

    DriverJ.VuilleumierP. (2001). Perceptual awareness and its loss in unilateral neglect and extinction. Cognition79, 3988. 10.1016/s0010-0277(00)00124-4

  • 19

    EdelmanG. M.GallyJ. A.BaarsB. J. (2011). Biology of consciousness. Front. Psychol.2:4. 10.3389/fpsyg.2011.00004

  • 20

    EmadiN.RajimehrR.EstekyH. (2014). High baseline activity in inferior temporal cortex improves neural and behavioral discriminability during visual categorization. Front. Syst. Neurosci.8:218. 10.3389/fnsys.2014.00218

  • 21

    EngelA. K.SingerW. (2001). Temporal binding and the neural correlates of sensory awareness. Trends Cogn. Sci.5, 1625. 10.1016/s1364-6613(00)01568-0

  • 22

    FarthingW. G. (1992). The Psychology of Consciousness.New York, NY: Prentice-Hall.

  • 23

    FingelkurtsA.FingelkurtsA. (2017). Information flow in the brain: ordered sequences of metastable states. Information8:22. 10.3390/info8010022

  • 24

    FingelkurtsA. A.FingelkurtsA. A. (2001). Operational architectonics of the human brain biopotential field: towards solving the mind-brain problem. Brain Mind2, 261296. 10.1023/:1014427822738

  • 25

    FingelkurtsA. A.FingelkurtsA. A. (2015). “Attentional state: from automatic detection to willful focused concentration,” in Attantion and Meaning. The Attentional Basis of Meaning, eds MarchettiG.BenedettiG.AlharbiA. (New york, NY: Nova Science Publishers), 133150.

  • 26

    FingelkurtsA. A.FingelkurtsA. A.Kallio-TamminenT. (2016). Long-term meditation training induced changes in the operational synchrony of default mode network modules during a resting state. Cogn. Process17, 2737. 10.1007/s10339-015-0743-4

  • 27

    FingelkurtsA. A.FingelkurtsA. A.KrauseC. M.MöttönenR.SamsM. (2003). Cortical operational synchrony during audio-visual speech integration. Brain Lang.85, 297312. 10.1016/s0093-934x(03)00059-2

  • 28

    FingelkurtsA. A.FingelkurtsA. A.NevesC. F. H. (2010). Natural world physical, brain operational and mind phenomenal space-time. Phys. Life Rev.7, 195249. 10.1016/j.plrev.2010.04.003

  • 29

    FingelkurtsA. A.FingelkurtsA. A.NevesC. F. H. (2013). Consciousness as a phenomenon in the operational architectonics of brain organization: Criticality and self-organization considerations. Chaos Solitons Fractals55, 1331. 10.1016/j.chaos.2013.02.007

  • 30

    FogliaL.WilsonR. A. (2013). Embodied cognition. Wiley Interdiscip. Rev. Cogn. Sci.4, 319325. 10.1002/wcs.1226

  • 31

    FoxM. D.SnyderA. Z.ZacksJ. M.RaichleM. E. (2005). Coherent spontaneous activity accounts for trial-to-trial variability in human evoked brain responses. Nat. Neurosci.9, 2325. 10.1038/nn1616

  • 32

    FrassinettiF.BologniniN.LàdavasE. (2002). Enhancement of visual perception by crossmodal visuo-auditory interaction. Exp. Brain Res.147, 332343. 10.1007/s00221-002-1262-y

  • 33

    FreemanW. J.HolmesM. D. (2005). Metastability, instability and state transition in neocortex. Neural Netw.18, 497504. 10.1016/j.neunet.2005.06.014

  • 34

    FreemanW. J.VitielloG. (2006). Nonlinear brain dynamics as macroscopic manifestation of underlying many-body field dynamics. Phys. Life Rev.3, 93118. 10.1016/j.plrev.2006.02.001

  • 35

    FriesP. (2005). A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends Cogn. Sci.9, 474480. 10.1016/j.tics.2005.08.011

  • 36

    FriesP. (2009). Neuronal gamma-band synchronization as a fundamental process in cortical computation. Annu. Rev. Neurosci.32, 209224. 10.1146/annurev.neuro.051508.135603

  • 37

    GhazanfarA. A.SchroederC. E. (2006). Is neocortex essentially multisensory?Trends Cogn. Sci.10, 278285. 10.1016/j.tics.2006.04.008

  • 38

    HeckD. H.McafeeS. S.LiuY.Babajani-FeremiA.RezaieR.FreemanW. J.et al. (2017). Breathing as a fundamental rhythm of brain function. Front. Neural Circuits10:115. 10.3389/fncir.2016.00115

  • 39

    HerreroJ. L.KhuvisS.YeagleE.CerfM.MehtaA. D. (2018). Breathing above the brain stem: volitional control and attentional modulation in humans. J. Neurophysiol.119, 145159. 10.1152/jn.00551.2017

  • 40

    HerrmannC. S.MunkM. H. J.EngelA. K. (2004). Cognitive functions of gamma-band activity: memory match and utilization. Trends Cogn. Sci.8, 347355. 10.1016/j.tics.2004.06.006

  • 41

    HusserlE. (1952). “Ideen zu Einer Reinen Phänomenologie und Phänomenologischen Philosophie II,” in Husserliana Bd. 4.Den Haag: Nijhoff.

  • 42

    HyafilA.GiraudA.-L.FontolanL.GutkinB. (2015). Neural cross-frequency coupling: connecting architectures, mechanisms and functions. Trends Neurosci.38, 725740. 10.1016/j.tins.2015.09.001

  • 43

    IachiniT.RuggieroG.ConsonM.TrojanoL. (2009). Lateralization of egocentric and allocentric spatial processing after parietal brain lesions. Brain Cogn.69, 514520. 10.1016/j.bandc.2008.11.001

  • 44

    IemiL.ChaumonM.CrouzetS. M.BuschN. A. (2017). Spontaneous neural oscillations bias perception by modulating baseline excitability. J. Neurosci.37, 807819. 10.1523/JNEUROSCI.1432-16.2017

  • 45

    JerathR.BeveridgeC. (2018). Top mysteries of the mind: insights from the default space model of consciousness. Front. Hum. Neurosci.12:162. 10.3389/fnhum.2018.00162

  • 46

    JerathR.CearleyS. M.BarnesV. A.Nixon-ShapiroE. (2016). How lateral inhibition and fast retinogeniculo-cortical oscillations create vision: a new hypothesis. Med. Hypotheses.96, 2029. 10.1016/j.mehy.2016.09.015

  • 47

    JerathR.CrawfordM. W. (2014). Neural correlates of visuospatial consciousness in 3D default space: Insights from contralateral neglect syndrome. Conscious Cogn.28, 8193. 10.1016/j.concog.2014.06.008

  • 48

    JerathR.CrawfordM. W. (2015). Layers of human brain activity: a functional model based on the default mode network and slow oscillations. Front. Hum. Neurosci.9:248. 10.3389/fnhum.2015.00248

  • 49

    JerathR.CrawfordM. W.BarnesV. A. (2015). A unified 3D default space consciousness model combining neurological and physiological processes that underlie conscious experience. Front. Psychol.6:1204. 10.3389/fpsyg.2015.01204

  • 50

    JonesE. G. (2007). The Thalamus.Cambridge, MA: Cambridge University Press.

  • 51

    KayserC.LogothetisN. K. (2007). Do early sensory cortices integrate cross-modal information?Brain Struct. Funct.212, 121132. 10.1007/s00429-007-0154-0

  • 52

    KayserC.PetkovC. I.LogothetisN. K. (2008). Visual modulation of neurons in auditory cortex. Cereb. Cortex18, 15601574. 10.1093/cercor/bhm187

  • 53

    KelsoJ. A. S.TognoliK. (2007). “Toward a complementary neuroscience: metastable coordination dynamics of the brain,” in Neurodynamics of Cognition and Consciousness. Understanding Complex Systems, eds PerlovskyL.KozmaR. (Berlin, Heidelberg: Springer), 3959.

  • 54

    KerkhoffG. (2001). Spatial hemineglect in humans. Prog. Neurobiol.63, 127. 10.1016/s0301-0082(00)00028-9

  • 55

    KnyazevG. G. (2012). EEG delta oscillations as a correlate of basic homeostatic and motivational processes. Neurosci. Biobehav. Rev.36, 677695. 10.1016/j.neubiorev.2011.10.002

  • 56

    KoepsellK.WangX.HirschJ. A.SommerF. T. (2010). Exploring the function of neural oscillations in early sensory systems. Front. Neurosci.4:53. 10.3389/neuro.01.010.2010

  • 57

    Koster-HaleJ.BednyM.SaxeR. (2014). Thinking about seeing: perceptual sources of knowledge are encoded in the theory of mind brain regions of sighted and blind adults. Cognition133, 6578. 10.1016/j.cognition.2014.04.006

  • 58

    LakatosP.ShahA. S.KnuthK. H.UlbertI.KarmosG.SchroederC. E. (2005). An oscillatory hierarchy controlling neuronal excitability and stimulus processing in the auditory cortex. J. Neurophysiol.94, 19041911. 10.1152/jn.00263.2005

  • 59

    LiuX.ZhuX.-H.ChenW. (2011). Baseline BOLD correlation predicts individuals’ stimulus-evoked BOLD responses. Neuroimage54, 22782286. 10.1016/j.neuroimage.2010.10.001

  • 60

    LlinásR.RibaryU.ContrerasD.PedroarenaC. (1998). The neuronal basis for consciousness. Philos. Trans. R. Soc. Lond. B Biol. Sci.353, 18411849. 10.1098/rstb.1998.0336

  • 61

    LlinásR. R.LeznikE.UrbanoF. J. (2002). Temporal binding via cortical coincidence detection of specific and nonspecific thalamocortical inputs: A voltage-dependent dye-imaging study in mouse brain slices. Proc. Natl. Acad. Sci. U S A99, 449454. 10.1073/pnas.012604899

  • 62

    LlinásR. R.RibaryU. (1994). Perception as an Oneiric-Like State Modulated by the Senses [Online].Cambridge, MA: The MIT Press.

  • 63

    LovelaceC. T.SteinB. E.WallaceM. T. (2003). An irrelevant light enhances auditory detection in humans: a psychophysical analysis of multisensory integration in stimulus detection. Brain Res. Cogn.17, 447453. 10.1016/s0926-6410(03)00160-5

  • 64

    McgurkH.MacdonaldJ. (1976). Hearing lips and seeing voices. Nature264, 746748.

  • 65

    MenonS.SinhaA.SreekantanB. V. (2013). Interdisciplinary Perspectives on Consciousness and the Self.New York, NY: Springer.

  • 66

    MetzingerT. (2003). Being No-One.Cambridge, MA: MIT Press.

  • 67

    MolholmS.RitterW.MurrayM. M.JavittD. C.SchroederC. E.FoxeJ. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn.14, 115128. 10.1016/s0926-6410(02)00066-6

  • 68

    MontoS.PalvaS.VoipioJ.PalvaJ. M. (2008). Very slow EEG fluctuations predict the dynamics of stimulus detection and oscillation amplitudes in humans. J. Neurosci.28, 82688272. 10.1523/JNEUROSCI.1910-08.2008

  • 69

    MurphyN.BrownW. (2007). Did My Neurons Make Me Do It? Philosophical and Neurobiological Perspectives on Moral Responsibility and Free Will.Oxford: Oxford University Press.

  • 70

    NoesseltT.RiegerJ. W.SchoenfeldM. A.KanowskiM.HinrichsH.HeinzeH.-J.et al. (2007). Audio-visual temporal correspondence modulates multisensory superior temporal sulcus plus primary sensory cortices. J. Neurosci.27, 1143111441. 10.1523/jneurosci.2252-07.2007

  • 71

    OizumiM.AlbantakisL.TononiG. (2014). From the phenomenology to the mechanisms of consciousness: integrated information theory 3.0. PLoS Comput. Biol.10:e1003588. 10.3389/fpsyg.2018.00101

  • 72

    RaichleM. E.GusnardD. A. (2002). Appraising the brain’s energy budget. Proc. Natl. Acad. Sci. U S A99, 1023710239. 10.1073/pnas.172399499

  • 73

    RaichleM. E.SnyderA. Z. (2007). A default mode of brain function: a brief history of an evolving idea. Neuroimage37, 10831090. 10.1016/j.neuroimage.2007.02.041

  • 74

    RevonsuoA. (2003). The contents of phenomenal consciousness: one relation to rule them all and in the unity bind them. Psyche9:5. 10.3389/fnsyn.2011.00005

  • 75

    RevonsuoA. (2006). Inner Presence: Consciousness as a Biological Phenomenon.Cambridge, CA: MIT Press.

  • 76

    RevonsuoA.NewmanJ. (1999). Binding and Consciousness. Conscious. Cogn.8, 123127. 10.1006/ccog.1999.0393

  • 77

    SasakiT.AbeM.OkumuraE.OkadaT.KondoK.SekiharaK.et al. (2013). Disturbed resting functional inter-hemispherical connectivity of the ventral attentional network in alpha band is associated with unilateral spatial neglect. PLoS One8:e73416. 10.1371/journal.pone.0073416

  • 78

    SenkowskiD.SchneiderT. R.FoxeJ. J.EngelA. K. (2008). Crossmodal binding through neural coherence: implications for multisensory processing. Trends Neurosci.31, 401409. 10.1016/j.tins.2008.05.002

  • 79

    SenkowskiD.TalsmaD.GrigutschM.HerrmannC. S.WoldorffM. G. (2007). Good times for multisensory integration: Effects of the precision of temporal synchrony as revealed by gamma-band oscillations. Neuropsychologia45, 561571. 10.1016/j.neuropsychologia.2006.01.013

  • 80

    SiegelS. (2006). Direct realism and perceptual consciousness. Philos. Phenomenol. Res.73, 378410. 10.1111/j.1933-1592.2006.tb00623.x

  • 81

    SingerW. (2011). “Consciousness and neuronal synchronization,” in The Neurology of Consciousness: Cognitive Neuroscience and Neuropathology, eds LaureysS.TononiG. (New York, NY: Elsevier Science), 111488.

  • 82

    SingerW.EngelA. K.KreiterA. K.MunkM. H. J.NeuenschwanderS.RoelfsemaP. R. (1997). Neuronal assemblies: necessity, signature and detectability. Trends Cogn. Sci.1, 252261. 10.1016/s1364-6613(97)01079-6

  • 83

    SingerW.GrayC. M. (1995). Visual feature integration and the temporal correlation hypothesis. Annu. Rev. Neurosci.18, 555586. 10.1146/annurev.ne.18.030195.003011

  • 84

    SteinB. E.MeredithM. A.HuneycuttW. S.McdadeL. (1989). Behavioral indices of multisensory integration: orientation to visual cues is affected by auditory stimuli. J. Cogn. Neurosci.1, 1224. 10.1162/jocn.1989.1.1.12

  • 85

    SteriadeM.TimofeevI.GrenierF. (2001). Natural waking and sleep states: a view from inside neocortical neurons. J. Neurophysiol.85, 19691985. 10.1152/jn.2001.85.5.1969

  • 86

    StrauchI.MeierB. (1996). In Search of Dreams. Results of Experimental Dream Research.New York, NY: SUNY Press.

  • 87

    SupèrH.Van Der TogtC.SpekreijseH.LammeV. A. F. (2003). Internal state of monkey primary visual cortex (V1) predicts figure-ground perception. J. Neurosci.23, 34073414. 10.1523/jneurosci.23-08-03407.2003

  • 88

    TalsmaD.WoldorffM. G. (2005). Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J. Cogn. Neurosci.17, 10981114. 10.1162/0898929054475172

  • 89

    TongY.HockeL. M.NickersonL. D.LicataS. C.LindseyK. P.FrederickB. (2013). Evaluating the effects of systemic low frequency oscillations measured in the periphery on the independent component analysis results of resting state networks. Neuroimage76, 202215. 10.1016/j.neuroimage.2013.03.019

  • 90

    TononiG.BolyM.MassiminiM.KochC. (2016). Integrated information theory: from consciousness to its physical substrate. Nat. Rev. Neurosci.17, 450461. 10.1038/nrn.2016.44

  • 91

    TrehubA. (2007). Space, self and the theater of consciousness. Conscious. Cogn.16, 310330. 10.1016/j.concog.2006.06.004

  • 92

    TreismanA. (1996). The binding problem. Curr. Opin. Neurobiol.6, 171178.

  • 93

    TreismanA. (1999). Solutions to the binding problem: progress through controversy and convergence. Neuron24, 105110.

  • 94

    TyllS.BudingerE.NoesseltT. (2011). Thalamic influences on multisensory integration. Commun. Integr. Biol.4, 378381. 10.4161/cib.15222

  • 95

    VanhataloS.PalvaJ. M.HolmesM. D.MillerJ. W.VoipioJ.KailaK. (2004). Infraslow oscillations modulate excitability and interictal epileptic activity in the human cortex during sleep. Proc. Natl. Acad. Sci. U S A101, 50535057. 10.1073/pnas.0305375101

  • 96

    VargaS.HeckD. H. (2017). Rhythms of the body, rhythms of the brain: Respiration, neural oscillations and embodied cognition. Conscious. Cogn.56, 7790. 10.1016/j.concog.2017.09.008

  • 97

    WangW.HuL.CuiH.XieX.HuY. (2013). Spatio-temporal measures of electrophysiological correlates for behavioral multisensory enhancement during visual, auditory and somatosensory stimulation: A behavioral and ERP study. Neurosci. Bull.29, 715724. 10.1007/s12264-013-1386-z

  • 98

    WattR. J.PhillipsW. A. (2000). The function of dynamic grouping in vision. Trends Cogn. Sci.4, 447454.

  • 99

    WeiskrantzL. (1997). Consciousness Lost and Found: A Neuropsychological Exploration.New York, NY: Oxford University Press.

  • 100

    WidmannA.GruberT.KujalaT.TervaniemiM.SchrögerE. (2007). Binding symbols and sounds: evidence from event-related oscillatory gamma-band activity. Cereb. Cortex17, 26962702. 10.1093/cercor/bhl178

  • 101

    WutzA.MelcherD.SamahaJ. (2018). Frequency modulation of neural oscillations according to visual task demands. Proc. Natl. Acad. Sci. U S A115, 13461351. 10.1073/pnas.1713318115

  • 102

    YuanH.ZotevV.PhillipsR.DrevetsW. C.BodurkaJ. (2012). Spatiotemporal dynamics of the brain at rest–exploring EEG microstates as electrophysiological signatures of BOLD resting state networks. Neuroimage60, 20622072. 10.1016/j.neuroimage.2012.02.031

  • 103

    Yuval-GreenbergS.DeouellL. Y. (2007). What you see is not (always) what you hear: induced gamma band responses reflect cross-modal interactions in familiar object recognition. J. Neurosci.27, 10901096. 10.1523/jneurosci.4828-06.2007

Summary

Keywords

default space, binding problem, metastable, oscillations, consciousness, phenomenology, multimodal integration, neural synchronization

Citation

Jerath R and Beveridge C (2019) Multimodal Integration and Phenomenal Spatiotemporal Binding: A Perspective From the Default Space Theory. Front. Integr. Neurosci. 13:2. doi: 10.3389/fnint.2019.00002

Received

26 October 2018

Accepted

17 January 2019

Published

05 February 2019

Volume

13 - 2019

Edited by

Atsushi Iriki, RIKEN Center for Biosystems Dynamics Research, Japan

Reviewed by

Yong Gu, Institute of Neuroscience, Shanghai Institutes for Biological Sciences (CAS), China; Andrew A. Fingelkurts, BM-Science, Finland

Updates

Copyright

*Correspondence: Ravinder Jerath

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics