Skip to main content

PERSPECTIVE article

Front. Hum. Neurosci., 10 February 2023
Sec. Cognitive Neuroscience
Volume 17 - 2023 | https://doi.org/10.3389/fnhum.2023.1116501

Digitally embodied lifespan neurocognitive development and Tactile Internet: Transdisciplinary challenges and opportunities

  • 1Chair of Lifespan Developmental Neuroscience, Faculty of Psychology, Technische Universität Dresden, Dresden, Germany
  • 2Centre for Tactile Internet With Human-in-the-Loop, Technische Universität Dresden, Dresden, Germany
  • 3Deutsche Telekom Chair of Communication Networks, Faculty of Electrical and Computer Engineering, Technische Universität Dresden, Dresden, Germany

Mechanisms underlying perceptual processing and inference undergo substantial changes across the lifespan. If utilized properly, technologies could support and buffer the relatively more limited neurocognitive functions in the still developing or aging brains. Over the past decade, a new type of digital communication infrastructure, known as the “Tactile Internet (TI),” is emerging in the fields of telecommunication, sensor and actuator technologies and machine learning. A key aim of the TI is to enable humans to experience and interact with remote and virtual environments through digitalized multimodal sensory signals that also include the haptic (tactile and kinesthetic) sense. Besides their applied focus, such technologies may offer new opportunities for the research tapping into mechanisms of digitally embodied perception and cognition as well as how they may differ across age cohorts. However, there are challenges in translating empirical findings and theories about neurocognitive mechanisms of perception and lifespan development into the day-to-day practices of engineering research and technological development. On the one hand, the capacity and efficiency of digital communication are affected by signal transmission noise according to Shannon’s (1949) Information Theory. On the other hand, neurotransmitters, which have been postulated as means that regulate the signal-to-noise ratio of neural information processing (e.g., Servan-Schreiber et al., 1990), decline substantially during aging. Thus, here we highlight neuronal gain control of perceptual processing and perceptual inference to illustrate potential interfaces for developing age-adjusted technologies to enable plausible multisensory digital embodiments for perceptual and cognitive interactions in remote or virtual environments.

1. Introduction

Human perceptual and cognitive processes are embodied through the sensory systems and embedded in physical, technological, and socio-cultural contexts (Quartz, 1999; Clark, 2012). Through perceiving different types of sensory information (e.g., auditory, visual, and tactile) and behaving in various environments, humans learn through their experiences to adapt to contextual constraints and affordances. At the same time, humans also modify the environments to construct new conditions for their lives, to which eventually require new adaptations. In this manner, human development at the individual and societal levels necessitates co-constructive processes between adaptive neurobiological and psychological mechanisms, on the one hand, and collectively generated resources for supporting individual development and general human conditions, on the other hand (Li, 2003).

A powerful collective human capacity in such “niche construction” processes (cf., Laland et al., 1999) is technological advancements that bring forth new tools, instruments, and infrastructures to alter life conditions. Since the rise of modern computers in the 1940s (Ifrah, 2000), the continued developments in computer, telecommunication, and other digital technologies have created digital environments for human behaviors and the research about them. Over the past decades the Internet and World Wide Web (Wolinsky, 1999) have become key digital infrastructures for remote access and exchange of information via the visual and auditory modalities. Furthermore, technologies of virtual and augmented reality (VR and AR) provide a spectrum of digital contexts that not only have the potentials for medical, educational, and industrial applications (see Eden et al., 2022 for review), but also as research tools for lab-based experiments to allow well-controlled naturalistic studies of human behaviors (e.g., Brookes et al., 2020; Hofmann et al., 2021). However, these technologies currently still constrain the digitally embodied perception and cognition mainly to the visual and auditory modalities. To go beyond such limitations, the means of digital information processing and communication need to expand to also include other modalities.

1.1. Toward new technologies for digitally transmitted perception and cognition

Recent progresses in digital communication, sensor, and actuator technologies, as well as machine-learning algorithms have stipulated the emergence of a new type of digital communication infrastructure, known as the Tactile Internet (TI), that goes beyond audio-visual based information exchanges (see Simsek et al., 2019; Fitzek et al., 2021 for reviews). Specifically, the TI is defined as: “A network or network of networks for remotely accessing, perceiving, manipulating or controlling real or virtual objects or processes in perceived real time by humans or machines.” The TI technologies aim to enable digitally transmitted closed-loop human-human or human-machine interactions in quasi real time by providing new multisensory interaction avenues for broad populations of users to experience and control remote, VR/AR, or other combinations of digitalized environments (Figure 1). Such interaction interfaces include, but not limited to, digitalized haptic (tactile and kinesthetic) information and cyber physical systems (CPS, i.e., systems of software and devices).

FIGURE 1
www.frontiersin.org

Figure 1. Schematic diagram of digitally transmitted closed-loop perceptual and cognitive interactions between humans and cyber physical systems (CPS) supported by Tactile Internet (TI) technologies [parts of the image are adapted from the authors’ work, Li et al., 2021, Copyright Elsevier 2021; the image of the senior female is a modification of royalty-free content with usage licence, credit: Prostock-studio/shutterstock.com].

When TI technologies are advanced enough to provide plausible digital sensory augmentations and stable remote interactions in quasi-real time, they could be applied to support human behavior in daily lives, particularly for populations whose perceptual and cognitive processes are either still undergoing development or affected by aging-related declines. Immersive VR, AR, or mixed-reality technologies may also open new solutions for designing more naturalistic experimental studies for cognitive neuroscience research. However, a key challenge in developing such technologies lies in concretely realizing the “human-in-the-loop” approach (Schirner et al., 2013) to integrate principles of human perception and cognition into engineering research and technological development. To this end, the research on lifespan neurocognitive development needs to take up transdisciplinary challenges of collaborating with the engineering fields of sensor and actuator as well as telecommunication technologies, beyond usual collaborations with cognitive scientists, neurobiologists, and medical researchers.

1.2. Digitally embodied closed-loop perceptual and cognitive interactions

Through TI technologies and the more recent vision of digitalized immersive 3D realms known as Metaverse (e.g., Al-Ghaili et al., 2022; Mystakidis, 2022; Rostami and Maier, 2022), the embodiments of human perceptual and cognitive processes would frequently be interacting with digitalized multisensory signals including haptics. Such “digital embodiments” raise challenges for digitalizing sensory signals in ways that preserve key stimulus characteristics for humans to sense and perceive, while not overburdening the latency and capacity requirements on the telecommunication networks that transmit these signals (e.g., Steinbach et al., 2018; Noll et al., 2022). The requirement of low latency is particularly important for remote closed-loop interactions to operate in a quasi-real-time manner and remain stable (e.g., Bachhuber and Steinbach, 2015). Another challenge is that the digitalized signals may not be perceived equally well and plausible either by the same person in different situational contexts or by people of different ages. Thus, it is important to integrate psychophysical and neurocognitive mechanisms of multisensory perception (e.g., Ernst and Banks, 2002; see Ernst and Bülthoff, 2004; Macaluso and Driver, 2005 for reviews) as well as their development and aging (Burr and Gori, 2012; Li and Rieckmann, 2014; Stein et al., 2014; Klever et al., 2019; Nava et al., 2020; Jones and Noppeney, 2021) into the very processes of designing sensor, augmentation, and network technologies for digitally transmitted perceptual and cognitive interactions.

2. Noise in digital communication and neuronal gain control of human information processing

Neither humans nor the CPS can be expected to “perceive and act” with perfect precision under all conditions. Sensory or sensor noise as well as process unreliability and delays are inevitable, be it from the biological or technological systems (Figure 2A). The potential amplifications of multiple sources of noise, unreliability, and delays are big challenges for realizing real-time digitally transmitted remote human-human or human-machine interactions that also entail haptic signals.

FIGURE 2
www.frontiersin.org

Figure 2. Interfaces for transdisciplinary research. (A) Digitally embodied closed-loop human-machine or human-human communication system in the presence of physical and biological noise. (B) Varying values of the G parameter of artificial neurons simulates dopaminergic neuronal gain control of neural information processing in younger and older adults (see text and Li et al., 2001, 2006 for details). (C) The speed and robustness of cognitive and perceptual processing vary across the lifespan [see text for details; figure plotted with data from the author’s work Li et al. (2004)]. (D) Inter-trial phase coherence of EEG frontal theta activities differs across the lifespan [see text for details. Images adapted from Papenberg et al. (2013), with permission, Copyright Elsevier 2013]. (E) Assessing cortical processes of contextual expectancy modulation of tactile perception using fNIRS in a virtual driving environment with audio-visual scenes of different road types (shown here is a scenario of driving on smooth road). (F) Plausible vibrotactile stimulations at a lower intensity but confirm with contextual expectation based on audio-visual information in the virtual driving scene elicited greater cortical responses in the sensorimotor cortex than implausible stimulations at a higher intensity [see text for details; images in (E) and (F) are adapted with permission from Kang et al. (2022), Communications Biology, 5:1360, 1–13].

The fact that noise attenuates signal resolution and the capacity of digital communication channels (e.g., Diggavi and Cover, 2001; van Wyk et al., 2021) is well known since Shannon’s (1949) classical information theory. During digitally transmitted closed-loop interactions, other than channel noise arising from telecommunication infrastructures, fluctuations in neural information processing are an intrinsic noise source in the brains (Manwani and Koch, 1999; Deco et al., 2009; Ferguson and Cardin, 2020) of the human information senders and receivers. It is, therefore, important to consider mechanisms that regulate neural information processing fidelity and how they may change during brain development and aging, since the new TI and related technologies envision to support broad populations of users.

Sensory signals usually can be noisy and the perceptual environments entail certain degrees of uncertainty (Ernst and Bülthoff, 2004). The human brains carry out complex computations to process sensory signals from the environment for us to consciously perceive and form internal models about important aspects of the surrounding world, which then allow us to make perceptual inferences for guiding behavior (e.g., Friston et al., 2012; Hoffman, 2019). Besides propagating activation potentials (i.e., nerve impulses in the form of tiny electric charges in the range of millivolts) through the axons in neurons, neural information processing also requires chemical signal transmissions between neurons. A variety of chemical substances, known as neurotransmitters, carry signals for information exchanges between neurons (see Hyman, 2005 for review). It is estimated that the human brain has about 1011 neurons, with each having 1,000–10,000 synapses, also known as connections (Azevedo et al., 2009; Zimmer, 2011). Electrical and neurochemical communications between neurons occur at the around 1014–1015 synapses the human adult brain has (Pereda, 2014).

Among the various neurotransmitters, dopamine is the focus here for several reasons. First, other than striatal dopamine’s well-known role in signaling reward values (Schultz, 2016), it also codes sensory and motor information (Engelhard et al., 2019) and regulate top-down cognitive control functions (Ott and Nieder, 2019). Together these make the dopamine system important for cognitive and perceptual functions (Lerner et al., 2021). Second, computational theories of neuronal gain control suggest that dopamine plays important roles in regulating the signal-to-noise ratio (SNR) of neural information processing (Figure 2B; Li et al., 2001; Servan-Schreiber et al., 1990) and in regulating the balance between bottom-up sensory saliency and top-down prior expectations during perceptual processing and inference (Friston et al., 2012; Pezzulo et al., 2018). Third, empirical evidence shows that dopamine affects performance fluctuations and the precision of brain activities (e.g., MacDonald et al., 2012; Yousif et al., 2016). Fourth, dopamine modulation is important for tactile perception (e.g., de Lafuente and Romo, 2011) and changes across the lifespan (see Li and Rieckmann, 2014 for review).

2.1. Lifespan development of dopaminergic gain control of processing fidelity

Empirical data based on receptor imaging of children or adolescents (e.g., Jucaite et al., 2005) are very scarce, due to the use of radioactive ligands in such imaging technique. However, non-invasive techniques of assessing protein expressions of dopamine receptors have shown very gradual development of dopamine receptors. After birth, protein expressions of the dopamine D1 receptor, important for top-down cognitive control and working memory functions in the prefrontal cortex (Takahashi et al., 2012), undergo gradual increase during childhood and adolescence and only reach the highest level in young adulthood (Rothmond et al., 2012). As for aging-related decline, accumulated receptor imaging findings indicate that although dopamine synthesis capacity is not affected much by aging (Karrer et al., 2017), the densities of dopamine D1 and D2 receptors as well as the presynaptic dopamine transporter (DAT) decline substantially during adulthood, with estimates of about 10% receptor losses per decade, starting from mid 20s (Erixon-Lindroth et al., 2005; Inoue et al., 2001; Kaasinen and Rinne, 2002).

Other than modeling dopamine as the reward prediction signal as in reinforcement learning algorithms (Dayan and Niv, 2008; Glimcher, 2011), dopaminergic modulation has also been modeled as neuronal gain control of the SNR of information transmission between neurons. Specifically, the gain (G) parameter of the sigmoidal (also termed logistic) input-output function (Figure 2B) can be adjusted to simulate individual (e.g., Servan-Schreiber et al., 1990) or age-related differences in dopamine levels (e.g., Li et al., 2001, 2006). Lowering the values of the G parameter to simulate lower levels of dopamine receptors in aging brains (Kaasinen et al., 2000; Erixon-Lindroth et al., 2005) reduces the slopes and non-linearity of the sigmoidal function, which consequently reduces the SNR of activation propagations across layers of simulated artificial neurons and limits their computational complexity (Li and Sikström, 2002). Functionally, attenuating gain control in neural network models results in lower processing fidelity that is reflected in larger activation fluctuations when responding to identical inputs as well as less distinctive internal activation patterns stored in the network’s connections that are triggered by different external input stimuli (Li and Sikström, 2002). Moreover, a net effect of varying the slope and the continuous non-linearity of the sigmoidal function by either reducing or excessively increasing the G parameter also constraints the network’s memory storage capacity (see Li and Rieckmann, 2014 for review), which is in line with the empirically observed inverted-U function of dopamine modulation of frontal cognitive processes (Cools and D’Esposito, 2011). Given these computational effects, it can be surmised that the gradual development of dopamine D1 receptor protein and aging-related declines of dopamine receptors suggest, respectively, less mature or declined neuronal gain control of information transmissions in developing and aging brains. These would have functional consequences on behavioral and brain processing fidelity.

Indeed, not only that cognitive and perceptual processing speed is slower in children and older adults, their processing speeds also fluctuate more across time (Figure 2C; Li et al., 2004; Papenberg et al., 2013). This reflects less reliable or less robust information processing in terms of brain dynamics measured with electroencephalography (EEG). For instance, the inter-trial phase coherence reflecting synchronicity of neuronal activities across time is lower in children, adolescents, and older adults than in younger adults (Figure 2D). Furthermore, within each of age groups lower levels of EEG synchronicity are associated with less reliable processing speed, indicating that higher behavioral fluctuations reflect lower temporal precision of brain electrophysiological activities (Papenberg et al., 2013).

2.2. Dopaminergic modulation of tactile perception

The impacts of dopamine and other related monoaminergic transmitters (serotonin and noradrenaline) on the coding and subsequent perception of sensory signals have been investigated with respect to different modalities in animals (Bao et al., 2004; Engelhard et al., 2019; see Jacob and Nienborg, 2018 for review) and in humans (e.g., Li et al., 2013; Yousif et al., 2016; Beste et al., 2018; Bang et al., 2020). We focus here on its role in modulating tactile perception.

Evidence from animal research shows that when detecting vibrotactile stimulations, the firing rates of neurons in several brain regions of Rhesus monkeys vary with the intensities and temporal characteristics of the vibrotactile signals (Lebedev et al., 1994; de Lafuente and Romo, 2006). Moreover, while anticipating the stimuli, the firing rate of midbrain dopamine neurons codes the uncertainty about the presence or absence of the tactile signals (de Lafuente and Romo, 2005) and reflects stimulation amplitude when the presence of a tractile stimulus is detected, indicating that dopamine modulates subjective tactile experiences (de Lafuente and Romo, 2011). The response time course of midbrain dopamine neurons during vibrotactile perception matches more closely to the onset of perceptual processes in the frontal premotor cortex (de Lafuente and Romo, 2005), instead of neuronal activities in the somatosensory cortex (de Lafuente and Romo, 2011). Together, these findings indicate that dopamine neurons underlie (i) the subjective experience of the perceived, rather than mere sensory, aspects of tactile signals and (ii) the regulation of inherent uncertainty during perceptual processing and inference. Furthermore, evidence from a recent receptor imaging study (Schneider et al., 2019) with a larger sample of monkeys also shows that the binding potentials of dopamine receptors (D1 and DAT) correlate with behavioral responsivity to tactile stimuli. Human pharmacological research also found that increasing the level of monoamines in the brain by administering amphetamine increases perceptual and cortical plasticity of tactile learning (Dinse et al., 2003).

3. Contextual expectancy and plausible sensory augmentation

Besides effects of neuronal gain control on sensory coding precision, the perceptual system needs to infer the most likely percept the sensory signals may represent. A principle of perception since Helmholtz’s (1857) classical view is that perception is guided by expectations that are based on prior experiences in similar contexts. In modern cognitive science, it is also recognized that external sensory signals alone are not sufficient to represent reality, instead individuals are conscious agents whose experiences may guide perceptual processing of sensory inputs to construct and reconstruct the perceived reality (Hoffman, 2019). Multisensory perception could be driven by low-level stimulus properties (e.g., temporal contingency, spatial congruence) or high-level contextual information (e.g., semantic relatedness, situational schemas, or multisensory scene context). Furthermore, the bottom-up sensory signals and top-down expectations interact during perception (Ernst and Bülthoff, 2004; Chen and Spence, 2010; Deroy et al., 2016; Gau and Noppeney, 2016; de Lange et al., 2018). Bayesian inference theories of perception and action posit that, through regulating the SNR of information processing, dopamine also influences the balance between a person’s prior expectations in a certain situational context and the saliency of sensory inputs from the environment (Friston et al., 2012; Pezzulo et al., 2018). Pathologies involving malfunctions of the dopamine system could result in a faulty bias of overweighting prior expectations, which lead to hallucinatory percepts such as in the cases of schizophrenia (Cassidy et al., 2018) or Parkinson’s disease (Collerton et al., 2012).

3.1. Contextual expectations modulate multisensory perception

Impacts of contextual expectancy on multisensory perception have been investigated in several modalities. For instance, when processing audio-visual stimuli, hearing semantically related auditory information (e.g., a barking sound) triggers the expectation of a certain animal (e.g., image of a dog) and enhances the identification of unclear or degraded visual images (Chen and Spence, 2010). As for visual-taste perception, seeing colors that confirm with the expectations of flavors of certain fruits enhances the accuracy of flavor perception (Spence et al., 2010). Furthermore, past studies also indicated that expectancy could induce changes in perceptual representations beyond just biasing the threshold of perceptual decisions. Cortical responses in the primary taste cortex after drinking mildly sweet drinks are stronger when individuals are led to expect a very sweet drink relative to without such an expectation (Woods et al., 2011). In terms of pain perception, which could be shaped by multisensory signals (Senkowski et al., 2014), a placebo drug for presumed pain relief was found to yield lower responses in brain regions of pain processing (e.g., thalamus and insula) and enhance activities in prefrontal regions associated with the anticipation of pain. Negative correlations between placebo-induced increase of cortical activities in the frontal expectancy regions and placebo-induced reduction of activities in regions of pain processing suggest that contextual expectations modulate pain perception (Wager et al., 2004).

3.2. Toward neurocognitive mechanisms of plausible tactile augmentation

Thus far, evidence for expectancy modulation of tactile perception is much scarcer than for other modalities. However, a recent study manipulated contextual congruency between audio-visual information of driving scenes and the intensity of vibrotactile augmentation in a VR environment to investigate cortical processes underlying plausible sensory augmentation in young adults (Kang et al., 2022). Videos of driving scenes with smooth (e.g., highway) or rough (e.g., cobblestone) road surfaces along with the corresponding audio sounds were paired either with strong or low vibrotactile stimulations delivered from a car seat (Figure 2E). Cortical activities in the frontal and sensorimotor regions that were measured with functional near-infrared-spectroscopy (fNIRS) were found to be stronger when responding to plausible vibrotactile stimulations with intensities at levels that could be expected, given the audio-visual information in the virtual scenarios. In line with findings for other sensory modalities, contextual expectancy in this case also affected tactile perceptual representations. Vibrotactile stimulations of a lower intensity but confirms with contextual expectations based on audio-visual information resulted in greater cortical activities in the sensorimotor cortex than stronger but implausible stimulations (Figure 2F). Furthermore, frontal activities under expected scenarios correlate negatively with expectation violation costs in the sensorimotor cortex, which indicate frontal top-down expectancy regulation of tactile perceptual representation.

The extent to which virtual events conform to human expectations – i.e., the concept of plausibility – is a commonly used criterion for constructing virtual environments that could be perceived as sufficiently realistic (Slater, 2009). The notion of defining the “plausibility” of virtual events in relation to the person’s expectations in VR research is very much in line with Bayesian theories and empirically observed effects of expectancy modulation of perception. Further transdisciplinary collaborations between neurocognitive research on expectancy modulation of perception and sensing/actuating technologies for VR/AR applications would be helpful to understand mechanisms underlying (multi)sensory augmentations for designing plausible digital embodiments. Besides machine-learning algorithms and network communication infrastructures, these technologies are also crucial components for the envisioned Metaverse (e.g., see Al-Ghaili et al., 2022 for review), which aims at developing digitalized immersive 3D realms that can flexibly combine real and different types of virtual environments (AR and mixed-reality) for multi-agent (human-human and human-machine) exchanges. In this regard, perceptual and lifespan developmental neuroscience research could guide the designs of AR/VR devices and other mixtures of digitalized environments to suit the neurocognitive functions of broad populations of users. Below, we highlight two lines of collaborative interfaces.

For instance, it has been demonstrated that empirical data of human psychophysical studies of perceptual judgments help the selection of different tactile codecs (e.g., Muschter et al., 2021), i.e., protocols for compressing digitalized tactile signals, for standardization. However, as of yet, it is not clear whether compressed tactile signals can be perceived equally well by people of different ages. A recent pilot study with a small sample of younger and older adults showed lager between-person differences in perceptual judgments of compressed vibrotactile signals in older than in younger adults, indicating that a given tactile codec might not yield satisfactory performance for all users in the older populations (Muschter et al., 2022). Given dopamine’s role of neuronal gain control affecting the SNR of neural information processing (Servan-Schreiber et al., 1990; Li et al., 2001, 2006), its function in coding uncertainty and amplitude of tactile stimulations (de Lafuente and Romo, 2006, 2011), as well as the clear aging-related declines of dopamine receptors (Kaasinen et al., 2000; Erixon-Lindroth et al., 2005), a potential interface is to conduct systematic age-comparative studies of perceptual judgments of compressed sensory information by different haptic codecs (Steinbach et al., 2018) to provide empirical data for age-adjusted codec designs and standardization.

Another potential interface is collaborative research on the design of plausible multisensory experiences in AR/VR or other mixtures of digital environments as envisioned in Metaverse (e.g., Al-Ghaili et al., 2022). In this regard, neurocognitive mechanisms of contextual expectancy-based multisensory perception presented above (Kang et al., 2022) is a starting point for further studies on foundations for plausible subjective experiences in digitalized environments. The frontal cortex underlying top-down expectancy-based control decline substantially during aging at the anatomical (e.g., Raz et al., 2005), functional (e.g., Nyberg et al., 2010), and neurochemical (e.g., Kaasinen et al., 2000; see Li and Rieckmann, 2014) levels. Moreover, the trade-off of dopamine modulation in the frontal and striatal regions underlie effects of uncertainty and prior expectations on cognitive control of flexible behavior (Daw et al., 2005) as well as perceptual inference (Friston et al., 2012; Cassidy et al., 2018). Thus, systematic collaborative age-comparative research on neurocognitive correlates of plausible perceptual experiences in AR/VR would be helpful for further developing other 3D immersive digital environments.

4. Concluding remark: Toward age-adjusted digital embodiment technologies

Current advancements in several subfields of TI technologies aim to develop new digital infrastructures to also integrate haptic signals for humans to remotely interact with other humans or machines, beyond just being able to hear or see the interaction partners. These technologies bare the potentials in generating new ways of supporting different aspects of human life, including applications in educational settings and gerontological care. However, current issues regarding plausible renderings of digitalized multisensory signals as well as network requirements in the speed, capacity, and reliability of transmitting large amounts of multisensory data are challenges that need to be resolved. Furthermore, age-related differences in perceptual and cognitive functions are usually not systematically evaluated en route to technological developments, which may limit the scope of potential user populations. As presented here, since the efficacy of dopaminergic modulation matures rather gradually during development and decline substantially during aging, the precision of registering and making perceptual inference of digitalized sensory signals would also be lower in these populations. It is thus important to systematically scrutinize age-related differences in neuromodulation of perceptual processing and perceptual inference, particularly in multisensory tasks involving the haptic sense, to inform age-adjusted development of TI technologies that can also support children and seniors in digitally embodied perceptual and cognitive interactions.

Other than the two potential interfaces selectively highlighted in this paper, collaborative research on lifespan differences in mechanisms underlying the perception of social affective touch (e.g., Croy et al., 2019; McIntyre et al., 2021) is another interface for developing actuation technologies of touch (e.g., Muthukumarana et al., 2020) that are important for digitally transmitted social interactions. In addition, besides the plausibility of digitalized sensory signals, the subjective feeling of personal presence is another ingredient for creating immersive digital environments. In this regard, cognitive neuroscience research that compare peri-personal space and body illusion in real and virtual environments offer another potential interface (see Serino, 2019 for review). Lastly, cognitive and neuroscience research on representations of joint action (see Shea et al., 2014; Prinz, 2015; for review) and the associated age differences (e.g., Keitel et al., 2014) as well as the research on making active inference in social situations (e.g., Friston and Frith, 2015; Hipólito and van Es, 2022) is another interface for designing algorithms for digitally transmitted multi-person/agent interactions.

Data availability statement

The original contributions presented in this perspective article are included in the references, further information can be directed to the corresponding author.

Author contributions

S-CL and FF collaborated extensively in several transdisciplinary projects, edited the manuscript together and approved the submitted version. S-CL drafted the manuscript based on their collaborations. Both authors contributed to the article and approved the submitted version.

Funding

S-CL and FF are funded by the German Research Foundation (DFG, Deutsche Forschungsgemeinschaft) as part of Germany’s Excellence Strategy – EXC 2050/1 – Project ID 390696704 – Cluster of Excellence “Centre for Tactile Internet with Human-in-the-Loop (CeTI)” of Technische Universität Dresden and by the Federal Ministry of Education and Research of Germany in the programme of “Souverän. Digital. Vernetzt.” Joint project 6G-life, project identification number: 16KISK001K. This publication was funded by the joint publication fund of the TU Dresden, the Medical Faculty Carl Gustav Carus, and the SLUB Dresden.

Acknowledgments

We thank collaborators and associated members of the Centre of Tactile Internet with Human-in-the Loop whose work are reviewed in this article, particularly Ercan Altinsoy, Basak Gülecyüz, Kathleen Kang, Kaan Karan, Evelyn Muschter, Andreas Noll, Eckehard Steinbach, and Robert Rosenkranz. We also thank the graphic design team from the Chair of Industrial Design Engineering for some of the included images. S-CL thanks also former collaborators, particularly Goran Papenberg and Dorothea Hämmerer, whose work on lifespan age differences in EEG synchronicity and reaction time fluctuations is reviewed here.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Al-Ghaili, A. M., Kasim, H., Al-Hada, N. M., Hassan, Z., Othman, M., Hussain, T. J., et al. (2022). A review of metaverse’s definitions, architecture, applications, challenges, issues, solutions, and future trends. IEEE Access 10, 125835–125866. doi: 10.1109/ACCESS.2022.3225638

CrossRef Full Text | Google Scholar

Azevedo, F. A., Carvalho, L. R., Grinberg, L. T., Farfel, J. M., Ferretti, R. E., Leite, R. E., et al. (2009). Equal numbers of neuronal and nonneuronal cells make the human brain an isometrically scaled-up primate brain. J. Comp. Neurol. 513, 532–541. doi: 10.1002/cne.21974

PubMed Abstract | CrossRef Full Text | Google Scholar

Bachhuber, C., and Steinbach, E. (2015). A system for precise end-to-end delay measurements in video communication. arXiv [preprint].

Google Scholar

Bang, D., Kishida, K. T., Lohrenz, T., White, J. P., Laxton, A. W., Tatter, S. B., et al. (2020). Sub-second dopamine and serotonin signaling in human striatum during perceptual decision-making. Neuron 108, 999–1010. doi: 10.1016/j.neuron.2020.09.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Bao, S., Chang, E. F., Woods, J., and Merzenich, M. M. (2004). Temporal plasticity in the primary auditory cortex induced by operant perceptual learning. Nat. Neurosci. 7, 974–981. doi: 10.1038/nn1293

PubMed Abstract | CrossRef Full Text | Google Scholar

Beste, C., Adelhöfer, N., Gohil, K., Passow, S., Roessner, V., and Li, S. C. (2018). Dopamine modulates the efficiency of sensory evidence accumulation during perceptual decision making. Int. J. Neuropsychopharmacol. 21, 649–655. doi: 10.1093/ijnp/pyy019

PubMed Abstract | CrossRef Full Text | Google Scholar

Brookes, J., Warburton, M., Alghadier, M., Mon-Williams, M., and Mushtaq, F. (2020). Studying human behavior with virtual reality: the unity experiment framework. Behav. Res. Methods 52, 455–463. doi: 10.3758/s13428-019-01242-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Burr, D., and Gori, M. (2012). “Multisensory integration develops late in humans,” In The Neural Bases of Multisensory Processes, eds M. M. Murray and M. T. Wallace (Boca Raton, FL: CRC Press/Taylor andamp).

Google Scholar

Cassidy, C. M., Balsam, P. D., Weinstein, J. J., Rosengard, R. J., Slifstein, M., Daw, N. D., et al. (2018). A perceptual inference mechanism for hallucinations linked to striatal dopamine. Curr. Biol. 28, 503–514. doi: 10.1016/j.cub.2017.12.059

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, Y. C., and Spence, C. (2010). When hearing the bark helps to identify the dog: semantically-congruent sounds modulate the identification of masked pictures. Cognition 114, 389–404. doi: 10.1016/j.cognition.2009.10.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Clark, A. (2012). “Embodied, embedded, and extended cognition,” in The Cambridge Handbook of Cognitive Science, ed. K. Frankish (Cambridge, MA: Cambridge University Press), 275–291.

Google Scholar

Collerton, D., Mosimann, U. P., and Archibald, N. (2012). Disorders of visual perception in Parkinson’s disease and other Lewy body disorders. Psychiatry Park.s Dis. 27, 41–52.

Google Scholar

Cools, R., and D’Esposito, M. (2011). Inverted-U–shaped dopamine actions on human working memory and cognitive control. Biol. Psychiatry 69, e113–e125. doi: 10.1016/j.biopsych.2011.03.028

PubMed Abstract | CrossRef Full Text | Google Scholar

Croy, I., Sehlstedt, I., Wasling, H. B., Ackerley, R., and Olausson, H. (2019). Gentle touch perception: from early childhood to adolescence. Dev. Cogn. Neurosci. 35, 81–86. doi: 10.1016/j.dcn.2017.07.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Daw, N. D., Niv, Y., and Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704–1711. doi: 10.1038/nn1560

PubMed Abstract | CrossRef Full Text | Google Scholar

Dayan, P., and Niv, Y. (2008). Reinforcement learning: the good, the bad and the ugly. Curr. Opin. Neurobiol. 18, 185–196. doi: 10.1016/j.conb.2008.08.003

PubMed Abstract | CrossRef Full Text | Google Scholar

de Lafuente, V., and Romo, R. (2005). Neuronal correlates of subjective sensory experience. Nat. Neurosci. 8, 1698–1703. doi: 10.1038/nn1587

PubMed Abstract | CrossRef Full Text | Google Scholar

de Lafuente, V., and Romo, R. (2006). Neural correlate of subjective sensory experience gradually builds up across cortical areas. Proc. Natl. Acad. Sci. U.S.A. 103, 14266–14271. doi: 10.1073/pnas.0605826103

PubMed Abstract | CrossRef Full Text | Google Scholar

de Lafuente, V., and Romo, R. (2011). Dopamine neurons code subjective sensory experiences and uncertainty of perceptual decisions. Proc. Natl Acad. Sci. U.S.A. 108, 19767–19771. doi: 10.1073/pnas.1117636108

PubMed Abstract | CrossRef Full Text | Google Scholar

de Lange, F. P., Heilbron, M., and Kok, P. (2018). How do expectations shape perception? Trends Cogn. Sci. 22, 764–779.

Google Scholar

Deco, G., Jirsa, V., McIntosh, A. R., Sporns, O., and Kötter, R. (2009). Key role of coupling, delay, and noise in resting brain fluctuations. Proc. Natl. Acad. Sci. U.S.A. 106, 10302–10307. doi: 10.1073/pnas.0901831106

PubMed Abstract | CrossRef Full Text | Google Scholar

Deroy, O., Spence, C., and Noppeney, U. (2016). Metacognition in multisensory perception. Trends Cogn. Sci. 20, 736–747. doi: 10.1016/j.tics.2018.06.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Diggavi, S. N., and Cover, T. M. (2001). The worst additive noise under a covariance constraint. IEEE Trans. Inform. Theory 47, 3072–3081. doi: 10.1109/18.959289

CrossRef Full Text | Google Scholar

Dinse, H. R., Ragert, P., Pleger, B., Schwenkreis, P., and Tegenthoff, M. (2003). Pharmacological modulation of perceptual learning and associated cortical reorganization. Science 301, 91–94. 1085423, doi: 10.1126/science

CrossRef Full Text | Google Scholar

Eden, J., Bräcklein, M., Ibáñez, J., Barsakcioglu, D. Y., Di Pino, G., Farina, D., et al. (2022). Principles of human movement augmentation and the challenges in making it a reality. Nat. Comm. 13:1345. doi: 10.1038/s41467-022-28725-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Engelhard, B., Finkelstein, J., Cox, J., Fleming, W., Jang, H. J., Ornelas, S., et al. (2019). Specialized coding of sensory, motor and cognitive variables in VTA dopamine neurons. Nature 570, 509–513. doi: 10.1038/s41586-019-1261-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Erixon-Lindroth, N., Farde, L., Wahlin, T. B. R., Sovago, J., Halldin, C., and Bäckman, L. (2005). The role of the striatal dopamine transporter in cognitive aging. Psychiatry Res. Neuroimaging 138, 1–12. doi: 10.1016/j.pscychresns.2004.09.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Ernst, M. O., and Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429–433. doi: 10.1038/415429a

PubMed Abstract | CrossRef Full Text | Google Scholar

Ernst, M. O., and Bülthoff, H. H. (2004). Merging the senses into a robust percept. Trends Cogn. Sci. 8, 162–169. doi: 10.1016/j.tics.2004.02.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Ferguson, K. A., and Cardin, J. A. (2020). Mechanisms underlying gain modulation in the cortex. Nat. Rev. Neurosci. 21, 80–92. doi: 10.1038/s41583-019-0253-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Fitzek, F., Li, S. C., Speidel, S., Strufe, T., Simsek, M., and Reisslein, M. (eds) (2021). Tactile Internet: With Human-in-the-Loop. Cambridge, MA: Academic Press.

Google Scholar

Friston, K. J., and Frith, C. D. (2015). Active inference, communication and hermeneutics. Cortex 68, 129–143. doi: 10.1016/j.cortex.2015.03.025

PubMed Abstract | CrossRef Full Text | Google Scholar

Friston, K. J., Shiner, T., FitzGerald, T., Galea, J. M., Adams, R., Brown, H., et al. (2012). Dopamine, affordance and active inference. PLoS Comput. Biol. 8:e1002327. doi: 10.1371/journal.pcbi.1002327

PubMed Abstract | CrossRef Full Text | Google Scholar

Gau, R., and Noppeney, U. (2016). How prior expectations shape multisensory perception. Neuroimage 124, 876–886. doi: 10.1016/j.neuroimage.2015.09.045

PubMed Abstract | CrossRef Full Text | Google Scholar

Glimcher, P. W. (2011). Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. Proc. Natl. Acad. Sci. U.S.A. 108(Suppl. 3), 15647–15654. doi: 10.1073/pnas.1014269108

PubMed Abstract | CrossRef Full Text | Google Scholar

Helmholtz, H. V. (1857). On the Physiological Causes of Harmony in Music. New York, NY: D. Appleton and Company, 61–106.

Google Scholar

Hipólito, I., and van Es, T. (2022). Enactive-dynamic social cognition and active inference. Front. Psychol. 11:855074. doi: 10.3389/fpsyg.2022.855074

PubMed Abstract | CrossRef Full Text | Google Scholar

Hoffman, D. (2019). The Case Against Reality: Why Evolution Hid the Truth From Our Eyes. New York, NY: WW Norton & Company.

Google Scholar

Hofmann, S. M., Klotzsche, F., Mariola, A., Nikulin, V., Villringer, A., and Gaebler, M. (2021). Decoding subjective emotional arousal from EEG during an immersive Virtual Reality experience. eLife 10:e64812. doi: 10.7554/eLife.64812

PubMed Abstract | CrossRef Full Text | Google Scholar

Hyman, S. E. (2005). Neurotransmitters. Curr. Biol. 15, R154–R158. doi: 10.1016/j.cub.2005.02.037

PubMed Abstract | CrossRef Full Text | Google Scholar

Ifrah, G. (2000). The Universal History of Computing: From the Abacus to Quantum Computing. Hoboken, NJ: John Wiley and Sons, Inc.

Google Scholar

Inoue, M., Suhara, T., Sudo, Y., Okubo, Y., Yasuno, F., Kishimoto, T., et al. (2001). Age-related reduction of extrastriatal dopamine D2 receptor measured by PET. Life Sci. 69, 1079–1084. doi: 10.1016/s0024-3205(01)01205-x

CrossRef Full Text | Google Scholar

Jacob, S. N., and Nienborg, H. (2018). Monoaminergic neuromodulation of sensory processing. Front. Neural Circ. 12:51. doi: 10.3389/fncir.2018.00051

PubMed Abstract | CrossRef Full Text | Google Scholar

Jones, S. A., and Noppeney, U. (2021). Ageing and multisensory integration: a review of the evidence, and a computational perspective. Cortex 138, 1–23. doi: 10.1016/j.cortex.2021.02.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Jucaite, A., Fernell, E., Halldin, C., Forssberg, H., and Farde, L. (2005). Reduced midbrain dopamine transporter binding in male adolescents with attention-deficit/hyperactivity disorder: association between striatal dopamine markers and motor hyperactivity. Biol. Psychiatry 57, 229–238. doi: 10.1016/j.biopsych.2004.11.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Kaasinen, V., and Rinne, J. O. (2002). Functional imaging studies of dopamine system and cognition in normal aging and Parkinson’s disease. Neurosci. Biobehav. Rev. 26, 785–793. doi: 10.1016/S0149-7634(02)00065-9

CrossRef Full Text | Google Scholar

Kaasinen, V., Vilkman, H., Hietala, J., Någren, K., Helenius, H., Olsson, H., et al. (2000). Age-related dopamine D2/D3 receptor loss in extrastriatal regions of the human brain. Neurobiol. Aging 21, 683–688. doi: 10.1016/s0197-4580(00)00149-4

CrossRef Full Text | Google Scholar

Kang, K. Y. I., Rosenkranz, R., Karan, E. K., Altinsoy, E., and Li, S.-C. (2022). Congruence-based contextual plausibility modulates cortical activity during vibrotactile perception in virtual multisensory environments. Commun. Biol. 5, 1–13. doi: 10.1038/s42003-022-04318-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Karrer, T. M., Josef, A. K., Mata, R., Morris, E. D., and Samanez-Larkin, G. R. (2017). Reduced dopamine receptors and transporters but not synthesis capacity in normal aging adults: a meta-analysis. Neurobiol. Aging 57, 36–46. doi: 10.1016/j.neurobiolaging.2017.05.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Keitel, A., Prinz, W., and Daum, M. M. (2014). Perception of individual and joint action in infants and adults. PLoS One 9:e107450. doi: 10.1371/journal.pone.0107450

PubMed Abstract | CrossRef Full Text | Google Scholar

Klever, L., Voudouris, D., Fiehler, K., and Billino, J. (2019). Age effects on sensorimotor predictions: what drives increased tactile suppression during reaching? J. Vis. 19, 1–17. doi: 10.1167/19.9.9

CrossRef Full Text | Google Scholar

Laland, K. N., Odling-Smee, F. J., and Feldman, M. W. (1999). Evolutionary consequences of niche construction and their implications for ecology. Proc. Natl. Acad. Sci. U.S.A. 96, 10242–10247. doi: 10.1073/pnas.96.18.10242

PubMed Abstract | CrossRef Full Text | Google Scholar

Lebedev, M. A., Denton, J. M., and Nelson, R. J. (1994). Vibration-entrained and premovement activity in monkey primary somatosensory cortex. J. Neurophysiol. 72, 1654–1673. doi: 10.1152/jn.1994.72.4.1654

PubMed Abstract | CrossRef Full Text | Google Scholar

Lerner, T. N., Holloway, A. L., and Seiler, J. L. (2021). Dopamine, updated: reward prediction error and beyond. Curr. Opin. Neurobiol. 67, 123–130. doi: 10.1016/j.conb.2020.10.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, S. C. (2003). Biocultural orchestration of developmental plasticity across levels: the interplay of biology and culture in shaping the mind and behavior across the life span. Psychol. Bull. 129, 171–194. doi: 10.1037/0033-2909.129.2.171

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, S. C., Lindenberger, U., Hommel, B., Aschersleben, G., Prinz, W., and Baltes, P. B. (2004). Transformations in the couplings among intellectual abilities and constituent cognitive processes across the life span. Psychol. Sci. 15, 155–163. doi: 10.1111/j.0956-7976.2004.01503003

CrossRef Full Text | Google Scholar

Li, S. C., Lindenberger, U., and Sikström, S. (2001). Aging cognition: from neuromodulation to representation. Trends Cogn. Sci. 5, 479–486. doi: 10.1016/S1364-6613(00)01769-1

CrossRef Full Text | Google Scholar

Li, S. C., Muschter, E., Limanowski, J., and Hatzipanayioti, A. (2021). “Human perception and neurocognitive development across the lifespan,” in Tactile Internet, eds F. H. Fitzek, S. C. Li, S. Speidel, T. Strufe, M. Simsek, and M. Reisslein (Cambridge, MA: Academic Press), 199–221.

Google Scholar

Li, S. C., Passow, S., Nietfeld, W., Schröder, J., Bertram, L., Heekeren, H. R., et al. (2013). Dopamine modulates attentional control of auditory perception: DARPP-32 (PPP1R1B) genotype effects on behavior and cortical evoked potentials. Neuropsychologia 51, 1649–1661.

Google Scholar

Li, S.-C., and Rieckmann, A. (2014). Neuromodulation and aging: implications of aging neuronal gain control on cognition. Curr. Opin Neurobiol. 29, 148–158. doi: 10.1016/j.conb.2014.07.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, S. C., and Sikström, S. (2002). Integrative neurocomputational perspectives on cognitive aging, neuromodulation, and representation. Neurosci. Biobehav. Rev. 26, 795–808. doi: 10.1016/s0149-7634(02)00066-0

CrossRef Full Text | Google Scholar

Li, S. C., von Oertzen, T., and Lindenberger, U. (2006). A neurocomputational model of stochastic resonance and aging. Neurocomputing 69, 1553–1560. doi: 10.1016/j.neucom.2005.06.015

CrossRef Full Text | Google Scholar

Macaluso, E., and Driver, J. (2005). Multisensory spatial interactions: a window onto functional integration in the human brain. Trends Neurosci. 28, 264–271. doi: 10.1016/j.tins.2005.03.008

PubMed Abstract | CrossRef Full Text | Google Scholar

MacDonald, S. W., Karlsson, S., Rieckmann, A., Nyberg, L., and Bäckman, L. (2012). Aging-related increases in behavioral variability: relations to losses of dopamine D1 receptors. J. Neurosci. 32, 8186–8191. doi: 10.1523/JNEUROSCI.5474-11.2012

PubMed Abstract | CrossRef Full Text | Google Scholar

Manwani, A., and Koch, C. (1999). Detecting and estimating signals in noisy cable structures. I: neuronal noise sources. Neural Comput. 11, 1797–1829. doi: 10.1162/089976699300015972

PubMed Abstract | CrossRef Full Text | Google Scholar

McIntyre, S., Nagi, S. S., McGlone, F., and Olausson, H. (2021). The effects of ageing on tactile function in humans. Neuroscience 464, 53–58. doi: 10.1016/j.neuroscience.2021.02.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Muschter, E., Herbst, L., Steinbach, E., and Li, S. C. (2022). “Age-related differences in perceptual vibrotactile quality assessment of a tactile codec,” in European Wireless, ed. S.-C. Li (Dresden: Dresden University of Technology).

Google Scholar

Muschter, E., Noll, A., Zhao, J., Hassen, R., Strese, M., Gülecyüz, B., et al. (2021). Perceptual quality assessment of compressed vibrotactile signals through comparative judgment. IEEE Trans. Haptics 14, 291–296. doi: 10.1109/TOH.2021.3077191

PubMed Abstract | CrossRef Full Text | Google Scholar

Muthukumarana, S., Elvitigala, D. S., Forero Cortes, J. P., Matthies, D. J., and Nanayakkara, S. (2020). “Touch me gently: recreating the perception of touch using a shape-memory alloy matrix” in Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (New York, NY: ACM).

Google Scholar

Mystakidis, S. M. (2022). Metaverse. Encyclopedia 2022, 486–497. doi: 10.3390/encyclopedia2010031

CrossRef Full Text | Google Scholar

Nava, E., Föcker, J., and Gori, M. (2020). Children can optimally integrate multisensory information after a short action-like mini game training. Dev. Sci. 23, e12840. doi: 10.1111/desc.12840

PubMed Abstract | CrossRef Full Text | Google Scholar

Noll, A., Hofbauer, M., Muschter, E., Li, S. C., and Steinbach, E. (2022). “Automated quality assessment for compressed vibrotactile signals using multi-method assessment fusion,” in Proceedings of the 2022 IEEE Haptics Symposium (HAPTICS), (Piscataway, NJ: IEEE), 1–6.

Google Scholar

Nyberg, L., Salami, A., Andersson, M., Eriksson, J., Kalpouzos, G., Kauppi, K., et al. (2010). Longitudinal evidence for diminished frontal cortex function in aging. Proc. Natl. Acad. Sci. U.S.A. 107, 22682–22686. doi: 10.1073/pnas.101265110

CrossRef Full Text | Google Scholar

Ott, T., and Nieder, A. (2019). Dopamine and cognitive control in prefrontal cortex. Trends Cogn. Sci. 23, 213–234. doi: 10.1016/j.tics.2018.12.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Papenberg, G., Hämmerer, D., Müller, V., Lindenberger, U., and Li, S. C. (2013). Lower theta inter-trial phase coherence during performance monitoring is related to higher reaction time variability: a lifespan study. Neuroimage 83, 912–920. doi: 10.1016/j.neuroimage.2013.07.032

PubMed Abstract | CrossRef Full Text | Google Scholar

Pereda, A. E. (2014). Electrical synapses and their functional interactions with chemical synapses. Nat. Rev. Neurosci. 15, 250–263. doi: 10.1038/nrn3708

PubMed Abstract | CrossRef Full Text | Google Scholar

Pezzulo, G., Rigoli, F., and Friston, K. J. (2018). Hierarchical active inference: a theory of motivated control. Trends Cogn. Sci. 22, 294–306. doi: 10.1016/j.tics.2018.01.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Prinz, W. (2015). Task representation in individual and joint settings. Front. Hum. Neurosci. 9:268. doi: 10.3389/fnhum.2015.00268

PubMed Abstract | CrossRef Full Text | Google Scholar

Quartz, S. R. (1999). The constructivist brain. Trends Cogn. Sci. 3, 48–57. doi: 10.1016/S1364-6613(98)01270-4

CrossRef Full Text | Google Scholar

Raz, N., Lindenberger, U., Rodrigue, K. M., Kennedy, K. M., Head, D., Williamson, A., et al. (2005). Regional brain changes in aging healthy adults: general trends, individual differences and modifiers. Cerebr. Cortex 15, 1676–1689. doi: 10.1093/cercor/bhi044

PubMed Abstract | CrossRef Full Text | Google Scholar

Rostami, S., and Maier, M. (2022). The metaverse and beyond: implementing advanced multiverse realms with smart wearables. IEEE Access 10, 110796–110806. doi: 10.1109/ACCESS.2022.3215736

CrossRef Full Text | Google Scholar

Rothmond, D. A., Weickert, C. S., and Webster, M. J. (2012). Developmental changes in human dopamine neurotransmission: cortical receptors and terminators. BMC Neurosci. 13:18. doi: 10.1186/1471-2202-13-18

PubMed Abstract | CrossRef Full Text | Google Scholar

Schirner, G., Erdogmus, D., Chowdhury, K., and Padir, T. (2013). The future of human-in-the-loop cyber-physical systems. Computer 46, 36–45. doi: 10.1109/MC.2013.31

CrossRef Full Text | Google Scholar

Schneider, M. L., Moore, C. F., Ahlers, E. O., Barnhart, T. E., Christian, B. T., DeJesus, O. T., et al. (2019). PET measures of D1, D2, and DAT binding are associated with heightened tactile responsivity in rhesus macaques: implications for sensory processing disorder. Front. Integr. Neurosci. 13:29. doi: 10.3389/fnint.2019.00029

PubMed Abstract | CrossRef Full Text | Google Scholar

Schultz, W. (2016). Dopamine reward prediction-error signalling: a two-component response. Nat. Rev. Neurosci. 17, 183–195. doi: 10.1038/nrn.2015.26

PubMed Abstract | CrossRef Full Text | Google Scholar

Senkowski, D., Höfle, M., and Engel, A. K. (2014). Crossmodal shaping of pain: a multisensory approach to nociception. Trends Cogn. Sci. 18, 319–327. doi: 10.1016/j.tics.2014.03.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Serino, A. (2019). Peripersonal space (PPS) as a multisensory interface between the individual and the environment, defining the space of the self. Neurosci. Biobehav. Rev. 99, 138–159. doi: 10.1016/j.neubiorev.2019.01.016

PubMed Abstract | CrossRef Full Text | Google Scholar

Servan-Schreiber, D., Printz, H., and Cohen, J. D. (1990). A network model of catecholamine effects: gain, signal-to-noise ratio, and behavior. Science 249, 892–895. doi: 10.1126/science.2392679

PubMed Abstract | CrossRef Full Text | Google Scholar

Shannon, C. E. (1949). Communication in the presence of noise. Proc. IRE 37, 10–21.

Google Scholar

Shea, N., Boldt, A., Bang, D., Yeung, N., Heyes, C., and Frith, C. D. (2014). Supra-personal cognitive control and metacognition. Trends Cogn. Sci. 18, 186–193. doi: 10.1016/j.tics.2014.01.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Simsek, M., Fettweis, G. P., and Chih-Lin, I. (2019). Tactile Internet [scanning the issue]. Proc. IEEE 107, 253–255. doi: 10.1109/JPROC.2019.2892535

CrossRef Full Text | Google Scholar

Slater, M. (2009). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos. Trans. R. Soc. B Biol. Sci. 364, 3549–3557. doi: 10.1098/rstb.2009.0138

PubMed Abstract | CrossRef Full Text | Google Scholar

Spence, C., Levitan, C. A., Shankar, M. U., and Zampini, M. (2010). Does food color influence taste and flavor perception in humans? Chemosensory Percept. 3, 68–84. doi: 10.1007/s12078-010-9067-z

CrossRef Full Text | Google Scholar

Stein, B. E., Stanford, T. R., and Rowland, B. A. (2014). Development of multisensory integration from the perspective of the individual neuron. Nat. Rev. Neurosci. 15, 520–535. doi: 10.1038/nrn3742

PubMed Abstract | CrossRef Full Text | Google Scholar

Steinbach, E., Strese, M., Eid, M., Liu, X., Bhardwaj, A., Liu, Q., et al. (2018). Haptic codecs for the tactile internet. Proc. IEEE 107, 447–470. doi: 10.1109/JPROC.2018.2867835

CrossRef Full Text | Google Scholar

Takahashi, H., Yamada, M., and Suhara, T. (2012). Functional significance of central D1 receptors in cognition: beyond working memory. J. Cereb. Blood Flow Metab. 32, 1248–1258. doi: 10.1038/jcbfm.2011.194

PubMed Abstract | CrossRef Full Text | Google Scholar

van Wyk, M. A., Ping, L., and Chen, G. (2021). Multivaluedness in networks: shannon’s noisy-channel coding theorem. IEEE Trans. Circ. Syst. II 68, 3234–3235. doi: 10.1109/TCSII.2021.3074925

CrossRef Full Text | Google Scholar

Wager, T. D., Rilling, J. K., Smith, E. E., Sokolik, A., Casey, K. L., Davidson, R. J., et al. (2004). Placebo-induced changes in FMRI in the anticipation and experience of pain. Science 303, 1162–1167. doi: 10.1126/science.109306

CrossRef Full Text | Google Scholar

Wolinsky, A. (1999). The History of the Internet and the World Wide Web. Berkeley Heights, NJ: Enslow Pub Incorporated.

Google Scholar

Woods, A. T., Lloyd, D. M., Kuenzel, J., Poliakoff, E., Dijksterhuis, G. B., and Thomas, A. (2011). Expected taste intensity affects response to sweet drinks in primary taste cortex. Neuroreport 22, 365–369. doi: 10.1097/WNR.0b013e3283469581

PubMed Abstract | CrossRef Full Text | Google Scholar

Yousif, N., Fu, R. Z., Bourquin, B. A. E. E., Bhrugubanda, V., Schultz, S. R., and Seemungal, B. M. (2016). Dopamine activation preserves visual motion perception despite noise interference of human V5/MT. J. Neurosci. 36, 9303–9312. doi: 10.1523/JNEUROSCI.4452-15.2016

PubMed Abstract | CrossRef Full Text | Google Scholar

Zimmer, C. (2011). 100 trillion connections. Sci. Am. 304, 58–61.

Google Scholar

Keywords: development, neuromodulation, signal-to-noise, perception, multisensory, sensory augmentation, Tactile Internet, aging

Citation: Li S-C and Fitzek FHP (2023) Digitally embodied lifespan neurocognitive development and Tactile Internet: Transdisciplinary challenges and opportunities. Front. Hum. Neurosci. 17:1116501. doi: 10.3389/fnhum.2023.1116501

Received: 05 December 2022; Accepted: 26 January 2023;
Published: 10 February 2023.

Edited by:

Christos Frantzidis, University of Lincoln, United Kingdom

Reviewed by:

Panteleimon Chriskos, Aristotle University of Thessaloniki, Greece
Martin Maier, Institut National de Recherche et de Sécurité (INRS), France

Copyright © 2023 Li and Fitzek. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Shu-Chen Li, www.frontiersin.org shu-chen.li@tu-dresden.de

Download