OPINION article

Front. Neurorobot., 28 June 2022

Volume 16 - 2022 | https://doi.org/10.3389/fnbot.2022.913605

Beyond Digital Twins: Phygital Twins for Neuroergonomics in Human-Robot Interaction

  • 1. Rehab Technologies, Istituto Italiano di Tecnologia, Genoa, Italy

  • 2. CNRS, Univ Rennes, Inria, IRISA, Rennes, France

Article metrics

View details

15

Citations

5,8k

Views

1,4k

Downloads

Introduction

Among the most recent enabling technologies, Digital Twins (DTs) emerge as data-intensive network-based computing solutions in multiple domains—from Industry 4.0 to Connected Health (Pires et al., 2019; Bagaria et al., 2020; Juarez et al., 2021; Phanden et al., 2021). A DT works as a virtual system for replicating, monitoring, predicting, and improving the processes and the features of a physical system—the Physical Twin (PT), connected in real-time with its DT (Grieves and Vickers, 2017; Kaur et al., 2020; Mourtzis et al., 2021; Volkov et al., 2021). Such a technology, based on advances in fields like the Internet of Things (IoT) and machine learning (Kaur et al., 2020), proposes novel ways to face the issues of complex systems as in Human-Robot Interaction (HRI) (Pairet et al., 2019) domains.

This position paper aims at proposing a physical-digital twinning approach to improve the understanding and the management of the PT in contexts of HRI according to the interdisciplinary perspective of neuroergonomics (Parasuraman, 2003; Frederic et al., 2020).

Approaching and Adopting Digital Twins

The DT definition is still an object of debate, and reaching one could be a necessary step for efficiently managing its technical requirements in terms of computing and connectivity (Shafto et al., 2012; Haag and Anderl, 2018; Jones et al., 2020; Kuehner et al., 2021; Singh et al., 2021; Botín-Sanabria et al., 2022; Wang D. et al., 2022). However, we can ignite our discussion by considering how Fuller et al. (2020) highlighted that a DT is not just a digital model or an offline simulation of a physical object. Nor does a DT correspond to a digital shadow, depicting the real-time states and changes of a PT that can just be manually modified. The changes in a DT automatically mirror and affect the status of its PT: the data flows bi-directionally (Van der Valk et al., 2020) and in real time between twins in digital and physical worlds, possibly without any human intervention (Liu et al., 2022) through the DT-driven control of an actuated PT. However, a DT is typically “played” by experts like managers, engineers, and designers as a complex interactive simulation to predict future issues in the PT according to its past and current behavior (Semeraro et al., 2021). This leads to new policies as feedback to the real system, even with the assistance of artificial intelligence layers (Umeda et al., 2019; Gichane et al., 2020). Considering their functions (Khan et al., 2022) each DT can focus on (i) monitoring a PT, (ii) simulating the future states of a PT, (iii) directly interacting—as an “operational DT”—with a cyber-physical system as PT.

Among the fields of DT application, robotics certainly offers several examples (Girletti et al., 2020; Matulis and Harvey, 2021) of twinning solutions, especially in conditions of HRI like human-robot collaboration (Malik and Bilberg, 2018; Maruyama et al., 2021; Tuli et al., 2021). In particular, literature in robotics offers interesting solutions of intuitive extended reality interfaces (Alfrink and Rossmann, 2019; Burghardt et al., 2020) to ease the interaction of an expert with a DT. In the next section, we propose that such an approach can be further enhanced by emulating certain PT components through a DT and others through a physical replica of the robotic system.

Phygital Twins in Human-Robot Interaction

Performing holistic, physical, and reality-based interaction with a robotic system is more intuitive for the user than contactless gestures to program or command the device and change its state to accomplish a task (Jacob et al., 2008; Heun et al., 2013; Blackler et al., 2019; Ravichandar et al., 2020). Following this reasoning, we decided to highlight the opportunity of emulating a PT through what we labeled as a “Phygital Twin.” This term has already been used by Sarangi et al. (2018) to describe an IoT setup designed to collect data and represent an environment (even through portable devices) to assist a farmer in precision agriculture paradigms. However, we envisioned the usage of this label for a wider class of solutions by pondering the meaning of the “phygital” attribute outside the domain of twinning processes.

As a neologism (merging two words: physical and digital), this attribute has been typically adopted across various domains like design and marketing, blending real and virtual dimensions as in its etymology (Gaggioli, 2017; Mikheev et al., 2021). This term was used, for instance, to define Tactile User Interfaces (TUIs) like the “phygital map” in Nakazawa and Tokuda (2007), the paradigms of “phygital play” (Lupetti et al., 2015) in mixed reality-based robotic games (MRRGs) (Prattico and Lamberti, 2020), and interactive solutions for work and education proposed during the COVID-19 pandemic (Chaturvedi et al., 2021; Burova et al., 2022).

Overall, these are just examples in a general virtual-real convergence trend (Tao and Zhang, 2017), like cyber-physical twins (Czwick and Anderl, 2020). This trend occurs in healthcare too (Gregory, 2022) about managing chronic conditions and predicting their progress or the therapeutic outcome (Voigt et al., 2021; Barresi et al., 2022). Furthermore, we must highlight how intrinsically phygital are the recent definitions of the metaverse, a digital world embracing cyber-physical systems and also DTs in its connection with the real world (Yoon et al., 2021).

Exploiting the phygital approach we foresee a Phygital Twin (PDT, highlighting both its physical and digital elements) as in the example in Figure 1. Within a PDT, certain components of the PT are replicated by digital objects and others by physical objects within an integrated extended reality model. These physical objects would be secondary instances of the same products (not necessarily a robot) in the PT. In Figure 1, an example of the human-exoskeleton system in a real context is the PT emulated by a DT (in green, on the left), based on a fully virtual model of the HRI system. On the other hand, the same PT can be represented (on the right) by a PDT, based on a virtual human “wearing” a real exoskeleton (identical to the one in the real-world context and, possibly, sustained by a mannequin) into a laboratory. Both settings, visualized by an expert through a mixed reality headset, enable the live visualization of anomalies in the right shoulder of the worker in this example.

Figure 1

Figure 1

A Physical Twin (PT), based on a human-exoskeleton system in a context of usage, connected (on the left) to its Digital Twin (DT) in green, based on a virtual model of the human-robot interaction (HRI) system, or (on the right) to its Phygital Twin (PDT), based on a holographic human “wearing” a real exoskeleton in a laboratory.

Different from the case of the fully virtual model on the left, the expert on the right can decide to alter the phygital model through intuitive physical interactions with the lab exoskeleton (working as a TUI), performing tests according to past and current data from the PT. Indeed, the expert receives visual feedback from the DT and more intuitive visuotactile feedback from the PDT. After obtaining the informed consent of the worker in the PT system, the experts can also update the remote wearable robot software according to their predictions.

Thus, the PDTs enable intuitive phygital interactions with experts to assess and improve the PT. Furthermore, its physical components can emulate the ones of the PT more reliably than a virtual simulacrum because they are based on the same products. The PDT computer-generated elements may also be visualized through a virtual reality headset instead of a mixed reality one, according to the need of depicting the PT context as a whole. However, focusing further on the virtual human component can also be greatly advantageous to deepen our knowledge of the user's conditions, especially in terms of neuromotor and neurocognitive processes, as the next section will propose.

Neuroergonomic Twinning of HRI Systems

Through digital human modeling (Paul et al., 2021), DTs can contribute to monitoring, assessing, and designing different human-system interactions (Caputo et al., 2019; Greco et al., 2020; Sharotry et al., 2022; Wang B. et al., 2022) according to the perspective of human factors. In particular, neuroergonomics (Mehta and Parasuraman, 2013)—especially computational neuroergonomics (Farahani et al., 2019)—can advantageously exploit twinning for understanding how the human nervous system works in real contexts (Cheng et al., 2022), and improving the design of any item interacting with it. This is certainly true about neuroergonomics in HRI contexts (Cassioli et al., 2021) for applications like monitoring motor control difficulties (Memar and Esfahani, 2018), providing robots with adaptive features (Lim et al., 2021), and improving brain-robot interfaces (Mao et al., 2019). Overall, the exploitation of DTs in this field can inherit the corpus of knowledge in neuroscience, especially when human-machine interactions are investigated (Gaggioli, 2018; Ramos et al., 2021). Interestingly, literature in this area already shows several approaches presenting analogies with PDTs, which can contribute to neuroergonomics in HRI by offering intuitive interactions with a phygital emulation of the human-robot system.

For instance, the field of bionic prosthetics (Frossard and Lloyd, 2021) offers this kind of solution, with emphasis on twinning the residual limb more than the device. Interestingly, Chen et al. (2022) labeled as “mechatronics-twin” a framework integrating a 6-DoF manipulator with biomechanical models to explore, through simulations, the operational behaviors of prosthetic sockets with amputees. Such an example sounds quite close to the concept of PDT, which can have additional features of real-time bidirectionality, intuitive physical interaction, and ecological validity (resemblance with real contexts).

Furthermore, Pizzolato et al. (2019) proposed human neuromusculoskeletal (NMS) system models for DTs to improve the outcome of the interactions between users and assistive or rehabilitative machines. NMS models implemented in robot control solutions can offer phygital features. For instance, the output of the interaction between a user and a mechatronic device (possibly enriched by extended reality solutions) can become a quantifiable index of healthy and pathological conditions and responses to treatments. This would make such an output a peculiar type of digital biomarker (Wright et al., 2017): a “phygital biomarker” or possibly, a “neurophygital biomarker” (a promising step in this direction is based on neuromechanical biomarkers for rehabilomics) (Garro et al., 2021). In line with this reasoning, we could think about “neurophygital twins” to extract biomarkers from the activity of their PTs: mechatronic devices like rehabilitative exoskeletons (Buccelli et al., 2022) or, possibly, any other robot (including humanoids) designed to interact with humans wearing sensors.

Through intuitive phygital interactions between the researcher or the clinician and the lab replica of the same machine in the real world, neuroergonomic hypotheses on psychophysiological and motor processes underlying HRIs can be tested in simulated experiments based on a PDT. We could also envision the development of neurorobotic systems (Li et al., 2019) mimicking neurocognitive and neuromotor processes to physically replace a virtual human model in a PDT: in this case, the neurorobotic model would be validated through its interaction with another machine within the same PDT. However, before addressing such challenges, the current constraints in our knowledge and know-how must be pondered. Besides the technical limitations in twinning (first of all, the computational burden of emulating neural processes in ecologically valid settings, without considering the connectivity issues to approach the real-time standards), we must also highlight how both DTs and PDTs raise ethical issues on privacy and consent in data representation and storage, and on concepts like “normality” and enhancement (Bruynseels et al., 2018; Braun, 2021; Nyholm, 2021). These issues should be discussed within the frame of the enablers and the barriers to twinning adoption (Perno et al., 2020), even pondering the opportunities offered by novel technological frameworks (Yi et al., 2022).

Conclusion

This position paper presented a novel “twinning design” concept: PDT, based on physical replicas of PT components enriched with virtual models and computational features to establish intuitive and reliable phygital interactions with experts. Thus, a PDT would facilitate the experts' task of assessing and improving the PT conditions. Furthermore, PDTs provide neuroergonomics with tools for iterative human-centered design and evaluation of robotic systems into a “metalaboratory” before and after their deployment.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Statements

Author contributions

GB devised the conceptual contents and structure of the paper and wrote the initial draft. CP, ML, and LDM improved the document and considering further potential applications of the proposed approach. All authors revised and approved the manuscript.

Acknowledgments

The authors thank Lorenzo Cavallaro (Rehab Technologies) for his help with the figure.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  • 1

    AlfrinkM.RossmannJ. (2019). “Enhanced interaction with industrial robots through extended reality relying on simulation-based digital twins,” in Proceedings of the Industrial Simulation Conference 2019 (Lisbon).

  • 2

    BagariaN.LaamartiF.BadawiH. F.AlbraikanA.Martinez VelazquezR. A.El SaddikA. (2020). “Health 4.0: digital twins for health and well-being,” in Connected Health in Smart Cities (Cham: Springer), 143152.

  • 3

    BarresiG.ZenzeriJ.TessadoriJ.LaffranchiM.SempriniM.MichieliL. D. (2022). “Neuro-gerontechnologies: applications and opportunities,” in Internet of Things for Human-Centered Design (Singapore: Springer), 123153.

  • 4

    BlacklerA.DesaiS.McEwanM.PopovicV.DiefenbachS. (2019). “Perspectives on the nature of intuitive interaction,” in Intuitive Interaction Research and Application, 1939. 10.1201/b22191-2

  • 5

    Botín-SanabriaD. M.MihaitaA. S.Peimbert-GarcíaR. E.Ramírez-MorenoM. A.Ramírez-MendozaR. A.Lozoya-SantosJ. D. J. (2022). Digital twin technology challenges and applications: A comprehensive review. Remot. Sens. 14, 1335. 10.3390/rs14061335

  • 6

    BraunM. (2021). Represent me: please! towards an ethics of digital twins in medicine. J. Med. Ethics47, 394400. 10.1136/medethics-2020-106134

  • 7

    BruynseelsK.Santoni de SioF.Van den HovenJ. (2018). Digital twins in health care: ethical implications of an emerging engineering paradigm. Front. Genet. 9, 31. 10.3389/fgene.2018.00031

  • 8

    BuccelliS.TessariF.FaninF.De GuglielmoL.CapittaG.PiezzoC.et al. (2022). A gravity-compensated upper-limb exoskeleton for functional rehabilitation of the shoulder complex. Appl. Sci. 12, 3364. 10.3390/app12073364

  • 9

    BurghardtA.SzybickiD.GierlakP.KurcK.PietruśP.CyganR. (2020). Programming of industrial robots using virtual reality and digital twins. Appl. Sci. 10, 486. 10.3390/app10020486

  • 10

    BurovaN. V.MolodkovaE. B.NikolaenkoA. V.PopazovaO. A. (2022). “Remote work as a societal incentive for creativity: phygital initiative for self-actualization,” in Technology, Innovation and Creativity in Digital Society. PCSF 2021. Lecture Notes in Networks and Systems, Vol. 345, eds D. Bylieva and A. Nordmann (Cham: Springer). 10.1007/978-3-030-89708-6_15

  • 11

    CaputoF.GrecoA.FeraM.MacchiaroliR. (2019). Digital twins to enhance the integration of ergonomics in the workplace design. Int. J. Ind. Ergon. 71, 2031. 10.1016/j.ergon.2019.02.001

  • 12

    CassioliF.FrondaG.BalconiM. (2021). Human–co-bot interaction and neuroergonomics: co-botic vs. robotic systems. Front. Robot. AI. 8, 659319. 10.3389/frobt.2021.659319

  • 13

    ChaturvediS.PurohitS.VermaM. (2021). Effective teaching practices for success during COVID 19 pandemic: towards phygital learning. Front. Educ. 6, 646557. 10.3389/feduc.2021.646557

  • 14

    ChenD.OttikkuttiS.TahmasebiK. N. (2022). “A mechatronics-twin framework based on Stewart platform for effective exploration of operational behaviors of prosthetic sockets with amputees,” in Paper Presented at the BIODEVICES-16th International Conference on Biomedical Electronics and Devices (Lisbon). Available online at: https://www.scitepress.org/Link.aspx?doi=10.5220/0010838600003123

  • 15

    ChengB.FanC.FuH.HuangJ.ChenH.LuoX. (2022). Measuring and computing cognitive statuses of construction workers based on electroencephalogram: a critical review. IEEE Transac. Comput. Soc. Syst. 1–6. 10.1109/TCSS.2022.3158585

  • 16

    CzwickC.AnderlR. (2020). Cyber-physical twins-definition, conception and benefit. Procedia CIRP. 90, 584588. 10.1016/j.procir.2020.01.070

  • 17

    FarahaniF. V.KarwowskiW.LighthallN. R. (2019). Application of graph theory for identifying connectivity patterns in human brain networks: a systematic review. Front. Neurosci. 13, 585. 10.3389/fnins.2019.00585

  • 18

    FredericD.WaldemerK.HasanA. (2020). Brain at work and in everyday life as the next frontier: grand field challenges for neuroergonomics. Front. Neuroergonom. 1, 583733. 10.3389/fnrgo.2020.583733

  • 19

    FrossardL.LloydD. (2021). The future of bionic limbs. Res. Feat. 134, 7477. 10.26904/RF-134-7477

  • 20

    FullerA.FanZ.DayC.BarlowC. (2020). Digital twin: enabling technologies, challenges and open research. IEEE Access. 8, 108952108971. 10.1109/ACCESS.2020.2998358

  • 21

    GaggioliA. (2017). Phygital spaces: when atoms meet bits. Cyberpsychol. Behav. Soc. Netw. 20, 774774. 10.1089/cyber.2017.29093.csi

  • 22

    GaggioliA. (2018). Digital twins: an emerging paradigm in cyberpsychology research?Cyberpsychol. Behav. Soc. Netw. 21, 468469. 10.1089/cyber.2018.29118.csi

  • 23

    GarroF.ChiappaloneM.BuccelliS.De MichieliL.SempriniM. (2021). Neuromechanical biomarkers for robotic neurorehabilitation. Front. Neurorobot. 15, 742163. 10.3389/fnbot.2021.742163

  • 24

    GichaneM. M.ByiringiroJ. B.ChesangA. K.NyagaP. M.LangatR. K.SmajicH.et al. (2020). Digital triplet approach for real-time monitoring and control of an elevator security system. Designs4, 9. 10.3390/designs4020009

  • 25

    GirlettiL.GroshevM.GuimarãesC.BernardosC. J.de la OlivaA. (2020). “An intelligent edge-based digital twin for robotics,” in Paper Presented at the 2020 IEEE Globecom Workshops (GC Wkshps) (Taipei). Available online at: https://ieeexplore.ieee.org/document/9367549

  • 26

    GrecoA.CaterinoM.FeraM.GerbinoS. (2020). Digital twin for monitoring ergonomics during manufacturing production. Appl. Sci. 10, 7758. 10.3390/app10217758

  • 27

    GregoryD. (2022). Healthcare Goes Digital: Designing for the Convergence of the Digital and Physical Environment—Implications for Design Professionals. Los Angeles, CA: SAGE Publications Sage CA.

  • 28

    GrievesM.VickersJ. (2017). “Digital twin: mitigating unpredictable, undesirable emergent behavior in complex systems,” in Transdisciplinary Perspectives on Complex Systems (Springer), 85113.

  • 29

    HaagS.AnderlR. (2018). Digital twin–Proof of concept. Manuf. Lett. 15, 6466. 10.1016/j.mfglet.2018.02.006

  • 30

    HeunV.KasaharaS.MaesP. (2013). “Smarter objects: using AR technology to program physical objects and their interactions,” in Extended Abstracts on Human Factors in Computing Systems (New York, NY: Association for Computing Machinery), 961966. 10.1145/2468356.2468528

  • 31

    JacobR. J.GirouardA.HirshfieldL. M.HornM. S.ShaerO.SoloveyE. T.et al. (2008). “Reality-based interaction: a framework for post-WIMP interfaces,” in Paper Presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence). Available online at: https://dl.acm.org/doi/abs/10.1145/1357054.1357089

  • 32

    JonesD.SniderC.NassehiA.YonJ.HicksB. (2020). Characterising the Digital Twin: a systematic literature review. CIRP J. Manuf. Sci. Technol. 29, 3652. 10.1016/j.cirpj.2020.02.002

  • 33

    JuarezM. G.BottiV. J.GiretA. S. (2021). Digital Twins: review and challenges. J. Comput. Inform. Sci. Eng. 21, 030802. 10.1115/1.4050244

  • 34

    KaurM. J.MishraV. P.MaheshwariP. (2020). “The convergence of digital twin, IoT, and machine learning: transforming data into action,” in Digital Twin Technologies and Smart Cities (Cham: Springer), 317.

  • 35

    KhanL. U.SaadW.NiyatoD.HanZ.HongC. S. (2022). Digital-twin-enabled 6G: vision, architectural trends, and future directions. IEEE Commun. Mag. 60, 7480. 10.1109/MCOM.001.21143

  • 36

    KuehnerK. J.ScheerR.StrassburgerS. (2021). Digital twin: finding common ground–a meta-review. Proc. CIRP. 104, 12271232. 10.1016/j.procir.2021.11.206

  • 37

    LiJ.LiZ.ChenF.BicchiA.SunY.FukudaT. (2019). Combined sensing, cognition, learning, and control for developing future neuro-robotics systems: a survey. IEEE Trans. Cogn. Dev. Syst. 11, 148161. 10.1109/TCDS.2019.2897618

  • 38

    LimY.PongsakornsathienN.GardiA.SabatiniR.KistanT.EzerN.et al. (2021). Adaptive human-robot interactions for multiple unmanned aerial vehicles. Robotics10, 12. 10.3390/robotics10010012

  • 39

    LiuY.OngS.NeeA. (2022). State-of-the-art survey on digital twin implementations. Adv. Manuf. 10, 123. 10.1007/s40436-021-00375-w

  • 40

    LupettiM. L.PiumattiG.RossettoF. (2015). “Phygital play HRI in a new gaming scenario,” in Paper Presented at the 2015 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN) (Turin). Available online at: https://ieeexplore.ieee.org/abstract/document/7325480

  • 41

    MalikA. A.BilbergA. (2018). Digital twins of human robot collaboration in a production setting. Proc. Manuf. 17, 278285. 10.1016/j.promfg.2018.10.047

  • 42

    MaoX.LiW.LeiC.JinJ.DuanF.ChenS. (2019). A brain–robot interaction system by fusing human and machine intelligence. IEEE Trans. Neural Syst. Rehabil. Eng. 27, 533542. 10.1109/TNSRE.2019.2897323

  • 43

    MaruyamaT.UeshibaT.TadaM.TodaH.EndoY.DomaeY.et al. (2021). Digital Twin-driven human robot collaboration using a digital human. Sensors21, 8266. 10.3390/s21248266

  • 44

    MatulisM.HarveyC. (2021). A robot arm digital twin utilising reinforcement learning. Comput. Graph. 95, 106114. 10.1016/j.cag.2021.01.011

  • 45

    MehtaR. K.ParasuramanR. (2013). Neuroergonomics: a review of applications to physical and cognitive work. Front. Hum. Neurosci. 7, 889. 10.3389/fnhum.2013.00889

  • 46

    MemarA. H.EsfahaniE. T. (2018). EEG correlates of motor control difficulty in physical human-robot interaction: a frequency domain analysis. Paper Presented at the 2018 IEEE Haptics Symposium (HAPTICS) (San Francisco, CA). Available online at: https://ieeexplore.ieee.org/abstract/document/8357181

  • 47

    MikheevA. A.KrasnovA.GriffithR.DraganovM. (2021). The interaction model within Phygital environment as an implementation of the open innovation concept. J Open Innov. Technol. Mark. Complex. 7, 114. 10.3390/joitmc7020114

  • 48

    MourtzisD.AngelopoulosJ.PanopoulosN.KardamakisD. (2021). A Smart IoT platform for oncology patient diagnosis based on AI: towards the human digital twin. Proc. CIRP. 104, 16861691. 10.1016/j.procir.2021.11.284

  • 49

    NakazawaJ.TokudaH. (2007). Phygital map: accessing digital multimedia from physical map. Paper Presented at the 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07) (Ontario Falls, ON). Available online at: https://ieeexplore.ieee.org/abstract/document/4224132

  • 50

    NyholmS. (2021). Should a medical digital twin be viewed as an extension of the patient's body?J. Med. Ethics47, 401402. 10.1136/medethics-2021-107448

  • 51

    PairetÈ.ArdónP.LiuX.LopesJ.HastieH.LohanK. S. (2019). A digital twin for human-robot interaction. Paper Presented at the 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) (Daegu). Available online at: https://ieeexplore.ieee.org/abstract/document/8673015

  • 52

    ParasuramanR. (2003). Neuroergonomics: research and practice. Theoret. Issues Ergon. Sci. 4, 520. 10.1080/14639220210199753

  • 53

    PaulG.AbeleN. D.KluthK. (2021). A review and qualitative meta-analysis of digital human modeling and cyber-physical-systems in Ergonomics 4.0. IISE Trans. Occup. Ergon. Hum. Fact. 9, 111123. 10.1080/24725838.2021.1966130

  • 54

    PernoM.HvamL.HaugA. (2020). Enablers and barriers to the implementation of digital twins in the process industry: a systematic literature review. Paper Presented at the 2020 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM) (Singapore). Available online at: https://ieeexplore.ieee.org/abstract/document/9309745

  • 55

    PhandenR. K.SharmaP.DubeyA. (2021). A review on simulation in digital twin for aerospace, manufacturing and robotics. Mater. Today Proc. 38, 174178. 10.1016/j.matpr.2020.06.446

  • 56

    PiresF.CachadaA.BarbosaJ.MoreiraA. P.LeitãoP. (2019). “Digital twin in industry 4.0: Technologies, applications and challenges,” in 2019 IEEE 17th International Conference on Industrial Informatics (IEEE), 721726.

  • 57

    PizzolatoC.SaxbyD. J.PalipanaD.DiamondL. E.BarrettR. S.TengY. D.et al. (2019). Neuromusculoskeletal modeling-based prostheses for recovery after spinal cord injury. Front. Neurorobot. 13, 97. 10.3389/fnbot.2019.00097

  • 58

    PratticoF. G.LambertiF. (2020). Mixed-reality robotic games: design guidelines for effective entertainment with consumer robots. IEEE Consumer Electr. Mag. 10, 616. 10.1109/MCE.2020.2988578

  • 59

    RamosD.GonçalvesG.FariaR.SanchesM. P. (2021). “Building a drone operator digital twin using a brain-computer interface for emotion recognition,” in 2021 20th International Conference on Advanced Robotics (IEEE), 824829.

  • 60

    RavichandarH.PolydorosA. S.ChernovaS.BillardA. (2020). Recent advances in robot learning from demonstration. Ann. Rev. Control Robot. Auton. Syst. 3, 297330. 10.1146/annurev-control-100819-063206

  • 61

    SarangiS.ChoudhuryS. B.JainP.BhattP. V.RamanathS.SharmaR.et al. (2018). Development and deployment of a scalable IoT Framework for digital farming applications. Paper Presented at the 2018 IEEE Global Humanitarian Technology Conference (GHTC) (San Jose, CA). Available online at: https://ieeexplore.ieee.org/abstract/document/8601742

  • 62

    SemeraroC.LezocheM.PanettoH.DassistiM. (2021). Digital twin paradigm: a systematic literature review. Comput. Industry. 130, 103469. 10.1016/j.compind.2021.103469

  • 63

    ShaftoM.ConroyM.DoyleR.GlaessgenE.KempC.LeMoigneJ.et al. (2012). Modeling, simulation, information technology and processing roadmap. Nat. Aeronaut. Space Administr. 32, 138.

  • 64

    SharotryA.JimenezJ. A.MediavillaF. A. M.WierschemD.KoldenhovenR. M.VallesD. (2022). Manufacturing operator ergonomics: a conceptual digital twin approach to detect biomechanical fatigue. IEEE Access10, 1277412791. 10.1109/ACCESS.2022.3145984

  • 65

    SinghM.FuenmayorE.HinchyE. P.QiaoY.MurrayN.DevineD. (2021). Digital twin: origin to future. Appl. Syst. Innov. 4, 36. 10.3390/asi4020036

  • 66

    TaoF.ZhangM. (2017). Digital twin shop-floor: a new shop-floor paradigm towards smart manufacturing. IEEE Access5, 2041820427. 10.1109/ACCESS.2017.2756069

  • 67

    TuliT. B.KohlL.ChalaS. A.MannsM.AnsariF. (2021). “Knowledge-based digital twin for predicting interactions in human-robot collaboration,” in 2021 26th IEEE International Conference on Emerging Technologies and Factory Automation (IEEE), 18.

  • 68

    UmedaY.OtaJ.KojimaF.SaitoM.MatsuzawaH.SukekawaT.et al. (2019). Development of an education program for digital manufacturing system engineers based on ‘Digital Triplet'concept. Proc. Manuf. 31, 363369. 10.1016/j.promfg.2019.03.057

  • 69

    Van der ValkH.HaßeH.MöllerF.ArbterM.HenningJ.-L.OttoB. (2020). A taxonomy of digital twins. Paper Presented at the AMCIS (Salt Lake City, UT). Available online at: https://aisel.aisnet.org/amcis2020/org_transformation_is/org_transformation_is/4/

  • 70

    VoigtI.InojosaH.DillensegerA.HaaseR.AkgünK.ZiemssenT. (2021). Digital twins for multiple sclerosis. Front. Immunol. 12, 1556. 10.3389/fimmu.2021.669811

  • 71

    VolkovI.RadchenkoG.TchernykhA. (2021). Digital twins, internet of things and mobile medicine: a review of current platforms to support smart healthcare. Prog. Comp. Softw. 47, 578590. 10.1134/S0361768821080284

  • 72

    WangB.ZhouH.YangG.LiX.YangH. (2022). Human Digital Twin (HDT) driven human-cyber-physical systems: key technologies and applications. Chin. J. Mech. Eng. 35, 16. 10.1186/s10033-022-00680-w

  • 73

    WangD.LiB.SongB.LiuY.MuhammadK.ZhouX. (2022). Dual-driven resource management for sustainable computing in the blockchain-supported digital twin IoT. IEEE Internet Things J. 10.1109/JIOT.2022.3162714

  • 74

    WrightJ. M.RegeleO. B.KourtisL. C.PszennyS. M.SirkarR.KovalchickC.et al. (2017). Evolution of the digital biomarker ecosystem. Dig. Med. 3, 154. 10.4103/digm.digm_35_17

  • 75

    YiC.ParkS.YangC.JiangF.DingZ.ZhuJ.et al. (2022). Muscular human cybertwin for internet of everything: a pilot study. IEEE Transac. Industr. Inform. 10.1109/TII.2022.3153305

  • 76

    YoonK.KimS.-K.JeongS. P.ChoiJ.-H. (2021). Interfacing cyber and physical worlds: introduction to IEEE 2888 standards. Paper Presented at the 2021 IEEE International Conference on Intelligent Reality (ICIR) (Piscataway, NJ). Available online at: https://ieeexplore.ieee.org/abstract/document/9480910

Summary

Keywords

neuroergonomics, robotics, human-robot interaction, Digital Twin, Phygital Twin, human-machine interfaces, neurorobotics

Citation

Barresi G, Pacchierotti C, Laffranchi M and De Michieli L (2022) Beyond Digital Twins: Phygital Twins for Neuroergonomics in Human-Robot Interaction. Front. Neurorobot. 16:913605. doi: 10.3389/fnbot.2022.913605

Received

05 April 2022

Accepted

23 May 2022

Published

28 June 2022

Volume

16 - 2022

Edited by

Hang Su, Fondazione Politecnico di Milano, Italy

Reviewed by

Mingchuan Zhou, Zhejiang University, China; Xuanyi Zhou, Zhejiang University of Technology, China; Xinxing Chen, Southern University of Science and Technology, China

Updates

Copyright

*Correspondence: Giacinto Barresi

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics