A Methodology for Integrating AI into Embodied Human Intelligence for the Performance of Complex Tasks

Tamim Ahmed^1*Thanassis Rikakis^2*

• ¹University of Southern California, Los Angeles, United States
• ²Department of Pediatrics and Radiology, Children's Hospital Los Angeles, University of Southern California, Los Angeles, United States

We propose a theory and methodology for designing human-AI collaboration in complex, embodied tasks. The theory differentiates human embodied intelligence from computational intelligence and identifies synergies where AI enhances—rather than replicates or replaces—human performance. We represent observable structures of expert performance as a nested network with four interdependent layers: \emph{Environment} (space and tools), \emph{Activity} (what is done), \emph{Goals} (what is aimed for), and \emph{Meaning} (how performance is interpreted), all connected by dynamic four-layer edges. A bidirectional Dynamic Bayesian Network (DBN) computes this representation across temporal scales: instants, actions, complete performances, and sequences. The DBN informs the design of digital tools (from sensors to data structures and AI modules) that can capture human performance and extract features, descriptors, and predictions that can enhance the observability and analysis of performance. During task performance, a \emph{top-down pass} predicts expert orientation—current goals and interpretations—and drives a search policy that selects where to look. A \emph{bottom-up pass} processes action-conditioned computational observations and filters them through a gated pipeline to produce new candidates of four layer connectivity (c4). After expert validation, candidates update the network, sharpening DBN posteriors, reducing entropy, and contributing to enhanced human performance. We instantiated this framework in automated physical rehabilitation assessment through a 12-month deployment with 10 clinicians and 105 stroke survivors. Co-design cycles developed and enriched a four layer DBN representation of rehabilitation assessment and informed the design of a computational ensemble for automated assessment. The computational ensemble achieved 90.8\% agreement with clinicians at the exercise level, 93.1\% at the segment level, and 90.6\% at the movement quality level. Clinicians validated automated assessments at high rates and reported improved confidence and efficiency when leveraging ensemble insights for therapy assessment and planning. This is a portable methodology and theory that can potentially be applied to the embodied performance of complex tasks across multiple applications.