Neural Audio Instruments: Epistemological and Phenomenological Perspectives on Musical Embodiment of Deep Learning

Victor Zappi^1*Kıvanç Tatar^2,3*

• ¹Department of Music, College of Arts, Media and Design, Northeastern University, Boston, Massachusetts, United States
• ²Division of Data Science and AI, Department of Computer Science and Engineering, Chalmers University of Technology, Gothenburg, Sweden
• ³Department of Computer Science and Engineering, Faculty of Information Technology, University of Gothenburg, Gothenburg, Sweden

Neural Audio is a category of deep learning pipelines which output audio signals directly, in realtime scenarios of action-sound interactions. In this work, we examine how neural audio-based artificial intelligence, when embedded in digital musical instruments (DMIs), shapes embodied musical interaction. While DMIs have long struggled to match the physical immediacy of acoustic instruments, neural audio methods can magnify this challenge, requiring data collection, model training and deep theoretical knowledge that appear to push musicians toward symbolic or conceptual modes of engagement. Paradoxically, these same methods can also foster more embodied practices, by introducing opaque yet expressive behaviors that free performers from rigid technical models and encourage discovery through tactile, real-time experimentation.Drawing on established perspectives in DMI embodiment literature, as well as emerging neuralaudio-focused efforts within the community, we highlight two seemingly conflicting aspects of these instruments: on one side, they inherit many "disembodying" traits known from DMIs; on the other, they open pathways reminiscent of acoustic phenomenology and soma, potentially restoring the close physical interplay often missed in digital performance.