Your new experience awaits. Try the new design now and help us make it even better

ORIGINAL RESEARCH article

Front. Comput. Sci.

Sec. Human-Media Interaction

Volume 7 - 2025 | doi: 10.3389/fcomp.2025.1570296

This article is part of the Research TopicEmbodied Perspectives on Sound and Music AIView all 13 articles

Exploring Pose Estimation in Instrumental Composition: The Body Fragmented Project

Provisionally accepted
  • University of Liverpool, Liverpool, United Kingdom

The final, formatted version of the article will be published soon.

In contemporary and experimental music composition, the integration of physical movement via sensors and digital technology offers new pathways for music composition, performance and interdisciplinary practices. This article introduces a methodology that centres the composer and performer's bodies in instrumental composition through the use of pose estimation technology. The approach supports non-linear collaborative processes between composer and performer, facilitating a movement-led instrumental composition practice. Through the Body Fragmented composition project, this research explores how pose estimation can be used to generate movement-based notation and support embodied musical expression. Findings from the project reveal that pose estimation effectively capture expressive movement for compositional development, support performer interpretation through visual scores, and enhance collaborative dialogue. The study also identifies limitations in pose estimation's ability to convey nuanced musical gestures, and detailed musical information, prompting the integration of supplementary notation materials. These insights contribute to the development of new forms of movement-led methodologies in instrumental composition.

Keywords: Pose estimation, instrumental composition2, music performance, motion capture3, embodied music interaction4, human-computer interaction5

Received: 03 Feb 2025; Accepted: 19 Sep 2025.

Copyright: © 2025 Kirby. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

* Correspondence: Jenn Kirby, jenn.kirby@liverpool.ac.uk

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.