Ground Truths: Challenges and Opportunities in Developing an AI Guitar Assistant

Chris Rhodes^1,2*Nico Garcia-Peguinho²Laura Beesley²Hongshuo Fan³Caroline Elizabeth Jay²Richard Allmendinger²Ricardo Climent²

• ¹University College London, London, United Kingdom
• ²The University of Manchester, Manchester, England, United Kingdom
• ³Royal Northern College of Music, Manchester, United Kingdom

Modern sensor and gesture tracking technologies (e.g., Myo armbands) allow us access to novel data measuring musical performance at a nuanced level: allowing us to 'see' otherwise unseen musical techniques. Meanwhile, advances in machine learning have given us the ability to create accurate predictions from often complex data capturing such techniques. At the same time, instrumental music education in the UK has seen great challenges regarding accessibility, caused by factors such as cost, standardised (non-personalised) curricula, and health issues as barriers to learning. As e-learning becomes a low-cost and personalised alternative to mainstream education, gamification is being used in popular music education apps (e.g., Yousician) to leverage game design principles and teach abstract musical concepts, such as timing and pitch, and stimulate learning. This ongoing project seeks to understand the challenges and opportunities in pairing modern sensor technologies with AI to develop an accessible AI guitar assistant. To do this, our work collects and analyses survey data from 21 guitarists across the UK to understand such accessibility issues and how we may design an AI system to address them. Our results show there is clear scope for developing a flexible and adaptive approach to music tuition via our developing AI guitar assistant, with the ability to address specific accessibility issues regarding the needs of individuals who feel excluded by expensive, standardised and homogeneous music education systems. Our contribution is a set of thematic insights, captured from survey data, for building an AI guitar assistant, which adjacent fields using AI can also benefit from. Our survey insights inform and stimulate a developing conversation around how to effectively integrate AI into music education. Our insights also indicate potential alternative approaches to mainstream and longstanding music education when leveraging emerging technologies, such as AI, to solve pressing social issues.