Audio and Linguistic Prediction of Objective and Subjective Cognition in Older Adults: What is the Role of Different Prompts?

Varsha D. Badal^1,2,3*Caitlyn Tran¹Haze Brown¹Danielle K. Glorioso^1,2,3Rebecca Daly^1,2,3Anthony Molina^1,3,4Alison Moore^1,3,4Erhan Bilal⁵Ellen E. Lee^1,2,3Colin A. Depp^1,2,3

• ¹University of California, San Diego, La Jolla, United States
• ²Department of Psychiatry, School of Medicine, University of California San Diego, San Diego, California, United States
• ³Sam and Rose Stein Institute for Research on Aging,University of California, San Diego, La Jolla, California, United States
• ⁴School of Medicine, University of California San Diego, La Jolla, California, United States
• ⁵IBM Research (United States), Yorktown Heights, New York, United States

Background: Psycho-linguistic and audio data derived from speech may be useful in screening and monitoring cognitive aging. However, there are gaps in understanding the predictive value of different prompts (e.g., open ended or structured) and the relationship of features to subjective versus objective cognition. Objective: To advance understanding of method variation in speech-analysis based psychometry, we evaluated targeted prompts for classification of impaired cognition and cognitive complaints.Method: A sample of 49 older participants (mean age: 76.9, SD: 8.5) completed short interview questions and cognitive assessments. Acoustic and Linguistic Inquiry through Word Counting i.e., LIWC (verbal content-based) features were derived from answers to open ended questions about aging (AG) and the Cookie Theft task (CT). Outcomes were objective cognitive ability measured using Telephone Interview for Cognitive Status (TICS-m), and subjective cognition using Cognitive Failures Questionnaire (CFQ).Results: A combined feature set including acoustic and LIWC (verbal content) yielded excellent classification results for both CFQ and TICS-m. The F1, precision and recall for CFQ elevation was 0.83, 0.85 and 0.82, and for TICS-m cutoff was 0.92, 0.92 and 0.92 respectively (using single learners). Features derived from CT task were of greater relevance to TICS-m classification, while the features from the AG task were of greater relevance to the CFQ classification. Conclusion: Acoustic and psycholinguistic features are relevant to assessment of cognition and subjective cognitive complaints, with combined features performing best. However, subjective and objective cognitions were predicted to differing extents by the different tasks, and the feature sets.