Cross-subject Mapping of Neural Activity with Restricted Boltzmann Machines

Haoming Yang^1*Marko Angjelichinoski¹Suya Wu¹Joy Putney²Simon Sponberg²Vahid Tarokh¹

• ¹Department of Electrical and Computer Engineering, Pratt School of Engineering, Duke University, Durham, United States
• ²Georgia Institute of Technology, Atlanta, United States

Subject-to-subject variability is a common challenge in generalizing neural data models across subjects, discriminating subject-specific and inter-subject features in large neural datasets, and engineering neural interfaces with subject-specific tuning. While many methods exist that map one subject to another, it remains challenging to combine many subjects in a computationally efficient manner, especially with highly non-linear features such as populations of spiking neurons or motor units. Consider subjects with trained neural decoders as sources and those without as targets. Our objective is to transfer data from one or more target subjects to the domain of the source subjects to directly apply the source neural decoder such that no target decoder needs to be trained. We propose to use the Restricted Boltzmann Machine (RBM) with Gaussian inputs and Bernoulli hidden units; once trained over the entire feature set of subjects, the RBM allows the mapping of target features on source feature spaces using Gibbs sampling. We also consider a novel computationally efficient training technique for RBMs based on the Fisher divergence, which allows closed-form gradients of the RBM to be computed. We apply our methods to decode turning behaviors from neuromuscular recordings of spike trains from the ten muscles that primarily control wing motion in an agile flying hawk moth, Manduca sexta. The dataset consists of this comprehensive motor program recorded from nine subjects, each driven by six discrete visual stimuli. The evaluations show that the target features can be decoded using the source classifier to classify the visual stimuli with an accuracy of up to 95% when mapped using an RBM trained by Fisher divergence, suggesting that RBMs for multi-cross-subject mapping applications are effective and efficient.