Using Noise to Distinguish Between System and Observer Effects in Multimodal Neuroimaging

Erik Fagerholm^1*Hirokazu Tanaka²Milan Brázdil³

• ¹King's College London, London, United Kingdom
• ²Tokyo Toshi Daigaku, Setagaya, Japan
• ³Masarykova univerzita, Brno, Czechia

It has become increasingly common to record brain activity simultaneously at more than one spatiotemporal scale. Here, we address a central question raised by such cross-scale datasets: do they reflect the same underlying dynamics observed in different ways, or different dynamics observed in the same way? In other words, to what extent can variation between modalities be attributed to system-level versus observer-level effects? System-level effects reflect genuine differences in neural dynamics at the resolutions sampled by each device. Observer-level effects, by contrast, reflect artefactual differences introduced by the nonlinear transformations each device imposes on the signal. We demonstrate that noise, when incorporated into generative models, can help disentangle these two sources of variation. We apply this noise-based approach to simultaneously recorded high-frequency broadband signals from macroelectrodes and microwires in the human hippocampus. Most subjects show a complex mixture of system- and observer-level contributions to their time series. However, in one subject, the cross-scale difference is statistically attributable to an observer-level effect—i.e., consistent with the same dynamics at both microwire and macroelectrode scales. This study shows that noise can be used in empirical datasets to determine whether cross-scale variation arises from differences in neural dynamics or differences in observer functions.