ORIGINAL RESEARCH article

Front. Neurosci., 02 August 2021

Sec. Perception Science

Volume 15 - 2021 | https://doi.org/10.3389/fnins.2021.642584

Olfactory Stimulation Modulates Visual Perception Without Training

  • 1. National Institute of Information and Communications Technology, Center for Information and Neural Networks, Osaka, Japan

  • 2. National Institute of Information and Communications Technology, Universal Communication Research Institute, Kyoto, Japan

Abstract

Considerable research shows that olfactory stimulations affect other modalities in high-level cognitive functions such as emotion. However, little known fact is that olfaction modulates low-level perception of other sensory modalities. Although some studies showed that olfaction had influenced on the other low-level perception, all of them required specific experiences like perceptual training. To test the possibility that olfaction modulates low-level perception without training, we conducted a series of psychophysical and neuroimaging experiments. From the results of a visual task in which participants reported the speed of moving dots, we found that participants perceived the slower motions with a lemon smell and the faster motions with a vanilla smell, without any specific training. In functional magnetic resonance imaging (fMRI) studies, brain activities in the visual cortices [V1 and human middle temporal area (hMT)] changed based on the type of olfactory stimulation. Our findings provide us with the first direct evidence that olfaction modulates low-level visual perception without training, thereby indicating that olfactory-visual effect is not an acquired behavior but an innate behavior. The present results show us with a new crossmodal effect between olfaction and vision, and bring a unique opportunity to reconsider some fundamental roles of olfactory function.

Introduction

Odors are powerful stimuli that not only evoke a sense of smell but also influence our mental states. In the real world, since we empirically know the effects of odors, we use them in our daily lives (e.g., aromatherapy). In scientific research fields, a number of studies on human crossmodal effects have shown that olfactory information interacts with other modalities in such high-level cognitive functions as emotions (; ), memories (; ; ), and social interactions (; ; ). In fact, it is often considered natural that olfactory stimulation influences such high-level cognitive functions, because the brain regions of olfaction and other cognitive functions are anatomically located near/overlap and are functionally associated (; ). For example, Frasnelli et al. showed a correlation between olfactory performance and cortical structure at insular that is generally linked to emotion (). On the other hand, it is relatively unknown that that olfactory stimulation affects low-level perception of different sensory modalities such as the detection and the identification of the spatial and temporal properties of sensory information (). For example, reported the case in which olfaction affected binocular rivalry (): the smell of rose/marker pen influenced the suppression time of binocular rivalry for the visual image of rose/marker pen. Also, found that olfaction induced the distinctive motion perception with the specific training that participants repeatedly viewed the specific motion paired with the particular smell (e.g., banana smell with rightward motion). Although binocular rivalry or motion perception are phenomena of low-level perception, they involve the specific experiences, that is to say, the congruent combination of olfactory and visual experience of rose/marker pen, or the specific perceptual training. Does olfactory stimulation modulate other low-level perception without training? To test that possibility, we investigated the effect of olfactory stimulation on visual motion perception, which is known to involve various crossmodal interactions (; ; ; ; ), thorough psychophysical and neuroimaging experiments.

Materials and Methods (Psychophysical Experiments)

Participants

Fourteen participants with normal or corrected vision and normal olfaction [seven females and seven males; mean age = 33.28 (SD = 6.74; ranging from 20 to 39)] participated in a series of experiments (“normal” in this study indicated a person who had never got vision/smell disorder for their daily lives, by their self-enumeration and recruiting agency’s reports). The post hoc analysis using PANGEA indicated that these sample size and experimental design (see below) yielded 80% power to detect d = 0.45 (; ).

Visual Stimuli and Aroma (Lemon and Vanilla)

The visual stimuli were presented using Psychtoolbox 3 on Windows 7. Motion dots were presented within an annulus with an inner diameter of 1 degree and an outer diameter of 25 degrees. Each white dot was 0.2 degrees square with 800 dots in a frame. All the motion dots, which were randomly assigned to each location at the beginning of a trial to move out of the presented circle in a radial way. We controlled the life time of the motion dots based on the results of preliminary experiments to avoid a situation where the participant might learn the change of the dot density at the edge of the circle along with different motion dot speeds.

As the olfactory stimulations, we used lemon and vanilla smells for the following reasons: they were supposedly unrelated to any feature of motion perception; they were oppositely located at the sensory map of the odor descriptions in the previous studies (; ). The lemon odor consisted of 67.26% limonene, 13.21% β-pinenne, 8.98% γ-terpinenne, and 2.11% citral. The vanilla odor consisted of 2.13% vanillin, 0.15% p-hydroxybenzaldehydel, 0.17% vanillic acid, 0.04% p-hydroxybenzonic acid, and 90.00% mono propylene glycol.

Projecting System of Aroma Shooter

In the experiments, we used an aroma projector (Aroma Shooter, Figure 1A) that controlled the delivery of discrete pulses of odor to a participant’s nose with suitable temporal precision (). Aroma Shooter has six aroma cartridge spaces. We put two lemon cartridges, two vanilla cartridges, and two odor-free cartridges in it. In the experiment, two cartridges were used in one trial to control the five kinds of olfactory stimulations in the whole experiment: full-lemon, half-lemon, full-vanilla, half-vanilla, and odor-free. Each odor was tested with regards to the motion dots; there was no simultaneous exposure to two different kinds of scents. In the full-lemon/vanilla condition, the Aroma Shooter used two lemon/vanilla cartridges. In half-lemon/vanilla condition, it used one lemon/vanilla cartridge and one odor-free cartridge. In the odor-free condition, it used two odor-free cartridges. With this method, participants perceived five kinds of olfactory stimulations with identical air strength.

FIGURE 1

Experimental Designs and Analyses

At the beginning of each trial, the participants fixated on the display center during exposure to one of three olfactory stimulations (lemon, vanilla, or odor-free) for 1.0 s and viewed expanding-motion dots for 1.0 s (Figure 1B). Participants were asked to report the subjective motion speed of the dots as fast or slow and were instructed to give one of these two answers even when they had difficulty making a decision (a forced-choice paradigm). To examine the degree of the effect of the olfactory stimulations, we set two different levels of chemical density for the lemon and vanilla projectors: full and half. We set five types of olfactory stimulations: full-lemon, half-lemon, full-vanilla, half-vanilla, and odor-free. There were seven different dot motion speeds: 3.0, 3.5, 4.0, 4.5, 5.0, 5.5, and 6.0 degrees/s. Combinations of olfactory stimulation and dot motion were presented in a randomized and counterbalanced order for each participant. Before the experiments, we did not give the participants any information about the olfactory stimulations (especially what odor).

In the entire visual experiment, the total number of trials was 525: 5 olfactory stimulations × 7 speed motion dots × 15 repetitions. To reduce the olfactory adaptation and ventilate the experiment room, we set at least 4.0-s intervals between trials and separated the experiment into five sessions (105 trials each). The presentation order of these conditions was randomly determined. To evaluate their performance in motion speed perception in each olfactory stimulation, we calculated the point of subjective equality (PSE) of the motion speed in each olfactory stimulation condition [50% response point of fast and slow; ] and compared it to that in the odor-free condition (each PSE divided by PSE of odor-free condition).

To confirm how participants perceived the olfactory stimulations during the main visual experiment, we conducted the olfactory experiment after the main visual experiment. This second experiment was identical to the main visual experiment except that participants were asked to identify the smell: lemon, odor-free, or vanilla. In the olfactory experiment, the total number of trials was 105: 5 olfactory stimulations × 7 speed motion dots × 3 repetitions. To assess their performance, we measured the accuracy of the olfactory tasks; 33.3% correct was the chance-level because of three alternative choices.

Results (Psychophysical Experiments)

Figure 2A represents the mean ratio of the PSE of the motion speed with full-lemon, half-lemon, half-vanilla, and full-vanilla to the PSE of the odor-free (n = 14; 525 trials each).

FIGURE 2

The results showed that the participants perceived the fastest motion with full-vanilla and the slowest motion with full-lemon, even when the stimuli were presented at the same motion speed (t(13) = 6.19, p < 0.001, and r = 0.87). The findings clearly suggest that participants perceived a higher speed of motion dots in this order: vanilla > odor-free > lemon (full-lemon and odor-free: t(13) = 2.85, p = 0.007, and r = 0.62: odor-free and full-vanilla: t(13) = 6.19, p = 0.01, and r = 0.59). According to a brief questionnaire after the experiment, no participants were aware of exactly what odors were released in the experiments, although some did notice the existence of several kinds of odor. In addition, the participants did not mention that their performances were based on some kind of rule, e.g., they perceived faster motions with vanilla.

Figure 2B shows the mean accuracy of the olfactory task (n = 14; 105 trials each, also see section “Materials and Methods”). The results revealed that participants distinguished among three olfactory stimulations (all accuracies exceeded the chance level). This indicates that they adequately perceived each olfactory stimulation during the main visual experiment. They also perceived the half- and full-lemon/vanilla in different degrees of sensation because the mean accuracies of full-lemon/vanilla were significantly higher than those of half-lemon/vanilla (full-lemon and half-lemon: t(13) = 4.23, p < 0.001, and r = 0.76: full-vanilla and half-vanilla: t(13) = 3.61, p = 0.002, and r = 0.71). These results provide solid explanations about the task performance differences between the half- and full-lemon/vanilla in the main visual experiment.

To examine how this olfactory-visual effect occurred in the neural levels of the perceptual processing, we measured the functional magnetic resonance imaging (fMRI) activities in the visual areas while the participants performed the visual task. Note that participants were not people who joined the first experiments.

Materials and Methods (fMRI Experiments)

Participants

Twelve participants with normal or corrected vision and normal olfaction [nine females and three males; mean age = 21.05 (SD = 6.55; ranging from 20 to 39)] participated in a series of experiments. The post hoc analysis using PANGEA indicated that these sample sizes and experimental designs (see the below) yielded 80% power to detect d = 0.45 (; ).

Visual Stimuli and Aroma

Stimuli and aroma were identical to the first psychophysical experiments.

Projecting System of an MRI-Compatible Olfactory Stimulator

We used an MRI-compatible olfactory stimulator (Arco System, Figures 3A,B). Unlike the first psychophysical experiments with Aroma Shooter (Figure 1A), since perception of olfactory stimulation depended on nasal respiration due to the mechanical system, they were asked to breathe through their nose as much as possible when white fixation and motion dots were presented (Figure 3C). Between each trial, at least a 7.0-s interval was set to avoid olfactory adaptation.

FIGURE 3

Experimental Design

We conducted the identical visual tasks to the first psychophysical experiment except for three different speeds of motion dots, 3.0, 4.5, and 6.0 degrees/s and only one level of chemical density for the lemon and vanilla odors. To maximize the effect of olfactory stimulation, participants were asked to breathe through their nose as much as possible when the valve was opened (Figure 3C). Over the entire experiment, the total number of trials was 240: 120 trials with odor-free, 60 with lemon, and 60 with vanilla stimulus. Each olfactory condition was accompanied by three different-motion-speed dots. To reduce the olfactory adaptation, we set at least a 7.0-s interval between trials, separated the experiment into eight sessions (30 trials each), and set the number of odor-free conditions as twice that of the other conditions. The presentation order of these conditions was randomized across conditions.

Functional Magnetic Resonance Imaging Data Acquisition and Analyses

Magnetic Resonance Imaging data were obtained by a 3T MRI scanner (Magnetom Trio; Siemens, Erlangen, Germany) using a 12-channel head coil at the Center for Information and Neural Networks (Osaka, Japan). To achieve a high spatial resolution whole-brain fMRI with a standard TR, we used multi-band echo planar imaging (EPI) implemented by CMRR1. An interleaved T2-weighted gradient-echo planar imaging scan acquired functional images that covered the entire brain (TR, 2,000 ms; TE, 30 ms; flip angle, 80°; multi-band acceleration factor = 3, partial Fourier = 6/8; voxel size, 2 × 2 × 2 mm; and number of slices, 75). We also collected anatomical images (T1-weighted, MP-RAGE) whose imaging parameters were as follows: TR, 1,900 ms; TE, 2.48 ms, flip angle, 9°; and voxel size, 1 × 1 × 1 mm.

Image pre-processing and statistical analyses were run by SPM12 (Wellcome Trust Centre for Neuroimaging, UCL, SPM). The acquired fMRI data underwent slice-timing correction and motion correction by SPM12. The data were then co-registered to the within-session high-resolution anatomical images of the same slices used for EPI and subsequently to the whole-head high-resolution anatomical images. Then the images were spatially normalized to the MNI template, their voxel size was resampled as 2 × 2 × 2 mm voxels. Finally, they were smoothed; the FWHM was 8 mm. Anatomical labels for the region of interest analysis were defined using the SPM anatomy toolbox (SPM Anatomy Toolbox) and WFU_PickAtlas.

Calculation of Ratio of Response Time in fMRI Experiment

Since, we found relatively large individual difference of response time in fMRI experiment, we calculated the ratio of response time (Response time at 3.0, 4.5, or 6.0 degrees/s divided by individual averaged response time at all dot speed). The unconverted data is available in Supplementary Figure 5.

Results (fMRI Experiments)

From the behavioral results, we found that the mean proportions of motion perceived as fast at 3.0 and 6.0 degrees/s were 3.8 ± 1.3 and 92.2 ± 1.9%, respectively, (Figure 4A, green circles on graph). Also, the mean response of fast at 4.5 degrees/s was 62.0 ± 5.1% (Figure 4A, a red circle on the graph).

FIGURE 4

In addition, the mean response time for making a decision at 4.5 degrees/s was significantly longer than at 3.0 and 6.0 degrees/s (3.0 and 4.5 degrees/s: t(11) = 4.19, p < 0.001, and r = 0.79: 4.5 degrees/s and 6.0 degrees/s: t(11) = 2.60, p = 0.01, and r = 0.62) (Figure 4B). These results suggest that participants had more difficulty making a decision (fast or slow) with 4.5 degree/s motion dots than at 3.0 (slowest motion) or 6.0 degrees/s (fastest motion).

From the fMRI results, the amount of activity in the human middle temporal area (hMT), which principally reflects the processed motion signals (; ; ; ; ), did not change based on the type of olfactory stimulation at the slowest and fastest motion speeds (relatively easy) (Figure 4C, an upper graph in the green rectangle, also see upper graphs in Supplementary Figure 1); however, they changed significantly with the type of olfactory stimulation at 4.5 degrees/s of motion (relatively difficult) (Figure 4C, an upper graphs in the red rectangle). The following are the two-way ANOVA results: odor type x task difficulty: F(2, 22) = 4.84, p = 0.018, and partialη2 = 0.31. In addition, the hMT activity amount with vanilla was significantly higher than with lemon at the relatively difficult condition (t(11) = 2.79, p = 0.009, and r = 0.64) (Figure 4C, an upper graph in the red rectangle). These results indicate that the fMRI activities in the visual cortex (hMT) changed significantly based on the type of olfactory stimulation when participants had more difficulty making a decision on the visual task. Similar activities were observed in the primary visual area (V1), which is the first stage of the cortical processing of visual information. The following are the results of a two-way ANOVA: odor type x task difficulty: F(2, 22) = 3.64, p = 0.043, and partialη2 = 0.25 (Figure 4C, bottom graphs, also see bottom graphs in Supplementary Figure 1), and the amount of V1 activity with vanilla was significantly higher than that with lemon at the relatively difficult condition (t(11) = 3.50, p = 0.002, and r = 0.73) (Figure 4C, a bottom graph in the red rectangle). In ANOVA analyses of V1 and hMT, the main effects of odor type and task difficulty were not significant except the task difficulty in V1 (Figure 4C).

Discussion

Our results demonstrated three significant points in the effect of olfactory stimulations on visual perception. First, the behavioral results certainly revealed that olfactory stimulation changed the visual perception without any specific training such as viewing the fast-motion with vanilla smell or slow-motion with lemon smell. This is the first direct evidence of olfactory-visual effect at the low-level of perceptual processing without training. This finding indicates that olfactory-visual effect is not an acquired but an innate behavior, because the obtained crossmodal phenomenon between olfaction and vision did not require any specific training. Confirming the presence of innate olfactory-visual effect gives us an opportunity to uncover not only crossmodal interaction with olfactory stimulations but also the roots in the biological evolution of olfactory system, because it might provide us with a clue to an underlying role of olfactory function such as olfaction for survival navigation (; ).

Second, the fMRI results showed that the olfactory stimulations directly or indirectly affected the brain activity in the visual cortices. In particular, the brain activity in the visual cortices (V1 and hMT) significantly changed based on the type of olfactory stimulation when participants had relative difficulty making decisions in the visual task (Figure 4C, graphs in red rectangle). To put it plainly, our perceptual system does not integrate the stimulus information for a task (motion dots here) with the information of the other modality (lemon and vanilla odors here) when the task stimulus satisfies certain criteria for making a decision; however, it does integrate the stimulus information for a task with the information of other modality when it fails to meet certain criteria. This is in accord with the general view of crossmodal effect (; ). Furthermore, since the fMRI results in V1 resembled those for hMT, this phenomenon appears to happen at an earlier perceptual level [also, the fMRI data in the other visual areas (V2 and V3) are available in Supplementary Figure 2]. This result is consistent with our view from the behavioral findings, that is to say, this implies the existence of crossmodal interactions between olfaction and vision at the low-level of perceptual processing (). By the same token, olfactory-visual interaction is presumably built in “hard-wiring” of the nervous system as an innate behavior (; ). One might assume that the olfactory stimulations affected not motion perception but just participants’ arousal level, which caused the different sense of visual perception (; ; ). To check that possibility, we measured fMRI activities in the thalamus that are associated with the level of arousal (; ). The results showed that those activities were not related to the type of olfactory stimulations in this study (Supplementary Figure 3). Hence, we concluded that the change of arousal level by an olfactory stimulation did not mainly contribute to our current findings. Moreover, we analyzed fMRI activities in the olfactory cortex for getting more insights of this olfactory-visual effect, but we could not find the significant BOLD signal differences with the olfactory stimulations used in this study (Supplementary Figure 4). To see the clearer relationship between olfactory stimulations and fMRI activities in the olfactory cortex, we might need to control the valence of chemical substances more severely ().

Third, our findings raise a new question. Why do the participants perceive slower movement with the lemon smell and faster movement with the vanilla smell? Perhaps the captured attention might have induced different speeds of moving dots, because an attended object was perceived to move faster than an unattended one (). For example, they could have paid less attention to the moving dots and perceived slower-moving dots, because the lemon odor might exploit more attentional resources than the vanilla odor. However, this is not likely. If that was the case, the fMRI activities in V1 and hMT, which are crucially influenced by attentional state (; ; ), changed with the type of the olfactory stimulation. But, they did not change with those odors used in this study (see in the main effects in Figure 4C). These results imply that this possibility cannot directly explain the current findings. Another possible explanation is that the lemon and vanilla odors might have influenced our participants’ perception of time. A number of psychological and neural studies have focused on our ability to keep and perceive our internal clocks (), and recent investigations have indicated that internal clocks are modulated by colors () and odors (). In our study, the lemon odor might have increased the speed of the internal clock, which might in turn have created a sense of slowness for the visual inputs at the perceptual level, and vice versa with the vanilla odor (). From another perspective, the current finding might be related to a fast-lemon issue; people usually link a lemon with being fast rather than slow (). This suggests that some symbolic elements of lemon (or vanilla) correlate with speed (fast or slow). However, the fast-lemon issue is mostly argued by semantic or synaesthetic association in high-level cognitive processing (; ; ; ). In addition, we identified a slow-lemon effect because the lemon odor made participants perceive slower-moving dots. Therefore, the present findings might not directly contribute to the interpretation of the fast-lemon issue. Although use of lemon and vanilla seemed to be effective for observation of this kind of crossmodal phenomenon (), one of the limitations of this study is caused by the fact that we tested only these two odors. In order to get a better understanding of this phenomenon, a broader range of odors should be tested in the future study. Although further studies are needed to fully understand the psychological/neurological mechanism of obtained results, our findings encourage us to re-examine not only other crossmodal interactions induced by olfaction but also some fundamental roles of the olfactory functions.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Statements

Data availability statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.

Ethics statement

The studies involving human participants were reviewed and approved by the Ethics Committee of the National Institute of Information and Communications Technology, Japan. The participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.

Author contributions

YT and YN conceived the research idea, designed the experiment, and conducted the experiments. All authors discussed the results and commented on the manuscript.

Funding

This work was partially supported by a JST (Japan Science and Technology Agency) project Keihanna Research Complex.

Acknowledgments

We thank Shinsuke Shimojo, Gregor Volberg, Anton Beer, Kyoko Hine, Parham Mokhtari, Akane Nagasawa, and Atsushi Wada for their comments.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. The reviewer GV declared a past collaboration with one of the authors YT to the handling editor.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnins.2021.642584/full#supplementary-material

References

Summary

Keywords

crossmodal perception, olfaction, motion perception, fMRI, psychophysics

Citation

Tsushima Y, Nishino Y and Ando H (2021) Olfactory Stimulation Modulates Visual Perception Without Training. Front. Neurosci. 15:642584. doi: 10.3389/fnins.2021.642584

Received

16 December 2020

Accepted

06 July 2021

Published

02 August 2021

Volume

15 - 2021

Edited by

Lars Muckli, University of Glasgow, United Kingdom

Reviewed by

Yong Gu, Institute of Neuroscience, Shanghai Institutes for Biological Sciences, Chinese Academy of Sciences (CAS), China; Marianna Obrist, University College London, United Kingdom; Gregor Volberg, University of Regensburg, Germany

Updates

Copyright

*Correspondence: Yoshiaki Tsushima,

This article was submitted to Perception Science, a section of the journal Frontiers in Neuroscience

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics