ORIGINAL RESEARCH article

Front. Hum. Neurosci., 18 January 2021

Sec. Brain Imaging and Stimulation

Volume 14 - 2020 | https://doi.org/10.3389/fnhum.2020.606238

A Look Into the Power of fNIRS Signals by Using the Welch Power Spectral Estimate for Deception Detection

  • 1. College of Electrical Engineering, Sichuan University, Chengdu, China

  • 2. China Mobile (Chengdu) Industrial Research Institute, Chengdu, China

  • 3. College of Biomedical Engineering, Sichuan University, Chengdu, China

  • 4. School of Information Science and Technology, Xichang University, Xichang, China

  • 5. Sichuan Cancer Hospital and Institute, Chengdu, China

  • 6. Institutes of Psychological Sciences, Hangzhou Normal University, Hangzhou, China

  • 7. Department of Psychology, Zhejiang Normal University, Jinhua, China

  • 8. Bioimaging Core, Faculty of Health Sciences, University of Macau, Taipa, China

Abstract

Neuroimaging technologies have improved our understanding of deception and also exhibit their potential in revealing the origins of its neural mechanism. In this study, a quantitative power analysis method that uses the Welch power spectrum estimation of functional near-infrared spectroscopy (fNIRS) signals was proposed to examine the brain activation difference between the spontaneous deceptive behavior and controlled behavior. The power value produced by the model was applied to quantify the activity energy of brain regions, which can serve as a neuromarker for deception detection. Interestingly, the power analysis results generated from the Welch spectrum estimation method demonstrated that the spontaneous deceptive behavior elicited significantly higher power than that from the controlled behavior in the prefrontal cortex. Meanwhile, the power findings also showed significant difference between the spontaneous deceptive behavior and controlled behavior, indicating that the reward system was only involved in the deception. The proposed power analysis method for processing fNIRS data provides us an additional insight to understand the cognitive mechanism of deception.

Introduction

Deception is a universally existing sociopsychological phenomenon, involving such psychological activities as perception, memory, thinking, and imagination (; ; Talwar and Kang, 2008; ). To date, great efforts have been made to reveal the neurobiological basis of deception. For example, electroencephalography (EEG)/event-related potential (ERP) (; ), functional magnetic resonance imaging (fMRI) (; ; ), functional near-infrared spectroscopy (fNIRS) (; Zhang et al., 2016), and various data analysis methods (; Zhang et al., 2016) were used to elicit the neural mechanisms underlying deception. Nevertheless, the neural mechanisms for deception still remains unclear, and the related data analysis methods need to be developed.

Because of poor EEG/ERP inherent spatial resolution, researchers are not better enabled to know about the brain regions involved in deception until the advent of fMRI (; ; ; ). Compared to fMRI, fNIRS can be operated in a portable, comfortable, and quiet way with fewer body constraints (). fNIRS that relies on the hemodynamic responses to infer brain activation has also been extensively utilized to inspect the cognition and brain disorders (; ; ; Yuan, 2013; ; Ren et al., 2019). In particular, fNIRS as an optical neuroimaging tool can provide the quantitative hemodynamic information including oxyhemoglobin (HbO) and deoxyhemoglobin concentration changes, which plays an important role in the study of cognitive processing in the frontal/prefrontal cortex (PFC) (; ; ; Yuan, 2013; ; Ren et al., 2019). More importantly, fNIRS has exhibited its unbeatable advantages in deception detection that involves the inspection of executive functions in PFC including withholding the truth and response monitoring (; ; ). Despite all these, deception still remains a profound paradigm for studying human behaviors, in view of the great complexity of deception in different environments and thus the limited understanding of neural mechanisms underlying various situations.

In view of the fact that the neural activities are accompanied by energy and power variation, the power changes of hemodynamic response, capable of reflecting brain activity intensity (; Zhang et al., 2010b), this study proposes a power analysis method based on the Welch power spectrum estimation of fNIRS signals including hemodynamic information, in a bid to quantify the brain hemodynamic responses associated with deception underlying various behavior states. The Welch power spectrum algorithm, as an effective spectral estimation method without seriously destroying the resolution, can significantly reduce the variance of spectral estimation by segmenting data through overlapping and adding windows in time domain (Welch, 1967; Proakis et al., 2003). We have made extensive efforts in acquiring data, documents, or information regarding the application of power analysis of fNIRS in exploring brain functional activity, which turns out to be a very rarely adopted practice, with little references available. But we do find the power measure produced by the power analysis model capable of quantifying the brain activity energy in different brain regions during a short-time period, and it has been applied in fMRI and EEG (Zhang et al., 2010a; Radulescu et al., 2012; ). And this leads us to assume that the power of fNIRS may also be able to serve as a neuromarker to unveil the brain power difference between the spontaneous deceptive and controlled behavior. In short, the novel measure in fNIRS proposed in this study is rather reasonably expected to be a valuable new approach to better understanding the cognitive mechanism associated with deception.

Materials and Methods

Participants

Twenty-five participants (14 females and 11 males; all aged 19–22 years) were recruited for the fNIRS experiments. All participants were right handed, who had no reported histories of brain diseases. Participants were instructed to sign informed consent documents prior to data acquisition. The protocol of this study was approved by the ethics committees of the Zhejiang Normal University, and the experimental tests were performed in accordance with the guidelines.

Tasks and Procedures

The paradigm adopted for the present study consisted of two blocks: one for spontaneous deceptive behavior and the other for controlled behavior. The spontaneous deceptive behavior block contained 40 event-related trials, whereas the controlled behavior block had 30 trials. The stimuli ended as soon as participants respond, and each trial included a 2 s prestimuli period, followed by an 11 s post-stimulus and recovery period with a white fixation cross displayed in the center of the monitor screen to make sure the hemodynamic response returned to the baseline (Figure 1).

FIGURE 1

During the stimuli period of each trial, participants were instructed to play a computer poker game with an opponent in a separated room. The winner was the poker game player who scored more points in each round (trial). For the spontaneous deceptive behavior stimuli, only the opponent picked up the first card of the poker game, and then only the participant who was able to see both his (her) and the opponent’s cards needed sent the final results of the competition (answers) to the opponent by pressing a button. The winner (the participant or the opponent) should be rewarded some amount of money. Interestingly, if the participant won the game for each round, he (she) generally sent the correct answer (win–win) to the opponent, whereas when the participant lost the game, he (she) might send a false answer to the opponent (lose–win) to receive a reward by deception or send the correct answer to lose the game (lose–lose). Among the 40-trial spontaneous deceptive behavior stimuli, 10 were for the win case, 30 for the lose case. Participants did not need to lie in the win case, whereas participants could lie for more money in the lose case. Therefore, 30 trials were designed for lose case to maintain the trials for lie (lose–win) or truth telling (lose–lose) were enough (about 10) for calculation.

By contrast, for the controlled behavior stimuli, participants needed to follow instructions on the computer screen to tell the truth or lie. In addition, the winner was not awarded any money for the controlled behavior task. The controlled behavior task consisted of three conditions: participants won the poker game and then sent the right answer (win–win) to the computer, and participants lost the game and sent the false (lose–win) or the true answer (lose–lose) to the computer. Ten trial tests were respectively, performed for each of the three conditions (i.e., win–win, lose–win, and lose–lose). And the test cases of spontaneous and controlled behaviors were provided in Table 1. Participants received rewards after they finished the whole experiment.

TABLE 1

CategoriesSpontaneous behavior (S)Controlled behavior (C)
Casesabcabc
Real answerWinLoseLoseWinLoseLose
Participant’ answerWinWinLoseWinWinLose
ResultsTruthDeceptionTruthTruthDeceptionTruth

Test cases of the spontaneous and controlled behaviors.

Data Acquisition and Preprocessing

fNIRS recordings were performed with a CW fNIRS system (ETG-4000, Hitachi Medical Co., Japan; 24 channels with eight laser sources and eight optical detectors). The optodes were placed on a 9 × 9 cm patch that was able to cover the frontal lobe (Figures 2A,B). The distance between each source and each detector was 30 mm; the sampling rate of the ETG-4000 system was 10 Hz, and the wavelengths of laser sources used were 695 and 830 nm. A three-dimensional (3D) magnetic space digitizer (EZT-DM401, Hitachi Medical Corporation, Japan) was utilized to measure the 3D spatial location of each optode on each participant’s scalp. And then the NIRS-SPM software (Ye et al., 2009) was used to access each channel’s mean MNI standard coordinates (Singh et al., 2005), which are provided in Table A1.

FIGURE 2

The fNIRS data were first processed by using a 0.01 Hz temporal high-pass filter and subsequently 0.3 Hz low-pass filter to remove baseline drifts and pulsation due to the heartbeat (; Sai et al., 2014). In this study, only HbO signals were processed for further power analysis because of its high signal-to-noise ratio (; ; ). Two participants were excluded from further analysis because of the poor quality of their optical data (possibly due to poor contact between the optodes and the scalp). Next, the datasets were segmented in relation to different markers that included three types of triggers for the spontaneous behaviors and three additional categories of triggers for the control behaviors (i.e., the win–win, lose–win, and lose–lose behaviors).

Data Analysis

For the trial-averaged HbO data from all channels, the PWELCH function in MATLAB is first used to calculate the Welch power spectral density (PSD) (Welch, 1967; Proakis et al., 2003) for each time series relevant to each channel and each participant. Interestingly, previous studies () showed that the Welch algorithm can break down the original signal into L overlapped segments. Consequently, the Welch power spectrum estimation algorithm of HbO signal x(n) is defined as follows:

  • 1)

    The signal x(n) with length N is divided into L data segments with length M, and the data segment is allowed to overlap, and N is the number of data points for each trial. The Welch power spectrum of xi(n), data segment i, is denoted as Pi(w) (Proakis et al., 2003),

in which is the normalized factor that ensures that the obtained power spectrum is asymptotically unbiased estimation; d2(n) is the window function, and w is the angular frequency.

  • 2)

    After calculating the Welch power spectrum of each data segment, we then generate the mean power spectrum of all L segments and obtain the Welch power spectrum estimation of the whole HbO signal x(n) (Proakis et al., 2003),

  • 3)

    Once the Welch power spectrum estimation of the mth channel for kth participant pm,k(w) is determined, the power is generated, which is the sum of PSD from all angular frequencies,

in which Pm,k is the power of the mth channel from the kth participant.

In addition, the standardized indicators for power are used to eliminate the effects of individual differences, in which Pm,k is standardized,

where Standard.Pm,k is the standardized form of Pm,k, Pk denotes the data vector with the total power from 24 channels for the kth subject, and mean(Pk) is the mean value of the data vector Pk.

As a result, a single power was produced for each channel from each participant based on Eqs 1–3, and then the power was standardized with Eq. 4. Further statistical analysis was performed by using the standardized indicator measures to identify the channels that exhibited significant difference between various conditions (; Nichols and Holmes, 2001; ; Zhang et al., 2010a, 2011).

Results and Discussion

The Welch power spectrum estimation of HbO signals was first generated for each channel from each subject. Although the power spectrum at characteristic points may be specified as the index of brain functional activation, brain activity may affect the power of signals at multiple frequencies. So we calculated the changes of average power for fNIRS signals in time domain. In order to obtain the average power in time domain by power spectrum, it is necessary to calculate the power of signals within all frequency bands. And the power as a novel neuromarker was produced for each channel from each subject, which was utilized as a quantitative measure for the following statistical analysis.

To inspect the neural correlates of deception, the paired t statistical test based on power measure was performed to examine the brain power differences between the spontaneous and controlled behaviors for the win–win, lose–win, and lose–lose cases. Interestingly, it was discovered from Figure 3 that for the win–win case, the spontaneous behavior exhibited significantly larger power than that from the controlled behavior in the frontopolar area (BA10, channel 04, and channel 09) and dorsolateral PFC (DLPFC) (BA09, channel 17). Meanwhile, the results in Figure 4 showed that for the lose–win case, the spontaneous deceptive behavior exhibited significantly higher power than the controlled behavior in the frontopolar area (BA10, channel 04), whereas the power for the controlled behavior was significantly enhanced as compared to that from the spontaneous behavior in the DLPFC (BA09, channel 12). In addition, we discovered that for the lose–lose case, the brain power for the controlled behavior was significantly higher in the frontopolar area (BA10, channel 07) than that from the spontaneous behavior (Figure 5). However, this is not the case for the brain power in DLPFC (BA09, channel 17), in which the spontaneous behavior exhibited higher value as compared to the controlled behavior.

FIGURE 3

FIGURE 4

FIGURE 5

Repeated-measures analysis of variance (ANOVA) measure was performed to explore the difference between the win–win, lose–win, and lose–lose conditions for the spontaneous deceptive behavior. The results in Figure 6 demonstrated that the power between the three cases exhibited significant difference in several brain regions, although this is not the case for the controlled behavior. For example, post hoc analysis for the spontaneous behavior showed that for the win–win case, the brain activation in DLPFC (BA09, channel 18) was significantly increased as compared to that from the lose–win case. In addition, compared with the lose–lose case, the lose–win case showed enhanced brain activation in the frontopolar area (BA10, channel 07). Meanwhile, the lose–lose case also exhibited significantly higher power than the lose–win case in the DLPFC (BA46, channel 11; BA09, channels 12 and 15). In particular, compared with the lose–lose case, the win–win case showed significantly higher brain power in the frontopolar area (BA10, channel 07) and DLPFC (BA09, channel 18). Further, the lose–lose case as well manifested significantly higher power than the win–win case in the DLPFC (BA09, channel 12).

FIGURE 6

In this study, fNIRS was used to inspect the neural mechanism of deception by using the measure of power, built on the basis of the Welch power spectrum estimation. The analysis of signals was not conducted directly based on the changes of signal amplitude at a certain instantaneous time point, but on quantitative comparison and analysis of the changes of power within all frequency bands between different cases. The analysis results of the power within all bands may not be consistent with the results of the amplitude variation of the fNIRS signal at a certain instantaneous time point, due to the fact that the amplitude at a single instantaneous time point is more susceptible to noise. Statistical analysis including the paired t test and the ANOVA measure was performed to examine the brain power difference between the spontaneous and controlled behaviors. The power spectrum approach has turned out to be able to detect neural activities for the whole brain using detection tools such as fMRI and EEG (; Moritz et al., 2003; ; ). But ours is the first ever study, to the best of our knowledge, that combines the power analysis model and fNIRS data to quantitatively examine the brain functional activation with deception. We discovered that the spontaneous deceptive behaviors exhibited significantly higher power than the controlled behavior. The analysis results also demonstrated that the power can be an effective neuromarker to reveal the complex neural mechanism associated with deception. Interestingly, the identified brain regions such as the right DLPFC (BA09), the left DLPFC (BA46), and the frontopolar area (BA10) are involved in the planning of complex and coordinated movements (; ), which plays an essential role in higher-level cognitive processing, particularly the goal-processing operations () and executing an action. In addition, previous reports also illustrated that the function of DLPFC including BA09 and BA46 is related to the executive function such as response control (Menon et al., 2001; Ridderinkhof et al., 2004). Importantly, during the stimuli period of spontaneous deceptive behavior, participants needed to make a decision on whether to tell truth or lie to the opponent, which might demand more cognitive efforts. By contrast, for the controlled behavior, participants were required to follow the instructions on the computer screen, which did not involve obvious cognitive efforts. Consequently, compared with that from the controlled behavior, enhanced brain power was discovered in the left frontopolar region and right DLPFC for the spontaneous behavior. Our results were also in line with previous findings that the functional brain networks of spontaneous deceptive behavior exhibited significant difference as compared to that from the controlled behavior (Zhang et al., 2016).

Meanwhile, the analysis results (Figure 6) of repeated-measures ANOVA are shown, which was performed to examine the brain power difference between the three conditions underlying the spontaneous deceptive behavior. Importantly, we discovered that there existed significant difference between the three cases during the performance of spontaneous behavior task. The brain regions that exhibited statistically significant power difference were the right frontopolar area (BA10) and the DLPFC (the left DLPFC, BA09, and BA46). Interestingly, previous fMRI studies also demonstrated that the PFC including the frontopolar area and DLPFC is the major cortical region within the “reward” neural network (Pochon et al., 2002; ). Hence, the fMRI findings showed good agreement with our results regarding the activated brain regions. In addition, the results in Figure 6 demonstrated that there were statistical differences in the frontopolar area and the DLPFC between the case of truth-telling and lying. In the truth-telling cases (win–win, lose–lose), the participants’ answer were consistent with the real answer. However, for the lose–win case, participants needed to report the opposite of real answer to lie for receiving the reward. The frontopolar area and the DLPFC are parts of the anterior PFC and have been identified to play an important role in the processing of response control, which is discovered as the central of lying (; Priori et al., 2008; ). It might be because of the differences that the participants choose to lie to get a reward or to present the fact as honest, which caused the significant differences in the frontopolar area and the DLPFC underlying the cases of using a truth-telling or a lying to deceive during the spontaneous behavior.

Conclusion

To the best of our knowledge, it was the first time that the power analysis model, which combined the neuroimaging tool fNIRS and the Welch power spectrum estimation method, was utilized for the quantitative analysis of brain power in deception with different behavior states. We discovered that the demanding executive tasks under the spontaneous behavior produced significantly higher power than those under the controlled behavior in the PFC including the left frontopolar area and the right DLPFC. These findings showed that the power analysis method can provide us supplementary reference information to explore the neural mechanism of deception.

Statements

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.

Ethics statement

The studies involving human participants were reviewed and approved by the Ethics Committees of the Zhejiang Normal University and the experimental tests were performed in accordance with the guidelines. The patients/participants provided their written informed consent to participate in this study.

Author contributions

JiaZ proposed the analysis method for processing fNIRS data. XL and LS designed the experiments. JiaZ and HR analyzed the data. XL prepared the Figures 1, 2B. HR prepared the Figures 3–6 and Table 1. XL and HR prepared the Table A1 and Figure 2A. JiaZ, HR, ZY, JinZ, XL, SM, and ZD wrote the manuscript. The others provided supports to this study during the experiments. All authors contributed to the article and approved the submitted version.

Funding

This research was supported by the National Natural Science Foundation of China (Grant No. 61876114) and Sichuan Science and Technology Program (Grant No. 2018TJPT0008, Science and Technology Department of Sichuan Province, China). This work was also supported in part by Liangshan State Science and Technology Program (Grant No. 18YYJS0073).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

Appendix

TABLE A1

ChannelsMNI coordinates (x, y, z)Brodmann areaProbability of overlap
Ch01−2171011—Orbitofrontal area0.57
Ch02−270010—Frontopolar area0.89
Ch032172−511—Orbitofrontal area0.74
Ch04−3265910—Frontopolar area0.88
Ch05−14731210—Frontopolar area1
Ch0612731210—Frontopolar area1
Ch073268410—Frontopolar area0.66
Ch08−23672210—Frontopolar area0.88
Ch09−2672210—Frontopolar area1
Ch1020701910—Frontopolar area1
Ch11−32553046—Dorsolateral prefrontal cortex0.97
Ch12−1362359—Dorsolateral prefrontal cortex0.50
Ch1311653310—Frontopolar area0.67
Ch1431582846—Dorsolateral prefrontal cortex0.77
Ch15−2052429—Dorsolateral prefrontal cortex0.93
Ch16−456439—Dorsolateral prefrontal cortex0.95
Ch171855429—Dorsolateral prefrontal cortex0.99
Ch18−3139479—Dorsolateral prefrontal cortex0.95
Ch19−1247509—Dorsolateral prefrontal cortex0.90
Ch201049519—Dorsolateral prefrontal cortex0.84
Ch212942479—Dorsolateral prefrontal cortex0.98
Ch22−2234578—Includes Frontal eye fields0.75
Ch23−539578—Includes Frontal eye fields0.85
Ch241837588—Includes Frontal eye fields0.76

The mean 3D MNI coordinates and associated brain regions for the 24 channels.

Summary

Keywords

functional near-infrared spectroscopy, power, Welch power spectrum estimation, deception, quantitative analysis

Citation

Zhang J, Zhang J, Ren H, Liu Q, Du Z, Wu L, Sai L, Yuan Z, Mo S and Lin X (2021) A Look Into the Power of fNIRS Signals by Using the Welch Power Spectral Estimate for Deception Detection. Front. Hum. Neurosci. 14:606238. doi: 10.3389/fnhum.2020.606238

Received

14 September 2020

Accepted

30 November 2020

Published

18 January 2021

Volume

14 - 2020

Edited by

Dajiang Zhu, University of Texas at Arlington, United States

Reviewed by

Lei Xi, Southern University of Science and Technology, China; Jiaying Xiao, Central South University, China

Updates

Copyright

*Correspondence: Site Mo, Xiaohong Lin,

This article was submitted to Brain Imaging and Stimulation, a section of the journal Frontiers in Human Neuroscience

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics