Skip to main content

REVIEW article

Front. Behav. Neurosci., 06 May 2021
Sec. Emotion Regulation and Processing
Volume 15 - 2021 | https://doi.org/10.3389/fnbeh.2021.647922

Assessing Impulsivity in Humans and Rodents: Taking the Translational Road

  • 1Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Braga, Portugal
  • 2ICVS/3B’s – PT Government Associate Laboratory, Braga/Guimarães, Portugal
  • 3Clinical Academic Center – Braga, Braga, Portugal
  • 4Psychological Neuroscience Lab, CIPsi, School of Psychology, University of Minho, Braga, Portugal

Impulsivity is a multidimensional construct encompassing domains of behavioral inhibition as well as of decision making. It is often adaptive and associated with fast responses, being in that sense physiological. However, abnormal manifestations of impulsive behavior can be observed in contexts of drug abuse and attention-deficit/hyperactivity disorder (ADHD), among others. A number of tools have therefore been devised to assess the different facets of impulsivity in both normal and pathological contexts. In this narrative review, we systematize behavioral and self-reported measures of impulsivity and critically discuss their constructs and limitations, establishing a parallel between assessments in humans and rodents. The first rely on paradigms that are typically designed to assess a specific dimension of impulsivity, within either impulsive action (inability to suppress a prepotent action) or impulsive choice, which implies a decision that weighs the costs and benefits of the options. On the other hand, self-reported measures are performed through questionnaires, allowing assessment of impulsivity dimensions that would be difficult to mimic in an experimental setting (e.g., positive/negative urgency and lack of premeditation) and which are therefore difficult (if not impossible) to measure in rodents.

Introduction

Impulsivity has been defined in multiple and partially overlapping manners: (i) a tendency to act quickly, although often prematurely, and without appropriate foresight (Dalley and Robbins, 2017), (ii) predisposition to react in a rapid and unplanned manner to internal or external stimuli with reduced consideration for the negative impacts of such reaction (Fineberg et al., 2010), or (iii) a non-reflective stimulus, in opposition to a reward-driven action (Nigg, 2017). It is considered to be in the same spectrum as compulsivity, which can be defined as the repetition of choices or actions in an inflexible manner, despite changes of setting or negative consequences (Voon and Dalley, 2016). However, they are on opposing extremes of a continuum, being assessed with different tests (Hook et al., 2021) and characterized by dissociable psychological and neurological correlates (Voon and Dalley, 2016).

Impulsivity is commonly aggregated into two major categories: impulsive action and impulsive choice. Impulsive action, or rather its inhibition, is the transient suppression of a quick response to an internal or external cue, allowing slower cognitive processes to be able to operate to guide the behavior (Winstanley et al., 2006). It has been suggested that impulsive actions can be divided into two types: action restraint or action cancelation, depending on the action being inhibited before or after its initiation, respectively (Schachar et al., 2007; Eagle et al., 2008). Impulsive choice, on the other hand, implies a decision-making component (Winstanley et al., 2006), mainly in two modalities: temporal discounting and reflection impulsivity. In the first, the preference for immediate smaller over delayed larger rewards reflects a higher impulsive choice. The second is the tendency to make fast decisions in the absence of sufficient evidence (Dalley and Robbins, 2017).

Impulsivity has a major adaptive role, but the balance between impulsivity and inhibition is labile, often depending on the situation. If an object falls off a table, the fast impulsive response of grabbing it is typically beneficial. However, if that object is at an extremely high temperature, such reflex can induce lesion. Such is also true for fast aggressive responses (in war vs. stable society contexts) or choice for a smaller immediate reward over a larger delayed one (in immediate need vs. comfortable living contexts). On the other hand, excessive impulsivity in a given context can lead to negative consequences such as physical injury, problems in maintaining relationships, or even imprisonment. At the pathological level, the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) classifies this trait as a diagnosis criterion, a feature, or a risk factor in multiple disorders, including attention-deficit/hyperactivity disorder (ADHD), gambling disorder, and disorders of alcohol or drug use, respectively (American Psychiatry Association, 2013). Indeed, a vast array of literature has associated impulsivity with disorders such as addiction (Mitchell, 2004; Jentsch et al., 2014; Herman and Duka, 2019), reactive aggression (Blair, 2016; Brennan and Baskin-Sommers, 2019), self-harm (McHugh et al., 2019), binge eating disorder (Giel et al., 2017), or ADHD (O’Neill et al., 2017). Comorbidities are also frequent, with impulsivity being a common factor between schizophrenia and aggression (Hoptman, 2015), ADHD and obesity (Cortese et al., 2016), or drug abuse, eating disorders, and self-harm in adolescents (Greydanus and Shek, 2009).

Thus, the assessment of impulsivity in a translational manner is of high importance. In this narrative review, we will systematize behavioral and self-reported measures of impulsivity in a critical manner. Considering that rodents are among the most widely used animal model, we will provide an analysis of tests commonly used for the assessment of impulsivity in humans and rodents and analyze their interspecies comparability. Regarding clinical validity, we will briefly mention results attained in pathologies of altered impulsivity, prioritizing literature with a higher degree of evidence (i.e., meta-analyses and systematic reviews).

Behavioral Measures of Impulsivity

Behavioral measures have the advantage of evaluating a given dimension of impulsivity in a direct and controlled manner. Also, tests developed for human usage can commonly be adapted for application in laboratory animals and vice versa. On the other hand, they are normally unable to assess impulsive behavior that occurs on more complex contexts, which is dependent on a specific emotional or physical state (e.g., impulsivity associated with states of high arousal), thus not capturing all of its dimensions (see self-reported measures for more information).

Impulsive Action

Tests for assessment of impulsive action typically involve a motor response, whose inhibition is rewarded. Considering their simplicity, they are easily adapted and applied to both rodents and humans (see Table 1 and Figure 1 for direct associations).

TABLE 1
www.frontiersin.org

Table 1. Behavioral measures of impulsivity.

FIGURE 1
www.frontiersin.org

Figure 1. Behavioral and self-reported measures of impulsivity. Behavioral (top) and self-reported (bottom) measures of impulsivity are shown in a schematic manner, highlighting the parallel between human (left) and rodent (right) methods. Image created with BioRender (www.biorender.com).

Go–noGo Task

The Go–noGo task assesses action restraint. In the human version, a sequence of images (typically letters) is shown to the experimental subjects, who are required to press a key whenever the signal is “Go” (e.g., the letter Z). In a subset of the trials, the “noGo” stimulus (instead of the “Go”) is shown, and the subject is required to withhold the response (Winstanley et al., 2006; Winstanley, 2011). Failure to achieve this inhibition is counted as an impulsive response. Many variations of this task have been used, mainly for convenience purposes, or in order to fulfill concerns of each particular study, including using different stimuli (e.g., shapes, pictures, and sounds) (Kaladjian et al., 2011; Dambacher et al., 2015; Hege et al., 2015) or different numbers of Go and noGo stimuli (e.g., V as noGo and any other letter as Go) (Horn et al., 2003). It is also possible to manipulate the number of impulsive responses by altering the presentation proportions (i.e., typically noGo is presented in around 25% of the trials, but this value has been increased up to 50%) (Kaladjian et al., 2011) or by introducing pre-stimulus cues (Kaladjian et al., 2011; Fillmore and Weafer, 2013). Additional elements can be assessed in this test by including distracting images (Brown et al., 2015) or working memory components (Garavan et al., 1999). Because of its simplicity, Go–noGo can be applied to different ages and cognitive profiles. It also seems to be relevant for impulsivity-related disorders, as users of cocaine, MDMA, tobacco, and alcohol were shown to present higher impulsivity in this task, in a meta-analysis (Smith et al., 2014); in contrast, no effects were found in cannabis users, and internet-addicted subjects showed even better inhibitory control than controls (Smith et al., 2014). Also, it has been argued that this test assesses mostly attentional processes (Criaud and Boulinguez, 2013).

Its rodent version (also named Go–noGo) follows a similar principle, except that the stimuli are typically sounds or smells. The animal learns that responding to a Go stimulus is reinforced, while responses to the noGo stimulus are not, being considered impulsive. There are multiple variations of this protocol, including different rewards (e.g., food, sucrose, and drugs), cues (e.g., sounds, lights, and smells), apparatus (operant box vs. box with subdivisions), proportion of Go and noGo trials, or application of negative reinforcement (e.g., air puff or quinine). These are typically developed for either convenience purposes (e.g., type of apparatus available) or due to specific experimental concerns (e.g., assessment of the effects of drug or punishment administration on the behavior). Also, protocols in which the animals are head-fixed have been developed, allowing usage of the Go–noGo task in experiments that involve imaging, electrophysiology, or similar protocols (Anker et al., 2009, rats; Moschak and Mitchell, 2012, rats; Jones et al., 2017, rats and mice; Kamigaki and Dan, 2017, mice; Schiff et al., 2018, mice; and Han et al., 2019, mice). In opposition to the human protocols, application in rodents requires extensive training, whose length will depend on the species (mouse or rat) and particularities of the Go–noGo version used. Indeed, these particularities may also need to be adapted according to species. For instance, Jones et al. (2017) showed that rats are able to learn a task in which a positive valence is associated with the Go cue and a negative valence is associated with the noGo cue, but not the opposite, while mice’s learning is associated with the reverse. As in the human version, this task relies on additional functions beyond impulsivity, including attention, Pavlovian and instrumental conditioning, and working memory (Mitchell, 2004).

Five-Choice Serial Reaction Time Task

The five-choice serial reaction time task (5-csrtt) is another widely used task for assessment of action restraint in rodents. In this task, five response orifices are available, and lights are shown in each one individually. Nose poking in the illuminated hole is rewarded with a sugar pellet, while responses that occur before one of these five lights is on (i.e., during the inter-trial interval [ITI]) are considered impulsive (Carli et al., 1983, rats; Winstanley et al., 2006, rats; Bari et al., 2008, rats; Cope et al., 2016, rats and mice; Higgins and Silenieks, 2017, rats and mice). Also, continuous responses at the apertures after reward delivery are considered perseverative, which are more akin to compulsion, rather than impulsivity (Robbins, 2002). Several variations of this task are used, including alterations in stimulus or ITI duration (altering the propensity toward impulsive responses) or stimulus intensity (altering the attentional demand) (Higgins and Silenieks, 2017, rats). 5-csrtt usage is, however, quite homogenous. Performance on this task is very reliable after appropriate training, which is relatively simple (Higgins and Silenieks, 2017, rats), although prolonged, which may be an impediment for evaluating transient stages of development (e.g., adolescence). Also, other functions are necessarily involved in its performance (e.g., motor, attention, and motivation). Indeed, considering the small stimulus presentation times—down to 1 s or less (Zhong et al., 2018, rats; Bruinsma et al., 2019, rats)—and that the 5-csrtt is based on a human attentional task [continuous performance task (<snm>CPT</snm>); see below] (Winstanley et al., 2006, rats; Higgins and Silenieks, 2017, rats), attentional demand is very high, which can be seen as a potential confounding factor in the assessment of impulsivity, or as an outcome in itself—i.e., the task can be used for attention evaluation (Bari et al., 2008, rats). Of note, rats have been reported to perform more impulsive responses and to be more reliant on temporal than visual strategies (i.e., assess the time to response, instead of relying on aperture lights) compared to mice (Cope et al., 2016).

Regarding a human equivalent, despite being based on the CPT, the 5-csrtt is more akin to a recent back-translation to humans as it does not include a key part of the original task—non-target stimuli. Voon et al. (2014) created a direct adaptation of the 5-csrtt, in which four windows in a touch screen are shown. The trial initiates with the subject pressing a computer key, and upon fast presentation of a stimulus in one of the windows, the key must be released and the correct window selected. Premature release of the trial initiation key is considered an impulsive response (Voon et al., 2014). This task was shown, in the same work, to be relevant for subjects with substance dependence (alcohol, tobacco, methamphetamine, and cannabinoids), who presented higher impulsivity levels than controls (Voon et al., 2014). Of notice, an adaptation of this human version has also been developed for application during magnetic resonance imaging (MRI) (Neufang et al., 2016).

CPT

The human CPT (Rosvold et al., 1956) is very similar to a human Go–noGo with inverted frequencies of “Go” and “noGo” targets. Thus, stimuli are shown sequentially, and upon appearance of a rare target, the subject is required to respond. The main metrics are the error rate and the reaction time (Ballard, 1996; Roebuck et al., 2016). Although some aspects of impulsivity can be captured in this test, it was designed primarily for assessment of attention (Riccio et al., 2002; Roebuck et al., 2016), and that remains its most common usage (Riccio et al., 2002). It is also influenced by other factors that are particularly important in an attentional task and which can be associated with the surrounding environment (e.g., noise and temperature) or with subject state or trait characteristics (e.g., motivation, age, and personality) (Corkum and Siegel, 1993; Ballard, 1996). Multiple variations of this task have been used, including different stimuli (visual letters, auditory letters, or tones), which do not seem to influence the outcome (Roebuck et al., 2016); different targets (e.g., an “X” that is shown after an “A,” thus introducing a working memory component); frequencies of target presentation; or interstimulus intervals (altering the attentional component and the propensity for impulsive responses) (Riccio et al., 2002). In meta-analyses, the CPT showed good performance in the assessment of children with ADHD (Losier et al., 1996; Huang-Pollock et al., 2012), as well as in the distinction between treated and non-treated patients with this pathology (Losier et al., 1996).

The CPT has been adapted for rodent usage in a multitude of manners. The most commonly used for impulsivity assessment is the 5-csrtt (see section “5-Choice Serial Reaction Time Task”), although the rodent CPT (rCPT) and the 5C-CPT are more akin to the original task. As in the CPT, rodents performing the rCPT are required to respond to target stimuli and to withhold response to non-targets. The task is administered using a touch screen, where a pattern is shown. The animal should touch a target pattern and withhold response to a non-target pattern in order to receive a reward; each stimulus is presented 50% of the time (Kim et al., 2015, mice). Of note, as an adaptation of the CPT, the rCPT was developed as a task to assess attention (Kim et al., 2015, mice) rather than impulsivity, although it has also been used for that effect (Caballero-Puntiverio et al., 2019, mice). The five-choice CPT (5C-CPT; rodents) is very similar to the above-described 5-csrtt, with the target being a light that is shown in one of five apertures, but also including a non-target stimulus—the simultaneous presentation of all five lights—to which the animal must withhold response (Bhakta and Young, 2017, rats and mice; Higgins and Silenieks, 2017, rats). It has been developed aiming to assess attention, vigilance, and response inhibition (Bhakta and Young, 2017), although it is not commonly used, potentially due to being so recent (2017).

Stop Signal Task

In opposition to the above-mentioned tests which are designed to evaluate action restraint, the stop signal task (SST) is the only one able to assess action cancelation. In its typical format for human application, a sequence of visual stimuli is shown, to which one of two actions is requested (e.g., pressing a left button for a leftward arrow and a right button for a rightward arrow). In some trials (typically 25%) and at random delays, a second stimulus (e.g., an image of a cross or a tone) is presented after the first, signaling that the response must be inhibited (stop signal) (Smith et al., 2014; Verbruggen et al., 2019). The stop-signal reaction time is estimated from the probability of stopping upon presentation at different delays and reflects the time that is required to stop an initiated response (Smith et al., 2014). Multiple adaptations of the SST have been used, aiming to alter either the attentional load or the stop reaction time. These include alterations of the number of stimuli/responses in the “Go” condition, salience of the stop signal, or frequency of presentation of the stop signal. Aiming to homogenize conclusions, a consensus guide was recently published (Verbruggen et al., 2019). The construct of this task allows reduced interference of attention in the assessment of impulsivity, and several meta-analyses have found effects in pathologies typically associated with impulsivity, including ADHD (Alderson et al., 2007; Lipszyc and Schachar, 2010), pathological gambling (Smith et al., 2014; Chowdhury et al., 2017) (although Lipszyc and Schachar, 2010, did not find this effect), substance dependence (Lipszyc and Schachar, 2010), and schizophrenia (Lipszyc and Schachar, 2010). On the other hand, as SST is designed to elicit approximately 50% failures, it may be considered too difficult by some subjects and decrease motivation (Smith et al., 2014).

The rodent version of SST follows a similar construct. The animals are trained to, after a signal, press a first and then a second lever, sequentially, in order to receive a reward. On some trials (typically 20%), a tone (stop signal) is presented after pressing of the first lever, and the animal is required to withhold from pressing the second lever (Winstanley and Clark, 2016, rats). Because the task is very similar to the human one, impulsive-like behavior can easily be inferred; however, it requires extensive training.

Impulsive Choice

Tests for assessment of impulsive choice imply a decision between two potential actions, aiming to maximize the attained reward. Such implies complex processes which often hinder a direct translation of tasks between human and rodents (see Table 1 and Figure 1 for direct associations).

Delay Discounting

The delay discounting (DD) task is based on the assessment of reward value through a balance between its size and the delay to get it. Typically, across trials, one of these two variables is changed, eventually reaching a level at which the value of both rewards is similar (indifference point) (Vanderveldt et al., 2016). In humans, the task is often performed using a computerized platform. Variations may depend on the goal of the study, e.g., different types of reward (money, drugs, food, etc.), or aim to alter the levels of impulsive decision making by changing the sequence in which the values are presented (ascending, descending, balanced, or random—see Robles and Vargas, 2008, for effects) or the number/size of delays/rewards (da Matta et al., 2012). Also, the structure can be fixed for all participants or adapted to the performance, aiming to increase sensitivity (da Matta et al., 2012). Steeper discounting has been associated with obesity (Amlung et al., 2016) and abuse of alcohol, tobacco, cannabis, stimulants, opiates, or gambling (Amlung et al., 2017). While testing is simple and data analysis is well established, its simplicity in comparison with real-world decision making has been discussed (Vanderveldt et al., 2016). Indeed, the task typically contemplates one immediate reward and one associated with a delay, but not two different delays. Such would be associated with more complex processes of decision, in which a preference reversal is commonly observed, i.e., an initial preference for the larger, more delayed reward, which is reversed as the time of the smallest, less delayed one gets closer (e.g., the planning for starting a diet on Monday, aiming to achieve a healthier lifestyle, which is replaced by the desire for highly energetic food) (Vanderveldt et al., 2016).

In the rodent version, the animals are required to select one of two levers in order to receive the corresponding reward (typically sugared food) (Winstanley et al., 2006, rats). In alternative, it has been performed in a T-maze, instead of an operant box (i.e., the choice is made by selecting the left or the right arm, rather than a lever or a nose-poke hole) (Winstanley, 2011, rats; Feja et al., 2014, rats; Masuda et al., 2020, mice), but other variations include the way the delay evolves (preset or adjusting and within or between sessions), the type of reward (e.g., food or drugs), or its relative size (Winstanley, 2011, rats).

While the human and rodent tasks are quite similar in their construction, they often differ in key aspects, including (i) the type of reward—palatable food or drink, alcohol, or drugs in rodents—and hypothetical money (most common), real food/drink, real money, entertainment, activities, or social/sexual reward in humans (of note, non-monetary rewards used in humans have been shown to increase non-systematic responding, Smith et al., 2018); (ii) the delay—normally in the range of seconds for rodents and months or years in humans (although delays of seconds have been previously applied to humans, Pietras et al., 2003); (iii) the reward presentation—typically, animals experience the reward, while it is just communicated to humans; (iv) the waiting—rodents who choose the long delay have to endure it in a relatively small space with minimal entertainment, while humans are able to proceed with their normal activities during the delay (Vanderveldt et al., 2016).

Beads Task

The beads task, used in humans, assesses the “jumping to conclusions” bias, which is considered as a lack of reflection impulsivity, even though it is controversial whether this is a test of impulsive choice. In this task, two jars of beads are filled with equal but opposite ratios of different-colored beads (e.g., jar 1 has 85 red and 15 blue beads, and jar 2 has 85 blue and 15 red beads). The jars are hidden, and individual beads are shown in a predetermined order to the subject, who needs to decide from which jar the beads are being taken. Two main variables are assessed: the number of beads drawn before a decision is made, and the proportion of extreme responders (i.e., subjects who make a decision based on one or two beads) (Dudley et al., 2016). Common variations of the beads task include changes in the ratios or in the jar contents (Dudley et al., 2016), altering impulsive decision; or inclusion of distractor sequences (McLean et al., 2018), improving reliability and repeatability (McLean et al., 2018). In a meta-analysis, people with psychosis in comparison with healthy controls required less beads to make a decision and had a higher number of extreme responders. Also, people with delusions required less beads than people with psychosis but without delusions, also having more extreme responders (Dudley et al., 2016). In impulsivity-related pathologies, to the best of our knowledge, no systematic reviews or meta-analyses were performed, although data suggest alterations in this task in binge drinkers (Banca et al., 2016). There is no rodent equivalent of this task, nor is there a rodent task that claims to assess reflection impulsivity.

Mixed Tasks

One rodent task, the variable delay to signal (VDS), assesses both impulsive action and delay tolerance (impulsive choice) (Leite-Almeida et al., 2013, rats; Soares et al., 2018, rats). It was originally based on the 5-csrtt, but using only one response aperture. The animals are required to nose-poke in the aperture when its light is on but refrain from doing it in the delay that precedes presentation of such light (impulsive response). At a first stage of the task, this delay is maintained constant (3 s), and premature responses reflect action impulsivity (i.e., were associated with the 5-csrtt). The second stage includes three blocks of different delays: 3, 6/12, and again 3 s, and an increase in impulsive responses in consequence of the larger delays reflects delay intolerance (i.e., is associated with DD) (Leite-Almeida et al., 2013, rats; Soares et al., 2018, rats). To date, no variations of this task have been published, except for an adaptation of the delays after the first publications (Leite-Almeida et al., 2012, rats; Leite-Almeida et al., 2013, rats), which may be due to a utilization restricted to the original group (Leite-Almeida et al., 2012, rats; Leite-Almeida et al., 2013, rats; Melo et al., 2016, rats; Carvalho et al., 2017, rats; Cunha et al., 2017, rats; Soares et al., 2018, rats; Cunha et al., 2020a, rats; Cunha et al., 2020b, rats), with only one exception to date (Jiménez-Urbieta et al., 2020, rats). In comparison with other tasks, the VDS reduces the attentional bias, as well as potential effects of extensive training. Its reduced training time (7 days) also allows assessment of transient states (e.g., adolescence). Indeed, it was shown to be sensitive to age, sex, and strain differences (Soares et al., 2018, rats). On the other hand, it still relies on motor performance, and despite association with DD, its inclusion as a task for the assessment of choice impulsivity would be discussible, as it does not imply a choice per se, but rather a delay intolerance component. Although the VDS is based on the 5-csrtt (which is, in turn, based on the CPT), it does not have a direct human equivalent task, nor has it been used in mice.

Self-Reported Measures of Impulsivity

Self-reported measures of impulsivity are attained using structured questionnaires regarding attitudes or feelings in different situations. Such allows the assessment of impulsivity within given contexts that cannot be reliably reproduced in a laboratory, and despite this dimension of subjectivity, they have often shown reliability and reproducibility (see below). On the other hand, subjective measures cannot be back-translated to rodents. We here summarize some of the most commonly used scales. For a more in-depth analysis of self-reported measures, please consult the recent review by Hook et al. (2021). Table 2 summarizes the basic components of the here-described tests.

TABLE 2
www.frontiersin.org

Table 2. Self-reported measures of impulsivity.

Barratt Impulsiveness Scale-11

The Barratt Impulsiveness Scale-11 (BIS-11) is one of the most widely used scales for the assessment of impulsivity. Its currently used version was designed by Patton et al. (1995) and assesses three main factors within 30 items, which can be further subdivided: attentional impulsiveness (attention and cognitive instability), motor impulsiveness (motor and perseverance), and non-planning impulsiveness (self-control and cognitive complexity), to which the subject responds through a scale that ranges from 1 (rarely/never) to 4 (almost always/always). Attentional impulsiveness items include statements such as “I don’t pay attention” or “I am a steady thinker” (inverted). Motor impulsiveness is reflected in sentences such as “I act on impulse” or “I am future oriented” (inverted). Non-planning impulsiveness is assessed though statements such as “I say things without thinking” or “I like to think about complex problems” (inverted) (International Society for Research on Impulsivity, 2020). Meta-analyses have shown that <snm>BIS</snm>-11 motor impulsivity is altered in pathological gamblers (Chowdhury et al., 2017) and that all dimensions are altered in bipolar disorder (Saddichha and Schuetz, 2014). Also, a systematic review has shown an association with food addiction (Maxwell et al., 2020).

Behavioral Inhibition System/Behavioral Activation System Scale

The Behavioral Inhibition System/Behavioral Activation System (BIS/BAS) scale was developed by Carver and White (1994) and is based on the idea of two contrasting systems. One is associated with anxiety, is sensitive to negative outcomes, and is activated do avoid them (BIS), while the second is associated with appetitive motivation, is sensitive to positive outcomes, and is activated to approach them (Carver and White, 1994). This scale includes 24 items to which the subject responds in a scale that ranges from 1 (very true for me) to 4 (very false for me). BIS/BAS includes four subscales: (i) BIS, assesses the reaction to an anticipated punishment through sentences as “I worry about making mistakes” or “Criticism and scolding hurts me quite a bit”; (ii) BAS drive, directed at the pursuit of desired goals, including “I go out of my way to get things that I want”; (iii) BAS reward responsiveness, assesses the positive response to the anticipation of a reward, such as “When I get something I want, I feel excited and energized”; and (iv) BAS fun seeking, evaluates the desire for new rewards and the approach motivation toward potentially rewarding events, such as “I will often do things for no other reason than that they might be fun” or “I often act in the spur of the moment” (Carver and White, 1994). Despite its wide usage, to the best of our knowledge, no meta-analyses have been published to assess BIS/BAS effects on impulsivity-related disorders. One systematic review, however, was unable to find associations of BAS and food addiction, while the number of BIS studies was insufficient for conclusion withdrawal (Maxwell et al., 2020). Nonetheless, the literature suggests associations with alcohol (Studer et al., 2016) and nicotine (Baumann et al., 2014) use.

Eysenck’s Impulsivity Inventory

Eysenck’s Impulsivity Inventory, also known as the Impulsiveness, Venturesomeness, and Empathy (IVE) Questionnaire, was developed, in its current version (I7) by Eysenck et al. (1985). Although it is not as commonly used as the above-mentioned scales, we include it in this review due to its different construct. The questionnaire is composed of 54 items to which the subjects respond in a dichotomic manner (yes or no). These are organized into three subscales: (i) impulsiveness, including items as “Do you often buy things on impulse?” or “Before making up your mind, do you consider all the advantages and disadvantages?” (inverted); (ii) venturesomeness, including “Would you enjoy water skiing?” or “Do you find it hard to understand people who risk their necks climbing mountains?” (inverted); and (iii) empathy, including “Would you feel sorry for a lonely stranger?” or “Do you like watching people open presents?” (Eysenck et al., 1985). No meta-analyses or systematic reviews have assessed this scale’s results in impulsivity-related disorders, although data suggest an association with obsessive-compulsive (Smári et al., 2008) and borderline personality (Mortensen et al., 2010) disorders, MDMA consumption (Morgan, 1998), and binge eating (Cuzzocrea et al., 2015).

UPPS-P Impulsive Behavior Scale

More recently, the UPPS-P Impulsive Behavior Scale was developed, having the particularity of assessing impulsive behavior that occurs under extreme positive emotions, i.e., positive urgency (Cyders et al., 2007). It is composed of 59 items (a shorter version of 20 items has also been developed, Cyders et al., 2014), to which answers range from 1 (agree strongly) to 4 (disagree strongly). Five dimensions are assessed: (i) negative urgency, including “When I feel rejected, I will often say things that I later regret” (inverted); (ii) positive urgency, as in “When I am in great mood, I tend to get into situations that could cause me problems” (inverted); (iii) sensation seeking, including “I quite enjoy taking risks” (inverted); (iv) lack of premeditation, such as “I like to stop and think things over before I do them”; and (v) lack of perseverance, including “Unfinished tasks really bother me” (International Society for Research on Impulsivity, 2020). Meta-analyses have been able to find associations between these subscales and impulsivity-related disorders, including alcohol (Berg et al., 2015) and substance (Berg et al., 2015; VanderVeen et al., 2016) abuse, nicotine dependence (Kale et al., 2018; Bos et al., 2019), borderline personality traits, suicidality, aggression, and eating disorders (Berg et al., 2015).

Discussion

Impulsivity is a multifaceted construct influenced by both biological (e.g., genetic, age, and sex) and environmental (familial, cultural, etc.) factors. For instance, impulsivity has been reported as sex dependent in both humans (Cross et al., 2011; Weafer and de Wit, 2014) and rodents (Weafer and de Wit, 2014; Soares et al., 2018), but the direction and strength of such effect depend on the assessed dimension. Additional variability may arise due to the mediation of other factors, as hormonal cycle in women (Diekhof, 2015) and female rats (Swalve et al., 2016), age (Soares et al., 2018, rats; Rosenbaum and Hartley, 2019, humans), genetics (Bezdjian et al., 2011, humans; Soares et al., 2018, rats; Jupp et al., 2020, rats), or environment (Bezdjian et al., 2011, humans; Kirkpatrick et al., 2013, rats). These influences, as well as their human–rodent parallels, are of high importance for the development of translational research. One additional relevant factor is attention, which is required for all the behavioral tasks presented above. It is widely acknowledged that attention to new environmental cues is critical for inhibiting the current flow of decisions and actions and for shifting toward a more appropriate flow (Bari and Robbins, 2013). Nevertheless, some of the available behavioral tasks for the assessment of impulsivity are frequently criticized by their excessive focus on attentional demand (e.g., 5-csrtt).

The here-described methods cover the spectrum of impulsivity dimensions and have been shown to reliably detect alterations in impulsivity in clinical contexts in which it is expected to be altered, including drugs (Jentsch et al., 2014) or alcohol (Herman and Duka, 2019) abuse, smoking (Mitchell, 2004), reactive aggression (Blair, 2016; Brennan and Baskin-Sommers, 2019) (often in the context of schizophrenia, Hoptman, 2015), self-harm (McHugh et al., 2019), binge eating disorder (Giel et al., 2017), or ADHD (O’Neill et al., 2017)—see text for details on meta-analyses and systematic reviews. Rodent task validation, on the other hand, is partially assumed by the similarities to their human counterparts, as most of these contexts can only be partially replicated in rodents. However, all the here-described rodent tasks have shown alterations of impulsivity associated with substances of abuse (e.g., 5-csrtt, Broos et al., 2017; 5C-CPT, Irimia et al., 2014; SST, Beckwith and Czachowski, 2016; DD, Harvey-Lewis et al., 2014; and VDS, Leite-Almeida et al., 2013).

Two main types of impulsivity assessments are here presented: behavioral and self-reported measures. Even though impulsivity is expected to vary with age, self-reported measures assess impulsivity as a trait—i.e., the scores are expected to remain relatively stable over time. They present several advantages, including the ability to assess different dimensions of impulsivity in the same questionnaire, which is applied in 5–15 min without the need for any equipment. They demonstrate satisfying psychometric characteristics, including good internal consistency and high test–retest reliability, and provide a context for the evaluated behaviors (e.g., “When I am in great mood, I tend to get into situations that could cause me problems” in UPPS-P). However, these behaviors are evaluated according to the subject’s perception and are thus not necessarily objective and of limited application if self-perception is altered. Importantly, self-reported measures are not transposable to animals. On the other hand, behavioral assessments provide laboratory-controlled, objective measurements of a given impulsivity dimension. These measurements can be altered according to internal states (e.g., arousal and stress) and can thus be considered more akin to state impulsivity, being therefore more suitable for association with transient states (e.g., drug effects). They can often be paralleled between humans and rodents, allowing a translational evaluation of cellular, molecular, and network players. However, they fail to provide more complex contexts to the assessment. A concern related to these laboratorial assessments pertains to a limited external validity, particularly in animal models. On the other hand, the use of imagetic and simulated settings (e.g., the use of virtual reality, Pollak et al., 2009; Henry et al., 2012) is a recurrent strategy that diminishes this limitation on the behavioral assessment of impulsivity in human subjects. Of note is that the concordance between self-report and behavioral measures seems to be weak, suggesting that they are assessing different constructs (see for example, Cyders and Coskunpinar, 2012; Hasegawa et al., 2019).

One additional source of variability between studies is the multiple adaptations of established tasks for both humans and rodents. These are often performed in order to answer a specific experimental question (e.g., impulsivity when aiming to attain drugs instead of natural rewards) or to adapt the task to a specific population (e.g., using images instead of letters when studying a cohort of children or manipulating the number of Go and noGo trials in a population with altered attention). Although often necessary, these changes from the originally designed task create difficulties in comparability and may raise questions regarding validity, as validation of small changes is rarely performed. Even though several systematic reviews of the literature focusing on impulsivity exist—see for example (Smith et al., 2014) for Go–noGo and SST—they typically do not account for task variations, which may provide relevant insights regarding the most adequate manipulations to assess impulsivity under specific conditions/goals. Also, behavioral measures have been adapted from humans to rodents and vice versa. Such implies alteration in the structure of the task, including the applied stimuli (e.g., letters for humans and sounds for animals) or the rewards (e.g., hypothetical money for humans and physical sugar pellets for rodents). These adaptations are necessary, although interpretations of a parallel between human and rodent behaviors require careful consideration. Indeed, one can argue that the behavioral tasks here presented for rodents try to mimic human impulsivity in species who would not naturally present these behaviors. Reactive aggression, for example, is an ethological behavior in both humans and rodents, and being associated with impulsivity (Blair, 2016; Brennan and Baskin-Sommers, 2019), it could be used to establish this parallel.

There are also additional limitations that are different in rodents and humans. In rodents, whenever the reward is palatable food, caloric restriction is necessary, creating difficulties in the interpretation of impulsivity vs. satiety. Also, in rodents (and to a smaller degree in humans), there is a very high motor demand in some of the tasks, as 5-csrtt, where fast, premature responses are considered impulsive, hindering interpretation or requiring adaptation of the task for aged or injured animals. On the other hand, animal experiments are typically performed by a comparison of different groups (e.g., cortical lesion vs. controls), who should all be in the same satiety conditions and whose motor performance can be assessed and controlled for. In human subjects, however, a range of additional factors can influence impulsivity (see above), some of which, as cultural or familial environment, can be difficult to control.

Conclusion

Impulsivity can be considered as an umbrella term in which multiple processes are included. Importantly, not all forms of impulsivity can be objectively measured through laboratory-controlled tasks, whose complementarity with self-reported measures is evidenced by the poor correlation between them. Such self-reported measures, as well as some behavioral ones (e.g., assessment of lack of planning), imply complex reasoning that, even if potentially adaptable to rodent behavioral tasks, would be hard to interpret. Indeed, even in simpler tasks, such as the DD, there is a necessary adaptation of times and rewards, which brings out questions regarding the validity of such translation. These difficulties are added to the necessary consideration of additional factors whose disentanglement from the impulsive behavior is not clear, including attention, memory, and motivation, as well as the context in which the impulsive behavior occurs (e.g., urgency in positive or negative situations). There is, however, an evident effort to establish a parallel between tasks, creating multiple translations and back-translations and thus allowing the assessment of the core of the behavior in a translational manner.

Author Contributions

ME performed the literature research. ME and HL-A designed the manuscript. ME, PM, and HL-A wrote the first draft. ME, PM, NS, and HL-A discussed, provided input, and approved the final manuscript. All authors contributed to the article and approved the submitted version.

Funding

This work was funded by the Fundação BIAL (project 331_2018), 2CA-Braga grants, and national funds, through the Foundation for Science and Technology (FCT) (projects UIDB/50026/2020 and UIDP/50026/2020).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

Alderson, R. M., Rapport, M. D., and Kofler, M. J. (2007). Attention-deficit/hyperactivity disorder and behavioral inhibition: a meta-analytic review of the stop-signal paradigm. J. Abnorm. Child Psychol. 35, 745–758. doi: 10.1007/s10802-007-9131-6

PubMed Abstract | CrossRef Full Text | Google Scholar

American Psychiatry Association, (2013). Diagnostic and Statistical Manual of Mental Disorders: DSM-5, Fifth Edn. Arlington, VA: American Psychiatric Association.

Google Scholar

Amlung, M., Petker, T., Jackson, J., Balodis, I., and MacKillop, J. (2016). Steep discounting of delayed monetary and food rewards in obesity: a meta-analysis. Psychol. Med. 46, 2423–2434. doi: 10.1017/S0033291716000866

PubMed Abstract | CrossRef Full Text | Google Scholar

Amlung, M., Vedelago, L., Acker, J., Balodis, I., and MacKillop, J. (2017). Steep delay discounting and addictive behavior: a meta-analysis of continuous associations. Addiction 112, 51–62. doi: 10.1111/add.13535

PubMed Abstract | CrossRef Full Text | Google Scholar

Anker, J. J., Zlebnik, N. E., Gliddon, L. A., and Carroll, M. E. (2009). Performance under a Go/No-go task in rats selected for high and low impulsivity with a delay-discounting procedure. Behav. Pharmacol. 20, 406–414. doi: 10.1097/FBP.0b013e3283305ea2

PubMed Abstract | CrossRef Full Text | Google Scholar

Ballard, J. C. (1996). Computerized assessment of sustained attention: a review of factors affecting vigilance performance. J. Clin. Exp. Neuropsychol. 18, 843–863. doi: 10.1080/01688639608408307

PubMed Abstract | CrossRef Full Text | Google Scholar

Banca, P., Lange, I., Worbe, Y., Howell, N. A., Irvine, M., Harrison, N. A., et al. (2016). Reflection impulsivity in binge drinking: behavioural and volumetric correlates. Addict. Biol. 21, 504–515. doi: 10.1111/adb.12227

PubMed Abstract | CrossRef Full Text | Google Scholar

Bari, A., Dalley, J. W., and Robbins, T. W. (2008). The application of the 5-choice serial reaction time task for the assessment of visual attentional processes and impulse control in rats. Nat. Protoc. 3, 759–767. doi: 10.1038/nprot.2008.41

PubMed Abstract | CrossRef Full Text | Google Scholar

Bari, A., and Robbins, T. W. (2013). Inhibition and impulsivity: behavioral and neural basis of response control. Prog. Neurobiol. 108, 44–79. doi: 10.1016/j.pneurobio.2013.06.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Baumann, M. R., Oviatt, D., Garza, R. T., Gonzalez-Blanks, A. G., Lopez, S. G., Alexander-Delpech, P., et al. (2014). Variation in BAS-BIS profiles across categories of cigarette use. Addict. Behav. 39, 1477–1483. doi: 10.1016/j.addbeh.2014.05.028

PubMed Abstract | CrossRef Full Text | Google Scholar

Beckwith, S. W., and Czachowski, C. L. (2016). Alcohol-preferring P rats exhibit elevated motor impulsivity concomitant with operant responding and self-administration of alcohol. Alcohol Clin. Exp. Res. 40, 1100–1110. doi: 10.1111/acer.13044

PubMed Abstract | CrossRef Full Text | Google Scholar

Berg, J. M., Latzman, R. D., Bliwise, N. G., and Lilienfeld, S. O. (2015). Parsing the heterogeneity of impulsivity: a meta-analytic review of the behavioral implications of the UPPS for psychopathology. Psychol. Assess. 27, 1129–1146. doi: 10.1037/pas0000111

PubMed Abstract | CrossRef Full Text | Google Scholar

Bezdjian, S., Baker, L. A., and Tuvblad, C. (2011). Genetic and environmental influences on impulsivity: a meta-analysis of twin, family and adoption studies. Clin. Psychol. Rev. 31, 1209–1223. doi: 10.1016/j.cpr.2011.07.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Bhakta, S. G., and Young, J. W. (2017). The 5 choice continuous performance test (5C-CPT): a novel tool to assess cognitive control across species. J. Neurosci. Methods 292, 53–60. doi: 10.1016/j.jneumeth.2017.07.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Blair, R. J. (2016). The neurobiology of impulsive aggression. J. Child Adolesc. Psychopharmacol. 26, 4–9. doi: 10.1089/cap.2015.0088

PubMed Abstract | CrossRef Full Text | Google Scholar

Bos, J., Hayden, M. J., Lum, J. A. G., and Staiger, P. K. (2019). UPPS-P impulsive personality traits and adolescent cigarette smoking: a meta-analysis. Drug Alcohol Depend. 197, 335–343. doi: 10.1016/j.drugalcdep.2019.01.018

PubMed Abstract | CrossRef Full Text | Google Scholar

Brennan, G. M., and Baskin-Sommers, A. R. (2019). Physical aggression is associated with heightened social reflection impulsivity. J. Abnorm. Psychol. 128, 404–414. doi: 10.1037/abn0000448

PubMed Abstract | CrossRef Full Text | Google Scholar

Broos, N., van Mourik, Y., Schetters, D., De Vries, T. J., and Pattij, T. (2017). Dissociable effects of cocaine and yohimbine on impulsive action and relapse to cocaine seeking. Psychopharmacology (Berl.) 234, 3343–3351. doi: 10.1007/s00213-017-4711-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Brown, M. R., Benoit, J. R., Juhas, M., Lebel, R. M., MacKay, M., Dametto, E., et al. (2015). Neural correlates of high-risk behavior tendencies and impulsivity in an emotional Go/NoGo fMRI task. Front. Syst. Neurosci. 9:24. doi: 10.3389/fnsys.2015.00024

PubMed Abstract | CrossRef Full Text | Google Scholar

Bruinsma, B., Terra, H., de Kloet, S. F., Luchicchi, A., Timmerman, A. J., Remmelink, E., et al. (2019). An automated home-cage-based 5-choice serial reaction time task for rapid assessment of attention and impulsivity in rats. Psychopharmacology (Berl.) 236, 2015–2026. doi: 10.1007/s00213-019-05189-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Caballero-Puntiverio, M., Lerdrup, L. S., Grupe, M., Larsen, C. W., Dietz, A. G., and Andreasen, J. T. (2019). Effect of ADHD medication in male C57BL/6J mice performing the rodent continuous performance test. Psychopharmacology (Berl.) 236, 1839–1851. doi: 10.1007/s00213-019-5167-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Carli, M., Robbins, T. W., Evenden, J. L., and Everitt, B. J. (1983). Effects of lesions to ascending noradrenergic neurones on performance of a 5-choice serial reaction task in rats; implications for theories of dorsal noradrenergic bundle function based on selective attention and arousal. Behav. Brain Res. 9, 361–380. doi: 10.1016/0166-4328(83)90138-9

CrossRef Full Text | Google Scholar

Carvalho, M. M., Campos, F. L., Marques, M., Soares-Cunha, C., Kokras, N., Dalla, C., et al. (2017). Effect of levodopa on reward and impulsivity in a rat model of Parkinson’s Disease. Front. Behav. Neurosci. 11:145. doi: 10.3389/fnbeh.2017.00145

PubMed Abstract | CrossRef Full Text | Google Scholar

Carver, C. S., and White, T. L. (1994). Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: the BIS/BAS Scales. J. Pers. Soc. Psychol. 67, 319–333. doi: 10.1037/0022-3514.67.2.319

CrossRef Full Text | Google Scholar

Chowdhury, N. S., Livesey, E. J., Blaszczynski, A., and Harris, J. A. (2017). Pathological gambling and motor impulsivity: a systematic review with meta-analysis. J. Gambl. Stud. 33, 1213–1239. doi: 10.1007/s10899-017-9683-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Cope, Z. A., Halberstadt, A. L., van Enkhuizen, J., Flynn, A. D., Breier, M., Swerdlow, N. R., et al. (2016). Premature responses in the five-choice serial reaction time task reflect rodents’ temporal strategies: evidence from no-light and pharmacological challenges. Psychopharmacology (Berl.) 233, 3513–3525. doi: 10.1007/s00213-016-4389-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Corkum, P. V., and Siegel, L. S. (1993). Is the continuous performance task a valuable research tool for use with children with attention-deficit-hyperactivity disorder? J. Child Psychol. Psychiatry 34, 1217–1239. doi: 10.1111/j.1469-7610.1993.tb01784.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Cortese, S., Moreira-Maia, C. R., St Fleur, D., Morcillo-Peńalver, C., Rohde, L. A., and Faraone, S. V. (2016). Association between ADHD and obesity: a systematic review and meta-analysis. Am. J. Psychiatry 173, 34–43. doi: 10.1176/appi.ajp.2015.15020266

PubMed Abstract | CrossRef Full Text | Google Scholar

Criaud, M., and Boulinguez, P. (2013). Have we been asking the right questions when assessing response inhibition in go/no-go tasks with fMRI? A meta-analysis and critical review. Neurosci. Biobehav. Rev. 37, 11–23. doi: 10.1016/j.neubiorev.2012.11.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Cross, C. P., Copping, L. T., and Campbell, A. (2011). Sex differences in impulsivity: a meta-analysis. Psychol. Bull. 137, 97–130. doi: 10.1037/a0021591

PubMed Abstract | CrossRef Full Text | Google Scholar

Cunha, A. M., Esteves, M., das Neves, S. P., Borges, S., Guimaraes, M. R., Sousa, N., et al. (2017). Pawedness Trait Test (PaTRaT)-A new paradigm to evaluate paw preference and dexterity in rats. Front. Behav. Neurosci. 11:192. doi: 10.3389/fnbeh.2017.00192

PubMed Abstract | CrossRef Full Text | Google Scholar

Cunha, A. M., Esteves, M., Pereira-Mendes, J., Guimaraes, M. R., Almeida, A., and Leite-Almeida, H. (2020a). High trait impulsivity potentiates the effects of chronic pain on impulsive behavior. Neurobiol. Pain 7:100042. doi: 10.1016/j.ynpai.2019.100042

PubMed Abstract | CrossRef Full Text | Google Scholar

Cunha, A. M., Teixeira, F. G., Guimaraes, M. R., Esteves, M., Pereira-Mendes, J., Soares, A. R., et al. (2020b). Unilateral accumbal dopamine depletion affects decision-making in a side-specific manner. Exp. Neurol. 327:113221. doi: 10.1016/j.expneurol.2020.113221

PubMed Abstract | CrossRef Full Text | Google Scholar

Cuzzocrea, F., Costa, S., Larcan, R., and Toffle, M. E. (2015). Differences between adolescents exhibiting moderate binging and non-binging eating behaviors. Springerplus 4:593. doi: 10.1186/s40064-015-1372-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Cyders, M. A., and Coskunpinar, A. (2012). The relationship between self-report and lab task conceptualizations of impulsivity. J. Res. Pers. 46, 121–124. doi: 10.1016/j.jrp.2011.11.005

CrossRef Full Text | Google Scholar

Cyders, M. A., Littlefield, A. K., Coffey, S., and Karyadi, K. A. (2014). Examination of a short english version of the UPPS-P impulsive behavior scale. Addict. Behav. 39, 1372–1376. doi: 10.1016/j.addbeh.2014.02.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Cyders, M. A., Smith, G. T., Spillane, N. S., Fischer, S., Annus, A. M., and Peterson, C. (2007). Integration of impulsivity and positive mood to predict risky behavior: development and validation of a measure of positive urgency. Psychol. Assess. 19:107.

Google Scholar

da Matta, A., Gonçalves, F. L., and Bizarro, L. (2012). Delay discounting: concepts and measures. Psychol. Neurosci. 5, 135–146. doi: 10.3922/j.psns.2012.2.03

CrossRef Full Text | Google Scholar

Dalley, J. W., and Robbins, T. W. (2017). Fractionating impulsivity: neuropsychiatric implications. Nat. Rev. Neurosci. 18, 158–171. doi: 10.1038/nrn.2017.8

PubMed Abstract | CrossRef Full Text | Google Scholar

Dambacher, F., Sack, A. T., Lobbestael, J., Arntz, A., Brugman, S., and Schuhmann, T. (2015). Out of control: evidence for anterior insula involvement in motor impulsivity and reactive aggression. Soc. Cogn. Affect. Neurosci. 10, 508–516. doi: 10.1093/scan/nsu077

PubMed Abstract | CrossRef Full Text | Google Scholar

Diekhof, E. K. (2015). Be quick about it. Endogenous estradiol level, menstrual cycle phase and trait impulsiveness predict impulsive choice in the context of reward acquisition. Horm. Behav. 74, 186–193. doi: 10.1016/j.yhbeh.2015.06.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Dudley, R., Taylor, P., Wickham, S., and Hutton, P. (2016). Psychosis, delusions and the “Jumping to Conclusions” reasoning bias: a systematic review and meta-analysis. Schizophr. Bull. 42, 652–665. doi: 10.1093/schbul/sbv150

PubMed Abstract | CrossRef Full Text | Google Scholar

Eagle, D. M., Bari, A., and Robbins, T. W. (2008). The neuropsychopharmacology of action inhibition: cross-species translation of the stop-signal and go/no-go tasks. Psychopharmacology (Berl.) 199, 439–456. doi: 10.1007/s00213-008-1127-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Eysenck, S. B. G., Pearson, P. R., Easting, G., and Allsopp, J. F. (1985). Age norms for impulsiveness, venturesomeness and empathy in adults. Pers. Individ. Differ. 6, 613–619. doi: 10.1016/0191-8869(85)90011-x

CrossRef Full Text | Google Scholar

Feja, M., Hayn, L., and Koch, M. (2014). Nucleus accumbens core and shell inactivation differentially affects impulsive behaviours in rats. Prog. Neuropsychopharmacol. Biol. Psychiatry 54, 31–42. doi: 10.1016/j.pnpbp.2014.04.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Fillmore, M. T., and Weafer, J. (2013). “Behavioral inhibition and addiction,” in The Wiley-Blackwell Handbook of Addiction Psychopharmacology, eds J. MacKillop and H. de Wit, (Hoboken, NJ: Wiley Blackwell).

Google Scholar

Fineberg, N. A., Potenza, M. N., Chamberlain, S. R., Berlin, H. A., Menzies, L., Bechara, A., et al. (2010). Probing compulsive and impulsive behaviors, from animal models to endophenotypes: a narrative review. Neuropsychopharmacology 35, 591–604. doi: 10.1038/npp.2009.185

PubMed Abstract | CrossRef Full Text | Google Scholar

Garavan, H., Ross, T. J., and Stein, E. A. (1999). Right hemispheric dominance of inhibitory control: an event-related functional MRI study. Proc. Natl. Acad. Sci. U. S. A. 96, 8301–8306. doi: 10.1073/pnas.96.14.8301

PubMed Abstract | CrossRef Full Text | Google Scholar

Giel, K. E., Teufel, M., Junne, F., Zipfel, S., and Schag, K. (2017). Food-related impulsivity in obesity and binge eating disorder-a systematic update of the evidence. Nutrients 9:1170. doi: 10.3390/nu9111170

PubMed Abstract | CrossRef Full Text | Google Scholar

Greydanus, D. E., and Shek, D. (2009). Deliberate self-harm and suicide in adolescents. Keio. J. Med. 58, 144–151. doi: 10.2302/kjm.58.144

PubMed Abstract | CrossRef Full Text | Google Scholar

Han, Z., Chen, W., Chen, X., Zhang, K., Tong, C., Zhang, X., et al. (2019). Awake and behaving mouse fMRI during Go/No-Go task. Neuroimage 188, 733–742. doi: 10.1016/j.neuroimage.2019.01.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Harvey-Lewis, C., Perdrizet, J., and Franklin, K. B. (2014). Delay discounting of oral morphine and sweetened juice rewards in dependent and non-dependent rats. Psychopharmacology (Berl.) 231, 2633–2645. doi: 10.1007/s00213-014-3438-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Hasegawa, A., Somatori, K., Nishimura, H., Hattori, Y., and Kunisato, Y. (2019). Associations between self-reported impulsivity and a latent variable of impulsive action constructed from three laboratory tasks. J. Exp. Psychopathol. 10:2043808719861894. doi: 10.1177/2043808719861894

CrossRef Full Text | Google Scholar

Hege, M. A., Stingl, K. T., Kullmann, S., Schag, K., Giel, K. E., Zipfel, S., et al. (2015). Attentional impulsivity in binge eating disorder modulates response inhibition performance and frontal brain networks. Int. J. Obes. (Lond.) 39, 353–360. doi: 10.1038/ijo.2014.99

PubMed Abstract | CrossRef Full Text | Google Scholar

Henry, M., Joyal, C. C., and Nolin, P. (2012). Development and initial assessment of a new paradigm for assessing cognitive and motor inhibition: the bimodal virtual-reality Stroop. J. Neurosci. Methods 210, 125–131. doi: 10.1016/j.jneumeth.2012.07.025

PubMed Abstract | CrossRef Full Text | Google Scholar

Herman, A. M., and Duka, T. (2019). Facets of impulsivity and alcohol use: what role do emotions play? Neurosci. Biobehav. Rev. 106, 202–216. doi: 10.1016/j.neubiorev.2018.08.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Higgins, G. A., and Silenieks, L. B. (2017). Rodent test of attention and impulsivity: the 5-choice serial reaction time task. Curr. Protoc. Pharmacol. 78, 5.49.1–5.49.34. doi: 10.1002/cpph.27

PubMed Abstract | CrossRef Full Text | Google Scholar

Hook, R. W., Grant, J. E., Ioannidis, K., Tiego, J., Yücel, M., Wilkinson, P., et al. (2021). Trans-diagnostic measurement of impulsivity and compulsivity: a review of self-report tools. Neurosci. Biobehav. Rev. 120, 455–469. doi: 10.1016/j.neubiorev.2020.10.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Hoptman, M. J. (2015). Impulsivity and aggression in schizophrenia: a neural circuitry perspective with implications for treatment. CNS Spectr. 20, 280–286. doi: 10.1017/S1092852915000206

PubMed Abstract | CrossRef Full Text | Google Scholar

Horn, N. R., Dolan, M., Elliott, R., Deakin, J. F., and Woodruff, P. W. (2003). Response inhibition and impulsivity: an fMRI study. Neuropsychologia 41, 1959–1966. doi: 10.1016/s0028-3932(03)00077-0

CrossRef Full Text | Google Scholar

Huang-Pollock, C. L., Karalunas, S. L., Tam, H., and Moore, A. N. (2012). Evaluating vigilance deficits in ADHD: a meta-analysis of CPT performance. J. Abnorm. Psychol. 121, 360–371. doi: 10.1037/a0027205

PubMed Abstract | CrossRef Full Text | Google Scholar

International Society for Research on Impulsivity, (2020). Available online at: http://www.impulsivity.org/ (accessed June 4, 2020).

Google Scholar

Irimia, C., Tuong, R. N., Quach, T., and Parsons, L. H. (2014). Impaired response inhibition in the rat 5 choice continuous performance task during protracted abstinence from chronic alcohol consumption. PLoS One 9:e109948. doi: 10.1371/journal.pone.0109948

PubMed Abstract | CrossRef Full Text | Google Scholar

Jentsch, J. D., Ashenhurst, J. R., Cervantes, M. C., Groman, S. M., James, A. S., and Pennington, Z. T. (2014). Dissecting impulsivity and its relationships to drug addictions. Ann. N. Y. Acad. Sci. 1327, 1–26. doi: 10.1111/nyas.12388

PubMed Abstract | CrossRef Full Text | Google Scholar

Jiménez-Urbieta, H., Gago, B., Quiroga-Varela, A., Rodríguez-Chinchilla, T., Merino-Galán, L., Delgado-Alvarado, M., et al. (2020). Motor impulsivity and delay intolerance are elicited in a dose-dependent manner with a dopaminergic agonist in parkinsonian rats. Psychopharmacology 237, 2419–2431. doi: 10.1007/s00213-020-05544-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Jones, S., Paul, E. S., Dayan, P., Robinson, E. S. J., and Mendl, M. (2017). Pavlovian influences on learning differ between rats and mice in a counter-balanced Go/NoGo judgement bias task. Behav. Brain Res. 331, 214–224. doi: 10.1016/j.bbr.2017.05.044

PubMed Abstract | CrossRef Full Text | Google Scholar

Jupp, B., Pitzoi, S., Petretto, E., Mar, A. C., Oliver, Y. P., Jordan, E. R., et al. (2020). Impulsivity is a heritable trait in rodents and associated with a novel quantitative trait locus on chromosome 1. Sci. Rep. 10:6684. doi: 10.1038/s41598-020-63646-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Kaladjian, A., Jeanningros, R., Azorin, J. M., Anton, J. L., and Mazzola-Pomietto, P. (2011). Impulsivity and neural correlates of response inhibition in schizophrenia. Psychol. Med. 41, 291–299. doi: 10.1017/S0033291710000796

PubMed Abstract | CrossRef Full Text | Google Scholar

Kale, D., Stautz, K., and Cooper, A. (2018). Impulsivity related personality traits and cigarette smoking in adults: a meta-analysis using the UPPS-P model of impulsivity and reward sensitivity. Drug Alcohol Depend. 185, 149–167. doi: 10.1016/j.drugalcdep.2018.01.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Kamigaki, T., and Dan, Y. (2017). Delay activity of specific prefrontal interneuron subtypes modulates memory-guided behavior. Nat. Neurosci. 20, 854–863. doi: 10.1038/nn.4554

PubMed Abstract | CrossRef Full Text | Google Scholar

Kim, C. H., Hvoslef-Eide, M., Nilsson, S. R. O., Johnson, M. R., Herbert, B. R., Robbins, T. W., et al. (2015). The continuous performance test (rCPT) for mice: a novel operant touchscreen test of attentional function. Psychopharmacology 232, 3947–3966. doi: 10.1007/s00213-015-4081-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Kirkpatrick, K., Marshall, A. T., Clarke, J., and Cain, M. E. (2013). Environmental rearing effects on impulsivity and reward sensitivity. Behav. Neurosci. 127, 712–724. doi: 10.1037/a0034124

PubMed Abstract | CrossRef Full Text | Google Scholar

Leite-Almeida, H., Cerqueira, J. J., Wei, H., Ribeiro-Costa, N., Anjos-Martins, H., Sousa, N., et al. (2012). Differential effects of left/right neuropathy on rats’ anxiety and cognitive behavior. Pain 153, 2218–2225. doi: 10.1016/j.pain.2012.07.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Leite-Almeida, H., Melo, A., Pego, J. M., Bernardo, S., Milhazes, N., Borges, F., et al. (2013). Variable delay-to-signal: a fast paradigm for assessment of aspects of impulsivity in rats. Front. Behav. Neurosci. 7:154. doi: 10.3389/fnbeh.2013.00154

PubMed Abstract | CrossRef Full Text | Google Scholar

Lipszyc, J., and Schachar, R. (2010). Inhibitory control and psychopathology: a meta-analysis of studies using the stop signal task. J. Int. Neuropsychol. Soc. 16, 1064–1076. doi: 10.1017/S1355617710000895

PubMed Abstract | CrossRef Full Text | Google Scholar

Losier, B. J., McGrath, P. J., and Klein, R. M. (1996). Error patterns on the continuous performance test in non-medicated and medicated samples of children with and without ADHD: a meta-analytic review. J. Child Psychol. Psychiatry 37, 971–987. doi: 10.1111/j.1469-7610.1996.tb01494.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Masuda, A., Sano, C., Zhang, Q., Goto, H., McHugh, T. J., Fujisawa, S., et al. (2020). The hippocampus encodes delay and value information during delay-discounting decision making. Elife 9:e52466. doi: 10.7554/eLife.52466

PubMed Abstract | CrossRef Full Text | Google Scholar

Maxwell, A. L., Gardiner, E., and Loxton, N. J. (2020). Investigating the relationship between reward sensitivity, impulsivity, and food addiction: a systematic review. Eur. Eat. Disord. Rev. 28, 368–384. doi: 10.1002/erv.2732

PubMed Abstract | CrossRef Full Text | Google Scholar

McHugh, C. M., Chun Lee, R. S., Hermens, D. F., Corderoy, A., Large, M., and Hickie, I. B. (2019). Impulsivity in the self-harm and suicidal behavior of young people: a systematic review and meta-analysis. J. Psychiatr. Res. 116, 51–60. doi: 10.1016/j.jpsychires.2019.05.012

PubMed Abstract | CrossRef Full Text | Google Scholar

McLean, B. F., Mattiske, J. K., and Balzan, R. P. (2018). Towards a reliable repeated-measures beads task for assessing the jumping to conclusions bias. Psychiatry Res. 265, 200–207. doi: 10.1016/j.psychres.2018.04.043

PubMed Abstract | CrossRef Full Text | Google Scholar

Melo, A., Leite-Almeida, H., Ferreira, C., Sousa, N., and Pego, J. M. (2016). Exposure to ketamine anesthesia affects rat impulsive behavior. Front. Behav. Neurosci. 10:226. doi: 10.3389/fnbeh.2016.00226

PubMed Abstract | CrossRef Full Text | Google Scholar

Mitchell, S. H. (2004). Measuring impulsivity and modeling its association with cigarette smoking. Behav. Cogn. Neurosci. Rev. 3, 261–275. doi: 10.1177/1534582305276838

PubMed Abstract | CrossRef Full Text | Google Scholar

Morgan, M. J. (1998). Recreational use of “ecstasy” (MDMA) is associated with elevated impulsivity. Neuropsychopharmacology 19, 252–264. doi: 10.1016/s0893-133x(98)00012-8

CrossRef Full Text | Google Scholar

Mortensen, J. A., Rasmussen, L. A., and Håberg, A. (2010). Trait impulsivity in female patients with borderline personality disorder and matched controls. Acta Neuropsychiatr. 22, 139–149. doi: 10.1111/j.1601-5215.2010.00468.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Moschak, T. M., and Mitchell, S. H. (2012). Acute ethanol administration and reinforcer magnitude reduction both reduce responding and increase response latency in a go/no-go task. Alcohol Clin. Exp. Res. 36, 1803–1810. doi: 10.1111/j.1530-0277.2012.01789.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Neufang, S., Akhrif, A., Herrmann, C. G., Drepper, C., Homola, G. A., Nowak, J., et al. (2016). Serotonergic modulation of ‘waiting impulsivity’ is mediated by the impulsivity phenotype in humans. Transl. Psychiatry 6:e940. doi: 10.1038/tp.2016.210

PubMed Abstract | CrossRef Full Text | Google Scholar

Nigg, J. T. (2017). Annual research review: on the relations among self-regulation, self-control, executive functioning, effortful control, cognitive control, impulsivity, risk-taking, and inhibition for developmental psychopathology. J. Child Psychol. Psychiatry 58, 361–383. doi: 10.1111/jcpp.12675

PubMed Abstract | CrossRef Full Text | Google Scholar

O’Neill, S., Rajendran, K., Mahbubani, S. M., and Halperin, J. M. (2017). Preschool predictors of ADHD symptoms and impairment during childhood and adolescence. Curr. Psychiatry Rep. 19:95. doi: 10.1007/s11920-017-0853-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Patton, J. H., Stanford, M. S., and Barratt, E. S. (1995). Factor structure of the Barratt impulsiveness scale. J. Clin. Psychol. 51, 768–774. doi: 10.1002/1097-4679(199511)51:6<768::aid-jclp2270510607<3.0.co;2-1

CrossRef Full Text | Google Scholar

Pietras, C. J., Cherek, D. R., Lane, S. D., Tcheremissine, O. V., and Steinberg, J. L. (2003). Effects of methylphenidate on impulsive choice in adult humans. Psychopharmacology (Berl.) 170, 390–398. doi: 10.1007/s00213-003-1547-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Pollak, Y., Weiss, P. L., Rizzo, A. A., Weizer, M., Shriki, L., Shalev, R. S., et al. (2009). The utility of a continuous performance test embedded in virtual reality in measuring ADHD-related deficits. J. Dev. Behav. Pediatr. 30, 2–6. doi: 10.1097/DBP.0b013e3181969b22

PubMed Abstract | CrossRef Full Text | Google Scholar

Riccio, C. A., Reynolds, C. R., Lowe, P., and Moore, J. J. (2002). The continuous performance test: a window on the neural substrates for attention? Arch. Clin. Neuropsychol. 17, 235–272. doi: 10.1016/S0887-6177(01)00111-1

CrossRef Full Text | Google Scholar

Robbins, T. W. (2002). The 5-choice serial reaction time task: behavioural pharmacology and functional neurochemistry. Psychopharmacology (Berl.) 163, 362–380. doi: 10.1007/s00213-002-1154-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Robles, E., and Vargas, P. A. (2008). Parameters of delay discounting assessment: number of trials, effort, and sequential effects. Behav. Process. 78, 285–290. doi: 10.1016/j.beproc.2007.10.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Roebuck, H., Freigang, C., and Barry, J. G. (2016). Continuous performance tasks: not just about sustaining attention. J. Speech Lang. Hear. Res. 59, 501–510. doi: 10.1044/2015_jslhr-l-15-0068

CrossRef Full Text | Google Scholar

Rosenbaum, G. M., and Hartley, C. A. (2019). Developmental perspectives on risky and impulsive choice. Philos. Trans. R. Soc. Lond. B Biol. Sci. 374:20180133. doi: 10.1098/rstb.2018.0133

PubMed Abstract | CrossRef Full Text | Google Scholar

Rosvold, H. E., Mirsky, A. F., Sarason, I., Bransome, E. D. Jr., and Beck, L. H. (1956). A continuous performance test of brain damage. J. Consult. Psychol. 20, 343–350. doi: 10.1037/h0043220

PubMed Abstract | CrossRef Full Text | Google Scholar

Saddichha, S., and Schuetz, C. (2014). Is impulsivity in remitted bipolar disorder a stable trait? A meta-analytic review. Compr. Psychiatry 55, 1479–1484. doi: 10.1016/j.comppsych.2014.05.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Schachar, R., Logan, G. D., Robaey, P., Chen, S., Ickowicz, A., and Barr, C. (2007). Restraint and cancellation: multiple inhibition deficits in attention deficit hyperactivity disorder. J. Abnorm. Child Psychol. 35, 229–238. doi: 10.1007/s10802-006-9075-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Schiff, H. C., Bouhuis, A. L., Yu, K., Penzo, M. A., Li, H., He, M., et al. (2018). An insula-central amygdala circuit for guiding tastant-reinforced choice behavior. J. Neurosci. 38, 1418–1429. doi: 10.1523/jneurosci.1773-17.2017

PubMed Abstract | CrossRef Full Text | Google Scholar

Smári, J., Bouranel, G., and Thornóra Eiethsdóttir, S. (2008). Responsibility and impulsivity and their interaction in relation to obsessive-compulsive symptoms. J. Behav. Ther. Exp. Psychiatry 39, 228–233. doi: 10.1016/j.jbtep.2007.07.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Smith, J. L., Mattick, R. P., Jamadar, S. D., and Iredale, J. M. (2014). Deficits in behavioural inhibition in substance abuse and addiction: a meta-analysis. Drug Alcohol Depend. 145, 1–33. doi: 10.1016/j.drugalcdep.2014.08.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Smith, K. R., Lawyer, S. R., and Swift, J. K. (2018). A meta-analysis of nonsystematic responding in delay and probability reward discounting. Exp. Clin. Psychopharmacol. 26, 94–107. doi: 10.1037/pha0000167

PubMed Abstract | CrossRef Full Text | Google Scholar

Soares, A. R., Esteves, M., Moreira, P. S., Cunha, A. M., Guimaraes, M. R., Carvalho, M. M., et al. (2018). Trait determinants of impulsive behavior: a comprehensive analysis of 188 rats. Sci. Rep. 8:17666. doi: 10.1038/s41598-018-35537-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Studer, J., Baggio, S., Dupuis, M., Mohler-Kuo, M., Daeppen, J. B., and Gmel, G. (2016). Drinking motives as mediators of the associations between reinforcement sensitivity and alcohol misuse and problems. Front. Psychol. 7:718. doi: 10.3389/fpsyg.2016.00718

PubMed Abstract | CrossRef Full Text | Google Scholar

Swalve, N., Smethells, J. R., and Carroll, M. E. (2016). Progesterone attenuates impulsive action in a Go/No-Go task for sucrose pellets in female and male rats. Horm. Behav. 85, 43–47. doi: 10.1016/j.yhbeh.2016.08.001

PubMed Abstract | CrossRef Full Text | Google Scholar

VanderVeen, J. D., Hershberger, A. R., and Cyders, M. A. (2016). UPPS-P model impulsivity and marijuana use behaviors in adolescents: a meta-analysis. Drug Alcohol Depend. 168, 181–190. doi: 10.1016/j.drugalcdep.2016.09.016

PubMed Abstract | CrossRef Full Text | Google Scholar

Vanderveldt, A., Oliveira, L., and Green, L. (2016). Delay discounting: pigeon, rat, human–does it matter? J. Exp. Psychol. Anim. Learn. Cogn. 42, 141–162. doi: 10.1037/xan0000097

PubMed Abstract | CrossRef Full Text | Google Scholar

Verbruggen, F., Aron, A. R., Band, G. P., Beste, C., Bissett, P. G., Brockett, A. T., et al. (2019). A consensus guide to capturing the ability to inhibit actions and impulsive behaviors in the stop-signal task. Elife 8:e46323. doi: 10.7554/eLife.46323

PubMed Abstract | CrossRef Full Text | Google Scholar

Voon, V., and Dalley, J. W. (2016). Translatable and back-translatable measurement of impulsivity and compulsivity: convergent and divergent processes. Curr. Top. Behav. Neurosci. 28, 53–91. doi: 10.1007/7854_2015_5013

CrossRef Full Text | Google Scholar

Voon, V., Irvine, M. A., Derbyshire, K., Worbe, Y., Lange, I., Abbott, S., et al. (2014). Measuring “waiting” impulsivity in substance addictions and binge eating disorder in a novel analogue of rodent serial reaction time task. Biol. Psychiatry 75, 148–155. doi: 10.1016/j.biopsych.2013.05.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Weafer, J., and de Wit, H. (2014). Sex differences in impulsive action and impulsive choice. Addict. Behav. 39, 1573–1579. doi: 10.1016/j.addbeh.2013.10.033

PubMed Abstract | CrossRef Full Text | Google Scholar

Winstanley, C. A. (2011). The utility of rat models of impulsivity in developing pharmacotherapies for impulse control disorders. Br. J. Pharmacol. 164, 1301–1321. doi: 10.1111/j.1476-5381.2011.01323.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Winstanley, C. A., and Clark, L. (2016). Translational models of gambling-related decision-making. Curr. Top. Behav. Neurosci. 28, 93–120. doi: 10.1007/7854_2015_5014

CrossRef Full Text | Google Scholar

Winstanley, C. A., Eagle, D. M., and Robbins, T. W. (2006). Behavioral models of impulsivity in relation to ADHD: translation between clinical and preclinical studies. Clin. Psychol. Rev. 26, 379–395. doi: 10.1016/j.cpr.2006.01.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhong, H., Dang, J., Huo, Z., Ma, Z., Chen, J., Huang, Y., et al. (2018). Effects of medial prefrontal cortex 5-HT(7) receptor knockdown on cognitive control after acute heroin administration. Brain Res. 1678, 419–431. doi: 10.1016/j.brainres.2017.11.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: impulsivity, behavior, self-report, translation, back-translation

Citation: Esteves M, Moreira PS, Sousa N and Leite-Almeida H (2021) Assessing Impulsivity in Humans and Rodents: Taking the Translational Road. Front. Behav. Neurosci. 15:647922. doi: 10.3389/fnbeh.2021.647922

Received: 30 December 2020; Accepted: 29 March 2021;
Published: 06 May 2021.

Edited by:

Tatyana Strekalova, I.M. Sechenov First Moscow State Medical University, Russia

Reviewed by:

Lorenzo Di Cesare Mannelli, University of Florence, Italy
David A. Slattery, University Hospital Frankfurt, Germany
Anna Gorlova, I.M. Sechenov First Moscow State Medical University, Russia

Copyright © 2021 Esteves, Moreira, Sousa and Leite-Almeida. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Hugo Leite-Almeida, hugoalmeida@med.uminho.pt

Download