Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 14 May 2019
Sec. Comparative Psychology

Toward a Standardized Test of Fearful Temperament in Primates: A Sensitive Alternative to the Human Intruder Task for Laboratory-Housed Rhesus Macaques (Macaca mulatta)

  • 1Centre for Research in Brain and Behaviour, School of Natural Sciences and Psychology, Liverpool John Moores University, Liverpool, United Kingdom
  • 2Biological Anthropology Research Centre, School of Natural Sciences and Psychology, Liverpool John Moores University, Liverpool, United Kingdom
  • 3Welfare and Cognition Group, Cognitive Neuroscience Laboratory, German Primate Center–Leibniz Institute for Primate Research, Göttingen, Germany
  • 4Behavior and Cognition, University of Göttingen, Göttingen, Germany
  • 5Leibniz-Science Campus Primate Cognition, German Primate Center–University of Göttingen, Göttingen, Germany

Standardized and sensitive tests to assess differences in temperament among primates housed in captivity are essential for monitoring welfare and improving science outcomes through reduced noise in data. Fearful temperament in primates has traditionally been assessed using the Human Intruder Test (HIT) in which duration of bodily freeze in response to approach by an unknown human is measured. The HIT is susceptible to variation between facilities in execution, interpretation of data and could be stressful for animals with more fearful temperaments. We tested the applicability of a touch-screen task with putatively negative stimuli as a more standardizable and sensitive tool for measuring fearful temperament in laboratory primates. Seventeen adult male rhesus macaques were assessed for fearfulness using the HIT. They were then tested on a touch-screen task designed to measure two behavioral indices of fearfulness: behavioral inhibition and response-slowing. We predicted monkeys assessed as having more fearful temperament in the HIT, would show the greatest degree of behavioral inhibition and response-slowing to negative pictures in the touch-screen task. In Study 1, monkeys were rewarded with juice for touching gray squares on the screen (control trials). On test trials a picture of an unknown male conspecific face with direct-gaze (signaling threat) was shown. Monkeys were less likely to touch direct-gaze faces than control trials, indicating behavioral inhibition to threat. Behavioral inhibition was greatest amongst monkeys scored with most fearful temperament in the HIT. This primary result indicates the touch-screen task may be sensitive to a more subtle form of the bodily freeze behavior measured using the HIT. In Study 2, we tested whether these findings generalized to other classes of putatively negative stimuli; monkeys were shown pictures of the human intruder and objects associated with veterinary and husbandry procedures, interspersed with control trials (gray squares). There was no evidence of behavioral inhibition in Study 2. There was some evidence for response-slowing, which was greater for pictures of objects than pictures of the human intruder, and occurred independently of fearfulness in the HIT. We propose touch-screen tasks provide a more standardized and sensitive approach for assessing fearful temperament in laboratory primates.

Introduction

Reliable methods to assess individual differences in how animals respond to stress in the laboratory environment are essential for improved scientific outcomes, animal welfare, and worker safety and satisfaction (Buchanan-Smith, 2006; Prescott et al., 2017). Primates are widely used research models in the study of the neuroscience of fear and anxiety, with most work being conducted with Macaca spp. (Walsh et al., 1995; Carlsson et al., 2004; Coleman and Pierre, 2014). Macaques exhibit marked individual differences in temperament and stress responsivity (Kalin et al., 1998; Gosling and John, 1999; Gottlieb and Capitanio, 2013; Capitanio et al., 2017), which has consequences for noise in experimental data. The development and refinement of methods to measure temperamental differences in coping response to daily stressors is required for standardizing scientific methods across research groups and improving quality of science through better ability to identify and control for latent confounds that may impact scientific research outcomes (Würbel, 2002; Buchanan-Smith, 2006; Prescott et al., 2017). In particular, variation between individuals in fearful temperament in primates is important to identify as it can negatively impact both scientific outcomes and individual welfare (Jennings et al., 2009).

Fearfulness in the laboratory is assessed in terms of defensive behaviors in the presence of threatening stimuli that vary in level of threat, e.g., distance and opportunity for escape (Blanchard et al., 2011). In humans and laboratory-housed non-human primates fearfulness has primarily been studied using bodily freeze in response to threat (e.g., stranger approach in human children: Ainsworth and Bell, 1970; Buss et al., 2004; human intruder tests in non-human primates: Kalin et al., 1998) and fear-conditioning (e.g., fear-potentiated startle reflex: Lang et al., 2000). During the stranger approach test, typically used with human children, a child is left alone in an observation room until a stranger enters and approaches the child. Duration of time the child spends in a frozen posture (generally defined as maintaining a tense body posture with no movement or vocalization for at least 2 s: Buss et al., 2004) is recorded. Children who freeze for long durations in the presence of the stranger are considered to be behaviorally inhibited (Ainsworth and Bell, 1970), which is a measure of fearfulness and a known risk factor for development of affective disorders in later childhood and into adulthood (Lewis-Morrarty et al., 2015; Van Hulle et al., 2017).

An analog of the stranger approach test which has been adapted for use with non-human primates is the Human Intruder Test (HIT; Kalin and Shelton, 1989). The HIT has been most widely applied with macaques (Coleman and Pierre, 2014; Capitanio et al., 2017). As with the stranger approach test, the HIT is a formalized enactment of a regular occurrence – a person entering the room. Briefly, a monkey is isolated in a room away from its social group (or mother in the case of infants). Then, a human ‘intruder,’ often wearing a face mask to conceal their identity, enters the room and stands in profile making no eye contact with the monkey. This is considered to be an ambiguous cue since gaze aversion is a signal of subordination in macaques (Maestripieri, 1997). While the intruder stands in profile macaques tend to freeze [generally defined as maintaining a tense body posture with no movement or vocalization for at least 3 s in non-human primates (Kalin et al., 2004)]. Freezing at this point is an adaptive response allowing assessment of the situation while reducing the likelihood of detection (Blanchard et al., 2011). Enhanced freezing in the profile condition has been associated with increased right frontal lobe activity (Kalin and Shelton, 2003) which, in humans, is associated with greater negative emotion processing and reactivity to negative stimuli (Adolphs et al., 1996). After a predetermined amount of time, the intruder orients frontally to stare at the monkey [a signal of dominance and threat in Macaca spp. and most other non-human primates (Maestripieri, 1997)] for an equal amount of time. When stared at, monkeys typically exhibit a range of aggressive-defensive and fear behaviors, reflecting appropriate fight or flight responses (Kalin and Shelton, 2003). The intruder may then approach closer to the monkey and repeat the two orientations (Gottlieb and Capitanio, 2013). Monkeys who display high levels of freezing during the frontal (and any repeated) orientations of the HIT are considered to exhibit the most fearful temperament (Kalin, 2003; Kalin and Shelton, 2003; Buss et al., 2004).

Methods used to conduct the HIT vary between facilities, as does the focus on, and treatment of, behavioral data. For example, the human intruder may stand in each orientation for 1 min (Gottlieb and Capitanio, 2013) or 10 min (Kalin and Shelton, 1989). There may be two orientations performed at each of two distances (Capitanio, 2011) or just one distance (Corcoran et al., 2012), or additional orientations such as standing with the back to the monkey at a single distance (Coleman et al., 2017). Finally, research groups take distinct theoretical and statistical approaches to treatment of behavioral data (e.g., Gottlieb and Capitanio, 2013 did not include freeze behavior in their factor analysis while Corcoran et al., 2012 found a significant effect of intruder on freezing behavior specifically), and interpretation in terms of fearful temperament (Kalin, 2003; Kalin and Shelton, 2003; Buss et al., 2004) or anxious temperament (Rogers et al., 2008; Corcoran et al., 2012; Gottlieb and Capitanio, 2013; Coleman and Pierre, 2014). The ARRIVE guidelines (Kilkenny et al., 2010) for improving bioscience reporting advise to test the imprecision associated with results of studies, but this can be challenging when faced with variability in methods. Furthermore, some studies have demonstrated inconsistency in results obtained from the same individuals when assessed for temperament using different methods. Carter et al. (2012) for example, found that individual scores for boldness in response to predator stimuli in baboons differed from boldness measured in the same individuals as time to approach novel food.

Refined methods for assessing negative emotional states, so that methods can more easily be standardized across research facilities, are more sensitive, less intrusive and less time-consuming, would improve quality of scientific and animal welfare (Russell et al., 1959; Coleman and Novak, 2017). Standardization, reduced intrusiveness and time savings can be achieved through development of automated systems that reduce experimenter bias. This is particularly so in settings where animals are already familiar with automated systems, such as cognitive research laboratories (Calapai et al., 2017; Berger et al., 2018) and some zoos (Clark, 2017; Cronin et al., 2018). Sensitivity can be enhanced by refining methods so that testing occurs at threshold. During the HIT, it has been proposed that most animals exhibit full-body freeze behavior during the far-profile condition, an adaptive response to avoid detection (Kalin and Shelton, 1989; Coleman and Pierre, 2014). A refined method would therefore be sensitive to subtle pre-cursor indicators of fearful response that arise only in animals with high level – or dysregulated – emotion. If such indicators can be characterized these methods would provide a clear refinement to the methodology of identifying fearful individuals (Kilkenny et al., 2010; NC3Rs, 2015; Prescott et al., 2017), additionally because it reduces stress to the others.

A number of computer-based paradigms exist to measure fear-related response to affective stimuli in humans. We argue these paradigms can be adapted for use with non-human primates. Tasks typically measure reaction-time to detect targets that appear on a screen on which threat cues are also presented (Fox et al., 2001; Algom et al., 2004; Mogg et al., 2008; Frings et al., 2010; Hommer et al., 2014; Aylward et al., 2017; Mkrtchian et al., 2017). Within the literature there is a general consensus that response-slowing, or total inhibition of response, to threatening (as opposed to non-threatening) stimuli is associated with negative affect. For example, Fox et al. (2001) developed an exogenous cueing attention bias task in which participants were required to respond to a target that appeared at locations on a screen either congruent or incongruent to locations of previously displayed negative, neutral or positive words. Respondents were slower to respond to targets following negative words than to respond to targets following neutral or positive words. The authors proposed the response-slowing may have been attributable to a subtle cognitive freeze response to the negative words. Recently, reinforcement learning models (e.g., Pavlovian response), which are widely used with non-human primates in research settings, have also been applied to measure behavioral inhibition in people with mood disorders (Mkrtchian et al., 2017). The latter study revealed that individuals categorized as having a mood disorder were more likely to withhold responses on a go/no-go reinforcement learning task than people with no such diagnosis.

Based on the human cognitive literature, Bethell et al. (2016) proposed a ‘response-slowing task’ as an alternative method to the HIT, for measuring dysregulated fear in rhesus macaques (M. mulatta). This touch-screen task presented pictures of conspecific faces which were considered to be potentially threatening (a neutral face with direct-gaze) or to have low threat value (a neutral face in profile). The stimuli were compiled to capture elements of both the HIT and the types of picture used in human cognitive studies. Rhesus macaques were first trained to touch a neutral gray square that appeared on a touch-screen, in order to gain a small food reward. They were then tested on their response times to touch the same gray squares when a conspecific face with direct-gaze or averted gaze appeared in the center of the square. Stimuli were presented one at a time on the touch-screen during two conditions: during a period of enrichment and in the days following a presumably stressful veterinary examination. Rhesus macaques had slower responses to direct-gaze faces (threat) relative to gray square controls following the veterinary examination, but there was no effect for the averted-gaze faces (low threat). The authors interpreted these results as possible evidence of stress-related response-slowing to threat, and proposed the task may provide a less intrusive and more sensitive alternative to the HIT in laboratory primates. More recently, researchers at Lincoln Park Zoo tested the utility of the response-slowing task for measuring the effect of a public air display (in which loud low-flying jets passed overhead on three consecutive days) on fearfulness in three species of primate: Japanese macaques (M. fuscata), chimpanzees (Pan troglodytes) and gorillas (Gorilla gorilla gorilla). Japanese macaques (but not the chimpanzees or gorillas) exhibited enhanced response slowing to direct-gaze faces in weeks when the air display occurred compared to weeks in which no display occurred (Cronin et al., 2018).

In order to serve as an alternative and less intrusive method to the HIT, the response-slowing task requires validation to establish the extent to which slowing and total inhibition of responses to emotional stimuli presented on a touch-screen are associated with freeze response in the HIT. Here, we present data from adult male rhesus macaques who took part in both the HIT and a touch-screen response-slowing task, adapted from Bethell et al. (2016). The rhesus macaques first took part in a HIT test during which they were assessed for fearful temperament measured as duration of freezing and fearful retreat. In our study, the human intruder was a technical staff member (with whom the monkeys had limited experience) wearing a human mask to conceal their identity. Following the HIT, we conducted two studies to assess the extent to which fearful temperament assessed in the HIT was predictive of behavioral inhibition during a touch-screen task. In Study 1, test stimuli were direct-gaze faces of male conspecifics (which we would expect monkeys to perceive as threatening). We measured the proportion of trials on which monkeys touched the faces for a reward or withheld responses (behavioral inhibition). On trials where a response was made, we measured speed to touch the face. We predicted that if the touch-screen task is sensitive to mechanisms that underlie freezing behavior in the HIT, then monkeys who show more freezing and retreat behavior during the HIT, will show greatest inhibition of response, and response-slowing, to direct-gaze faces.

In Study 2, the same cohort of monkeys took part in two response-slowing tasks during which we showed non-social putatively negative stimuli. Stimuli were images of a person wearing the same mask worn by the intruder in the HIT, and familiar objects associated with veterinarian and husbandry procedures which we presumed would have negative associations for the monkeys. We predicted that macaques who show more freezing during the HIT would be more sensitive to these non-social negative stimuli and again show greater inhibition of response, and response-slowing than non-fearful monkeys.

Materials and Methods

Animals and Housing

Seventeen male rhesus macaques (age range of 4–12 years: Table 1) living in isosexual groups of 2–4 at the Cognitive Neuroscience Laboratory, German Primate Centre (DPZ) took part in this research. Monkeys were housed in indoor rooms providing an enriched environment (including a multitude of toys and wooden structures, natural as well as artificial light, and space exceeding all applicable German and European regulations, Berger et al., 2018). Indoor rooms were temperature-controlled and connected via a tunnel to rooms with one side (made of wire-mesh and glass louwers) toward the outside of the building and which were at ambient outdoor temperature and lighting, but protected from precipitation. On test days the monkeys had free access to water for at least 4 h (typically much more: for definitions of access to water see Pfefferle et al., 2018) and received monkey chow ad libitum. On non-test days the monkeys had free access to water and received monkey chow ad libitum, supplemented with dried fruits, fresh fruits and vegetables. The health of the monkeys was monitored daily by the animal care staff, DPZ veterinarians, and the laboratory researchers who are all highly experienced with these animals.

TABLE 1
www.frontiersin.org

Table 1. Animal identity and age at taking part in the HIT, arranged by descending HIT freeze-fear score, with performance data for Study 1 (faces) and Study 2 (mask and object).

Testing Compartment

Each indoor room was connected to a testing compartment (ca. 807590 cm), with wire mesh walls in an adjacent room, accessible through a sliding door where monkeys regularly took part in touch-screen tasks, were fed treats by care staff, and where they could be separated from the group for veterinary inspection. All animals were used to entering this compartment on a daily basis and many worked daily on touch-screen tasks there. The HIT, and subsequently the response-slowing task (Study 1 and Study 2), were conducted in this area. For all individuals the HIT preceded the response-slowing task (mean lag = 22 weeks; range = 1–89 weeks). Monkeys were separated from social group members and encouraged to enter their respective testing compartment with small fruit rewards (grape, raisin or banana) prior to each testing session. For the HIT, social group members and those animals in adjacent rooms were moved out of sight (to their outdoor enclosure) to prevent exposure to the experiment.

Human Intruder Test (HIT)

All monkeys completed the HIT prior to cognitive testing, as part of a pre-existing welfare protocol to assess temperament in animals at the facility. A monkey was first separated in its testing compartment and allowed to settle for 5 min. The HIT progressed in four stages: far-profile, far-frontal, near-profile, and near-frontal (after: Gottlieb and Capitanio, 2013; Capitanio et al., 2017). Initially a male adult human (wearing a human mask to conceal his identity), entered the room, approached a point marked 1 m of the front of the compartment and stood in profile to the compartment for 1 min (far-profile condition). After 1 min the experimenter turned to face and look at the monkey for 1 min (far-frontal). Both orientations (profile and frontal) were then repeated at another point 0.3 m from the front of the compartment (near-profile and near-frontal). All stages of the HIT were recorded on a Panasonic (HC-W580) video camera and video was later coded for analysis of behavioral response using the program BORIS v.6.0.2 (Friard and Gamba, 2016). Only one monkey from a pair was tested on any 1 day to minimize disruption for each pair. We identified two non-mutually exclusive behavioral categories of interest from previous studies that used the HIT (Kalin et al., 1998; Gottlieb and Capitanio, 2013) and literature on defensive distance to threat (Blanchard et al., 2011): freeze response (>2 s in a frozen posture) and fearful retreat (defined here as time spent at the back of the compartment). All monkeys were naïve to the HIT at the start of this study.

Cognitive Task

Stimuli and Apparatus

The response-slowing task was adapted from Bethell et al. (2016). There were four types of stimuli: ‘training,’ ‘filler,’ ‘control,’ and ‘test’ (Figure 1A). Training stimuli consisted of a 70% luminance gray square with a side length of 78 mm on the screen. We created two additional categories of training stimuli by superimposing pictures that we presumed to have positive or neutral emotional valence for the monkeys onto the training stimulus. Images were of fruits (n = 18; ‘fruit’) and unknown conspecific infants (n = 18 ‘infant’; collected by DP at the Cayo Santiago Field Station of the Caribbean Primate Research Centre, Puerto Rico). Nine ‘fruit’ and 11 ‘infant’ stimuli were also presented during testing as filler stimuli to maintain monkeys’ interest in the task. The control stimulus during testing was the gray square that had been used during training.

FIGURE 1
www.frontiersin.org

Figure 1. (A) An illustrative timeline showing (in chronological order) the ‘start button,’ always displayed at lower center of the screen; control stimulus (during testing; also used as the training stimulus during training), shown at screen location 1; the 0.5 s inter-trial interval (ITI) until the onset of the next start button; filler stimulus ‘fruit,’ shown at screen location 5; ITI and start button; direct-gaze face (test stimulus in Study 1), shown at screen location 3. (B) The six locations on the screen at which stimuli were shown.

Test stimuli were pictures that we presumed to have negative emotional valence for the monkeys. In Study 1 (faces), there was one category of test stimulus: ‘direct-gaze face’ for which pictures of unknown conspecific adult male faces with direct gaze were used (18 identities, photographs taken by DP at the Cayo Santiago Field Station). Pictures were trimmed so that only the monkey’s head was visible. These trimmed photos were superimposed onto the center of the control stimulus (leaving a 6 mm gray border).

In Study 2 (mask and objects), two categories of test stimulus were created. The first category ‘mask’ consisted of a picture of the mask previously seen during the HIT. The second category ‘objects’ comprised color photographs of veterinary and husbandry objects (one picture each of a glove, a broom and a net).

Stimuli were presented on an eXperimental Behavioral Instrument (XBI: Calapai et al., 2017; Berger et al., 2018) using MWorks1 software. The built-in drinker spout of the XBI was placed 250 mm in front of the center of the integrated 15″ (300 mm × 225 mm) touch-screen monitor. All monkeys had previously worked with the XBI in previous studies.

Procedure

All training and test sessions followed a block design and consisted of a maximum of 120 trials. Prior to testing, monkeys were trained to respond to the control and filler stimuli presented at six locations on the touch-screen (Figure 1B). Monkeys began a trial by touching a 70% luminescence gray square (‘start button’) that appeared within a colored bar at the bottom of the screen for up to 10 s. Once touched, the start button disappeared and one of the three categories of training stimulus (control, fruit, or infant) appeared in one of the six screen locations. The stimulus remained on the screen for 3 s regardless of whether the monkey touched it. (During the training phase, 15 monkeys worked consistently with a stimulus duration of 3 s and generally performed up to 120 trials within approximately 120 min. We used a 1 s stimulus duration for two monkeys who indicated poor motivation to work consistently during this training phase.) If the monkey touched the stimulus, as visual feedback, the gray part of it decreased to 35% luminescence (i.e., darkening), a secondary reinforcing tone was played via a speaker behind the apparatus and the monkey was rewarded with automatic delivery of a 0.25 ml fluid reward via the drinker spout. Fluid reward was a mix of 70% plain water and 30% flavored water (active O2, Adelholzener) or grape juice (kept consistent for each monkey). Primary and secondary reinforcers were delivered on a 100% fixed reinforcement ratio during training and testing phases. All responses were recorded automatically by the MWorks program. There was a fixed 500 ms inter-trial interval between the stimulus offset and the onset of the start button for the next trial. If the monkey touched the screen during the interval the timer reset so that the onset of the next trial occurred 500 ms after the monkey stopped touching the screen. Each category of stimulus was presented an equal number of times at each of the six screen locations. Criterion for learning the task was 80% touches on control trials.

Once a monkey had reached criterion for training, he began testing on the next available day. A test session always began with a warm-up block (n = 6 trials) in which the monkey had to first respond by correctly touching on three control (C) trials, followed by a control and a filler (F; i.e., pictures of infants) trial (which could occur in either order), and followed by a final control trial (i.e., C, C, C, F + C, C). A trial occurred once at each of the six screen locations, with order of location randomized for each testing session. The test block comprised 108 trials (control n = 72, test n = 18, filler n = 18) in which trials occurred in a pseudo-randomized order with the instruction that the 18 test (T) trials were always preceded by at least one, and no more than three, consecutive control trials (i.e., ‘F, C, T…’ and ‘F, C, C, C, T…’). On completing the test block, the test session ended with a cool-down block (n = 6 trials) containing one control trial, followed by one control and one filler (infant) trial in randomized order, and ending with three control trials (C, F + C, C, C, C). Again, trials occurred at random, once at each of the six screen locations. In Study 1, (faces) each monkey took part in one daily session. In Study 2 (mask and objects), each monkey took part in one daily test session with mask stimuli, and one daily test session with object stimuli, counterbalanced between monkeys for order in which they did these. Criterion for including data from a given monkey in the analysis was at least 65% touches on control trials in a daily test session.

Data Preparation

Behavioral data for duration of freeze and time spent at the back of the testing compartment were recorded as total duration for each behavioral category summed across the four 1-min stages of the HIT: far/near × profile/frontal, (after Capitanio et al., 2017). Correlational analysis revealed a positive correlation between freeze and fearful retreat (r1,14 = 0.54, P = 0.05) and so we combined scores to create a single measure we labeled ‘freeze-fear score,’ and which could have a maximum score of 480 s summed across the two non-mutually exclusive categories.

Data from the touch-screen task were treated following common protocol in the human literature (e.g., Mogg et al., 2008; Holmes et al., 2009). Only control and test trial data from the test block were used in the analysis. Data were in two forms: binomial go/no-go response and latency to respond on ‘go’ trials. We removed all responses faster than 300 ms (deemed to have occurred too quickly to reflect meaningful response to the stimuli: see also Bethell et al., 2016). To reduce the influence of outliers, for ‘go’ trials we trimmed the data at 2 SD above the mean per individual. To estimate response-slowing effects on test trials, we calculated a reaction time (RT) difference score for each monkey by subtracting the mean RT on control trials from the mean RT on test trials, controlling for location on the screen. Positive values therefore indicate slower responses on test trials compared with controls and negative values indicate faster responses on test trials compared with controls. The full data set can be accessed at Supplementary Data Sheet S1.

Statistical Analysis

Statistical analyses were conducted in R v. 3.4.3 (R Core Team, 2017). In both Study 1 and Study 2, we fitted linear mixed models including all possible random slopes using the package ‘lme4’ version 1.1-15 (Bates et al., 2015). Subject identity was entered as a random factor in all models. To keep type I error rates at the nominal level of 0.05, we added all possible random slopes estimates [i.e., for all factors with cases representing all individuals at most levels (Schielzeth and Forstmeier, 2009; Barr et al., 2013)]. We did not include the correlations between random slopes and intercepts into the models, because of increased computation time and since it is known that neglecting them does not compromise type I error rates (Barr et al., 2013). Prior to fitting the models, we checked all predictor variables for correlations above 0.4 (which could result in collinearity), checked all response and predictor variables for their distribution and transformed data to obtain more normal distributions when necessary. We scaled all covariates using a z-transformation to a mean of zero and a standard deviation of one. Scaled covariates provide more comparable estimates and are easier to interpret with regards to interactions (Aiken and West, 1991; Schielzeth, 2010). For plotting purposes we present untransformed values, and model lines obtained from these, to aid interpretation.

Study 1 (Direct-Gaze Faces)

In Study 1, we fitted two linear mixed models to test the hypothesis that more fearful monkeys (as assessed using the HIT) would show (a) enhanced behavioral inhibition of response and (b) response-slowing to negative stimuli (conspecific face with direct-gaze) during the touch-screen task. We therefore entered our key predictor variables stimulus type (test, control) and freeze-fear score as an interaction term. We controlled for the potential effects of two factors: stimulus location on the screen (six locations) and XBI apparatus number (five machines); and two covariates: age and trial number. Trial number was square root transformed following distribution checks. We fitted this generalized linear mixed model (including all possible random slopes and subject as random factor) using the ‘glmer’ function with binomial error structure and logit link function (McCullagh and Nelder, 1996). Since the model did not converge when using the default optimizer ‘Nelder-Mead’ and the default number of iterations, we used the argument ‘control’ to specify the optimizer to ‘bobyqa’ and increased the number of iterations to 100,000. We visually inspected the distribution of the random effects for normality, finding no indication of influential cases. Additionally, we assessed model stability using a loop that excludes data points one by one from the data set, and comparing the model estimates derived with those obtained from the full model, again there was no indication of influential cases. To rule out collinearity, we determined Variance Inflation Factors (VIF: Tabachnick and Fidell, 2001; Quinn and Keough, 2002; Field, 2005; Zuur et al., 2010) using the function ‘vif’ of the R-package car (Fox and Weisberg, 2011) applied to a standard linear model with all response and predictor variables, but excluding the interactions and random effects (maximum VIF = 1.40).

For those trials in which the monkeys did make a response, we ran a second generalized linear mixed model testing for a relationship between freeze-fear score from the HIT and the reaction time (RT) difference score. In this model, we controlled for the potential effects of the factors stimulus location on the screen (six locations) and XBI apparatus (five machines), and the covariates age and temporal sequence of stimulus presentations (an adjusted form of trial number since information about unique trial number was lost after removing ‘no-go’ trials and calculating RT difference scores). Following distribution checks, we square root transformed the variable temporal sequence of stimulus presentations. Data were analyzed fitting a general linear mixed model (including all possible random slopes and subject as random factor) using the ‘lmer’ function with Gaussian error structure and identity link function (Baayen, 2008). We checked whether the assumptions of normally distributed and homogeneous residuals were fulfilled by visually inspecting qq-plots and plots of residuals against fitted values. We visually inspected the distribution of random effects for normality and checked for model stability by excluding subjects one at a time and comparing the model estimates derived for these subsets of the data with those derived for the full data set. We found no evidence for influential cases. Variance Inflation Factors (VIF: Tabachnick and Fidell, 2001; Quinn and Keough, 2002; Field, 2005; Zuur et al., 2010) were derived using the function ‘vif’ of the R-package car (Fox and Weisberg, 2011) applied to a standard linear model excluding the interactions and random effects (maximum VIF = 1.46).

Study 2 (Mask and Object)

As in Study 1, we ran two models to test the sensitivity of the touch-screen task to fearfulness, this time to a human mask and objects associated with veterinary and husbandry procedures. In the first model, we tested whether the probability to touch a stimulus on the touch-screen (‘go/no-go’) is explained by freeze-fear score and stimulus type (test, control) entered as an interaction term, and freeze-fear score and stimulus category (mask, object) entered as a second interaction term. Control variables were the factors order of test session (mask test session first or object test session first), previous exposure to the test stimuli (in cases where sessions were terminated early for extraneous reasons and rerun later: yes/no), location on the screen (six locations) and XBI apparatus (five machines), and the covariates age and trial number. Following distribution checks we square root transformed the response variable and trial number. We fitted this generalized linear mixed model (including all possible random slopes and subject as random factor) using the ‘glmer’ function with binomial error structure and logit link function (McCullagh and Nelder, 1996). Since the model did not converge when using the default optimizer ‘Nelder-Mead’ and the default number of iterations, we used the argument ‘control’ to specify the optimizer to ‘bobyqa’ and increasing the number of iterations to 1,000,000. We checked the assumptions of the model by visually inspecting the distribution of the random effects for normality, assessed model stability (excluding data points at a time and comparing the model estimates of that reduced model with those of the full model), and tested for issues of collinearity (maximum VIF = 1.78). None of these tests indicated an issue.

In the second model, we tested for a possible effect of freeze-fear score and stimulus category (mask, object) as an interaction term on RT difference score. We fitted a general linear mixed model (including all possible random slopes and subject as random factor) using the ‘lmer’ function with Gaussian error structure and identity link function (Baayen, 2008). Control variables were the factors order of test session (mask session first or object session first), previous exposure to the test stimuli (in cases where sessions were terminated early for extraneous reasons and rerun later: yes/no), location on the screen (six locations) and XBI apparatus number (five machines), and the covariates age and temporal sequence of stimulus presentations (an adjusted form of trial number since information about unique trial number was lost after removing ‘no-go’ trials and calculating RT difference scores). Following distribution checks we square root transformed the response variable as well as the control variable temporal sequence of stimulus presentations. Visual inspection of qq-plots and plots of residuals against fitted values indicated four outliers. We checked the outliers but since no reason could be identified for why those four cases appeared different, and model stability checks indicated no influential cases, we retained the outliers in the model (model results with these four cases removed revealed no meaningful change in the analysis output or interpretation). Variance Inflation Factors gave no indication of collinearity (largest VIF = 1.78).

In Studies 1 and 2, following model checks, we tested the significance of the full model (comprising all predictor variables, random slopes and random effects) against its null model (comprising the intercept, control variables, random slopes and random effects) using a likelihood ratio test (function ‘anova’ with the argument test set to ‘Chisq’; Dobson, 2002; Forstmeier and Schielzeth, 2011). To allow for a likelihood ratio test we fitted the models using Maximum Likelihood (rather than Restricted Maximum Likelihood: Bolker et al., 2009). Where a model comparison result revealed a significant or marginally significantly better fit of the full model, we used the ‘drop’ function to assess whether any interactions were significant and therefore to be retained or removed in the final model (Barr et al., 2013).

Ethics Statement

This study complied with institutional guidelines on Animal Care and Use of the German Primate Center and was conducted in accordance with national and international guidelines on the use of primates in research including German Animal Protection Law, the European Union Directive 2010/63/EU on the Protection of Animals used for Scientific Purposes and the Society for Neuroscience Policies on the Use of Animals and Humans in Neuroscience Research. The animals used in this study were all highly accustomed to settings and scenarios experienced in the current study. All animals in this study were also participating in studies that require a governmental permit due to being animal experiments (the permit was issued by the responsible regional government office, Niedersaechsisches Landesamt fuer Verbraucherschutz und Lebensmittelsicherheit, LAVES, under the permit number 3392 42502-04-13/1100). Additionally, the study was approved by Liverpool John Moores University Ethical Review Panel under permit number EB/20-184.

Results

HIT

Seventeen monkeys completed the HIT (mean age at time of HIT: 7.51 years, range 4.22–11.63 years; Table 1), producing a total of 68 min of video for coding. All monkeys exhibited freeze response and fearful retreat during the first stage of the HIT (far-profile), and all monkeys also exhibited fearful retreat in the near stage (both near-profile and near-frontal). Four monkeys exhibited freeze response in the near stage (both near-profile and near-frontal). Mean freeze-fear score across all four stages of the HIT was 297 s (range 139–480).

Study 1: Fearful Temperament Predicts Behavioral Inhibition (but Not Response Slowing) to Direct-Gaze Faces

For touch-screen Study 1 (direct-gaze faces), 16 monkeys initially took part, completing 1598 test and control trials (test n = 285). All monkeys reached the 65% performance criterion for consideration for inclusion in the analysis. We discarded warm-up and warm-down trials (9.95% of the data, n = 159 trials) and responses faster than 300 ms (0.38% of the data, n = 6 control trials) resulting in 1,433 trials. For go/no-go responses we then removed data from the two monkeys who had worked on the 1 second trial duration (Hum and Osk: 11.26% of the data, n = 180 trials), and two monkeys who had been temporarily singly housed for veterinary purposes during the study period (Bex and Zaz: 11.14% of the data, n = 178 trials; Table 1). This resulted in 1075 ‘go/no-go’ trials (test n = 216) from 12 monkeys (mean age on first day of Study 1: 7.81 years, range 5.96–12.18) for inclusion in the analysis. Mean probabilities to respond on control and test trials were 0.97 ± 0.01 and 0.88 ± 0.04, respectively. For the analysis of latency to respond on ‘go’ trials, we included data from the two monkeys who worked on the 1 s schedule, and discarded all non-responses (6.51% of the data, n = 103 trials), and all trials with RTs above 2 SD of individual means (4.57% of the data, n = 73 trials). We calculated the RT difference scores from the remaining 1,257 ‘go’ responses (matched for stimulus identity and location on the screen), resulting in 204 RT difference scores from 14 monkeys (mean age on first day of testing in Study 1: 8.53, range 5.96–12.18) for analysis. Mean RT difference score was 48.19 ± 12.83 ms.

To assess behavioral inhibition of response, go/no-go data were entered in the model as the binary response variable. The full model (containing the interaction term between stimulus type and freeze-fear score and the four control variables) was significantly different compared to the null model (excluding the interaction term between stimulus type and freeze-fear score, but retaining the intercept and the four control variables: likelihood ratio test, LRT: χ2 = 14.68, df = 3, P = 0.002). The model revealed a significant interaction between stimulus type and freeze-fear score (LRT: χ2 = 4.32, df = 1, P = 0.038: Table 2). Monkeys were significantly less likely to touch direct-gaze faces than controls overall (z = -3.10, P = 0.002) and this effect was greatest for monkeys with higher freeze-fear scores (z = -2.22, P = 0.078; Figure 2). For the four control variables (stimulus location on the screen, XBI apparatus number, age and trial number) we found a significant and positive relationship for trial number (LRT: χ2 = 4.02, df = 1, P = 0.045) whereby monkeys responded on proportionally more trials as the session progressed, an effect that visual inspection of the data revealed was driven by the change in probability of responding during the early presentations of the test trials (Figure 3). There were also significant effects of XBI number (LRT: χ2 = 10.12, df = 3, P = 0.018) and stimulus location (LRT: χ2 = 17.83, df = 5, P = 0.003) on probability to touch stimuli. The latter result appeared to be driven by a tendency to make more responses to stimuli presented in the lower half of the screen (nearer the start button) than the upper part of the screen, with no indication of visual field effects (Table 3).

TABLE 2
www.frontiersin.org

Table 2. Results of the generalized linear mixed model for Study 1 (direct-gaze faces) examining the interaction between test predictors stimulus type and freeze-fear score on the probability of monkeys to touch stimuli presented on the touch-screen.

FIGURE 2
www.frontiersin.org

Figure 2. Probability to touch test (direct-gaze face) and control trials combined, plotted against freeze-fear score for n = 12 monkeys in Study 1. Individual means are shown. Circle size indicates number of trials. Lines represent model estimates.

FIGURE 3
www.frontiersin.org

Figure 3. Mean ± SE probability to touch (A) control trials (n = 72 trials per monkey) and (B) test (direct-gaze face) trials (n = 18 trials per monkey) in the temporal sequence in which they were shown during the test block for n = 12 monkeys in Study 1. Group means are shown.

TABLE 3
www.frontiersin.org

Table 3. Probability to touch test (direct-gaze face) and control (gray square) trials at each of the six screen locations in Study 1.

For RT difference scores in Study 1 the full model did not explain the data better than the null model (LRT: χ2 = 2.42, df = 1, P = 0.120). We ran no further analyses.

Study 2: Fearful Temperament Does Not Predict Behavioral Inhibition or Response Slowing to a Mask or Objects

For touch-screen Study 2 (mask and objects) 17 monkeys initially took part, of which 16 monkeys responded on control trials above the 65% performance criterion (Table 1). The 16 monkeys completed a total of 3,536 test and control trials (test n = 631). We discarded warm-up and warm-down trials (10.01% of the data, n = 354 trials) and responses faster than 300 ms (0.48% of data, n = 4 test and n = 13 control trials) resulting in 3,165 trials. For go/no-go responses we then removed data from the two monkeys who had worked with the 1 s trial duration (Hum and Osk: 13.09% of the data, n = 463 trials) resulting in 2,702 trials (test n = 537 trials) from 14 monkeys (mean age on first day of Study 2: 7.17 years, range 5.05–11.21 years) for analysis. Mean proportion of responses on control and test trials during the mask study were 0.90 ± 0.03 and 0.92 ± 0.03, respectively, and in the object study were 0.89 ± 0.03 and 0.84 ± 0.05. For the analysis of latency to respond on ‘go’ trials, we retained the two monkeys working on the 1 s schedule and discarded all non-responses (8.99% of data, n = 318 trials), and RTs above 2 SD of individual means (3.91% of the data, n = 138 trials). We calculated the RT difference scores from the remaining 2767 ‘go’ responses, resulting in 521 difference scores (mask: n = 283, object: n = 238) from 16 monkeys (mean age on first day of Study 2: 8.02 years, range 5.05–11.95 years) for analysis. Mean RT difference scores for the mask and object studies were 40.78 ± 28.51 and 169.71 ± 52.23, respectively.

For the ‘go/no-go’ data the full vs. null model comparison was non-significant (LRT: χ2 = 7.46, df = 5, P = 0.188) and we ran no further analyses.

For RT difference score, the comparison between the full and the null model revealed a significant deviation (LRT: χ2 = 8.17, df = 3, P = 0.043; Table 4). The interaction term was not significant (χ2 = 1.88, df = 1, P = 0.170), so we removed it from the model. The final model indicated a significant effect of test type on RT difference score (LRT: χ2 = 6.10, df = 1, P = 0.014), with monkeys showing greater response-slowing to objects than to mask stimuli (estimate = -1.72, t = -2.73; Figure 4). We also found a significant change in RT difference scores as the sessions progressed (LRT: χ2 = 6.49, df = 1, P = 0.011; Table 4), with monkeys showing greatest response-slowing during the first three presentations of the test stimuli, which decreased over time (estimate = -0.48, t = -2.77; Figure 5). There was a marginally significant effect of age on RT difference scores (LRT: χ2 = 3.05, df = 1, P = 0.081; Table 4), revealing a trend for response-slowing being greater amongst younger animals. Results of the same analysis excluding the four outliers (reported in the “Materials and Methods” section) pointed in a similar direction.

TABLE 4
www.frontiersin.org

Table 4. Results of the general linear mixed model for the Study 2 (mask and object) examining the effect of the test predictors test type and freeze-fear score on the reaction time difference score.

FIGURE 4
www.frontiersin.org

Figure 4. (A) Reaction time difference score (RT test trial – RT control trial, in ms) for responses to masks and objects by n = 16 monkeys in Study 2. Individual means and model estimate shown. Circle size indicates number of trials. (B) RT difference scores for responses to faces (n = 12 monkeys in Study 1) are shown with model estimate for comparison purposes.

FIGURE 5
www.frontiersin.org

Figure 5. Mean ± SE reaction time difference score (RT test trial – RT control trial, in ms) for responses to masks and objects (combined) by n = 16 monkeys in Study 2. There were n = 18 test trials per stimulus category per monkey. Data are plotted as temporal sequence of ‘go’ responses made. Group means are shown. Circle size indicates number of trials. Smaller circles for trial to the right reflect the fact that many monkeys did not touch every test trial. Line represents model estimate.

Discussion

Developing standardized and sensitive tools that improve scientific outcomes while positively impacting animal welfare is a key 3Rs outcome. We proposed that touch-screen tasks sensitive to fearful temperament in humans, and presumably ethically non-problematic given their widespread use in human cognitive psychological research, could be adapted to assess fearful temperament in another primate species. We tested this hypothesis in male rhesus macaques, by comparing behavioral inhibition and response-slowing on a touch-screen task with ratings of fearful temperament obtained using a traditional method: the HIT. In the HIT, monkeys who showed the greatest degree of whole body freezing and fearful retreat behavior were assessed as having the most fearful temperament. In the present study, monkeys who were most fearful in the HIT also showed the greatest degree of behavioral inhibition (measured as withholding of response) during the touch-screen task when presented with pictures of an unknown conspecific with direct-gaze. The relationship between fearful temperament and behavioral inhibition of response was specific to conspecific faces with direct-gaze as we found no evidence for behavioral inhibition when pictures of a human mask or objects associated with veterinary and husbandry procedures were shown. To our knowledge this is the first study to directly assess the extent to which fearful temperament (as assessed in the HIT) is associated with behavioral inhibition of response during a touch-screen task. We propose that this touch-screen task, in the laboratory context, offers a more standardized and sensitive method for assessing fearful temperament than the traditional HIT.

Our finding for behavioral inhibition of response to direct-gaze faces by monkeys with more fearful temperament in Study 1 supports a large body of literature demonstrating a priority of processing effect for conspecific faces (Adolphs et al., 1996; Parr, 2011). Behavioral inhibition of response occurred to the direct-gaze faces, but not to the mask or objects, or the presumably neutral control stimulus (gray square). This finding suggests that behavioral inhibition to direct-gaze faces was driven by the negative emotional content of the face stimuli, and that the touch-screen task is sensitive to inhibition of response to threatening social stimuli. Direct eye-contact by an unknown male is a highly salient signal of dominance and social threat in rhesus macaques (Maestripieri, 1997). The lack of behavioral inhibition to presentations of the human mask suggests that behavioral inhibition is elicited by conspecific faces specifically, and not faces in general.

Our finding for response-slowing only to object stimuli in Study 2 highlights the need to establish the appropriate level analysis for any given species, captive setting and set of stimuli. Monkeys were slower to touch pictures of objects associated with husbandry and veterinary procedures relative to gray squares, and relative to a picture of the mask used during the HIT. This suggests that objects may have greater negative valence for the monkeys than the mask. It is also possible that this finding is an artifact of the use of a single picture of the mask leading to speeded habituation masking any initial inhibition or response-slowing.

There was evidence for habituation to negative stimuli over repeated trials in both studies. Behavioral inhibition of response to direct-gaze conspecific faces occurred most often during the first three presentations in Study 1, as did response-slowing for objects (and mask) in Study 2. Habituation to emotional cues is known to occur when stimuli are presented multiple times within a test session (Denny et al., 2014) and can present issues for analysis of data, especially when effects are small (Nanhoe-Mahabier et al., 2012). We included trial number as a control variable and random slope in our models to control for potential habituation effects of repeated presentations of test trials. We recommend maintaining this information in analyses by retaining some aspect of time or trial number as a control variable. An issue we are currently looking at in a separate study is the extent to which habituation across the course of a session masks patterns of affective responding, a consideration for experimental design in both the human and animal literatures (Nanhoe-Mahabier et al., 2012).

A direction for future research is to establish the sensitivity of the touch-screen task to state and trait affect, and to identify how the influence of the two on performance may be teased apart. Both Bethell et al. (2016) and Cronin et al. (2018) found response-slowing to direct-gaze faces in Macaca spp. during presumably negative emotional states (following a veterinary check, and during a noisy public event in a zoo), compared to presumably neutral emotional states in the absence of any known stressors. The current study differs methodologically from Cronin et al. (2018) who tested Japanese macaques in their social group and Bethell et al. (2016), who tested singly housed rhesus macaques. Our study population were temporarily separated from their group members for testing, a procedure which is a daily occurrence for experimental purposes and to which the monkeys had been habituated over time. It is not known to what extent this separation may still result in elevated stress for some individuals. Since the focus of the current study was not to test for changes in affective state, we did not manipulate, measure or control for current emotional state. Given the significant relationship between freeze-fear score and behavioral inhibition to direct-gaze faces, it is unlikely that state affect masked trait fearfulness in Study 1. It may even have enhanced it. Studies with humans indicate that behavioral inhibition on go/no-go tasks is greatest amongst clinical populations when patients are under stress (Mkrtchian et al., 2017). For example, participants diagnosed with negative mood disorders more accurately inhibit responding on a cognitive task when threatened with unpredictable shock, suggesting state stress enhances behavioral inhibition (Mkrtchian et al., 2017). Aylward et al. (2017), however, failed to find an effect of threat of unpredictable shock on behavioral inhibition in a non-clinical sample, indicating that behavioral inhibition under stress identifies clinical, but not sub-clinical, populations. We therefore might expect not to see behavioral inhibition in a (presumably) sub-clinical group of monkeys under baseline conditions. Anecdotally, the two monkeys (Bex and Zaz) who had been temporarily moved into singly housing prior to the start of Study 1 (and were therefore excluded from the analysis for Study 1) touched only one direct-gaze face between them (although both responded above criterion on control trials). Both had mid-range scores for fearful temperament, and a good level of performance during Study 2 when they were socially housed. It is therefore possible this result arose from a negative affective state associated with single housing or the events leading up to it, an interpretation in line with the findings of Bethell et al. (2016). Encouragingly both animals continued working throughout Study 1, as did all other monkeys, avoiding problems of a self-selecting sample. Throughout both studies only one monkey failed to reach criterion on control trials during testing (Fla, Study 2). Since this individual had the lowest freeze-fear score of all animals tested, and a high response rate during Study 1, it does not appear that this poor performance in Study 2 is due to temperament, but possibly due to transient extraneous factors not accounted for here. With trained animals in the laboratory context, the task proposed here has a high completion rate and is unlikely to be restricted to a self-selecting sample. Self-selection may be a consideration in other context such as zoos (e.g., Cronin et al., 2018).

Another future direction for research is to establish sensitivity of responses on the touch-screen task to physiological arousal. Monkeys who found the test stimuli most negative may also have experienced the greatest increases in arousal. Arousal has a non-linear effect on response speed, leading to both speeding and slowing of response depending on where on the arousal curve an individual is (Mendl, 1999). In human psychological research, stimulus valence effects are greatest when stimuli are shown in blocks containing stimuli of just one valence type, where cumulative carry-over effects on physiological arousal occur with repeated presentations (Bradley et al., 1996; Frings et al., 2010). These cumulative effects can be lost when stimuli of different valence are shown within the same block (Algom et al., 2004). We attempted to minimize cumulative arousal effects in the current study by including filler trials in which infants and fruits were shown, although we did not collect physiological data to validate any effect on arousal. Presenting stimuli in a block design with a single-valence shown in each block may reveal response-slowing where the effect to be detected is small and dependent on cumulative arousal.

Additional factors that may have influenced performance on the touch-screen task include mismatching effects (e.g., touch a negative stimulus to gain a positive reward, which has been shown to exacerbate the impact of transient emotion states on task performance (Raoult et al., 2017), and influence of attentional processes (Bar-Haim et al., 2007). For example, Aylward et al. (2017) found faster responses by human participants taking part in a computer task to fearful faces compared to happy faces, which was independent of affective state (threat of electric shock). The authors attributed this speeding of response to attentional capture by negative stimuli. Fox et al. (2001) were able to rule out attentional capture effects for response speed to targets following negative stimuli in their exogenous cueing task by adjusting the relative location of the negative stimuli and neutral targets. Adjusting the temporal and spatial synchrony of cues and targets can therefore help elucidate the relative contribution of different mechanisms underlying responses to cues presented during computer tasks. Furthermore, with the current cohort we did not have data available to allow us to account for latent variables such as relatedness, genotype, early rearing environment, age of removal from the mother, and social rank, all of which reflect the unique history of gene–environmental interactions for each animal (Würbel, 2002). These shape the development of fearful temperament and influence responses to social and negative stimuli in cognitive tasks (Jones et al., 1992; Lang et al., 2000; Buss et al., 2004; Rogers et al., 2008; Corcoran et al., 2012; Gottlieb and Capitanio, 2013; Coleman and Pierre, 2014).

The current study sheds light on previous work. Bethell et al. (2016) presented direct-gaze conspecific face stimuli to adult male M. mulatta for 60 s or until touched. In that study it was not possible to distinguish whether monkeys learned that touching a stimulus made it disappear, leading to faster responses in animals who found the stimuli aversive, but not too aversive to touch. In the current study, we inhibited learning that touching a stimulus made it disappear by shortening and fixing the stimulus presentation time to 3 or 1 s. A touch response in the current study therefore should more accurately reflect early emotional response to the stimulus independent of later executive processes that may have subsequently influenced decision to respond in Bethell et al. (2016).

There is a growing call for new technologies and automated systems for standardizing and refining methods across facilities (Buchanan-Smith, 2006; Prescott et al., 2017; Berger et al., 2018). We used a touch-screen apparatus with which monkeys were familiar having used it on a daily basis (Calapai et al., 2017) that was programmed with open source software2 to automatically collect data for two objective measures of response (proportion of touches and speed to touch). Familiarity with apparatus and reinforcement contingencies associated with working for rewards in laboratory settings should reduce stress compared with the more ambiguous context of the HIT. The use of pictorial stimuli (which can be manipulated in terms of emotional intensity and to incorporate facility-specific imagery) provides opportunity for increased sensitivity compared to the HIT. For example, in a stranger approach test with 3-year-old children, Buss et al. (2004) found that only children who exhibited fearful response in the mildest of four fearful contexts (stranger approach in which the child could move away and seek comfort from the mother) also showed increased salivary cortisol and were therefore characterized as having dysregulated fear. Here, conspecific faces with direct gaze met this criterion for three of the monkeys who showed highest levels of freeze and fear response during the HIT. Whether the touch-screen task could be adapted for use with younger monkeys (some groups conduct the HIT as standard at ∼107 days old: Capitanio, 2011) is unclear. Ultimately, the reliable analysis of individual differences in expression and regulation of emotion such as fearful temperament will require testing of multiple potential underlying mechanisms across multiple contexts.

In summary, the touch-screen task presented here with male rhesus macaques was sensitive to behavioral inhibition of response to negative conspecific faces, and slowing of responses to pictures of objects associated with husbandry and veterinary procedures. Behavioral inhibition to direct-gaze conspecific faces on the touch-screen task was greatest in monkeys who showed most freezing and fearful behaviors during the HIT, suggesting that the task, when run using highly salient negative picture stimuli, is sensitive to fearful temperament. It is possible the behavioral inhibition reflects an early and subtle pre-cursor component of the freeze response evident in the HIT. Altogether, we conclude that relatively simple touch-screen tasks like that presented here show promise for developing standardized and sensitive tests of temperament, negative affect and underlying mechanisms. Further work is needed to assess the reproducibility and generalizability of these findings across species and contexts.

Ethics Statement

This study complied with institutional guidelines on Animal Care and Use of the German Primate Center and was conducted in accordance with national and international guidelines on the use of primates in research including German Animal Protection Law, the European Union Directive 2010/63/EU on the Protection of Animals used for Scientific Purposes and the Society for Neuroscience Policies on the Use of Animals and Humans in Neuroscience Research. The animals used in this study were all highly accustomed to settings and scenarios experienced in the current study. All animals in this study were also participating in studies that require a governmental permit due to being animal experiments (the permit was issued by the responsible regional government office, Niedersaechsisches Landesamt fuer Verbraucherschutz und Lebensmittelsicherheit, LAVES, under the permit number 3392 42502-04-13/1100). These fall into the category of mild to moderate, according to the severity categorization of Annex VIII of the European Union’s directive 2010/63/EU on the protection of animals used for scientific purposes (see also Pfefferle et al., 2018). Additionally, the study was approved by Liverpool John Moores University Ethical Review Panel under permit number EB/20-184.

Author Contributions

EB, DP, and RB contributed to the conception and design of the study. LC, DP, and RB collected the data. DP and EB performed statistical analyses. Together all authors interpreted the data. EB wrote the first draft of the manuscript with DP writing sections of it. All authors contributed to the manuscript revision, read and approved the submitted version.

Funding

This study was supported by the European Cooperation in Science and Technology (COST) primTRAIN program (http://www.cost.eu/COST_Actions/ca/CA15131, COSTSTSM-CA15131-36153 assigned to EB and DP), the Leibniz-ScienceCampus Primate Cognition Incoming Grant (https://www.primate-cognition.eu/en/funding-measures/incoming-grants.html, assigned to DP), and the German Research Foundation (http://www.dfg.de/) Research Unit 2591 (Alexander Gail and Stefan Treue). Rhesus macaque images presented in this study were re-used from the grant PF 659/3-1 to DP provided by the German Research Foundation (http://www.dfg.de/).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We thank Prof. Dr. Stefan Treue and Prof. Dr. Alexander Gail for access to animals, support throughout the study and for useful feedback on the manuscript. We thank the reviewers for their insightful feedback. We also thank Amy Moffatt for help collecting the data and the DPZ animal care and veterinary staff for care of the animals.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2019.01051/full#supplementary-material

Footnotes

  1. ^ http://mworks-project.org
  2. ^ https://mworks.github.io/

References

Adolphs, R., Damasio, H., Tranel, D., and Damasio, A. R. (1996). Cortical systems for the recognition of emotion in facial expressions. J. Neurosci. 16, 7678–7687. doi: 10.1523/jneurosci.16-23-07678.1996

CrossRef Full Text | Google Scholar

Aiken, L. S., and West, S. G. (1991). Multiple Regression: Testing and Interpreting Interactions. Newbury Park, CA: Sage.

Google Scholar

Ainsworth, M. D. S., and Bell, S. M. (1970). Attachment, exploration, and separation: illustrated by the behavior of one-year-olds in a strange situation. Child Dev. 41, 49–67. doi: 10.1111/j.1467-8624.1970.tb00975.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Algom, D., Chajut, E., and Lev, S. (2004). A rational look at the emotional stroop phenomenon: a generic slowdown, not a stroop effect. J. Exp. Psychol.Gen. 133, 323–338. doi: 10.1037/0096-3445.133.3.323

PubMed Abstract | CrossRef Full Text | Google Scholar

Aylward, J., Valton, V., Goer, F., Mkrtchian, A., Lally, N., Peters, S., et al. (2017). The impact of induced anxiety on affective response inhibition. R. Soc. Open Sci. 4:170084. doi: 10.1098/rsos.170084

PubMed Abstract | CrossRef Full Text | Google Scholar

Baayen, R. H. (2008). Analyzing Linguistic Data. Cambridge: Cambridge University Press.

Google Scholar

Bar-Haim, Y., Lamy, D., Pergamin, L., Bakermans-Kranenburg, M. J., and Van Ijzendoorn, M. H. (2007). Threat-related attentional bias in anxious and nonanxious individuals: a meta-analytic study. Psychol. Bull. 133, 1–24. doi: 10.1037/0033-2909.133.1.1

PubMed Abstract | CrossRef Full Text | Google Scholar

Barr, D. J., Levy, R., Scheepers, C., and Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: keep it maximal. J. Mem. Lang. 68, 255–278. doi: 10.1016/j.jml.2012.11.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Bates, D., Machler, M., Bolker, B. M., and Walker, S. C. (2015). Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67, 1–48.

Google Scholar

Berger, M., Calapai, A., Stephan, V., Niessing, M., Burchardt, L., Gail, A., et al. (2018). Standardized automated training of rhesus monkeys for neuroscience research in their housing environment. J. Neurophysiol. 119, 796–807. doi: 10.1152/jn.00614.2017

PubMed Abstract | CrossRef Full Text | Google Scholar

Bethell, E. J., Holmes, A., MacLarnon, A., and Semple, S. (2016). Emotion evaluation and response slowing in a non-human primate: new directions for cognitive bias measures of animal emotion? Behav. Sci. (Basel) 6:2. doi: 10.3390/bs6010002

PubMed Abstract | CrossRef Full Text | Google Scholar

Blanchard, D. C., Griebel, G., Pobbe, R., and Blanchard, R. J. (2011). Risk assessment as an evolved threat detection and analysis process. Neurosci. Biobehav. Rev. 35, 991–998. doi: 10.1016/j.neubiorev.2010.10.016

PubMed Abstract | CrossRef Full Text | Google Scholar

Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., et al. (2009). Generalized linear mixed models: a practical guide for ecology and evolution. Trends Ecol. Evol. 24, 127–135. doi: 10.1016/j.tree.2008.10.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Bradley, M. M., Cuthbert, B. N., and Lang, P. J. (1996). Picture media and emotion: effects of a sustained affective context. Psychophysiology 33, 662–670. doi: 10.1111/j.1469-8986.1996.tb02362.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Buchanan-Smith, H. M. (2006). Primates in laboratories: standardisation, harmonisation, variation and science. ALTEX Altern. Anim. Exp. 23, 115–119.

Google Scholar

Buss, K. A., Davidson, R. J., Kalin, N. H., and Goldsmith, H. H. (2004). Context-specific freezing and associated physiological reactivity as a dysregulated fear response. Dev. Psychol. 40, 583–594. doi: 10.1037/0012-1649.40.4.583

PubMed Abstract | CrossRef Full Text | Google Scholar

Calapai, A., Berger, M., Niessing, M., Heisig, K., Brockhausen, R., Treue, S., et al. (2017). A cage-based training, cognitive testing and enrichment system optimized for rhesus macaques in neuroscience research. Behav. Res. Methods 49, 35–45. doi: 10.3758/s13428-016-0707-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Capitanio, J. P. (2011). Individual differences in emotionality: social temperament and health. Am. J. Primatol. 73, 507–515. doi: 10.1002/ajp.20870

PubMed Abstract | CrossRef Full Text | Google Scholar

Capitanio, J. P., Blozis, S. A., Snarr, J., Steward, A., and Mccowan, B. J. (2017). Do ”birds of a feather flock together” or do ”opposites attract”? Behavioral responses and temperament predict success in pairings of rhesus monkeys in a laboratory setting. Am. J. Primatol 79, 1–11. doi: 10.1002/ajp.22464

PubMed Abstract | CrossRef Full Text | Google Scholar

Carlsson, H. E., Schapiro, S. J., Farah, I., and Hau, J. (2004). Use of primates in research: a global overview. Am. J. Primatol. 63, 225–237. doi: 10.1002/ajp.20054

PubMed Abstract | CrossRef Full Text | Google Scholar

Carter, A. J., Marshall, H. H., Heinsohn, R., and Cowlishaw, G. (2012). How not to measure boldness: novel object and antipredator responses are not the same in wild baboons. Anim. Behav. 84, 603–609. doi: 10.1016/j.anbehav.2012.06.015

CrossRef Full Text | Google Scholar

Clark, F. E. (2017). Cognitive enrichment and welfare: current approaches and future directions. Anim. Behav. Cogn. 4, 52–71. doi: 10.12966/abc.05.02.2017

CrossRef Full Text | Google Scholar

Coleman, K., Lutz, C. K., Worlein, J. M., Gottlieb, D. H., Peterson, E., Lee, G. H., et al. (2017). The correlation between alopecia and temperament in rhesus macaques (Macaca mulatta) at four primate facilities. Am. J. Primatol. 79, 1–10. doi: 10.1002/ajp.22504

PubMed Abstract | CrossRef Full Text | Google Scholar

Coleman, K., and Novak, M. A. (2017). Environmental enrichment in the 21st century. ILAR J. 58, 295–307. doi: 10.1093/ilar/ilx008

PubMed Abstract | CrossRef Full Text | Google Scholar

Coleman, K., and Pierre, P. J. (2014). Assessing anxiety in nonhuman primates. ILAR J. 55, 333–346. doi: 10.1093/ilar/ilu019

PubMed Abstract | CrossRef Full Text | Google Scholar

Corcoran, C. A., Pierre, P. J., Haddad, T., Bice, C., Suomi, S. J., Grant, K. A., et al. (2012). Long-term effects of differential early rearing in rhesus macaques: behavioral reactivity in adulthood. Dev. Psychobiol. 54, 546–555. doi: 10.1002/dev.20613

PubMed Abstract | CrossRef Full Text | Google Scholar

Cronin, K. A., Bethell, E. J., Jacobson, S. L., and Ross, S. R. (2018). evaluating mood changes in response to anthropogenic noise with a response-slowing task in three species of zoo-housed primates. Anim. Cogn. 5, 209–221. doi: 10.26451/abc.05.02.03.2018

CrossRef Full Text | Google Scholar

Denny, B. T., Jin, F., Xun, L., Guerreri, S., Mayson, S. J., Rimsky, L., et al. (2014). Insula-amygdala functional connectivity is correlated with habituation to repeated negative images. Soc. Cogn. Affect. Neurosci. 9, 1660–1667. doi: 10.1093/scan/nst160

PubMed Abstract | CrossRef Full Text | Google Scholar

Dobson, A. J. (2002). An Introduction to Generalized Linear Models. Boca Raton: Chapman and Hall.

Google Scholar

Field, A. (2005). Discovering Statistics using SPSS. London: Sage.

Google Scholar

Forstmeier, W., and Schielzeth, H. (2011). Cryptic multiple hypotheses testing in linear models: overestimated effect sizes and the winner’s curse. Behav. Ecol. Sociobiol. 65, 47–55. doi: 10.1007/s00265-010-1038-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Fox, E., Russo, R., Bowles, R., and Dutton, K. (2001). Do threatening stimuli draw or hold visual attention in subclinical anxiety? J. Exp. Psychol. Gen. 130, 681–700. doi: 10.1037/0096-3445.130.4.681

CrossRef Full Text | Google Scholar

Fox, J., and Weisberg, S. (2011). A R Companion to Applied Regression. Thousand Oaks, CA: Sage.

Google Scholar

Friard, O., and Gamba, M. (2016). BORIS: a free, versatile open-source event-logging software for video/audio coding and liver observations. Methods Ecol. Evol. 7, 1324–1330.

Frings, C., Englert, J., Wentura, D., and Bermeitinger, C. (2010). Decomposing the emotional stroop effect. Q. J. Exp. Psychol. 63, 42–49. doi: 10.1080/17470210903156594

PubMed Abstract | CrossRef Full Text | Google Scholar

Gosling, S. D., and John, O. P. (1999). Personality dimensions in nonhuman animals: a cross-species review. Curr. Dir. Psychol. Sci. 8, 69–75. doi: 10.1111/1467-8721.00017

CrossRef Full Text | Google Scholar

Gottlieb, D. H., and Capitanio, J. P. (2013). Latent variables affecting behavioral response to the human intruder test in infant rhesus macaques (Macaca mulatta). Am. J. Primatol. 75, 314–323. doi: 10.1002/ajp.22107

PubMed Abstract | CrossRef Full Text | Google Scholar

Holmes, A., Bradley, B. P., Kragh Nielsen, M., and Mogg, K. (2009). Attentional selectivity for emotional faces: evidence from human electrophysiology. Psychophysiology 46, 62–68. doi: 10.1111/j.1469-8986.2008.00750.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Hommer, R. E., Meyer, A., Stoddard, J., Connolly, M. E., Mogg, K., Bradley, B. P., et al. (2014). Attention bias to threat faces in severe mood dysregulation. Depress. Anxiety 31, 559–565. doi: 10.1002/da.22145

PubMed Abstract | CrossRef Full Text | Google Scholar

Jennings, M., Prescott, M. J., and Members of the Joint Working Group on Refinement (2009). Refinements in husbandry, care and common procedures for non-human primates: ninth report of the BVAAWF/FRAME/RSPCA/UFAW joint working group on refinement. Lab. Anim. 43, 1–47. doi: 10.1258/la.2008.007143

PubMed Abstract | CrossRef Full Text | Google Scholar

Jones, R. B., Satterlee, D. G., and Ryder, F. H. (1992). Fear and distress in Japanese quail chicks of two lines genetically selected for low or high adrenocortical response to immobilization stress. Horm. Behav. 26, 385–393. doi: 10.1016/0018-506x(92)90008-j

CrossRef Full Text | Google Scholar

Kalin, N. H. (2003). Nonhuman primate studies of fear, anxiety, and temperament and the role of benzodiazepine receptors and GABA systems. J. Clin. Psychiatry 64, 41–44.

PubMed Abstract | Google Scholar

Kalin, N. H., Larson, C., Shelton, S. E., and Davidson, R. J. (1998). Asymmetric frontal brain activity, cortisol, and behavior associated with fearful temperament in rhesus monkeys. Behav. Neurosci. 112, 286–292. doi: 10.1037//0735-7044.112.2.286

CrossRef Full Text | Google Scholar

Kalin, N. H., and Shelton, S. E. (1989). Defensive behaviors in infant rhesus monkeys: environmental cues and neurochemical regulation. Science 243, 1718–1721. doi: 10.1126/science.2564702

PubMed Abstract | CrossRef Full Text | Google Scholar

Kalin, N. H., and Shelton, S. E. (2003). Nonhuman Primate Models to Study Anxiety, Emotion Regulation, and Psychopathology. Ann. N. Y. Acad. Sci. 1008, 189–200. doi: 10.1196/annals.1301.021

CrossRef Full Text | Google Scholar

Kalin, N. H., Shelton, S. E., and Davidson, R. J. (2004). The role of the central nucleus of the amygdala in mediating fear and anxiety in the primate. J. Neurosci. 24, 5506–5515. doi: 10.1523/jneurosci.0292-04.2004

CrossRef Full Text | Google Scholar

Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., and Altman, D. G. (2010). Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. PLoS Biol. 8:e1000412. doi: 10.1371/journal.pbio.1000412

PubMed Abstract | CrossRef Full Text | Google Scholar

Lang, P. J., Davis, M., and Öhman, A. (2000). Fear and anxiety: animal models and human cognitive psychophysiology. J. Affect. Disord. 61, 137–159. doi: 10.1016/s0165-0327(00)00343-8

CrossRef Full Text | Google Scholar

Lewis-Morrarty, E., Degnan, K. A., Chronis-Tuscano, A., Pine, D. S., Henderson, H. A., and Fox, N. A. (2015). Infant attachment security and early childhood behavioral inhibition interact to predict adolescent social anxiety symptoms. Child Dev. 86, 598–613. doi: 10.1111/cdev.12336

PubMed Abstract | CrossRef Full Text | Google Scholar

Maestripieri, D. (1997). Gestural communication in macaques: usage and meaning of nonvocal signals. Evol. Commun. 1, 193–222. doi: 10.1075/eoc.1.2.03mae

CrossRef Full Text | Google Scholar

McCullagh, P., and Nelder, J. A. (1996). Generalized Linear Models. London: Chapman and Hall.

Google Scholar

Mendl, M. (1999). Performing under pressure: stress and cognitive function. Appl. Anim. Behav. Sci. 65, 221–244. doi: 10.1016/s0168-1591(99)00088-x

CrossRef Full Text | Google Scholar

Mkrtchian, A., Aylward, J., Dayan, P., Roiser, J. P., and Robinson, O. J. (2017). Modeling avoidance in mood and anxiety disorders using reinforcement learning. Biol. Psychiatry 82, 532–539. doi: 10.1016/j.biopsych.2017.01.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Mogg, K., Holmes, A., Garner, M., and Bradley, B. P. (2008). Effects of threat cues on attentional shifting, disengagement and response slowing in anxious individuals. Behav. Res. Ther. 46, 656–667. doi: 10.1016/j.brat.2008.02.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Nanhoe-Mahabier, W., Allum, J. H. J., Overeem, S., Borm, G. F., Nijhuis, L. B. O., and Bloem, B. R. (2012). First trial reactions and habituation rates over successive balance perturbations in Pakinson’s disease. Neuroscience 217, 123–129. doi: 10.1016/j.neuroscience.2012.03.064

PubMed Abstract | CrossRef Full Text | Google Scholar

NC3Rs. (2015). Our Vision 2015-2025, National Centre for the Replacement Refinement and Reduction of Animals in Research. Available: https://www.nc3rs.org.uk/sites/default/files/documents/Corporate_publications/NC3Rs20Our20Vision202015-2025.pdf (accessed October 10, 2015).

Parr, L. A. (2011). The evolution of face processing in primates. Phils. Trans. R. Soc. B Biol. Sci. 366, 1764–1777. doi: 10.1098/rstb.2010.0358

PubMed Abstract | CrossRef Full Text | Google Scholar

Pfefferle, D., Plümer, S., Burchardt, L., Treue, S., and Gail, A. (2018). Assessment of stress responses in rhesus macaques (Macaca mulatta) to daily routine procedures in system neuroscience based on salivary cortisol concentrations. PLoS One 13:e0190190. doi: 10.1371/journal.pone.0190190

PubMed Abstract | CrossRef Full Text | Google Scholar

Prescott, M. J., Langermans, J. A., and Ragan, I. (2017). Applying the 3Rs to non-human primate research: barriers and solutions. Drug Discov. Today Dis. Models 23, 51–56. doi: 10.1016/j.ddmod.2017.11.001

CrossRef Full Text | Google Scholar

Quinn, G., and Keough, M. (2002). Experimental Design and Data Analysis for Biologists. Cambridge: Cambridge University Press.

Google Scholar

R Core Team (2017). R: A language and Environment for Statistical Computing. R Foundation for Statistical Computing. Vienna: R Core Team.

Google Scholar

Raoult, C. M. C., Moser, J., and Gygax, L. (2017). Mood as cumulative expectation mismatch: a test of theory based on data from non-verbal cognitive bias tests. Front. Psychol. 8:2197. doi: 10.3389/fpsyg.2017.02197

PubMed Abstract | CrossRef Full Text | Google Scholar

Rogers, J., Shelton, S. E., Shelledy, W., Garcia, R., and Kalin, N. H. (2008). Genetic influences on behavioral inhibition and anxiety in juvenile rhesus macaques. Genes Brain Behav. 7, 463–469. doi: 10.1111/j.1601-183x.2007.00381.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Russell, W. M. S., Burch, R. L., and Hume, C. W. (1959). The Principles of Humane Experimental Technique. London: Methuen.

Google Scholar

Schielzeth, H. (2010). Simple means to improve the interpretability of regression coefficients. Methods Ecol. Evol. 1, 103–113. doi: 10.1111/j.2041-210x.2010.00012.x

CrossRef Full Text | Google Scholar

Schielzeth, H., and Forstmeier, W. (2009). Conclusions beyond support: overconfident estimates in mixed models. Behav. Ecol. 20, 416–420. doi: 10.1093/beheco/arn145

PubMed Abstract | CrossRef Full Text | Google Scholar

Tabachnick, B., and Fidell, L. (2001). Using Multivariate Statistics. Boston: Allyn and Bacon.

Google Scholar

Van Hulle, C. A., Moore, M. N., Lemery-Chalfant, K., Goldsmith, H. H., and Brooker, R. J. (2017). Infant stranger fear trajectories predict anxious behaviors and diurnal cortisol rhythm during childhood. Dev. Psychopathol. 29, 1119–1130. doi: 10.1017/S0954579417000311

PubMed Abstract | CrossRef Full Text | Google Scholar

Walsh, D. M., Stratton, S. C., Harvey, F. J., Beresford, I. J. M., and Hagan, R. M. (1995). The anxiolytic-like activity of GR159897, a non-peptide NK2 receptor antagonist in rodent and primate models of anxiety. Psychopharmacology 121, 186–191. doi: 10.1007/bf02245629

PubMed Abstract | CrossRef Full Text | Google Scholar

Würbel, H. (2002). Behavioral phenotyping enhanced–beyond (environmental) standardization. Genes Brain Behav. 1, 3–8. doi: 10.1046/j.1601-1848.2001.00006.x

CrossRef Full Text | Google Scholar

Zuur, A., Ieno, E., and Elphick, C. (2010). A protocol for data exploration to avoid common statistical problems. Methods Ecol. Evol. 1, 3–14. doi: 10.1111/j.2041-210x.2009.00001.x

CrossRef Full Text | Google Scholar

Keywords: Human Intruder Test, behavioral inhibition, response-slowing, welfare, rhesus macaque, dysregulated fear, refinement, 3Rs

Citation: Bethell EJ, Cassidy LC, Brockhausen RR and Pfefferle D (2019) Toward a Standardized Test of Fearful Temperament in Primates: A Sensitive Alternative to the Human Intruder Task for Laboratory-Housed Rhesus Macaques (Macaca mulatta). Front. Psychol. 10:1051. doi: 10.3389/fpsyg.2019.01051

Received: 20 December 2018; Accepted: 24 April 2019;
Published: 14 May 2019.

Edited by:

Thomas Bugnyar, University of Vienna, Austria

Reviewed by:

Kristine Coleman, Oregon Health & Science University, United States
Zhanna Reznikova, Institute of Systematics and Ecology of Animals (RAS), Russia
Sonja Elena Koski, University of Helsinki, Finland

Copyright © 2019 Bethell, Cassidy, Brockhausen and Pfefferle. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Emily J. Bethell, E.J.Bethell@ljmu.ac.uk

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.