METHODS article

Front. Behav. Neurosci., 18 January 2021

Sec. Individual and Social Behaviors

Volume 14 - 2020 | https://doi.org/10.3389/fnbeh.2020.606900

A Customizable Low-Cost System for Massively Parallel Zebrafish Behavioral Phenotyping

  • 1. Biozentrum, University of Basel, Basel, Switzerland

  • 2. Department of Neurobiology, University of Alabama at Birmingham, Birmingham, AL, United States

  • 3. Center for Brain Science, Harvard University, Cambridge, MA, United States

Abstract

High-throughput behavioral phenotyping is critical to genetic or chemical screening approaches. Zebrafish larvae are amenable to high-throughput behavioral screening because of their rapid development, small size, and conserved vertebrate brain architecture. Existing commercial behavioral phenotyping systems are expensive and not easily modified for new assays. Here, we describe a modular, highly adaptable, and low-cost system. Along with detailed assembly and operation instructions, we provide data acquisition software and a robust, parallel analysis pipeline. We validate our approach by analyzing stimulus response profiles in larval zebrafish, confirming prepulse inhibition phenotypes of two previously isolated mutants, and highlighting best practices for growing larvae prior to behavioral testing. Our new design thus allows rapid construction and streamlined operation of many large-scale behavioral setups with minimal resources and fabrication expertise, with broad applications to other aquatic organisms.

Introduction

High-throughput behavioral tracking offers great potential for large-scale mutant phenotyping (Thyme et al., ) and drug screening (MacRae and Peterson, ). Indeed, drug screens have revealed conserved signaling pathways that regulate complex behaviors in both zebrafish and mammals (Kokel et al., ; Rihel et al., ; Leung and Mourrain, ). Furthermore, larval zebrafish maintained in 96-well plate format execute diverse behaviors including prepulse inhibition (Burgess and Granato, ), sleep (Chiu et al., ), seizures (Griffin et al., ), prey consumption (Jordi et al., ), and responses to visual (Randlett et al., ), acoustic (Wolman et al., ), or thermal stimuli (Chiu et al., ). Many researchers use commercial systems to test these behaviors, but such solutions are limited in their adaptability and prohibitively costly when many parallel systems are required.

For example, two of the most commonly used commercial systems are the DanioVision from Noldus and the ZebraBox from ViewPoint. Without add-ons, these systems provide only baseline movement tracking (i.e., activity, swimming bursts, thigmotaxis) and LED light control. While add-ons such as high-speed cameras, acoustic stimulation, and temperature control are available, they greatly increase system cost. Furthermore, users are often limited to commercially provided analysis code and data processing formats.

To bypass these challenges, we present building plans for a modular behavioral testing setup (Figure 1A), together with software for data acquisition and analysis. Our new design significantly extends systems previously validated in a large-scale mutant screen (Thyme et al., ), with more precise control over a broader range of assays and greater ease of construction. This system includes most of the assays of commercially available solutions and easily accommodates additional modules. Our analysis software utilizes a high-performance computing cluster for parallel processing of multi-day datasets with hundreds of user-defined events. Additionally, we outline best experimental practices for yielding consistent and reliable behavioral data. This fully customizable and modular setup can be easily adapted as new behavioral assays are published, significantly lowering barriers to large-scale phenotyping approaches.

Figure 1

Materials and Methods

Materials

All components and costs are described in Supplementary Material Table 1, and all schematics are included in FabricationFiles (Supplementary Material Data Sheet 2). While access to a laser cutter and 3D printer substantially decreases cost and time of construction, online manufacturing websites can easily produce equivalent parts (see Supplementary Material Data Sheet 1).

Box Assembly

Supplementary Material describes all assembly steps. The setup housing consists of a light-insulated enclosure, a camera to track fish motion, and a computer/electronics setup to deliver stimuli (Figure 1A). The enclosure was laser-cut from high-density polyethylene (HDPE) and fastened with 80/20 rails (Figure 1B).

The enclosure contains a white LED panel to deliver ambient light or stimuli, an infrared (IR) light to visualize animals, and a 3D-printed fish plate holder with a mounted acoustic transducer (Figure 1B). The white LED panel is mounted on an acrylic shelf and illuminates fish from below, while the IR light rests behind and reflects off the white light panel. Fish were detected with a Grasshopper3 camera (FLIR Systems) and a 50 mm fixed focal length lens with an IR filter.

Data Acquisition

See Supplementary Material (Data Sheet 1) for detailed operation instructions.

Computer Hardware

The setup was operated using a standard desktop computer and custom LabVIEW software (Supplementary Material Data Sheet 3). Minimum hardware requirements for the most computationally demanding assay (acoustic habituation; 1-s movies at 285 frames-per-second [fps] acquired every 2 s) were 16.0 GB RAM, an Intel Core i7-9700 processor, Windows 10, and a 1 TB Solid-State Drive. For those who do not have access to a full LabVIEW license, a compiled executable can be provided upon request. Running the executable will require a nominal license fee for the National Instruments Vision Development Tools package.

Stimulus Delivery and Data Collection

Acoustic and visual stimuli were controlled by a circuit board that communicates between LabVIEW software and system devices (Figure 2A). A Teensy 3.6 microcontroller and custom Arduino script relays stimulus command strings to LabVIEW (Figure 2B). Each “command string” specifies stimulus parameters such as amplitude (a), frequency (f), duration (d), and delay times (D) (full list in Supplementary Material Data Sheet 1). The microcontroller then sends voltage changes to the surface transducer or LED light panel to produce stimuli. The “command ID” (Figure 2B) specifies the LabVIEW event type, such as high-speed movie acquisition during stimulus presentation.

Figure 2

To run an experiment, users (1) construct an events file (Supplementary Material Data Sheet 3) with desired command strings, (2) designate regions of interest (ROIs) using a separate LabVIEW script (Generate ROIs.vi) (Figure 2C), which generates an ROI binary data file (rois) and ROI string text file (rois_string) (Supplementary Material Data Sheet 3). ROIs can match many different multi-well plate formats. (3) Select the events file, the ROI binary data file, and a png image of the plate using the LabVIEW graphical user interface (GUI) (Figure 2D). Users also define data output names and folders. See Supplementary Material Data Sheet 1 for detailed setup instructions. The ROI string text file is used in later stages of the analysis.

30 fps data is collected for the duration of the experiment in two formats: the change in pixels between each frame within each ROI, and the coordinates of the centroid of each fish in each ROI (Slow-speed data, Figure 2E). User-defined LabVIEW events trigger acquisition of one-second movies at 285 fps (high-speed data). LabVIEW can also trigger acquisition of 30 fps movies of desired length.

Data Analysis Software

Our analysis pipeline (Figure 3) is based in the Python programming language. All analyses were performed on a high-performance computing (HPC) cluster due to vastly increased parallel processing capacity. LabVIEW generates slow-speed motion (delta pixels) and centroid (coordinates) data, while our Python scripts extract motion and centroid from high-speed data (Figure 3A). As in LabVIEW, a centroid for each fish is identified in each ROI to determine coordinates. Our typical behavior run produces close to one thousand high-speed movies (784 in example run), making parallel processing advantageous at this tracking step, particularly if comparing multiple genotypes or analyzing data from multiple experiments. However, all scripts are compatible with local analysis on a single core and can be adapted to parallel processing environments other than HPC. Tracking of 784 movies takes <1.5 h on a standard iMac (vs. <5 min on the HPC cluster). Anaconda3 and OpenCV must be installed. Scripts for analysis of the tracked data have been extensively profiled for efficient analysis of 3 days of movement data and hundreds of high-speed movies. Each analysis run takes between 1.5 and 3.5 h on a single core, depending on the number of animals. The total size of a run is ~20 GB prior to analysis, which expands to 60–120 GB depending on the number of groups compared, due to the thousands of graphs generated. Storage needs can be reduced by producing or saving graphs only for measures with statistically significant differences.

Figure 3

Input data from slow- and high-speed tracking is processed to generate numerous measurements and output graphs (Figure 3B) ranging from classic behaviors such as sleep bouts and waking activity (Chen et al., ) to recently published observations such as turn angle preference during dark flash response (Horstick et al., ) (Python/examplefiles/BehavioralMetrics.xlsx and Python/PlotParameters) (Supplementary Material Data Sheet 3). A Fish object is created for each animal and contains all associated slow- and high-speed data as well as genotype. Slow-speed data is converted into movement bouts calculated from both motion data and centroid data. Metrics such as frequency, velocity, and fraction of time in well-center are calculated for each bout and binned based on time (such as average velocity / 10 min). High-speed data is processed based on the type of event and the parameters of the event string. Identification of an event response depends on modality (visual, acoustic) and the time delays in the string. Metrics analogous to bout properties are then calculated for the response. High-speed and binned slow-speed data are returned to the Fish object as ProcessedData objects, which are then used to generate graphs according to user-defined event sections. The event sections are specified in the sections file, which segments the behavior run into time windows for different assays. For example, an acoustic habituation assay would be analyzed separately from the prepulse inhibition assay. Event sections may also correspond to different times of the run such as night or day, and need not include high-speed events. Sections without high-speed events are referred to as “time” sections. An example sections file is included in the Supplementary Software (Python/sectionsfile) in Supplementary Material Data Sheet 3. Data and statistics are saved and a graph is generated for every combination of an EventSections object and ProcessedData object. A Kruskal-Wallis one-way ANOVA is calculated for every metric, and a linear mixed model (Thyme et al., ) is also calculated for baseline data with a time component. The code is also available on GitHub (https://github.com/sthyme/ZebrafishBehavior) and will be updated as improvements are made.

Assays

The most common multi-well larval zebrafish assays are based on acoustic and visual stimulation, utilizing the surface transducer and the LED light panel. These include responses to increased light or decreased light (dark flash), dark flash habituation, acoustic responses and thresholds, prepulse inhibition, and acoustic habituation. Our setup can test responses to a broad range of acoustic (tones of varying frequency, duration, wave-form, and amplitude delivered by surface transducer), visual (whole-field luminance changes such as dark or light flashes), and thermal stimuli (cooling or heating with a water circulation system; see Supplementary Material Data Sheet 1), and can be further modified for additional assays. The design also includes a mini-projector underneath the fish plate, which can present user-defined movies such as moving gratings to induce the optomotor response (Figure 4) (Naumann et al., ). Movies are presented through LabVIEW via the VLC media player (using movie file paths instead of command strings). Supplementary Software (Python/OMR) in Supplementary Material Data Sheet 3 includes Python scripts to generate gratings and example movies. Code to track multiple animals was completed with a custom script (http://github.com/docviv/behavior-scripts) based on an algorithm adapted from (Bolton et al., ).

Figure 4

To test arousal threshold (Figure 5), we delivered acoustic (20 ms, 625 Hz, square wave-form) or dark flash (1 s) visual stimuli at 12 different intensities in separate experiments: acoustic = a0.0005, a0.001, a0.003, a0.0075, a0.01, a0.03, a0.06, a0.075, a0.1, a0.3, a0.5, a1, visual = b245, b240, b230, b220, b210, b200, b175, b150, b125, b100, b50, b0, with baseline light = b250. Supplementary Figure 16 (Data Sheet 1) summarizes the corresponding decibel and lux values. 30-50 total trials of each intensity were administered in randomized order at 2 min intervals. Other experiments for mutant and wild-type animals correspond to the event strings in the supplemental events file in Supplementary Material. Stimulus responses were classified based on threshold values for movement distance (0.9 pixels), pixel change (3.0), and the number of frames for the distance and the delta pixel measures (respectively, 2 and 3). Users can adjust these parameters via input options in processmotiondata.py (Supplementary Material Data Sheet 3). We also separated bulk responses with movement filters to classify putative C-bends (acoustic startle response) and O-bends (dark flash response). For C-bends, we filtered based on cumulative delta pixels and velocity of the response, as previous studies indicate that short-latency escapes have higher velocity than other escape-like responses (Burgess and Granato, ). For O-bends, we filtered based on response time and the sum of heading angles in the response, based on previous studies measuring bend amplitude (Randlett et al., ). The O-bend filter was validated using dark flash data in Figure 5, where O-bends should not occur in the absence of stimulus.

Figure 5

Zebrafish Husbandry

All zebrafish were housed in the Zebrafish Research Facility of the University of Alabama at Birmingham and experiments were approved under protocol number IACUC-21744 (UAB Institutional Animal Care and Use Committee; Birmingham, Alabama). All crosses were derived from a single parental pair (mainly Ekkwill strain) to minimize genetic background differences. Arousal threshold assays were conducted in a mixed TL/AB background. Larvae were grown in 150 × 15 mm petri dishes with standard methylene blue water, at a density of <150 fish per plate. Animals were maintained at 28°C and a 14 h/10 h light/dark cycle. Behavioral experiments were conducted on the same light/dark cycle. Dead material and debris were removed twice before 4 days post-fertilization (dpf) (afternoons of day 0 and day 2). All behavioral assays were conducted on zebrafish larvae 4–7 dpf. Zebrafish of any age can be monitored in this setup with an appropriate holding chamber.

Zebrafish Sample Processing

Only healthy larvae with normal swim bladder morphology were included in experiments. Larvae were arrayed in 96-well plates (E&K Scientific Cat#2074, 0.7 mL/square well volume) in standard methylene blue water. The plate was placed in an ice-water bath until movement abated and sealed with an oxygen-permeable film (Thermo Fisher Scientific Cat#4311971) to eliminate water evaporation during multi-day experiments (Data Sheet 1: Supplementary Figures 17, 18). Sealing is essential to long-term (>16 h) experiments but incompatible with drug delivery. Accordingly, previous drug screens for sleep modulators periodically refilled evaporated water (Rihel et al., ). Sealed plates were placed into the behavior box and secured tightly (screw in one corner) to prevent movement due to the surface transducer. A minimum time of 1 h between plate sealing and conducting assays is recommended, to allow the larvae to recover from the cooling step and habituate to the environment. Our typical assay includes a 5–7 h break, as we load the larvae into the boxes on the afternoon of 4 dpf and analyze data starting at 11 PM. Temperature inside the setup ranged from 29.5 to 30.5°C (measured with a wireless Temp Stick), while room temperature was maintained at 23°C. For mutant experiments, larvae were genotyped by (1) noting all dead or unhealthy animals, (2) cooling plate on ice until movement ceased, (3) removing water in wells, (4) immersing in sodium hydroxide and transferring to a PCR plate for DNA extraction and amplification.

Results

Precise Stimulus Control

Previous versions of our setup used two solenoid tappers and a custom white LED array to deliver acoustic and visual stimuli, respectively (Thyme et al., ). Stimulus intensity was inconsistent across setups due to variable construction. For example, solenoid tappers delivered limited and inconsistent tap strengths due to variable height alignment and spring properties, and suffered from artifacts such as inadvertent double or triple tapping (data not shown). The single mounted surface transducer now allows consistent and fine control over a broad range of stimulus durations, voltages, waveforms, and frequencies. Likewise, the new white LED panels deliver consistent luminance across a broad range across setups. We include a simple protocol to calibrate and standardize light levels using a photodiode (see Supplementary Material Data Sheet 1). To validate these modifications, we monitored larval zebrafish responses to acoustic and dark flash stimuli of variable intensities during day and night. By calculating “dose-response” curves for each type of stimulus, we determined arousal threshold, defined as stimulus strength generating half-maximal response probability (Figure 5). Larvae exhibited significantly higher arousal threshold during night relative to day (Figure 5A, top; night threshold = 31.43, day threshold = 13.17). Acoustic stimulus response probabilities did not differ between fish positioned proximally or distally to the transducer, indicating consistent stimulus delivery across the 96-well plate (Figure 5A, bottom; proximal threshold = 15.19, distal threshold = 12.57). While maximal dark flash responses matched previously reported levels (Figure 5B) (Woods et al., ), we observed improved maximal responses to acoustic stimuli relative to previous assays using solenoids (Lee et al., ; Singh et al., ). Our modifications thus accommodate previously challenging assays and offer improved standardization.

Mutant Prepulse Inhibition Phenotypes

We previously demonstrated (Thyme et al., ) that mutants for the schizophrenia risk genes atxn7 and sbno1 (Schizophrenia Working Group of the Psychiatric Genomics Consortium, ; Girard et al., ) exhibit defects in prepulse inhibition (PPI), a sensory-motor gating phenomenon in which a weak prepulse stimulus suppresses an immediately following strong stimulus response. In zebrafish, PPI manifests in response frequency and/or response magnitude. Because previous experiments relied on solenoid tappers, we tested whether the surface transducer recapitulates the PPI assay and phenotypes. Indeed, atxn7 and sbno1 mutants both exhibited decreased PPI relative to sibling controls as previously observed (Figure 6). To further optimize PPI stimulus conditions, we tested multiple frequencies and inter-stimulus intervals (Data Sheet 1: Supplementary Figure 19) and selected 1,000 and 1,400 Hz for further testing in mutants, for which randomly interspersed PPI and control stimuli were separated by 3 min. Atxn7 (Figures 6A,B) and sbno1 (Figures 6C,D) mutants exhibited increased response frequency and magnitude relative to sibling controls with 1,000 Hz stimuli but not with 1,400 Hz stimuli. These results indicate that PPI phenotypes can vary according to acoustic stimulation frequency.

Figure 6

Wild Type Comparisons

While commonly used wild-type zebrafish strains exhibit substantial genetic diversity (Guryev et al., ; Brown et al., ), few studies explicitly define optimal growth and husbandry conditions that minimize possibly resultant behavioral variability.

As a first step to defining important parameters, we assessed three different conditions on larval zebrafish behavior. (1) To compare separately reared larvae, we divided sibling larvae into two dishes at identical density (Figure 7A). (2) To assess effects of density, we compared sibling larvae reared in two dishes of high or low density. (3) To compare non-siblings, we raised different clutches at identical densities. For each experiment, we also compared within each experimental group as a control and interleaved animals from each condition in the 96-well plate to minimize possible positional effects (Figure 7B).

Figure 7

To estimate behavioral differences, we calculated strictly standardized mean difference (SSMD) values across all behavioral parameters (SSMD of 0 indicates no effect). Growing larvae in separate dishes or at different densities did not affect behavior, as demonstrated by largely overlapping SSMD distributions. However, larvae from different clutches exhibited significantly divergent SSMD distributions relative to control within-clutch comparisons (Figure 8A). For example, non-sibling larvae exhibited significantly different spontaneous movement frequency and dark flash response displacement, in contrast to siblings raised at identical or different densities (Figure 8B). Replicates of non-sibling comparisons generated greater numbers of p-values < 0.05 and more divergent kernel density estimate peaks relative to other comparisons (Figure 8C). These results highlight the importance of comparing behavioral phenotypes within the same clutch.

Figure 8

Discussion

The setup described above can test diverse zebrafish behaviors at high throughput and with minimal equipment and cost. In addition to baseline motion parameters, the system can assay prepulse inhibition (Figure 6) and responses to acoustic, visual, and thermal stimuli (Figure 5 and data not shown). We also incorporate a mini-projector to test additional visual behaviors such as the optomotor response (Figure 4). Together with different multi-well formats (such as 6-well plates with larger wells), our setup can accommodate more sophisticated visual assays including looming stimuli (Temizer et al., ; Marques et al., ), approach-avoidance to prey-predator (Barker and Baier, ), and decision-making based on dot coherence (Bahl and Engert, ). Because many components are commercially available, multiple boxes can be completely assembled within 2 days.

Our modular hardware design supports rapid adaptation for additional assays with adult animals or arena shapes beyond 96-well plate format. Modified camera/lens configurations can produce different resolutions or acquisition speeds. The circuit board design includes multiple BNC connectors capable of triggering or sampling from other devices. For example, these connectors can support optogenetic experiments (Oikonomou et al., ) as in the DanioVision system, or deliver electric shocks for conditioning assays (Valente et al., ), as in the ZebraBox system. Limitations of the current setup include the inability to present visual cues laterally (Bianco et al., ; Semmelhack et al., ) due to projector positioning, and experiments that require high-resolution tail and eye segmentation, as the camera and/or lens would need to be upgraded. Additionally, the system currently includes a single camera and collecting three-dimensional data requires modification of the LabVIEW software (Macrı̀ et al., ).

The software to execute and analyze experiments is also highly adaptable. Existing experiment events can be modified to yield new event types. For example, users can acquire extended movies (Command ID “2”) of a desired length or frame-rate by customizing the event type. These slow-speed movies provide opportunities for a wide range of new analyses that move beyond centroid/motion data, such as machine learning approaches to uncover phenotypes. This approach would have particular utility when monitoring older animals with more complex behaviors than larvae (Cachat et al., ; Pérez-Escudero et al., ; Dreosti et al., ; Geng and Peterson, ). While our Python-based analyses measure motion parameters more comprehensively than any commercially available zebrafish analysis software, machine learning may distinguish additional classes of movements or responses. For example, we do not explicitly distinguish O-bends and C-bends from other movements, but used parameters such as motion velocity to separate responses. Indeed, our analysis pipeline (Figure 3) is currently based solely on motion quantification, but is also highly flexible. A large set of input options can be modified from default settings without coding (Supplementary Material Data Sheet 1). Furthermore, the code's object-oriented and modular style permits independent modification of parameters such as the output graph format. However, a limitation of our platform is that a LabVIEW license is required. Users without access to LabVIEW can adapt open-source triggering software to collect movies (Lopes et al., ; Štih et al., ) while still utilizing our construction and analysis guidelines.

Using this new system, we assessed best practices for raising zebrafish larvae for behavioral experiments (Figures 7, 8). First, we found no effect of splitting a clutch across two petri dishes. While we routinely removed all debris from dishes during growth (see Methods), different levels of cleanliness may still influence behavior. Second, we observed no behavioral differences between larvae grown at two different densities, although densities higher than 150/dish were not tested and may negatively impact growth. Third, and most critical, we found that wild-type animals from different clutches exhibited behavioral differences of similar magnitude to mutants with the strongest behavioral phenotypes of 165 mutants (Thyme et al., ) vs. their respective control siblings (Data Sheet 1: Supplementary Figure 20). These results underscore the importance of comparing results within single clutches. We postulate that inter-clutch differences may contribute to variability in other contexts such as calcium imaging, where data is often collected from many parental pairs.

The zebrafish model continues to increase in popularity (Teame et al., ), while recent advances in genome editing technologies lower experimental barriers for non-traditional models. Our adaptable behavioral setup can monitor any small aquatic organism, particularly in multi-well format, and can thus accelerate discovery along both of these avenues. While neuroscientists likely represent the majority of users, our system can also serve as a powerful diagnostic tool for the development and function of other organs such as muscle (Maves, ). Finally, genome sequencing continues to link large numbers of genes to human disease (Schizophrenia Working Group of the Psychiatric Genomics Consortium, ; Satterstrom et al., ). The high throughput approaches outlined here will be critical to establish connections between disease-associated genes and decipher their neurobiological functions.

Statements

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The animal study was reviewed and approved by UAB Institutional Animal Care and Use Committee; Birmingham, Alabama.

Author contributions

WJ, BG, ES, and ST contributed to design and construction of the behavior setup. ST, WJ, and MV wrote the manuscript. ES built the majority of the LabVIEW software with contributions from MV and ST. ST built the majority of the Python software with contributions from MV. BG built the Arduino interface. ST, WJ, and MV conducted the experiments to demonstrate box functionality. All authors contributed to the article and approved the submitted version.

Funding

This research was supported by R00 MH110603 (ST), UL1TR003096 (UAB CCTS support to ST), and the UAB VSRC core grant P30 EY003039 for use of the supported electronics and machining services.

Acknowledgments

The authors thank Verdion Martina, Gretchen Kioschos, and Emma Jones for assistance in building behavior boxes, Verdion Martina for assisting with data collection, Emma Jones for helpful comments on figures, Ari Ginsparg for assisting with Python environments, the UAB fish facility staff for zebrafish care, the UAB research computing team for providing and maintaining the Cheaha cluster, and the UAB electronics and machine shop. This manuscript has been released as a pre-print at BioRxiv (Joo et al., ).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnbeh.2020.606900/full#supplementary-material

References

Summary

Keywords

zebrafish, high-throughput screens, automated behavior, pre-pulse inhibition, neuropsychiatric disease, high-speed tracking, DanioVision, ZebraBox

Citation

Joo W, Vivian MD, Graham BJ, Soucy ER and Thyme SB (2021) A Customizable Low-Cost System for Massively Parallel Zebrafish Behavioral Phenotyping. Front. Behav. Neurosci. 14:606900. doi: 10.3389/fnbeh.2020.606900

Received

15 September 2020

Accepted

10 December 2020

Published

18 January 2021

Volume

14 - 2020

Edited by

Rui F. Oliveira, University Institute of Psychological, Social and Life Sciences (ISPA), Portugal

Reviewed by

David Goncalves, University of Saint Joseph, Macau; Ethan K. Scott, The University of Queensland, Australia

Updates

Copyright

*Correspondence: Summer B. Thyme

This article was submitted to Individual and Social Behaviors, a section of the journal Frontiers in Behavioral Neuroscience

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics