<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="brief-report" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Physiol.</journal-id>
<journal-title>Frontiers in Physiology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Physiol.</abbrev-journal-title>
<issn pub-type="epub">1664-042X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">917976</article-id>
<article-id pub-id-type="doi">10.3389/fphys.2022.917976</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Physiology</subject>
<subj-group>
<subject>Perspective</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>How Reproducibility Will Accelerate Discovery Through Collaboration in Physio-Logging</article-title>
<alt-title alt-title-type="left-running-head">Czapanskiy and Beltran</alt-title>
<alt-title alt-title-type="right-running-head">Reproducibility in Physio-Logging</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Czapanskiy</surname>
<given-names>Max F.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/1755689/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Beltran</surname>
<given-names>Roxanne S.</given-names>
</name>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/525656/overview"/>
</contrib>
</contrib-group>
<aff id="aff1">
<sup>1</sup>
<institution>Hopkins Marine Station, Stanford University</institution>, <addr-line>Pacific Grove</addr-line>, <addr-line>CA</addr-line>, <country>United States</country>
</aff>
<aff id="aff2">
<sup>2</sup>
<institution>Department of Ecology and Evolutionary Biology</institution>, <institution>University of California Santa Cruz</institution>, <addr-line>Santa Cruz</addr-line>, <addr-line>CA</addr-line>, <country>United States</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/13143/overview">Randall William Davis</ext-link>, Texas A&#x26;M University at Galveston, United States</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1800308/overview">Gretchen Stahlman</ext-link>, Rutgers, The State University of New Jersey, United States</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1800243/overview">Hazik Mohamed</ext-link>, Stellar Consulting Group, Singapore</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Max F. Czapanskiy, <email>maxczapanskiy@gmail.com</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Physio-logging, a section of the journal Frontiers in Physiology</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>08</day>
<month>07</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>13</volume>
<elocation-id>917976</elocation-id>
<history>
<date date-type="received">
<day>11</day>
<month>04</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>16</day>
<month>06</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2022 Czapanskiy and Beltran.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Czapanskiy and Beltran</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>What new questions could ecophysiologists answer if physio-logging research was fully reproducible? We argue that <italic>technical debt</italic> (computational hurdles resulting from prioritizing short-term goals over long-term sustainability) stemming from insufficient <italic>cyberinfrastructure</italic> (field-wide tools, standards, and norms for analyzing and sharing data) trapped physio-logging in a scientific silo. This debt stifles comparative biological analyses and impedes interdisciplinary research. Although physio-loggers (e.g., heart rate monitors and accelerometers) opened new avenues of research, the explosion of complex datasets exceeded ecophysiology&#x2019;s informatics capacity. Like many other scientific fields facing a deluge of complex data, ecophysiologists now struggle to share their data and tools. Adapting to this new era requires a change in mindset, from &#x201c;data as a noun&#x201d; (e.g., traits, counts) to &#x201c;data as a sentence&#x201d;, where measurements (nouns) are associate with transformations (verbs), parameters (adverbs), and metadata (adjectives). Computational reproducibility provides a framework for capturing the entire sentence. Though usually framed in terms of scientific integrity, reproducibility offers immediate benefits by promoting collaboration between individuals, groups, and entire fields. Rather than a tax on our productivity that benefits some nebulous greater good, reproducibility can accelerate the pace of discovery by removing obstacles and inviting a greater diversity of perspectives to advance science and society. In this article, we 1) describe the computational challenges facing physio-logging scientists and connect them to the concepts of <italic>technical debt</italic> and <italic>cyberinfrastructure</italic>, 2) demonstrate how other scientific fields overcame similar challenges by embracing computational reproducibility, and 3) present a framework to promote computational reproducibility in physio-logging, and bio-logging more generally.</p>
</abstract>
<kwd-group>
<kwd>bio-logging</kwd>
<kwd>ecophysiology</kwd>
<kwd>ecoinformatics</kwd>
<kwd>cyberinfrastructure</kwd>
<kwd>technical debt</kwd>
</kwd-group>
<contract-sponsor id="cn001">National Science Foundation<named-content content-type="fundref-id">10.13039/100000001</named-content>
</contract-sponsor>
</article-meta>
</front>
<body>
<sec id="s1">
<title>Introduction</title>
<p>Ecophysiology, like many other scientific disciplines, is undergoing a technological revolution fueled by advances in both hardware and software. One technology dramatically advancing the research boundary is physio-logging, which enabled observations of animals&#x2019; physiology in the field using animal-borne sensors (<xref ref-type="bibr" rid="B12">Fahlman et al., 2021</xref>; <xref ref-type="bibr" rid="B22">Hawkes et al., 2021</xref>). Ecophysiologists suddenly find themselves with far more data, of increasing complexity, than ever before. Although these new data led to breakthroughs in answering individual questions, the lack of field-wide standards and tools largely siloed research groups, stifling collaboration and synthesis.</p>
<p>In this article, we introduce the concepts of <italic>cyberinfrastructure</italic> and <italic>technical debt</italic> (<xref ref-type="table" rid="T1">Table 1</xref>) as they apply to physio-logging research using a trio of researcher personas and the scientific challenges they face. Then, we describe how other scientific disciplines, such as astronomy, neuroscience, and molecular biology, have addressed these issues by embracing reproducibility as a guiding principle. Finally, we propose physio-logging cyberinfrastructure that promotes reproducibility and reduces barriers to collaboration.</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>Glossary of terms.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">Term</th>
<th align="center">Definition</th>
<th align="center">References</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Cyberinfrastructure</td>
<td>The collective interface between data collection and data analysis for a scientific field, including software, hardware, personnel, and shared practices</td>
<td>
<xref ref-type="bibr" rid="B3">Atkins et al. (2003)</xref>
</td>
</tr>
<tr>
<td align="left">Technical debt</td>
<td>Short-term, sub-optimal choices in data and code that hamper future development without refactoring, such as missing documentation and bug-prone code</td>
<td>(<xref ref-type="bibr" rid="B23">Hinsen, 2015</xref>; <xref ref-type="bibr" rid="B9">Codabux et al., 2021</xref>; <xref ref-type="bibr" rid="B43">Vidoni, 2021</xref>)</td>
</tr>
<tr>
<td align="left">Heterogeneous data</td>
<td>Combinations of data collected at different temporal scales and/or with different properties, for example multivariate time series (e.g., acceleration) with intermittent geospatial locations (e.g., GPS)</td>
<td>(<xref ref-type="bibr" rid="B34">Leinfelder et al., 2011</xref>; <xref ref-type="bibr" rid="B37">Michener and Jones, 2012</xref>)</td>
</tr>
<tr>
<td align="left">Literate programming</td>
<td>A programming technique that combines code itself with descriptive text and outputs (figures, tables). R Markdown is an implementation of literate programming</td>
<td>(<xref ref-type="bibr" rid="B29">Knuth, 1984</xref>; <xref ref-type="bibr" rid="B4">Baumer and Udwin, 2015</xref>; <xref ref-type="bibr" rid="B28">Kery et al., 2018</xref>)</td>
</tr>
<tr>
<td align="left">Data provenance</td>
<td>A record of the origin and processing steps that produced the data</td>
<td>
<xref ref-type="bibr" rid="B37">Michener and Jones, (2012)</xref>
</td>
</tr>
</tbody>
</table>
</table-wrap>
<sec id="s1-1">
<title>Barriers to Collaboration and Synthesis</title>
<p>In the following vignettes, three physio-logging researcher personas encounter common scientific challenges stemming from accumulated technical debt and insufficient cyberinfrastructure. We expect these challenges will be familiar to the reader and help connect their own experiences to the concepts in this article.</p>
<p>
<italic>Person A is a graduate student studying ecophysiology. They have their own physio-logging data and a second dataset contributed by a collaborating lab. Before conducting any meaningful analysis, Person A spends multiple weeks corresponding with another grad student in the collaborating lab to figure out how to merge the datasets due to mismatched variable names and units. Later in the analysis, Person A discovers that their own data recorded time in Coordinated universal Time and the collaborating lab used local time, requiring them to spend more time correcting the input data and re-running earlier steps. The analysis is not ready in time for their next committee meeting.</italic>
</p>
<p>
<italic>Person B is the Principal Investigator of a comparative physiology lab. The lab recently completed a field season and the trainees are working hard to process all the new physio-logging data. Meanwhile, Person B wants to know how their study system fits into the broader phylogenetic and morphological space, so they ask comparable physio-logging data from other labs. Despite a rich literature on this subject, only a small number of labs have the bandwidth and/or interest to contribute data for a synthesis study. As a result, Person B writes a paper with limited comparative power and they struggle to find funding for the next field season.</italic>
</p>
<p>
<italic>Person C is a data scientist at a government agency developing a new deep learning method for time series classification. They meet Person A at a caf&#xe9; on campus and realize their physio-logging data would be a perfect case study for the new method. Unfortunately, the dataset is not large enough on its own, so Person A promises to contact their collaborators to get more data. The data management issues encountered earlier by Person A present such substantial barriers to collating a sufficiently large dataset that both Persons lose interest and move on to other projects. Person C&#x2019;s method contributes to breakthrough advances in bio-medical research, but they never think about physio-logging again.</italic>
</p>
<p>The challenges encountered by the researcher personas illustrate how technical debt prevents collaboration and innovation. <italic>Person A</italic> is the early career researcher who works hands-on with bio-logging data, navigating a fragile computational ecosystem of inconsistently formatted data and poorly documented scripts. <italic>Person B</italic> is further along in their career and delegates computational tasks to achieve their scientific goals. <italic>Person C</italic> represents scientists in other fields who could make important contributions to physio-logging if they were given access and resources. The obstacles facing each persona are unique to their perspective and experience, but they all have the same consequence: narrowing the scope of scientific inquiry.</p>
</sec>
<sec id="s1-2">
<title>Cyberinfrastructure and Technical Debt</title>
<p>
<italic>Cyberinfrastructure</italic> is a layer in the technological stack driving modern science, situated between data production and discipline-specific analysis practices (<xref ref-type="bibr" rid="B3">Atkins et al., 2003</xref>). Translated into the physio-logging domain, &#x201c;data production&#x201d; includes electronic tags deployed on animals in the field. &#x201c;Analysis practices&#x201d; refers to both technical (e.g., statistical methods and packages) and social (e.g., norms about sharing data and code) aspects of physio-logging science. Cyberinfrastructure is the oft invisible middle layer that interfaces between data production and analysis practices. Efforts towards cyberinfrastructure in bio-logging generally include, for example, universal data standards (<xref ref-type="bibr" rid="B7">Campbell et al., 2016</xref>; <xref ref-type="bibr" rid="B41">Sequeira et al., 2021</xref>) and repositories with interfacing software (<xref ref-type="bibr" rid="B31">Kranstauber et al., 2011</xref>; <xref ref-type="bibr" rid="B27">Kays et al., 2022</xref>). The purpose of cyberinfrastructure is to &#x201c;provide an effective and efficient platform for the empowerment of specific communities of researchers to innovate and eventually revolutionize what they do, how they do it, and who participates&#x201d; (<xref ref-type="bibr" rid="B3">Atkins et al., 2003</xref>, p. 5).</p>
<p>In the absence of cyberinfrastructure, scientists are incentivized by funding, hiring, and promotion structures to choose rapid data collection and analysis over long-term technical sustainability. <italic>Technical debt</italic> is the lingering bug, the missing documentation, the &#x201c;I swear it works on my machine&#x201d; left behind in pursuit of scientific output (<xref ref-type="bibr" rid="B23">Hinsen, 2015</xref>). Up to a point, technical debt is not a problem; rather, it is the natural side effect of important scientific tasks like exploratory analyses and prototyping tools. But eventually technical debt creates obstacles for future work (<xref ref-type="bibr" rid="B9">Codabux et al., 2021</xref>; <xref ref-type="bibr" rid="B43">Vidoni, 2021</xref>). Removing those obstacles requires either 1) resources allocated specifically to auditing and fixing data and code (i.e., refactoring <xref ref-type="bibr" rid="B1">Adorf et al. (2019)</xref>) or 2) cyberinfrastructure that promotes best practices from the start. The first approach is unlikely to work at scale because existing incentive structures (funding, publications, hiring and promotion) do not prioritize refactoring existing data and code. Other scientific fields embraced the second approach, improved cyberinfrastructure, to address the same issues facing physio-logging. But before we investigate those efforts, we first describe in greater detail the technical debts in physio-logging.</p>
</sec>
<sec id="s1-3">
<title>Where Did Our Technical Debt Come From</title>
<p>The underlying cause of the obstacles to collaboration and synthesis is a field-wide, collective technical debt incurred when an empirical/theoretical science (ecophysiology) embraced a data-intensive method (physio-logging) without simultaneously developing cyberinfrastructure. What was it about physio-logging that triggered ecophysiology&#x2019;s technical debt?</p>
<p>Physio-logging changed the nature of ecophysiological data from simple, small tables to dense, <italic>heterogeneous</italic> (<xref ref-type="table" rid="T1">Table 1</xref>) mixtures of physiological, geospatial, and biomechanical time series (<xref ref-type="bibr" rid="B21">Harrison, 2021</xref>). Major developments in ecophysiology during the 20th and early 21st centuries were fueled by comparative analyses across morphology, phylogeny, geography, and other biological dimensions. Critically, these comparative studies were only possible because data could be combined from multiple individual studies. Consider the Metabolic Theory of Ecology, which emerged from scaling approaches that connected patterns and processes across the many levels of biological organization, from molecules to ecosystems (<xref ref-type="bibr" rid="B5">Brown et al., 2004</xref>). Three <italic>Persons A</italic> (Gilooly, Allen, and Savage&#x2013;post-doctoral scholars at the time) and a <italic>Person B</italic> (Brown&#x2013;an established biologist) assembled a synthetic dataset from dozens of earlier publications. In collaboration with a <italic>Person C</italic> (West&#x2013;a theoretical physicist), the group articulated a theoretical framework for ecology from first principles. Though controversial, the Metabolic Theory of Ecology inspired a wave of innovative research (<xref ref-type="bibr" rid="B32">Lafferty et al., 2008</xref>; <xref ref-type="bibr" rid="B6">Burton et al., 2011</xref>; <xref ref-type="bibr" rid="B15">Gardner et al., 2011</xref>; <xref ref-type="bibr" rid="B35">Locey and Lennon, 2016</xref>) and amounted to a major advance in biological theory. Coincidentally, while Brown et al. were analyzing &#x201c;simple&#x201d; ecophysiological data, physio-logging data were growing in size and complexity. No longer simple recorders that measured individual data points (<xref ref-type="bibr" rid="B30">Kooyman, 1966</xref>; <xref ref-type="bibr" rid="B17">Goldbogen and Meir, 2014</xref>), by 2004 bio-loggers had evolved into high-resolution, multisensory devices collecting gigabytes of heterogeneous data (<xref ref-type="bibr" rid="B46">Wilmers et al., 2015</xref>). A scientific community accustomed to simple, small datasets was suddenly presented with a profound informatics challenge&#x2013;largely without the training, resources, and incentives to properly meet it. We have yet to develop adequate cyberinfrastructure, leaving a growing technical debt that impedes <italic>Persons A-C</italic>&#x2019;s progress and limits discoveries using physio-logging tools.</p>
</sec>
<sec id="s1-4">
<title>Reproducible Research Repays Technical Debt</title>
<p>As biologists, we are trained to think of data as observations. In other words, data are nouns: a cow&#x2019;s mass, a salmon&#x2019;s heart rate, a bird&#x2019;s body temperature. However, physio-loggers record such vast quantities of complex, heterogeneous data that their interpretation <italic>cannot be separated</italic> from the computational methods used to process and analyze them. For example, consider a table of 50&#xa0;Hz tri-axial accelerometer and magnetometer data. Even when visualized graphically, these data are largely meaningless to a human interpreter. But if we correct for the orientation of the tag relative to the animal&#x2019;s body and account for the declination and inclination of the local magnetic field, then we can transform acceleration and magnetism into pitch, roll, and heading (<xref ref-type="bibr" rid="B25">Johnson and Tyack, 2003</xref>). Now the human interpreter can meaningfully visualize the animal&#x2019;s fine-scale movements to identify physiologically relevant behaviors such as exercise (<xref ref-type="bibr" rid="B45">Williams et al., 2020</xref>), rest (<xref ref-type="bibr" rid="B38">Mitani et al., 2010</xref>), and escape (<xref ref-type="bibr" rid="B44">Williams et al., 2017</xref>). Physio-logging &#x201c;data&#x201d; are more than the final numbers; they are also the computational pipeline that transforms raw measurements into useful information. When it comes to physio-logging, data are not nouns; they are whole sentences composed of verbs (transformations), adjectives (metadata), and adverbs (parameters).</p>
<p>Computational reproducibility is the practice of writing the data&#x2019;s entire sentence so that anyone can read it. Sharing our data this way accomplishes both &#x201c;global&#x201d; and &#x201c;local&#x201d; goals (<xref ref-type="bibr" rid="B14">Feinberg et al., 2020</xref>). The &#x201c;global&#x201d; goal is satisfying the scientific norm of reproducibility, providing transparency and integrity for our entire field. These ideals are the focus of the widely reported &#x201c;reproducibility crisis&#x201d; (<xref ref-type="bibr" rid="B39">Peng, 2015</xref>; <xref ref-type="bibr" rid="B13">Fanelli, 2018</xref>). But other data-intensive fields have embraced a &#x201c;local&#x201d; goal for computational reproducibility by reframing it in terms of collaboration and knowledge transfer. In this context, reproducibility is accomplished through computational best practices, such as re-usable code and proper documentation. This framing contains tangible solutions to the challenges experienced by <italic>Persons A-C</italic>. Sharing data as reproducible workflows (<xref ref-type="bibr" rid="B10">Cohen-Boulakia et al., 2017</xref>; <xref ref-type="bibr" rid="B20">Gr&#xfc;ning et al., 2018</xref>; <xref ref-type="bibr" rid="B47">Wratten et al., 2021</xref>) solves the incompatibility issues that distracted <italic>Person A</italic> from doing good science and promotes collaboration within (<italic>Person B</italic>) and between (<italic>Person C</italic>) scientific disciplines. More importantly, it removes technical obstacles preventing broad, equitable access to our science. But a &#x201c;data as a sentence&#x201d;, reproducibility-focused mindset is too much to expect of individual ecophysiologists without adequate cyberinfrastructure to support them. How have other fields provided tools, education, and other resources to their scientists?</p>
</sec>
<sec id="s1-5">
<title>Cyberinfrastructure Examples From Other Fields</title>
<p>Most scientific fields are facing similar informatics challenges as ecophysiology; a few have developed cyberinfrastructure to promote sharing &#x201c;data as a sentence&#x201d;. What physio-logging is to ecophysiology, sky imaging is to astronomy, brain imaging is to neuroscience, and high-throughput sequencing is to molecular biology. The quantity and complexity of image and sequence data created technical debts in those fields as well, which were addressed through the coordinated development of cyberinfrastructure. Saliently, these fields used the &#x201c;local&#x201d; goal of computational reproducibility (collaboration and knowledge transfer) to motivate adoption of their respective cyberinfrastructures.</p>
<p>Astronomy&#x2019;s cyberinfrastructure is represented by the aptly named Virtual Observatory (VO) (<xref ref-type="bibr" rid="B40">Quinn et al., 2004</xref>). There are currently 22 VOs around the world, such as the National Virtual Observatory in the United States and the Virtual Observatory of India. Each VO provides open access to sky imagery and other astronomical data in standardized formats agreed upon by the International Virtual Observatory Alliance (IVOA). In addition to data sharing, VOs provide open processing and analysis workflows, providing astronomers with invaluable tools for the &#x201c;data as a sentence&#x201d; mindset (<xref ref-type="bibr" rid="B11">Cui et al., 2020</xref>). The VO framework fuels innovative breakthroughs in astronomy, including the discovery of galaxies (<xref ref-type="bibr" rid="B8">Chilingarian et al., 2009</xref>).</p>
<p>In neuroscience, the proliferation of brain image data led to ad hoc, incompatible data curation practices, inspiring a standardization effort: the Brain Imaging Data Structure (BIDS). BIDS was developed to solve a problem familiar to physio-logging scientists: &#x201c;Lack of consensus leads to misunderstanding and time wasted on rearranging data or rewriting scripts that expect particular file formats and organization, as well as a possible cause for errors.&#x201d; (<xref ref-type="bibr" rid="B18">Gorgolewski et al., 2016</xref>, p. 2). In addition to a standardized data format, BIDS includes a software ecosystem for importing, validating, and processing imaging data (<xref ref-type="bibr" rid="B19">Gorgolewski et al., 2017</xref>). Like VOs, BIDS integrates data and code, facilitating &#x201c;data as a sentence&#x201d;.</p>
<p>The Human Genome Project published a draft of the human genome in 2001, representative of molecular biology&#x2019;s pivot to big data (<xref ref-type="bibr" rid="B33">Lander et al., 2001</xref>). Three years later, Bioconductor emerged as a provider of data access, processing, and analysis tools (<xref ref-type="bibr" rid="B16">Gentleman et al., 2004</xref>; <xref ref-type="bibr" rid="B24">Huber et al., 2015</xref>). Like the VOs and BIDS, Bioconductor provides both data structures and computational methods. From the beginning, it was designed with reproducibility as an explicit goal, to promote collaboration in both sharing data and developing methods. As important new technologies emerge, such as high-throughput single-cell sequencing, the cyberinfrastructure provided by Bioconductor promotes collaborations between biologists, statisticians, and computer scientists to rapidly develop new methods for handling the influx of increasingly heterogeneous data (<xref ref-type="bibr" rid="B2">Amezquita et al., 2020</xref>). In turn, the cultural norm of reproducibility incentivizes best practices, such as software documentation and validation, that facilitate adoption by researchers across the discipline.</p>
<p>VOs, BIDS, and Bioconductor exemplify the &#x201c;data as a sentence&#x201d; perspective by providing both data formats and computational tools for handling large quantities of heterogeneous data. Although there are data formats (<xref ref-type="bibr" rid="B41">Sequeira et al., 2021</xref>; <xref ref-type="bibr" rid="B27">Kays et al., 2022</xref>) and computational tools (<xref ref-type="bibr" rid="B26">Joo et al., 2020</xref>) for geospatial bio-logging data, the two sides have been developed independently without shared interfaces. Physio-logging lacks any such infrastructure.</p>
</sec>
</sec>
<sec id="s2">
<title>Introducing <monospace>biologr</monospace>
</title>
<p>What would physio-logging cyberinfrastructure look like in practice? Following the lessons of the Virtual Observatory, BIDS, Bioconductor, and other successful efforts, it should facilitate reproducibility by integrating data formats directly with computational tools. Beginning with the data format, the nc-eTAG specification provides an extensible and efficient structure for storing bio-logging data (<xref ref-type="bibr" rid="B42">Tsontos et al., 2020</xref>). But recall the data alone are only the nouns; we must also capture the rest of the sentence. Existing workflows for processing bio-logging data are typically ad hoc and ephemeral, meaning they&#x2019;re lost from the scientific record after publication. As a result, the data shared in repositories, whether they&#x2019;re specialized for bio-logging like MoveBank or general purpose like Zenodo, are missing much of the story.</p>
<p>We propose an R package, <monospace>biologr</monospace>, that advances the goal of bio-logging cyberinfrastructure, supporting ecophysiologists and our colleagues in the broader bio-logging space. <monospace>biologr</monospace> interacts with the nc-eTAG data format and explicitly captures the entire workflow. By archiving both raw and processed data together with the workflow connecting them, <monospace>biologr</monospace> records the data&#x2019;s entire sentence: nouns, verbs, and all (<xref ref-type="fig" rid="F1">Figure 1</xref>).</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>The proposed <monospace>biologr</monospace> R package will provide physio-logging cyberinfrastructure. <bold>(A)</bold> From raw data to standardized, reproducible data. Import and export functions ensure data standard compliance, e.g., file formats and directory structures. A validate function automatically verifies that the computational workflow (see <bold>(B)</bold>) reproducibly generates the processed data. <bold>(B)</bold> <monospace>biologr</monospace> provides an R Markdown template (see section Introducing <monospace>biologr</monospace>) for recording the workflow. The R Markdown <monospace>knit</monospace> command creates a report documenting data processing and interpretation, i.e., data provenance.</p>
</caption>
<graphic xlink:href="fphys-13-917976-g001.tif"/>
</fig>
<p>What minimum set of functionalities would <monospace>biologr</monospace> require to make physio-logging data reproducible? In brief: data standards, import/export, validation, and workflow. For data standards, <monospace>biologr</monospace> relies on nc-eTAG for processed data and a standardized directory structure that organizes components for reproducibility. <monospace>biologr</monospace> needs both import and export functions to get the raw data into the nc-eTAG format and to populate the directory structure. Importantly, the export function saves both the data <italic>and the computational workflow</italic>. BIDS and other cyberinfrastructures have demonstrated that another critical function is automated validation (<xref ref-type="bibr" rid="B18">Gorgolewski et al., 2016</xref>). Computational reproducibility is built on standards, and without validation standardization quickly falls apart. So <monospace>biologr</monospace>&#x2019;s automated validator checks both form (i.e., do the file formats and directory structures adhere to the standard?) and function (i.e., does the workflow reproducibly generate the processed data from the raw?). Import/export and validation both require a reproducible workflow, which is the component most responsible for reproducibility.</p>
<p>
<monospace>biologr</monospace> captures the physio-logging computational workflow using <italic>literate programming</italic> (<xref ref-type="table" rid="T1">Table 1</xref>) (<xref ref-type="bibr" rid="B29">Knuth, 1984</xref>; <xref ref-type="bibr" rid="B28">Kery et al., 2018</xref>). Literate programming is a technique that interweaves code, text, and output (e.g., figures and tables) - a combination that captures computational workflows in both human- and computer-readable formats. <monospace>biologr</monospace> provides an R Markdown template, a literate programming implementation with broad adoption in the scientific community (<xref ref-type="bibr" rid="B4">Baumer and Udwin, 2015</xref>). Instead of an ad hoc, ephemeral script, the physio-logging researcher authors their workflow in R Markdown. Not only does this preserve computational details for automated validation and re-use/modification by other researchers, the output of the R Markdown file is itself a <italic>provenance</italic> report (<xref ref-type="table" rid="T1">Table 1</xref>), explicitly recording the transformations and interpretations in the data (<xref ref-type="bibr" rid="B37">Michener and Jones, 2012</xref>). This workflow approach promotes reproducibility by serving as the glue that binds together data standards, import/export, and validation.</p>
</sec>
<sec sec-type="discussion" id="s3">
<title>Discussion</title>
<sec id="s3-1">
<title>A Vision for the Future of Physio-Logging</title>
<p>The goal of this article is to invite the physio-logging community to a conversation about the existing limitations, and potential advances, in our work relating to cyberinfrastructure and reproducibility. The International Virtual Observatory Alliance, Brain Imaging Data Structure, and Bioconductor all have governing bodies with working groups to design, develop, and disseminate cyberinfrastructure for their fields. A working group within the International Bio-logging Society (<ext-link ext-link-type="uri" xlink:href="http://www.bio-logging.net/">www.bio-logging.net</ext-link>) could serve the same role for physio-logging, especially if ecoinformaticians were included in the process (<xref ref-type="bibr" rid="B36">Michener et al., 2012</xref>). The proposed <monospace>biologr</monospace> package provides a starting point for those conversations. Below, we offer alternative vignettes to describe how our researcher personas would benefit from <monospace>biologr</monospace>.</p>
<p>
<italic>Person A is a</italic> <italic>grad</italic> <italic>student studying ecophysiology. They have their own physio-logging data and a second dataset contributed by a collaborating lab. The two labs use slightly different methods to process their data, but both use</italic> <monospace>biologr</monospace> <italic>for recording their workflows. Person A edits their collaborator&#x2019;s workflow to make the two datasets compatible and kicks off the reproducible workflow with a single click. They leave for lunch and come back to the lab to find two happily interoperable datasets. The analysis is done by the end of the week and their committee congratulates them on their progress.</italic>
</p>
<p>
<italic>Person B is the Principal Investigator of a comparative physiology lab. The lab recently completed a field season and the trainees are working hard to process all the new physio-logging data. Meanwhile, Person B wants to know how their study system fits into the broader phylogenetic and morphological picture. There is a rich literature on this subject, so dozens of archived datasets are available through a physio-logging data portal based on</italic> <monospace>biologr</monospace>
<italic>. Person B downloads the data, runs a phylogenetically-informed scaling analysis, and writes a high-impact synthesis study. The publication opens exciting lines of collaborative inquiry and leads to a new multi-million dollar grant.</italic>
</p>
<p>
<italic>Person C is a post-doc in computer science developing a new deep learning method for time series classification. They meet Person A at a cafe on campus and realize their physio-logging data would be a perfect case study for the new method. Person C spends the afternoon reading</italic> <monospace>biologr</monospace> <italic>documentation and assembles a large physio-logging dataset from multiple studies. They demonstrate that their method accurately identifies physiological states from behavioral data and publish the method as a</italic> <monospace>biologr</monospace>
<italic>-compatible R package, which is used by several physio-logging labs in their research.</italic>
</p>
</sec>
</sec>
<sec sec-type="conclusion" id="s4">
<title>Conclusion</title>
<p>Physio-logging, and bio-logging more generally, gave biologists new tools for observing animals in their natural habitats with previously inconceivable detail. But concurrent with this great leap forward, we accumulated a technical debt that cost us the ability to easily share and synthesize our data. Ecophysiology became a data-intensive science without developing the cyberinfrastructure to handle large quantities of complex, heterogeneous data. <monospace>biologr</monospace> illustrates how we can develop tools to reproducibly process and archive physio-logging data. By embracing reproducibility, we can repay our technical debt and usher in a new era of collaboration while fostering best practices in a diverse next generation of physio-logging researchers. As individuals, labs, data repositories, and other stakeholders adopt shared standards, the possibilities for exploration and synthesis will grow exponentially.</p>
</sec>
</body>
<back>
<sec id="s5" sec-type="data-availability">
<title>Data Availability Statement</title>
<p>The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.</p>
</sec>
<sec id="s6">
<title>Author Contributions</title>
<p>Perspective conception: MC. Draft manuscript preparation: MC and RB.</p>
</sec>
<sec id="s7">
<title>Funding</title>
<p>The work was funded in part by National Science Foundation award &#x23;2052497 to RB.</p>
</sec>
<sec sec-type="COI-statement" id="s8">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s9">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ack>
<p>The authors thank Philippine Chambault, Millie Chapman, James Fahlbusch, William Oestreich, and Allison Payne for their constructive criticism of this manuscript. MC&#x2019;s perspective on the links between reproducibility and collaboration were greatly influenced by conversations with Susan Holmes&#x2019; lab group and the Stanford Data Science Center for Open and REproducible Science seminar series. We are grateful for the insightful feedback from two reviewers.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Adorf</surname>
<given-names>C. S.</given-names>
</name>
<name>
<surname>Ramasubramani</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Anderson</surname>
<given-names>J. A.</given-names>
</name>
<name>
<surname>Glotzer</surname>
<given-names>S. C.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>How to Professionally Develop Reusable Scientific Software-And when Not to</article-title>. <source>Comput. Sci. Eng.</source> <volume>21</volume>, <fpage>66</fpage>&#x2013;<lpage>79</lpage>. <pub-id pub-id-type="doi">10.1109/MCSE.2018.2882355</pub-id>
</citation>
</ref>
<ref id="B2">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Amezquita</surname>
<given-names>R. A.</given-names>
</name>
<name>
<surname>Lun</surname>
<given-names>A. T. L.</given-names>
</name>
<name>
<surname>Becht</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Carey</surname>
<given-names>V. J.</given-names>
</name>
<name>
<surname>Carpp</surname>
<given-names>L. N.</given-names>
</name>
<name>
<surname>Geistlinger</surname>
<given-names>L.</given-names>
</name>
<etal/>
</person-group> (<year>2020</year>). <article-title>Orchestrating Single-Cell Analysis with Bioconductor</article-title>. <source>Nat. Methods</source> <volume>17</volume>, <fpage>137</fpage>&#x2013;<lpage>145</lpage>. <pub-id pub-id-type="doi">10.1038/s41592-019-0654-x</pub-id>
</citation>
</ref>
<ref id="B3">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Atkins</surname>
<given-names>D. E.</given-names>
</name>
<name>
<surname>Droegemeier</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Feldman</surname>
<given-names>S. I.</given-names>
</name>
<name>
<surname>Garcia-Molina</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Klein</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Messerschmitt</surname>
<given-names>D.</given-names>
</name>
<etal/>
</person-group> (<year>2003</year>). <source>Revolutionizing Science and Engineering through Cyberinfrastructure, Report of the Blue-Ribbon Advisory Panel on Cyberinfrastructure</source>. <publisher-loc>Alexandria, VA</publisher-loc>: <publisher-name>National Science Foundation</publisher-name>.</citation>
</ref>
<ref id="B4">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Baumer</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Udwin</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>R Markdown</article-title>. <source>WIREs Comput. Stat.</source> <volume>7</volume>, <fpage>167</fpage>&#x2013;<lpage>177</lpage>. <pub-id pub-id-type="doi">10.1002/wics.1348</pub-id>
</citation>
</ref>
<ref id="B5">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Brown</surname>
<given-names>J. H.</given-names>
</name>
<name>
<surname>Gillooly</surname>
<given-names>J. F.</given-names>
</name>
<name>
<surname>Allen</surname>
<given-names>A. P.</given-names>
</name>
<name>
<surname>Savage</surname>
<given-names>V. M.</given-names>
</name>
<name>
<surname>West</surname>
<given-names>G. B.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>Toward a Metabolic Theory of Ecology</article-title>. <source>Ecology</source> <volume>85</volume>, <fpage>1771</fpage>&#x2013;<lpage>1789</lpage>. <pub-id pub-id-type="doi">10.1890/03-9000</pub-id>
</citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Burton</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Killen</surname>
<given-names>S. S.</given-names>
</name>
<name>
<surname>Armstrong</surname>
<given-names>J. D.</given-names>
</name>
<name>
<surname>Metcalfe</surname>
<given-names>N. B.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>What Causes Intraspecific Variation in Resting Metabolic Rate and what Are its Ecological Consequences?</article-title> <source>Proc. R. Soc. B</source> <volume>278</volume>, <fpage>3465</fpage>&#x2013;<lpage>3473</lpage>. <pub-id pub-id-type="doi">10.1098/rspb.2011.1778</pub-id>
</citation>
</ref>
<ref id="B7">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Campbell</surname>
<given-names>H. A.</given-names>
</name>
<name>
<surname>Urbano</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Davidson</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Dettki</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Cagnacci</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>A Plea for Standards in Reporting Data Collected by Animal-Borne Electronic Devices</article-title>. <source>Anim. Biotelemetry</source> <volume>4</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1186/s40317-015-0096-x</pub-id>
</citation>
</ref>
<ref id="B8">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chilingarian</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Cayatte</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Revaz</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Dodonov</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Durand</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Durret</surname>
<given-names>F.</given-names>
</name>
<etal/>
</person-group> (<year>2009</year>). <article-title>A Population of Compact Elliptical Galaxies Detected with the Virtual Observatory</article-title>. <source>Science</source> <volume>326</volume>, <fpage>1379</fpage>&#x2013;<lpage>1382</lpage>. <pub-id pub-id-type="doi">10.1126/science.1175930</pub-id>
</citation>
</ref>
<ref id="B9">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Codabux</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Vidoni</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Fard</surname>
<given-names>F. H.</given-names>
</name>
</person-group>, <year>2021</year>. <article-title>Technical Debt in the Peer-Review Documentation of R Packages: a rOpenSci Case Study</article-title>, <conf-name>Proceeding of the 2021 IEEE/ACM 18th International Conference on Mining Software Repositories (MSR). Presented at the 2021 IEEE/ACM 18th International Conference on Mining Software Repositories (MSR)</conf-name>, <conf-date>June 2021</conf-date>, pp. <fpage>195</fpage>&#x2013;<lpage>206</lpage>. <pub-id pub-id-type="doi">10.1109/MSR52588.2021.00032</pub-id>
</citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cohen-Boulakia</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Belhajjame</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Collin</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Chopard</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Froidevaux</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Gaignard</surname>
<given-names>A.</given-names>
</name>
<etal/>
</person-group> (<year>2017</year>). <article-title>Scientific Workflows for Computational Reproducibility in the Life Sciences: Status, Challenges and Opportunities</article-title>. <source>Future Gener. Comput. Syst.</source> <volume>75</volume>, <fpage>284</fpage>&#x2013;<lpage>298</lpage>. <pub-id pub-id-type="doi">10.1016/j.future.2017.01.012</pub-id>
</citation>
</ref>
<ref id="B11">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cui</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Tao</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Fan</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Xiao</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>He</surname>
<given-names>B.</given-names>
</name>
<etal/>
</person-group> (<year>2020</year>). <article-title>Towards an Astronomical Science Platform: Experiences and Lessons Learned from Chinese Virtual Observatory</article-title>. <source>Astronomy Comput.</source> <volume>32</volume>, <fpage>100392</fpage>. <pub-id pub-id-type="doi">10.1016/j.ascom.2020.100392</pub-id>
</citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fahlman</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Aoki</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Bale</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Brijs</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Chon</surname>
<given-names>K. H.</given-names>
</name>
<name>
<surname>Drummond</surname>
<given-names>C. K.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>The New Era of Physio-Logging and Their Grand Challenges</article-title>. <source>Front. Physiol.</source> <volume>12</volume>, <fpage>669158</fpage>. <pub-id pub-id-type="doi">10.3389/fphys.2021.669158</pub-id>
</citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fanelli</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Is Science Really Facing a Reproducibility Crisis, and Do We Need it to?</article-title> <source>Proc. Natl. Acad. Sci. U.S.A.</source> <volume>115</volume>, <fpage>2628</fpage>&#x2013;<lpage>2631</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1708272114</pub-id>
</citation>
</ref>
<ref id="B14">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Feinberg</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Sutherland</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Nelson</surname>
<given-names>S. B.</given-names>
</name>
<name>
<surname>Jarrahi</surname>
<given-names>M. H.</given-names>
</name>
<name>
<surname>Rajasekar</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>The New Reality of Reproducibility: The Role of Data Work in Scientific Research</article-title>. <source>Proc. ACM Hum.-Comput. Interact.</source> <volume>4</volume>, <fpage>0351</fpage>&#x2013;<lpage>03522</lpage>. <pub-id pub-id-type="doi">10.1145/3392840</pub-id>
</citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gardner</surname>
<given-names>J. L.</given-names>
</name>
<name>
<surname>Peters</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Kearney</surname>
<given-names>M. R.</given-names>
</name>
<name>
<surname>Joseph</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Heinsohn</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Declining Body Size: a Third Universal Response to Warming?</article-title> <source>Trends Ecol. Evol.</source> <volume>26</volume>, <fpage>285</fpage>&#x2013;<lpage>291</lpage>. <pub-id pub-id-type="doi">10.1016/j.tree.2011.03.005</pub-id>
</citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gentleman</surname>
<given-names>R. C.</given-names>
</name>
<name>
<surname>Carey</surname>
<given-names>V. J.</given-names>
</name>
<name>
<surname>Bates</surname>
<given-names>D. M.</given-names>
</name>
<name>
<surname>Bolstad</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Dettling</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Dudoit</surname>
<given-names>S.</given-names>
</name>
<etal/>
</person-group> (<year>2004</year>). <article-title>Bioconductor: Open Software Development for Computational Biology and Bioinformatics</article-title>. <source>Genome Biol.</source> <volume>5</volume>, <fpage>R80</fpage>. <pub-id pub-id-type="doi">10.1186/gb-2004-5-10-r80</pub-id>
</citation>
</ref>
<ref id="B17">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Goldbogen</surname>
<given-names>J. A.</given-names>
</name>
<name>
<surname>Meir</surname>
<given-names>J. U.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>The Device that Revolutionized Marine Organismal Biology</article-title>. <source>J. Exp. Biol.</source> <volume>217</volume>, <fpage>167</fpage>&#x2013;<lpage>168</lpage>. <pub-id pub-id-type="doi">10.1242/jeb.092189</pub-id>
</citation>
</ref>
<ref id="B18">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gorgolewski</surname>
<given-names>K. J.</given-names>
</name>
<name>
<surname>Auer</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Calhoun</surname>
<given-names>V. D.</given-names>
</name>
<name>
<surname>Craddock</surname>
<given-names>R. C.</given-names>
</name>
<name>
<surname>Das</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Duff</surname>
<given-names>E. P.</given-names>
</name>
<etal/>
</person-group> (<year>2016</year>). <article-title>The Brain Imaging Data Structure, a Format for Organizing and Describing Outputs of Neuroimaging Experiments</article-title>. <source>Sci. Data</source> <volume>3</volume>, <fpage>160044</fpage>. <pub-id pub-id-type="doi">10.1038/sdata.2016.44</pub-id>
</citation>
</ref>
<ref id="B19">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gorgolewski</surname>
<given-names>K. J.</given-names>
</name>
<name>
<surname>Alfaro-Almagro</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Auer</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Bellec</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Capot&#x103;</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Chakravarty</surname>
<given-names>M. M.</given-names>
</name>
<etal/>
</person-group> (<year>2017</year>). <article-title>BIDS Apps: Improving Ease of Use, Accessibility, and Reproducibility of Neuroimaging Data Analysis Methods</article-title>. <source>PLoS Comput. Biol.</source> <volume>13</volume>, <fpage>e1005209</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1005209</pub-id>
</citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gr&#xfc;ning</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Chilton</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>K&#xf6;ster</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Dale</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Soranzo</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>van den Beek</surname>
<given-names>M.</given-names>
</name>
<etal/>
</person-group> (<year>2018</year>). <article-title>Practical Computational Reproducibility in the Life Sciences</article-title>. <source>Cell Syst.</source> <volume>6</volume>, <fpage>631</fpage>&#x2013;<lpage>635</lpage>. <pub-id pub-id-type="doi">10.1016/j.cels.2018.03.014</pub-id>
</citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Harrison</surname>
<given-names>X. A.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>A Brief Introduction to the Analysis of Time-Series Data from Biologging Studies</article-title>. <source>Phil. Trans. R. Soc. B</source> <volume>376</volume>, <fpage>20200227</fpage>. <pub-id pub-id-type="doi">10.1098/rstb.2020.0227</pub-id>
</citation>
</ref>
<ref id="B22">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hawkes</surname>
<given-names>L. A.</given-names>
</name>
<name>
<surname>Fahlman</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Sato</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Introduction to the Theme Issue: Measuring Physiology in Free-Living Animals</article-title>. <source>Phil. Trans. R. Soc. B</source> <volume>376</volume>, <fpage>20200210</fpage>. <pub-id pub-id-type="doi">10.1098/rstb.2020.0210</pub-id>
</citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hinsen</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Technical Debt in Computational Science</article-title>. <source>Comput. Sci. Eng.</source> <volume>17</volume>, <fpage>103</fpage>&#x2013;<lpage>107</lpage>. <pub-id pub-id-type="doi">10.1109/MCSE.2015.113</pub-id>
</citation>
</ref>
<ref id="B24">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Huber</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Carey</surname>
<given-names>V. J.</given-names>
</name>
<name>
<surname>Gentleman</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Anders</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Carlson</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Carvalho</surname>
<given-names>B. S.</given-names>
</name>
<etal/>
</person-group> (<year>2015</year>). <article-title>Orchestrating High-Throughput Genomic Analysis with Bioconductor</article-title>. <source>Nat. Methods</source> <volume>12</volume>, <fpage>115</fpage>&#x2013;<lpage>121</lpage>. <pub-id pub-id-type="doi">10.1038/nmeth.3252</pub-id>
</citation>
</ref>
<ref id="B25">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Johnson</surname>
<given-names>M. P.</given-names>
</name>
<name>
<surname>Tyack</surname>
<given-names>P. L.</given-names>
</name>
</person-group> (<year>2003</year>). <article-title>A Digital Acoustic Recording Tag for Measuring the Response of Wild Marine Mammals to Sound</article-title>. <source>IEEE J. Ocean. Eng.</source> <volume>28</volume>, <fpage>3</fpage>&#x2013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1109/JOE.2002.808212</pub-id>
</citation>
</ref>
<ref id="B26">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Joo</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Boone</surname>
<given-names>M. E.</given-names>
</name>
<name>
<surname>Clay</surname>
<given-names>T. A.</given-names>
</name>
<name>
<surname>Patrick</surname>
<given-names>S. C.</given-names>
</name>
<name>
<surname>Clusella&#x2010;Trullas</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Basille</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Navigating through the R Packages for Movement</article-title>. <source>J. Anim. Ecol.</source> <volume>89</volume>, <fpage>248</fpage>&#x2013;<lpage>267</lpage>. <pub-id pub-id-type="doi">10.1111/1365-2656.13116</pub-id>
</citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kays</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Davidson</surname>
<given-names>S. C.</given-names>
</name>
<name>
<surname>Berger</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Bohrer</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Fiedler</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Flack</surname>
<given-names>A.</given-names>
</name>
<etal/>
</person-group> (<year>2022</year>). <article-title>The Movebank System for Studying Global Animal Movement and Demography</article-title>. <source>Methods Ecol. Evol.</source> <volume>13</volume>, <fpage>419</fpage>&#x2013;<lpage>431</lpage>. <pub-id pub-id-type="doi">10.1111/2041-210X.13767</pub-id>
</citation>
</ref>
<ref id="B28">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Kery</surname>
<given-names>M. B.</given-names>
</name>
<name>
<surname>Radensky</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Arya</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>John</surname>
<given-names>B. E.</given-names>
</name>
<name>
<surname>Myers</surname>
<given-names>B. A.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>The Story in the Notebook</article-title>. <conf-name>Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI &#x2019;18</conf-name>, <conf-loc>Montr&#x00E9;al, QC</conf-loc> (<publisher-loc>New York, NY, USA</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>11</lpage>. <pub-id pub-id-type="doi">10.1145/3173574.3173748</pub-id>
</citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Knuth</surname>
<given-names>D. E.</given-names>
</name>
</person-group> (<year>1984</year>). <article-title>Literate Programming</article-title>. <source>Comput. J.</source> <volume>27</volume>, <fpage>97</fpage>&#x2013;<lpage>111</lpage>. <pub-id pub-id-type="doi">10.1093/comjnl/27.2.97</pub-id>
</citation>
</ref>
<ref id="B30">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kooyman</surname>
<given-names>G. L.</given-names>
</name>
</person-group> (<year>1966</year>). <article-title>Maximum Diving Capacities of the Weddell Seal, Leptonychotes Weddelli</article-title>. <source>Science</source> <volume>151</volume>, <fpage>1553</fpage>&#x2013;<lpage>1554</lpage>. <pub-id pub-id-type="doi">10.1126/science.151.3717.1553</pub-id>
</citation>
</ref>
<ref id="B31">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kranstauber</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Cameron</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Weinzerl</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Fountain</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Tilak</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Wikelski</surname>
<given-names>M.</given-names>
</name>
<etal/>
</person-group> (<year>2011</year>). <article-title>The Movebank Data Model for Animal Tracking</article-title>. <source>Environ. Model. Softw.</source> <volume>26</volume>, <fpage>834</fpage>&#x2013;<lpage>835</lpage>. <pub-id pub-id-type="doi">10.1016/j.envsoft.2010.12.005</pub-id>
</citation>
</ref>
<ref id="B32">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lafferty</surname>
<given-names>K. D.</given-names>
</name>
<name>
<surname>Allesina</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Arim</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Briggs</surname>
<given-names>C. J.</given-names>
</name>
<name>
<surname>De Leo</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Dobson</surname>
<given-names>A. P.</given-names>
</name>
<etal/>
</person-group> (<year>2008</year>). <article-title>Parasites in Food Webs: the Ultimate Missing Links</article-title>. <source>Ecol. Lett.</source> <volume>11</volume>, <fpage>533</fpage>&#x2013;<lpage>546</lpage>. <pub-id pub-id-type="doi">10.1111/j.1461-0248.2008.01174.x</pub-id>
</citation>
</ref>
<ref id="B33">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lander</surname>
<given-names>E. S.</given-names>
</name>
<name>
<surname>Linton</surname>
<given-names>L. M.</given-names>
</name>
<name>
<surname>Birren</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Nusbaum</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Zody</surname>
<given-names>M. C.</given-names>
</name>
<name>
<surname>Baldwin</surname>
<given-names>J.</given-names>
</name>
<etal/>
</person-group> (<year>2001</year>). <article-title>Initial Sequencing and Analysis of the Human Genome</article-title>. <source>Nature</source> <volume>409</volume>, <fpage>860</fpage>&#x2013;<lpage>921</lpage>. <comment>International Human Genome Sequencing Consortium, Whitehead Institute for Biomedical Research, C. for G.R., The Sanger Centre:, Washington University Genome Sequencing Center, US DOE Joint Genome Institute:, Baylor College of Medicine Human Genome Sequencing Center:, RIKEN Genomic Sciences Center:, Genoscope and CNRS UMR-8030:, Department of Genome Analysis, I. of M.B., GTC Sequencing Center:, Beijing Genomics Institute/Human Genome Center:, Multimegabase Sequencing Center, T.I. for S.B., Stanford Genome Technology Center:, University of Oklahoma&#x2019;s Advanced Center for Genome Technology:, Max Planck Institute for Molecular Genetics:, Cold Spring Harbor Laboratory, L.A.H.G.C., GBF&#x2014;German Research Centre for Biotechnology:, &#x2a;Genome Analysis Group (listed in alphabetical order, also includes individuals listed under other headings):, Scientific management: National Human Genome Research Institute, U.N.I. of H., Stanford Human Genome Center:, University of Washington Genome Center:, Department of Molecular Biology, K.U.S. of M., University of Texas Southwestern Medical Center at Dallas:, Office of Science, U.D. of E., The Wellcome Trust:</comment>. <pub-id pub-id-type="doi">10.1038/35057062</pub-id>
</citation>
</ref>
<ref id="B34">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Leinfelder</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Bowers</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>O&#x2019;Brien</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Jones</surname>
<given-names>M. B.</given-names>
</name>
<name>
<surname>Schildhauer</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2011</year>). &#x201c;<article-title>Using Semantic Metadata for Discovery and Integration of Heterogeneous Ecological Data</article-title>,&#x201d; in <source>Proceedings of the Environmental Information Management Conference (EIM 2011)</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Jones</surname>
<given-names>M. B.</given-names>
</name>
<name>
<surname>Gries</surname>
<given-names>C.</given-names>
</name>
</person-group>, <fpage>92</fpage>&#x2013;<lpage>97</lpage>.</citation>
</ref>
<ref id="B35">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Locey</surname>
<given-names>K. J.</given-names>
</name>
<name>
<surname>Lennon</surname>
<given-names>J. T.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Scaling Laws Predict Global Microbial Diversity</article-title>. <source>Proc. Natl. Acad. Sci. U.S.A.</source> <volume>113</volume>, <fpage>5970</fpage>&#x2013;<lpage>5975</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1521291113</pub-id>
</citation>
</ref>
<ref id="B36">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Michener</surname>
<given-names>W. K.</given-names>
</name>
<name>
<surname>Allard</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Budden</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Cook</surname>
<given-names>R. B.</given-names>
</name>
<name>
<surname>Douglass</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Frame</surname>
<given-names>M.</given-names>
</name>
<etal/>
</person-group> (<year>2012</year>). <article-title>Participatory Design of DataONE-Enabling Cyberinfrastructure for the Biological and Environmental Sciences</article-title>. <source>Ecol. Inf.</source> <volume>11</volume>, <fpage>5</fpage>&#x2013;<lpage>15</lpage>. <pub-id pub-id-type="doi">10.1016/j.ecoinf.2011.08.007</pub-id>
</citation>
</ref>
<ref id="B37">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Michener</surname>
<given-names>W. K.</given-names>
</name>
<name>
<surname>Jones</surname>
<given-names>M. B.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Ecoinformatics: Supporting Ecology as a Data-Intensive Science</article-title>. <source>Trends Ecol. Evol.</source> <volume>27</volume>, <fpage>85</fpage>&#x2013;<lpage>93</lpage>. <pub-id pub-id-type="doi">10.1016/j.tree.2011.11.016</pub-id>
</citation>
</ref>
<ref id="B38">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mitani</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Andrews</surname>
<given-names>R. D.</given-names>
</name>
<name>
<surname>Sato</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Kato</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Naito</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Costa</surname>
<given-names>D. P.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>Three-dimensional Resting Behaviour of Northern Elephant Seals: Drifting like a Falling Leaf</article-title>. <source>Biol. Lett.</source> <volume>6</volume>, <fpage>163</fpage>&#x2013;<lpage>166</lpage>. <pub-id pub-id-type="doi">10.1098/rsbl.2009.0719</pub-id>
</citation>
</ref>
<ref id="B39">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Peng</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>The Reproducibility Crisis in Science: A Statistical Counterattack</article-title>. <source>Significance</source> <volume>12</volume>, <fpage>30</fpage>&#x2013;<lpage>32</lpage>. <pub-id pub-id-type="doi">10.1111/j.1740-9713.2015.00827.x</pub-id>
</citation>
</ref>
<ref id="B40">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Quinn</surname>
<given-names>P. J.</given-names>
</name>
<name>
<surname>Barnes</surname>
<given-names>D. G.</given-names>
</name>
<name>
<surname>Csabai</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Cui</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Genova</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Hanisch</surname>
<given-names>B.</given-names>
</name>
<etal/>
</person-group> (<year>2004</year>). &#x201c;<article-title>The International Virtual Observatory Alliance: Recent Technical Developments and the Road Ahead</article-title>,&#x201d; in <conf-name>Proceedings of SPIE</conf-name>. <volume>Vol. 5493</volume>, <fpage>137</fpage>. <pub-id pub-id-type="doi">10.1117/12.551247</pub-id>
</citation>
</ref>
<ref id="B41">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sequeira</surname>
<given-names>A. M. M.</given-names>
</name>
<name>
<surname>O&#x27;Toole</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Keates</surname>
<given-names>T. R.</given-names>
</name>
<name>
<surname>McDonnell</surname>
<given-names>L. H.</given-names>
</name>
<name>
<surname>Braun</surname>
<given-names>C. D.</given-names>
</name>
<name>
<surname>Hoenner</surname>
<given-names>X.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>A Standardisation Framework for Bio&#x2010;logging Data to Advance Ecological Research and Conservation</article-title>. <source>Methods Ecol. Evol.</source> <volume>12</volume>, <fpage>996</fpage>&#x2013;<lpage>1007</lpage>. <pub-id pub-id-type="doi">10.1111/2041-210X.13593</pub-id>
</citation>
</ref>
<ref id="B42">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Tsontos</surname>
<given-names>V. M.</given-names>
</name>
<name>
<surname>Chihin</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Arms</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2020</year>). <source>NASA-OIIP netCDF Templates for Electronic Tagging Data: The Nc-eTAG File Format and Metadata Specification (Version 1.0)</source>. <comment>[WWW Document]. figshare</comment>. <pub-id pub-id-type="doi">10.6084/m9.figshare.10159820.v1</pub-id>
</citation>
</ref>
<ref id="B43">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Vidoni</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2021</year>).<article-title>Evaluating Unit Testing Practices in R Packages</article-title>. <conf-name>Proceeding of the 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE). Presented at the 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE)</conf-name>, <conf-date>May 2021</conf-date>, <conf-loc>Madrid, ES</conf-loc>. <publisher-name>IEEE</publisher-name>, <fpage>1523</fpage>&#x2013;<lpage>1534</lpage>. <pub-id pub-id-type="doi">10.1109/ICSE43902.2021.00136</pub-id>
</citation>
</ref>
<ref id="B44">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Williams</surname>
<given-names>T. M.</given-names>
</name>
<name>
<surname>Blackwell</surname>
<given-names>S. B.</given-names>
</name>
<name>
<surname>Richter</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Sinding</surname>
<given-names>M.-H. S.</given-names>
</name>
<name>
<surname>Heide-J&#xf8;rgensen</surname>
<given-names>M. P.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Paradoxical Escape Responses by Narwhals ( Monodon Monoceros )</article-title>. <source>Science</source> <volume>358</volume>, <fpage>1328</fpage>&#x2013;<lpage>1331</lpage>. <pub-id pub-id-type="doi">10.1126/science.aao2740</pub-id>
</citation>
</ref>
<ref id="B45">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Williams</surname>
<given-names>H. J.</given-names>
</name>
<name>
<surname>Shepard</surname>
<given-names>E. L. C.</given-names>
</name>
<name>
<surname>Holton</surname>
<given-names>M. D.</given-names>
</name>
<name>
<surname>Alarc&#xf3;n</surname>
<given-names>P. A. E.</given-names>
</name>
<name>
<surname>Wilson</surname>
<given-names>R. P.</given-names>
</name>
<name>
<surname>Lambertucci</surname>
<given-names>S. A.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Physical Limits of Flight Performance in the Heaviest Soaring Bird</article-title>. <source>Proc. Natl. Acad. Sci. U.S.A.</source> <volume>117</volume>, <fpage>17884</fpage>&#x2013;<lpage>17890</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1907360117</pub-id>
</citation>
</ref>
<ref id="B46">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wilmers</surname>
<given-names>C. C.</given-names>
</name>
<name>
<surname>Nickel</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Bryce</surname>
<given-names>C. M.</given-names>
</name>
<name>
<surname>Smith</surname>
<given-names>J. A.</given-names>
</name>
<name>
<surname>Wheat</surname>
<given-names>R. E.</given-names>
</name>
<name>
<surname>Yovovich</surname>
<given-names>V.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>The Golden Age of Bio-Logging: How Animal-Borne Sensors Are Advancing the Frontiers of Ecology</article-title>. <source>Ecology</source> <volume>96</volume>, <fpage>1741</fpage>&#x2013;<lpage>1753</lpage>. <pub-id pub-id-type="doi">10.1890/14-1401.1</pub-id>
</citation>
</ref>
<ref id="B47">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wratten</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Wilm</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>G&#xf6;ke</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Reproducible, Scalable, and Shareable Analysis Pipelines with Bioinformatics Workflow Managers</article-title>. <source>Nat. Methods</source> <volume>18</volume>, <fpage>1161</fpage>&#x2013;<lpage>1168</lpage>. <pub-id pub-id-type="doi">10.1038/s41592-021-01254-9</pub-id>
</citation>
</ref>
</ref-list>
</back>
</article>