<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Ecol. Evol.</journal-id>
<journal-title>Frontiers in Ecology and Evolution</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Ecol. Evol.</abbrev-journal-title>
<issn pub-type="epub">2296-701X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fevo.2018.00016</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Ecology and Evolution</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>The Influence of Social Information and Self-expertise on Emergent Task Allocation in Virtual Groups</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Nakayama</surname> <given-names>Shinnosuke</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/317409/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Diner</surname> <given-names>David</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Holland</surname> <given-names>Jacob G.</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Bloch</surname> <given-names>Guy</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/36374/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Porfiri</surname> <given-names>Maurizio</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="author-notes" rid="fn001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/167252/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Nov</surname> <given-names>Oded</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="author-notes" rid="fn002"><sup>&#x0002A;</sup></xref>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering</institution>, <addr-line>Brooklyn, NY</addr-line>, <country>United States</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Ecology, Evolution and Behavior, The Hebrew University of Jerusalem</institution>, <addr-line>Jerusalem</addr-line>, <country>Israel</country></aff>
<aff id="aff3"><sup>3</sup><institution>Department of Technology Management and Innovation, New York University Tandon School of Engineering</institution>, <addr-line>Brooklyn, NY</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Simon Garnier, New Jersey Institute of Technology, United States</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Mehdi Moussaid, Max Planck Institute for Human Development (MPG), Germany; Takao Sasaki, Arizona State University, United States</p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x0002A;Correspondence: Maurizio Porfiri <email>mporfiri&#x00040;nyu.edu</email></p></fn>
<fn fn-type="corresp" id="fn002"><p>Oded Nov <email>onov&#x00040;nyu.edu</email></p></fn>
<fn fn-type="other" id="fn003"><p>This article was submitted to Behavioral and Evolutionary Ecology, a section of the journal Frontiers in Ecology and Evolution</p></fn></author-notes>
<pub-date pub-type="epub">
<day>21</day>
<month>02</month>
<year>2018</year>
</pub-date>
<pub-date pub-type="collection">
<year>2018</year>
</pub-date>
<volume>6</volume>
<elocation-id>16</elocation-id>
<history>
<date date-type="received">
<day>20</day>
<month>12</month>
<year>2017</year>
</date>
<date date-type="accepted">
<day>06</day>
<month>02</month>
<year>2018</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2018 Nakayama, Diner, Holland, Bloch, Porfiri and Nov.</copyright-statement>
<copyright-year>2018</copyright-year>
<copyright-holder>Nakayama, Diner, Holland, Bloch, Porfiri and Nov</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Dynamic group coordination facilitates adaptive division of labor in response to group-level changes. Yet, little is known about how it can be operationalized in online collaborations among individuals with limited information about each other. We hypothesized that simple social information about the task distribution of others can elicit emergent task allocation. We conducted an online experiment where participants analyze images of a polluted canal by freely switching between two tasks: creating keyword-based tags for images and categorizing existing tags. During the task execution, we presented experimentally manipulated information about the contrasting group-level task distributions. Participants did not change the effort allocation between the tasks when they were notified that the group is deficient in workers in the task they intrinsically prefer. By contrast, they allocated more effort to the less preferred task than they would intrinsically do when their intrinsic effort allocation counterbalances the current distribution of workers in the group. Such behavioral changes were observed more strongly among those with higher skills in the less preferred task. Our results demonstrate the possibility of optimizing group coordination through design interventions at the individual level that lead to spontaneous adaption of division of labor at the group level. When participants were provided information about the group-level task distribution, they tend to allocate more effort to the task against their intrinsic preference.</p>
</abstract>
<kwd-group>
<kwd>behavioral plasticity</kwd>
<kwd>citizen science</kwd>
<kwd>collective behavior</kwd>
<kwd>content creation</kwd>
<kwd>content curation</kwd>
<kwd>crowdsourcing</kwd>
<kwd>division of labor</kwd>
</kwd-group>
<contract-num rid="cn001">BCS 1124795</contract-num>
<contract-num rid="cn001">IIS 1149745</contract-num>
<contract-num rid="cn001">CBET 1547864</contract-num>
<contract-num rid="cn001">CMMI 1644828</contract-num>
<contract-sponsor id="cn001">National Science Foundation<named-content content-type="fundref-id">10.13039/100000001</named-content></contract-sponsor>
<counts>
<fig-count count="5"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="56"/>
<page-count count="9"/>
<word-count count="6441"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>1. Introduction</title>
<p>In groups, division of labor often emerges through task specialization, which constitutes an efficient way to perform collective tasks (Smith, <xref ref-type="bibr" rid="B43">1776</xref>). However, groups composed of specialists may not function efficiently in dynamically varying social environments, where the distribution of workers across tasks may change over time. An economical solution to efficient division of labor may be afforded by coordinated task allocation in response to changes in the operational environment, considering that adaptability is one of the most fundamental prerequisites for effective teamwork (Burke et al., <xref ref-type="bibr" rid="B7">2006</xref>). Team adaptation can be realized through team situational awareness (Salas et al., <xref ref-type="bibr" rid="B41">1995</xref>), which emerges from shared understanding of the current situation within teams. Combined with shared mental models of task requirement and responsibility (Salas et al., <xref ref-type="bibr" rid="B39">2001</xref>) and mutual performance monitoring (McIntyre and Salas, <xref ref-type="bibr" rid="B30">1995</xref>), members could spontaneously adjust their roles to meet the need of others, and consequently, teams could operationalize adaptively in the new environment (Serfaty et al., <xref ref-type="bibr" rid="B42">1993</xref>; Entin and Serfaty, <xref ref-type="bibr" rid="B10">1999</xref>). Thus, information on the group&#x00027;s needs is expected to elicit coordinated task allocation toward the balanced division of labor.</p>
<p>A key factor for adaptive group performance is communication (Burke et al., <xref ref-type="bibr" rid="B7">2006</xref>; Mastrogiacomo et al., <xref ref-type="bibr" rid="B29">2014</xref>). Through communication, groups can construct shared knowledge about the expertise of members, called transactive memory (Stewart and Stasser, <xref ref-type="bibr" rid="B46">1995</xref>). With transactive memory, group members can allocate their responsibilities among tasks based on their expertise and adaptively coordinate task allocation in response to changes in the environment, based on a shared mental model (Stasser et al., <xref ref-type="bibr" rid="B44">1995</xref>). For example, group members with higher skills in a task may be more likely to switch to that task when there is a deficit of people working on this task to facilitate the achievement of the collective goal. Once transactive memory is developed in a group, members can coordinate task allocation through the existing transactive memory even without further communication (Wegner et al., <xref ref-type="bibr" rid="B50">1991</xref>; Wittenbaum et al., <xref ref-type="bibr" rid="B54">1996</xref>, <xref ref-type="bibr" rid="B55">1998</xref>; Hollingshead, <xref ref-type="bibr" rid="B17">2000</xref>). For example, Littlepage et al. (<xref ref-type="bibr" rid="B23">2008</xref>) found no effect of communication on group performance when members already had transactive memory. However, transactive memory would be difficult to develop in the first place in groups with limited communication tools, such as online communities, or short-lived groups that do not have time to do so. Presently, it is not clear whether these groups are still able to coordinate without communication or transactive memory in response to changes in the operational environment when provided only with social information about the current task allocation.</p>
<p>Crowdsourcing, an online practice of enlisting a large number of people to perform micro-tasks, offers a unique experimental setting to systematically investigate group coordination. Recent studies have explored collective tasks in crowdsourcing projects, where participants spontaneously allocate themselves among different activities (Luther et al., <xref ref-type="bibr" rid="B25">2009</xref>; Willett et al., <xref ref-type="bibr" rid="B53">2011</xref>; Valdes et al., <xref ref-type="bibr" rid="B49">2012</xref>). Common tasks performed in crowdsourcing projects are content creation and content curation. In content creation, participants act as distributed sensors to gather information. In ARTigo (<ext-link ext-link-type="uri" xlink:href="http://www.artigo.org">www.artigo.org</ext-link>), for example, people tag images of artwork with the associated words, such as style and emotions, toward building a search engine for artwork. In content curation, participants act as distributed processors to extract semantic information from the large amount of data created by automated monitoring systems or human participants. In Snapshot Serengeti (<ext-link ext-link-type="uri" xlink:href="http://www.snapshotserengeti.org">www.snapshotserengeti.org</ext-link>), people categorize images of wildlife into species online, which helps understand the distribution of wildlife. When participants share an objective in conducting crowdsourcing projects with multiple activities, they may coordinate their task allocation as a virtual group, and consequently, overall output of the projects may increase (Dissanayake et al., <xref ref-type="bibr" rid="B9">2015</xref>).</p>
<p>The use of crowdsourcing has been shown to be particularly advantageous in performing hypothesis-driven studies on human behavior in socio-technical settings, where computer interface can be used as a customizable and controllable stimulus to identify determinants of behavior. For example, crowdsourcing has been used to investigate risk preference (Eriksson and Simpson, <xref ref-type="bibr" rid="B11">2010</xref>), performance changes with group size (Mao et al., <xref ref-type="bibr" rid="B26">2016</xref>), and social dilemma in networks (Suri and Watts, <xref ref-type="bibr" rid="B48">2011</xref>). These efforts have contributed to validating the high-degree of reproducibility of crowdsourcing-based behavioral studies (Rand, <xref ref-type="bibr" rid="B37">2012</xref>) in agreement with traditional studies (Paolacci et al., <xref ref-type="bibr" rid="B35">2010</xref>; Behrend et al., <xref ref-type="bibr" rid="B6">2011</xref>; Mason and Suri, <xref ref-type="bibr" rid="B27">2012</xref>; Crump et al., <xref ref-type="bibr" rid="B8">2013</xref>). Thus, using crowdsourcing enables the experimenter to control the social signals provided to participants and precisely identify the specific activities associated with the labor.</p>
<p>Beyond its potential value in social behavior, addressing group coordination in crowdsourcing has compelling implications for our capacity to design efficient collective tasks in online communities. Just as the specific motivational factors contributing to the division of labor are presently unclear, the role of social information on group coordination in crowdsourcing remains elusive. An improved understanding of these aspects could inform design interventions for collective tasks (Feigh et al., <xref ref-type="bibr" rid="B13">2012</xref>; Nov et al., <xref ref-type="bibr" rid="B33">2014</xref>). Such interventions could modulate social signals to elicit the dynamic assignment of people to selected tasks toward optimized collaboration in a shared effort.</p>
<p>Here, we investigated the roles of social information and individual differences (Nov et al., <xref ref-type="bibr" rid="B34">2013</xref>) in skill levels on spontaneous task allocation when people collaborate toward a shared objective in a crowdsourcing effort as a short-lived virtual group without the possibility of communication. Resting on the premises that humans are social animals that exhibit high behavioral plasticity in response to changes in social environments (Aronson, <xref ref-type="bibr" rid="B3">1972</xref>) and that task specialization is an efficient way to perform collective tasks (West et al., <xref ref-type="bibr" rid="B52">2015</xref>), we hypothesized that workers in projects that are aimed at a collective goal will distribute themselves into tasks to balance the distribution of workers across the tasks. Specifically, when the number of workers on a certain task is perceived to be deficient, there should be an increased tendency of others to switch to that task. Further, we hypothesized that people who display higher skill levels in the deficient task would show stronger behavioral tendency to choose that task without knowing skill levels of others. We tested our hypotheses by providing experimentally manipulated social information about the distribution of workers between contrasting tasks (creating or curating content), using a crowdsourcing project (Laut et al., <xref ref-type="bibr" rid="B21">2014</xref>) as the experimental setup.</p>
</sec>
<sec sec-type="materials and methods" id="s2">
<title>2. Materials and methods</title>
<sec>
<title>2.1. Infrastructure</title>
<p>The Brooklyn Atlantis citizen science project was designed to monitor the environmental health of the Gowanus Canal (Brooklyn, NY, USA), one of the most polluted bodies of water in the U.S. On the web-based platform, participants access the images taken by an aquatic robot and can create tags on any notable objects in the images. We modified the Brooklyn Atlantis infrastructure to allow participants to perform two tasks: an image tagging task and a tag categorization task (Figure <xref ref-type="fig" rid="F1">1</xref>). In the image tagging task, participants are presented with an image, and are instructed to select any notable object using a mouse and type the description using a keyboard. They are allowed to create as many image tags as they want on the same image. In the tag categorizing task, participants are presented with an existing tag associated with a particular image, created by other participants. When participants hover the mouse over the tag, they are displayed a portion of the image associated with the tag text. To assign a category to a tag, participants drag the tag text to one of the categories presented at the bottom of the screen, such as &#x0201C;nature,&#x0201D; &#x0201C;waste/debris,&#x0201D; and &#x0201C;human-made structure.&#x0201D; Each tag can belong to only one category.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Screenshots of a tagging mode <bold>(Left)</bold> and a categorizing mode <bold>(Right)</bold>.</p></caption>
<graphic xlink:href="fevo-06-00016-g0001.tif"/>
</fig>
<p>The platform records the number of images participants tagged and categorized. Detailed instructions for each task are included on the task screens. Additionally, the application displays to participants the number of other people currently working each of the two tasks.</p>
</sec>
<sec>
<title>2.2. Experiment</title>
<p>We recruited U.S. participants from Amazon Mechanical Turk. A flow chart in Figure <xref ref-type="fig" rid="F2">2</xref> summarizes the experimental procedure. First, participants were presented with the collective objective: a short paragraph was displayed to them, explaining that the images and tags come from an environmental monitoring project and that participation will aid the project&#x00027;s effort in assembling an image repository. This was aimed at increasing participants&#x00027; motivations by framing the crowdsourcing effort as a scientific activity with societal benefits, and laying a collective objective to be accomplished through both the tagging and categorization tasks. The participants were informed that monetary compensation did not depend on either the individual&#x00027;s or the group&#x00027;s output. Then, participants were asked to complete a 4-min online tutorial on both the tagging and categorizing tasks (Figure <xref ref-type="fig" rid="F1">1</xref>). After completing the tutorial, participants proceeded by clicking a button to a 3-min trial session, in which they familiarized themselves with the application. During this session, participants were allowed to switch freely between the two tasks by clicking &#x0201C;Switch Tasks&#x0201D; or continue to the next image by clicking &#x0201C;Next.&#x0201D;</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>A flow chart of the experimental procedure.</p></caption>
<graphic xlink:href="fevo-06-00016-g0002.tif"/>
</fig>
<p>After the trial session, participants proceeded by clicking a button to the main experimental session in which they were instructed to work on their tasks of choice for 8 min, during which they could freely switch between tasks or continue working on the same task. The first task displayed on the screen was randomized in the trial and main sessions, which controlled for any bias caused by participants simply continuing in the first task they encountered during the experiment.</p>
<p>To investigate spontaneous task allocation in response to the task choices of others, we displayed experimentally manipulated information about the number of other participants performing the tagging and categorizing tasks throughout the main session (Table <xref ref-type="table" rid="T1">1</xref>). Each participant was randomly assigned to one of four experimental conditions: In the control condition, participants were given no social information on how many people were engaged in either task. In the &#x0201C;categorizers deficient&#x0201D; condition, participants were informed that 14 people were tagging and 1 person was categorizing. In the &#x0201C;taggers deficient&#x0201D; condition, they were informed that 1 person was tagging and 14 people were categorizing. In the &#x0201C;balanced&#x0201D; condition, they were informed that seven people were tagging and seven people were categorizing. The displayed numbers included the participant. When the participant switched the task, the numbers were adjusted accordingly to keep the total number of other participants constant throughout the main session.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>The numbers of taggers and categorizers displayed to the participants in the main session.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Treatment</bold></th>
<th valign="top" align="center"><bold>Number of taggers</bold></th>
<th valign="top" align="center"><bold>Number of categorizers</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Control</td>
<td valign="top" align="center">None</td>
<td valign="top" align="center">None</td>
</tr>
<tr>
<td valign="top" align="left">&#x0201C;Taggers deficient&#x0201D;</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">14</td>
</tr>
<tr>
<td valign="top" align="left">&#x0201C;Balanced&#x0201D;</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">&#x0201C;Categorizers deficient&#x0201D;</td>
<td valign="top" align="center">14</td>
<td valign="top" align="center">1</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Participants were automatically logged out of the system when they were inactive for 10 min in the main session or for 30 min in the entire experiment. As a result, we had 94 participants in the control condition, 121 participants in the &#x0201C;categorizers deficient&#x0201D; condition, 57 participants in the &#x0201C;balanced&#x0201D; condition, and 109 participants in &#x0201C;taggers deficient&#x0201D; condition, totaling 381 participants. Upon finishing the whole session, participants were paid $2.50. Each participant was allowed to participate in the experiment only once.</p>
<p>This study was exempt from an institutional review board and did not require an approval by an ethics committee, as the methods and experimental protocols fell under the category of exempt research by University Committee on Activities Involving Human Subjects. The informed consent was obtained from all subjects to participate in the study.</p>
</sec>
<sec>
<title>2.3. Analysis</title>
<p>First, we investigated whether the social information presented to participants changed their choice of tasks. We used a generalized linear model with treatment (control, &#x0201C;categorizers deficient,&#x0201D; &#x0201C;balanced,&#x0201D; and &#x0201C;taggers deficient&#x0201D;) as a predictor variable and the numbers of images tagged and categorized by each participant as response variables, specifying binomial errors with a logit link [R package lme4 v.1.1-12 (Bates et al., <xref ref-type="bibr" rid="B5">2015</xref>)]. The effect of each treatment was compared to the control condition using a Wald test, whose statistic is equal to a <italic>z</italic>-score. The statistical significance was adjusted for multiple comparisons using Dunnett&#x00027;s test [R package multcomp v.1.4-6 (Hothorn et al., <xref ref-type="bibr" rid="B18">2008</xref>)]. Participants who did not switch the task during the entire session (i.e., the trail and main sessions) were excluded from the analysis to eliminate the possibility that they did not understand the functionality of the platform (<italic>n</italic> &#x0003D; 13 in control, 24 in &#x0201C;categorizers deficient,&#x0201D; 8 in &#x0201C;balanced,&#x0201D; and 15 in &#x0201C;taggers deficient&#x0201D;). Subsequently, the analysis was conducted using 321 participants in total, with 81 participants in the control condition, 97 participants in the &#x0201C;categorizers deficient&#x0201D; condition, 49 participants in the &#x0201C;balanced&#x0201D; condition, and 94 participants in the &#x0201C;taggers deficient&#x0201D; condition.</p>
<p>Next, we investigated whether the spontaneous task allocation was influenced by the participant&#x00027;s skill levels of performing one task relative to the other. We assessed individual skill levels as the speed of tagging relative to that of categorizing, considering that time is a resource that is limited equally to all participants during the task. Specifically, using the data in the trial session, we calculated the proportion of the speed of tagging per image over the sum of the speeds of tagging and categorizing for each individual. The relative speed of tagging ranges between 0 and 1, with large values indicating that participants perform the tagging task faster than the categorizing task per image. We also checked the consistency of the relative speed of tagging over time by comparing between the trial session and the main session in the control condition (i.e., no social information on others) using Pearson&#x00027;s correlation test. To test the effect of the relative speed of tagging on task allocation, we used a generalized linear model, specifying binomial errors with a logit link. As predictor variables, we specified treatment and participant&#x00027;s relative speed of tagging as main effects and the interaction of the two. Significance of the interaction term was checked using a likelihood ratio test by comparing the fit of the model with and without the interaction term. Significance of each coefficient was checked using a Wald test with Bonferroni correction for multiple comparisons (Zuur et al., <xref ref-type="bibr" rid="B56">2009</xref>).</p>
<p>Finally, we explored the rationale of the potential influence of the relative skill levels on spontaneous task allocation without a possibility of communication. Specifically, we investigated whether the relative skill level of an individual was associated with the absolute skill level of the individual among all participants. We tested for correlation between the relative speed of tagging and the absolute speed of tagging among all participants in the trial session using Pearson&#x00027;s correlation test.</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>3. Results</title>
<p>In the 3-min trial session, where no social information was provided, participants (<italic>n</italic> &#x0003D; 321) created 10.3 &#x000B1; 5.5 (mean &#x000B1; standard deviation) tags and categorized 25.7 &#x000B1; 14.7 tags. They spent 87.6 &#x000B1; 35.5 s on tagging and 92.4 &#x000B1; 35.5 s on categorizing. As a result, participants created 0.12 &#x000B1; 0.05 tags/s and categorized 0.27 &#x000B1; 0.09 tags/s, spending 32.4 &#x000B1; 18.6% of time on tagging. In the 8-min main session, participants in the control condition (<italic>n</italic> &#x0003D; 81) created 29.8 &#x000B1; 16.8 tags in 209.7 &#x000B1; 97.7 s and categorized 83.4 &#x000B1; 40.5 tags in 270.3 &#x000B1; 97.7 s. As a result, they created 0.14 &#x000B1; 0.05 tags/s and categorized 0.31 &#x000B1; 0.09 tags/s.</p>
<p>In the 8-min main session, the social information presented to participants influenced the choice of task (Figure <xref ref-type="fig" rid="F3">3</xref>). When participants did not receive any social information, they performed the categorizing task more often than the tagging task (73.7% on average, <italic>z</italic> &#x0003D; 43.445, <italic>p</italic> &#x0003C; 0.001), indicating that participants were intrinsically biased in task choice toward categorizing. However, when participants received social information that taggers were deficient in the group (&#x0201C;taggers deficient&#x0201D; condition), participants changed their actions to counterbalance the distribution of workers by performing a tagging task more often compared to the control condition (<italic>z</italic> &#x0003D; 10.855, <italic>p</italic> &#x0003C; 0.001). Similarly, when participants were informed that others were distributed evenly between the tasks in the group (&#x0201C;balanced&#x0201D; condition), they changed from the intrinsic task choice that were biased toward categorizing and performed a tagging task more often compared to the control condition (<italic>z</italic> &#x0003D; 3.702, <italic>p</italic> &#x0003C; 0.001). By contrast, when participants were notified that group distribution between the tasks was strongly biased against the intrinsic task choice (&#x0201C;categorizers deficient&#x0201D; condition), they did not change their actions compared to the control condition (<italic>z</italic> &#x0003D; &#x02212;1.203, <italic>p</italic> &#x0003D; 0.485).</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>Proportion of the number of tagging acts over the total number of tagging &#x0002B; categorizing acts in different conditions: control condition (no social information), &#x0201C;categorizers deficient&#x0201D; condition (14 taggers and 1 categorizer), &#x0201C;balanced&#x0201D; condition (7 taggers and 7 categorizers), and &#x0201C;taggers deficient&#x0201D; condition (1 tagger and 14 categorizers). Asterisks indicate significant difference (<italic>p</italic> &#x0003C; 0.05) compared to the control condition. Vertical lines indicate 95% confidence intervals.</p></caption>
<graphic xlink:href="fevo-06-00016-g0003.tif"/>
</fig>
<p>Participants&#x00027; relative speed of tagging was consistent across trials (Figure <xref ref-type="fig" rid="F4">4</xref>). The relative speed of tagging was positively correlated between the trial session and the main session in the control condition (Person&#x00027;s correlation test, <italic>r</italic> &#x0003D; 0.368, <italic>t</italic> &#x0003D; 3.522, <italic>df</italic> &#x0003D; 79, <italic>p</italic> &#x0003C; 0.001). Further, the relative speed of tagging within a participant was highly correlated with the absolute speed of tagging among all participants in the trial session (<italic>r</italic> &#x0003D; 0.511, <italic>t</italic> &#x0003D; 10.614, <italic>df</italic> &#x0003D; 319, <italic>p</italic> &#x0003C; 0.001).</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p>Participant&#x00027;s relative speed of tagging in the trial session and the main session. Relative speed of tagging was calculated as the proportion of tagging speed over the total speed (tagging and categorizing).</p></caption>
<graphic xlink:href="fevo-06-00016-g0004.tif"/>
</fig>
<p>Spontaneous task allocation was determined by both the treatment and participant&#x00027;s relative speed of tagging (Figure <xref ref-type="fig" rid="F5">5</xref>). Overall, we found a significant interaction between treatment and the relative speed of tagging (Likelihood ratio test, <inline-formula><mml:math id="M1"><mml:msubsup><mml:mrow><mml:mi>&#x003C7;</mml:mi></mml:mrow><mml:mrow><mml:mn>3</mml:mn></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:mn>97</mml:mn><mml:mo>.</mml:mo><mml:mn>224</mml:mn></mml:math></inline-formula>, adjusted <italic>p</italic> &#x0003C; 0.001), indicating that relationship between task choice and relative speed of tagging depended on the treatments. When the &#x0201C;categorizers deficient&#x0201D; condition was compared to the control condition, there was no significant interaction between conditions and the relative speed of tagging (<italic>z</italic> &#x0003D; &#x02212;0.446, adjusted <italic>p</italic> &#x0003E; 0.999). By contrast, when the &#x0201C;balanced&#x0201D; condition was compared to the control condition, the relative speed of tagging showed a positive interaction with condition (<italic>z</italic> &#x0003D; 4.539, adjusted <italic>p</italic> &#x0003C; 0.001), indicating that participants with higher speeds of tagging relative to categorizing were more likely to perform the tagging task, compared to the participants in the control condition. A similar relationship was found in the &#x0201C;taggers deficient&#x0201D; condition, where participants with higher speeds of tagging were more likely to switch to a tagging task (<italic>z</italic> &#x0003D; 7.015, adjusted <italic>p</italic> &#x0003C; 0.001).</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p>Effects of the relative speed of tagging on task choice. <bold>(A)</bold> &#x0201C;Categorizers deficient&#x0201D; condition, <bold>(B)</bold> &#x0201C;balanced&#x0201D; condition, <bold>(C)</bold> &#x0201C;taggers deficient&#x0201D; condition. Dashed lines represent the control condition, and solid lines represent the treatment conditions with some form of social information. Each point represents the number of images tagged (top) and categorized (bottom) by each individual. The point size is proportional to the number.</p></caption>
<graphic xlink:href="fevo-06-00016-g0005.tif"/>
</fig>
</sec>
<sec sec-type="discussion" id="s4">
<title>4. Discussion</title>
<p>The results confirm our hypothesis that people spontaneously allocate their tasks toward balancing the division of labor in response to social information about the worker distribution when they perform a collective task. Specifically, when people were notified that the group deficits workers in the categorizing task (i.e., the &#x0201C;categorizers deficient&#x0201D; condition), they did not change their intrinsic task choice, which was biased toward categorizing. By contrast, they allocated more effort to the less preferred task than they would intrinsically do when their intrinsic task choice counterbalances the current distribution of workers in the group (i.e., the &#x0201C;taggers deficient&#x0201D; and &#x0201C;balanced&#x0201D; conditions). Therefore, our results suggest that the social information elicits spontaneous task allocation when people are working toward a collective goal.</p>
<p>Further, in agreement with our expectations, the findings revealed that the extent of the observed behavioral changes depended on the participant&#x00027;s skill levels. In both the &#x0201C;taggers deficient&#x0201D; and &#x0201C;balanced&#x0201D; conditions, a stronger behavioral change toward tagging against their intrinsic inclination to categorizing was found in participants who exhibited higher skill levels in tagging compared to categorizing (i.e., faster speed of tagging relative to categorizing). By contrast, participants with low tagging speed were less likely to change their task choice from their intrinsic inclination to categorizing in the same situations. In our study, it is plausible that participants with low tagging speed exhibited limited changes in task allocation toward tagging as they assumed that they would contribute less to the group output if they changed their behavior. Therefore, people working as a group toward a collective goal are likely to use their skill level in each task in deciding task allocation, possibly to optimize group performance when direct communication is not possible.</p>
<p>Naturally, the amount of information curated should be similar to the amount of information created toward maximizing group output, and participants in a collective task changed their task choices to the expected direction. When they were not able to communicate to assess their own skill levels relative to others, participants used their skill levels of one task relative to the other as a reference for changing their actions. This is seemingly counterintuitive, since knowledge of the relative skills of a participant should not constitute a valid appraisal of the absolute skills of the participant in a group. However, the relative speed of tagging of each participant was highly correlated with the absolute speed of tagging among other participants, suggesting that self-assessment may offer an efficient indicator for the contribution to the group in collective tasks. Thus, in agreement with our hypothesis, participants with high skill levels in a specific task tended to contribute more to it as a compensatory strategy to increase group output (Salas et al., <xref ref-type="bibr" rid="B40">2015</xref>). Further study is needed to test whether participants would exhibit more adaptive behavioral responses to the social information when provided with information about the absolute skill levels of participants within a group.</p>
<p>Our results show that the social information elicited behavioral change even in the &#x0201C;balanced&#x0201D; condition, where people performed the tagging task more often than they would intrinsically do, such that the efforts were evenly distributed between the tasks at a group level. However, social information on the task distribution might exert a weaker influence in larger groups, as people could feel negligible contributions of changing their behavior to the group. Responses to social information would also hinge on the rewarding schemes. In contrast to our experiment, rewarding group performance might facilitate behavioral changes against the individual preference toward a more balanced division of labor, whereas rewarding individual performance might hinder such behavioral changes by eliciting selfish behavior.</p>
<p>Our study was grounded in the use of crowdsourcing as an experimental platform to investigate changes in division of labor in virtual groups. This platform was pivotal in testing our hypothesis, by providing the possibility to systematically select social interactions, precisely identify tasks, and present the social information in real time. Beyond these methodological advantages, crowdsourcing allows to reach a diverse background of participants and optimizes cost- and time-effectiveness, in comparison with more traditional experimental settings (Mason and Suri, <xref ref-type="bibr" rid="B27">2012</xref>). However, the use of crowdsourcing could also raise concerns about the generalizability of our findings, which are based on experiments where social influences occurred only in a virtual setting and the users were paid to participate. While it could be proposed that these factors might change motivations of participants, potentially eliciting more selfish behavior (Kohn, <xref ref-type="bibr" rid="B20">1993</xref>), recent studies have indicated that paid participants in crowdsourcing exhibit the same heuristics in behavior as those in traditional methods (Paolacci et al., <xref ref-type="bibr" rid="B35">2010</xref>) and that data quality is not affected by the amount of payment (Mason and Watts, <xref ref-type="bibr" rid="B28">2009</xref>). These concerns are further assuaged by our findings that participants indeed exhibited spontaneous task allocation in response to social information and expertise to the expected direction as adaptive groups would do, in a similar way that group members lend support to one another if necessary (Porter et al., <xref ref-type="bibr" rid="B36">2003</xref>).</p>
<p>Although our results demonstrate that people can utilize simple social information to balance the division of labor, they do not undermine the importance of communication in adaptive group coordination. Numerous studies demonstrate that communication enhances group performance by allowing group members to identify expertise and knowledge of others (Stasser et al., <xref ref-type="bibr" rid="B44">1995</xref>; Argote and Olivera, <xref ref-type="bibr" rid="B2">1999</xref>) and allocating task responsibilities in such a way to utilize their expertise (Hackman, <xref ref-type="bibr" rid="B16">1987</xref>; Littlepage et al., <xref ref-type="bibr" rid="B24">1995</xref>, <xref ref-type="bibr" rid="B22">1997</xref>; Stempfle et al., <xref ref-type="bibr" rid="B45">2001</xref>). Further, communication can enhance adaptive group coordination in the dynamic environment by helping members to learn from each other and foster team situational awareness (West, <xref ref-type="bibr" rid="B51">2004</xref>). Thus, communication is an important factor for groups to capitalize the synergetic potential. However, laying the foundation for direct communication is challenging in online communities with limited communication tools. In these communities, performance could be enhanced by implementing information sharing mechanisms, in which people can share their knowledge (Kankanhalli et al., <xref ref-type="bibr" rid="B19">2005</xref>; Espinosa et al., <xref ref-type="bibr" rid="B12">2007</xref>; Robert et al., <xref ref-type="bibr" rid="B38">2008</xref>) and engage in discussion (Alavi and Leidner, <xref ref-type="bibr" rid="B1">1999</xref>). When it is practically difficult or impossible to implement these systems, due to technical and privacy-related issues, it may still be possible to enhance group performance by providing the information about the past actions of others, considering that people can infer expertise of others from it (Wegner et al., <xref ref-type="bibr" rid="B50">1991</xref>). Further study is needed to scrutinize the influences of different types of information on group dynamics (Stieglitz and Dang-Xuan, <xref ref-type="bibr" rid="B47">2013</xref>), with a metric that accurately assesses group performance.</p>
<p>Our study shows that, overall, participants modified their contributions to balance the task distribution in the group. Such group awareness in a virtual setting is also seen in many other large-scale online environments, such as Wikipedia and Stack Overflow, where people help each other as virtual groups with no seeming reward (McLure-Wasko and Faraj, <xref ref-type="bibr" rid="B31">2000</xref>, <xref ref-type="bibr" rid="B32">2005</xref>; Forte et al., <xref ref-type="bibr" rid="B14">2009</xref>). Our findings suggest the possibility of enhancing group output through design interventions that address individual behavioral plasticity to ultimately modulate spontaneous adaption of collective dynamics (Feigh et al., <xref ref-type="bibr" rid="B13">2012</xref>; Barg-Walkow and Rogers, <xref ref-type="bibr" rid="B4">2016</xref>). For example, by exposing workers to social information about a distribution of other workers, the collective task designer or administrator could dynamically influence workers&#x00027; task choice in a desired direction. Considering that groups often perform better when they are given autonomy in decision making (Hackman and Oldham, <xref ref-type="bibr" rid="B15">1980</xref>), such design interventions can help enhance group management and output.</p>
</sec>
<sec id="s5">
<title>Author contributions</title>
<p>DD contributed to designing the study, conducting the experiment, and revising the manuscript. SN contributed to analyzing the data, drafting the manuscript, and revising the manuscript. JH and GB contributed to revising the manuscript. MP and ON contributed to designing the study and revising the manuscript.</p>
<sec>
<title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alavi</surname> <given-names>M.</given-names></name> <name><surname>Leidner</surname> <given-names>D. E.</given-names></name></person-group> (<year>1999</year>). <article-title>Knowledge management systems: issues, challenges, and benefits</article-title>. <source>Commun. Assoc. Inform. Syst.</source> <volume>1</volume>, <fpage>1</fpage>&#x02013;<lpage>28</lpage>.</citation>
</ref>
<ref id="B2">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Argote</surname> <given-names>L.</given-names></name> <name><surname>Olivera</surname> <given-names>F.</given-names></name></person-group> (<year>1999</year>). <article-title>Orgnizational learning and new product development: CORE processes</article-title>, in <source>Shared Cognition in Organization: The Management of Knowledge</source>, eds <person-group person-group-type="editor"><name><surname>Thompson</surname> <given-names>L. L.</given-names></name> <name><surname>Levine</surname> <given-names>J. M.</given-names></name> <name><surname>Messick</surname> <given-names>D. M.</given-names></name></person-group> (<publisher-loc>Mahwah, NJ</publisher-loc>: <publisher-name>Erlbaum</publisher-name>), <fpage>297</fpage>&#x02013;<lpage>325</lpage>.</citation>
</ref>
<ref id="B3">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Aronson</surname> <given-names>E.</given-names></name></person-group> (<year>1972</year>). <source>The Social Animal</source>. <publisher-loc>London</publisher-loc>: <publisher-name>W.H. Freeman &#x00026; Company</publisher-name>.</citation>
</ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barg-Walkow</surname> <given-names>L. H.</given-names></name> <name><surname>Rogers</surname> <given-names>W. A.</given-names></name></person-group> (<year>2016</year>). <article-title>The effect of incorrect reliability information on expectations, perceptions, and use of automation</article-title>. <source>Hum. Factors</source> <volume>58</volume>, <fpage>242</fpage>&#x02013;<lpage>260</lpage>. <pub-id pub-id-type="doi">10.1177/0018720815610271</pub-id><pub-id pub-id-type="pmid">26519483</pub-id></citation>
</ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bates</surname> <given-names>D.</given-names></name> <name><surname>M&#x000E4;chler</surname> <given-names>M.</given-names></name> <name><surname>Bolker</surname> <given-names>B.</given-names></name> <name><surname>Walker</surname> <given-names>S.</given-names></name></person-group> (<year>2015</year>). <article-title>Fitting linear mixed-effects models using lme4</article-title>. <source>J. Stat. Softw.</source> <volume>67</volume>, <fpage>1</fpage>&#x02013;<lpage>48</lpage>. <pub-id pub-id-type="doi">10.18637/jss.v067.i01</pub-id></citation>
</ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Behrend</surname> <given-names>T. S.</given-names></name> <name><surname>Sharek</surname> <given-names>D. J.</given-names></name> <name><surname>Meade</surname> <given-names>A. W.</given-names></name> <name><surname>Wiebe</surname> <given-names>E. N.</given-names></name></person-group> (<year>2011</year>). <article-title>The viability of crowdsourcing for survey research</article-title>. <source>Behav. Res. Methods</source> <volume>43</volume>, <fpage>800</fpage>&#x02013;<lpage>813</lpage>. <pub-id pub-id-type="doi">10.3758/s13428-011-0081-0</pub-id><pub-id pub-id-type="pmid">21437749</pub-id></citation>
</ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Burke</surname> <given-names>C. S.</given-names></name> <name><surname>Stagl</surname> <given-names>K. C.</given-names></name> <name><surname>Salas</surname> <given-names>E.</given-names></name> <name><surname>Pierce</surname> <given-names>L.</given-names></name> <name><surname>Kendall</surname> <given-names>D.</given-names></name></person-group> (<year>2006</year>). <article-title>Understanding team adaptation: a conceptual analysis and model</article-title>. <source>J. Appl. Psychol.</source> <volume>91</volume>, <fpage>1189</fpage>&#x02013;<lpage>1207</lpage>. <pub-id pub-id-type="doi">10.1037/0021-9010.91.6.1189</pub-id><pub-id pub-id-type="pmid">17100478</pub-id></citation>
</ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Crump</surname> <given-names>M. J.</given-names></name> <name><surname>McDonnell</surname> <given-names>J. V.</given-names></name> <name><surname>Gureckis</surname> <given-names>T. M.</given-names></name></person-group> (<year>2013</year>). <article-title>Evaluating Amazon&#x00027;s Mechanical Turk as a tool for experimental behavioral research</article-title>. <source>PLoS ONE</source> <volume>8</volume>:<fpage>e57410</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0057410</pub-id><pub-id pub-id-type="pmid">23516406</pub-id></citation>
</ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dissanayake</surname> <given-names>I.</given-names></name> <name><surname>Zhang</surname> <given-names>J.</given-names></name> <name><surname>Gu</surname> <given-names>B.</given-names></name></person-group> (<year>2015</year>). <article-title>Task division for team success in crowdsourcing contests: resource allocation and alignment effects</article-title>. <source>J. Manag. Inform. Syst.</source> <volume>32</volume>, <fpage>8</fpage>&#x02013;<lpage>39</lpage>. <pub-id pub-id-type="doi">10.1080/07421222.2015.1068604</pub-id></citation>
</ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Entin</surname> <given-names>E. E.</given-names></name> <name><surname>Serfaty</surname> <given-names>D.</given-names></name></person-group> (<year>1999</year>). <article-title>Adaptive team coordination</article-title>. <source>Hum. Factors</source> <volume>41</volume>, <fpage>312</fpage>&#x02013;<lpage>325</lpage>. <pub-id pub-id-type="doi">10.1518/001872099779591196</pub-id></citation>
</ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eriksson</surname> <given-names>K.</given-names></name> <name><surname>Simpson</surname> <given-names>B.</given-names></name></person-group> (<year>2010</year>). <article-title>Emotional reactions to losing explain gender differences in entering a risky lottery</article-title>. <source>Judgm. Decis. Making</source> <volume>5</volume>, <fpage>159</fpage>&#x02013;<lpage>163</lpage>.</citation>
</ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Espinosa</surname> <given-names>J.</given-names></name> <name><surname>Slaughter</surname> <given-names>S.</given-names></name> <name><surname>Kraut</surname> <given-names>R.</given-names></name> <name><surname>Herbsleb</surname> <given-names>J.</given-names></name></person-group> (<year>2007</year>). <article-title>Team knowledge and coordination in geographically distributed software development</article-title>. <source>J. Manag. Inform. Syst.</source> <volume>24</volume>, <fpage>135</fpage>&#x02013;<lpage>169</lpage>. <pub-id pub-id-type="doi">10.2753/MIS0742-1222240104</pub-id></citation>
</ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Feigh</surname> <given-names>K. M.</given-names></name> <name><surname>Dorneich</surname> <given-names>M. C.</given-names></name> <name><surname>Hayes</surname> <given-names>C. C.</given-names></name></person-group> (<year>2012</year>). <article-title>Toward a characterization of adaptive systems: a framework for researchers and system designers</article-title>. <source>Hum. Factors</source> <volume>54</volume>, <fpage>1008</fpage>&#x02013;<lpage>1024</lpage>. <pub-id pub-id-type="doi">10.1177/0018720812443983</pub-id><pub-id pub-id-type="pmid">23397810</pub-id></citation>
</ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Forte</surname> <given-names>A.</given-names></name> <name><surname>Larco</surname> <given-names>V.</given-names></name> <name><surname>Bruckman</surname> <given-names>A.</given-names></name></person-group> (<year>2009</year>). <article-title>Decentralization in wikipedia governance</article-title>. <source>J. Manag. Inform. Syst.</source> <volume>26</volume>, <fpage>49</fpage>&#x02013;<lpage>72</lpage>. <pub-id pub-id-type="doi">10.2753/MIS0742-1222260103</pub-id></citation>
</ref>
<ref id="B15">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Hackman</surname> <given-names>J. R.</given-names></name> <name><surname>Oldham</surname> <given-names>G. R.</given-names></name></person-group> (<year>1980</year>). <source>Work Redesign</source>. <publisher-loc>Reading, MA</publisher-loc>: <publisher-name>Addison-Weskey</publisher-name>.</citation>
</ref>
<ref id="B16">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Hackman</surname> <given-names>R. J.</given-names></name></person-group> (<year>1987</year>). <article-title>The design of work groups</article-title>, in <source>Handbook of Organizational Behavior</source>, ed <person-group person-group-type="editor"><name><surname>Lorsch</surname> <given-names>J. W.</given-names></name></person-group> (<publisher-loc>Englewood Cliffs, NJ</publisher-loc>: <publisher-name>Prentice Hall</publisher-name>), <fpage>315</fpage>&#x02013;<lpage>339</lpage>.</citation>
</ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hollingshead</surname> <given-names>A. B.</given-names></name></person-group> (<year>2000</year>). <article-title>Perceptions of expertise and transactive memory in work relationships</article-title>. <source>Group Process. Intergr. Relat.</source> <volume>3</volume>, <fpage>257</fpage>&#x02013;<lpage>267</lpage>. <pub-id pub-id-type="doi">10.1177/1368430200033002</pub-id></citation>
</ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hothorn</surname> <given-names>T.</given-names></name> <name><surname>Bretz</surname> <given-names>F.</given-names></name> <name><surname>Westfall</surname> <given-names>P.</given-names></name></person-group> (<year>2008</year>). <article-title>Simultaneous inference in general parametric models</article-title>. <source>Biometr. J.</source> <volume>50</volume>, <fpage>346</fpage>&#x02013;<lpage>363</lpage>. <pub-id pub-id-type="doi">10.1002/bimj.200810425</pub-id><pub-id pub-id-type="pmid">18481363</pub-id></citation>
</ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kankanhalli</surname> <given-names>A.</given-names></name> <name><surname>Tan</surname> <given-names>B. C. Y.</given-names></name> <name><surname>Wei</surname> <given-names>K.-K.</given-names></name></person-group> (<year>2005</year>). <article-title>Contributing knowledge to electronic knowledge repositories: an empirical investigation</article-title>. <source>MIS Q.</source> <volume>29</volume>, <fpage>113</fpage>&#x02013;<lpage>143</lpage>. <pub-id pub-id-type="doi">10.2307/25148670</pub-id></citation>
</ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kohn</surname> <given-names>A. S.</given-names></name></person-group> (<year>1993</year>). <article-title>Why incentive plans cannot work</article-title>. <source>Harvard Business Rev.</source> <volume>71</volume>, <fpage>54</fpage>&#x02013;<lpage>63</lpage>.</citation>
</ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Laut</surname> <given-names>J.</given-names></name> <name><surname>Henry</surname> <given-names>E.</given-names></name> <name><surname>Nov</surname> <given-names>O.</given-names></name> <name><surname>Porfiri</surname> <given-names>M.</given-names></name></person-group> (<year>2014</year>). <article-title>Development of a mechatronics-based citizen science platform for aquatic environmental monitoring</article-title>. <source>IEEE/ASME Trans. Mechatr.</source> <volume>19</volume>, <fpage>1541</fpage>&#x02013;<lpage>1551</lpage>. <pub-id pub-id-type="doi">10.1109/TMECH.2013.2287705</pub-id></citation>
</ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Littlepage</surname> <given-names>G.</given-names></name> <name><surname>Robison</surname> <given-names>W.</given-names></name> <name><surname>Reddington</surname> <given-names>K.</given-names></name></person-group> (<year>1997</year>). <article-title>Effects of task experience and group experience on group performance, member ability, and recognition of expertise</article-title>. <source>Organ. Behav. Hum. Decis. Process.</source> <volume>69</volume>, <fpage>133</fpage>&#x02013;<lpage>147</lpage>. <pub-id pub-id-type="doi">10.1006/obhd.1997.2677</pub-id></citation>
</ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Littlepage</surname> <given-names>G. E.</given-names></name> <name><surname>Hollingshead</surname> <given-names>A. B.</given-names></name> <name><surname>Drake</surname> <given-names>L. R.</given-names></name> <name><surname>Littlepage</surname> <given-names>A. M.</given-names></name></person-group> (<year>2008</year>). <article-title>Transactive memory and performance in work groups: specificity, communication, ability differences, and work allocation</article-title>. <source>Group Dyn.</source> <volume>12</volume>, <fpage>223</fpage>&#x02013;<lpage>241</lpage>. <pub-id pub-id-type="doi">10.1037/1089-2699.12.3.223</pub-id></citation>
</ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Littlepage</surname> <given-names>G. E.</given-names></name> <name><surname>Schmidt</surname> <given-names>G. W.</given-names></name> <name><surname>Whisler</surname> <given-names>E. W.</given-names></name> <name><surname>Frost</surname> <given-names>A. G.</given-names></name></person-group> (<year>1995</year>). <article-title>An input-process-output analysis of influence and performance in problem-solving groups</article-title>. <source>J. Pers. Soc. Psychol.</source> <volume>69</volume>, <fpage>877</fpage>&#x02013;<lpage>889</lpage>. <pub-id pub-id-type="doi">10.1037/0022-3514.69.5.877</pub-id></citation>
</ref>
<ref id="B25">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Luther</surname> <given-names>K.</given-names></name> <name><surname>Counts</surname> <given-names>S.</given-names></name> <name><surname>Stecher</surname> <given-names>K. B.</given-names></name> <name><surname>Hoff</surname> <given-names>A.</given-names></name> <name><surname>Johns</surname> <given-names>P.</given-names></name></person-group> (<year>2009</year>). <article-title>Pathfinder: an online collaboration environment for citizen scientists</article-title>, in <source>Proceedings of the 27th International Conference on Human Factors in Computing Systems - CHI &#x00027;09</source> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM Press</publisher-name>), <fpage>239</fpage>.</citation>
</ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mao</surname> <given-names>A.</given-names></name> <name><surname>Mason</surname> <given-names>W.</given-names></name> <name><surname>Suri</surname> <given-names>S.</given-names></name> <name><surname>Watts</surname> <given-names>D.</given-names></name></person-group> (<year>2016</year>). <article-title>An experimental study of team size and performance on a complex task</article-title>. <source>PLoS ONE</source> <volume>11</volume>:<fpage>e0153048</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0153048</pub-id><pub-id pub-id-type="pmid">27082239</pub-id></citation>
</ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mason</surname> <given-names>W.</given-names></name> <name><surname>Suri</surname> <given-names>S.</given-names></name></person-group> (<year>2012</year>). <article-title>Conducting behavioral research on Amazon&#x00027;s Mechanical Turk</article-title>. <source>Behav. Res. Methods</source> <volume>44</volume>, <fpage>1</fpage>&#x02013;<lpage>23</lpage>. <pub-id pub-id-type="doi">10.3758/s13428-011-0124-6</pub-id><pub-id pub-id-type="pmid">21717266</pub-id></citation>
</ref>
<ref id="B28">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Mason</surname> <given-names>W. A.</given-names></name> <name><surname>Watts</surname> <given-names>D. J.</given-names></name></person-group> (<year>2009</year>). <article-title>Financial incentives and the performance of crowds</article-title>, in <source>Proceedings of the ACM SIGKDD Workshop on Human Computation</source> (<publisher-loc>New York, NY</publisher-loc>), <fpage>77</fpage>&#x02013;<lpage>85</lpage>. <pub-id pub-id-type="doi">10.1145/1600150.1600175</pub-id></citation>
</ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mastrogiacomo</surname> <given-names>S.</given-names></name> <name><surname>Missonier</surname> <given-names>S.</given-names></name> <name><surname>Bonazzi</surname> <given-names>R.</given-names></name></person-group> (<year>2014</year>). <article-title>Talk before it&#x00027;s too late: reconsidering the role of conversation in information systems project management</article-title>. <source>J. Manag. Inform. Syst.</source> <volume>31</volume>, <fpage>44</fpage>&#x02013;<lpage>78</lpage>. <pub-id pub-id-type="doi">10.2753/MIS0742-1222310103</pub-id></citation>
</ref>
<ref id="B30">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>McIntyre</surname> <given-names>R. M.</given-names></name> <name><surname>Salas</surname> <given-names>E.</given-names></name></person-group> (<year>1995</year>). <article-title>Measuring and managing for team performance: emerging principles from complex environment</article-title>, in <source>Team Effectiveness and Decision Making in Organizations</source>, eds <person-group person-group-type="editor"><name><surname>Guzzo</surname> <given-names>R.</given-names></name> <name><surname>Salas</surname> <given-names>E.</given-names></name></person-group> (<publisher-loc>San Francisco, CA</publisher-loc>: <publisher-name>Jossey-Bass</publisher-name>), <fpage>9</fpage>&#x02013;<lpage>45</lpage>.</citation>
</ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>McLure-Wasko</surname> <given-names>M.</given-names></name> <name><surname>Faraj</surname> <given-names>S.</given-names></name></person-group> (<year>2000</year>). <article-title>&#x0201C;It is what one does&#x0201D;: why people participate and help others in electronic communities of practice</article-title>. <source>J. Strat. Inform. Syst.</source> <volume>9</volume>, <fpage>155</fpage>&#x02013;<lpage>173</lpage>. <pub-id pub-id-type="doi">10.1016/S0963-8687(00)00045-7</pub-id></citation>
</ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>McLure-Wasko</surname> <given-names>M.</given-names></name> <name><surname>Faraj</surname> <given-names>S.</given-names></name></person-group> (<year>2005</year>). <article-title>Why should I share? Examining social capital and knowledge contribution in electronic networks of practice</article-title>. <source>MIS Q.</source> <volume>29</volume>, <fpage>35</fpage>&#x02013;<lpage>57</lpage>. <pub-id pub-id-type="doi">10.2307/25148667</pub-id></citation>
</ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nov</surname> <given-names>O.</given-names></name> <name><surname>Arazy</surname> <given-names>O.</given-names></name> <name><surname>Anderson</surname> <given-names>D.</given-names></name></person-group> (<year>2014</year>). <article-title>Scientists&#x00040;home: what drives the quantity and quality of online citizen science participation?</article-title> <source>PLoS ONE</source> <volume>9</volume>:<fpage>e90375</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0090375</pub-id><pub-id pub-id-type="pmid">24690612</pub-id></citation>
</ref>
<ref id="B34">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Nov</surname> <given-names>O.</given-names></name> <name><surname>Arazy</surname> <given-names>O.</given-names></name> <name><surname>L&#x000F3;pez</surname> <given-names>C.</given-names></name> <name><surname>Brusilovsky</surname> <given-names>P.</given-names></name></person-group> (<year>2013</year>). <article-title>Exploring personality-targeted UI design in online social participation systems</article-title>, in <source>Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI &#x00027;13</source> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM Press</publisher-name>), <fpage>361</fpage>&#x02013;<lpage>370</lpage>. <pub-id pub-id-type="doi">10.1145/2470654.2470707</pub-id></citation>
</ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Paolacci</surname> <given-names>G.</given-names></name> <name><surname>Chandler</surname> <given-names>J.</given-names></name> <name><surname>Ipeirotis</surname> <given-names>P. G.</given-names></name></person-group> (<year>2010</year>). <article-title>Running experiments on Amazon Mechanical Turk</article-title>. <source>Judgm. Decis. Making</source> <volume>5</volume>, <fpage>411</fpage>&#x02013;<lpage>419</lpage>.</citation>
</ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Porter</surname> <given-names>C. O.</given-names></name> <name><surname>Hollenbeck</surname> <given-names>J. R.</given-names></name> <name><surname>Ilgen</surname> <given-names>D. R.</given-names></name> <name><surname>Ellis</surname> <given-names>A. P.</given-names></name> <name><surname>West</surname> <given-names>B. J.</given-names></name> <name><surname>Moon</surname> <given-names>H. K.</given-names></name></person-group> (<year>2003</year>). <article-title>Backing up behaviors in teams: the role of personality and legitimacy of need</article-title>. <source>J. Appl. Psychol.</source> <volume>88</volume>, <fpage>391</fpage>&#x02013;<lpage>403</lpage>. <pub-id pub-id-type="doi">10.1037/0021-9010.88.3.391</pub-id><pub-id pub-id-type="pmid">12814289</pub-id></citation>
</ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rand</surname> <given-names>D. G.</given-names></name></person-group> (<year>2012</year>). <article-title>The promise of Mechanical Turk: how online labor markets can help theorists run behavioral experiments</article-title>. <source>J. Theor. Biol.</source> <volume>299</volume>, <fpage>172</fpage>&#x02013;<lpage>179</lpage>. <pub-id pub-id-type="doi">10.1016/j.jtbi.2011.03.004</pub-id><pub-id pub-id-type="pmid">21402081</pub-id></citation>
</ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Robert</surname> <given-names>L. P.</given-names></name> <name><surname>Dennis</surname> <given-names>A. R.</given-names></name> <name><surname>Ahuja</surname> <given-names>M. K.</given-names></name></person-group> (<year>2008</year>). <article-title>Social capital and knowledge integration in digitally enabled teams</article-title>. <source>Inform. Syst. Res.</source> <volume>19</volume>, <fpage>314</fpage>&#x02013;<lpage>334</lpage>. <pub-id pub-id-type="doi">10.1287/isre.1080.0177</pub-id></citation>
</ref>
<ref id="B39">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Salas</surname> <given-names>E.</given-names></name> <name><surname>Cannon-Bowers</surname> <given-names>J.</given-names></name> <name><surname>Fiore</surname> <given-names>J. A.</given-names></name> <name><surname>Stout</surname> <given-names>R. J.</given-names></name></person-group> (<year>2001</year>). <article-title>Cue-recognition training to enhance team situation awareness</article-title>, in <source>New Trends in Cooperative Activities: Understanding System Dynamics in Complex Environments</source>, eds <person-group person-group-type="editor"><name><surname>McNeese</surname> <given-names>M.</given-names></name> <name><surname>Salas</surname> <given-names>E.</given-names></name> <name><surname>Endsley</surname> <given-names>M.</given-names></name></person-group> (<publisher-loc>Santa Monica, CA</publisher-loc>: <publisher-name>Human Factors and Ergonomics Society</publisher-name>), <fpage>169</fpage>&#x02013;<lpage>190</lpage>.</citation>
</ref>
<ref id="B40">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salas</surname> <given-names>E.</given-names></name> <name><surname>Grossman</surname> <given-names>R.</given-names></name> <name><surname>Hughes</surname> <given-names>A. M.</given-names></name> <name><surname>Coultas</surname> <given-names>C. W.</given-names></name></person-group> (<year>2015</year>). <article-title>Measuring team cohesion: observations from the science</article-title>. <source>Hum. Factors</source> <volume>57</volume>, <fpage>365</fpage>&#x02013;<lpage>374</lpage>. <pub-id pub-id-type="doi">10.1177/0018720815578267</pub-id><pub-id pub-id-type="pmid">25875429</pub-id></citation>
</ref>
<ref id="B41">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salas</surname> <given-names>E.</given-names></name> <name><surname>Prince</surname> <given-names>C.</given-names></name> <name><surname>Baker</surname> <given-names>D. P.</given-names></name> <name><surname>Shrestha</surname> <given-names>L.</given-names></name></person-group> (<year>1995</year>). <article-title>Situation awareness in team performance: implications for measurement and training</article-title>. <source>Hum. Factors</source> <volume>37</volume>, <fpage>123</fpage>&#x02013;<lpage>136</lpage>. <pub-id pub-id-type="doi">10.1518/001872095779049525</pub-id></citation>
</ref>
<ref id="B42">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Serfaty</surname> <given-names>D.</given-names></name> <name><surname>Entin</surname> <given-names>E. E.</given-names></name> <name><surname>Volpe</surname> <given-names>C.</given-names></name></person-group> (<year>1993</year>). <article-title>Adaptation to stress in team decision-making and coordination</article-title>, in <source>Proceedings of the Human Factors and Ergonomics Society</source>, (<publisher-loc>Santa Monica, CA</publisher-loc>: <publisher-name>Human Factors and Ergonomics Society</publisher-name>), <fpage>1228</fpage>&#x02013;<lpage>1232</lpage>. <pub-id pub-id-type="doi">10.1177/154193129303701806</pub-id></citation>
</ref>
<ref id="B43">
<citation citation-type="other"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>A.</given-names></name></person-group> (<year>1776</year>). <source>An Inquiry Into the Nature and Causes of the Wealth of Nations</source>.</citation>
</ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stasser</surname> <given-names>G.</given-names></name> <name><surname>Stewart</surname> <given-names>D. D.</given-names></name> <name><surname>Wittenbaum</surname> <given-names>G. M.</given-names></name></person-group> (<year>1995</year>). <article-title>Expert roles and information exchange during discussion: the importance of knowing who knows what</article-title>. <source>J. Exp. Soc. Psychol.</source> <volume>31</volume>, <fpage>244</fpage>&#x02013;<lpage>265</lpage>. <pub-id pub-id-type="doi">10.1006/jesp.1995.1012</pub-id></citation>
</ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stempfle</surname> <given-names>J.</given-names></name> <name><surname>Hubner</surname> <given-names>O.</given-names></name> <name><surname>Badke-Schaub</surname> <given-names>P.</given-names></name></person-group> (<year>2001</year>). <article-title>A functional theory of task role distribution in work groups</article-title>. <source>Group Process. Intergr. Relat.</source> <volume>4</volume>, <fpage>138</fpage>&#x02013;<lpage>159</lpage>. <pub-id pub-id-type="doi">10.1177/1368430201004002005</pub-id></citation>
</ref>
<ref id="B46">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stewart</surname> <given-names>D. D.</given-names></name> <name><surname>Stasser</surname> <given-names>G.</given-names></name></person-group> (<year>1995</year>). <article-title>Expert role assignment and information sampling during collective recall and decision making</article-title>. <source>J. Pers. Soc. Psychol.</source> <volume>69</volume>, <fpage>619</fpage>&#x02013;<lpage>628</lpage>. <pub-id pub-id-type="doi">10.1037/0022-3514.69.4.619</pub-id><pub-id pub-id-type="pmid">7473023</pub-id></citation>
</ref>
<ref id="B47">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stieglitz</surname> <given-names>S.</given-names></name> <name><surname>Dang-Xuan</surname> <given-names>L.</given-names></name></person-group> (<year>2013</year>). <article-title>Emotions and information diffusion in social media&#x02014;sentiment of microblogs and sharing behavior</article-title>. <source>J. Manag. Inform. Syst.</source> <volume>29</volume>, <fpage>217</fpage>&#x02013;<lpage>248</lpage>. <pub-id pub-id-type="doi">10.2753/MIS0742-1222290408</pub-id></citation>
</ref>
<ref id="B48">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Suri</surname> <given-names>S.</given-names></name> <name><surname>Watts</surname> <given-names>D. J.</given-names></name></person-group> (<year>2011</year>). <article-title>Cooperation and contagion in web-based, networked public goods experiments</article-title>. <source>PLoS ONE</source> <volume>6</volume>:<fpage>e16836</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0016836</pub-id><pub-id pub-id-type="pmid">21412431</pub-id></citation>
</ref>
<ref id="B49">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Valdes</surname> <given-names>C.</given-names></name> <name><surname>Ferreirae</surname> <given-names>M.</given-names></name> <name><surname>Feng</surname> <given-names>T.</given-names></name> <name><surname>Wang</surname> <given-names>H.</given-names></name> <name><surname>Tempel</surname> <given-names>K.</given-names></name> <name><surname>Liu</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2012</year>). <article-title>A collaborative environment for engaging novices in scientific inquiry</article-title>, in <source>Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces - ITS &#x00027;12</source> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM Press</publisher-name>), <fpage>109</fpage>.</citation>
</ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wegner</surname> <given-names>D. M.</given-names></name> <name><surname>Erber</surname> <given-names>R.</given-names></name> <name><surname>Raymond</surname> <given-names>P.</given-names></name></person-group> (<year>1991</year>). <article-title>Transactive memory in close relationships</article-title>. <source>J. Pers. Soc. Psychol.</source> <volume>61</volume>, <fpage>923</fpage>&#x02013;<lpage>929</lpage>. <pub-id pub-id-type="doi">10.1037/0022-3514.61.6.923</pub-id><pub-id pub-id-type="pmid">1774630</pub-id></citation>
</ref>
<ref id="B51">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>West</surname> <given-names>M. A.</given-names></name></person-group> (<year>2004</year>). <source>Effective Teamwork: Practical Lessons From Organizational Research</source>. <publisher-loc>Oxford</publisher-loc>: <publisher-name>Blackwell</publisher-name>.</citation>
</ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>West</surname> <given-names>S. A.</given-names></name> <name><surname>Fisher</surname> <given-names>R. M.</given-names></name> <name><surname>Gardner</surname> <given-names>A.</given-names></name> <name><surname>Kiers</surname> <given-names>E. T.</given-names></name> <name><surname>Mccutcheon</surname> <given-names>J. P.</given-names></name></person-group> (<year>2015</year>). <article-title>Major evolutionary transitions in individuality</article-title>. <source>Proc. Natl. Acad. Sci. U.S.A.</source> <volume>112</volume>, <fpage>10112</fpage>&#x02013;<lpage>10119</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1421402112</pub-id><pub-id pub-id-type="pmid">25964342</pub-id></citation>
</ref>
<ref id="B53">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Willett</surname> <given-names>W.</given-names></name> <name><surname>Heer</surname> <given-names>J.</given-names></name> <name><surname>Hellerstein</surname> <given-names>J.</given-names></name> <name><surname>Agrawala</surname> <given-names>M.</given-names></name></person-group> (<year>2011</year>). <article-title>CommentSpace: structured support for collaborative visual analysis</article-title>, in <source>Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems - CHI &#x00027;11</source> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM Press</publisher-name>), <fpage>3131</fpage>.</citation>
</ref>
<ref id="B54">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wittenbaum</surname> <given-names>G. M.</given-names></name> <name><surname>Stasser</surname> <given-names>G.</given-names></name> <name><surname>Merry</surname> <given-names>C. J.</given-names></name></person-group> (<year>1996</year>). <article-title>Tacit coordination in anticipation of small group task completion</article-title>. <source>J. Exp. Soc. Psychol.</source> <volume>32</volume>, <fpage>129</fpage>&#x02013;<lpage>152</lpage>. <pub-id pub-id-type="doi">10.1006/jesp.1996.0006</pub-id></citation>
</ref>
<ref id="B55">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Wittenbaum</surname> <given-names>G. M.</given-names></name> <name><surname>Vaughan</surname> <given-names>S. I.</given-names></name> <name><surname>Stasser</surname> <given-names>G.</given-names></name></person-group> (<year>1998</year>). <article-title>Coordination in task-performning groups</article-title>, in <source>Theory and Reserch on Small Groups</source>, eds <person-group person-group-type="editor"><name><surname>Tindale</surname> <given-names>R. S.</given-names></name> <name><surname>Heath</surname> <given-names>L.</given-names></name> <name><surname>Edwards</surname> <given-names>J.</given-names></name> <name><surname>Posavac</surname> <given-names>E. J.</given-names></name> <name><surname>Bryant</surname> <given-names>F. B.</given-names></name> <name><surname>Myers</surname> <given-names>J.</given-names></name> <name><surname>Suarez-Balcazar</surname> <given-names>Y.</given-names></name> <name><surname>Henderson-King</surname> <given-names>E.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Plenum Press</publisher-name>), <fpage>177</fpage>&#x02013;<lpage>204</lpage>.</citation>
</ref>
<ref id="B56">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Zuur</surname> <given-names>A. F.</given-names></name> <name><surname>Ieno</surname> <given-names>E. N.</given-names></name> <name><surname>Walker</surname> <given-names>N.</given-names></name> <name><surname>Saveliev</surname> <given-names>A. A.</given-names></name> <name><surname>Smith</surname> <given-names>G. M.</given-names></name></person-group> (<year>2009</year>). <source>Mixed Effects Models and Extensions in Ecology with R</source>. Statistics for Biology and Health. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Springer</publisher-name>.</citation>
</ref>
</ref-list>
<fn-group>
<fn fn-type="financial-disclosure"><p><bold>Funding.</bold> This work was supported by the National Academies Keck Futures Initiative under grant CB9 and the National Science Foundation under grant numbers BCS 1124795, CBET 1547864, CMMI 1644828, and IIS 1149745.</p>
</fn>
</fn-group>
</back>
</article>