<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2019.00925</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Does Scale-Free Syntactic Network Emerge in Second Language Learning?</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Jiang</surname> <given-names>Jingyang</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/719319/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Yu</surname> <given-names>Wuzhe</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/722607/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Liu</surname> <given-names>Haitao</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/314536/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Linguistics, Zhejiang University</institution>, <addr-line>Hangzhou</addr-line>, <country>China</country></aff>
<aff id="aff2"><sup>2</sup><institution>Institute of Quantitative Linguistics, Beijing Language and Culture University</institution>, <addr-line>Beijing</addr-line>, <country>China</country></aff>
<aff id="aff3"><sup>3</sup><institution>Center for Linguistics and Applied Linguistics, Guangdong University of Foreign Studies</institution>, <addr-line>Guangzhou</addr-line>, <country>China</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Ping Li, Pennsylvania State University, United States</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Zude Zhu, Jiangsu Normal University, China; Tao Gong, Educational Testing Service, United States; Yiyi Zhao, Xiamen University, China</p></fn>
<corresp id="c001">&#x002A;Correspondence: Haitao Liu, <email>lhtzju@yeah.net</email></corresp>
<fn fn-type="other" id="fn002"><p>This article was submitted to Language Sciences, a section of the journal Frontiers in Psychology</p></fn></author-notes>
<pub-date pub-type="epub">
<day>26</day>
<month>04</month>
<year>2019</year>
</pub-date>
<pub-date pub-type="collection">
<year>2019</year>
</pub-date>
<volume>10</volume>
<elocation-id>925</elocation-id>
<history>
<date date-type="received">
<day>06</day>
<month>08</month>
<year>2018</year>
</date>
<date date-type="accepted">
<day>08</day>
<month>04</month>
<year>2019</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2019 Jiang, Yu and Liu.</copyright-statement>
<copyright-year>2019</copyright-year>
<copyright-holder>Jiang, Yu and Liu</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Language is a complex system during whose operation many properties may emerge spontaneously. Using complex network approach, existing studies have found that, in first language (L1) acquisition, syntactic complex network featuring the scale-free and the small-world properties, will emerge at the age of 24 months. For foreign language (L2) learning, however, researchers have not reached a consensus on whether syntactic network with these two properties will emerge. Therefore, this study adopts complex network approach in L2 learning study, attempting to answer this question. In this study, nine networks are constructed on the basis of English compositions by Chinese students. Properties of these networks reveal that the syntactic network featuring these two properties, instead of emerging suddenly at a certain point, has existed at the very beginning of the L2 learning of Chinese students, and persists throughout the entire process of L2 learning, which is different from what has been found in L1 acquisition. The reason is probably that the already established L1 syntactic system provides foundation for L2 syntactic learning, and L2 learners tend to use the entrenched L1 syntactic network to generate L2 syntactic structures. L2 syntactic learning thus is not characterized by a sudden emergence of syntactic system, but a gradual approximation to the target language, with its own unique properties. For the first time, this study provides a tentative answer to L2 syntactic emergence from the perspective of complex network, and provides a macroscopic description of L2 syntactic developmental trajectory.</p>
</abstract>
<kwd-group>
<kwd>syntactic emergence</kwd>
<kwd>complex network</kwd>
<kwd>dependency syntax</kwd>
<kwd>scale-freeness</kwd>
<kwd>small-worldness</kwd>
<kwd>second language learning</kwd>
</kwd-group>
<counts>
<fig-count count="8"/>
<table-count count="7"/>
<equation-count count="4"/>
<ref-count count="65"/>
<page-count count="17"/>
<word-count count="0"/>
</counts>
</article-meta>
</front>
<body>
<sec><title>Introduction</title>
<p>The non-linear interaction of subsystems of a complex system usually results in an unpredictable outcome (<xref ref-type="bibr" rid="B53">Santos and Zhao, 2017</xref>), which is termed <bold><italic>emergence</italic></bold>. It is defined as &#x201C;the first systematic use of a structure&#x201D; (<xref ref-type="bibr" rid="B50">Pienemann, 1984</xref>, p. 191), and involves &#x201C;some new kind of relation&#x201D; (<xref ref-type="bibr" rid="B14">Ellis, 1998</xref>, p. 631), in which &#x201C;the whole is more than the sum of its parts&#x201D; (<xref ref-type="bibr" rid="B20">Holland, 1998</xref>, p. 2). The phenomenon of emergence has become one of the most attractive subjects in the field of complex system.</p>
<p>Language is also a complex system (<xref ref-type="bibr" rid="B35">Liu, 2018</xref>), and language acquisition may be investigated from the perspective of complex system (<xref ref-type="bibr" rid="B58">Sol&#x00E9; et al., 2010</xref>; <xref ref-type="bibr" rid="B19">Gromov and Migrina, 2017</xref>), complex dynamic system (<xref ref-type="bibr" rid="B1">Baba and Nitta, 2014</xref>; <xref ref-type="bibr" rid="B61">Wachs-Lopes and Rodrigues, 2016</xref>), and complex adaptive system (<xref ref-type="bibr" rid="B5">Beckner et al., 2009</xref>; <xref ref-type="bibr" rid="B15">Ellis, 2016</xref>; <xref ref-type="bibr" rid="B37">Lu et al., 2016</xref>). <xref ref-type="bibr" rid="B40">MacWhinney (2015)</xref> listed 19 important emergentist mechanisms of language, including proliferation, competition, generalization, error correction, self-organization, topological organization, etc. He also introduced some specific quantitative methods, such as Parallel Distributed Processing, Self-Organizing Feature Maps, and Dynamic Systems Theory, which were utilized to account for the emergence of language in previous studies. However, <xref ref-type="bibr" rid="B41">MacWhinney and O&#x2019;Grady (2015)</xref> have not mentioned the complex network approach, which is another effective way to analyze and explain the emergent properties of human languages.</p>
<p>Some important properties of complex networks, like the scale-free and the small-world properties, are found to emerge in first language (L1) acquisition. L1 acquisition goes through holophrastic stage, two-word stage with rapid vocabulary growth, and fluent grammatical conversation phase that features steadily increased sentence length and exponentially increased syntactic types (<xref ref-type="bibr" rid="B51">Radford, 1990</xref>; <xref ref-type="bibr" rid="B10">Corominas-Murtra et al., 2009</xref>). The development of L1 syntax is non-linear: at a certain age, the growth may be explosive, which is what is meant by emergence. Resorting to empirical data and complex network approach, <xref ref-type="bibr" rid="B10">Corominas-Murtra et al. (2009)</xref> found, for the first time, that at the age of 24 months, two important complex network properties, i.e., the scale-free property and the small-world property, emerge in L1 syntactic networks, signaling a sharp transition from a pre-syntactic organization to a scale-free and small-world syntactic network. Therefore, the emergence of syntax, which concerns the change of word-word relations, signals the rapid shift from chaotic word clusters to well-organized sentences. From the perspective of complex network, the emergence of syntax means the shift from a non-scale-free and non-small-world language structure to a scale-free and small-world language network.</p>
<p>As for L2 syntactic learning, various studies have attempted to find out whether there is such an abrupt shift in L2 learning, but failed to reach consensus on this issue. L2 learning is viewed as a dynamic and complex process teeming with emergences (<xref ref-type="bibr" rid="B29">Larsen-Freeman, 1997</xref>; <xref ref-type="bibr" rid="B14">Ellis, 1998</xref>), and several theories are suggested to explain this process. Chaos/Complexity Theory, for instance, may uncover the patterns underlying complex and dynamic language system (<xref ref-type="bibr" rid="B20">Holland, 1998</xref>; <xref ref-type="bibr" rid="B30">Larsen-Freeman and Cameron, 2008</xref>). Dynamic Systems Theory (DST) views learner language as a continually changing system, takes into consideration all variables concerning learning, and tries to model this system mathematically (e.g., <xref ref-type="bibr" rid="B12">de Bot et al., 2007</xref>). In L2 development, emergences, or, sudden shifts, which reflect system restructuring, have already been observed by empirical studies. For example, <xref ref-type="bibr" rid="B54">Sato (1988)</xref> investigated the emergence of complex syntactic structures in L2 development of two Vietnamese learners of English, especially the coordination, the subordination, and the complement structures. Besides, the emergence of English verb-argument constructions, such as verb locative, verb object locative, and ditransitive, were examined in L2 development (<xref ref-type="bibr" rid="B16">Ellis and Larsen-Freeman, 2009</xref>), with the finding that the acquisition of verb-argument constructions was influenced by input frequency, prototypicality and generality of the semantic types. With DST methods, <xref ref-type="bibr" rid="B59">Spoelman and Verspoor (2010)</xref> collected 54 writing samples (spanning 3 years) of a Dutch learner of Finnish, and detected in them a sharp change in noun phrases and the competition between noun phrase complexity and sentence complexity during these 3 years. <xref ref-type="bibr" rid="B44">Mellow (2006</xref>, <xref ref-type="bibr" rid="B45">2008</xref>) diachronically investigated into the language production of a 12-year-old Spanish learner of English, and found that the complex structures such as relative clauses and argument dependencies of verbs emerged from item-based learning.</p>
<p>However, these researches all have their limitations. For one thing, these investigations failed to elucidate the emergence of syntax. As discussed above, the emergence of syntactic system is signaled by a rapid shift from arbitrary word clusters to well-organized grammatical sentences, which have not been examined in above studies. For another, these studies are microscopic, usually involving only a few participants, or a few specific structures such as verb-argument constructions, relative clauses and argument dependencies of verbs. As a result, they may fail to provide a panoramic picture of L2 syntactic development.</p>
<p>Based on large-scale language materials, this study aims to macroscopically explore the overall syntactic development in L2 learning, by employing network approaches to measure syntactic changes. <xref ref-type="bibr" rid="B10">Corominas-Murtra et al. (2009</xref>, <xref ref-type="bibr" rid="B11">2010</xref>) analyzed two complex network properties of child language: the scale-free and the small-world properties, identified for the first time the precise time of the syntactic explosion in L1 acquisition, and reported that at the age of around 24 months occurred a sharp transition from the pre-syntactic organization to the scale-free, small-world, heterogeneous syntactic network. Complex network approach is thus capable of capturing the overall features of a network, throwing light on the phase transition, and providing potent quantitative measures for system-level analysis (<xref ref-type="bibr" rid="B9">Cong and Liu, 2014</xref>). Hence, to capture a holistic picture, this study employs complex network analyses into English syntactic development of Chinese learners, from primary school years, through junior high school years, to senior high school years. The following two research questions will be addressed:</p>
<list list-type="simple" prefix-word="simple">
<list-item><label>(1)</label><p>From a macroscopic complex network perspective, is there an English syntactic explosion in Chinese L2 learning? Or rather, do the properties of scale-freeness and small-worldness emerge in syntactic networks of Chinese learners of English? What is the overall syntactic development trajectory of the Chinese L2 learners across the 9 grades?</p></list-item>
<list-item><label>(2)</label><p>What are the differences in the properties of syntactic networks of the nine grades? And what differences in lexical and syntactic capacity of each grade are indicated by these differences in network properties?</p></list-item></list>
<p>Question 1 is aimed to grasp the most prominent overall features of the 9 syntactic dependency networks. Question 2 is intended to figure out the specific differences among different stages of syntactic development of L2 learners. It is hoped that the answers to these two questions can shed light on the L2 syntactic development from beginners to high-level learners, which could be of much significance to language pedagogy.</p>
</sec>
<sec id="s1" sec-type="materials|methods">
<title>Materials and Methods</title>
<sec><title>Background Information of Participants and the Corpus Construction</title>
<p>The participants are 509 Chinese students, whose grades range from P<sub>4</sub> (fourth graders of the primary schools) to S<sub>3</sub> (third graders of the senior high schools). These students are from two primary schools, two junior high schools, and two senior high schools. Every pair of schools have similar quality in education, the same English syllabus, the same English textbook, and the same class hours each week. So the learning environments are very similar and we can thus minimize the interference of irrelevant factors. The English teachers were consulted about the English proficiency of these grades. They are very sure that on the whole, the students&#x2019; English proficiency of a higher grade is better than that of a lower grade, though the English test paper for the higher grade is more difficult than that for the lower grade and the average score of the former is even a bit higher than that of the latter. Grades are believed to be one of the most valid indexes for language proficiency (<xref ref-type="bibr" rid="B64">Wolfe-Quintero et al., 1998</xref>; <xref ref-type="bibr" rid="B38">Lu, 2011</xref>). Besides, to eliminate the &#x201C;outliers&#x201D; of each grade, a simplified version of questionnaire based on LHQ 2.0 (<xref ref-type="bibr" rid="B32">Li et al., 2014</xref>) was employed, including questions about age, gender, education, years of English learning, after-school English learning courses, overseas experience, and self-evaluation of English level. Average-level students whose language proficiency were representative of their grades were then selected as participants according to the questionnaire and their English quiz scores. Hence, in this study, student grade, i.e., the years of English learning, was an acceptable proficiency indicator of English. Therefore, writings by students from P<sub>4</sub> to S<sub>3</sub> are used to observe whether there is an emergence of scale-free and small-world syntactic network during the process of second language learning. The information of each grade, including the age and years of English learning, is presented in <xref ref-type="table" rid="T1">Table 1</xref>.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>A brief profile of participants.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Grade</th>
<th valign="top" align="center">Age</th>
<th valign="top" align="center">Years of English Learning</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">P<sub>4</sub> (fourth grade of primary school)</td>
<td valign="top" align="center">9&#x2013;10</td>
<td valign="top" align="center">0&#x2013;1</td>
</tr>
<tr>
<td valign="top" align="left">P<sub>5</sub> (fifth grade of primary school)</td>
<td valign="top" align="center">10&#x2013;11</td>
<td valign="top" align="center">1&#x2013;2</td>
</tr>
<tr>
<td valign="top" align="left">P<sub>6</sub> (sixth grade of primary school)</td>
<td valign="top" align="center">11&#x2013;12</td>
<td valign="top" align="center">2&#x2013;3</td>
</tr>
<tr>
<td valign="top" align="left">J<sub>1</sub> (first grade of junior high school)</td>
<td valign="top" align="center">12&#x2013;13</td>
<td valign="top" align="center">3&#x2013;4</td>
</tr>
<tr>
<td valign="top" align="left">J<sub>2</sub> (second grade of junior high school)</td>
<td valign="top" align="center">13&#x2013;14</td>
<td valign="top" align="center">4&#x2013;5</td>
</tr>
<tr>
<td valign="top" align="left">J<sub>3</sub> (third grade of junior high school)</td>
<td valign="top" align="center">14&#x2013;15</td>
<td valign="top" align="center">5&#x2013;6</td>
</tr>
<tr>
<td valign="top" align="left">S<sub>1</sub> (first grade of senior high school)</td>
<td valign="top" align="center">15&#x2013;16</td>
<td valign="top" align="center">6&#x2013;7</td>
</tr>
<tr>
<td valign="top" align="left">S<sub>2</sub> (second grade of senior high school)</td>
<td valign="top" align="center">16&#x2013;17</td>
<td valign="top" align="center">7&#x2013;8</td>
</tr>
<tr>
<td valign="top" align="left">S<sub>3</sub> (third grade of senior high school)</td>
<td valign="top" align="center">17&#x2013;18</td>
<td valign="top" align="center">8&#x2013;9</td></tr>
</tbody>
</table>
</table-wrap>
<p>Writing tasks for all participants were assigned by their own English teacher in classroom tests at roughly the end of the semester in December. Students were fully aware that their compositions would be used for research, but their personal information would not be revealed under any circumstances. Written informed consent was obtained from participants above the age of 16, and the parents of all participants under the age of 16. The study was approved by the Research Ethics Board of Zhejiang University.</p>
<p>Students were required to finish their compositions in a prescribed period of time without any form of aid. Word count was prescribed (after consultation with the teachers in relevant schools) clearly for each grade in writing instructions: 40 words for fourth graders, 50 for fifth graders, 60 for sixth graders, 100 for the junior high school students and 130 for the senior high school students. In order to arouse the writing interests of the primary school students and to encourage them to write as much as possible, their topics such as &#x201C;My Family,&#x201D; &#x201C;Fruit,&#x201D; &#x201C;Planting Trees&#x201D; and &#x201C;My Weekend&#x201D; are presented in the form of colorful pictures; whereas for the high school students, the topics are presented in English, like &#x201C;My Weekend,&#x201D; &#x201C;An Embarrassing Thing.&#x201D; The topics include description and narration, because these two genres are not that demanding, and students are supposed to master these two genres at a very early stage of learning. The different topics are evenly distributed among the primary school students, but the junior and senior high school students used the same topics, respectively. By prescribing similar topics and genres, we intend to minimize the effects of irrelevant factors.</p>
<p>All the compositions were sent to us by their teachers, and were inputted into the computer after screening off the invalid ones, which are either too short (not meeting the minimal word count requirement of each grade), incomplete, irrelevant, or inappropriate. Besides, to ensure similar network sizes, which may facilitate the following comparative study, and guarantee consistency of the samples, it was decided that for each grade, the size of sample should be about 5000 word tokens. Therefore, 509 compositions were randomly chosen as the source of data for the current research, with a total of 45503 word tokens. <xref ref-type="table" rid="T2">Table 2</xref> shows the information of the language materials, including the topic, the number of sampled compositions, and the number of word tokens of each grade.</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Information of the self-built corpus.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Group</th>
<th valign="top" align="left">Topic</th>
<th valign="top" align="center">No. of compositions</th>
<th valign="top" align="center">Word count</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">P<sub>4</sub></td>
<td valign="top" align="left">Cleaning/Planting Trees/My Weekend/Clothes/Family/Fruit/My Classroom/</td>
<td valign="top" align="center">104</td>
<td valign="top" align="center">4909</td>
</tr>
<tr>
<td valign="top" align="left">P<sub>5</sub></td>
<td valign="top" align="left">Cleaning/Planting Trees/My Weekend/Clothes/Family/Fruit/My Classroom/</td>
<td valign="top" align="center">91</td>
<td valign="top" align="center">5048</td>
</tr>
<tr>
<td valign="top" align="left">P<sub>6</sub></td>
<td valign="top" align="left">Cleaning/ Planting Trees/My Weekend/ Clothes/Family/Fruit/ My Classroom/</td>
<td valign="top" align="center">70</td>
<td valign="top" align="center">5083</td>
</tr>
<tr>
<td valign="top" align="left">J<sub>1</sub></td>
<td valign="top" align="left">My Weekend</td>
<td valign="top" align="center">57</td>
<td valign="top" align="center">5072</td>
</tr>
<tr>
<td valign="top" align="left">J<sub>2</sub></td>
<td valign="top" align="left">My Weekend</td>
<td valign="top" align="center">49</td>
<td valign="top" align="center">5021</td>
</tr>
<tr>
<td valign="top" align="left">J<sub>3</sub></td>
<td valign="top" align="left">My Weekend</td>
<td valign="top" align="center">36</td>
<td valign="top" align="center">5087</td>
</tr>
<tr>
<td valign="top" align="left">S<sub>1</sub></td>
<td valign="top" align="left">A(n) Embarrassing/Surprising/Unforgettable Thing</td>
<td valign="top" align="center">37</td>
<td valign="top" align="center">5183</td>
</tr>
<tr>
<td valign="top" align="left">S<sub>2</sub></td>
<td valign="top" align="left">A(n) Embarrassing/ Surprising/ Unforgettable Thing</td>
<td valign="top" align="center">32</td>
<td valign="top" align="center">5065</td>
</tr>
<tr>
<td valign="top" align="left">S<sub>3</sub></td>
<td valign="top" align="left">A(n) Embarrassing/ Surprising/ Unforgettable Thing</td>
<td valign="top" align="center">33</td>
<td valign="top" align="center">5035</td>
</tr>
<tr>
<td valign="top" align="left" colspan="4"><hr/></td></tr>
<tr>
<td valign="top" align="left">Total</td>
<td valign="top" align="left"></td>
<td valign="top" align="center">509</td>
<td valign="top" align="center">45503</td></tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec><title>The Construction of Syntactic Dependency Networks</title>
<p>In order to conduct complex network analysis, we have to construct language networks in the first place. However complex a network is, its basic elements are simple (<xref ref-type="bibr" rid="B33">Liu, 2008</xref>): vertices (or nodes) and edges (<xref ref-type="bibr" rid="B46">Newman, 2003</xref>, <xref ref-type="bibr" rid="B47">2010</xref>). The former represents the entities of a network while the latter, the relationships between these entities. In a language network, vertices are linguistic units, such as words, and edges are pairwise relations between these linguistic units (<xref ref-type="bibr" rid="B33">Liu, 2008</xref>).</p>
<p>Suitable network representation is the prerequisite for the valid network analysis (<xref ref-type="bibr" rid="B6">Butts, 2009</xref>). To investigate the incremental syntactic development of L2 learners, syntactic networks are constructed, where a vertex represents a word type and the edge, the syntactic relation between two words. Besides, language networks must be constructed on the basis of linguistic rationales in order to be of research significance for language studies (<xref ref-type="bibr" rid="B34">Liu, 2011</xref>). Constituency, which concerns part-whole structures, and dependency, which concerns the binary asymmetrical relations between words, are two principal methods for syntactic analysis. In this study, the syntactic network is constructed on the basis of dependency structure. First, dependency grammar is shown to be more suitable for the research of language acquisition for learner language involving syntactic mistakes (<xref ref-type="bibr" rid="B22">Jiang and Ouyang, 2017</xref>). Second, the elements of dependencies are perfectly suitable to construct a network (<xref ref-type="bibr" rid="B33">Liu, 2008</xref>). Third, dependency grammar has been effectively applied to the investigation into L1 syntactic networks (<xref ref-type="bibr" rid="B10">Corominas-Murtra et al., 2009</xref>). For a reliable comparison between L1 and L2, dependency grammar is employed in the current study to construct syntactic networks.</p>
<p>According to dependency grammar, words in a sentence are connected by syntactic dependency relations (<xref ref-type="bibr" rid="B43">Mel&#x2019;&#x010D;uk, 1988</xref>; <xref ref-type="bibr" rid="B21">Hudson, 2010</xref>). In each dependency, there is a <italic>governor &#x2014;</italic> the head word, and a <italic>dependent</italic> &#x2014; the word governed by, or depends on the head word, as shown in <xref ref-type="fig" rid="F1">Figure 1</xref>. The asymmetrical relation between the two words is shown by the arrow, which points from the governor to the dependent, with a label on the arrow to indicate the dependency type, or the syntactic relation. In <xref ref-type="fig" rid="F2">Figure 2</xref>, for example, <italic>The</italic> depends on <italic>student</italic>; <italic>has</italic> governs <italic>student</italic> and <italic>book</italic>; <italic>book g</italic>overns <italic>a</italic>; and <italic>has</italic> is not governed by any word (i.e., <italic>has</italic> is the root of the sentence). From the perspective of network, the dependent and the governor in sentences are vertices, and the dependency relations between them are edges.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p>Three elements of a dependency.</p></caption>
<graphic xlink:href="fpsyg-10-00925-g001.tif"/>
</fig>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption><p>Dependency structure of the sentence <italic>The student has a book</italic>. <italic>nsubj</italic> is subject, <italic>det i</italic>s determiner, <italic>dobj</italic> is direct object.</p></caption>
<graphic xlink:href="fpsyg-10-00925-g002.tif"/>
</fig>
<p>Dependency structures of sentences can be presented in forms of tables, as illustrated by <xref ref-type="table" rid="T3">Table 3</xref>, which gives the dependency structures of two English sentences (<italic>This is a book</italic> and <italic>This book is very interesting</italic>).</p>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>Dependency structures of two sentences.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Order number of sentence</th>
<th valign="top" align="center" colspan="3">Dependent<hr/></th>
<th valign="top" align="center" colspan="3">Governor<hr/></th>
<th valign="top" align="left">Dependency type</th>
</tr>
<tr>
<td valign="top" align="left"></td>
<th valign="top" align="center">Order number</th>
<th valign="top" align="left">Word</th>
<th valign="top" align="left">POS</th>
<th valign="top" align="center">Order number</th>
<th valign="top" align="left">Word</th>
<th valign="top" align="left">POS</th>
<td valign="top" align="left"></td></tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">1</td>
<td valign="top" align="center">1</td>
<td valign="top" align="left">This</td>
<td valign="top" align="left">DT</td>
<td valign="top" align="center">2</td>
<td valign="top" align="left">is</td>
<td valign="top" align="left">VBZ</td>
<td valign="top" align="left">nsubj</td>
</tr>
<tr>
<td valign="top" align="left">1</td>
<td valign="top" align="center">2</td>
<td valign="top" align="left">is</td>
<td valign="top" align="left">VBZ</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td></tr>
<tr>
<td valign="top" align="left">1</td>
<td valign="top" align="center">3</td>
<td valign="top" align="left">a</td>
<td valign="top" align="left">DT</td>
<td valign="top" align="center">4</td>
<td valign="top" align="left">book</td>
<td valign="top" align="left">NN</td>
<td valign="top" align="left">det</td>
</tr>
<tr>
<td valign="top" align="left">1</td>
<td valign="top" align="center">4</td>
<td valign="top" align="left">book</td>
<td valign="top" align="left">NN</td>
<td valign="top" align="center">2</td>
<td valign="top" align="left">is</td>
<td valign="top" align="left">VBZ</td>
<td valign="top" align="left">xcomp</td>
</tr>
<tr>
<td valign="top" align="left">2</td>
<td valign="top" align="center">1</td>
<td valign="top" align="left">This</td>
<td valign="top" align="left">DT</td>
<td valign="top" align="center">2</td>
<td valign="top" align="left">book</td>
<td valign="top" align="left">NN</td>
<td valign="top" align="left">det</td></tr>
<tr>
<td valign="top" align="left">2</td>
<td valign="top" align="center">2</td>
<td valign="top" align="left">book</td>
<td valign="top" align="left">NN</td>
<td valign="top" align="center">3</td>
<td valign="top" align="left">is</td>
<td valign="top" align="left">VBZ</td>
<td valign="top" align="left">nsubj</td>
</tr>
<tr>
<td valign="top" align="left">2</td>
<td valign="top" align="center">3</td>
<td valign="top" align="left">is</td>
<td valign="top" align="left">VBZ</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td></tr>
<tr>
<td valign="top" align="left">2</td>
<td valign="top" align="center">4</td>
<td valign="top" align="left">very</td>
<td valign="top" align="left">RB</td>
<td valign="top" align="center">5</td>
<td valign="top" align="left">interesting</td>
<td valign="top" align="left">JJ</td>
<td valign="top" align="left">advmod</td>
</tr>
<tr>
<td valign="top" align="left">2</td>
<td valign="top" align="center">5</td>
<td valign="top" align="left">interesting</td>
<td valign="top" align="left">JJ</td>
<td valign="top" align="center">3</td>
<td valign="top" align="left">is</td>
<td valign="top" align="left">VBZ</td>
<td valign="top" align="left">xcomp</td></tr>
</tbody></table>
<table-wrap-foot>
<attrib><italic>DT is a determiner, <italic>NN</italic> is a noun, <italic>VBZ</italic> is a verb in present tense, <italic>RB</italic> is an adverb, <italic>JJ</italic> is an adjective, <italic>nsubj</italic> is subject, <italic>xcomp</italic> is predicative, <italic>advmod</italic> is adverb modifier. In addition, all the punctuations have been deleted.</italic></attrib>
</table-wrap-foot>
</table-wrap>
<p>These dependency-annotated sentences can be converted into a syntactic network, as illustrated by <xref ref-type="fig" rid="F3">Figure 3</xref>, which displays the syntactic network converted from <xref ref-type="table" rid="T3">Table 3</xref>. The vertices in the network are word types, and the directed edges among them indicate the asymmetric syntactic dependency relations. In <xref ref-type="table" rid="T3">Table 3</xref>, <italic>a</italic> and <italic>This</italic> depend on <italic>book</italic> which in turn depends on <italic>is</italic>. In <xref ref-type="fig" rid="F3">Figure 3</xref>, hence, there are two edges pointing from the vertex <italic>book</italic> to <italic>a</italic> and <italic>This</italic>, and one edge pointing from the vertex <italic>is</italic> to the vertex <italic>book</italic>.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption><p>The syntactic dependency network of two sentences <italic>This is a book</italic> and <italic>This book is very interesting.</italic></p></caption>
<graphic xlink:href="fpsyg-10-00925-g003.tif"/>
</fig>
<p>Syntactic treebanks are constructed through a syntactically tagging software Stanford Parser 3.6.0<sup><xref ref-type="fn" rid="fn01">1</xref></sup> (<xref ref-type="bibr" rid="B42">Marneffe and Manning, 2008</xref>), and then are manually checked to ensure annotation accuracy. Details about this tagging software and the procedures are available in <xref ref-type="bibr" rid="B49">Ouyang and Jiang (2018)</xref>. The syntactic errors in the students&#x2019; compositions are not corrected, and are left as they are in the treebanks as well as syntactic networks. The basic elements involved in network analysis are vertices and edges between them. One column of dependents plus another column of governors in the treebank will suffice for network construction. Therefore, syntactic errors, can only be reflected by the lack of edges between vertices in networks. For example, a learner made a syntactic error that the main verb <italic>is</italic> is missing in the sentence <italic>This is a book</italic>. Then, there would be no governor for the subject <italic>This</italic> and the object <italic>book</italic> in the treebank, and there would be no edge between vertices <italic>is</italic> and <italic>This</italic> and no edge between vertices <italic>is</italic> and <italic>book</italic> in the corresponding syntactic network. Take the sentence <italic>I must go to home</italic> as another case. The word <italic>to</italic> is redundant in this sentence, so there would be no governor for this word in the treebank and no edge linking to this vertex in the network. They will thus affect the network parameters such as degree and clustering coefficient. In this way, syntactic network can reflect language learners&#x2019; actual performance.</p>
<p>All the 509 compositions from nine grades were inputted into computer in plain text format, and each one was labeled with a unique code indicating the student&#x2019;s school, grade, number and topic. Following the annotation principles of dependency grammar, nine syntactic dependency treebanks were automatically constructed through Stanford Parser 3.6.0, and then were manually checked. These dependency treebanks, each corresponding to a grade, were then converted into dependency networks by Createpajek<sup><xref ref-type="fn" rid="fn02">2</xref></sup> (a network converting software, whose details are available in <xref ref-type="app" rid="A1">Appendix</xref>). So 9 syntactic networks are generated, each labeled according to the grade, such as network P<sub>4</sub>, network J<sub>1</sub>, network S<sub>3</sub>, and the like.</p>
</sec>
<sec><title>Network Properties</title>
<p>Network analysis may produce a variety of quantitative measures (<xref ref-type="bibr" rid="B47">Newman, 2010</xref>; <xref ref-type="bibr" rid="B34">Liu, 2011</xref>) to characterize the macroscopic properties of language networks (<xref ref-type="bibr" rid="B9">Cong and Liu, 2014</xref>). In the present study, the differences in network properties among grades may reveal the cognitive mechanism underlying the process of language learning. In fact, network science has offered effective instrumentalities to capture complex properties of cognitive and behavioral processes. For example, cognitive scientists have adopted network theory to describe neural organization and cognitive processes (<xref ref-type="bibr" rid="B3">Baronchelli et al., 2013</xref>; <xref ref-type="bibr" rid="B26">Karuza et al., 2016</xref>), to explore human learning process (<xref ref-type="bibr" rid="B25">Karuza et al., 2017</xref>; <xref ref-type="bibr" rid="B24">Kahn et al., 2018</xref>), and to investigate language acquisition and learning (<xref ref-type="bibr" rid="B57">Sizemore et al., 2018</xref>). In this study, the macroscopic network properties like scale-freeness and small-worldness can be indicated by network parameters, such as degree, average degree, average path length, clustering coefficient. On the basis of these parameters, the emergence of network properties and its linguistic implications will be explored.</p>
<sec><title>Degree</title>
<p>Degree (<italic>k</italic>) is a network parameter that measures the connectivity of a vertex in a network, referring to the number of edges which connect this vertex with others. In a directed network, the degree of a vertex may be classified into in-degree (centripetal) and out-degree (centrifugal) force, which represents a word&#x2019;s ability to govern and to be governed by other words. In <xref ref-type="fig" rid="F3">Figure 3</xref>, for instance, the degree of the vertex <italic>book</italic> is 3, with the in-degree being 1 and the out-degree being 2. In a syntactic network, the degree of a given vertex represents its syntactic relations with other words (<xref ref-type="bibr" rid="B7">Chen et al., 2011</xref>), and therefore measures its syntactic valency, i.e., its combinatorial ability to form syntactic dependencies (<xref ref-type="bibr" rid="B9">Cong and Liu, 2014</xref>). Hubs of networks are those vertices with high degrees.</p>
<p><italic>The average degree &#x003C; k ></italic> of a network is the mean of degrees of all its vertices, and thus may serve as an indicator of the connectivity of network. For example, there are 6 vertices in the syntactic network in <xref ref-type="fig" rid="F3">Figure 3</xref>. The degrees of the 6 vertices <italic>a, very, This, interesting, is</italic>, and <italic>book</italic> are respectively 1, 1, 2, 2, 3, and 3, so the total degree is 12, and the average degree is 2 (12/6).</p>
</sec>
<sec><title>Clustering Coefficient</title>
<p>In a language network, the words linking to a given vertex may link to one another themselves. For instance, in <xref ref-type="fig" rid="F3">Figure 3</xref>, the vertex <italic>This</italic> is linked to both <italic>is</italic> and <italic>book</italic>, which are also connected to each other themselves. <italic>Clustering coefficient</italic> is a network parameter reflecting the probability that two words linking to a vertex connect to each other (<xref ref-type="bibr" rid="B47">Newman, 2010</xref>). It measures the degree to which vertex gather together, that is, the transitivity of a network.</p>
<p>If vertex <italic>i</italic> is connected with <italic>k<sub>i</sub></italic> vertices through <italic>k<sub>i</sub></italic> edges, then the maximal number of edges among these nodes is <italic>k<sub>i</sub> (k<sub>i</sub> -1)/2</italic>. Suppose <italic>E<sub>i</sub></italic> is the number of edges actually existing among the <italic>k<sub>i</sub></italic> vertices, then the clustering coefficient <italic>C<sub>i</sub></italic> of vertex <italic>i</italic> is the ratio of the actual number <italic>E<sub>i</sub></italic> to the number of all possible edges, i.e.</p>
<disp-formula id="E1"><mml:math id="M1"><mml:mrow><mml:mtable><mml:mtr><mml:mtd><mml:mrow><mml:msub><mml:mi>C</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>2</mml:mn><mml:msub><mml:mi>E</mml:mi><mml:mi>i</mml:mi></mml:msub></mml:mrow><mml:mrow><mml:msub><mml:mi>k</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:msub><mml:mi>k</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:mfrac></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:mrow></mml:math></disp-formula>
<p>The clustering coefficient of a network (<italic>C</italic>) is the mean of clustering coefficients of all its vertices:</p>
<disp-formula id="E2"><mml:math id="M2"><mml:mrow><mml:mtable><mml:mtr><mml:mtd><mml:mrow><mml:mi>C</mml:mi><mml:mo>=</mml:mo><mml:mfrac><mml:mn>1</mml:mn><mml:mi>N</mml:mi></mml:mfrac><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>N</mml:mi></mml:munderover><mml:mrow><mml:msub><mml:mi>C</mml:mi><mml:mi>i</mml:mi></mml:msub></mml:mrow></mml:mstyle></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:mrow></mml:math></disp-formula>
<p>In the syntactic network of <xref ref-type="fig" rid="F3">Figure 3</xref>, the vertex <italic>is</italic> connects with 3 vertices, i.e., <italic>This, book</italic> and <italic>interesting</italic>, among which only <italic>This</italic> and <italic>book</italic> are connected. Therefore, the clustering coefficient of vertex <italic>is</italic> is 1/3, while for <italic>very, a</italic> and <italic>interesting</italic>, the clustering coefficient is 0.</p>
</sec>
<sec><title>Average Path Length</title>
<p>In a network, a vertex can combine with another vertex directly or connect to it via several other vertices. Thus arises the concept of <italic>Path length</italic>, which measures the number of edges between two vertices. The shortest path length is the degree of separation between two vertices. In <xref ref-type="fig" rid="F3">Figure 3</xref>, for example, the shortest path length between <italic>a</italic> and <italic>This</italic> is 2, and between <italic>a</italic> and <italic>interesting</italic> is 3.</p>
<p>Consequently, the average path length <italic>(L)</italic> of a network is a parameter defined as the average of all the shortest path lengths in the network, calculated as:</p>
<disp-formula id="E3"><mml:math id="M3"><mml:mrow><mml:mtable><mml:mtr><mml:mtd><mml:mrow><mml:mo>L</mml:mo><mml:mo>=</mml:mo><mml:mfrac><mml:mn>1</mml:mn><mml:mrow><mml:mfrac><mml:mn>1</mml:mn><mml:mn>2</mml:mn></mml:mfrac><mml:mi>N</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>N</mml:mi><mml:mo>&#x2212;</mml:mo><mml:mn>1</mml:mn><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:mfrac><mml:mstyle displaystyle='true'><mml:munder><mml:mo>&#x2211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>&#x003E;</mml:mo><mml:mi>j</mml:mi></mml:mrow></mml:munder><mml:mrow><mml:msub><mml:mi>d</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mstyle></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:mrow></mml:math></disp-formula>
<p>In this formula, <italic>N</italic> is the total number of vertices in the network; <italic>d<sub>ij</sub></italic> stands for the shortest edges between vertex <italic>i</italic> and vertex <italic>j</italic>.</p>
<p>As for large-scale networks, the software Pajek<sup><xref ref-type="fn" rid="fn03">3</xref></sup> (<xref ref-type="bibr" rid="B4">Batagelj and Mrvar, 2011</xref>; <xref ref-type="bibr" rid="B13">De Nooy et al., 2018</xref>) is used for calculating the above network parameters, and the procedures are introduced in <xref ref-type="app" rid="A1">Appendix</xref>.</p>
</sec>
<sec><title>Scale-Free and Small-World Properties</title>
<p>To examine the scale-free and small-world properties of a network, the comparison between the original graph and its counterpart random network has to be carried out. The corresponding random network, in this study, is generated automatically by Pajek with the same number of vertices and the same number of edges as the original one (Erd&#x00F6;s&#x2013;R&#x00E9;nyi network, see the generation procedure in <xref ref-type="app" rid="A1">Appendix</xref>). In the random network, the connections among the vertices are random and vertices have the same probability to be connected.</p>
<p>The scale-free property of a complex network is concerned with the degree distribution for the network. As mentioned above, in a network, a vertex&#x2019;s degree is the number of edges linked to it. Thus <italic>P(k)</italic> is the probability of a vertex to have a certain degree <italic>k</italic>. In a random network, the degrees of vertices follow binomial distribution or Poisson distribution (<xref ref-type="bibr" rid="B46">Newman, 2003</xref>, <xref ref-type="bibr" rid="B47">2010</xref>). On the contrary, in a scale-free network, the degrees of vertices generally follow power-law distribution (<xref ref-type="bibr" rid="B46">Newman, 2003</xref>, <xref ref-type="bibr" rid="B47">2010</xref>), which means that a small number of vertices have high degrees whereas many other vertices have low degrees. This power-law distribution can be formulated as:</p>
<disp-formula id="E4"><mml:math id="M4"><mml:mrow><mml:mtable><mml:mtr><mml:mtd><mml:mrow><mml:mi>P</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>k</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>~</mml:mo><mml:msup><mml:mi>k</mml:mi><mml:mrow><mml:mo>&#x2212;</mml:mo><mml:mi>y</mml:mi></mml:mrow></mml:msup></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:mrow></mml:math></disp-formula>
<p>The degree distribution follows the power law for some constant exponent &#x03B3;, and then its corresponding cumulative degree distribution follows the Zipf&#x2019;s law, with exponent &#x03B3;&#x2019;, and &#x03B3;&#x2019; equals &#x03B3;-1.</p>
<p>The small-world property is concerned with two network parameters: the average path length (<italic>L</italic>) and the clustering coefficient (<italic>C</italic>) (<xref ref-type="bibr" rid="B46">Newman, 2003</xref>, <xref ref-type="bibr" rid="B47">2010</xref>; <xref ref-type="bibr" rid="B18">Ferrer-i-Cancho et al., 2004</xref>; <xref ref-type="bibr" rid="B9">Cong and Liu, 2014</xref>). Compared with its random network, a small-world network has almost small average path length and far greater clustering coefficient (<xref ref-type="bibr" rid="B63">Watts and Strogatz, 1998</xref>). This means that the vertices in a small-world network tend to cluster together locally, and the distance between any two vertices is not long. Therefore, such kind of network is believed to be the best for local and global communication (<xref ref-type="bibr" rid="B63">Watts and Strogatz, 1998</xref>).</p>
<p>Small-world and scale-free properties are important features of human language networks (<xref ref-type="bibr" rid="B17">Ferrer-i-Cancho and Sol&#x00E9;, 2001</xref>; <xref ref-type="bibr" rid="B18">Ferrer-i-Cancho et al., 2004</xref>). Moreover, <xref ref-type="bibr" rid="B10">Corominas-Murtra et al. (2009</xref>, <xref ref-type="bibr" rid="B11">2010</xref>) identified the emergence of these two properties in L1 acquisition of children, which may indicate a phase shift of children&#x2019;s language from non-syntactic clusters to syntactic networks. Therefore, in order to examine whether a similar phase shift takes place in L2 learners&#x2019; immature language, this study investigates into the emergence of the scale-free and small-world properties in syntactic network of each grade.</p>
</sec>
</sec></sec>
<sec><title>Results</title>
<p>Nine syntactic dependency treebanks are transformed into 9 syntactic dependency networks (P<sub>4</sub>, P<sub>5</sub>, P<sub>6</sub>, J<sub>1</sub>, J<sub>2</sub>, J<sub>3</sub>, S<sub>1</sub>, S<sub>2</sub>, S<sub>3</sub>), and the above parameters of each syntactic network are calculated. The results are presented in this section.</p>
<sec><title>General Information of the 9 Syntactic Networks</title>
<p><xref ref-type="table" rid="T4">Table 4</xref> shows the general information of these networks from nine grades, including the number of vertices, the number of word tokens, and the Type/Token ratio (TTR). In these networks, vertices are word types, and the total number of words is the numbers of word tokens. To investigate lexical diversity/vocabulary richness of texts of similar size, the Type/Token ratio (TTR) is widely used (<xref ref-type="bibr" rid="B52">Richards, 1987</xref>). It is found that students from higher grades often present more lexical diversity or vocabulary richness. In addition, the global network of each grade (including all the vertices/word types) is presented in <xref ref-type="fig" rid="F4">Figure 4</xref> (see the drawing process in <xref ref-type="app" rid="A1">Appendix</xref>). Dots in graphs are vertices (word types), and lines among vertices are edges, i.e., syntactic dependency relations. The numbers of both vertices and edges increase steadily with the growth of grade.</p>
<table-wrap position="float" id="T4">
<label>Table 4</label>
<caption><p>Lexical information of each network.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Network</th>
<th valign="top" align="center">P<sub>4</sub></th>
<th valign="top" align="center">P<sub>5</sub></th>
<th valign="top" align="center">P<sub>6</sub></th>
<th valign="top" align="center">J<sub>1</sub></th>
<th valign="top" align="center">J<sub>2</sub></th>
<th valign="top" align="center">J<sub>3</sub></th>
<th valign="top" align="center">S<sub>1</sub></th>
<th valign="top" align="center">S<sub>2</sub></th>
<th valign="top" align="center">S<sub>3</sub></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Vertices</td>
<td valign="top" align="center">551</td>
<td valign="top" align="center">644</td>
<td valign="top" align="center">671</td>
<td valign="top" align="center">661</td>
<td valign="top" align="center">711</td>
<td valign="top" align="center">800</td>
<td valign="top" align="center">1007</td>
<td valign="top" align="center">999</td>
<td valign="top" align="center">1121</td></tr>
<tr>
<td valign="top" align="left">Word tokens</td>
<td valign="top" align="center">4909</td>
<td valign="top" align="center">5047</td>
<td valign="top" align="center">5083</td>
<td valign="top" align="center">5072</td>
<td valign="top" align="center">5021</td>
<td valign="top" align="center">5087</td>
<td valign="top" align="center">5183</td>
<td valign="top" align="center">5065</td>
<td valign="top" align="center">5035</td>
</tr>
<tr>
<td valign="top" align="left">TTR</td>
<td valign="top" align="center">11.224</td>
<td valign="top" align="center">12.760</td>
<td valign="top" align="center">13.200</td>
<td valign="top" align="center">13.032</td>
<td valign="top" align="center">14.161</td>
<td valign="top" align="center">15.726</td>
<td valign="top" align="center">19.429</td>
<td valign="top" align="center">19.724</td>
<td valign="top" align="center">22.264</td></tr>
</tbody>
</table>
</table-wrap>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption><p>Nine global syntactic dependency networks (from P<sub>4</sub> to S<sub>3</sub>).</p></caption>
<graphic xlink:href="fpsyg-10-00925-g004.tif"/>
</fig>
</sec>
<sec><title>The Scale-Free and the Small-World Properties of the 9 Syntactic Networks</title>
<p>To examine whether there is the emergence of scale-free property, the degree distributions of these 9 networks are extracted and compared with the degree distributions of their corresponding random networks (<xref ref-type="bibr" rid="B46">Newman, 2003</xref>), which may help identify the scale-free property of a network. For the purpose of reducing the noise in the long tail, the present study opts for the cumulative degree distributions (in log-log scales) of the nine networks, as shown in <xref ref-type="fig" rid="F5">Figure 5</xref>.</p>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption><p>The cumulative degree distributions of 9 syntactic dependency networks.</p></caption>
<graphic xlink:href="fpsyg-10-00925-g005.tif"/>
</fig>
<p>It can be seen in <xref ref-type="fig" rid="F5">Figure 5</xref> that all the determination coefficients <italic>R<sup>2</sup></italic> of nine syntactic networks are above 0.9, indicating that the degrees in 9 networks all fit well the power-law distribution, displaying Zipfian-like distributions. The fitting formulas are presented in each graph, with the power exponent &#x03B3;&#x2019; and the determination coefficient <italic>R<sup>2</sup></italic> presented in <xref ref-type="fig" rid="F6">Figure 6</xref>, which registers a rapid increase of &#x03B3;&#x2019; during the first three years of language learning, and then a tendency to stagnate at around 1.38 during the rest 6 years. The degree distributions of nine corresponding random networks are well fitted to binomial distribution, which is the essential feature of random Erd&#x00F6;s&#x2013;R&#x00E9;nyi networks, and won&#x2019;t be presented here due to the space limit. The Zipf&#x2019;s law-like distributions of degrees in nine syntactic networks and the binomial distributions in 9 random networks suggest that the syntactic networks of all 9 grades exhibit a scale-free property.</p>
<fig id="F6" position="float">
<label>FIGURE 6</label>
<caption><p>Power exponent &#x03B3;&#x2019; and determination coefficient <italic>R<sup>2</sup></italic> of nine syntactic networks.</p></caption>
<graphic xlink:href="fpsyg-10-00925-g006.tif"/>
</fig>
<p>Two network parameters, average path length (<italic>L</italic>) and clustering coefficient (<italic>C</italic>), are used to identify the small-world property of networks. <xref ref-type="table" rid="T5">Table 5</xref> displays the average path lengths (<italic>L</italic>) and the clustering coefficients (<italic>C</italic>) extracted from the 9 syntactic network and the corresponding random networks.</p>
<table-wrap position="float" id="T5">
<label>Table 5</label>
<caption><p>Major parameters of the nine networks and their corresponding random networks.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Networks</th>
<th valign="top" align="center">Word tokens</th>
<th valign="top" align="center"><italic>N</italic></th>
<th valign="top" align="center"><italic>&#x003C; k ></italic></th>
<th valign="top" align="center"><italic>C</italic></th>
<th valign="top" align="center"><italic>L</italic></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">P<sub>4</sub></td>
<td valign="top" align="center">4909</td>
<td valign="top" align="center">551</td>
<td valign="top" align="center">5.967</td>
<td valign="top" align="center">0.356</td>
<td valign="top" align="center">2.844</td></tr>
<tr>
<td valign="top" align="left">Random P<sub>4</sub></td>
<td valign="top" align="center">4909</td>
<td valign="top" align="center">551</td>
<td valign="top" align="center">5.967</td>
<td valign="top" align="center">0.009</td>
<td valign="top" align="center">3.731</td></tr>
<tr>
<td valign="top" align="left">P<sub>5</sub></td>
<td valign="top" align="center">5047</td>
<td valign="top" align="center">644</td>
<td valign="top" align="center">5.950</td>
<td valign="top" align="center">0.333</td>
<td valign="top" align="center">2.797</td></tr>
<tr>
<td valign="top" align="left">Random P<sub>5</sub></td>
<td valign="top" align="center">5047</td>
<td valign="top" align="center">644</td>
<td valign="top" align="center">5.950</td>
<td valign="top" align="center">0.008</td>
<td valign="top" align="center">3.820</td></tr>
<tr>
<td valign="top" align="left">P<sub>6</sub></td>
<td valign="top" align="center">5083</td>
<td valign="top" align="center">671</td>
<td valign="top" align="center">6.342</td>
<td valign="top" align="center">0.274</td>
<td valign="top" align="center">2.970</td></tr>
<tr>
<td valign="top" align="left">Random P<sub>6</sub></td>
<td valign="top" align="center">5083</td>
<td valign="top" align="center">671</td>
<td valign="top" align="center">6.342</td>
<td valign="top" align="center">0.009</td>
<td valign="top" align="center">3.735</td></tr>
<tr>
<td valign="top" align="left">J<sub>1</sub></td>
<td valign="top" align="center">5072</td>
<td valign="top" align="center">661</td>
<td valign="top" align="center">6.260</td>
<td valign="top" align="center">0.115</td>
<td valign="top" align="center">3.308</td></tr>
<tr>
<td valign="top" align="left">Random J<sub>1</sub></td>
<td valign="top" align="center">5072</td>
<td valign="top" align="center">661</td>
<td valign="top" align="center">6.260</td>
<td valign="top" align="center">0.010</td>
<td valign="top" align="center">3.747</td></tr>
<tr>
<td valign="top" align="left">J<sub>2</sub></td>
<td valign="top" align="center">5021</td>
<td valign="top" align="center">711</td>
<td valign="top" align="center">6.819</td>
<td valign="top" align="center">0.145</td>
<td valign="top" align="center">3.160</td></tr>
<tr>
<td valign="top" align="left">Random J<sub>2</sub></td>
<td valign="top" align="center">5021</td>
<td valign="top" align="center">711</td>
<td valign="top" align="center">6.819</td>
<td valign="top" align="center">0.007</td>
<td valign="top" align="center">3.650</td></tr>
<tr>
<td valign="top" align="left">J<sub>3</sub></td>
<td valign="top" align="center">5087</td>
<td valign="top" align="center">800</td>
<td valign="top" align="center">7.128</td>
<td valign="top" align="center">0.138</td>
<td valign="top" align="center">3.183</td></tr>
<tr>
<td valign="top" align="left">Random J<sub>3</sub></td>
<td valign="top" align="center">5087</td>
<td valign="top" align="center">800</td>
<td valign="top" align="center">7.128</td>
<td valign="top" align="center">0.008</td>
<td valign="top" align="center">3.624</td></tr>
<tr>
<td valign="top" align="left">S<sub>1</sub></td>
<td valign="top" align="center">5183</td>
<td valign="top" align="center">1007</td>
<td valign="top" align="center">6.878</td>
<td valign="top" align="center">0.114</td>
<td valign="top" align="center">3.236</td></tr>
<tr>
<td valign="top" align="left">RandomS<sub>1</sub></td>
<td valign="top" align="center">5183</td>
<td valign="top" align="center">1007</td>
<td valign="top" align="center">6.878</td>
<td valign="top" align="center">0.008</td>
<td valign="top" align="center">3.804</td></tr>
<tr>
<td valign="top" align="left">S<sub>2</sub></td>
<td valign="top" align="center">5065</td>
<td valign="top" align="center">999</td>
<td valign="top" align="center">7.033</td>
<td valign="top" align="center">0.122</td>
<td valign="top" align="center">3.227</td></tr>
<tr>
<td valign="top" align="left">Random S<sub>2</sub></td>
<td valign="top" align="center">5065</td>
<td valign="top" align="center">999</td>
<td valign="top" align="center">7.033</td>
<td valign="top" align="center">0.005</td>
<td valign="top" align="center">3.771</td></tr>
<tr>
<td valign="top" align="left">S<sub>3</sub></td>
<td valign="top" align="center">5035</td>
<td valign="top" align="center">1121</td>
<td valign="top" align="center">6.401</td>
<td valign="top" align="center">0.108</td>
<td valign="top" align="center">3.266</td></tr>
<tr>
<td valign="top" align="left">Random S<sub>3</sub></td>
<td valign="top" align="center">5035</td>
<td valign="top" align="center">1121</td>
<td valign="top" align="center">6.401</td>
<td valign="top" align="center">0.005</td>
<td valign="top" align="center">3.991</td></tr>
</tbody></table>
<table-wrap-foot>
<attrib><italic>N, the number of vertices, &#x003C;<italic>k</italic>>, average degree; <italic>C</italic>, clustering coefficient; <italic>L</italic>, average path length.</italic></attrib>
</table-wrap-foot>
</table-wrap>
<p>Compared with the random network counterpart, a small-world network presents smaller average path length and far greater clustering coefficient (<xref ref-type="bibr" rid="B63">Watts and Strogatz, 1998</xref>). As <xref ref-type="table" rid="T5">Table 5</xref> shows, all the nine syntactic networks have far greater clustering coefficients and smaller average path length than the corresponding random networks. These results suggest that all the 9 syntactic networks display small-world property.</p>
</sec>
<sec><title>Lexical and Syntactic Development of the Primary School Students</title>
<p>This section will be devoted to the English lexical and syntactic development of the primary school students, who have developed neither vocabulary nor syntax well enough to express ideas freely or construct sentences flexibly. Consequently, they had to rely on their mother tongue to finish the writing, and they were allowed (not encouraged) to occasionally use Chinese words. To faithfully reflect their actual use of English, Chinese words in the compositions of the primary schools students (P<sub>4</sub>, P<sub>5</sub>, and P<sub>6</sub>) are included in the analyses in the treebanks and the networks only in this section. The number and the percentage of Chinese word tokens in each treebank are presented in <xref ref-type="table" rid="T6">Table 6</xref>. The syntactic dependency networks of the three primary school grades are displayed in <xref ref-type="fig" rid="F7">Figure 7</xref>. In each graph of <xref ref-type="fig" rid="F7">Figure 7</xref>, for better visualization, English words are symbolized by vertices on the left circle, and Chinese words, by vertices on the right circle. The lines between the left and the right circles are syntactic dependency relations between English words and Chinese words.</p>
<table-wrap position="float" id="T6">
<label>Table 6</label>
<caption><p>The use of Chinese words in the primary school students&#x2019; English compositions.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Grade</th>
<th valign="top" align="center">Chinese word tokens</th>
<th valign="top" align="center">Total word tokens</th>
<th valign="top" align="center">Proportion of Chinese</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">P<sub>4</sub></td>
<td valign="top" align="center">1320</td>
<td valign="top" align="center">6229</td>
<td valign="top" align="center">21.19%</td>
</tr>
<tr>
<td valign="top" align="left">P<sub>5</sub></td>
<td valign="top" align="center">391</td>
<td valign="top" align="center">5439</td>
<td valign="top" align="center">7.19%</td>
</tr>
<tr>
<td valign="top" align="left">P<sub>6</sub></td>
<td valign="top" align="center">115</td>
<td valign="top" align="center">5198</td>
<td valign="top" align="center">2.21%</td></tr>
</tbody>
</table>
</table-wrap>
<fig id="F7" position="float">
<label>FIGURE 7</label>
<caption><p>The Chinese&#x2013;English syntactic dependency networks of P<sub>4</sub> (on the left), P<sub>5</sub> (in the middle), and P<sub>6</sub> (on the right).</p></caption>
<graphic xlink:href="fpsyg-10-00925-g007.tif"/>
</fig>
<p>It can be seen in <xref ref-type="table" rid="T6">Table 6</xref> and <xref ref-type="fig" rid="F7">Figure 7</xref> that in the primary school years, the use of Chinese words tends to decrease with the advancement of L2 learning. Chi-square test shows that the difference in percentage of Chinese words is statistically significant between P<sub>4</sub> and P<sub>5</sub> (21.19 vs. 7.19%, <italic>p</italic> = 0.008). Accordingly, the cross-language syntactic relations between English and Chinese words decreased with the grade growth, which are presented by the lines between the left and right circles in the graph. These results quantitatively reveal that the fifth graders (P<sub>5</sub>) have made considerable progress in their use of English, manifesting the importance of the first year in English learning.</p>
</sec>
<sec><title>Comparisons of Network Parameters</title>
<p>A network has some important parameters, such as the number of vertices, average degree <italic>&#x003C; k ></italic>, clustering coefficient (<italic>C</italic>), and the average path length (<italic>L</italic>), which can characterize the global network properties. As mentioned above, the primary school pupils often use Chinese words in their compositions. But when calculating these network parameters, Chinese words are excluded and only English words in the compositions are included for following network analysis, because the focus of our research is on the syntactic development of English.</p>
<p>The parameters of nine syntactic networks and nine random networks are presented in <xref ref-type="table" rid="T5">Table 5</xref>, and how these parameters change with the growth of grade is shown in <xref ref-type="fig" rid="F8">Figure 8</xref>. The non-parametric Kruskal&#x2013;Wallis test was employed to investigate whether there are significant differences between adjacent grades in these parameters. <xref ref-type="fig" rid="F8">Figure 8A</xref> shows that the number of vertices monotonously increases with the growth of grade, and that the number of edges experiences a rapid growth when students move from J<sub>1</sub> to S<sub>1</sub>. The changes in average degree are presented in <xref ref-type="fig" rid="F8">Figure 8B</xref>, which shows that the average degree on the whole increases across the primary school and the junior high school years, except a slight decrease in J<sub>1</sub>, but fluctuates violently in the senior high school grades. Kruskal&#x2013;Wallis test suggests that there are no significant differences in degree distribution between adjacent grades. <xref ref-type="table" rid="T7">Table 7</xref> displays the 5 vertices (words) with the highest degrees in each network. It can be seen that the nine syntactic networks have similar high-degree words that function as hubs: <italic>is/are/was, and, the, a, I, to, at</italic>, and <italic>in</italic>. Among them, <italic>is/are/was</italic> has the highest degree (the most edges) in 6 networks, especially the networks of the primary school grades. For S<sub>2</sub> and S<sub>3</sub> learners, the preposition <italic>to</italic> has the highest degrees and becomes the most important hub of the network.</p>
<fig id="F8" position="float">
<label>FIGURE 8</label>
<caption><p>Changes in network parameters in L2 learning (from P<sub>4</sub> to S<sub>3</sub>). Panel <bold>(A)</bold> shows the changes of number of vertices and edges from P<sub>4</sub> to S<sub>3</sub>. Panel <bold>(B)</bold> shows the changes in average degree across nine grades. Panel <bold>(C)</bold> displays the evolution of clustering coefficient. The changes in average path length are shown in panel <bold>(D)</bold>.</p></caption>
<graphic xlink:href="fpsyg-10-00925-g008.tif"/>
</fig>
<table-wrap position="float" id="T7">
<label>Table 7</label>
<caption><p>The five vertices with highest degrees in the nine networks.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="center" colspan="2">P<sub>4</sub> Network</th>
<th valign="top" align="center" colspan="2">P<sub>5</sub> Network</th>
<th valign="top" align="center" colspan="2">P<sub>6</sub> Network</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold>Degree</bold></td>
<td valign="top" align="center"><bold>Word</bold></td>
<td valign="top" align="center"><bold>Degree</bold></td>
<td valign="top" align="center"><bold>Word</bold></td>
<td valign="top" align="center"><bold>Degree</bold></td>
<td valign="top" align="center"><bold>Word</bold></td>
</tr>
<tr>
<td valign="top" align="left">233</td>
<td valign="top" align="center">is</td>
<td valign="top" align="center">269</td>
<td valign="top" align="center">is</td>
<td valign="top" align="center">281</td>
<td valign="top" align="center">is</td></tr>
<tr>
<td valign="top" align="left">85</td>
<td valign="top" align="center">and</td>
<td valign="top" align="center">103</td>
<td valign="top" align="center">the</td>
<td valign="top" align="center">118</td>
<td valign="top" align="center">the</td>
</tr>
<tr>
<td valign="top" align="left">79</td>
<td valign="top" align="center">the</td>
<td valign="top" align="center">96</td>
<td valign="top" align="center">and</td>
<td valign="top" align="center">103</td>
<td valign="top" align="center">are</td></tr>
<tr>
<td valign="top" align="left">59</td>
<td valign="top" align="center">a</td>
<td valign="top" align="center">88</td>
<td valign="top" align="center">are</td>
<td valign="top" align="center">90</td>
<td valign="top" align="center">and</td>
</tr>
<tr>
<td valign="top" align="left">55</td>
<td valign="top" align="center">are</td>
<td valign="top" align="center">68</td>
<td valign="top" align="center">a</td>
<td valign="top" align="center">61</td>
<td valign="top" align="center">a</td></tr>
<tr>
<td valign="top" align="left" colspan="6"><hr/></td></tr>
<tr>
<td valign="top" align="center" colspan="2"><bold>J<sub>1</sub> Network</bold><hr/></td>
<td valign="top" align="center" colspan="2"><bold>J<sub>2</sub> Network</bold><hr/></td>
<td valign="top" align="center" colspan="2"><bold>J<sub>3</sub> Network</bold><hr/></td></tr>
<tr>
<td valign="top" align="left"><bold>Degree</bold></td>
<td valign="top" align="center"><bold>Word</bold></td>
<td valign="top" align="center"><bold>Degree</bold></td>
<td valign="top" align="center"><bold>Word</bold></td>
<td valign="top" align="center"><bold>Degree</bold></td>
<td valign="top" align="center"><bold>Word</bold></td>
</tr>
<tr>
<td valign="top" align="left">120</td>
<td valign="top" align="center">is</td>
<td valign="top" align="center">153</td>
<td valign="top" align="center">was</td>
<td valign="top" align="center">124</td>
<td valign="top" align="center">I</td></tr>
<tr>
<td valign="top" align="left">105</td>
<td valign="top" align="center">I</td>
<td valign="top" align="center">123</td>
<td valign="top" align="center">I</td>
<td valign="top" align="center">122</td>
<td valign="top" align="center">is</td>
</tr>
<tr>
<td valign="top" align="left">91</td>
<td valign="top" align="center">to</td>
<td valign="top" align="center">114</td>
<td valign="top" align="center">in</td>
<td valign="top" align="center">120</td>
<td valign="top" align="center">was</td></tr>
<tr>
<td valign="top" align="left">83</td>
<td valign="top" align="center">at</td>
<td valign="top" align="center">111</td>
<td valign="top" align="center">to</td>
<td valign="top" align="center">118</td>
<td valign="top" align="center">to</td>
</tr>
<tr>
<td valign="top" align="left">67</td>
<td valign="top" align="center">the</td>
<td valign="top" align="center">94</td>
<td valign="top" align="center">the</td>
<td valign="top" align="center">90</td>
<td valign="top" align="center">in</td></tr>
<tr>
<td valign="top" align="left" colspan="6"><hr/></td></tr>
<tr>
<td valign="top" align="center" colspan="2"><bold>S<sub>1</sub> Network</bold><hr/></td>
<td valign="top" align="center" colspan="2"><bold>S<sub>2</sub> Network</bold><hr/></td>
<td valign="top" align="center" colspan="2"><bold>S<sub>3</sub> Network</bold><hr/></td></tr>
<tr>
<td valign="top" align="left"><bold>Degree</bold></td>
<td valign="top" align="center"><bold>Word</bold></td>
<td valign="top" align="center"><bold>Degree</bold></td>
<td valign="top" align="center"><bold>Word</bold></td>
<td valign="top" align="center"><bold>Degree</bold></td>
<td valign="top" align="center"><bold>Word</bold></td>
</tr>
<tr>
<td valign="top" align="left" colspan="6"><hr/></td></tr>
<tr>
<td valign="top" align="left">178</td>
<td valign="top" align="center">was</td>
<td valign="top" align="center">180</td>
<td valign="top" align="center">to</td>
<td valign="top" align="center">193</td>
<td valign="top" align="center">to</td></tr>
<tr>
<td valign="top" align="left">175</td>
<td valign="top" align="center">I</td>
<td valign="top" align="center">158</td>
<td valign="top" align="center">was</td>
<td valign="top" align="center">187</td>
<td valign="top" align="center">was</td>
</tr>
<tr>
<td valign="top" align="left">153</td>
<td valign="top" align="center">to</td>
<td valign="top" align="center">147</td>
<td valign="top" align="center">I</td>
<td valign="top" align="center">157</td>
<td valign="top" align="center">I</td></tr>
<tr>
<td valign="top" align="left">109</td>
<td valign="top" align="center">in</td>
<td valign="top" align="center">116</td>
<td valign="top" align="center">in</td>
<td valign="top" align="center">136</td>
<td valign="top" align="center">the</td>
</tr>
<tr>
<td valign="top" align="left">104</td>
<td valign="top" align="center">the</td>
<td valign="top" align="center">114</td>
<td valign="top" align="center">the</td>
<td valign="top" align="center">121</td>
<td valign="top" align="center">in</td></tr>
</tbody>
</table>
</table-wrap>
<p>The changes of clustering coefficient (<italic>C</italic>) are displayed in <xref ref-type="fig" rid="F8">Figure 8C</xref>. It can be seen that the clustering coefficient descends dramatically during the first 3 years, rises slightly in the junior high school years, and then fluctuates in the senior high school years. Kruskal&#x2013;Wallis test suggests significant differences between the grades of P<sub>4</sub> and P<sub>5</sub> (<italic>p</italic> &#x003C; 0.001), P<sub>6</sub> and J<sub>1</sub> (<italic>p</italic> &#x003C; 0.001), J<sub>1</sub> and J<sub>2</sub> (<italic>p</italic> = 0.040), J<sub>3</sub> and S<sub>1</sub> (<italic>p</italic> = 0.003). <xref ref-type="fig" rid="F8">Figure 8D</xref> shows the changes in average path length (<italic>L</italic>), which experiences a sharp increase in J<sub>1</sub>. Significant differences are found between the grades of P<sub>6</sub> and J<sub>1</sub> (<italic>p</italic> &#x003C; 0.001), J<sub>3</sub> and S<sub>1</sub> (<italic>p</italic> = 0.010).</p>
<p>The language acquired by L2 learners, i.e., the &#x201C;interlanguage,&#x201D; is considered as closely related to both the native and the target languages (<xref ref-type="bibr" rid="B55">Selinker, 1969</xref>). Then it is valuable to compare network properties (parameters) of the interlanguage, the native language, and the target language, so as to pin down the possible unique features of interlanguage. The network parameters of native language (Chinese and English), which are from <xref ref-type="bibr" rid="B36">Liu and Li (2010)</xref>, are presented in <xref ref-type="fig" rid="F8">Figure 8B</xref>&#x2013;<xref ref-type="fig" rid="F8">D</xref>, where the full line indicates English network parameters and the dotted line indicates Chinese network parameters. The results of the comparison will be discussed in Section &#x201C;Comparisons of Network Parameters of the Nine Networks.&#x201D;</p>
</sec>
</sec>
<sec><title>Discussion</title>
<sec><title>Scale-Free and Small-World Properties of the Nine Syntactic Dependency Networks</title>
<p>Scale-free and small-world properties are two network indictors of the emergence of syntax. With the abrupt appearances of these two properties in L1 networks, <xref ref-type="bibr" rid="B10">Corominas-Murtra et al. (2009)</xref> identified the emergence of syntactic network in L1 acquisition. The present study also uses these two properties as network indicators, and the results show that the networks from nine grades (P<sub>4</sub> to J<sub>3</sub>) all exhibit scale-free and small-world properties.</p>
<p>A scale-free network means that in this network a minority of vertices have extremely high degrees while a majority of vertices have relatively low degrees (<xref ref-type="bibr" rid="B46">Newman, 2003</xref>; <xref ref-type="bibr" rid="B18">Ferrer-i-Cancho et al., 2004</xref>). To recap, the degree of vertices follows a Zipfian-law distribution, as can be seen in <xref ref-type="fig" rid="F6">Figure 6</xref>, which clearly points to the fact that the nine syntactic networks all exhibit the scale-free property. Obviously, this finding is different from the findings of L1 study by <xref ref-type="bibr" rid="B10">Corominas-Murtra et al. (2009)</xref>, who reported that L1 acquisition experiences a phase shift from a non-scale-free structure to a scale-free network when children were about 2 years old. However, our findings show that there is no such phase shift in L2 learning.</p>
<p>But there are differences among nine networks in how well the Zipfian distribution fits the degrees of their vertices. These differences are reflected by the power exponent &#x03B3; of degree distribution, which often ranges from 2 to 3 in a scale-free network (<xref ref-type="bibr" rid="B2">Barabasi and Albert, 1999</xref>). The &#x03B3;&#x2019; of the corresponding cumulative degree distribution equals &#x03B3;-1, so the value of &#x03B3;&#x2019; is between 1 and 2. The more &#x03B3;&#x2019; approximates to value &#x201C;1,&#x201D; the better Zipfian distribution fits the data. As can be seen in <xref ref-type="fig" rid="F6">Figure 6</xref>, &#x03B3;&#x2019; first rapidly increases during the first 3 years of language learning, then stagnates at around 1.38. In a syntactic network, the scale-free property reflects the different ability of vertices (words) to syntactically combine with other words (<xref ref-type="bibr" rid="B9">Cong and Liu, 2014</xref>). Therefore, the fact that the degree of a syntactic network fits Zipfian distribution better implies that the students are able to use these words more proficiently. One would assume that with the growth of age and grade, the syntactic network should produce exponent closer to value &#x201C;1,&#x201D; fitting Zipfian distribution better, which, however, is not confirmed in our study. This could be due to the large quantity of language mistakes made by the primary school students and the repeated use of similar sentence structures. <xref ref-type="table" rid="T7">Table 7</xref> shows that in networks P<sub>4</sub>, P<sub>5</sub>, and P<sub>6</sub>, the top hub is invariably the vertex <italic>is</italic>, whose degree is constantly over 200, almost twice as many as the degrees of the top hub in networks S<sub>1</sub>, S<sub>2</sub>, and S<sub>3</sub>. In other words, networks P<sub>4</sub>, P<sub>5</sub>, and P<sub>6</sub> display a more Zipfian-like distribution. However, the high degree of <italic>is</italic> in networks P<sub>4</sub>, P<sub>5</sub>, and P<sub>6</sub> does not mean high language proficiency. Instead, it may result from the beginners&#x2019; limited lexicon and the repeated use of similar sentence structures such as <italic>This is&#x2026;</italic> and <italic>It is&#x2026;</italic>. A detailed explanation would be given in Section &#x201C;Comparisons of Network Parameters of the Nine Networks.&#x201D;</p>
<p>Compared with the random network counterpart, a small-world network has smaller average path length and far greater clustering coefficient (<xref ref-type="bibr" rid="B63">Watts and Strogatz, 1998</xref>). As <xref ref-type="table" rid="T5">Table 5</xref> shows, all the nine syntactic networks display far greater clustering coefficients and smaller average path length than those of the corresponding random networks. These results suggest that all the syntactic networks display a small-world property.</p>
<p>Similarly, there is no abrupt emergence of small-world property during L2 learning. In other words, the syntactic networks of L2 learners exhibit small-world property even in the primary school years. In a nutshell, the dependency networks of L2 learners from all 9 grades display both scale-free and small-world properties. In contrast, such properties, which are absent at the initial stage, will suddenly emerge during L1 acquisition. This disparity can be attributed to the fact that during L2 learning, learners can rely on the syntactic similarity between the native language&#x2014;Chinese and the target language&#x2014;English in this case to construct sentences. It is known that both languages are SVO languages, with some slight differences, such as the placement of attributives, adverbials and the word order of interrogatives. For language beginners, most of their productions are simple sentences with basic subject-verb-object structure like <italic>My family has six people. I have a brother. He is tall</italic> and <italic>The apple is haochi</italic> (Chinese pinyin for <italic>delicious</italic>). These simple sentences have similar structures in both English and Chinese. Therefore, as long as the basic vocabulary is mastered, early English learners can readily construct English sentences by resorting to their syntactic knowledge of Chinese. Moreover, English dependency network has much in common with Chinese dependency network (<xref ref-type="bibr" rid="B36">Liu and Li, 2010</xref>). In other words, positive transferring of mother language&#x2019;s syntax is possible, which may explain the absence of sudden emergence of syntactic complex networks in Chinese English learners. The syntactic knowledge of Chinese facilitates the mastering of English syntactic structures. Therefore, if native and target languages have similar syntactic structures, syntactic phase transition may not take place during L2 learning. This tentative conclusion, of course, needs more evidence from different languages. In addition, this lack of phase shift can be explained with the Unified Competition Model (UCM) proposed by <xref ref-type="bibr" rid="B39">MacWhinney (2012)</xref>. There is a competition between native language and target language during L2 learning: the &#x201C;entrenched&#x201D; L1 knowledge constrains the learning of new knowledge of L2, and the degree of &#x201C;entrenchment&#x201D; depends on the extent of consolidation of the learner&#x2019;s L1 (<xref ref-type="bibr" rid="B31">Li, 2015</xref>). As L1 knowledge becomes more solid, new and different L2 structures are more difficult to acquire. Chinese English learners begin to learn L2 at around the age of nine, and at that time their L1 syntax has already been well-established. Hence, learners will use the already well-established L1 syntactic rules to generate L2 sentences. L2 syntactic network, as a result, bears much resemblance to extant L1 network, which renders the phase shift very unlikely in L2 learning.</p>
</sec>
<sec><title>Lexical and Syntactic Development of the Primary School Students</title>
<p>There are three reasons for the extra attention paid to the primary school students. First, as mentioned in Section &#x201C;Background Information of Participants and the Corpus Construction,&#x201D; Chinese students start to learn L2 at the fourth grade in the primary school, at the age of nine. L2 research has attached much importance to children&#x2019;s second language learning (<xref ref-type="bibr" rid="B28">Lakshmanan, 1995</xref>). Therefore, this period is worthy of close examination: if there is the sudden emergence of syntax, which is signaled by the small-world and the scale-free properties, it may well occur in this period. Moreover, language immaturity and the resulting vast mistakes pose a great challenge for studies of primary school students&#x2019; English. Previous studies rarely investigate into the second language of children in this period, not to mention the syntactic development. Not least, different from students of high schools, the primary school students often use L1 in their compositions. Given these reasons, this section will closely examine the language progress in the primary school students.</p>
<p>For the primary school students, neither the L2 vocabulary nor the L2 syntax has developed well enough for them to express ideas or construct sentences freely in L2. Consequently, they have to rely on their L1 to finish the writing (<xref ref-type="bibr" rid="B8">Cohen and Brooks-Carson, 2001</xref>). This code-mixing phenomenon is the most prominent characteristic of L2 learning in this phase. It can be seen in <xref ref-type="table" rid="T6">Table 6</xref> and <xref ref-type="fig" rid="F7">Figure 7</xref> that for the primary school students, the use of Chinese words tends to decrease with the advancement of L2 learning, as has been reported in previous studies (<xref ref-type="bibr" rid="B62">Wang and Wen, 2002</xref>; <xref ref-type="bibr" rid="B65">Woodall, 2002</xref>). Besides, the dramatic decrease of Chinese words at the grade of P<sub>5</sub> is also noteworthy. As shown in <xref ref-type="fig" rid="F7">Figure 7</xref>, the dependency relations between L1 words (the right circle) and L2 words (the left circle) decrease steadily with the grade growth. Most such dependency relations are replaced by English&#x2013;English dependencies in networks P<sub>5</sub> and P<sub>6</sub>. In brief, while L1 acquisition starts from scratch, L2 learning begins with the mixed use of two languages.</p>
</sec>
<sec><title>Comparisons of Network Parameters of the Nine Networks</title>
<p>In order to explore the specific syntactic features exhibited at different stages of L2 learning, this section comparatively probes into the important network parameters of the 9 syntactic networks, including the number of vertices, the average degree <italic>&#x003C; k ></italic>, clustering coefficient (<italic>C</italic>), and the average path length (<italic>L</italic>).</p>
<p><xref ref-type="table" rid="T4">Table 4</xref> shows the numbers of word types, tokens and TTRs of each network. It can be seen that the lexical diversity or vocabulary richness increases gradually with the grade growth. <xref ref-type="fig" rid="F8">Figure 8A</xref> shows that the number of vertices increases steadily with the grade growth, and that the number of edges experiences, from J<sub>1</sub> to S<sub>1</sub>, a rapid rise. Edges in a syntactic dependency network are syntactic relations between words. The rapid increase of edges thus indicates the rapid development of syntax. This means that the richness and complexity of syntactic relations, i.e., syntactic proficiency, have witnessed a substantial development in the junior high school year and the first senior high school year.</p>
<p>The changes in degree and average degree also deserve our attention. Vertices with relatively high degrees are hubs of a network. The 5 vertices with the highest degrees in the nine L2 networks are displayed in <xref ref-type="table" rid="T7">Table 7</xref>. L1 syntactic development witnesses a critical shift of hubs from semantic word <italic>it</italic> to function words <italic>a</italic> or <italic>the</italic> when the properties of scale-freeness and small-worldness emerge (<xref ref-type="bibr" rid="B10">Corominas-Murtra et al., 2009</xref>). However, in L2 syntactic development, the situation is different: all 9 syntactic networks have similar hubs (<italic>is/are/was, and, the, a, I, to, at</italic>, and <italic>in</italic>). Function words such as <italic>and, the, a</italic> have high degrees and play important roles even in the networks of L2 beginners. In addition, the copula <italic>be</italic> persistently has the highest degrees almost throughout the learning process. During the senior high school years, <italic>to</italic> has the highest degrees, becoming the most important vertex in networks. These findings are consistent with previous findings that function words such as articles and prepositions tend to be hubs of a network (<xref ref-type="bibr" rid="B17">Ferrer-i-Cancho and Sol&#x00E9;, 2001</xref>; <xref ref-type="bibr" rid="B9">Cong and Liu, 2014</xref>; <xref ref-type="bibr" rid="B23">Jin and Liu, 2016</xref>). These hubs, i.e., the copula <italic>be</italic> and other function words, exists even in network P<sub>4</sub>, which may account for the absence of the phase shift, that is, the sudden emergence of scale-free property in L2 learning. Function words are key elements in sentence structures (<xref ref-type="bibr" rid="B27">Klammer et al., 2010</xref>). The high degrees of function words indicate their great combinatorial capacity in syntactic networks.</p>
<p>The average degree, as shown in <xref ref-type="fig" rid="F8">Figure 8B</xref>, presents an increasing trend over the period from P<sub>4</sub> to J<sub>3</sub>, except for a slight decrease in J<sub>1</sub>, and a descending trend in the senior high school years. The degree of a vertex (word) indicates its syntactic valency, i.e., its ability to form syntactic dependencies with words (<xref ref-type="bibr" rid="B7">Chen et al., 2011</xref>; <xref ref-type="bibr" rid="B9">Cong and Liu, 2014</xref>). Thus the said increasing average degree means enriched syntactic valency. That is, during the years of the primary school and the junior high school, students&#x2019; syntactic capacity develops gradually with the grade. However, during the senior high school years, the average degree firstly rises moderately, but then falls abruptly in S<sub>3</sub>, which is beyond our expectation. Probably, for Chinese S<sub>3</sub> students, English learning has become a kind of repetitive practice and exercises for college entrance examination, resulting in the stagnation of syntactic development. As for the networks of mother tongues, the average degree is 7.127 for English and 6.478 for Chinese. Interestingly, the average degrees of networks J<sub>2</sub>, J<sub>3</sub>, S<sub>1</sub>, and S<sub>2</sub> fluctuate within this range, somewhere between the average degrees of the native and the target languages. In other words, the interlanguage, namely the English acquired by Chinese students, is syntactically different from the target language. The disparity between interlanguage and target language is also revealed by the slight differences in the probability distribution of dependency distance (<xref ref-type="bibr" rid="B49">Ouyang and Jiang, 2018</xref>).</p>
<p>The changes in clustering coefficient are linguistically significant as well. As displayed in <xref ref-type="fig" rid="F8">Figure 8C</xref>, the clustering coefficient descends dramatically during the first 3 years, rises slightly in the junior high school years, and then fluctuates in the senior high school years. The decrease of clustering coefficient in the first 3 years, especially in J<sub>1</sub>, can be attributed to the rapid increase of vertices, i.e., vocabulary, and the resulting &#x201C;dilution&#x201D; of edges, which may be construed as the lagging development of syntax. Note that the clustering coefficient (<italic>C</italic>) of a vertex is the ratio of the actual edges to all possible edges among its neighbor vertices. Hence, if a vertex links to only one vertex (i.e., poor combinatorial capacity), the <italic>C</italic> of this vertex is zero. The sudden drop in J<sub>1</sub>, therefore, implies that many vertices may have zero clustering coefficient, owing to the rapid increase of vocabulary and the simple syntactic structures used by beginners. In other words, J<sub>1</sub> students may experience an expansion of vocabulary, but lack the ability to use these words creatively in new contexts. But with the advancement of learning, this ability gradually improves, leading to enriched syntactic valency and increased clustering coefficient. <xref ref-type="bibr" rid="B60">Verspoor et al. (2012)</xref> proposed that the learning focus for beginners is the accumulation of vocabulary, and given that the vocabulary threshold is reached, middle-level learners will shift much attention to sentence structures. Besides, networks of native English and native Chinese display quite similar clustering coefficient: 0.122 and 0.128 respectively. The clustering coefficient of the interlanguage, except for the primary school students, generally fluctuates around that of native languages.</p>
<p>The average path lengths (<italic>L</italic>) of these syntactic networks are shown in <xref ref-type="fig" rid="F8">Figure 8D</xref>. <italic>L</italic> measures the network distance and the separation degree between a pair of vertices. As can be seen in <xref ref-type="fig" rid="F8">Figure 8D</xref>, the average path length experiences a sharp increase in J<sub>1</sub>. Interestingly, the changing trajectory of average path length seems to inversely mirror that of clustering coefficient. The reason for the decrease of <italic>C</italic>, i.e., the rapid increase of vocabulary, may also account for the sudden rise of <italic>L</italic> in J<sub>1</sub>. When all vertices are linked to one center node, the <italic>L</italic> is the smallest, and the small value of <italic>L</italic> in a network has much to do with hubs (<xref ref-type="bibr" rid="B63">Watts and Strogatz, 1998</xref>; <xref ref-type="bibr" rid="B48">Nishikawa et al., 2002</xref>). Therefore, in networks P<sub>4</sub>, P<sub>5</sub>, P<sub>6</sub>, the relatively high degrees of the hubs, i.e., many dependency of words like <italic>is</italic>, lead to low <italic>L</italic>. The abrupt increase of <italic>L</italic> in J<sub>1</sub> may also indicate that the syntactic ability lags behind lexicon, which has also been observed in L1 learners under the age of two, i.e., before the phase shift (<xref ref-type="bibr" rid="B10">Corominas-Murtra et al., 2009</xref>). Moreover, the boom of edges during the junior high school years (as seen in <xref ref-type="fig" rid="F8">Figure 8A</xref>) may have much to do with the reduction of the average path length <italic>L</italic>. As to networks of L1, the average path length is 3.308 for English and 3.371 for Chinese. It can be seen that, for both junior and senior high school students, the average path length is slightly below those of both native English and native Chinese. This fact reflects the independence of the interlanguage to some extent. Similar to average degree, the average path length of interlanguage does not reach that of target language. This fact suggests that, even for advanced Chinese English learners, the L2 syntactic network is sparser than the network of native English, which means that it is not as well-organized as the syntactic network of native English.</p>
<p>From the above analysis, it can be concluded that in L2 learning there are no syntactic phase shift, namely, no sudden emergence of scale-freeness and small-worldness in syntactic networks of Chinese English learners. Different from L1 acquisition, which starts from scratch and features the sudden emergences of the above two complex network properties, L2 learning is usually based on an existing L1 syntactic network. Therefore, such an emergence is absent. Instead, there is a rather gradual approximation to the target language. Moreover, foreign language is acquired non-linearly and different linguistic subsystems (lexicon, syntax, etc.) are learned at different paces in different learning stages. Vocabulary goes through an expansion in the first year of the junior high schools, because in that year English becomes a major subject and textbook provides considerable vocabulary input. Syntax, on the other hand, does not substantially develop until late junior high school years and senior high school years, especially J<sub>3</sub> and S<sub>1</sub>. In other words, syntax develops later than lexicon. In addition, the fluctuations of some parameters in senior high school years support the theory of fossilization (<xref ref-type="bibr" rid="B56">Selinker and Lamendella, 1978</xref>). In other words, language competence of L2 learners does not improve continuously with grade. Instead, after a certain period, the progress may slow down, stagnate, or even decline. Besides, through the comparison of these network parameters of the interlanguage, the native language and the target language, it can be seen that interlanguage has its independent status, not simply a variety of the target language that is distorted by the mother tongue. It actually displays properties which are unique, peculiar to itself.</p>
</sec>
</sec>
<sec><title>Conclusion</title>
<p>Based on dependency treebanks, network analyses of syntax provide new insights into the overall complexity of human language, which is unavailable with traditional linguistic methods (<xref ref-type="bibr" rid="B9">Cong and Liu, 2014</xref>). In the present study, quantitative analyses of dependency syntactic networks of L2 learners have answered the proposed research questions we intend to explore. First, in L2 learning there is no phase shift from a pre-syntactic structure to a syntactic network featuring scale-freeness and small-worldness. From the very beginning of L2 learning, i.e., the P<sub>4</sub> grade, the syntactic networks of L2 learners have displayed the scale-free and small-world network properties, which is different from what has been observed in L1 acquisition. The reason is probably that the existent L1 syntactic system has already provided foundation for L2 syntax learning, and the entrenched L1 knowledge constrains the learning of new L2 syntactic knowledge. L2 learners tend to use the already well-established L1 syntactic network to generate L2 syntactic structures, which results in the absence of sudden emergence of the above two network properties. L2 syntactic learning is characterized by gradual approximation to the target language. Second, in L2 learning, the vocabulary gradually expands with the growth of grade, but the primary school students tend to rely heavily on their mother tongue in English writing, involving frequent code-mixing. The use of mother tongue declines significantly in P<sub>5</sub> and vanishes in J<sub>1</sub>. Furthermore, network parameters, namely, the average degree, the number of edges, the clustering coefficient, and the average path length, indicate significant increase of lexical diversity in J<sub>1</sub>, and lagging maturation of syntax in J<sub>3</sub> and S<sub>1</sub>. The syntactic network of Chinese English learners, even the advanced ones, is not as well-organized as that of native speakers. Third, the analyses of network parameters also reveal the fluctuation or fossilization of syntactic capacity of the senior high school students. In other words, the developments of L2 lexical and syntactic capacity are neither linear nor unidirectional.</p>
<p>Language as a complex adaptive system involves the interaction, cooperation and also competition among its subsystems (e.g., L1 and L2, lexicon and syntax). Complex network approach employed in this study provides operable instrumentality to investigate the complex system of language. The L2 syntactic system, as discussed above, is not isolated or independent. Instead, during the L2 learning, learners, especially the beginners, frequently resort to their entrenched L1 syntactic knowledge to construct sentences. For L2 learners, L1 and L2 are closely related. What&#x2019;s more, in L2 learning, the significant increase of lexical diversity in J<sub>1</sub> and the lagging maturation of syntax in J<sub>3</sub> and S<sub>1</sub> indicate the competition between lexicon and syntax of a single language. This study is the first to apply complex network method to macroscopically investigate the emergence of L2 syntax, enriching the study of language complexity.</p>
<p>However, our research does have some limitations. The most obvious one lies in the compositions we used, which are collected from different groups of students and different schools. This fact means our research is actually a pseudo longitudinal research. Language learners of the same grade also have great individual differences, and some of them may have after-school English lessons. Therefore, though the grade is a relatively effective way to indicate language proficiency, it would be better to group students according to learners&#x2019; actual language proficiency. That being said, we did try to have some control over the students and the compositions. For example, the students were all chosen from the schools with similar education quality and rankings. The students selected are those of average performance in each grade, neither the best nor the worst, which may guarantee that the students are comparable. The compositions from each grade are written and collected at the same time point, which makes sure that between every two adjacent grades, the difference in English learning time is exactly 1 year. Of course, in future studies, it would be desirable that participants should be divided strictly by their language proficiency. Also, though complex network approach offers us a macroscopic picture of language structure and some insight into the dynamic cognitive process in L2 learning, further explorations are needed to clarify the relationship between the macroscopic complexity and microscopic linguistic features.</p>
</sec>
<sec><title>Author Contributions</title>
<p>JJ and HL conceived and designed the study. JJ and WY collected the data and performed the statistical analysis. All authors contributed to the result interpretation and manuscript writing.</p>
</sec>
<sec><title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<fn-group>
<fn fn-type="financial-disclosure">
<p><bold>Funding.</bold> This study was partly supported by the National Social Science Foundation of China (Grant No. 17AYY021), the Fundamental Research Funds for the Central Universities (<italic>Research on the Syntactic Development of English Learners; Program of Big Data PLUS Language Universals and Cognition</italic>, Zhejiang University), and the MOE Project of the Center for Linguistics and Applied Linguistics, Guangdong University of Foreign Studies.</p>
</fn>
</fn-group>
<ack>
<p>We would like to express our sincere gratitude to Dr. Elisabeth Karuza, Dr. Chunshan Xu, and the three reviewers for their valuable suggestions which are of great help to the improvement of the manuscript.</p>
</ack>
<app-group>
<app id="A1">
<title>Appendix</title>
<p>With the syntactic dependency network in <xref ref-type="fig" rid="F3">Figure 3</xref> as an example, we list the overall procedure for the analysis of a syntactic dependency network as follows:</p>
<list list-type="simple" prefix-word="simple">
<list-item><label>(1)</label><p>Treebank building. Our treebank takes the form of an Excel table, with one column as the dependents and another column as their respective governors.</p></list-item>
<list-item><label>(1)</label><p>Data transformation. The data of an Excel form (an.xls file) should be transformed into a.net file before importing into the software <bold>Pajek</bold> by using the software <bold>Creatpajek</bold>.</p></list-item>
<list-item><label>(3)</label><p>Data importation. Click &#x201C;File &#x2192; Network &#x2192; Read&#x201D; on the main window of <bold>Pajek</bold>, then the.net file was imported into the software <bold>Pajek</bold>.</p></list-item>
<list-item><label>(4)</label><p>Random network generation. The number of vertices and edges of the original network are obtained by clicking &#x201C;Info &#x2192; Network &#x2192; General&#x201D; on the main window of <bold>Pajek</bold>. Click &#x201C;Net &#x2192; Random Networks &#x2192; Total No. of Arcs &#x2192; input the number of vertices and edges of the original network,&#x201D; then the corresponding directed random Erd&#x00F6;s&#x2013;R&#x00E9;nyi network is generated, whose arcs need to be converted into edges. Click &#x201C;Net &#x2192; Transform &#x2192; Arcs- > Edges &#x2192; All,&#x201D; then the corresponding random network is obtained.</p></list-item>
<list-item><label>(5)</label><p>Network analysis.</p>
<p>Click &#x201C;Net &#x2192; Transform &#x2192; Remove &#x2192; Multiple lines/Loops&#x201D; on the main window of <bold>Pajek</bold>, then the multiple lines and the loops of are removed from the network;</p>
<p>Click &#x201C;Draw &#x2192; Draw&#x201D; on the main window of <bold>Pajek</bold>, then click &#x201C;Layout &#x2192; Energy &#x2192; Kamada-Kawai &#x2192; Free&#x201D; on the draw window of Pajek, we could obtain a macro picture of the network;</p>
<p>Click &#x201C;Net &#x2192; Partitions &#x2192;Degree &#x2192; All&#x201D; on the main window of <bold>Pajek</bold>, then the <italic>degree</italic> of every vertex in the network are calculated;</p>
<p>Click &#x201C;Info &#x2192; Network &#x2192; General&#x201D; on the main window of <bold>Pajek</bold>, then the value of the network&#x2019;s <italic>average degree</italic> could be reached;</p>
<p>Click &#x201C;Net &#x2192; Vector &#x2192; Clustering Coefficient &#x2192; CC1&#x201D; on the main window of <bold>Pajek</bold> to calculate the <italic>clustering coefficient</italic> of the network;</p>
<p>Click &#x201C;Net &#x2192; Paths Between 2 Vertices &#x2192; Distribution of Distance &#x2192; From All Vertices&#x201D; on the main window of <bold>Pajek</bold>, the shortest path length of the network is obtained.</p></list-item></list>
</app>
</app-group>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baba</surname> <given-names>K.</given-names></name> <name><surname>Nitta</surname> <given-names>R.</given-names></name></person-group> (<year>2014</year>). <article-title>Phase transitions in development of writing fluency from a complex dynamic systems perspective.</article-title> <source><italic>Lang. Learn.</italic></source> <volume>64</volume> <fpage>1</fpage>&#x2013;<lpage>35</lpage>. <pub-id pub-id-type="doi">10.1111/lang.12033</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barabasi</surname> <given-names>A.</given-names></name> <name><surname>Albert</surname> <given-names>R.</given-names></name></person-group> (<year>1999</year>). <article-title>Emergence of scaling in random networks.</article-title> <source><italic>Science</italic></source> <volume>286</volume> <fpage>509</fpage>&#x2013;<lpage>512</lpage>. <pub-id pub-id-type="doi">10.1126/science.286.5439.509</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baronchelli</surname> <given-names>A.</given-names></name> <name><surname>Ferrer-i-Cancho</surname> <given-names>R.</given-names></name> <name><surname>Pastor-Satorras</surname> <given-names>R.</given-names></name> <name><surname>Chater</surname> <given-names>N.</given-names></name> <name><surname>Christiansen</surname> <given-names>M. H.</given-names></name></person-group> (<year>2013</year>). <article-title>Networks in cognitive science.</article-title> <source><italic>Trends Cogn. Sci.</italic></source> <volume>17</volume> <fpage>348</fpage>&#x2013;<lpage>360</lpage>. <pub-id pub-id-type="doi">10.1016/j.tics.2013.04.010</pub-id> <pub-id pub-id-type="pmid">23726319</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Batagelj</surname> <given-names>V.</given-names></name> <name><surname>Mrvar</surname> <given-names>A.</given-names></name></person-group> (<year>2011</year>). <source><italic>Pajek: Program for Analysis and Visualization of Large Networks.</italic></source></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Beckner</surname> <given-names>C.</given-names></name> <name><surname>Ellis</surname> <given-names>N. C.</given-names></name> <name><surname>Blythe</surname> <given-names>R.</given-names></name> <name><surname>Holland</surname> <given-names>J.</given-names></name> <name><surname>Bybee</surname> <given-names>J.</given-names></name> <name><surname>Ke</surname> <given-names>J.</given-names></name><etal/></person-group> (<year>2009</year>). <article-title>Language is a complex adaptive system: position paper.</article-title> <source><italic>Lang. Learn.</italic></source> <volume>59</volume> <fpage>1</fpage>&#x2013;<lpage>26</lpage>. <pub-id pub-id-type="doi">10.1111/j.1467-9922.2009.00533.x</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Butts</surname> <given-names>C. T.</given-names></name></person-group> (<year>2009</year>). <article-title>Revisiting the foundations of network analysis.</article-title> <source><italic>Science</italic></source> <volume>325</volume> <fpage>414</fpage>&#x2013;<lpage>416</lpage>. <pub-id pub-id-type="doi">10.1126/science.1171022</pub-id> <pub-id pub-id-type="pmid">19628855</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>X.</given-names></name> <name><surname>Xu</surname> <given-names>C.</given-names></name> <name><surname>Li</surname> <given-names>W.</given-names></name></person-group> (<year>2011</year>). <article-title>&#x201C;Extracting valency patterns of word classes from syntactic complex networks,&#x201D; in</article-title> <source><italic>Proceedings of the International Conference on Dependency Linguistics</italic></source> <role>eds</role> <person-group person-group-type="editor"><name><surname>Gerdes</surname> <given-names>K.</given-names></name> <name><surname>Haji&#x010D;ov&#x00E1;n</surname> <given-names>E.</given-names></name> <name><surname>Wanner Barcelona</surname> <given-names>L.</given-names></name></person-group> <fpage>165</fpage>&#x2013;<lpage>172</lpage>.</citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cohen</surname> <given-names>A. D.</given-names></name> <name><surname>Brooks-Carson</surname> <given-names>A.</given-names></name></person-group> (<year>2001</year>). <article-title>Research on direct versus translated writing: students&#x2019; strategies and their results.</article-title> <source><italic>Mod. Lang. J.</italic></source> <volume>85</volume> <fpage>169</fpage>&#x2013;<lpage>188</lpage>. <pub-id pub-id-type="doi">10.1111/0026-7902.00103</pub-id></citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cong</surname> <given-names>J.</given-names></name> <name><surname>Liu</surname> <given-names>H.</given-names></name></person-group> (<year>2014</year>). <article-title>Approaching human language with complex networks.</article-title> <source><italic>Phys. Life Rev.</italic></source> <volume>11</volume> <fpage>598</fpage>&#x2013;<lpage>618</lpage>. <pub-id pub-id-type="doi">10.1016/j.plrev.2014.04.004</pub-id> <pub-id pub-id-type="pmid">24794524</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Corominas-Murtra</surname> <given-names>B.</given-names></name> <name><surname>Valverde</surname> <given-names>S.</given-names></name> <name><surname>Sol&#x00E9;</surname> <given-names>R. V.</given-names></name></person-group> (<year>2009</year>). <article-title>The ontogeny of scale-free syntax networks: phase transitions in early language acquisition.</article-title> <source><italic>Adv. Complex Syst.</italic></source> <volume>12</volume> <fpage>371</fpage>&#x2013;<lpage>392</lpage>. <pub-id pub-id-type="doi">10.1142/S0219525909002192</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Corominas-Murtra</surname> <given-names>B.</given-names></name> <name><surname>Valverde</surname> <given-names>S.</given-names></name> <name><surname>Sol&#x00E9;</surname> <given-names>R. V.</given-names></name></person-group> (<year>2010</year>). <article-title>&#x201C;Emergence of scale-free syntax networks,&#x201D; in</article-title> <source><italic>Evolution of Communication and Language in Embodied Agents</italic></source> <role>eds</role> <person-group person-group-type="editor"><name><surname>Nolfi</surname> <given-names>S.</given-names></name> <name><surname>Mirolli</surname> <given-names>M.</given-names></name></person-group> (<publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>) <fpage>83</fpage>&#x2013;<lpage>101</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-642-01250-1_6</pub-id> <pub-id pub-id-type="pmid">30662738</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>de Bot</surname> <given-names>K.</given-names></name> <name><surname>Lowie</surname> <given-names>W.</given-names></name> <name><surname>Verspoor</surname> <given-names>M.</given-names></name></person-group> (<year>2007</year>). <article-title>A dynamic systems theory approach to second language acquisition.</article-title> <source><italic>Biling</italic></source> <volume>10</volume> <fpage>7</fpage>&#x2013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1017/S1366728906002732</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>De Nooy</surname> <given-names>W.</given-names></name> <name><surname>Mrvar</surname> <given-names>A.</given-names></name> <name><surname>Batagelj</surname> <given-names>V.</given-names></name></person-group> (<year>2018</year>). <source><italic>Exploratory Social Network Analysis with Pajek: Revised and Expanded Edition for Updated Software</italic></source> <edition>3rd Edn.</edition> <publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>.</citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ellis</surname> <given-names>N. C.</given-names></name></person-group> (<year>1998</year>). <article-title>Emergentism, connectionism and language learning.</article-title> <source><italic>Lang. Learn.</italic></source> <volume>48</volume> <fpage>631</fpage>&#x2013;<lpage>664</lpage>. <pub-id pub-id-type="doi">10.1111/0023-8333.00063</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ellis</surname> <given-names>N. C.</given-names></name></person-group> (<year>2016</year>). <article-title>Salience, cognition, language complexity, and complex adaptive system.</article-title> <source><italic>Stud. Second Lang. Acquis.</italic></source> <volume>38</volume> <fpage>341</fpage>&#x2013;<lpage>351</lpage>. <pub-id pub-id-type="doi">10.1017/S027226311600005X</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ellis</surname> <given-names>N. C.</given-names></name> <name><surname>Larsen-Freeman</surname> <given-names>D.</given-names></name></person-group> (<year>2009</year>). <article-title>Constructing a second language: analyses and computational simulations of the emergence of linguistic constructions from usage.</article-title> <source><italic>Lang. Learn.</italic></source> <volume>59</volume> <fpage>90</fpage>&#x2013;<lpage>125</lpage>. <pub-id pub-id-type="doi">10.1111/j.1467-9922.2009.00537.x</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ferrer-i-Cancho</surname> <given-names>R.</given-names></name> <name><surname>Sol&#x00E9;</surname> <given-names>R. V.</given-names></name></person-group> (<year>2001</year>). <article-title>The small world of human language.</article-title> <source><italic>Proc. Biol. Sci.</italic></source> <volume>268</volume> <fpage>2261</fpage>&#x2013;<lpage>2265</lpage>. <pub-id pub-id-type="doi">10.1098/rspb.2001.1800</pub-id> <pub-id pub-id-type="pmid">11674874</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ferrer-i-Cancho</surname> <given-names>R.</given-names></name> <name><surname>Sol&#x00E9;</surname> <given-names>R. V.</given-names></name> <name><surname>K&#x00F6;hler</surname> <given-names>R.</given-names></name></person-group> (<year>2004</year>). <article-title>Patterns in syntactic dependency networks.</article-title> <source><italic>Phys. Rev. E</italic></source> <volume>69</volume>:<issue>051915</issue>. <pub-id pub-id-type="doi">10.1103/PhysRevE.69.051915</pub-id> <pub-id pub-id-type="pmid">15244855</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gromov</surname> <given-names>V.</given-names></name> <name><surname>Migrina</surname> <given-names>A.</given-names></name></person-group> (<year>2017</year>). <article-title>A Language as a self-organized critical system.</article-title> <source><italic>Complexity</italic></source> <volume>2017</volume> <fpage>1</fpage>&#x2013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1155/2017/9212538</pub-id></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Holland</surname> <given-names>J. H.</given-names></name></person-group> (<year>1998</year>). <source><italic>Emergence: From Chaos to Order.</italic></source> <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>. <pub-id pub-id-type="doi">10.1155/2017/9212538</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hudson</surname> <given-names>R.</given-names></name></person-group> (<year>2010</year>). <source><italic>An Introduction to Word Grammar.</italic></source> <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>. <pub-id pub-id-type="doi">10.1155/2017/9212538</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jiang</surname> <given-names>J.</given-names></name> <name><surname>Ouyang</surname> <given-names>J.</given-names></name></person-group> (<year>2017</year>). <article-title>Dependency distance: a new perspective on the syntactic development in second language acquisition.</article-title> <source><italic>Phys. Life Rev.</italic></source> <volume>21</volume> <fpage>209</fpage>&#x2013;<lpage>210</lpage>. <pub-id pub-id-type="doi">10.1016/j.plrev.2017.06.018</pub-id> <pub-id pub-id-type="pmid">28663013</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jin</surname> <given-names>H.</given-names></name> <name><surname>Liu</surname> <given-names>H.</given-names></name></person-group> (<year>2016</year>). <article-title>Chinese writing of deaf or hard-of-hearing students and normal-hearing peers from complex network approach.</article-title> <source><italic>Front. Psychol.</italic></source> <volume>7</volume>:<issue>1777</issue>. <pub-id pub-id-type="doi">10.3389/fpsyg.2016.01777</pub-id> <pub-id pub-id-type="pmid">27920733</pub-id></citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kahn</surname> <given-names>A. E.</given-names></name> <name><surname>Karuza</surname> <given-names>E. A.</given-names></name> <name><surname>Vettel</surname> <given-names>J. M.</given-names></name> <name><surname>Bassett</surname> <given-names>D. S.</given-names></name></person-group> (<year>2018</year>). <article-title>Network constraints on learnability of probabilistic motor sequences.</article-title> <source><italic>Nat. Hum. Behav.</italic></source> <volume>2</volume> <fpage>936</fpage>&#x2013;<lpage>947</lpage>. <pub-id pub-id-type="doi">10.1038/s41562-018-0463-8</pub-id> <pub-id pub-id-type="pmid">30988437</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Karuza</surname> <given-names>E. A.</given-names></name> <name><surname>Kahn</surname> <given-names>A. E.</given-names></name> <name><surname>Thompson-Schill</surname> <given-names>S. L.</given-names></name> <name><surname>Bassett</surname> <given-names>D. S.</given-names></name></person-group> (<year>2017</year>). <article-title>Process reveals structure: how a network is traversed mediates expectations about its architecture.</article-title> <source><italic>Sci. Rep.</italic></source> <volume>7</volume>:<issue>12733</issue>. <pub-id pub-id-type="doi">10.1038/s41598-017-12876-5</pub-id> <pub-id pub-id-type="pmid">28986524</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Karuza</surname> <given-names>E. A.</given-names></name> <name><surname>Thompson-Schill</surname> <given-names>S. L.</given-names></name> <name><surname>Bassett</surname> <given-names>D. S.</given-names></name></person-group> (<year>2016</year>). <article-title>Local patterns to global architectures: influences of network topology on human learning.</article-title> <source><italic>Trends Cogn. Sci.</italic></source> <volume>20</volume> <fpage>629</fpage>&#x2013;<lpage>640</lpage>. <pub-id pub-id-type="doi">10.1016/j.tics.2016.06.003</pub-id> <pub-id pub-id-type="pmid">27373349</pub-id></citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Klammer</surname> <given-names>T. P.</given-names></name> <name><surname>Schulz</surname> <given-names>M. R.</given-names></name> <name><surname>Volpe</surname> <given-names>A. D.</given-names></name></person-group> (<year>2010</year>). <source><italic>Analyzing English Grammar.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Pearson</publisher-name>. <pub-id pub-id-type="doi">10.1016/j.tics.2016.06.003</pub-id> <pub-id pub-id-type="pmid">27373349</pub-id></citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lakshmanan</surname> <given-names>U.</given-names></name></person-group> (<year>1995</year>). <article-title>Child second language acquisition of syntax.</article-title> <source><italic>Stud. Second Lang. Acquis.</italic></source> <volume>17</volume> <fpage>301</fpage>&#x2013;<lpage>329</lpage>. <pub-id pub-id-type="doi">10.1017/S0272263100014224</pub-id></citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Larsen-Freeman</surname> <given-names>D.</given-names></name></person-group> (<year>1997</year>). <article-title>Chaos/complexity science and second language acquisition.</article-title> <source><italic>Appl. Linguist.</italic></source> <volume>18</volume> <fpage>141</fpage>&#x2013;<lpage>165</lpage>. <pub-id pub-id-type="doi">10.1093/applin/18.2.141</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Larsen-Freeman</surname> <given-names>D.</given-names></name> <name><surname>Cameron</surname> <given-names>L.</given-names></name></person-group> (<year>2008</year>). <source><italic>Complex Systems and Applied Linguistics.</italic></source> <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>. <pub-id pub-id-type="doi">10.1093/applin/18.2.141</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>P.</given-names></name></person-group> (<year>2015</year>). <article-title>&#x201C;Bilingualism as a dynamic process,&#x201D; in</article-title> <source><italic>The Handbook of Language Emergence</italic></source> <role>eds</role> <person-group person-group-type="editor"><name><surname>MacWhinney</surname> <given-names>B.</given-names></name> <name><surname>O&#x2019;Grady</surname> <given-names>W.</given-names></name></person-group> (<publisher-loc>Chichester</publisher-loc>: <publisher-name>Wiley-Blackwell</publisher-name>) <fpage>511</fpage>&#x2013;<lpage>536</lpage>. <pub-id pub-id-type="doi">10.1002/9781118346136.ch23</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>P.</given-names></name> <name><surname>Zhang</surname> <given-names>F.</given-names></name> <name><surname>Tsai</surname> <given-names>E.</given-names></name> <name><surname>Puls</surname> <given-names>B.</given-names></name></person-group> (<year>2014</year>). <article-title>Language history questionnaire (LHQ 2.0): a new dynamic web-based research tool.</article-title> <source><italic>Biling</italic></source> <volume>17</volume> <fpage>673</fpage>&#x2013;<lpage>680</lpage>. <pub-id pub-id-type="doi">10.1017/S1366728913000606</pub-id></citation></ref>
<ref id="B33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>H.</given-names></name></person-group> (<year>2008</year>). <article-title>The complexity of Chinese syntactic dependency networks.</article-title> <source><italic>Physica A</italic></source> <volume>387</volume> <fpage>3048</fpage>&#x2013;<lpage>3058</lpage>. <pub-id pub-id-type="doi">10.1016/j.physa.2008.01.069</pub-id></citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>H.</given-names></name></person-group> (<year>2011</year>). <article-title>Linguistic complex networks: a new approach to language exploration.</article-title> <source><italic>Die Grundlagenstudien aus Kybernetik und Geisteswissenschaft</italic></source> <volume>52</volume> <fpage>151</fpage>&#x2013;<lpage>170</lpage>.</citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>H.</given-names></name></person-group> (<year>2018</year>). <article-title>Language as a human-driven complex adaptive system: comment on &#x201C;Rethinking foundations of language from a multidisciplinary perspective&#x201D; by T. Gong et al.</article-title> <source><italic>Phys. Life Rev.</italic></source> <comment>26&#x2013;27</comment> <fpage>149</fpage>&#x2013;<lpage>151</lpage>. <pub-id pub-id-type="doi">10.1016/j.plrev.2018.06.006</pub-id> <pub-id pub-id-type="pmid">30477685</pub-id></citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>H.</given-names></name> <name><surname>Li</surname> <given-names>W.</given-names></name></person-group> (<year>2010</year>). <article-title>Language clusters based on linguistic complex networks.</article-title> <source><italic>Chin. Sci. Bull.</italic></source> <volume>55</volume> <fpage>3458</fpage>&#x2013;<lpage>3465</lpage>. <pub-id pub-id-type="doi">10.1007/s11434-010-4114-3</pub-id></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lu</surname> <given-names>Q.</given-names></name> <name><surname>Xu</surname> <given-names>C.</given-names></name> <name><surname>Liu</surname> <given-names>H.</given-names></name></person-group> (<year>2016</year>). <article-title>Can chunking reduce syntactic complexity of natural languages?</article-title> <source><italic>Complexity</italic></source> <volume>21</volume> <fpage>33</fpage>&#x2013;<lpage>41</lpage>. <pub-id pub-id-type="doi">10.1002/cplx.21779</pub-id></citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lu</surname> <given-names>X.</given-names></name></person-group> (<year>2011</year>). <article-title>A corpus-based evaluation of syntactic complexity measures as indices of college-level ESL writers&#x2019; language development.</article-title> <source><italic>TESOL Quart.</italic></source> <volume>45</volume> <fpage>36</fpage>&#x2013;<lpage>62</lpage>. <pub-id pub-id-type="doi">10.5054/tq.2011.240859</pub-id></citation></ref>
<ref id="B39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>MacWhinney</surname> <given-names>B.</given-names></name></person-group> (<year>2012</year>). <article-title>&#x201C;The logic of the unified model,&#x201D; in</article-title> <source><italic>The Routledge Handbook of Second Language Acquisition</italic></source> <role>eds</role> <person-group person-group-type="editor"><name><surname>Gass</surname> <given-names>S.</given-names></name> <name><surname>Mackey</surname> <given-names>A.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Routledge</publisher-name>) <fpage>211</fpage>&#x2013;<lpage>227</lpage>.</citation></ref>
<ref id="B40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>MacWhinney</surname> <given-names>B.</given-names></name></person-group> (<year>2015</year>). <article-title>&#x201C;Introduction: language emergence,&#x201D; in</article-title> <source><italic>The Handbook of Language Emergence</italic></source> <role>eds</role> <person-group person-group-type="editor"><name><surname>MacWhinney</surname> <given-names>B.</given-names></name> <name><surname>O&#x2019;Grady</surname> <given-names>W.</given-names></name></person-group> (<publisher-loc>Chichester</publisher-loc>: <publisher-name>Wiley-Blackwell</publisher-name>) <fpage>511</fpage>&#x2013;<lpage>536</lpage>.</citation></ref>
<ref id="B41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>MacWhinney</surname> <given-names>B.</given-names></name> <name><surname>O&#x2019;Grady</surname> <given-names>W.</given-names></name></person-group> (<year>2015</year>). <source><italic>The Handbook of Language Emergence.</italic></source> <publisher-loc>Chichester</publisher-loc>: <publisher-name>Wiley-Blackwell</publisher-name>.</citation></ref>
<ref id="B42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marneffe</surname> <given-names>M.</given-names></name> <name><surname>Manning</surname> <given-names>C.</given-names></name></person-group> (<year>2008</year>). <source><italic>Stanford Typed Dependencies Manual.</italic></source> <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://nlp.stanford.edu/software/dependencies_manual.pdf">http://nlp.stanford.edu/software/dependencies_manual.pdf</ext-link>. (accessedSeptemberrefvol05, 2016)</comment></citation></ref>
<ref id="B43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mel&#x2019;&#x010D;uk</surname> <given-names>I.</given-names></name></person-group> (<year>1988</year>). <source><italic>Dependency Syntax: Theory and Practice.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>State University of New York Press</publisher-name>.</citation></ref>
<ref id="B44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mellow</surname> <given-names>J. D.</given-names></name></person-group> (<year>2006</year>). <article-title>The emergence of second language syntax: a case study of the acquisition of relative clauses.</article-title> <source><italic>Appl. Linguist.</italic></source> <volume>27</volume> <fpage>645</fpage>&#x2013;<lpage>670</lpage>. <pub-id pub-id-type="doi">10.1093/applin/aml031</pub-id></citation></ref>
<ref id="B45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mellow</surname> <given-names>J. D.</given-names></name></person-group> (<year>2008</year>). <article-title>The emergence of complex syntax: a longitudinal case study of the ESL development of dependency resolution.</article-title> <source><italic>Lingua</italic></source> <volume>118</volume> <fpage>499</fpage>&#x2013;<lpage>521</lpage>. <pub-id pub-id-type="doi">10.1016/j.lingua.2007.01.007</pub-id></citation></ref>
<ref id="B46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Newman</surname> <given-names>M. E. J.</given-names></name></person-group> (<year>2003</year>). <article-title>The structure and function of complex networks.</article-title> <source><italic>SIAM Rev.</italic></source> <volume>45</volume> <fpage>167</fpage>&#x2013;<lpage>256</lpage>. <pub-id pub-id-type="doi">10.1137/S003614450342480</pub-id></citation></ref>
<ref id="B47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Newman</surname> <given-names>M. E. J.</given-names></name></person-group> (<year>2010</year>). <source><italic>Networks: An Introduction.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.</citation></ref>
<ref id="B48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nishikawa</surname> <given-names>T.</given-names></name> <name><surname>Motter</surname> <given-names>A. E.</given-names></name> <name><surname>Lai</surname> <given-names>Y. C.</given-names></name> <name><surname>Hoppensteadt</surname> <given-names>F. C.</given-names></name></person-group> (<year>2002</year>). <article-title>Smallest small-world network.</article-title> <source><italic>Phys. Rev. E</italic></source> <volume>66</volume> <issue>046139</issue>/5. <pub-id pub-id-type="doi">10.1103/PhysRevE.66.046139</pub-id> <pub-id pub-id-type="pmid">12443291</pub-id></citation></ref>
<ref id="B49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ouyang</surname> <given-names>J.</given-names></name> <name><surname>Jiang</surname> <given-names>J.</given-names></name></person-group> (<year>2018</year>). <article-title>Can the probability distribution of dependency distance measure language proficiency of second language learners?</article-title> <source><italic>J. Quant. Linguist</italic>.</source> <volume>25</volume> <fpage>295</fpage>&#x2013;<lpage>313</lpage>. <pub-id pub-id-type="doi">10.1080/09296174.2017.1373991</pub-id></citation></ref>
<ref id="B50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pienemann</surname> <given-names>M.</given-names></name></person-group> (<year>1984</year>). <article-title>Psychological constraints on the teachability of languages.</article-title> <source><italic>Stud. Second Lang. Acquis.</italic></source> <volume>6</volume> <fpage>186</fpage>&#x2013;<lpage>214</lpage>. <pub-id pub-id-type="doi">10.1017/S0272263100005015</pub-id></citation></ref>
<ref id="B51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Radford</surname> <given-names>A.</given-names></name></person-group> (<year>1990</year>). <source><italic>Syntactic Theory and the Acquisition of English Syntax: The Nature of Early Child Grammars of English.</italic></source> <publisher-loc>Oxford</publisher-loc>: <publisher-name>Blackwell</publisher-name>.</citation></ref>
<ref id="B52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Richards</surname> <given-names>B.</given-names></name></person-group> (<year>1987</year>). <article-title>Type/token ratios: what do they really tell us?</article-title> <source><italic>J. Child Lang.</italic></source> <volume>14</volume> <fpage>201</fpage>&#x2013;<lpage>209</lpage>. <pub-id pub-id-type="doi">10.1017/S0305000900012885</pub-id> <pub-id pub-id-type="pmid">3611238</pub-id></citation></ref>
<ref id="B53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Santos</surname> <given-names>E.</given-names></name> <name><surname>Zhao</surname> <given-names>Y.</given-names></name></person-group> (<year>2017</year>). <article-title>Automatic emergence detection in complex systems.</article-title> <source><italic>Complexity</italic></source> <volume>2017</volume> <fpage>1</fpage>&#x2013;<lpage>24</lpage>. <pub-id pub-id-type="doi">10.1155/2017/3460919</pub-id></citation></ref>
<ref id="B54"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sato</surname> <given-names>C.</given-names></name></person-group> (<year>1988</year>). <article-title>Origins of complex syntax in interlanguage development.</article-title> <source><italic>Stud. Second Lang. Acquis.</italic></source> <volume>10</volume> <fpage>371</fpage>&#x2013;<lpage>395</lpage>. <pub-id pub-id-type="doi">10.1017/S027226310000749X</pub-id></citation></ref>
<ref id="B55"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Selinker</surname> <given-names>L.</given-names></name></person-group> (<year>1969</year>). <article-title>Language transfer.</article-title> <source><italic>Gen. Linguist.</italic></source> <volume>9</volume> <fpage>67</fpage>&#x2013;<lpage>92</lpage>.</citation></ref>
<ref id="B56"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Selinker</surname> <given-names>L.</given-names></name> <name><surname>Lamendella</surname> <given-names>J. T.</given-names></name></person-group> (<year>1978</year>). <article-title>Two perspectives on fossilization in interlanguage learning.</article-title> <source><italic>Interlang. Stud. Bull.</italic></source> <volume>3</volume> <fpage>143</fpage>&#x2013;<lpage>191</lpage>.</citation></ref>
<ref id="B57"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sizemore</surname> <given-names>A. E.</given-names></name> <name><surname>Karuza</surname> <given-names>E. A.</given-names></name> <name><surname>Giusti</surname> <given-names>C.</given-names></name> <name><surname>Bassett</surname> <given-names>D. S.</given-names></name></person-group> (<year>2018</year>). <article-title>Knowledge gaps in the early growth of semantic networks.</article-title> <source><italic>Nat. Hum. Behav.</italic></source> <volume>2</volume> <fpage>682</fpage>&#x2013;<lpage>692</lpage>. <pub-id pub-id-type="doi">10.1038/s41562-018-0422-4</pub-id> <pub-id pub-id-type="pmid">30333998</pub-id></citation></ref>
<ref id="B58"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sol&#x00E9;</surname> <given-names>R. V.</given-names></name> <name><surname>Corominas-Murtra</surname> <given-names>B.</given-names></name> <name><surname>Valverde</surname> <given-names>S.</given-names></name> <name><surname>Steels</surname> <given-names>L.</given-names></name></person-group> (<year>2010</year>). <article-title>Language networks: their structure, function, and evolution.</article-title> <source><italic>Complexity</italic></source> <volume>15</volume> <fpage>20</fpage>&#x2013;<lpage>26</lpage>. <pub-id pub-id-type="doi">10.1002/cplx.20305</pub-id></citation></ref>
<ref id="B59"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Spoelman</surname> <given-names>M.</given-names></name> <name><surname>Verspoor</surname> <given-names>M.</given-names></name></person-group> (<year>2010</year>). <article-title>Dynamic patterns in development of accuracy and complexity: a longitudinal case study in the acquisition of Finnish.</article-title> <source><italic>Appl. Linguist.</italic></source> <volume>31</volume> <fpage>532</fpage>&#x2013;<lpage>553</lpage>. <pub-id pub-id-type="doi">10.1093/applin/amq001</pub-id></citation></ref>
<ref id="B60"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Verspoor</surname> <given-names>M.</given-names></name> <name><surname>Schmid</surname> <given-names>M.</given-names></name> <name><surname>Xu</surname> <given-names>X.</given-names></name></person-group> (<year>2012</year>). <article-title>A dynamic usage based perspective on L2 writing.</article-title> <source><italic>J. Second Lang. Writ.</italic></source> <volume>21</volume> <fpage>239</fpage>&#x2013;<lpage>263</lpage>. <pub-id pub-id-type="doi">10.1016/j.jslw.2012.03.007</pub-id></citation></ref>
<ref id="B61"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wachs-Lopes</surname> <given-names>G. A.</given-names></name> <name><surname>Rodrigues</surname> <given-names>P. S.</given-names></name></person-group> (<year>2016</year>). <article-title>Analyzing natural human language from the point of view of dynamic of a complex network.</article-title> <source><italic>Expert Syst. Appl.</italic></source> <volume>45</volume> <fpage>8</fpage>&#x2013;<lpage>22</lpage>. <pub-id pub-id-type="doi">10.1016/j.eswa.2015.09.020</pub-id></citation></ref>
<ref id="B62"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>W. Y.</given-names></name> <name><surname>Wen</surname> <given-names>Q. F.</given-names></name></person-group> (<year>2002</year>). <article-title>L1 use in the L2 composing process: an exploratory study of 16 Chinese EFL writers.</article-title> <source><italic>J. Second Lang. Writ.</italic></source> <volume>11</volume> <fpage>225</fpage>&#x2013;<lpage>246</lpage>. <pub-id pub-id-type="doi">10.1016/S1060-3743(02)00084-X</pub-id></citation></ref>
<ref id="B63"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Watts</surname> <given-names>D. J.</given-names></name> <name><surname>Strogatz</surname> <given-names>S. H.</given-names></name></person-group> (<year>1998</year>). <article-title>Collective dynamics of &#x201C;small-world&#x201D; networks.</article-title> <source><italic>Nature</italic></source> <volume>393</volume> <fpage>440</fpage>&#x2013;<lpage>442</lpage>. <pub-id pub-id-type="doi">10.1038/30918</pub-id> <pub-id pub-id-type="pmid">27843396</pub-id></citation></ref>
<ref id="B64"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wolfe-Quintero</surname> <given-names>K.</given-names></name> <name><surname>Inagaki</surname> <given-names>S.</given-names></name> <name><surname>Kim</surname> <given-names>H.</given-names></name></person-group> (<year>1998</year>). <source><italic>Second Language Development in Writing: Measures of Fluency, Accuracy, and Complexity.</italic></source> <publisher-loc>Honolulu, HI</publisher-loc>: <publisher-name>University of Hawai&#x2019;i Press</publisher-name>. <pub-id pub-id-type="doi">10.1038/30918</pub-id> <pub-id pub-id-type="pmid">27843396</pub-id></citation></ref>
<ref id="B65"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Woodall</surname> <given-names>B. R.</given-names></name></person-group> (<year>2002</year>). <article-title>Language-switching: using the first language while writing in a second language.</article-title> <source><italic>J. Second Lang. Writ.</italic></source> <volume>11</volume> <fpage>7</fpage>&#x2013;<lpage>28</lpage>. <pub-id pub-id-type="doi">10.1016/S1060-3743(01)00051-0</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn id="fn01"><label>1</label><p>Stanford parser can be downloaded from <ext-link ext-link-type="uri" xlink:href="https://nlp.stanford.edu/software/corenlp-backup-download.html">https://nlp.stanford.edu/software/corenlp-backup-download.html</ext-link>.</p></fn>
<fn id="fn02"><label>2</label><p>Createpajek can be downloaded from <ext-link ext-link-type="uri" xlink:href="http://vlado.fmf.uni-lj.si/pub/networks/pajek/howto/excel2pajek.htm">http://vlado.fmf.uni-lj.si/pub/networks/pajek/howto/excel2pajek.htm</ext-link>.</p></fn>
<fn id="fn03"><label>3</label><p>Pajek provides the users with efficient analysis of large networks and can be downloaded from <ext-link ext-link-type="uri" xlink:href="http://vlado.fmf.uni-lj.si/pub/networks/pajek/">http://vlado.fmf.uni-lj.si/pub/networks/pajek/</ext-link>.</p></fn>
</fn-group>
</back>
</article>