<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Archiving and Interchange DTD v2.3 20070202//EN" "archivearticle.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="methods-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Public Health</journal-id>
<journal-title>Frontiers in Public Health</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Public Health</abbrev-journal-title>
<issn pub-type="epub">2296-2565</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpubh.2019.00232</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Public Health</subject>
<subj-group>
<subject>Curriculum, Instruction, and Pedagogy</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Transdisciplinary Obesity Prevention Research Sciences (TOPRS) Curriculum Increases Knowledge About Complex Causes and Consequences of Obesity for Undergraduate Students</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Fiese</surname> <given-names>Barbara H.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/154595/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Hammons</surname> <given-names>Amber</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/781940/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Koester</surname> <given-names>Brenda</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/703933/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Garcia</surname> <given-names>Gabriela L.</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/788924/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Parker</surname> <given-names>Loran</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/788863/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Teegarden</surname> <given-names>Dorothy</given-names></name>
<xref ref-type="aff" rid="aff5"><sup>5</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/737294/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Family Resiliency Center, University of Illinois at Urbana-Champaign</institution>, <addr-line>Champaign, IL</addr-line>, <country>United States</country></aff>
<aff id="aff2"><sup>2</sup><institution>Child and Family Science, California State University</institution>, <addr-line>Fresno, CA</addr-line>, <country>United States</country></aff>
<aff id="aff3"><sup>3</sup><institution>Education Development Center</institution>, <addr-line>Chicago, IL</addr-line>, <country>United States</country></aff>
<aff id="aff4"><sup>4</sup><institution>Evaluation and Learning Research Center, Purdue University</institution>, <addr-line>West Lafayette, IN</addr-line>, <country>United States</country></aff>
<aff id="aff5"><sup>5</sup><institution>Department of Nutrition Science, Purdue University</institution>, <addr-line>West Lafayette, IN</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Harshad Thakur, Tata Institute of Social Sciences, India</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Souheila AliHassan, Tawam Hospital, United Arab Emirates; Paraskevi Papadopoulou, American College of Greece, Greece</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Barbara H. Fiese <email>bhfiese&#x00040;illinois.edu</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Public Health Education and Promotion, a section of the journal Frontiers in Public Health</p></fn></author-notes>
<pub-date pub-type="epub">
<day>20</day>
<month>08</month>
<year>2019</year>
</pub-date>
<pub-date pub-type="collection">
<year>2019</year>
</pub-date>
<volume>7</volume>
<elocation-id>232</elocation-id>
<history>
<date date-type="received">
<day>31</day>
<month>05</month>
<year>2019</year>
</date>
<date date-type="accepted">
<day>02</day>
<month>08</month>
<year>2019</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2019 Fiese, Hammons, Koester, Garcia, Parker and Teegarden.</copyright-statement>
<copyright-year>2019</copyright-year>
<copyright-holder>Fiese, Hammons, Koester, Garcia, Parker and Teegarden</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract><p>Most researchers and public health officials would agree that the causes and consequences of obesity are complex and multi-faceted. However, curricula designed to address these complexities are limited and often guided by a single discipline. The purpose of the Transdisciplinary Obesity Prevention Research Sciences (TOPRS) program was to develop a &#x0201C;flip-the-classroom&#x0201D; curriculum on obesity prevention across multiple disciplines such that students would gain an appreciation of the complex origins of obesity. The curriculum is based on the 6 C&#x00027;s model (cell, child, clan, community, country, culture) that proposes a cell-to-society approach to obesity. Twenty video micro-lectures were developed and students were tested on content knowledge pre- and post-viewing. The curriculum was administered at three university sites to 74 undergraduate students across 23 declared majors from 2014&#x02013;2016. There were significant gains in knowledge about the causes and consequences of obesity. Recommendations are offered to adopt this curriculum in undergraduate and other educational settings.</p></abstract> <kwd-group>
<kwd>obesity curriculum</kwd>
<kwd>flip-the-classroom</kwd>
<kwd>active learning</kwd>
<kwd>undergraduate education</kwd>
<kwd>public health</kwd>
</kwd-group>
<contract-sponsor id="cn001">U.S. Department of Agriculture<named-content content-type="fundref-id">10.13039/100000199</named-content></contract-sponsor>
<counts>
<fig-count count="3"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="23"/>
<page-count count="7"/>
<word-count count="4337"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>There is little disagreement that the origins of the obesity epidemic are multifactorial and progress toward a solution has been stubbornly slow. In a recent call to action for improved health care training and prevention of obesity, Dietz et al. noted that medical education and health professional training lags behind in understanding stigma associated with obesity, working on interdisciplinary teams, and modifying lifestyles (<xref ref-type="bibr" rid="B1">1</xref>). Others have noted that medical students have somewhat unidimensional views of the causes of obesity with over one quarter endorsing purely physiological causes and close to a quarter not endorsing causes outside of overeating and physical activity (<xref ref-type="bibr" rid="B2">2</xref>). Most expert panels recommend multi-pronged approaches to prevention and intervention that involve multiple disciplines working as a team and across sectors (e.g., healthcare, education, government) in order to effect the most long lasting change at a population level (<xref ref-type="bibr" rid="B3">3</xref>&#x02013;<xref ref-type="bibr" rid="B5">5</xref>).</p>
<p>Although the call for more comprehensive and interdisciplinary approaches has been made for over a decade, educational programming has not kept pace with scientific thinking on the topic, and most public health professionals are not trained in transdisciplinary approaches (<xref ref-type="bibr" rid="B6">6</xref>). Currently, most educational efforts in obesity prevention and treatment occurs at the postdoctoral level in specialty programs such as those offered through Nutrition Obesity Research Centers (NORC) funded by the National Institute of Diabetes and Digestive and Kidney Diseases. There are a few doctoral level programs such as the Illinois Transdisciplinary Obesity Prevention Program (I-TOPP) (<xref ref-type="bibr" rid="B7">7</xref>) and the Pennsylvania State University Childhood Obesity Prevention Graduate Training Program funded by the United States Department of Agriculture, National Institute of Food and Agriculture. Rarer yet are interdisciplinary programs at the undergraduate level. A program that exposes undergraduate students to the complexities of obesity has the potential to increase the scientific workforce as well as raise awareness of the next generation of parents and public health professionals. Adding obesity as topic at the undergraduate level also has the potential to effect career choices and practice in the future.</p>
<p>There is increasing interest in promoting transdisciplinary education as a means to address major public health issues. Lawlor et al. describe a MPH program organized around the tenets of transdisciplinarity, including an applied problem driven approach that recognizes the multiple factors that contribute to a public health problem (<xref ref-type="bibr" rid="B8">8</xref>). A key component of transdisciplinary team science is the ability to work collaboratively in an integrative process across disciplines to address a common research problem (<xref ref-type="bibr" rid="B9">9</xref>, <xref ref-type="bibr" rid="B10">10</xref>). To date, the majority of efforts to train scientists in this approach have been directed toward graduate and post-graduate level students (<xref ref-type="bibr" rid="B11">11</xref>). There are however, exceptions at the undergraduate level (<xref ref-type="bibr" rid="B12">12</xref>). In this report we describe an undergraduate transdisciplinary curriculum addressing the complexity of obesity. We provide evidence that the curriculum and its hands-on problem-solving format increased knowledge about the complexity of the causes and consequences of obesity as well as research skills.</p>
<sec>
<title>Pedagogical Framework</title>
<p>The curriculum was designed to take a cell-to-society approach to the causes and consequences of obesity. Using the 6 C&#x00027;s socio-ecological framework (<xref ref-type="bibr" rid="B13">13</xref>, <xref ref-type="bibr" rid="B14">14</xref>) the curriculum addresses the epidemiological, biological, genetic, family, community, policy, and cultural factors that contribute to the incidence and prevalence of obesity. For example, the biological micro-lectures included overviews of genetic contributions, fetal programming, and the role of the gut microbiome. Family and child factors included picky eating, feeding practices, family mealtimes and sleep. Community factors included the built environment and physical activity as well as neighborhood influences. Policy issues were discussed, including access to food, food advertising, and food policies. Culturally relevant interventions were also discussed. In addition there were modules on the chronic health conditions associated with obesity including cardiovascular disease, diabetes, bone health, and cancer (see <xref ref-type="fig" rid="F1">Figure 1</xref> for a depiction of the theoretical model and sample curriculum topics for each ecology). The entire curriculum can be accessed at <ext-link ext-link-type="uri" xlink:href="https://stemedhub.org/groups/toprs">https://stemedhub.org/groups/toprs</ext-link>.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Six C&#x00027;s theoretical model that guided curriculum.</p></caption>
<graphic xlink:href="fpubh-07-00232-g0001.tif"/>
</fig>
<p>We applied a flip-the-classroom approach with hands-on learning activities. Several educators and professional organizations have called for a more active hands-on approach to learning at the undergraduate level (<xref ref-type="bibr" rid="B15">15</xref>, <xref ref-type="bibr" rid="B16">16</xref>). A flip-the-classroom approach allows instructors to use valuable class time for application of content material while out of class time is spent viewing videos and reading literature that focus on content. Flipped classroom instruction has proven to increase student engagement (<xref ref-type="bibr" rid="B17">17</xref>), academic performance (<xref ref-type="bibr" rid="B18">18</xref>), and critical thinking skills (<xref ref-type="bibr" rid="B19">19</xref>). In our case, it was also possible to provide content from experts across multiple disciplines without relying on in-person lectures. It took close to 2 years to develop the curriculum materials, engage the experts in recording the micro-lectures, and refining the instructor handbook. However, once the materials were developed they minimized the time of the instructor for course preparation outside of updating the relevant literature and refining hands-on-learning activities.</p>
</sec>
<sec>
<title>Learning Environment</title>
<p>We chose to develop the curriculum for undergraduate students who were from a variety of majors. The knowledge base of most undergraduate students about the complex origins of obesity is extremely limited. To date, most of the extant research has focused on single issues such as calories (<xref ref-type="bibr" rid="B20">20</xref>) or sugar sweetened beverages (<xref ref-type="bibr" rid="B21">21</xref>). If we are to train the next generation of scientists and public health professionals about the complexities of the causes of obesity, then it is incumbent to begin at an earlier point in the education process than medical or graduate studies. We purposely designed the curriculum to be attractive to students across multiple majors and most appropriate for students beyond their sophomore year.</p>
<p>The curriculum was delivered at three different sites across a period of 2 years. We deliberately created the curriculum to be flexible such that instructors could pick and choose modules to fit the needs of their particular institution- thereby avoiding some of the pitfalls of transdisciplinary education. The sites differed by the duration of the course and the direct involvement of students in research. Site 1 (Illinois) structured the course across two semesters and all students were engaged in a research project that culminates in presenting at an undergraduate research symposium at the end of the academic year. Site 2 (Purdue) offered the course in the fall following an intensive research experience in the preceding summer and through the fall semester. Site 3 (California State University, Fresno) offered the course for one semester and involved students indirectly in research through research simulations in class-based interdisciplinary teams. The class was offered across 2014&#x02013;2016. Analyses was conducted throughout 2016 and into 2017.</p>
<p>Students watched weekly micro-lectures online and outside of class. Class time was reserved for discussion of the material and activities in interdisciplinary teams. For example, during the week on pediatric nutrition and breastfeeding, students gathered into their interdisciplinary teams and discussed the Surgeon General&#x00027;s Executive Summary-Call to Action to Support Breastfeeding. In these teams, students chose three of the recommended actions and designed programs and/or campaigns to implement the action. They then discussed how these actions fit within the 6 C&#x00027;s model of childhood obesity. One of the main projects of the course included preparing and presenting research posters. Students involved directly in research presented on their research projects while those in the indirect research experience class designed posters based on an obesity-related literature review. Students integrated theories, methodologies, and new concepts from the various disciplines in their posters.</p>
<p>An external evaluation team was responsible for evaluating the gain in content knowledge and confidence in research skills. Surveys were administered online pre- and post-course. The addition of an external evaluation team allowed for the cross-site evaluation and reduced the likelihood that students would respond more (or less) favorably to their own instructor. In this report we summarize the evaluation findings describing content gain and confidence in research skills pre-class and post-class participation.</p>
</sec>
</sec>
<sec id="s2">
<title>Method</title>
<sec>
<title>Participants</title>
<p>Across a period of 2 years, 74 students enrolled in the TOPRS course across the three sites. The majority of the students were women (91.9%). The students were relatively diverse in terms of race and ethnicity (38% White, 26% Asian/Pacific Islander, 19% Hispanic/Latino, 7% African American, and 10% other). The majority of the students were between 18 and 21 years of age (81.7%) with the remainder between 22 and 25 years (16.9%) and one student reported being 25 years of age or older. The students were primarily juniors and seniors (29.7% 3rd year, 31.1% 4th year) with the remainder 1st year (6.8%), 2nd year 20.2%), or 5th year (12.2%). The students listed a total of 23 different disciplinary majors ranging from Biochemistry to Speech and Hearing Sciences. A listing of majors and percentages of students within each discipline is presented in <xref ref-type="table" rid="T1">Table 1</xref>.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Students&#x00027; disciplinary majors.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Disciplinary major</bold></th>
<th valign="top" align="center"><bold>Frequency</bold></th>
<th valign="top" align="center"><bold>Percent enrolled</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Biochemistry</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">1.4%</td>
</tr>
<tr>
<td valign="top" align="left">Chemistry</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">2.7%</td>
</tr>
<tr>
<td valign="top" align="left">Child Development</td>
<td valign="top" align="center">13</td>
<td valign="top" align="center">17.8%</td>
</tr>
<tr>
<td valign="top" align="left">Community Health</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">4.1%</td>
</tr>
<tr>
<td valign="top" align="left">Communication</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">1.4%</td>
</tr>
<tr>
<td valign="top" align="left">Dietetics</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">8.0%</td>
</tr>
<tr>
<td valign="top" align="left">Doctor of Pharmacy</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">1.4%</td>
</tr>
<tr>
<td valign="top" align="left">Economics</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">1.4%</td>
</tr>
<tr>
<td valign="top" align="left">Family and Consumer Sciences</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">2.7%</td>
</tr>
<tr>
<td valign="top" align="left">Food Science and Human Nutrition</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">6.8%</td>
</tr>
<tr>
<td valign="top" align="left">Human Development and Family Studies</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">5.5%</td>
</tr>
<tr>
<td valign="top" align="left">Integrative Biology</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">4.1%</td>
</tr>
<tr>
<td valign="top" align="left">Interdisciplinary Health</td>
<td valign="top" align="center">8</td>
<td valign="top" align="center">11.0%</td>
</tr>
<tr>
<td valign="top" align="left">Kinesiology</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">2.7%</td>
</tr>
<tr>
<td valign="top" align="left">Liberal Studies</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">1.4%</td>
</tr>
<tr>
<td valign="top" align="left">Molecular and Cellular Biology</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">5.5%</td>
</tr>
<tr>
<td valign="top" align="left">Neurobiology</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">1.4%</td>
</tr>
<tr>
<td valign="top" align="left">Pharmaceutical Science</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">1.4%</td>
</tr>
<tr>
<td valign="top" align="left">Pre-Nursing</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">6.8%</td>
</tr>
<tr>
<td valign="top" align="left">Psychology</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">1.4%</td>
</tr>
<tr>
<td valign="top" align="left">Social Work</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">1.4%</td>
</tr>
<tr>
<td valign="top" align="left">Sociology</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">2.7%</td>
</tr>
<tr>
<td valign="top" align="left">Speech and Hearing Sciences</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">4.1%</td>
</tr>
<tr>
<td valign="top" align="left">Undeclared</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">2.7%</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec>
<title>Procedure</title>
<p>Students were administered online surveys prior to the beginning of the class and at the end of the semester. The surveys assessed content knowledge about the topics taught in the class, as well as, student self-assessment of knowledge about scientific research, and self-assessment of research skills. The content varied somewhat from year 1 to year 2 as modules were added on biological causes and chronic health conditions associated with obesity. The Institutional Review Boards at all three universities approved this evaluation.</p>
</sec>
<sec>
<title>Measures</title>
<p>Content knowledge was assessed through investigator developed measure designed to reflect the content of each micro-lecture. In year one three questions were generated per topic. In year two five questions were generated per topic. Answers to the questions were not part of the student&#x00027;s grades, and they were aware of this. Knowledge of scientific research was assessed using an instrument adapted from Seymour et al. (<xref ref-type="bibr" rid="B22">22</xref>). Student research skills were assessed using a research skills scale adapted from Kardash (<xref ref-type="bibr" rid="B23">23</xref>).</p>
</sec>
<sec>
<title>Analytic Plan</title>
<p>Paired sample <italic>t</italic>-tests were conducted to assess changes pre-post participation in the class. Individual item analysis was also conducted to identify patterns of change to inform future curriculum development.</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<p>There was a significant increase in content knowledge in Year 1 in seven of the 10 modules (see <xref ref-type="fig" rid="F2">Figure 2</xref>). Students gained knowledge about the neighborhood influences, the role of the built environment and physical activity, sleep, childcare, and feeding practices, media, culturally relevant interventions, and family mealtimes. There were no significant gains in understanding of food advertising, picky eating, or food policy from before the class to after the completion of the course.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Change in content knowledge Year 1. &#x0002A;Means were statistically significant between pre- and post-surveys (<italic>p</italic> &#x0003C; 0.05).</p></caption>
<graphic xlink:href="fpubh-07-00232-g0002.tif"/>
</fig>
<p>In year two, the students evidenced significant gains in knowledge in 14 of the 20 modules (see <xref ref-type="fig" rid="F3">Figure 3</xref>). There were significant increases in knowledge about bone health, the gut to brain axis, pediatric nutrition and breastfeeding, picky eating, sleep, food policy, genetic influences, culturally relevant interventions, brain health, cancer, the 6 C framework, and child care and feeding practices from before the class until after the class ended.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>Change in content knowledge Year 2. <sup>&#x0002A;</sup>Means were statistically significant between pre- and post-surveys (<italic>p</italic> &#x0003C; 0.05).</p></caption>
<graphic xlink:href="fpubh-07-00232-g0003.tif"/>
</fig>
<p>Students gained significantly in their understanding of research and their research skills. Student self-assessment of their understanding of &#x0201C;nature of the job as a researcher&#x0201D; (<italic>t</italic> (71) &#x0003D; 8.225, <italic>p</italic> &#x0003D; .000) and their understanding of the &#x0201C;research process&#x0201D; (<italic>t</italic> (71) &#x0003D; 6.255, <italic>p</italic> &#x0003D; .000) displayed significant gains. At the beginning of the course, the majority of students reported a &#x0201C;weak&#x0201D; or &#x0201C;average&#x0201D; understanding of the research process (70.3%) and the nature of the job as a researcher (78.4%). By the end of the course, an overwhelming majority of the students reported having a &#x0201C;Strong&#x0201D; or &#x0201C;Very Strong&#x0201D; understanding of the research process (69.4%), and the nature of the job as a researcher (70.8%).</p>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>Obesity is a complex public health concern that requires transdisciplinary approaches for solutions. However, few scientists are explicitly trained in team science approaches. Rarer yet are programs at the undergraduate level that expose students to interdisciplinary and transdisciplinary methods. In this report, we documented knowledge gains and increased confidence in research skills in an undergraduate course delivered across three different sites. Overall, students gained content knowledge about the complex causes, consequences, and correlates of obesity. Further, they gained appreciation of the research process and their own confidence as researchers. In this discussion, we highlight some of the lessons learned from this evaluation and future directions for course development.</p>
<p>Across two evaluation points (Years 1 and 2) we were able to demonstrate that students gained content knowledge about the role that sleep, childcare and feeding practices, neighborhood influences, and culturally relevant interventions might play in obesity. Modules only evaluated once (Year 2) also showed significant gains in knowledge in the 6 C Framework, Cancer, Pediatric Nutrition and Breastfeeding, and Gut to Brain. Modules that evidenced significant gains in knowledge 1 year but not on another included Food Policy, Picky Eating, Family Mealtimes &#x00026; Nutrition, and the Changing Food &#x00026; Media Environment. We can only speculate about the different pattern of results. For those modules that evidenced consistent significant gains, our impression is that these are areas that students had little baseline knowledge and stood to gain the most information. Anecdotally, students were fascinated with the role that sleep played in risk for obesity. They also tended to personalize this factor in relation to their own health. In addition, they had little exposure to factors such as child care and the potential role that feeding practices in child care might play in health.</p>
<p>Even though we were able to show gains in some content areas- the overall purpose of the course is also to expose the students to the research process. Using valuable class time and a hands-on approach actively engaged students in critical thinking about how to develop research questions and the limits of scientific evidence. The students gained not only content knowledge about the causes and consequences of obesity but also the research process and the role of a researcher. Because they were assigned to work on teams, they also gained valuable experience from diverse backgrounds as to how the research process unfolds and how to consider multiple perspectives.</p>
<p>Some of the challenges to teaching the TOPRs course included students feeling that the course and research projects (for the two classes that included direct research experiences) were too separate and needed better integration. In Krettek and Thorpenberg&#x00027;s review of transdisiciplinary higher education, one of their suggestions for effective transdisciplinary teaching is that instructors across varied disciplines work together to design their lectures (<xref ref-type="bibr" rid="B6">6</xref>). The TOPRS curriculum does this in the micro-lectures, but future courses may take this a step further by having the researchers that are working directly with students on research projects come to a class and get the entire class involved in a discussion around the specific research project. Setting aside time for students to discuss their specific research projects as well as allocating time for practicing research poster presentations might also help students to see the intersection of the course content and direct research experiences. We encourage interested instructors to visit the website to determine the suitability and usefulness of the materials for their own instructional needs <ext-link ext-link-type="uri" xlink:href="https://stemedhub.org/groups/toprs">https://stemedhub.org/groups/toprs</ext-link>.</p>
<p>A report commissioned by the National Academy of Medicine Roundtable on Population Health Improvement recommends that interdisciplinary training be provided at multiple levels, beginning with an investment at the high school and undergraduate levels as a way of building a foundation of basic skills, competencies, and knowledge of population health concepts (<xref ref-type="bibr" rid="B9">9</xref>). The 2015 report lists three categories of competencies for training in population health science: knowledge, interdisciplinary skills, and knowledge exchange, and that these competencies can be achieved through immersion in an interdisciplinary environment, mentoring, and being part of an interdisciplinary team. The TOPRS undergraduate curriculum aims to provide a basic foundation for this type of training, as a central goal of the program is to actively teach interdisciplinarity. The three classes that participated in this program experienced the interdisciplinary environment, mentoring, and experience on an interdisciplinary team in varying degrees.</p>
<p>In two of the courses, the students participated in a hands-on research experience working on interdisciplinary teams. In the other course, students did not participate in research directly but engaged in exercises, and class activities on interdisciplinary teams designed to simulate working on research teams to solve problems related to obesity. The mentoring aspect also varied as the students working on research projects with faculty had more access to mentors in this capacity, but the instructor in the other course served as a mentor as well, but to a lesser degree. Students have fewer opportunities to get involved in research at the teaching university than at the research university, and this was the first intensive exposure to research for many of the students. As such, many of the students used the instructor as a mentor, asking questions about research and several later signed up to work on a research project with the instructor.</p>
<p>We recognize that this report is not without limitations. The students enrolled in the courses across sites were primarily female. Thus, further work needs to be done to consider whether the format and topic of the course appeals equally to men and women.</p>
<p>In conclusion, although each class experience was different, all resulted in gains in knowledge content as well as appreciation for the research process. These results are promising because the curriculum can be replicated and adapted to fit the needs of particular types of schools and students can be expected to leave the course with a basic foundation in interdisciplinary and transdisciplinary methods as applied to an important and urgent public health problem. Programs such as TOPRS can provide students exposure at the undergraduate level to transdisciplinary concepts and methodology as well as give them team building experience, which is a first step in effective collaborative science.</p>
<sec>
<title>Permission to Reuse and Copyright</title>
<p>All of the material is original and does not require permission.</p>
</sec>
</sec>
<sec sec-type="data-availability" id="s5">
<title>Data Availability</title>
<p>The evaluation data is available upon reasonable request from the authors.</p>
</sec>
<sec id="s6">
<title>Author Contributions</title>
<p>BF, AH, DT, and BK originally developed the curriculum. LP and GG designed the measurement protocols. GG conducted the evaluation. All authors contributed to the writing and review of the manuscript. GG conducted the analyses presented in the manuscript.</p>
<p>Portions of these findings were presented at The Obesity Society as a poster in 2016. This manuscript is not currently under review at any other source.</p>
<sec>
<title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back>
<ack><p>The authors respectfully acknowledge Jill Bowers who assisted in developing the curriculum and all the scientists who freely gave their time to create the micro-lectures.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<label>1.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dietz</surname> <given-names>WH</given-names></name> <name><surname>Baur</surname> <given-names>LA</given-names></name> <name><surname>Hall</surname> <given-names>K</given-names></name> <name><surname>Puhl</surname> <given-names>RM</given-names></name> <name><surname>Taveras</surname> <given-names>EM</given-names></name> <name><surname>Uauy</surname> <given-names>R</given-names></name> <etal/></person-group>. <article-title>Management of obesity: Improvement of health-care training and systems for prevention and care</article-title>. <source>Lancet.</source> (<year>2015</year>) <volume>385</volume>:<fpage>2521</fpage>&#x02013;<lpage>33</lpage>. <pub-id pub-id-type="doi">10.1016/S0140-6736(14)61748-7</pub-id><pub-id pub-id-type="pmid">25703112</pub-id></citation></ref>
<ref id="B2">
<label>2.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Phelan</surname> <given-names>SM</given-names></name> <name><surname>Burgess</surname> <given-names>DJ</given-names></name> <name><surname>Burke</surname> <given-names>SE</given-names></name> <name><surname>Przedworski</surname> <given-names>JM</given-names></name> <name><surname>Dovidio</surname> <given-names>JF</given-names></name> <name><surname>Hardeman</surname> <given-names>R</given-names></name> <etal/></person-group>. <article-title>Beliefs about the causes of obesity in a national sample of 4th year medical students</article-title>. <source>Patient Edu Counsel.</source> (<year>2015</year>) <volume>98</volume>:<fpage>1446</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1016/j.pec.2015.06.017</pub-id><pub-id pub-id-type="pmid">26143579</pub-id></citation></ref>
<ref id="B3">
<label>3.</label>
<citation citation-type="book"><person-group person-group-type="author"><collab>Institute of Medicine</collab></person-group>. <source>Preventing Childhood Obesity: Health in the Balance</source>. <publisher-loc>Washington DC</publisher-loc>: <publisher-name>The National Academies Press</publisher-name> (<year>2005</year>).</citation></ref>
<ref id="B4">
<label>4.</label>
<citation citation-type="book"><person-group person-group-type="author"><collab>Institute of Medicine</collab></person-group>. <source>Early Childhood Obesity Prevention Policies</source>. <publisher-loc>Washington DC</publisher-loc>: <publisher-name>The National Academies Press</publisher-name> (<year>2011</year>).</citation></ref>
<ref id="B5">
<label>5.</label>
<citation citation-type="book"><person-group person-group-type="author"><collab>Institute of Medicine</collab></person-group>. <source>State of Obesity Solutions in the United States: Workshop Summary</source>. <publisher-loc>Washington DC</publisher-loc>: <publisher-name>The National Academies Press</publisher-name> (<year>2014</year>).</citation></ref>
<ref id="B6">
<label>6.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Krettek</surname> <given-names>A</given-names></name> <name><surname>Thorpenberg</surname> <given-names>S</given-names></name></person-group>. <article-title>Transdisciplinary higher education- A challenge for public health science</article-title>. <source>Edu Res Int.</source> (<year>2011</year>) <year>2011</year>. <pub-id pub-id-type="doi">10.1155/2011/649539</pub-id></citation></ref>
<ref id="B7">
<label>7.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Keck</surname> <given-names>A</given-names></name> <name><surname>Sloan</surname> <given-names>S</given-names></name> <name><surname>Liechty</surname> <given-names>JM</given-names></name> <name><surname>Paceley</surname> <given-names>MS</given-names></name> <name><surname>Donovan</surname> <given-names>SM</given-names></name> <name><surname>Bost</surname> <given-names>KK</given-names></name> <etal/></person-group>. <article-title>Longitudinal perspectives of faculty and students on benefits and barriers to transdisciplinary graduate education: program assessment and institutional recommendations</article-title>. <source>Palgrave Commun.</source> (<year>2017</year>) <volume>3</volume>. <pub-id pub-id-type="doi">10.1057/s41599-017-0027-y</pub-id></citation></ref>
<ref id="B8">
<label>8.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lawlor</surname> <given-names>EF</given-names></name> <name><surname>Kreuter</surname> <given-names>MW</given-names></name> <name><surname>Sebert-Kuhlmann</surname> <given-names>S</given-names></name> <name><surname>McBride</surname> <given-names>TD</given-names></name></person-group>. <article-title>Methodological Innovations in public health education: transdisciplinary problem solving</article-title>. <source>Am J Pub Health.</source> (<year>2015</year>) <volume>105</volume>:<fpage>S99</fpage>&#x02013;<lpage>103</lpage>. <pub-id pub-id-type="doi">10.2105/AJPH.2014.302462</pub-id><pub-id pub-id-type="pmid">25706031</pub-id></citation></ref>
<ref id="B9">
<label>9.</label>
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Bachrach</surname> <given-names>C</given-names></name> <name><surname>Robert</surname> <given-names>S</given-names></name> <name><surname>Thomas</surname> <given-names>Y</given-names></name></person-group>. <source>Training in Interdisciplinary Population Health Science: Current Successes and Future Needs</source>. (<year>2017</year>). Available online at: <ext-link ext-link-type="uri" xlink:href="http://www.nationalacademies.org/hmd/~/media/Files/Activity%20Files/PublicHealth/PopulationHealthImprovementRT/Commissioned%20Papers/Training%20Population%20Health%20Science%20final.pdf">http://www.nationalacademies.org/hmd/&#x0007E;/media/Files/Activity%20Files/PublicHealth/PopulationHealthImprovementRT/Commissioned%20Papers/Training%20Population%20Health%20Science%20final.pdf</ext-link> (accessed August 22, 2017).</citation></ref>
<ref id="B10">
<label>10.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stokols</surname> <given-names>D</given-names></name> <name><surname>Hall</surname> <given-names>KL</given-names></name> <name><surname>Taylor</surname> <given-names>BK</given-names></name> <name><surname>Moser</surname> <given-names>RP</given-names></name></person-group>. <article-title>The science of team science: overview of the field and introduction to the supplement</article-title>. <source>Am J Prevent Med.</source> (<year>2008</year>) <volume>35</volume>:<fpage>S77</fpage>&#x02013;<lpage>89</lpage>. <pub-id pub-id-type="doi">10.1016/j.amepre.2008.05.002</pub-id><pub-id pub-id-type="pmid">18619407</pub-id></citation></ref>
<ref id="B11">
<label>11.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mitrany</surname> <given-names>M</given-names></name> <name><surname>Stokols</surname> <given-names>D</given-names></name></person-group>. <article-title>Gauging the transdisciplinary qualities and outcomes of doctoral training programs</article-title>. <source>J Plan Edu Res.</source> (<year>2005</year>) <volume>24</volume>:<fpage>437</fpage>&#x02013;<lpage>49</lpage>. <pub-id pub-id-type="doi">10.1177/0739456X04270368</pub-id></citation></ref>
<ref id="B12">
<label>12.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Misra</surname> <given-names>S</given-names></name> <name><surname>Stokols</surname> <given-names>D</given-names></name> <name><surname>Hall</surname> <given-names>KL</given-names></name> <name><surname>Feng</surname> <given-names>A</given-names></name></person-group>. <article-title>Transdisciplinary training in health research: distinctive features and future directions</article-title>. In: Kirst M, ed. <source>Converging Disciplines.</source> <publisher-loc>New york, NY</publisher-loc>: <publisher-name>Springer</publisher-name> (<year>2011</year>). pp. <fpage>133</fpage>&#x02013;<lpage>47</lpage>.</citation></ref>
<ref id="B13">
<label>13.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fiese</surname> <given-names>BH</given-names></name> <name><surname>Bost</surname> <given-names>KK</given-names></name> <name><surname>McBride</surname> <given-names>BA</given-names></name> <name><surname>Donovan</surname> <given-names>SM</given-names></name></person-group>. <article-title>Childhood obesity from cell to society</article-title>. <source>Trends Endocrinol Metab.</source> (<year>2013</year>) <volume>24</volume>:<fpage>375</fpage>&#x02013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1016/j.tem.2013.01.009</pub-id><pub-id pub-id-type="pmid">23608162</pub-id></citation></ref>
<ref id="B14">
<label>14.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Harrison</surname> <given-names>K</given-names></name> <name><surname>Bost</surname> <given-names>KK</given-names></name> <name><surname>McBride</surname> <given-names>BA</given-names></name> <name><surname>M Donovan</surname> <given-names>S</given-names></name> <name><surname>Kim</surname> <given-names>J</given-names></name> <name><surname>Wiley</surname> <given-names>AR</given-names></name> <etal/></person-group>. <article-title>Toward a developmental conceptualization of contributors to overweight and obesity in childhood: the six-C&#x00027;s model</article-title>. <source>Child Develop Perspect.</source> (<year>2011</year>) <volume>5</volume>:<fpage>50</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1111/j.1750-8606.2010.00150.x</pub-id></citation></ref>
<ref id="B15">
<label>15.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ruiz-Primo</surname> <given-names>MA</given-names></name> <name><surname>Briggs</surname> <given-names>D</given-names></name> <name><surname>Iverson</surname> <given-names>H</given-names></name> <name><surname>Talbot</surname> <given-names>R</given-names></name> <name><surname>Shepard</surname> <given-names>LA</given-names></name></person-group>. <article-title>Impact of undergraduate science course innovations on learning</article-title>. <source>Science.</source> (<year>2011</year>) <volume>331</volume>:<fpage>1269</fpage>&#x02013;<lpage>170</lpage>. <pub-id pub-id-type="doi">10.1126/science.1198976</pub-id><pub-id pub-id-type="pmid">21393529</pub-id></citation></ref>
<ref id="B16">
<label>16.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Freeman</surname> <given-names>S</given-names></name> <name><surname>Eddy</surname> <given-names>SL</given-names></name> <name><surname>McDonough</surname> <given-names>M</given-names></name> <name><surname>Smith</surname> <given-names>MK</given-names></name> <name><surname>Okoroafor</surname> <given-names>N</given-names></name> <name><surname>Jordt</surname> <given-names>H.</given-names></name> <etal/></person-group>. <article-title>Active learning increases student performance in science engineering, and mathematics</article-title>. <source>Proc Natl Acad Sci USA.</source> (<year>2004</year>) <volume>111</volume>:<fpage>8410</fpage>&#x02013;<lpage>5</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1319030111</pub-id><pub-id pub-id-type="pmid">24821756</pub-id></citation></ref>
<ref id="B17">
<label>17.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rossi</surname> <given-names>RD</given-names></name></person-group>. <article-title>ConfChem conference on flipped classroom: improving student engagement in organic chemistry using the inverted classroom model</article-title>. <source>J Chem Edu.</source> (<year>2015</year>) <volume>92</volume>:<fpage>1577</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1021/ed500899e</pub-id></citation></ref>
<ref id="B18">
<label>18.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Blazquez</surname> <given-names>BO</given-names></name> <name><surname>Masluk</surname> <given-names>B</given-names></name> <name><surname>Diaz</surname> <given-names>RF</given-names></name> <name><surname>Aguilar-Latoree</surname> <given-names>A</given-names></name> <name><surname>Magallon</surname> <given-names>IA</given-names></name> <name><surname>Botaya</surname> <given-names>RM</given-names></name></person-group>. <article-title>The use of flipped classroom as an active learning approach improves academic performance in social work: a randomized trial in a university</article-title>. <source>PLoS ONE.</source> (<year>2019</year>) <volume>14</volume>:<fpage>e0214623</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0214623</pub-id></citation></ref>
<ref id="B19">
<label>19.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Styers</surname> <given-names>ML</given-names></name> <name><surname>Van Zandt</surname> <given-names>PA</given-names></name> <name><surname>Hayden</surname> <given-names>KL</given-names></name></person-group>. <article-title>Active learning in flipped life course sciences courses promotes development of critical thinking skills</article-title>. <source>CBE Life Sci Edu.</source> (<year>2018</year>) <volume>17</volume>:<fpage>ar39</fpage>. <pub-id pub-id-type="doi">10.1187/cbe.16-11-0332</pub-id></citation></ref>
<ref id="B20">
<label>20.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fernandes</surname> <given-names>AC</given-names></name> <name><surname>Oliveira</surname> <given-names>RC</given-names></name> <name><surname>Rodrigues</surname> <given-names>VM</given-names></name> <name><surname>Fiates</surname> <given-names>GMR</given-names></name> <name><surname>Proenca</surname> <given-names>RP</given-names></name></person-group>. <article-title>Perceptions of university students regarding calories, food healthiness, and the importance of calorie information in menu labeling</article-title>. <source>Appetite.</source> (<year>2015</year>) <volume>91</volume>:<fpage>173</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1016/j.appet.2015.04.042</pub-id></citation></ref>
<ref id="B21">
<label>21.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jasti</surname> <given-names>S</given-names></name> <name><surname>Rubin</surname> <given-names>R</given-names></name> <name><surname>Doak</surname> <given-names>CM</given-names></name></person-group>. <article-title>Sugar-sweetened beverage knoweldge and consumption in college students</article-title>. <source>Health Behav Policy Rev.</source> (<year>2017</year>) <volume>4</volume>:<fpage>37</fpage>&#x02013;<lpage>45</lpage>. <pub-id pub-id-type="doi">10.14485/HBPR.4.1.4</pub-id></citation></ref>
<ref id="B22">
<label>22.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Seymour</surname> <given-names>E</given-names></name> <name><surname>Wiese</surname> <given-names>D</given-names></name> <name><surname>Hunter</surname> <given-names>A</given-names></name> <name><surname>Daffinrud</surname> <given-names>AM</given-names></name></person-group>. <article-title>Creating a better mousetrap: on-line student assessment of their learning gains</article-title>. In: <source>Paper presented at: National Meeting of the American Chemical Society.</source> <publisher-loc>San Francisco, CA</publisher-loc> (<year>2000</year>).</citation></ref>
<ref id="B23">
<label>23.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kardash</surname> <given-names>CM</given-names></name></person-group>. <article-title>Evaluation of undergraduate research experience: perceptions of undergraduate interns and their faculty mentors</article-title>. <source>J Edu Psychol.</source> (<year>2000</year>) <volume>92</volume>:<fpage>191</fpage>&#x02013;<lpage>201</lpage>. <pub-id pub-id-type="doi">10.1037//0022-0663.92.1.191</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn fn-type="financial-disclosure"><p><bold>Funding.</bold> The curriculum development, implementation, and evaluation was supported, in part, by a United States Department of Education Higher Education Challenge grant to BF, AH, and DT. Award No. 2013-70003-20922.</p>
</fn>
</fn-group>
</back>
</article>