<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Archiving and Interchange DTD v2.3 20070202//EN" "archivearticle.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="methods-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Vet. Sci.</journal-id>
<journal-title>Frontiers in Veterinary Science</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Vet. Sci.</abbrev-journal-title>
<issn pub-type="epub">2297-1769</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fvets.2023.1192598</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Veterinary Science</subject>
<subj-group>
<subject>Methods</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Use of an online gaming tool, the Veterinary DialogueTrainer, for teaching clinical communication skills to bovine veterinary practitioners</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes"><name><surname>Dorrestein</surname><given-names>Linda</given-names></name><xref rid="aff1" ref-type="aff"><sup>1</sup></xref><xref rid="c001" ref-type="corresp"><sup>&#x002A;</sup></xref><uri xlink:href="https://loop.frontiersin.org/people/2247419/overview"/>
</contrib>
<contrib contrib-type="author"><name><surname>Jansen</surname><given-names>Jolanda</given-names></name><xref rid="aff2" ref-type="aff"><sup>2</sup></xref><uri xlink:href="https://loop.frontiersin.org/people/2265370/overview"/>
</contrib>
<contrib contrib-type="author"><name><surname>Plagis</surname><given-names>Tessa</given-names></name><xref rid="aff2" ref-type="aff"><sup>2</sup></xref><uri xlink:href="https://loop.frontiersin.org/people/2370998/overview"/>
</contrib>
<contrib contrib-type="author"><name><surname>Ritter</surname><given-names>Caroline</given-names></name><xref rid="aff3" ref-type="aff"><sup>3</sup></xref><uri xlink:href="https://loop.frontiersin.org/people/1265991/overview"/>
</contrib>
<contrib contrib-type="author"><name><surname>Vertenten</surname><given-names>Geert</given-names></name><xref rid="aff4" ref-type="aff"><sup>4</sup></xref><uri xlink:href="https://loop.frontiersin.org/people/2365324/overview"/>
</contrib>
<contrib contrib-type="author"><name><surname>Barkema</surname><given-names>Herman W.</given-names></name><xref rid="aff1" ref-type="aff"><sup>1</sup></xref><uri xlink:href="https://loop.frontiersin.org/people/320099/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Faculty of Veterinary Medicine, University of Calgary</institution>, <addr-line>Calgary, AB</addr-line>, <country>Canada</country></aff>
<aff id="aff2"><sup>2</sup><institution>St. Anna Advies</institution>, <addr-line>Beuningen</addr-line>, <country>Netherlands</country></aff>
<aff id="aff3"><sup>3</sup><institution>Department of Health Management, Atlantic Veterinary College, University of Prince Edward Island</institution>, <addr-line>Charlottetown, PE</addr-line>, <country>Canada</country></aff>
<aff id="aff4"><sup>4</sup><institution>MSD Animal Health</institution>, <addr-line>Boxmeer</addr-line>, <country>Netherlands</country></aff>
<author-notes>
<fn fn-type="edited-by" id="fn0001">
<p>Edited by: Richard Van Vleck Pereira, University of California, Davis, United States</p>
</fn>
<fn fn-type="edited-by" id="fn0002">
<p>Reviewed by: Jennifer Van Os, University of Wisconsin-Madison, United States; Andrea Tipold, University of Veterinary Medicine Hannover, Germany</p>
</fn>
<corresp id="c001">&#x002A;Correspondence: Linda Dorrestein, <email>linda.dorrestein@ucalgary.ca</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>19</day>
<month>07</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>10</volume>
<elocation-id>1192598</elocation-id>
<history>
<date date-type="received">
<day>23</day>
<month>03</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>04</day>
<month>07</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2023 Dorrestein, Jansen, Plagis, Ritter, Vertenten and Barkema.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Dorrestein, Jansen, Plagis, Ritter, Vertenten and Barkema</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>Effective clinical communication is essential for bovine veterinary practitioners to establish and maintain positive client relationships. When applied properly in herd health consultancy, it increases client satisfaction and adherence to veterinary advice, and improves patient health and welfare. Although communication skills are often taught by providing feedback on simulated conversations, this has limitations, including time constraints, subjective assessments, and cost. The Veterinary DialogueTrainer (VDT) is an online serious game platform using &#x2018;digital role-play&#x2019; with avatars, recently developed to enhance and assess learning outcomes, improve use of learned skills, and increase cost-effectiveness of communication training. The objective was to evaluate its suitability and applicability. Finnish (<italic>n</italic>&#x2009;=&#x2009;24) and Swedish (<italic>n</italic>&#x2009;=&#x2009;21) bovine veterinarians participated in communication training using VDT for training and assessment. Participants completed the provided scenario at least twice. After playing a bovine health communication simulation, participants received their scores and feedback on selected conversation options. VDT scores measured multiple aspects of communication on a 0&#x2013;100% scale, based on motivational interviewing methodology and Calgary-Cambridge guidelines. Mean (&#x00B1;SD) number of attempts participants played the scenario was 4.1 (&#x00B1;2.6, Finland) and 3.9 (&#x00B1;1.3, Sweden), with highest total score reached after a mean of 3.5 (&#x00B1;2.1, Finland) and 3.1 (&#x00B1;1.1, Sweden) attempts. On the first attempt, 39 participants (87%) scored &#x003C;50% of the highest possible score, whereas most (<italic>n</italic>&#x2009;=&#x2009;34, 76%) achieved a higher score on the second attempt. Mean total score increased from 15 (&#x00B1;14) to 77% (&#x00B1;33) for Finish participants and from 40 (&#x00B1;22.0) to 87% (&#x00B1;19.4) for Swedish participants. The majority (<italic>n</italic>&#x2009;=&#x2009;33, 73%) of participants reached a score&#x2009;&#x003E;80% after 4.0 (&#x00B1;1.6, Finland) or 2.8 (&#x00B1;1.0, Sweden) attempts. Net Promoter Score of the training was +89 (Finland), +88 (Finland) and&#x2009;+&#x2009;83 (Sweden) on a scale from &#x2212;100 to +100, indicating that most participants were very likely to recommend the training to other veterinarians. Use of VDT increased communication skills scores but whether it will improve communication skills in practice requires further study. We concluded there is a likely benefit of using the VDT in teaching and monitoring veterinary communication competencies and preparing for offline role-plays and real-life conversations in veterinary practice.</p>
</abstract>
<kwd-group>
<kwd>communication skills</kwd>
<kwd>serious games</kwd>
<kwd>veterinarian-farmer communication</kwd>
<kwd>communication training method</kwd>
<kwd>veterinarian and farmer</kwd>
<kwd>herd health consultancy</kwd>
</kwd-group>
<contract-sponsor id="cn1">Canada&#x2019;s Natural Sciences and Engineering Research Council (NSERC) Industrial Research Chair Program (Ottawa, ON, Canada), with industry contributions from Alberta Milk (Edmonton, AB, Canada), the Dairy Farmers of Canada (Ottawa, ON, Canada), Westgen Endowment Fund (Milner, BC, Canada), the BC Dairy Association (Burnaby, BC, Canada), Canadian Dairy Network (Guelph, ON, Canada), CanWest DHI (Guelph, ON, Canada), SaskMilk (Regina, SK, Canada), Dairy Farmers of Manitoba (Winnipeg, MB, Canada), and MSD Animal Health (Kirkland, QC, Canada)</contract-sponsor>
<counts>
<fig-count count="4"/>
<table-count count="4"/>
<equation-count count="0"/>
<ref-count count="44"/>
<page-count count="12"/>
<word-count count="7763"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Veterinary Humanities and Social Sciences</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec id="sec1" sec-type="intro">
<label>1.</label>
<title>Introduction</title>
<p>Veterinarians are a key information source of dairy farmers and they have substantial impacts on herd health management decisions (<xref ref-type="bibr" rid="ref1">1</xref>, <xref ref-type="bibr" rid="ref2">2</xref>). Historically, dairy veterinarians were only called to farms to treat individual animals. Although individual animal calls remain part of dairy veterinary practice, the modern dairy veterinarian needs to be a well-rounded herd health and production management consultant (<xref ref-type="bibr" rid="ref3">3</xref>). This paradigm shift has occurred in the last decades (<xref ref-type="bibr" rid="ref4 ref5 ref6">4&#x2013;6</xref>) with studies directed toward understanding farmers&#x2019; perspectives and needs (<xref ref-type="bibr" rid="ref7 ref8 ref9">7&#x2013;9</xref>), the role of the veterinarian, and skills needed in herd health and production management (<xref ref-type="bibr" rid="ref6">6</xref>, <xref ref-type="bibr" rid="ref10">10</xref>, <xref ref-type="bibr" rid="ref11">11</xref>).</p>
<p>Well-developed communication skills are a core competency vital to improving herd health, as they have the potential to increase farmer satisfaction with herd health consultancy and adherence to veterinary advice (<xref ref-type="bibr" rid="ref12 ref13 ref14">12&#x2013;14</xref>). Regardless, there is room to improve communication competencies of practicing veterinarians, especially because communication skills training was often lacking in their veterinary curriculum (<xref ref-type="bibr" rid="ref1">1</xref>, <xref ref-type="bibr" rid="ref15">15</xref>, <xref ref-type="bibr" rid="ref16">16</xref>). However, these competencies are increasingly addressed in the veterinary curriculum and veterinary continuing education (<xref ref-type="bibr" rid="ref17 ref18 ref19">17&#x2013;19</xref>).</p>
<p>Teaching methods vary among teaching institutions, but often include a didactic part, e.g., lectures, problem-based teaching such as case studies, and experiential learning approaches such as role playing in small groups or facilitated one-on-one learning (<xref ref-type="bibr" rid="ref20">20</xref>, <xref ref-type="bibr" rid="ref21">21</xref>). Communication behavior is more likely to be changed through experiential methods, e.g., role-play, by providing opportunities to practice alternative approaches to communication (<xref ref-type="bibr" rid="ref22">22</xref>, <xref ref-type="bibr" rid="ref23">23</xref>). Unfortunately, there is a paucity of opportunities for veterinary communication training in postgraduate education. Developing such a program for practicing veterinarians involves integral challenges, such as time constraints, costs, veterinarians&#x2019; doubts regarding value of training (<xref ref-type="bibr" rid="ref23">23</xref>, <xref ref-type="bibr" rid="ref24">24</xref>), and limitations of traditional role-play training, e.g., simulated clients, reluctance of training participants to engage in role-play (<xref ref-type="bibr" rid="ref25">25</xref>), and difficulties to administer, assess and repeat (<xref ref-type="bibr" rid="ref26">26</xref>).</p>
<p>Online serious games have potential for improving continuing communication education for veterinary practitioners. In these games, the concept of gaming has been applied to training and education to facilitate an interactive learning environment, engaging learners to improve knowledge or skills (<xref ref-type="bibr" rid="ref26">26</xref>, <xref ref-type="bibr" rid="ref27">27</xref>). Virtual patients (VPs), simulations of patient encounters in an online interactive computer environment, are examples of such serious games in the human medicine context (<xref ref-type="bibr" rid="ref28">28</xref>, <xref ref-type="bibr" rid="ref29">29</xref>). Although VPs increased communication knowledge and clinical reasoning of students in human medicine education (<xref ref-type="bibr" rid="ref27">27</xref>, <xref ref-type="bibr" rid="ref29">29</xref>), VPs are rarely used in communication skills education for veterinary medicine [reviewed by (<xref ref-type="bibr" rid="ref30">30</xref>)]. Jeuring et al. (<xref ref-type="bibr" rid="ref31">31</xref>) introduced &#x201C;Communicate!&#x201D; a serious game currently used in the communication skills curriculum for veterinary students in The Netherlands (<xref ref-type="bibr" rid="ref28">28</xref>). Since then, the &#x201C;Communicate!&#x201D;-tool has been further developed and has been renamed to Veterinary DialogueTrainer (VDT). So far, the tool has not been used in continuing education for veterinary practitioners.</p>
<p>Objectives of this study were to: (1) present the Veterinary DialogueTrainer (VDT) as an online communication training tool for veterinary practitioners; (2) evaluate whether the VDT improves virtually assessed communication skills scores in bovine practitioners during clinical communication skills training; and (3) explore participants&#x2019; willingness to recommend the tool to other veterinarians. Further, to the best of the authors&#x2019; knowledge, this is the first study to explore the use of an online virtual patient in the context of training postgraduate veterinarians, offering guidance for future studies. Successful application of the VDT would improve teaching clinical communication in terms of increasing communication skills in veterinary practitioners, cost-effectiveness of training interventions, and preparing for offline role-plays and real-life conversations in veterinary practice.</p>
</sec>
<sec id="sec2" sec-type="materials|methods">
<label>2.</label>
<title>Materials and methods</title>
<sec id="sec3">
<label>2.1.</label>
<title>Participants</title>
<p>Data for this study were retrieved during two communication training events focused on bovine veterinarians, one held in Finland (September 24 and 25, 2019) and the other in Sweden (October 28, 2021). In Finland, 51 bovine veterinarians received an online invitation to participate in a communication training on preventative dairy herd health consultancy. This training was organized by ETKO animal health and economy-project (Kuopio, Finland). The Swedish training, hosted at a Swedish Veterinary Congress (Stockholm, Sweden), was attended by 25 bovine practitioners who were present at the conference and signed up on-site. After the training, participating veterinarians were invited by email to participate in the study.</p>
<p>Inclusion criteria for this study were participation in the training events and having completed the simulation on initiating a herd health conversation (see &#x201C;Training intervention&#x201D;) at least twice. Consent was obtained from veterinarians that met inclusion criteria. Ethics approval was obtained from the University of Calgary&#x2019;s Research Ethics board (REB20-0137).</p>
</sec>
<sec id="sec4">
<label>2.2.</label>
<title>Veterinary DialogueTrainer</title>
<p>DialogueTrainer is an online serious game platform developed to enhance and assess learning outcomes, improve use of learned skills, and increase cost-effectiveness of communication training (<xref ref-type="bibr" rid="ref28">28</xref>, <xref ref-type="bibr" rid="ref31">31</xref>). Communication simulations specifically built and/or selected for a target group can be provided through the platform and accessed online at any time. In a communication simulation, a player engages in a &#x201C;digital role-play&#x201D; with an avatar, a digital persona. These simulations can be used for a wide array of activities, e.g., to support teaching of constructs or skills, practice conversation techniques, and assess learning outcomes. Communication simulations are developed using Communicate! software as used by the existing DialogueTrainer platform (<xref ref-type="bibr" rid="ref28">28</xref>, <xref ref-type="bibr" rid="ref31">31</xref>). This software tool was developed at Utrecht University (Utrecht, the Netherlands), to improve communication skills training of students of various study programs.</p>
<p>The VDT offers a platform for veterinary students and professionals to engage in simulated conversations with a virtual client in a veterinary setting (<xref rid="fig1" ref-type="fig">Figure 1</xref>). A demonstration account is available at <ext-link xlink:href="https://en.dialoguetrainer.app/join/JVABAQAX" ext-link-type="uri">https://en.dialoguetrainer.app/join/JVABAQAX</ext-link>. In this study, participants in the training intervention completed the simulation &#x201C;First contact.&#x201D; Simulations were played by veterinary practitioners (the player) who engaged with a virtual dairy farmer (the client). The VDT was designed to make it easily accessible, intuitive, and self-explanatory. No previous experience with the tool was needed. During a simulated farm visit, the virtual farmer tells (through a speech bubble and voice over) about a situation or issue on their farm in a way that warrants a reaction from the playing veterinarian (<xref rid="fig2" ref-type="fig">Figure 2A</xref>).</p>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption>
<p>Screenshot of the Veterinary Dialogue Trainer player &#x201C;dashboard&#x201D; on which simulated conversations are listed with associated scores.</p>
</caption>
<graphic xlink:href="fvets-10-1192598-g001.tif"/>
</fig>
<fig position="float" id="fig2">
<label>Figure 2</label>
<caption>
<p><bold>(A)</bold> Screenshot of a node in a VDT scenario. The player can click one of the answer possibilities or click the &#x201C;+&#x201D; on the right to suggest alternatives. In <bold>(B,C)</bold>, results of choosing the first or second options are demonstrated. <bold>(B)</bold> Screenshot of a node in a VDT scenario. The avatar&#x2019;s response after choosing the option &#x201C;I noticed a couple of calves have diarrhea. Would you like any help?&#x2019; in <bold>(A)</bold>. <bold>(C)</bold> Screenshot of a node in a VDT scenario. The avatar&#x2019;s response after choosing the option &#x201C;Just out of curiosity, how are things going on the farm in general?&#x201D; in <bold>(A)</bold>.</p>
</caption>
<graphic xlink:href="fvets-10-1192598-g002.tif"/>
</fig>
<p>Then, the player has the possibility to click on one of multiple predefined player choices, called a &#x201C;node&#x201D; in the scenario. The player chooses the option that is closest to how they would intend to respond in a similar situation. The player&#x2019;s response elicits a reaction from the virtual farmer, either verbally or non-verbally (change in posture and/or a thought in a thought balloon) and directs the conversation further (<xref rid="fig2" ref-type="fig">Figures 2B</xref>,<xref rid="fig2" ref-type="fig">C</xref>). At each node in the conversation, the intention of the player&#x2019;s choices influences continuation of the conversation in a positive, neutral, or negative direction. Depending on choices, the conversation ends when the player has given the farmer final advice and concludes the visit, or, in case they have upset the farmer, by the farmer asking them to leave the farm. After completing the game, the player is presented with a total score and sub scores for three parameters (see &#x201C;scoring of scenarios&#x201D;) and an overview of all steps in the conversation, with feedback for every step.</p>
</sec>
<sec id="sec5">
<label>2.3.</label>
<title>Development of VDT communication scenarios</title>
<p>Scenarios were developed according to a five-step process. First, the situation for which a scenario would be developed was determined and learning objectives, target audience and content of situation-specific conversations explored. Consequently, in collaboration with communication experts, farmers and veterinary practitioners, the best communication practices for each situation were determined based on behavioral theory (<xref ref-type="bibr" rid="ref32">32</xref>, <xref ref-type="bibr" rid="ref33">33</xref>), motivational interviewing methodology, and Calgary-Cambridge guidelines (<xref ref-type="bibr" rid="ref12">12</xref>, <xref ref-type="bibr" rid="ref34">34</xref>). In the third step, &#x201C;Do&#x2019;s and don&#x2019;ts&#x201D; were determined for the specific situation of the simulated conversation, and aligned with previously established learning objectives, e.g., &#x201C;Building the client relationship.&#x201D; Fourth, the scenario was written and converted into a simulated conversation, i.e., the simulation (<xref rid="fig3" ref-type="fig">Figure 3</xref>). Multiple answer possibilities (i.e., player statements) for each node enabled participants to choose an option matching their intention in the node, e.g., showing empathy, being time efficient. Additionally, the developer enhanced the character, complexity, and depth of the virtual farmer/client, e.g., by adding certain body postures and thought balloons.</p>
<fig position="float" id="fig3">
<label>Figure 3</label>
<caption>
<p>Screenshot of a scenario decision tree. This is an example scenario, it is not used in this study. Orange box: information or knowledge transfer to the player, e.g., providing background of the conversation, staging the scenario. Blue box: answer possibilities for the player of the scenario. Red box: response of the avatar. Green arrow: best communication practice. Purple arrow: sub-assertive/less effective answer. Red arrow: too direct, dominant, or even (passive) aggressive answer.</p>
</caption>
<graphic xlink:href="fvets-10-1192598-g003.tif"/>
</fig>
</sec>
<sec id="sec6">
<label>2.4.</label>
<title>Scoring of simulations</title>
<p>Learning goals in the simulations used in this study were related to &#x201C;Building the relationship,&#x201D; &#x201C;Clarifying needs,&#x201D; and &#x201C;Showing added value,&#x201D; the three domains included in training intervention (see &#x201C;training intervention&#x201D;). Learning objectives in a simulation are referred to as parameters, which are encoded as integers (<xref ref-type="bibr" rid="ref35">35</xref>). Underlying communication skills that are represented in statements of the player contribute to an incremental score on parameters, e.g., when the player selects an option with an open-ended question that seeks to understand the needs of the virtual farmer, the parameter &#x201C;Clarifying needs&#x201D; will change by +1 (<xref rid="tab1" ref-type="table">Table 1</xref>). Additionally, the statement can have an effect on the virtual character, e.g., &#x201C;Relief,&#x201D; and provide textual feedback for the player. Ultimately, a player&#x2019;s score on a parameter is the percentage of the maximum possible obtainable score for that parameter. Scores on the parameters &#x201C;Identifying needs,&#x201D; &#x201C;Relationship building,&#x201D; and &#x201C;Showing added value&#x201D; were averaged to a total score &#x201C;Bovine Preventive Consultant&#x201D; on a 0&#x2013;100% scale.</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption>
<p>Examples of underlying communication skills contributing to parameters (<xref ref-type="bibr" rid="ref12">12</xref>).</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th align="center" valign="top" colspan="3">Parameter</th>
</tr>
<tr>
<th/>
<th align="left" valign="top">Building the relationship</th>
<th align="left" valign="top">Clarifying needs</th>
<th align="left" valign="top">Showing added value</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Underlying communication skills</td>
<td align="left" valign="top">Establishing initial rapport, demonstrating empathy, involving the avatar, affirming the avatar</td>
<td align="left" valign="top">Asking open-ended and follow-up questions, reflective listening statements, perceiving cues</td>
<td align="left" valign="top">Offering veterinary services without pushing, establishing follow-up plan and/or appointments, explaining costs</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="sec7">
<label>2.5.</label>
<title>Training intervention</title>
<p>Communication training focused on communication skills needed to be a successful veterinary herd health consultant and was based on Motivational Interviewing methodology (<xref ref-type="bibr" rid="ref34">34</xref>) and Calgary-Cambridge guidelines (<xref ref-type="bibr" rid="ref12">12</xref>). The main language during training intervention was English. During training, the background and development of the VDT were introduced, communication simulations played, general feedback on previously obtained scores given, and time allocated to repeat simulations to enhance learning. Players were encouraged to not solely try to obtain a high score, but afterwards also &#x2018;play around&#x2019; to enhance learning about undesirable ways of communication.</p>
<p>Finnish participants were invited to create a user profile for the VDT and to play the communication simulations provided before the training and at set moments during training. Swedish participants created a user profile at the beginning of the training.</p>
<p>Training for the Finnish participants lasted 2 d, with five simulations with increasing difficulty provided to participants (<xref rid="fig1" ref-type="fig">Figure 1</xref>). In the first simulation, the player initiated the conversation regarding herd health with the virtual farmer; the second scenario depicted a herd health visit conversation; the third scenario addressed the follow-up of a herd health conversation; and in the fourth scenario the player had a conversation with a &#x201C;hard-to-reach&#x201D; farmer, i.e. a farmer that is more resistant to change. The fifth and final scenario brought together all previous simulations, enabling the player to use all experiences.</p>
<p>Training duration for the Swedish participants was 4&#x2009;h and covered similar topics, albeit not as in-depth as the 2-d training. Due to limited time, these participants took part in the first simulation only. As the first simulation was played by both groups, this manuscript will focus on scores of that specific simulation.</p>
</sec>
<sec id="sec8">
<label>2.6.</label>
<title>Net promoter score</title>
<p>Participants were given opportunities to provide feedback by means of the Net Promotor Score (NPS), an index ranging from &#x2212;100 to +100 measuring participants&#x2019; willingness to recommend the course to others (<xref ref-type="bibr" rid="ref36">36</xref>). For Finnish participants this was possible after Day 1 and completion of training. For Swedish participants this was possible right after completion. The NPS was assessed by asking participants the following question: &#x201C;On a scale from 0 to 10, how likely are you to recommend this training to others?&#x201D; Responses were grouped; promoters were the participants who gave a score of 9 or 10, and detractors were those who indicated 6 or lower. Finally, responses were compiled and percentage of detractors was subtracted from percentage of promoters (<xref ref-type="bibr" rid="ref36">36</xref>).</p>
</sec>
<sec id="sec9">
<label>2.7.</label>
<title>Questionnaire</title>
<p>Participants were asked to provide general demographic data as well as information specific to their veterinary practice and prior experience with communication training (<xref ref-type="sec" rid="app1">Appendix 1</xref>).</p>
</sec>
<sec id="sec10">
<label>2.8.</label>
<title>Data analyses</title>
<p>Data were compiled in Microsoft Excel Version 16.69 (Microsoft Corp., Redmond, WA, United States), which was also used for descriptive analyses. Statistical analyses were performed with Rstudio 2022.07.2, build 576 (PBC, Boston, MA, United States, <ext-link xlink:href="http://www.rstudio.com/" ext-link-type="uri">http://www.rstudio.com/</ext-link>). We explored attained scores and number of attempts by participating veterinarians by creating tables and descriptive statistics like mean and median. Scores of participants at consecutive attempts were compared using paired Student&#x2019;s <italic>t</italic>-tests (H<sub>0</sub>: mean difference&#x2009;=&#x2009;0). Separate <italic>t</italic>-tests were conducted for data from Finnish and data from Swedish participants. Statistical significance was declared at a <italic>p-</italic>value&#x2009;&#x003C;&#x2009;0.05.</p>
</sec>
</sec>
<sec id="sec11" sec-type="results">
<label>3.</label>
<title>Results</title>
<sec id="sec12">
<label>3.1.</label>
<title>Participants</title>
<p>In the Finnish training, 35 of the 51 initial invitees actively participated in training, of which 24 completed the first VDT scenario multiple times. The Swedish training had 25 participants taking part in the online communication simulations; 21 participants completed the communication simulation at least twice and met inclusion criteria for this study. Reasons for not playing the simulation, or not playing repeatedly, included lack of a device, lack of internet connection, and time constraints.</p>
<p>Demographic characteristics of participants are presented in <xref rid="tab2" ref-type="table">Table 2</xref>. Twelve (50%) Finnish and 18 (75%) Swedish participants worked in bovine medicine for the majority of their time (&#x003E;50% of the time/week).</p>
<table-wrap position="float" id="tab2">
<label>Table 2</label>
<caption>
<p>Demographic characteristics (No, %) of veterinarians participating in training in Finland or Sweden, respectively.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th align="left" valign="top">Finland</th>
<th align="left" valign="top">Sweden</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top" colspan="3">
<bold>Gender</bold>
<xref rid="tfn1" ref-type="table-fn"><sup>a</sup></xref></td>
</tr>
<tr>
<td align="left" valign="top">Female</td>
<td align="center" valign="top">23 (96)</td>
<td align="center" valign="top">17 (81)</td>
</tr>
<tr>
<td align="left" valign="top">Male</td>
<td align="center" valign="top">1 (4)</td>
<td align="center" valign="top">4 (19)</td>
</tr>
<tr>
<td align="left" valign="top" colspan="3">
<bold>Employment</bold>
<xref rid="tfn1" ref-type="table-fn"><sup>a</sup></xref></td>
</tr>
<tr>
<td align="left" valign="top">Clinic, Owner</td>
<td align="center" valign="top">6 (25)</td>
<td align="center" valign="top">0 (0)</td>
</tr>
<tr>
<td align="left" valign="top">Clinic, Associate</td>
<td align="center" valign="top">4 (17)</td>
<td align="center" valign="top">11 (52)</td>
</tr>
<tr>
<td align="left" valign="top">Clinic, Locum</td>
<td align="center" valign="top">3 (13)</td>
<td align="center" valign="top">6 (29)</td>
</tr>
<tr>
<td align="left" valign="top">Government</td>
<td align="center" valign="top">9 (38)</td>
<td align="center" valign="top">1 (5)</td>
</tr>
<tr>
<td align="left" valign="top">Industry</td>
<td align="center" valign="top">1 (4)</td>
<td align="center" valign="top">2 (10)</td>
</tr>
<tr>
<td align="left" valign="top">Teaching</td>
<td align="center" valign="top">1 (4)</td>
<td align="center" valign="top">1 (5)</td>
</tr>
<tr>
<td align="left" valign="top" colspan="3">
<bold>Clinic size</bold>
<xref rid="tfn2" ref-type="table-fn"><sup>b</sup></xref></td>
</tr>
<tr>
<td align="left" valign="top">Full-time veterinarians</td>
<td align="center" valign="top">3, 3 (0&#x2013;8)</td>
<td align="center" valign="top">14, 1 (0&#x2013;85)</td>
</tr>
<tr>
<td align="left" valign="top">Part-time veterinarians</td>
<td align="center" valign="top">2, 1 (0&#x2013;20)</td>
<td align="center" valign="top">4, 1 (0&#x2013;33)</td>
</tr>
<tr>
<td align="left" valign="top">Age<xref rid="tfn2" ref-type="table-fn"><sup>b</sup></xref> (y)</td>
<td align="center" valign="top">42, 40 (30&#x2013;66)</td>
<td align="center" valign="top">43, 41 (30&#x2013;63)</td>
</tr>
<tr>
<td align="left" valign="top">Duration of experience in veterinary practice<xref rid="tfn2" ref-type="table-fn"><sup>b</sup></xref> (y)</td>
<td align="center" valign="top">13, 11 (1&#x2013;32)</td>
<td align="center" valign="top">12, 11 (1&#x2013;35)</td>
</tr>
<tr>
<td align="left" valign="top" colspan="3">
<bold>Practicing in</bold>
<xref rid="tfn1" ref-type="table-fn"><sup>a</sup></xref></td>
</tr>
<tr>
<td align="left" valign="top">Finland</td>
<td align="center" valign="top">24 (100)</td>
<td align="center" valign="top">0 (0)</td>
</tr>
<tr>
<td align="left" valign="top">Estonia</td>
<td align="center" valign="top">1 (4)</td>
<td align="center" valign="top">0 (0)</td>
</tr>
<tr>
<td align="left" valign="top">Sweden</td>
<td align="center" valign="top">1 (4)</td>
<td align="center" valign="top">20 (95)</td>
</tr>
<tr>
<td align="left" valign="top">Other</td>
<td align="center" valign="top">0 (0)</td>
<td align="center" valign="top">1 (5)</td>
</tr>
<tr>
<td align="left" valign="top" colspan="3">
<bold>Work activities</bold>
<xref rid="tfn2" ref-type="table-fn"><sup>b</sup></xref><bold>, estimated proportion of work hours per week spent working in (%)</bold>
</td>
</tr>
<tr>
<td align="left" valign="top">Bovine</td>
<td align="center" valign="top">55, 55 (0&#x2013;100)</td>
<td align="center" valign="top">70, 100 (0&#x2013;100)</td>
</tr>
<tr>
<td align="left" valign="top">Small animal</td>
<td align="center" valign="top">28, 25 (0&#x2013;100)</td>
<td align="center" valign="top">2, 0 (0&#x2013;30)</td>
</tr>
<tr>
<td align="left" valign="top">Equine</td>
<td align="center" valign="top">5, 0 (0&#x2013;33)</td>
<td align="center" valign="top">9, 0 (0&#x2013;70)</td>
</tr>
<tr>
<td align="left" valign="top">Other</td>
<td align="center" valign="top">13, 0 (0&#x2013;100)</td>
<td align="center" valign="top">19, 0 (0&#x2013;100)</td>
</tr>
<tr>
<td align="left" valign="top" colspan="3">
<bold>Working hours</bold>
<xref rid="tfn2" ref-type="table-fn"><sup>b</sup></xref><bold>(h/week)</bold>
</td>
</tr>
<tr>
<td align="left" valign="top">Full-time working participants</td>
<td align="center" valign="top">47, 47 (36&#x2013;71), <italic>n</italic> =&#x2009;14</td>
<td align="center" valign="top">42, 40 (40&#x2013;50), <italic>n</italic> =&#x2009;13</td>
</tr>
<tr>
<td align="left" valign="top">Part-time working participants</td>
<td align="center" valign="top">29, 32 (5&#x2013;40), <italic>n</italic> =&#x2009;9<break/>(1 missing)</td>
<td align="center" valign="top">32, 32 (30&#x2013;35), <italic>n</italic> =&#x2009;8</td>
</tr>
<tr>
<td align="left" valign="top">HHPM farm visits<xref rid="tfn3" ref-type="table-fn"><sup>c</sup></xref> (no/month)</td>
<td align="center" valign="top">10, 6 (1&#x2013;30)</td>
<td align="center" valign="top">9, 5 (0&#x2013;40)</td>
</tr>
<tr>
<td align="left" valign="top">Previously participated in communication training<xref rid="tfn1" ref-type="table-fn"><sup>a</sup></xref></td>
<td align="center" valign="top">7 (29)</td>
<td align="center" valign="top">14 (67)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="tfn1">
<label>a</label>
<p>Values are no. (%). Percentages are based on total number of 24 (Finland) and 21 (Sweden) participating veterinarians. Percentages may not add up to 100% due to rounding.</p>
</fn>
<fn id="tfn2">
<label>b</label>
<p>Values are mean, median (minimum&#x2013;maximum).</p>
</fn>
<fn id="tfn3">
<label>c</label>
<p>Herd health and production management.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>Seven (29%) Finnish and 14 (67%) Swedish participants received some form of veterinary communication training before participating in the study. Their experiences ranged from a few hours to multiple (multi-day) courses. Participant&#x2019;s mean scores, stratified by previous communication skills training experience, are in <xref rid="tab3" ref-type="table">Table 3</xref>.</p>
<table-wrap position="float" id="tab3">
<label>Table 3</label>
<caption>
<p>Average Veterinary DialogueTrainer scores of participants on parameters that were the foundation of veterinary communication training; &#x201C;Clarifying needs,&#x201D; &#x201C;Relationship building,&#x201D; and &#x201C;Showing added value.&#x201D;</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th colspan="2" rowspan="2"></th>
<th align="center" valign="top" colspan="4">Finland (<italic>n</italic>&#x2009;=&#x2009;24)</th>
<th align="center" valign="top" colspan="4">Sweden (<italic>n</italic>&#x2009;=&#x2009;21)</th>
</tr>
<tr>
<th align="center" valign="top">Clarifying needs</th>
<th align="center" valign="top">Relationship building</th>
<th align="center" valign="top">Showing added value</th>
<th align="center" valign="top">Total score</th>
<th align="center" valign="top">Clarifying needs</th>
<th align="center" valign="top">Relationship building</th>
<th align="center" valign="top">Showing added value</th>
<th align="center" valign="top">Total score</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top" rowspan="3">Did not previously receive communication skills training</td>
<td align="center" valign="top">1st</td>
<td align="char" valign="top" char="(">18 (7)</td>
<td align="char" valign="top" char="(">11 (7)</td>
<td align="char" valign="top" char="(">2 (6)</td>
<td align="char" valign="top" char="(">10 (7)</td>
<td align="char" valign="top" char="(">52 (35)</td>
<td align="char" valign="top" char="(">50 (37)</td>
<td align="char" valign="top" char="(">35 (47)</td>
<td align="char" valign="top" char="(">46 (39)</td>
</tr>
<tr>
<td align="center" valign="top">2nd</td>
<td align="char" valign="top" char="(">46 (31)</td>
<td align="char" valign="top" char="(">44 (32)</td>
<td align="char" valign="top" char="(">12 (14)</td>
<td align="char" valign="top" char="(">34 (26)</td>
<td align="char" valign="top" char="(">41 (31)</td>
<td align="char" valign="top" char="(">40 (32)</td>
<td align="char" valign="top" char="(">10 (12)</td>
<td align="char" valign="top" char="(">30 (24)</td>
</tr>
<tr>
<td align="center" valign="top">best</td>
<td align="char" valign="top" char="(">69 (39)</td>
<td align="char" valign="top" char="(">66 (40)</td>
<td align="char" valign="top" char="(">62 (49)</td>
<td align="char" valign="top" char="(">66 (43)</td>
<td align="char" valign="top" char="(">91 (10)</td>
<td align="char" valign="top" char="(">88 (13)</td>
<td align="char" valign="top" char="(">80 (40)</td>
<td align="char" valign="top" char="(">86 (20)</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="3">Did previously receive communication skills training</td>
<td align="center" valign="top">1st</td>
<td align="char" valign="top" char="(">14 (5)</td>
<td align="char" valign="top" char="(">10 (8)</td>
<td align="char" valign="top" char="(">0 (0)</td>
<td align="char" valign="top" char="(">8 (4)</td>
<td align="char" valign="top" char="(">53 (21)</td>
<td align="char" valign="top" char="(">57 (19)</td>
<td align="char" valign="top" char="(">22 (16)</td>
<td align="char" valign="top" char="(">44 (17)</td>
</tr>
<tr>
<td align="center" valign="top">2nd</td>
<td align="char" valign="top" char="(">52 (38)</td>
<td align="char" valign="top" char="(">53 (37)</td>
<td align="char" valign="top" char="(">30 (48)</td>
<td align="char" valign="top" char="(">45 (40)</td>
<td align="char" valign="top" char="(">61 (30)</td>
<td align="char" valign="top" char="(">68 (27)</td>
<td align="char" valign="top" char="(">27 (28)</td>
<td align="char" valign="top" char="(">52 (27)</td>
</tr>
<tr>
<td align="center" valign="top">best</td>
<td align="char" valign="top" char="(">89 (17)</td>
<td align="char" valign="top" char="(">88 (17)</td>
<td align="char" valign="top" char="(">70 (38)</td>
<td align="char" valign="top" char="(">82 (26)</td>
<td align="char" valign="top" char="(">87 (20)</td>
<td align="char" valign="top" char="(">91 (9)</td>
<td align="char" valign="top" char="(">78 (35)</td>
<td align="char" valign="top" char="(">85 (21)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>Stratified by previous experience with communication skills training. Finnish participants reached their best total score in on average 3.5 (SD&#x2009;&#x00B1;&#x2009;2.1) times. Swedish participants reached their best total score in on average 3.1 (SD&#x2009;&#x00B1;&#x2009;1.1) times. Mean score for first attempt, second and best attempts in % (&#x00B1;SD).</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="sec13">
<label>3.2.</label>
<title>Number of attempts</title>
<p>The range of attempts varied greatly, with 2 veterinarians playing the simulated conversation 11 times (<xref rid="tab4" ref-type="table">Table 4</xref>). Most participants reached a total score&#x2009;&#x003E;80% and 7 (Finland) and 8 (Sweden) players reached a 100% score. Most players stopped playing the simulation after obtaining their high score. However, 15 participants (6 Finnish, 9 Swedish) continued playing for on average 2 additional attempts (SD&#x2009;&#x00B1;&#x2009;1.3) after obtaining the maximum score.</p>
<table-wrap position="float" id="tab4">
<label>Table 4</label>
<caption>
<p>Attempted plays of the VDT simulation.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th align="center" valign="top">Finland, <italic>n</italic>&#x2009;=&#x2009;24</th>
<th align="center" valign="top">Sweden, <italic>n</italic>&#x2009;=&#x2009;21</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Mean number per player</td>
<td align="center" valign="top">4.1 (2.7)</td>
<td align="center" valign="top">3.9 (1.3)</td>
</tr>
<tr>
<td align="left" valign="top">Reaching a total score&#x2009;&#x003E;80%</td>
<td align="center" valign="top">4.0 (1.6), <italic>n</italic> =&#x2009;17</td>
<td align="center" valign="top">2.8 (1.0), <italic>n</italic> =&#x2009;16</td>
</tr>
<tr>
<td align="left" valign="top">Reaching score 100%</td>
<td align="center" valign="top">5.3 (1.8), <italic>n</italic> =&#x2009;7</td>
<td align="center" valign="top">3.4 (0.5), <italic>n</italic> =&#x2009;8</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>Number of attempts (&#x00B1;SD).</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="sec14">
<label>3.3.</label>
<title>Obtained scores</title>
<p>At the first attempt of playing the scenario 39 (87%) participants had a total score&#x2009;&#x003C;50%, most (<italic>n</italic>&#x2009;=&#x2009;34) increased their initial score at the second time playing the simulation. Almost all (<italic>n</italic>&#x2009;=&#x2009;41, 91%) participants increased their scores after playing multiple times; the others achieved their highest score at the first attempt and thereafter did not get a higher score.</p>
<p>Mean scores for the Finnish participants between the first and the second attempt increased on &#x201C;Clarifying needs,&#x201D; &#x201C;Relationship Building,&#x201D; &#x201C;Showing added value,&#x201D; and total score (<xref rid="fig4" ref-type="fig">Figure 4A</xref>; <italic>p</italic>&#x2009;&#x003C;&#x2009;0.05). However, scores of Swedish participants did not increase between first and second attempts (<xref rid="fig4" ref-type="fig">Figure 4B</xref>). For both Finnish and Swedish participants, mean scores on all parameters increased between the first and the best attempt, with participants reaching a total high score after playing the simulation on average 3.3 (SD&#x2009;&#x00B1;&#x2009;1.7) times.</p>
<fig position="float" id="fig4">
<label>Figure 4</label>
<caption>
<p><bold>(A)</bold> Average scores (%) of participants&#x2019; first, second, and best attempts on the simulation for communication skills parameters. Finnish participants reached their best total score in on average 3.5 (SD&#x2009;&#x00B1;&#x2009;2.1) times. Finnish participants, <italic>N</italic>&#x2009;=&#x2009;24. <bold>(B)</bold> Average scores (%) of participants&#x2019; first, second, and best attempts on the simulation for communication skills parameters. Swedish participants reached their best total score in on average 3.1 (SD&#x2009;&#x00B1;&#x2009;1.1) times. Swedish participants, <italic>N</italic>&#x2009;=&#x2009;21.</p>
</caption>
<graphic xlink:href="fvets-10-1192598-g004.tif"/>
</fig>
</sec>
<sec id="sec15">
<label>3.4.</label>
<title>User feedback</title>
<p>The NPS question was answered by 35 Finnish training participants on training Day 1, the NPS for the first day was +89 (four times an 8, 10 times a 9, and 21 times a 10). The second day the question was answered by 32 participants and received a score of +88 (one 7, 3 times 8, 11 times a 9, and 17 times a 10). Twelve Swedish participants answered the question, the NPS was +83 (2 times an 8, 4 times a 9, and 6 times a 10).</p>
</sec>
</sec>
<sec id="sec16" sec-type="discussions">
<label>4.</label>
<title>Discussion</title>
<p>This study aimed to: introduce and evaluate the use of the Veterinary DialogueTrainer in post graduate communication training; determine whether the VDT improved virtually assessed communication skills scores; and report on the willingness of participants to recommend this online role-playing tool to other veterinarians.</p>
<p>Compared to the 2018 report of the Federation of Veterinarians of Europe (<xref ref-type="bibr" rid="ref37">37</xref>) in which Finland and Sweden had a female veterinary population of 89 and 82%, respectively, the gender distribution of participating veterinarians was skewed more toward women (96 and 81%). Participating food animal veterinary practitioners from Finland were of similar age [in Norring et al. (<xref ref-type="bibr" rid="ref38">38</xref>) mean age was 42&#x2009;&#x00B1;&#x2009;10 y, data not available for Sweden] and practice experience was similar for both Finnish and Swedish participants [(<xref ref-type="bibr" rid="ref38">38</xref>), 14&#x2009;&#x00B1;&#x2009;10 y; in Reijula (<xref ref-type="bibr" rid="ref39">39</xref>) 39.1% had &#x003E;15 y experience]. Workload (excluding on-call shifts) in our study was slightly less (39.7&#x2009;h/week) than reported by Reijula et al. (<xref ref-type="bibr" rid="ref39">39</xref>) who mentioned 41.7&#x2009;h/week for women and 44.1&#x2009;h/week for men. However, when stratified into whether participants work on a full-or part-time, participants worked ~45 or 30&#x2009;h/wk., respectively.</p>
<p>There was no apparent difference between scores of participants who had or had not previously received communication skills training. Due to a lack of standardization in previous training experiences, it was not possible to comment on effectiveness of that training. It was noteworthy that Finnish participants who previously received communication skills training increased their scores to a greater extent compared to those who had not.</p>
<p>In this study the VDT is used as part of a group training to facilitate a blended learning experience. An advantage of it being part of a training is debriefing and reflection with facilitators and fellow participants after engaging with the simulation. This way, the learning experience is deepened, and retention might be improved. In a different setting the VDT can also be used as an individual stand-alone e-learning. When individually playing the simulation, the participants receive feedback on their scores and can learn from mistakes by playing multiple times. The use of the tool in different settings is currently subject of further study.</p>
<p>Most participants scored &#x003C;50% at the first attempt playing the Veterinary DialogueTrainer simulation, and all were able to improve their score. This indicates that choosing the best practice answers in the simulations, leading to a 100% score, was difficult for most participants on their first attempt. The results also indicate that participants were able to choose more effective options to communicate with the avatar leading to increase of scores.</p>
<p>We choose 50% for this manuscript as it is widely understood as pass/fail in assessments. Whether this is an adequate interpretation of the scores that participants get for playing the simulations, is subject to further study.</p>
<p>This study was the first exploration whether the tool was not too easy, e.g., most of the participants scoring very high on the first try of the simulation, not too hard, e.g., participants were able to obtain the high score, and whether participants were able to improve their scores from baseline. Additionally, this is a first exploration of participants&#x2019; skill level in determining what the best communication practice in a simulation might be and whether that level seems to increase with training. What score or what increase in score is &#x201C;enough,&#x201D; and how that translates to real life consultations is subject to further study.</p>
<p>Scores on various parameters of the communication simulation increased from the first attempt to the second for the Finnish veterinarians, whereas scores increased from the first attempt to the best for both Finnish and Swedish veterinarians. There was an apparent difference between Finnish and Swedish veterinarians, as the latter had higher scores for both first attempt and for best scores. That veterinary communication is widely studied in Sweden (<xref ref-type="bibr" rid="ref19">19</xref>, <xref ref-type="bibr" rid="ref40">40</xref>) may have enhanced understanding of veterinary communication skills in Swedish veterinarians. Additionally, selection bias may have occurred due to language of training being English. The participants typically communicate with their clients in the client&#x2019;s local language, i.e., Finnish, Swedish and/or Estonian. Simulations included in the tool can be translated to any language. This might improve the usefulness and adoption of the tool as a possible language barrier is diminished. Participants generally had good functional English and voluntarily joined the training, which may have influenced their performance. Cultural differences may also have influenced willingness to participate and perform. More research is needed to study the effect of the language of the tool on the participation and the performance.</p>
<p>Interestingly, participants scored lower on the parameter &#x201C;Showing added value&#x201D; than on &#x201C;Clarifying needs,&#x201D; and &#x201C;Relationship building.&#x201D; This might be a result of the flow of the scenario, where opportunities to score on this parameter occur later in the simulation than the other two. If the player &#x201C;upset&#x201D; the virtual farmer and the conversation was terminated prematurely by the avatar, this decreased opportunities to score on &#x201C;Showing added value.&#x201D;</p>
<p>Additionally, that participants played the simulation multiple times, even after having obtained their highest score, demonstrated they were motivated to engage with the tool and that a barrier to engage in role-play may have been lifted (<xref ref-type="bibr" rid="ref25">25</xref>). This sentiment was supported by the Net Promoter Score scores of +89, +88 (Finland) and&#x2009;+83 (Sweden) indicating participants were likely to recommend this training to other veterinarians.</p>
<p>Based on current results, the Veterinary DialogueTrainer could satisfy the learning conditions stated by Ericsson&#x2019;s model on expert performance (<xref ref-type="bibr" rid="ref41">41</xref>). This model articulates that deliberate practice in specified learning circumstances is the only way to achieve expert levels of performance. Learning conditions that should be met are &#x201C;(a) performing learning tasks with well-defined goals; (b) motivated to improve; (c) learning tasks of short duration with opportunities of immediate feedback, reflection and corrections; and (d) ample opportunities for repetition, gradual refinements and practice in challenging situations (<xref ref-type="bibr" rid="ref41">41</xref>).&#x201D; After restricted training, i.e., training where these conditions are not met, an individuals&#x2019; performance merely adapts to typical situational demands on a satisfactory level; more experience will therefore not result in improved behavior and expert performance. The VDT could have an important role in beforementioned deliberate practice and meeting learning conditions. VDT simulations can be designed for specific and clearly defined learning objectives (Condition a). In addition, Condition b can be met, demonstrated by players playing multiple times and continuing to play after having reached their high scores. This provides learners with an opportunity of repeated practice of short learning tasks, while directly receiving feedback and providing a chance for reflection and correction (condition c). Additionally, as it is an online tool that can contain multiple scenarios of ascending difficulty, it offers the possibility of repeated learning experiences and practice of challenging situations (condition d).</p>
<p>Some veterinary work (<xref ref-type="bibr" rid="ref40">40</xref>, <xref ref-type="bibr" rid="ref42">42</xref>) demonstrated that after a short communication training of 4&#x2013;5&#x2009;h in the UK or a 6-month training program in Sweden in motivational interviewing (a communication methodology where practitioners are trained to evoke motivation of their clients for a specific behavioral change), even though communication competencies generally improved, only 21 and 6% of participants, respectively, were able to reach &#x201C;fair competency&#x201D; for these skills, emphasizing the importance of deliberate practice over prolonged time to master a skill. The VDT could have a role in deliberately practicing communication skills as simulations are continuously available.</p>
<p>As training is increasingly being offered online, an advantage of the VDT is that it provides the veterinary field a scenario building tool capable to build simulations for a vast variety of settings. The VDT is not only suitable to simulate conversations between vets and their clients but allows simulations of all types of conversations, as a wide range of avatars, backgrounds, and emotions is available. Once a simulation is built, it can easily be translated into any language, making it easily scalable for larger and diverse audiences.</p>
<p>Communication between veterinarian and client exists of verbal and non-verbal transfer of messages. In the VDT, participants are limited to communication through pre-determined written answers. Even though choosing between answers might increase the participant&#x2019;s understanding of ways to respond in certain situations and therefore adds to the learning experience, these pre-determined answers also limit the response options. So, a gap is present between the tool and real-life conversations, in which a person can use a variety of answers, tone of voice, facial expression etc. in their communication. Work is ongoing to narrow this gap. For example, since delivering the training, the VDT has been developed further to enable open text responses of participants, e.g., typing or audio recording their response.</p>
<p>Whether increased communication scores measured by the VDT translate into increased communication skills in veterinary practice requires further study. Nevertheless, in a systematic review by Boyle et al. (<xref ref-type="bibr" rid="ref43">43</xref>), studies examining serious games that focused on knowledge or skills acquisition, playing such games increased performance compared to control groups. Furthermore, Sch&#x00F6;nbrodt et al. (<xref ref-type="bibr" rid="ref44">44</xref>) demonstrated connections between behaviors toward a virtual spouse in a computer-generated world and intimacy motives and satisfaction with real-world relationships, implying some transmission occurred between real and virtual worlds. Communication skills scores as measured by the VDT increased on the levels of clarifying needs, relationship building, showing added value, and the total score. Research currently underway will explore whether communication scores in VDT are linked to real world behavior by participating veterinarians, providing an exciting opportunity to add virtual role-play to the toolbox of veterinary clinical communication educators.</p>
<p>After playing a scenario, the participant receives specific feedback for each node in the simulated conversation. This feedback is highly useful in both &#x201C;well-played&#x201D; and &#x201C;poorly played&#x201D; simulations (i.e., for high and for low scores), as it provides advice on what to do and what to avoid in the specific context of the scenario. Therefore, players of the simulations are encouraged to aspire to get both a 100% score and a low score, e.g., by making the farmer &#x201C;angry,&#x201D; to deepen their learning in both situations. However, this results in the situation that no assumptions can be made about participants&#x2019; motivations in playing when they have a low score, i.e., are they actively trying to obtain a poor score for the feedback or for fun or were they unable to get a high score. Therefore, no conclusions can be made on whether 0% scores were deliberate, i.e., to &#x201C;upset&#x201D; the virtual farmer to learn from the feedback, or not. In the future, this challenge could easily be mitigated by instructing players to aim for improving their scores up to a high score first, before deliberately &#x201C;upsetting&#x201D; the virtual farmer.</p>
</sec>
<sec id="sec17" sec-type="conclusions">
<label>5.</label>
<title>Conclusion</title>
<p>This study demonstrated the VDT to be a promising tool for use in veterinary communication training. Participants appreciated the learning experience and increased their scores in multiple attempts. Irrespective of challenges faced, we predict a clear benefit of using the VDT in teaching veterinary communication competencies.</p>
</sec>
<sec id="sec18" sec-type="data-availability">
<title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="sec19">
<title>Ethics statement</title>
<p>The studies involving human participants were reviewed and approved by University of Calgary&#x2019;s Research Ethics board. The patients/participants provided their written informed consent to participate in this study.</p>
</sec>
<sec id="sec20">
<title>Author contributions</title>
<p>LD, CR, and HB conceived of the presented idea. JJ and GV organized and facilitated the training and data collection and were in charge of planning. LD and JJ collected the data. TP supported LD in extracting the data from the VDT platform. LD processed the data, performed the analysis, drafted the manuscript, and designed the figures. CR and HB aided in interpreting the results and supervised the project. LD, JJ, and TP wrote the manuscript with input from all other authors. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec sec-type="funding-information" id="sec21">
<title>Funding</title>
<p>This study was supported by the Industrial Research Chair in Infectious Diseases of Dairy Cattle, funded by Canada&#x2019;s Natural Sciences and Engineering Research Council (NSERC) Industrial Research Chair Program (Ottawa, ON, Canada), with industry contributions from Alberta Milk (Edmonton, AB, Canada), the Dairy Farmers of Canada (Ottawa, ON, Canada), Westgen Endowment Fund (Milner, BC, Canada), the BC Dairy Association (Burnaby, BC, Canada), Canadian Dairy Network (Guelph, ON, Canada), CanWest DHI (Guelph, ON, Canada), SaskMilk (Regina, SK, Canada), Dairy Farmers of Manitoba (Winnipeg, MB, Canada), and MSD Animal Health (Kirkland, QC, Canada).</p>
</sec>
<sec sec-type="COI-statement" id="sec22">
<title>Conflict of interest</title>
<p>St. Anna Advies B.V. (<ext-link xlink:href="http://www.anna-advies.com" ext-link-type="uri">www.anna-advies.com</ext-link>, Beuningen, The Netherlands) holds a license to use the DialogueTrainer platform in a veterinary setting and developed the simulations used in this study. Employees of St. Anna Advies had no input on the study design or which results are presented in this manuscript. GV is an employee of MSD Animal Health. He had no input on the study design nor which results were presented in this manuscript.</p>
<p>The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="sec100" sec-type="disclaimer">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<ack>
<p>The authors acknowledge Sanna Nikunen and Lisa Ekman for their support in the data collection. The authors thank John P. Kastelic (University of Calgary, AB, Canada) for editing the manuscript.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="ref1"><label>1.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cipolla</surname><given-names>M</given-names></name> <name><surname>Zecconi</surname><given-names>A</given-names></name></person-group>. <article-title>Short communication: study on veterinarian communication skills preferred and perceived by dairy farmers</article-title>. <source>Res Vet Sci</source>. (<year>2015</year>) <volume>99</volume>:<fpage>60</fpage>&#x2013;<lpage>2</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.rvsc.2015.02.004</pub-id>, PMID: <pub-id pub-id-type="pmid">25744431</pub-id></citation></ref>
<ref id="ref2"><label>2.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Relun</surname><given-names>A</given-names></name> <name><surname>Guatteo</surname><given-names>R</given-names></name> <name><surname>Auzanneau</surname><given-names>MM</given-names></name> <name><surname>Bareille</surname><given-names>N</given-names></name></person-group>. <article-title>Farmers&#x2019; practices, motivators and barriers for adoption of treatments of digital dermatitis in dairy farms</article-title>. <source>Animal</source>. (<year>2013</year>) <volume>7</volume>:<fpage>1542</fpage>&#x2013;<lpage>50</lpage>. doi: <pub-id pub-id-type="doi">10.1017/s1751731113000803</pub-id>, PMID: <pub-id pub-id-type="pmid">23632105</pub-id></citation></ref>
<ref id="ref3"><label>3.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lam</surname><given-names>TJGM</given-names></name> <name><surname>Jansen</surname><given-names>J</given-names></name> <name><surname>van den Borne</surname><given-names>BHP</given-names></name> <name><surname>Renes</surname><given-names>RJ</given-names></name> <name><surname>Hogeveen</surname><given-names>H</given-names></name></person-group>. <article-title>What veterinarians need to know about communication to optimise their role as advisors on udder health in dairy herds</article-title>. <source>N Z Vet J</source>. (<year>2011</year>) <volume>59</volume>:<fpage>8</fpage>&#x2013;<lpage>15</lpage>. doi: <pub-id pub-id-type="doi">10.1080/00480169.2011.547163</pub-id></citation></ref>
<ref id="ref4"><label>4.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>da Silva</surname><given-names>JC</given-names></name> <name><surname>Noordhuizen</surname><given-names>JPTM</given-names></name> <name><surname>Noordhuizen</surname><given-names>JPTM</given-names></name> <name><surname>Vagneur</surname><given-names>M</given-names></name> <name><surname>Bexiga</surname><given-names>R</given-names></name> <name><surname>Gelfert</surname><given-names>CC</given-names></name> <etal/></person-group>. <article-title>Veterinary dairy herd health management in Europe constraints and perspectives</article-title>. <source>Vet Q</source>. (<year>2006</year>) <volume>28</volume>:<fpage>23</fpage>&#x2013;<lpage>32</lpage>. doi: <pub-id pub-id-type="doi">10.1080/01652176.2006.9695203</pub-id>, PMID: <pub-id pub-id-type="pmid">16605158</pub-id></citation></ref>
<ref id="ref5"><label>5.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>LeBlanc</surname><given-names>SJ</given-names></name> <name><surname>Lissemore</surname><given-names>KD</given-names></name> <name><surname>Kelton</surname><given-names>DF</given-names></name> <name><surname>Duffield</surname><given-names>TF</given-names></name> <name><surname>Leslie</surname><given-names>KE</given-names></name></person-group>. <article-title>Major advances in disease prevention in dairy cattle</article-title>. <source>J Dairy Sci</source>. (<year>2006</year>) <volume>89</volume>:<fpage>1267</fpage>&#x2013;<lpage>79</lpage>. doi: <pub-id pub-id-type="doi">10.3168/jds.S0022-0302(06)72195-6</pub-id></citation></ref>
<ref id="ref6"><label>6.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mee</surname><given-names>JF</given-names></name></person-group>. <article-title>The role of the veterinarian in bovine fertility management on modern dairy farms</article-title>. <source>Theriogenology</source>. (<year>2007</year>) <volume>68</volume>:<fpage>S257</fpage>&#x2013;<lpage>65</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.theriogenology.2007.04.030</pub-id>, PMID: <pub-id pub-id-type="pmid">17498793</pub-id></citation></ref>
<ref id="ref7"><label>7.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Croyle</surname><given-names>SL</given-names></name> <name><surname>Belage</surname><given-names>E</given-names></name> <name><surname>Khosa</surname><given-names>DK</given-names></name> <name><surname>LeBlanc</surname><given-names>SJ</given-names></name> <name><surname>Haley</surname><given-names>DB</given-names></name> <name><surname>Kelton</surname><given-names>DF</given-names></name></person-group>. <article-title>Dairy farmers&#x2019; expectations and receptivity regarding animal welfare advice: a focus group study</article-title>. <source>J Dairy Sci</source>. (<year>2019</year>) <volume>102</volume>:<fpage>7385</fpage>&#x2013;<lpage>97</lpage>. doi: <pub-id pub-id-type="doi">10.3168/jds.2018-15821</pub-id>, PMID: <pub-id pub-id-type="pmid">31202646</pub-id></citation></ref>
<ref id="ref8"><label>8.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Derks</surname><given-names>M</given-names></name> <name><surname>van de Ven</surname><given-names>LMA</given-names></name> <name><surname>van Werven</surname><given-names>T</given-names></name> <name><surname>Kremer</surname><given-names>WDJ</given-names></name> <name><surname>Hogeveen</surname><given-names>H</given-names></name></person-group>. <article-title>The perception of veterinary herd health management by Dutch dairy farmers and its current status in the Netherlands: a survey</article-title>. <source>Prev Vet Med</source>. (<year>2012</year>) <volume>104</volume>:<fpage>207</fpage>&#x2013;<lpage>15</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.prevetmed.2011.12.019</pub-id>, PMID: <pub-id pub-id-type="pmid">22284342</pub-id></citation></ref>
<ref id="ref9"><label>9.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hall</surname><given-names>J</given-names></name> <name><surname>Wapenaar</surname><given-names>W</given-names></name></person-group>. <article-title>Opinions and practices of veterinarians and dairy farmers towards herd health management in the UK</article-title>. <source>Vet Rec</source>. (<year>2012</year>) <volume>170</volume>:<fpage>441</fpage>. doi: <pub-id pub-id-type="doi">10.1136/vr.100318</pub-id>, PMID: <pub-id pub-id-type="pmid">22411767</pub-id></citation></ref>
<ref id="ref10"><label>10.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cake</surname><given-names>MA</given-names></name> <name><surname>Bell</surname><given-names>MA</given-names></name> <name><surname>Williams</surname><given-names>JC</given-names></name> <name><surname>Brown</surname><given-names>FJL</given-names></name> <name><surname>Dozier</surname><given-names>M</given-names></name> <name><surname>Rhind</surname><given-names>SM</given-names></name> <etal/></person-group>. <article-title>Which professional (non-technical) competencies are most important to the success of graduate veterinarians? A best evidence medical education (BEME) systematic review: BEME guide no. 38</article-title>. <source>Med Teach</source>. (<year>2016</year>) <volume>38</volume>:<fpage>550</fpage>&#x2013;<lpage>63</lpage>. doi: <pub-id pub-id-type="doi">10.3109/0142159X.2016.1173662</pub-id>, PMID: <pub-id pub-id-type="pmid">27145182</pub-id></citation></ref>
<ref id="ref11"><label>11.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kristensen</surname><given-names>E</given-names></name> <name><surname>Jakobsen</surname><given-names>EB</given-names></name></person-group>. <article-title>Challenging the myth of the irrational dairy farmer; understanding decision-making related to herd health</article-title>. <source>N Z Vet J</source>. (<year>2011</year>) <volume>59</volume>:<fpage>1</fpage>&#x2013;<lpage>7</lpage>. doi: <pub-id pub-id-type="doi">10.1080/00480169.2011.547162</pub-id>, PMID: <pub-id pub-id-type="pmid">21328151</pub-id></citation></ref>
<ref id="ref12"><label>12.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Adams</surname><given-names>CL</given-names></name> <name><surname>Kurtz</surname><given-names>S</given-names></name></person-group>. <source>Skills for communicating in veterinary medicine</source>. <edition>1st</edition> ed. <publisher-loc>NJ</publisher-loc>: <publisher-name>Otmoor Publishing Parsippany</publisher-name> (<year>2017</year>).</citation></ref>
<ref id="ref13"><label>13.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bard</surname><given-names>AM</given-names></name> <name><surname>Main</surname><given-names>D</given-names></name> <name><surname>Roe</surname><given-names>E</given-names></name> <name><surname>Haase</surname><given-names>A</given-names></name> <name><surname>Whay</surname><given-names>HR</given-names></name> <name><surname>Reyher</surname><given-names>KK</given-names></name></person-group>. <article-title>To change or not to change? Veterinarian and farmer perceptions of relational factors influencing the enactment of veterinary advice on dairy farms in the United Kingdom</article-title>. <source>J Dairy Sci</source>. (<year>2019</year>) <volume>102</volume>:<fpage>10379</fpage>&#x2013;<lpage>94</lpage>. doi: <pub-id pub-id-type="doi">10.3168/jds.2019-16364</pub-id></citation></ref>
<ref id="ref14"><label>14.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ritter</surname><given-names>C</given-names></name> <name><surname>Adams</surname><given-names>CL</given-names></name> <name><surname>Kelton</surname><given-names>DF</given-names></name> <name><surname>Barkema</surname><given-names>HW</given-names></name></person-group>. <article-title>Factors associated with dairy farmers&#x2019; satisfaction and preparedness to adopt recommendations after veterinary herd health visits</article-title>. <source>J Dairy Sci</source>. (<year>2019</year>) <volume>102</volume>:<fpage>4280</fpage>&#x2013;<lpage>93</lpage>. doi: <pub-id pub-id-type="doi">10.3168/jds.2018-15825</pub-id>, PMID: <pub-id pub-id-type="pmid">30852012</pub-id></citation></ref>
<ref id="ref15"><label>15.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pun</surname><given-names>JKH</given-names></name></person-group>. <article-title>An integrated review of the role of communication in veterinary clinical practice</article-title>. <source>BMC Vet Res</source>. (<year>2020</year>) <volume>16</volume>:<fpage>394</fpage>. doi: <pub-id pub-id-type="doi">10.1186/s12917-020-02558-2</pub-id>, PMID: <pub-id pub-id-type="pmid">33076917</pub-id></citation></ref>
<ref id="ref16"><label>16.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ritter</surname><given-names>C</given-names></name> <name><surname>Adams</surname><given-names>CL</given-names></name> <name><surname>Kelton</surname><given-names>DF</given-names></name> <name><surname>Barkema</surname><given-names>HW</given-names></name></person-group>. <article-title>Clinical communication patterns of veterinary practitioners during dairy herd health and production management farm visits</article-title>. <source>J Dairy Sci</source>. (<year>2018</year>) <volume>101</volume>:<fpage>10337</fpage>&#x2013;<lpage>50</lpage>. doi: <pub-id pub-id-type="doi">10.3168/jds.2018-14741</pub-id>, PMID: <pub-id pub-id-type="pmid">30172401</pub-id></citation></ref>
<ref id="ref17"><label>17.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Adams</surname><given-names>CL</given-names></name> <name><surname>Ladner</surname><given-names>L</given-names></name></person-group>. <article-title>Implementing a simulated client program: bridging the gap between theory and practice</article-title>. <source>J Vet Med Educ</source>. (<year>2004</year>) <volume>31</volume>:<fpage>138</fpage>&#x2013;<lpage>45</lpage>. doi: <pub-id pub-id-type="doi">10.3138/jvme.31.2.138</pub-id>, PMID: <pub-id pub-id-type="pmid">15181596</pub-id></citation></ref>
<ref id="ref18"><label>18.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moore</surname><given-names>DA</given-names></name> <name><surname>Sischo</surname><given-names>WM</given-names></name> <name><surname>Kurtz</surname><given-names>S</given-names></name> <name><surname>Siler</surname><given-names>JD</given-names></name> <name><surname>Pereira</surname><given-names>RV</given-names></name> <name><surname>Warnick</surname><given-names>LD</given-names></name> <etal/></person-group>. <article-title>Improving dairy organizational communication from the veterinarian&#x2019;s perspective: results of a continuing veterinary medical education pilot program</article-title>. <source>J Vet Med Educ</source>. (<year>2016</year>) <volume>43</volume>:<fpage>33</fpage>&#x2013;<lpage>40</lpage>. doi: <pub-id pub-id-type="doi">10.3138/jvme.0215-028R</pub-id>, PMID: <pub-id pub-id-type="pmid">26751909</pub-id></citation></ref>
<ref id="ref19"><label>19.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Svensson</surname><given-names>C</given-names></name> <name><surname>Emanuelson</surname><given-names>U</given-names></name> <name><surname>Bard</surname><given-names>AM</given-names></name> <name><surname>Forsberg</surname><given-names>L</given-names></name> <name><surname>Wickstr&#x00F6;m</surname><given-names>H</given-names></name> <name><surname>Reyher</surname><given-names>KK</given-names></name></person-group>. <article-title>Communication styles of Swedish veterinarians involved in dairy herd health management: a motivational interviewing perspective</article-title>. <source>J Dairy Sci</source>. (<year>2019</year>) <volume>102</volume>:<fpage>10173</fpage>&#x2013;<lpage>85</lpage>. doi: <pub-id pub-id-type="doi">10.3168/jds.2018-15731</pub-id>, PMID: <pub-id pub-id-type="pmid">31521349</pub-id></citation></ref>
<ref id="ref20"><label>20.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mossop</surname><given-names>L</given-names></name> <name><surname>Gray</surname><given-names>C</given-names></name> <name><surname>Blaxter</surname><given-names>A</given-names></name> <name><surname>Gardiner</surname><given-names>A</given-names></name> <name><surname>MacEachern</surname><given-names>K</given-names></name> <name><surname>Watson</surname><given-names>P</given-names></name> <etal/></person-group>. <article-title>Communication skills training: what the vet schools are doing</article-title>. <source>Vet Rec</source>. (<year>2015</year>) <volume>176</volume>:<fpage>114</fpage>&#x2013;<lpage>7</lpage>. doi: <pub-id pub-id-type="doi">10.1136/vr.h425</pub-id>, PMID: <pub-id pub-id-type="pmid">25634922</pub-id></citation></ref>
<ref id="ref21"><label>21.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shaw</surname><given-names>JR</given-names></name></person-group>. <article-title>Evaluation of communication skills training programs at north American veterinary medical training institutions</article-title>. <source>J Am Vet Med Assoc</source>. (<year>2019</year>) <volume>255</volume>:<fpage>722</fpage>&#x2013;<lpage>33</lpage>. doi: <pub-id pub-id-type="doi">10.2460/javma.255.6.722</pub-id>, PMID: <pub-id pub-id-type="pmid">31478810</pub-id></citation></ref>
<ref id="ref22"><label>22.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Kurtz</surname><given-names>SM</given-names></name></person-group> In: <person-group person-group-type="editor"><name><surname>Silverman</surname> <given-names>J</given-names></name> <name><surname>Draper</surname> <given-names>J</given-names></name></person-group>, editors. <source>Teaching and learning communication skills in medicine</source>. <publisher-loc>Oxford</publisher-loc>: <publisher-name>Radcliffe Publishing Ltd.</publisher-name> (<year>2005</year>)</citation></ref>
<ref id="ref23"><label>23.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Magrath</surname><given-names>C</given-names></name></person-group>. <article-title>A conceptual framework for facilitator training to expand communication-skills training among veterinary practitioners</article-title>. <source>J Vet Med Educ</source>. (<year>2006</year>) <volume>33</volume>:<fpage>108</fpage>&#x2013;<lpage>10</lpage>. doi: <pub-id pub-id-type="doi">10.3138/jvme.33.1.108</pub-id></citation></ref>
<ref id="ref24"><label>24.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McDermott</surname><given-names>MP</given-names></name> <name><surname>Cobb</surname><given-names>MA</given-names></name> <name><surname>Tischler</surname><given-names>VA</given-names></name> <name><surname>Robb&#x00E9;</surname><given-names>IJ</given-names></name> <name><surname>Dean</surname><given-names>RS</given-names></name></person-group>. <article-title>Evaluating veterinary practitioner perceptions of communication skills and training</article-title>. <source>Vet Rec</source>. (<year>2017</year>) <volume>180</volume>:<fpage>305</fpage>. doi: <pub-id pub-id-type="doi">10.1136/vr.103997</pub-id>, PMID: <pub-id pub-id-type="pmid">28275092</pub-id></citation></ref>
<ref id="ref25"><label>25.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lane</surname><given-names>C</given-names></name> <name><surname>Rollnick</surname><given-names>S</given-names></name></person-group>. <article-title>The use of simulated patients and role-play in communication skills training: a review of the literature to august 2005</article-title>. <source>Patient Educ Couns</source>. (<year>2007</year>) <volume>67</volume>:<fpage>13</fpage>&#x2013;<lpage>20</lpage>. doi: <pub-id pub-id-type="doi">10.1016/J.PEC.2007.02.011</pub-id>, PMID: <pub-id pub-id-type="pmid">17493780</pub-id></citation></ref>
<ref id="ref26"><label>26.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Othlinghaus-Wulhorst</surname><given-names>J</given-names></name> <name><surname>Hoppe</surname><given-names>HU</given-names></name></person-group>. <article-title>A technical and conceptual framework for serious role-playing games in the area of social skill training</article-title>. <source>Front Comput Sci</source>. (<year>2020</year>) <volume>2</volume>:<fpage>28</fpage>. doi: <pub-id pub-id-type="doi">10.3389/FCOMP.2020.00028</pub-id></citation></ref>
<ref id="ref27"><label>27.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sipiyaruk</surname><given-names>K</given-names></name> <name><surname>Gallagher</surname><given-names>JE</given-names></name> <name><surname>Hatzipanagos</surname><given-names>S</given-names></name> <name><surname>Reynolds</surname><given-names>PA</given-names></name></person-group>. <article-title>A rapid review of serious games: from healthcare education to dental education</article-title>. <source>Eur J Dent Educ</source>. (<year>2018</year>) <volume>22</volume>:<fpage>243</fpage>&#x2013;<lpage>57</lpage>. doi: <pub-id pub-id-type="doi">10.1111/eje.12338</pub-id>, PMID: <pub-id pub-id-type="pmid">29573165</pub-id></citation></ref>
<ref id="ref28"><label>28.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lala</surname><given-names>R</given-names></name> <name><surname>Jeuring</surname><given-names>J</given-names></name> <name><surname>van Dortmont</surname><given-names>J</given-names></name> <name><surname>van Geest</surname><given-names>M</given-names></name></person-group>. <article-title>Scenarios in virtual learning environments for one-to-one communication skills training</article-title>. <source>Int J Educ Technol High Educ</source>. (<year>2017</year>) <volume>14</volume>:<fpage>1</fpage>&#x2013;<lpage>15</lpage>. doi: <pub-id pub-id-type="doi">10.1186/S41239-017-0054-1/FIGURES/3</pub-id></citation></ref>
<ref id="ref29"><label>29.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Poulton</surname><given-names>T</given-names></name> <name><surname>Balasubramaniam</surname><given-names>C</given-names></name></person-group>. <article-title>Virtual patients: a year of change</article-title>. <source>Med Teach</source>. (<year>2011</year>) <volume>33</volume>:<fpage>933</fpage>&#x2013;<lpage>7</lpage>. doi: <pub-id pub-id-type="doi">10.3109/0142159X.2011.613501</pub-id></citation></ref>
<ref id="ref30"><label>30.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Artemiou</surname><given-names>E</given-names></name> <name><surname>Adams</surname><given-names>CL</given-names></name> <name><surname>Toews</surname><given-names>L</given-names></name> <name><surname>Violato</surname><given-names>C</given-names></name> <name><surname>Coe</surname><given-names>JB</given-names></name></person-group>. <article-title>Informing web-based communication curricula in veterinary education: a systematic review of web-based methods used for teaching and assessing clinical communication in medical education</article-title>. <source>J Vet Med Educ</source>. (<year>2014</year>) <volume>41</volume>:<fpage>44</fpage>&#x2013;<lpage>54</lpage>. doi: <pub-id pub-id-type="doi">10.3138/jvme.0913-126R</pub-id></citation></ref>
<ref id="ref31"><label>31.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jeuring</surname><given-names>J</given-names></name> <name><surname>Grosfeld</surname><given-names>F</given-names></name> <name><surname>Heeren</surname><given-names>B</given-names></name> <name><surname>Hulsbergen</surname><given-names>M</given-names></name> <name><surname>Ijntema</surname><given-names>R</given-names></name> <name><surname>Jonker</surname><given-names>V</given-names></name> <etal/></person-group>. <article-title>Communicate! &#x2014; a serious game for communication skills &#x2014;</article-title>. <source>Lecture Notes Comput Sci (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)</source>. (<year>2015</year>) <volume>9307</volume>:<fpage>513</fpage>&#x2013;<lpage>7</lpage>. doi: <pub-id pub-id-type="doi">10.1007/978-3-319-24258-3_49</pub-id></citation></ref>
<ref id="ref32"><label>32.</label><citation citation-type="other"><person-group person-group-type="author"><name><surname>Deci</surname><given-names>EL</given-names></name> <name><surname>Ryan</surname><given-names>RM</given-names></name></person-group>. <source>Intrinsic motivation and self-determination in human behavior (perspectives in social psychology)</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Springer</publisher-name>. (<year>1985</year>). <fpage>371</fpage> p.</citation></ref>
<ref id="ref33"><label>33.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Prochaska</surname><given-names>JO</given-names></name> <name><surname>DiClemente</surname><given-names>CC</given-names></name></person-group>. <article-title>Stages and processes of self-change of smoking: toward an integrative model of change</article-title>. <source>J Consult Clin Psychol</source>. (<year>1983</year>) <volume>51</volume>:<fpage>390</fpage>&#x2013;<lpage>5</lpage>. doi: <pub-id pub-id-type="doi">10.1037//0022-006X.51.3.390</pub-id></citation></ref>
<ref id="ref34"><label>34.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Miller</surname><given-names>WR</given-names></name> <name><surname>Rollnick</surname><given-names>S</given-names></name></person-group>. <source>Motivational interviewing: Helping people change</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Guilford press</publisher-name> (<year>2012</year>).</citation></ref>
<ref id="ref35"><label>35.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Overbeek</surname><given-names>T</given-names></name> <name><surname>Lala</surname><given-names>R</given-names></name> <name><surname>Jeuring</surname><given-names>J</given-names></name></person-group>. <article-title>Scenario smells: Signalling potential problems in dialogue scenarios in a serious game</article-title>. <source>Int J Serious Games</source>. (<year>2020</year>) <volume>7</volume>:<fpage>51</fpage>&#x2013;<lpage>73</lpage>. doi: <pub-id pub-id-type="doi">10.17083/IJSG.V7I4.364</pub-id></citation></ref>
<ref id="ref36"><label>36.</label><citation citation-type="other"><person-group person-group-type="author"><name><surname>Brooks</surname><given-names>LL</given-names></name> <name><surname>Owen</surname><given-names>R</given-names></name></person-group>. <source>Answering the ultimate question: How net promoter can transform your business</source>. <publisher-loc>Hoboken, NJ</publisher-loc>: <publisher-name>Jossey-Bass</publisher-name>. (<year>2009</year>). <fpage>304</fpage> p.</citation></ref>
<ref id="ref37"><label>37.</label><citation citation-type="other"><person-group person-group-type="author"><name><surname>Aldiss</surname><given-names>J.</given-names></name> <name><surname>Buhot</surname><given-names>C.</given-names></name> <name><surname>Carri&#x00E8;re</surname><given-names>B.</given-names></name> <name><surname>Fossing</surname><given-names>C.</given-names></name> <name><surname>F&#x00E4;rber</surname><given-names>H.</given-names></name> <name><surname>Glardon</surname><given-names>O.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>VetSurvey. Survey of the veterinary profession in Europe</article-title>. Available at: <ext-link xlink:href="https://fve.org/cms/wp-content/uploads/FVE_Survey_2018_WEB.pdf" ext-link-type="uri">https://fve.org/cms/wp-content/uploads/FVE_Survey_2018_WEB.pdf</ext-link>.</citation></ref>
<ref id="ref38"><label>38.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Norring</surname><given-names>M</given-names></name> <name><surname>Wikman</surname><given-names>I</given-names></name> <name><surname>Hokkanen</surname><given-names>A.-H.</given-names></name> <name><surname>Kujala</surname><given-names>MV</given-names></name> <name><surname>H&#x00E4;nninen</surname><given-names>L</given-names></name></person-group>. <article-title>Empathic veterinarians score cattle pain higher</article-title>. <source>Vet J</source>. (<year>2014</year>) <volume>200</volume>:<fpage>186</fpage>&#x2013;<lpage>190</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.tvjl.2014.02.005</pub-id></citation></ref>
<ref id="ref39"><label>39.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Reijula</surname><given-names>K</given-names></name> <name><surname>R&#x00E4;s&#x00E4;nen</surname><given-names>K</given-names></name> <name><surname>H&#x00E4;m&#x00E4;l&#x00E4;inen</surname><given-names>M</given-names></name> <name><surname>Juntunen</surname><given-names>K</given-names></name> <name><surname>Lindbohm</surname><given-names>ML</given-names></name> <name><surname>Taskinen</surname><given-names>H</given-names></name> <etal/></person-group>. <article-title>Work environment and occupational health of Finnish veterinarians</article-title>. <source>Am J Ind Med</source>. (<year>2003</year>) <volume>44</volume>:<fpage>46</fpage>&#x2013;<lpage>57</lpage>. doi: <pub-id pub-id-type="doi">10.1002/ajim.10228</pub-id>, PMID: <pub-id pub-id-type="pmid">12822135</pub-id></citation></ref>
<ref id="ref40"><label>40.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Svensson</surname><given-names>C</given-names></name> <name><surname>Wickstr&#x00F6;m</surname><given-names>H</given-names></name> <name><surname>Emanuelson</surname><given-names>U</given-names></name> <name><surname>Bard</surname><given-names>AM</given-names></name> <name><surname>Reyher</surname><given-names>KK</given-names></name> <name><surname>Forsberg</surname><given-names>L</given-names></name></person-group>. <article-title>Training in motivational interviewing improves cattle veterinarians&#x2019; communication skills for herd health management</article-title>. <source>Vet Rec</source>. (<year>2020</year>) <volume>187</volume>:<fpage>191</fpage>. doi: <pub-id pub-id-type="doi">10.1136/vr.105646</pub-id>, PMID: <pub-id pub-id-type="pmid">32303667</pub-id></citation></ref>
<ref id="ref41"><label>41.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Anders Ericsson</surname><given-names>K</given-names></name></person-group>. <article-title>Deliberate practice and Acquisition of Expert Performance: a general overview</article-title>. <source>Acad Emerg Med</source>. (<year>2008</year>) <volume>15</volume>:<fpage>988</fpage>&#x2013;<lpage>94</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1553-2712.2008.00227.x</pub-id>, PMID: <pub-id pub-id-type="pmid">18778378</pub-id></citation></ref>
<ref id="ref42"><label>42.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bard</surname><given-names>AM</given-names></name></person-group>. <source>Improving dairy cattle welfare: Examining motivational interviewing, veterinary communication and the herd health advisory paradigm</source>. <publisher-loc>Bristol</publisher-loc>: <publisher-name>University of Bristol</publisher-name> (<year>2018</year>).</citation></ref>
<ref id="ref43"><label>43.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Boyle</surname><given-names>EA</given-names></name> <name><surname>Hainey</surname><given-names>T</given-names></name> <name><surname>Connolly</surname><given-names>TM</given-names></name> <name><surname>Gray</surname><given-names>G</given-names></name> <name><surname>Earp</surname><given-names>J</given-names></name> <name><surname>Ott</surname><given-names>M</given-names></name> <etal/></person-group>. <article-title>An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games</article-title>. <source>Comput Educ</source>. (<year>2016</year>) <volume>94</volume>:<fpage>178</fpage>&#x2013;<lpage>92</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.compedu.2015.11.003</pub-id></citation></ref>
<ref id="ref44"><label>44.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sch&#x00F6;nbrodt</surname><given-names>FD</given-names></name> <name><surname>Asendorpf</surname><given-names>JB</given-names></name></person-group>. <article-title>Virtual social environments as a tool for psychological assessment: Dynamics of interaction with a virtual spouse</article-title>. <source>Psychol Assess</source>. (<year>2011</year>) <volume>23</volume>:<fpage>7</fpage>&#x2013;<lpage>17</lpage>. doi: <pub-id pub-id-type="doi">10.1037/a0021049</pub-id></citation></ref>
</ref-list>
<app-group id="appg1">
<app id="app1">
<title>Appendix 1. Questionnaire participants</title>
<p>1. What is your year of birth? ____.</p>
<p>2. What is your gender?</p>
<list list-type="bullet">
<list-item>
<p>Male.</p>
</list-item>
<list-item>
<p>Female.</p>
</list-item>
<list-item>
<p>Non-binary.</p>
</list-item>
<list-item>
<p>None of these applies to me. I prefer to identify as &#x2026;</p>
</list-item>
</list>
<p>3. What is the number of years you have been practicing as a veterinarian in veterinary clinical practice?</p>
<p>4. In which country do you work as a veterinarian?</p>
<p>5. What is your main type of work? Indicate the percentage of time you spend working in the following:</p>
<list list-type="bullet">
<list-item>
<p>% bovine.</p>
</list-item>
<list-item>
<p>% small animal.</p>
</list-item>
<list-item>
<p>% equine.</p>
</list-item>
<list-item>
<p>% other, please specify &#x2026;&#x2026;</p>
</list-item>
</list>
<p>6. How many herd health visits do you conduct on average each month?</p>
<p>7. What is your position in your veterinary clinic.</p>
<list list-type="bullet">
<list-item>
<p>Owner.</p>
</list-item>
<list-item>
<p>Associate.</p>
</list-item>
<list-item>
<p>Locum.</p>
</list-item>
<list-item>
<p>Other, please specify &#x2026;&#x2026;</p>
</list-item>
</list>
<p>8. Are you working full time or part time?</p>
<p>Part time, &#x2026; hours a week, a full-time week in your clinic being &#x2026; hours a week.</p>
<p>Full time, a full-time week in your clinic being &#x2026; hours a week.</p>
<p>9. How many veterinarians are working in your clinic?</p>
<p>&#x2026;full-time veterinarians, &#x2026; part-time veterinarians.</p>
<p>10. Did you participate in any communication training before? This may include training during your veterinary education as well as continuing communication training.</p>
<list list-type="bullet">
<list-item>
<p>Yes</p>
</list-item>
<list-item>
<p>No</p>
</list-item>
</list>
<p>If you answered yes, please describe the length and character of the communication training.</p>
</app>
</app-group>
</back>
</article>