<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychiatry</journal-id>
<journal-title>Frontiers in Psychiatry</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychiatry</abbrev-journal-title>
<issn pub-type="epub">1664-0640</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyt.2023.1199989</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychiatry</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>The TRAPD approach as a method for questionnaire translation</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Walde</surname>
<given-names>Peggy</given-names>
</name>
<xref rid="c001" ref-type="corresp"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/1690415/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>V&#x00F6;llm</surname>
<given-names>Birgit Angela</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/492968/overview"/>
</contrib>
</contrib-group>
<aff><institution>Clinic of Forensic Psychiatry, Rostock University Medical Center</institution>, <addr-line>Rostock</addr-line>, <country>Germany</country></aff>
<author-notes>
<fn id="fn0001" fn-type="edited-by">
<p>Edited by: Sarah Markham, King&#x2019;s College London, United Kingdom</p>
</fn>
<fn id="fn0002" fn-type="edited-by">
<p>Reviewed by: Uldis Ozolins, Western Sydney University, Australia; Brent Kelsen, National Taipei University, Taiwan</p>
</fn>
<corresp id="c001">&#x002A;Correspondence: Peggy Walde, <email>peggy.walde@med.uni-rostock.de</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>15</day>
<month>06</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>14</volume>
<elocation-id>1199989</elocation-id>
<history>
<date date-type="received">
<day>04</day>
<month>04</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>15</day>
<month>05</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2023 Walde and V&#x00F6;llm.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Walde and V&#x00F6;llm</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>Surveys and questionnaires are widely used in various areas of psychological and psychiatric research and practice. Many instruments have been used in several languages and across cultural contexts. A popular method of choice for their translation into another language involves translation and back-translation. Unfortunately, this method&#x2019;s ability to detect flaws in translation and necessities for cultural adaptation is limited. To address these shortcomings, the Translation, Review, Adjudication, Pretest, and Documentation (TRAPD) approach of questionnaire translation from cross-cultural survey design has been developed. In this approach, several translators with different professional backgrounds translate the questionnaire on their own first and then come together to discuss their versions. Since the translators&#x2019; expertise is required to vary (e.g., survey methodology experts, translation experts, expert knowledge in the questionnaire&#x2019;s topic) the team approach results in a high-quality translation as well as offering opportunities for cultural adaptation. This article illustrates the application of the TRAPD approach on the basis of the translation process of the Forensic Restrictiveness Questionnaire from English into German. Differences and advantages are discussed.</p>
</abstract>
<kwd-group>
<kwd>questionnaire translation</kwd>
<kwd>TRAPD approach</kwd>
<kwd>forensic mental health</kwd>
<kwd>forensic psychiatry</kwd>
<kwd>restrictiveness</kwd>
</kwd-group>
<counts>
<fig-count count="1"/>
<table-count count="2"/>
<equation-count count="0"/>
<ref-count count="27"/>
<page-count count="13"/>
<word-count count="13117"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Forensic Psychiatry</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec id="sec1" sec-type="intro">
<title>1. Introduction</title>
<p>Questionnaires are one of the most frequently used instruments in psychological research and the social sciences in general. They are, for example, used to explore medical symptoms, personality characteristics, attitudes, feelings and other modalities that are difficult to assess otherwise. In most cases, questionnaires are originally developed to explore a phenomenon in a certain country or culture. Subsequent translations often require a number of adaptations to meet the characteristics of the new context (<xref ref-type="bibr" rid="ref1">1</xref>).</p>
<p>The translation of a questionnaire is not just a translation of words. A questionnaire is intended to measure certain latent constructs that cannot be observed themselves. Therefore, the quality of the items determines if the construct is met and if the questionnaire is understood by the intended users. Both are crucial to generate valid results from which meaningful conclusions can be drawn. Mistakes in translation can add to misleading results and, in the worst case, wrong conclusions and decisions in research and practice. Therefore, linguistic characteristics (e.g., word order, sentence structure), cultural context (e.g., special connotations of single words, idioms) and knowledge about the population where the questionnaire is intended to be used (e.g., psychiatric patients, children, employees in a certain kind of company) have to be considered (<xref ref-type="bibr" rid="ref2">2</xref>). Furthermore, the way the questionnaire is translated depends on its intended use. For some purposes, e.g., diagnostic, it is important that the questions fit well into the targeted culture and language. There are several diagnoses in the DSM-V that include a paragraph regarding culture-related diagnostic issues that need to be considered or, if not, might lead to inappropriate diagnoses. One example is the diagnosis of schizophrenia. The authors state that &#x201C;Ideas that appear to be delusional in one culture (e.g., witchcraft) may be commonly held in another. In some cultures, visual or auditory hallucinations with a religious content, (e.g., hearing God&#x2019;s voice) are a normal part of religious experience&#x201D; [(<xref ref-type="bibr" rid="ref3">3</xref>), p. 103].</p>
<p>Another often-cited example is the question of a person&#x2019;s intelligence. What is or is not seen as part of intelligence varies across countries [e.g., (<xref ref-type="bibr" rid="ref4">4</xref>)]. These examples clearly demonstrate, that questionnaire adaptations might be necessary, depending on the instrument&#x2019;s purpose. If critical decisions are made based on the results of the questionnaire, more extensive adaptations can be useful and the translated instrument might differ from the source questionnaire to a larger extent (e.g., in psychiatric diagnostics or prognosis that informs decisions about release of offenders from detention). If the emphasis is more on cross-cultural comparability, it might be useful to limit adaptations to maintain the comparability of questions (<xref ref-type="bibr" rid="ref5">5</xref>). In her publication Behr (<xref ref-type="bibr" rid="ref6">6</xref>) points out five major challenges a professional translator is confronted with when translating a (psychological) questionnaire: Missing context in stand-alone items, missing knowledge about the construct measured, missing knowledge of intentions behind certain wording decisions, uncertainty about participants addressed (e.g., in adaptive testing, certain sets of items are limited to subgroups of participants, e.g., women or unemployed people), and uncertainties about leeway in standardizations (esp. when cross-cultural comparability between source and target language questionnaire is intended). All of these uncertainties can lead to invalid translations. With these thoughts in mind, one could ask if the translation through an experienced professional could be a better option. It is true that a person who is experienced with the questionnaire topic (e.g., a researcher, clinician, teacher etc.) and is fluent in the source language might be able to compensate the missing background knowledge of a professional translator. But compared with professional translators, these people will probably have issues with the linguistic nuances like lexis, connotations or sentence structure, that is not always obvious to (non-)native speakers without the corresponding linguistic background. Another field of expertise is the methodological knowledge about questionnaire design. Neither linguists nor specialists with language skills can be expected to have experience in questionnaire development and adaptation. Knowledge like that might, however, be relevant, e.g., in terms of translation of labels of Likert scales, comparable length and difficulty of items etc. In conclusion it would appear that it needs the expertise of at least three different professions to properly adapt a questionnaire. The need for different expertise is currently also mentioned by different questionnaire and survey guidelines [e.g., (<xref ref-type="bibr" rid="ref7">7</xref>, <xref ref-type="bibr" rid="ref8">8</xref>)].</p>
<p>The current methods used in questionnaire translation include various forms of forward and backward translation. Forward translation describes the simple translation from a source language into a target language. A forward translation without any further measures of quality assurance is prone to errors and should be avoided (<xref ref-type="bibr" rid="ref9">9</xref>). The most popular method to ensure translational quality of their questionnaire is backtranslation (<xref ref-type="bibr" rid="ref10">10</xref>), i.e., the translation of the questionnaire back into its original (source) language. The original text and the backtranslation are compared. If differences in original and backtranslated questionnaires occur, this is seen as an indication for translation shortcomings. The process of backtranslation is also mentioned in the current version of the International Test Commission&#x2019;s guidelines on translating and adapting tests (<xref ref-type="bibr" rid="ref7">7</xref>). However, these guidelines also mention several shortcomings of forward and backtranslation when used alone. A combination of multiple translation approaches is recommended to overcome these. It is also mentioned that the translational process shall consider linguistic, psychological, and cultural differences between source and target questionnaire. However, the ITC guidelines do not describe specific translation procedures, so that the precise steps to be taken to address these processes remain unclear. As described, backtranslation is currently a popular method of quality assurance. At the same time this method has been critically reviewed by some experts. Behr (<xref ref-type="bibr" rid="ref11">11</xref>) summarizes several shortcomings of backtranslation in her work. She mentions, e.g., that translational mistakes cannot be made during forward translation only but also during backtranslation. Furthermore, if backtranslation is used as part of a translation process, it might lead to translations that orient too closely on the source text. Difficulties can arise here in relation to necessary cultural adaptations which consequently lower the validity of the target questionnaire. Further issues can arise when forward and backward translators are not aware of the context or technical terms used in special fields of a questionnaire and therefore both use the wrong term. As example the author mentions a large cross-European survey in which the translators were asked to translate the English terms &#x2018;child care service&#x2019; and &#x201C;longterm care service&#x201D; into German. The author described the issues arising during the process as follows:</p>
<p>&#x201C;Care services&#x201D; was translated into German as &#x201C;Pflegedienste,&#x201D; which was returned as &#x201C;care services.&#x201D; Thus, for back translation evaluators at least, all seemed fine. However, while in English one general term for both services is appropriate, in German you will have to be more careful. Depending on how you translate the &#x2018;care&#x2019; bit, you may focus on caring for the ill and the elderly or you may focus more in general on attending to someone, regardless of ill health. The German term &#x201C;Pflegedienst&#x201D; for &#x201C;care services&#x201D; did not fit the questionnaire context since it is only used in the context of the ill and/or the elderly and is thus not fitting to general child care services&#x201D; [(<xref ref-type="bibr" rid="ref11">11</xref>), p. 580].</p>
<p>To overcome these shortcomings, several options exist. One alternative, also mentioned by the ITC, can be a forward translation by several independent translators and the reconciliation of their versions by a third, independent translator or expert (<xref ref-type="bibr" rid="ref7">7</xref>). It is not stated in more detail, how this reconciliation should be done, e.g., if the third translator should meet with the other translators to discuss their versions or should do the translation by themselves only, if reconciliation should be done by a single person or a team and which qualification(s) these people should have. Acquadro et al. (<xref ref-type="bibr" rid="ref12">12</xref>) describe various forms of synthesis of the several forward translations by the original translators, independent translators or (focus) groups with different people, some including, e.g., participants of the questionnaire&#x2019;s intended user group. Interestingly, almost every translation process reviewed by Acquadro et al. included a backtranslation after the synthesis and an additional review of the results. The synthesis is regularly done by translators, whereas, e.g., methodologists, health care professionals or other experts are often involved in the review process. These procedures involve many different people and therefore make the translation process very time consuming and expensive.</p>
<p>Therefore, the TRAPD approach has been suggested by Harkness (<xref ref-type="bibr" rid="ref13">13</xref>). Therein, TRAPD is an acronym for the steps of the translation process, specifically Translation, Review, Adjudication, Pretest, and Documentation (see <xref rid="fig1" ref-type="fig">Figure 1</xref>).</p>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption>
<p>TRAPD team translation model [(<xref ref-type="bibr" rid="ref13">13</xref>), p. 292].</p>
</caption>
<graphic xlink:href="fpsyt-14-1199989-g001.tif"/>
</fig>
<p>The TRAPD approach is meant to work with at least two translations from different translators. Ideally, each translator provides a draft translation of the whole questionnaire (parallel translation). If necessary, it is possible to let different translators translate different parts of an instrument, e.g., if the questionnaire is very extensive (split translation). In this case a certain amount of overlap is recommended (<xref ref-type="bibr" rid="ref13">13</xref>). According to the author, the translations should be done by professional translators with experience in the topic of the questionnaire. If, e.g., a psychological questionnaire is translated, a translator with prior experience in education or legal translation might not be an appropriate choice. If it is difficult to find an appropriate translator, e.g., when language and/or topic are very specific, it is reasonable to draw on proficient bilinguals. The translators create a translation independent from each other and note issues or questions that might arise during the process. In the next step the several drafts are taken into a review discussion. All translators are part of an extended review team, along with experts for questionnaire methodology. Organizations using the team approach also involve participants in the expert review who are familiar with the questionnaire&#x2019;s topic (<xref ref-type="bibr" rid="ref9">9</xref>). Within a review meeting, one of the participants functions as senior reviewer who moderates the discussion and, as that, takes care of organizational duties (e.g., sticking to the schedule). During the review the various translation options of the drafts are compared with each other which can foster discussion. First adaptations can be made at that stage. In addition, mistakes of a single translation can be detected easily. Harkness (<xref ref-type="bibr" rid="ref13">13</xref>) also states that contributions from several translators make it easier to deal with regional variances and individual preferences that might influence a translator&#x2019;s decision. The opportunity to think about the translation in advance and being aware of its challenges also makes discussions more effective (p. 293). Furthermore, queries that might have occurred during translation are considered in the discussions. The result of the review process should be a single version of the translated questionnaire synthesized from the various drafts. If questions arise during the review process that cannot be resolved by the reviewers or if reviewers cannot agree on a translation, these are documented and postponed to the Adjudication phase. Depending on, e.g., the length of the questionnaire, one or more adjudicators can be involved. An adjudicator should be familiar with the translation project, methods and the questionnaire topic but was not involved in the actual translation process so far. The adjudicator(s), along with the review moderator, decide about the reviewed version and further adaptations and if the questionnaire translation is ready for pretesting. If the pretest reveals further adaptation necessities or other shortcomings, these are sent to the adjudicator in order to resolve them. There are several points of this approach that can be adapted to the individual circumstances of a project. Such adaptations are pointed out in the method section. The following text describes the application of the TRAPD approach to the translation of a questionnaire for forensic mental health research. We will describe in detail the procedure of each of the single steps (translation, review, adjudication, pretest, documentation) and point out individual adaptations of the process for our specific research context.</p>
</sec>
<sec id="sec2" sec-type="methods">
<title>2. Method</title>
<sec id="sec3">
<title>2.1. Research design overview</title>
<p>The Forensic Restrictiveness Questionnaire [FRQ; (<xref ref-type="bibr" rid="ref14">14</xref>)] has been developed and validated in the United Kingdom, UK. The FRQ is a questionnaire for forensic mental health in-patients to describe their subjective experience of restrictions that result from their detention in a forensic hospital. Tomlin (<xref ref-type="bibr" rid="ref14">14</xref>) described the experience of restrictiveness as &#x201C;The extent to which phenomena created, maintained or augmented directly or indirectly by forensic psychiatric care are subjectively experienced by a resident as infringing negatively upon their autonomy, self or personhood&#x201D; (p. 253). Describing the experience of restrictiveness that way, the definition covers the experience of obvious restrictions (e.g., like locked doors, limited contact to people outside the hospital) as well as more subtle ones (e.g., limited privacy in double rooms, limited choice in daily routines and activities). The FRQ is a self-rating questionnaire with 10 questions regarding sociodemographic characteristics and 15 items (e.g., <italic>The restrictions on the ward make sense</italic>). Patients are asked to rate their agreement or disagreement for each of the 15 items on a 5-point Likert scale from 1 (strongly disagree) to 5 (strongly agree). The complete source questionnaire can be provided by the authors upon request. </p>
<sec id="sec4">
<title>2.1.1. Researcher description</title>
<p>The research team was composed of one female psychologist and PhD candidate student who worked as a researcher at the Clinic for Forensic Psychiatry at Rostock University Medical Center, Germany, and the female medical director of a Clinic of Forensic Psychiatry who was also holding a professorship in forensic psychiatry at Rostock University Medical Center. The medical director was one of the participants in the translation process and had been living and working Great Britain for almost two decades. The medical director&#x2019;s history allowed an extensive understanding of the language and culture of both countries and knowledge about the forensic mental health system in both countries.</p>
</sec>
<sec id="sec5">
<title>2.1.2. Participants</title>
<p>The translation into German took place in 2020. We used the team approach introduced by Harkness (<xref ref-type="bibr" rid="ref13">13</xref>). All of the four participating translators (3 females, 1 male) were born in Germany (one with a Turkish migrant background) and described German as their native language but lived or had been living and working/studying in the United Kigdom for between five and 19&#x2009;years. Therefore, all of them were considered to have sufficient knowledge of the British and German culture additional to their language skills. None of the persons were professionally trained translators. Two of them were psychiatrists with several years of occupational experience in general and forensic psychiatry in the United Kigdom and Germany. The other translators had a degree in Psychology and in Pharmacy. Therefore, the translators combined expertise in British and German culture, (forensic) psychiatry in both countries and methodological knowledge regarding questionnaire design. The fourth translator with the pharmaceutical background was seen as lay translator. We expected the missing psychological-psychiatric background to add to a more everyday oriented translation of the questionnaire that is easier to understand for patients.</p>
<p>Participating patients were 17 forensic mental health patients treated in the Clinic of Forensic Psychiatry at Rostock University Medical Center. Nine of them participated in the first round, 8 in the second round. Five patients were detained according to &#x00A7; 63 Strafgesetzbuch (StGB, German penal code) which affects individuals who committed crimes because of a serious mental illness (e.g., schizophrenia or personality disorder). Detention under this paragraph is not limited in time but is evaluated annually to determine whether criteria for detention are still fulfilled. Another 12 patients were detained according to &#x00A7; 64 StGB, which refers to offenders with substance use disorders. Duration of detention under this paragraph is time limited, usually to 2&#x2009;years and reviewed every 6&#x2009;months. All but one patient were male. Patients&#x2019; age ranged from 20 to 62&#x2009;years (<italic>M</italic> =&#x2009;35.25, <italic>Mdn</italic> =&#x2009;31, <italic>SD</italic> =&#x2009;12.20), the typical age range for forensic mental health patients in Germany [Statistisches (<xref ref-type="bibr" rid="ref15">15</xref>)]. Fourteen participants had a diagnosis of substance use disorder, seven of personality disorder, two of schizophrenia, one of intellectual disability and five of other diagnoses (comorbidities included). Their cognitive abilities ranged from 66 to 116 (<italic>M</italic> =&#x2009;84.41, <italic>Mdn</italic> =&#x2009;74, <italic>SD</italic> =&#x2009;17.97) according to the German version of the Wechsler Adult Intelligence Scale [WAIS-IV, (<xref ref-type="bibr" rid="ref16">16</xref>)] Two patients had a migration background. Both of them identified themselves as acculturated predominantly to German culture (see next paragraph for more details). A more detailed description of the sample is presented in <xref ref-type="supplementary-material" rid="SM1">Appendix A</xref>.</p>
</sec>
</sec>
<sec id="sec6">
<title>2.2. Participant sampling and recruitment</title>
<p>For the translational process, several attempts to recruit translators were made. We were looking for German native speakers who live or were living in Great Britain for at least 2&#x2009;years and, therefore, were considered familiar to the British language and culture. Additionally, familiarity with (forensic) mental health care systems in both countries were desirable but not mandatory. In fact, it was turned out to be very difficult to find people with these characteristics. To recruit translators, members of the research team contacted people from their professional and personal background and also posted a call on various Facebook study participation groups. Four people were willing to participate. They were invided and offered a compensation for their time.</p>
<p>Patient participants for the cognitive pretest interview were patients of the Clinic for Forensic Psychiatry in Rostock, Germany, who were recruited in two rounds. The first round was the initial cognitive pretest conducted in late 2021 which already revealed adaptation necessities. The second round was conducted in early 2022. All participants were preselected by the research team according to a quota sampling plan. This plan contained several characteristics to make sure that also small but persistently existing subgroups are represented in the pretest that would have been underrepresented in random sampling (e.g., women). Characteristics that were taken into consideration for the quota plan were age, sex, diagnosis, legal basis for detention, and intellectual abilities WAIS-IV. We also included patients with migrant background (meaning the patient themselves or at least one of their parents were born and raised outside Germany). For these patients, a participation in a German questionnaire translation and validation process only made sense if the person showed a certain level of acculturation to German culture. Acculturation describes the individual process cultural change by becoming familiar and identifying oneself with the culture a person is living in [i.e., its behaviors, traditions, language etc., (<xref ref-type="bibr" rid="ref17">17</xref>, <xref ref-type="bibr" rid="ref18">18</xref>)]. We used the Frankfurter Akkulturationsskala [Frankfurt Acculturation Scale; FRAKK, (<xref ref-type="bibr" rid="ref18">18</xref>)] to identify patients who described themselves as acculturated to German culture. The FRAKK is based on a two-dimensional model of acculturation that states that a person can be acculturated in two cultures at the same time. Therefore, being involved in one&#x2019;s culture of origin not necessarily excludes being involved in the majority society&#x2019;s culture (or vice versa). The model finally states four different states &#x2013; acculturation to origin culture or the majority society&#x2019;s culture only, acculturation to both cultures or to none of them. For our cognitive pretest we tested patients with a migration background, who were interested in participating on the pretest with the FRAKK and invited patients who described themselves as acculturated to German culture alone or together with their (parents&#x2019;) culture. We did not include patients who did not speak German to a level that enabled them to express themselves in an interview with open questions. We also excluded patients who were not able to give their informed consent for participation (e.g., because of active psychosis) and patients from local prisons who were in the clinic only for a short-term psychiatric intervention. Patients were offered 5&#x20AC; for their participation.</p>
</sec>
<sec id="sec7">
<title>2.3. Data collection</title>
<p>The translators were given information about the population the questionnaire was intended to address before the translation. This information contained a definition of forensic psychiatry, a brief overview of the forensic psychiatric system in Germany as well as the most important patient characteristics (e.g., average age, gender, education and diagnoses). All translators were asked to provide a translation that orients closely to the original questionnaire and its simplicity and avoid too complex translations due to the usually low level of educational achievement in the forensic population. The translators were provided a form to fill in their translation for every item of the FRQ and every sentence of the questionnaire instructions as well as space for alternative translations or notes about uncertainties that arose during translation. The four translators then prepared their translation independently from each other and sent them to the reviewer in advance of the review discussion. All translators translated the entire instructions and all items of the FRQ [parallel translation, (<xref ref-type="bibr" rid="ref19">19</xref>)]. The reviewer, which was represented by the first author (PW) then prepared the translations for the review discussion.</p>
<p>The review discussion lasted 70&#x2009;min. Unfortunately, the psychological translator was prevented at short notice and not able to join the review discussion, so four people attended (three translators and the reviewer as moderator). The discussion was held as a video conference given one of the translators was still living in the United Kingdom at that time. The reviewer prepared a presentation which presented one introductory sentence or item with its four translation versions on each slide on a shared screen. She welcomed the translators and introduced the aim of the discussion, which was to discuss the four different translations and, ideally, agree on a final version. She also pointed out the option to come up with a new version that evolved during discussion. The discussion was recorded and transcribed verbatim. Participants were able to agree on one translation version with the exception of two introductory sentences and one item. The decision regarding these parts was made by the reviewer in a discussion with the second author (BV), who served as adjudicator. Discussion was held 1&#x2009;day after the review taking into account the reviewers&#x2019; notes and the audio record. Additionally, two professional translators were shown the original questionnaire as well as the review translation and asked for their evaluation. Their annotations were discussed by the reviewer and the adjudicator and final adaptations were made.</p>
<p>The review discussion as well as the evaluation of the translators left some questions regarding ambiguous wordings in the source questionnaire and the original author&#x2019;s intention. These were solved by the reviewer via consultation of the original author or were taken into account as questions for the pretest which involved the intended user group, i.e., forensic patients. The preliminary version for the pretest was produced by the reviewer together with an adjudicator and checked for grammatical and spelling mistakes.</p>
<p>The version produced by the reviewer and adjudicator was taken to a cognitive pretest with forensic mental health in-patients. The pretest was designed as a semi-structured face to face interview. All interviews were conducted by the first author. The cognitive pretest consisted of an interview manual and prepared score cards. Patients were presented the introductory section of the FRQ and all of the 15 items one by one on a score card which was read out by the interviewer at the same time. After each score card, the interviewer first waited for patient&#x2019;s initial reaction (e.g., questions or mimic that might indicate issues of comprehension). For the items, patients were then asked for their rating of each item. An additional score card with the 5-point Likert scale was on display all the time to support the answering process. For some of the items we used additional questions, so-called probes, to further explore patients&#x2019; answers and how they came to their conclusion. We used comprehensive probes, category selection probes and specific probes. Comprehensive probes are used to explore patients&#x2019; understanding of a certain word or phrase (e.g., <italic>Could you please explain what</italic> Individuum <italic>means for you</italic>?). Category selection probes were used to see how patients came to their answer (e.g., <italic>So you chose a</italic> 4 <italic>in your last rating. Could you please explain why you chose this rating?</italic>). Specific probes are used to explore more specific questions (e.g., <italic>What hobbies were you thinking of, when you answered the question?</italic>). If probes were not sufficient to elucidate the question, the interviewer was free to ask additional questions. Patients were informed at the beginning of the interview, that they can decline answering certain questions without giving a reason. The interviews were intended to last between 30 and 45&#x2009;min. Their actual duration varied between 16 and 64&#x2009;min. After the interview, the interviewer thanked the patients and handed over the expense allowance.</p>
</sec>
<sec id="sec8">
<title>2.4. Data recording, transforming, and analysis</title>
<p>The review discussion was held as online conference via Zoom and was recorded via the conference&#x2019;s recording function. The audio file was transcribed verbatim by a student assistant and checked for correctness by the first author.</p>
<p>For the cognitive pretest, the interviews took place in the visiting room of the clinic or in patients&#x2019; rooms, according to the patients&#x2019; preferences. All interviews were recorded on an audiotape and partially transcribed. We left out transcription of parts that had no relation to the pretest questions. All transcripts were analyzed using NVivo 12 pro according to predefined questions using Thematic Analysis (<xref ref-type="bibr" rid="ref20">20</xref>).</p>
</sec>
</sec>
<sec id="sec9" sec-type="results">
<title>3. Results</title>
<sec id="sec10">
<title>3.1. Translation process</title>
<p>Several challenges arose during the translation process. In some cases, the team had to weigh up a translation as close as possible to the original text against an adapted version. The first option would lead to better compatibility between the British and German version in international comparability studies. The latter option might lead to more valid data in a German population. If in doubt, the priority was given to validity in the German population and, therefore, to a good fitting adaptation, even if this might limit the international comparability of the British and German questionnaire versions.</p>
<p>The instruction sentences lead to several divergent translations. The first sentence of the instructions is <italic>This questionnaire asks how you experience the restrictiveness of your care</italic>. For the word <italic>care</italic> there is no corresponding German translation that fits well into the context of a forensic hospital. The usual translation <italic>Pflege</italic> is more commonly used to describe the caring activities for ill people in general hospitals (usually delivered by nurses) or for the elderly. More suiting translations would include <italic>Behandlung</italic> (treatment) or <italic>Unterbringung</italic> (detention). We decided to ask the patients in the pretest which term they would find more appropriate and why.</p>
<p>The second sentence (<italic>We want to know how you feel about each of the statements included below</italic>) referred to the 15 items in which the patients are asked to rate different statements regarding their detention according to their agreement or disagreement. The word <italic>feel</italic> is difficult to translate into German since the literal translation would ask more for an emotional evaluation (e.g., good or bad) and is uncommon in contexts of agreement in German. A better translation would be <italic>halten von</italic> or <italic>denken &#x00FC;ber</italic> (both translated with <italic>think</italic> in English). During the review discussion the option <italic>halten von</italic> was preferred, since the other option <italic>denken &#x00FC;ber</italic> was thought to emphasize the cognitive rating over the emotional rating too much. Nonetheless, the translators afterwards mentioned a negative connotation of <italic>halten von</italic> that might influence the patient&#x2019;s ratings. Therefore, we chose <italic>denken &#x00FC;ber</italic> for the pretest version.</p>
<p>The last instruction sentence also evoked some discussion and lead to divergent suggestions by the review and the professional translators. The sentence <italic>Please think about how you have felt over the last week when completing this.</italic> Was translated in the review discussion as <italic>Bitte denken Sie beim Ausf&#x00FC;llen daran, wie Sie sich im Verlauf der letzten Woche gef&#x00FC;hlt haben</italic>. This sentence contained several difficulties. First, the grammatical structure of the English sentence cannot be copied one by one into German. Second, the word <italic>feel</italic> cannot be translated literally here, since the German question about how somebody feels implies an evaluation (e.g., good, bad) or an emotion (e.g., happy, sad) as an answer. Since the following questionnaire items ask for the amount of agreement to a statement, the word <italic>feel</italic> or its literal translation would not fit into this context and might lead to confusion. Therefore, the word feel was not translated literally as <italic>f&#x00FC;hlen</italic> but adapted as <italic>erleben</italic> (experience).</p>
<p>There was also some discussion regarding the translation of the scale points in the third instruction sentence. The scale points were strongly disagree, disagree, not sure, agree und strongly agree. A common German translation is the literal translation <italic>Stimme zu</italic> (agree) and <italic>Stimme voll und ganz zu</italic> (totally agree) and analogue <italic>Stimme nicht zu</italic> and <italic>Stimme &#x00FC;berhaupt nicht zu</italic>. One of the professional translators mentioned that this expression indicates a grading of something and that agreement has no grading &#x2013;you either agree or not. Therefore, she suggested an option that expresses tendencies &#x2013; <italic>Stimme eher zu</italic> (rather agree) and <italic>Stimme voll zu</italic> (completely agree). We found this explanation reasonable and decided to follow these suggestions.</p>
<p>Further discussion was elicited by the actual questionnaire items. In item 2 (<italic>I can express my feelings here enough</italic>) the review translators discussed the term <italic>enough</italic> and if it might be understood by all patients as intended. That means the patients would be able to express themselves to an extent that they are satisfied (or relieved). The review translators with clinical expertise thought that most of the patients might interpret this item in the intended way. Nonetheless, we decided to evaluate patients&#x2019; interpretation of this in the pretest.</p>
<p>Item 3 (<italic>The hospital helps me practice hobbies I like</italic>) led to diverging translations amongst the review translators and objections with the professional translators afterwards. The review translators agreed on the translation <italic>Die Klinik hilft mir dabei, meinen Hobbys nachzugehen</italic> and introduced the term <italic>my hobbies</italic> instead of <italic>hobbies</italic> alone. They intended to remove the term <italic>I like</italic> because they felt like a hobby would be something a person likes <italic>per se</italic>. The professional translators agreed with that. They explained that the term &#x201C;hobbies&#x201D; in English would have a broader meaning, compared to German. In English, the word &#x201C;hobby&#x201D; includes any kind of leisure time activity. In German, the word &#x201C;Hobby&#x201D; also exists but is more linked to leisure time activities that are practiced on a regular basis (e.g., going to the gym twice a week or joining a club&#x2019;s activities as a registered member). Because of that, they felt that <italic>my hobbies</italic> was not an appropriate translation. The expression <italic>my hobbies</italic> instead of <italic>hobbies</italic> alone might add to a misleading interpretation by patients in a way that they might interpret this item as to which extent they can continue leisure time activities in the clinic that they used to do before detention. This interpretation would lie behind the item&#x2019;s intention, so we decided to remove the word <italic>my</italic> from the translation and keep a more verbatim translation with <italic>I like (Die Klinik hilft mir dabei, Hobbys nachzugehen, die mir gefallen)</italic>. To test if this translation was still misleading to patients this item should be evaluated in the pretest.</p>
<p>Item 6 (<italic>Staff respect me as an individual</italic>) was translated by in the review translators as <italic>Das Personal respektiert mich als Individuum</italic>. One of the professional translators mentioned that the word <italic>Individuum</italic> is not very common in German everyday language and that forensic patients might have issues with that due to their on average lower level of formal education. Since there is no alternative translation that captures the word&#x2019;s meaning and is more common in everyday language, we decided to keep the word <italic>Individuum</italic> and test its comprehensibility in the pretest.</p>
<p>A critical word that led to divergent evaluations by review and professional translators was the word <italic>fair</italic> in items 10 (<italic>It is fair I am here right now</italic>) and 14 (<italic>The rules on the ward are fair</italic>). The word <italic>fair</italic> does also exist in German. To stay as close to the original translation as possible and in order to be consistent (both original items used the same word) the review translators kept this word in both translations. The professional translators differed from that and suggested an alternative. They noted that the word fair had a closer interpretation in German compared to English and would be more commonly used in play and sports contexts or when talking about a person&#x2019;s behavior. Therefore, one of them suggested <italic>gerecht</italic> as more suitable, which can be translated as <italic>just(ified)</italic> or <italic>according to the law</italic> in German. There are also indications in the literature that German participants in a general population survey made a difference between <italic>fair</italic> and <italic>gerecht</italic> (<xref ref-type="bibr" rid="ref21">21</xref>). Therefore, we decided to further evaluate patients&#x2019; interpretations of these items in the pretest.</p>
<p>Issues also arose with item 11 (<italic>I can participate in activities I find meaningful</italic>). The translation of <italic>meaningful</italic> was difficult because review and professional translators were unaware of the original author&#x2019;s intention. Additionally, the review translator&#x2019;s version <italic>Ich kann an Aktivit&#x00E4;ten teilnehmen, die f&#x00FC;r mich von Bedeutung sind</italic> was seen as correct in terms of content by the professional translators but they mentioned the expression <italic>die f&#x00FC;r mich von Bedeutung sind</italic> as slightly uncommon in everyday language in connection with the term <italic>Aktivit&#x00E4;ten</italic> (activities). We decided to ask the original author about his intentions regarding the term <italic>meaningful</italic>. He replied that meaningful was meant to express a personal, emotional importance rather than an objective importance. For example, a court appointment might be important objectively but it might not necessarily have the same emotional importance to the patient. Here, e.g., family visits might carry more emotional relevance, even if they are of less objective relevance compared to the court appointment. According to this, we adjusted the initial review translation to <italic>Ich kann an Aktivit&#x00E4;ten teilnehmen, die mir wichtig sind</italic> (which was also an alternative suggestion by one of the professional translators). To make sure patients interpret this item in the intended way, we choose to evaluate it in the pretest.</p>
<p>Item 15 (<italic>The restrictions on the ward make sense</italic>) was translated by the review translators as <italic>Die Einschr&#x00E4;nkungen auf Station sind sinnvoll</italic>. One of the professional translators mentioned that in German make sense is ambiguous. It can address if something is understandable on a cognitive level as well as the evaluation of the reasonableness of the ward&#x2019;s restrictions. Another consultation with the original questionnaire&#x2019;s author clarified that the item aims at the latter. The author mentioned an example in which the patients on the ward of a hospital were not allowed to have a knife in their rooms due to reasons of safety but were allowed to have a metal nail file. The patients were able to understand that restriction cognitively but evaluated it negatively since a nail file can also be used as a weapon. As a result, the review translator&#x2019;s suggestion was kept. To make sure patients interpret this item according to its intention, we decided to evaluate their interpretation in the pretest.</p>
<p>The only item that needed adaptation because of cultural differences was item 4 (<italic>I feel included in my care plan enough [CPA and Ward Rounds]</italic>). The concept of the Care Programme Approach (CPA) is specific to Britain&#x2019;s health care system and has no equivalent in Germany. Therefore, it was translated in a more general way as <italic>Behandlungsplanung</italic> (treatment planning).</p>
<p>One last adaptation decision was made after the translational process was finished. The reviewer decided, after supervision with the above-mentioned research team member, to remove the demographic items from the questionnaire. There were several reasons for this. First, since the FRQ-G is intended to be used in research primarily, the demographic, legal and clinical variables that have to be collected, vary according to the individual research project&#x2019;s questions and, therefore, are likely to be changed by other researchers, anyway. Furthermore, in a conversation with the original author it turned out that the demographic variables in his studies were taken from the patients records and not answered by the patients themselves. This was done for reasons of data quality and consistency because it was assumed that some of these questions might be difficult to answer for patients (e.g., for how long they have already been detained and for how long they had been detained previously). The final translation used for the cognitive pretest can be seen in <xref rid="tab1" ref-type="table">Table 1</xref>.</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption>
<p>Original FRQ and German translation after review discussion and adjudication.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">English original</th>
<th align="left" valign="top">German translation</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Instructions for use:</td>
<td align="left" valign="top">Hinweise zum Ausf&#x00FC;llen:</td>
</tr>
<tr>
<td align="left" valign="top">This questionnaire asks how you experience the restrictiveness of your care</td>
<td align="left" valign="top">In diesem Fragebogen geht es darum, wie Sie die Einschr&#x00E4;nkungen im Rahmen Ihrer Behandlung erleben</td>
</tr>
<tr>
<td align="left" valign="top">We want to know how you feel about each of the statements included below</td>
<td align="left" valign="top">Wir m&#x00F6;chten erfahren, wie Sie &#x00FC;ber die untenstehenden Aussagen denken</td>
</tr>
<tr>
<td align="left" valign="top">Please read the following statements and mark &#x2018;Strongly Disagree&#x2019;, &#x2018;Disagree&#x2019;, &#x2018;Not Sure, &#x2018;Agree&#x2019; or &#x2018;Strongly Agree&#x2019;</td>
<td align="left" valign="top">Bitte lesen Sie die folgenden Aussagen und markieren Sie &#x201C;Stimme &#x00FC;berhaupt nicht zu,&#x201D; &#x201C;Stimme eher nicht zu&#x201C;, &#x201E;Unentschieden&#x201C;, &#x201C;Stimme eher zu&#x201D; und &#x201C;Stimme voll und ganz zu.&#x201D;</td>
</tr>
<tr>
<td align="left" valign="top">Please think about how you have felt over the last week when completing this</td>
<td align="left" valign="top">Bitte denken Sie beim Ausf&#x00FC;llen daran, wie Sie sich im Verlauf der letzten Woche gef&#x00FC;hlt haben</td>
</tr>
<tr>
<td align="left" valign="top">If you have any questions, please ask a member of staff</td>
<td align="left" valign="top">Wenn Sie Fragen haben, wenden Sie sich bitte an das Personal</td>
</tr>
<tr>
<td align="left" valign="top">Information about you:</td>
<td align="left" valign="top">removed</td>
</tr>
<tr>
<td align="left" valign="top">(To be filled by yourself or member of staff)</td>
<td align="left" valign="top">removed</td>
</tr>
<tr>
<td align="left" valign="top">Date:</td>
<td align="left" valign="top">removed</td>
</tr>
<tr>
<td align="left" valign="top">Study ID:</td>
<td align="left" valign="top">removed</td>
</tr>
<tr>
<td align="left" valign="top">Age:</td>
<td align="left" valign="top">removed</td>
</tr>
<tr>
<td align="left" valign="top">Ethnicity:</td>
<td align="left" valign="top">removed</td>
</tr>
<tr>
<td align="left" valign="top">Gender:</td>
<td align="left" valign="top">removed</td>
</tr>
<tr>
<td align="left" valign="top">Diagnosis:</td>
<td align="left" valign="top">removed</td>
</tr>
<tr>
<td align="left" valign="top">Mental Health Act Section(s):</td>
<td align="left" valign="top">removed</td>
</tr>
<tr>
<td align="left" valign="top">How long have you been in this Secure Hospital:</td>
<td align="left" valign="top">removed</td>
</tr>
<tr>
<td align="left" valign="top">How long have you been in other Secure Hospitals</td>
<td align="left" valign="top">removed</td>
</tr>
<tr>
<td align="left" valign="top">Index Offence(s) (if applicable):</td>
<td align="left" valign="top">removed</td>
</tr>
<tr>
<td align="left" valign="top">1. I am treated like a human being here</td>
<td align="left" valign="top">1. Ich werde hier wie ein Mensch behandelt</td>
</tr>
<tr>
<td align="left" valign="top">2. I can express my feelings here enough</td>
<td align="left" valign="top">2. Ich habe hier gen&#x00FC;gend M&#x00F6;glichkeiten, meine Gef&#x00FC;hle auszudr&#x00FC;cken</td>
</tr>
<tr>
<td align="left" valign="top">3. The hospital helps me practice hobbies I like</td>
<td align="left" valign="top">3. Die Klinik hilft mir dabei, Hobbys nachzugehen, die mir gefallen</td>
</tr>
<tr>
<td align="left" valign="top">4. I feel included in my care plan enough (CPA and Ward Rounds)</td>
<td align="left" valign="top">4. Ich f&#x00FC;hle mich gen&#x00FC;gend in meine Behandlung einbezogen (Behandlungsplanung und Visiten)</td>
</tr>
<tr>
<td align="left" valign="top">5. I am given enough information about my care</td>
<td align="left" valign="top">5. Ich werde gen&#x00FC;gend &#x00FC;ber meine Behandlung informiert</td>
</tr>
<tr>
<td align="left" valign="top">6. Staff respect me as an individual</td>
<td align="left" valign="top">6. Das Personal respektiert mich als Individuum</td>
</tr>
<tr>
<td align="left" valign="top">7. I am given enough responsibility on the ward</td>
<td align="left" valign="top">7. Mir wird gen&#x00FC;gend Verantwortung auf Station gegeben</td>
</tr>
<tr>
<td align="left" valign="top">8. I am trusted by staff enough</td>
<td align="left" valign="top">8. Das Personal vertraut mir gen&#x00FC;gend</td>
</tr>
<tr>
<td align="left" valign="top">9. I can choose what I want to do each day</td>
<td align="left" valign="top">9. Ich kann jeden Tag entscheiden, was ich tun m&#x00F6;chte</td>
</tr>
<tr>
<td align="left" valign="top">10. It is fair I am here right now</td>
<td align="left" valign="top">10. Es ist gerecht, dass ich zurzeit hier bin</td>
</tr>
<tr>
<td align="left" valign="top">11. I can participate in activities I find meaningful</td>
<td align="left" valign="top">11. Ich kann an Aktivit&#x00E4;ten teilnehmen, die mir wichtig sind</td>
</tr>
<tr>
<td align="left" valign="top">12. My rights are respected properly here</td>
<td align="left" valign="top">12. Meine Rechte werden hier angemessen respektiert</td>
</tr>
<tr>
<td align="left" valign="top">13. I am forced to do things I do not want to do</td>
<td align="left" valign="top">13. Ich werde gezwungen Dinge zu tun, die ich nicht tun will</td>
</tr>
<tr>
<td align="left" valign="top">14. The rules on the ward are fair</td>
<td align="left" valign="top">14. Die Regeln auf Station sind gerecht</td>
</tr>
<tr>
<td align="left" valign="top">15. The restrictions on the ward make sense</td>
<td align="left" valign="top">15. Die Einschr&#x00E4;nkungen auf Station sind sinnvoll</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="sec11">
<title>3.2. Cognitive pretest</title>
<p>The analysis of the pretest led to several adaptations of the questionnaire. The complete questionnaire after the first and second pretest round is presented in <xref rid="tab2" ref-type="table">Table 2</xref>. For reasons of space only items that led to questionnaire adaptations are discussed. The full results can be provided by the authors upon request.</p>
<table-wrap position="float" id="tab2">
<label>Table 2</label>
<caption>
<p>Original English Version of the FRQ, review translation and adaptations after the first and second round of pretest.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">English Original</th>
<th align="left" valign="top">German Translation</th>
<th align="left" valign="top">Adaptations after Pretest, Round 1</th>
<th align="left" valign="top">Adaptations after Pretest, Round 2</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Instructions for use:</td>
<td align="left" valign="top">Hinweise zum Ausf&#x00FC;llen:</td>
<td align="left" valign="top">Hinweise zum Ausf&#x00FC;llen:</td>
<td align="left" valign="top">Hinweise zum Ausf&#x00FC;llen:</td>
</tr>
<tr>
<td align="left" valign="top">This questionnaire asks how you experience the restrictiveness of your <italic>care</italic>.</td>
<td align="left" valign="top">In diesem Fragebogen geht es darum, wie Sie die Einschr&#x00E4;nkungen im Rahmen Ihrer <italic>Behandlung</italic> erleben.</td>
<td align="left" valign="top">In diesem Fragebogen geht es darum, wie Sie die Einschr&#x00E4;nkungen im Rahmen Ihrer <italic>Unterbringung</italic> erleben.</td>
<td align="left" valign="top">In diesem Fragebogen geht es darum, wie Sie die Einschr&#x00E4;nkungen im Rahmen Ihrer <italic>Unterbringung</italic> erleben.</td>
</tr>
<tr>
<td align="left" valign="top">We want to know how you feel about each of the statements included below.</td>
<td align="left" valign="top">Wir m&#x00F6;chten erfahren, wie Sie &#x00FC;ber die untenstehenden Aussagen denken.</td>
<td align="left" valign="top">Wir m&#x00F6;chten erfahren, wie Sie &#x00FC;ber die untenstehenden Aussagen denken</td>
<td align="left" valign="top">Wir m&#x00F6;chten erfahren, wie Sie &#x00FC;ber die untenstehenden Aussagen denken</td>
</tr>
<tr>
<td align="left" valign="top">Please read the following statements and mark &#x2018;Strongly Disagree&#x2019;, &#x2018;Disagree&#x2019;, &#x2018;Not Sure, &#x2018;Agree&#x2019; or &#x2018;Strongly Agree&#x2019;.</td>
<td align="left" valign="top">Bitte lesen Sie die folgenden Aussagen und markieren Sie &#x201C;Stimme &#x00FC;berhaupt nicht zu,&#x201D; &#x201C;Stimme eher nicht zu&#x201C;, &#x201E;<italic>Unentschieden</italic>&#x201C;, &#x201C;Stimme eher zu&#x201D; und &#x201C;Stimme voll und ganz zu.&#x201D;</td>
<td align="left" valign="top">Bitte lesen Sie die folgenden Aussagen und markieren Sie &#x201C;Stimme &#x00FC;berhaupt nicht zu,&#x201D; &#x201C;Stimme eher nicht zu&#x201C;, &#x201E;<italic>Teils teils</italic>&#x201C;, &#x201C;Stimme eher zu&#x201D; oder &#x201C;Stimme voll und ganz zu.&#x201D;</td>
<td align="left" valign="top">Bitte lesen Sie die folgenden Aussagen und markieren Sie &#x201C;Stimme &#x00FC;berhaupt nicht zu,&#x201D; &#x201C;Stimme eher nicht zu&#x201C;, &#x201E;<italic>Teils teils</italic>&#x201C;, &#x201C;Stimme eher zu&#x201D; oder &#x201C;Stimme voll und ganz zu.&#x201D;</td>
</tr>
<tr>
<td align="left" valign="top">Please think about how you have felt over the last week when completing this.</td>
<td align="left" valign="top">Bitte denken Sie beim Ausf&#x00FC;llen daran, wie sie sich im Verlauf der letzten Woche gef&#x00FC;hlt haben.</td>
<td align="left" valign="top">Bitte denken Sie beim Ausf&#x00FC;llen daran, wie Sie sich im Verlauf der letzten Woche gef&#x00FC;hlt haben.</td>
<td align="left" valign="top">Bitte denken Sie beim Ausf&#x00FC;llen daran, wie Sie sich im Verlauf der letzten Woche gef&#x00FC;hlt haben.</td>
</tr>
<tr>
<td align="left" valign="top">If you have any questions, please ask a member of staff.</td>
<td align="left" valign="top">Wenn Sie Fragen haben, wenden Sie sich bitte an das Personal.</td>
<td align="left" valign="top">Wenn Sie Fragen haben, wenden Sie sich bitte an das Personal.</td>
<td align="left" valign="top">Wenn Sie Fragen haben, wenden Sie sich bitte an das Personal.</td>
</tr>
<tr>
<td align="left" valign="top">1. I am treated like a human being here</td>
<td align="left" valign="top">1. Ich werde hier wie ein Mensch behandelt</td>
<td align="left" valign="top">1. Ich werde hier wie ein Mensch behandelt</td>
<td align="left" valign="top">1. Ich werde hier wie ein Mensch behandelt</td>
</tr>
<tr>
<td align="left" valign="top">2. I can express my feelings here enough</td>
<td align="left" valign="top">2. Ich habe hier gen&#x00FC;gend M&#x00F6;glichkeiten, meine Gef&#x00FC;hle auszudr&#x00FC;cken</td>
<td align="left" valign="top">2. Ich habe hier gen&#x00FC;gend M&#x00F6;glichkeiten, meine Gef&#x00FC;hle auszudr&#x00FC;cken (B), <italic>wenn ich es m&#x00F6;chte</italic> (A)</td>
<td align="left" valign="top">2. Ich habe hier gen&#x00FC;gend M&#x00F6;glichkeiten, meine Gef&#x00FC;hle auszudr&#x00FC;cken, <italic>wenn ich es m&#x00F6;chte</italic></td>
</tr>
<tr>
<td align="left" valign="top">3. The hospital helps me practice <italic>hobbies</italic> I like</td>
<td align="left" valign="top">3. Die Klinik hilft mir dabei, <italic>Hobbys</italic> nachzugehen, die mir gefallen</td>
<td align="left" valign="top">3. Die Klinik hilft mir dabei, <italic>Freizeitaktivit&#x00E4;ten</italic> (A) / <italic>Hobbys</italic> (B) nachzugehen, die mir gefallen</td>
<td align="left" valign="top">3. Die Klinik hilft mir dabei, <italic>Freizeitaktivit&#x00E4;ten</italic> nachzugehen, die mir gefallen</td>
</tr>
<tr>
<td align="left" valign="top">4. I feel included in my care plan enough (CPA and Ward Rounds)</td>
<td align="left" valign="top">4. Ich f&#x00FC;hle mich gen&#x00FC;gend in meine Behandlung einbezogen (Behandlungsplanung und Visiten)</td>
<td align="left" valign="top">4. Ich f&#x00FC;hle mich gen&#x00FC;gend in meine Behandlung einbezogen (Behandlungsplanung und Visiten)</td>
<td align="left" valign="top">4. Ich f&#x00FC;hle mich gen&#x00FC;gend in meine Behandlung einbezogen (Behandlungsplanung und Visiten)</td>
</tr>
<tr>
<td align="left" valign="top">5. I am given enough information about my care</td>
<td align="left" valign="top">5. Ich werde gen&#x00FC;gend &#x00FC;ber meine Behandlung informiert</td>
<td align="left" valign="top">5. Ich werde gen&#x00FC;gend &#x00FC;ber meine Behandlung informiert</td>
<td align="left" valign="top">5. Ich werde gen&#x00FC;gend &#x00FC;ber meine Behandlung informiert</td>
</tr>
<tr>
<td align="left" valign="top">6. Staff respect me as an <italic>individual</italic></td>
<td align="left" valign="top">6. Das Personal respektiert mich als <italic>Individuum</italic></td>
<td align="left" valign="top">6. Das Personal respektiert <italic>mich mit all meinen Eigenschaften und Besonderheiten</italic></td>
<td align="left" valign="top">6. Das Personal respektiert mich <italic>als Pers&#x00F6;nlichkeit mit all meinen Eigenschaften</italic></td>
</tr>
<tr>
<td align="left" valign="top">7. I am given enough responsibility on the ward</td>
<td align="left" valign="top">7. Mir wird gen&#x00FC;gend Verantwortung auf Station gegeben</td>
<td align="left" valign="top">7. Mir wird gen&#x00FC;gend Verantwortung auf Station gegeben</td>
<td align="left" valign="top">7. Mir wird gen&#x00FC;gend Verantwortung auf Station gegeben</td>
</tr>
<tr>
<td align="left" valign="top">8. I am trusted by staff enough</td>
<td align="left" valign="top">8. Das Personal vertraut mir gen&#x00FC;gend</td>
<td align="left" valign="top">8. Das Personal vertraut mir gen&#x00FC;gend</td>
<td align="left" valign="top">8. Das Personal vertraut mir gen&#x00FC;gend</td>
</tr>
<tr>
<td align="left" valign="top">9. I can choose what I want to do each day</td>
<td align="left" valign="top">9. Ich kann jeden Tag entscheiden, was ich tun m&#x00F6;chte</td>
<td align="left" valign="top">9. Ich kann jeden Tag entscheiden, was ich tun m&#x00F6;chte</td>
<td align="left" valign="top">9. Ich kann jeden Tag entscheiden, was ich tun m&#x00F6;chte</td>
</tr>
<tr>
<td align="left" valign="top">10. It is <italic>fair</italic> I am here right now</td>
<td align="left" valign="top">10. Es ist <italic>gerecht</italic>, dass ich zurzeit hier bin</td>
<td align="left" valign="top">10. Es ist <italic>gerecht</italic> (A)/<italic>fair</italic> (B), dass ich zurzeit hier bin.</td>
<td align="left" valign="top">10. Es ist <italic>gerecht</italic>, dass ich zurzeit hier bin</td>
</tr>
<tr>
<td align="left" valign="top">11. I can participate in activities I find meaningful</td>
<td align="left" valign="top">11. Ich kann an Aktivit&#x00E4;ten teilnehmen, die mir wichtig sind</td>
<td align="left" valign="top">11. Ich kann an Aktivit&#x00E4;ten teilnehmen, die mir wichtig sind</td>
<td align="left" valign="top">11. Ich kann an Aktivit&#x00E4;ten teilnehmen, die mir wichtig sind</td>
</tr>
<tr>
<td align="left" valign="top">12. My rights are respected properly here</td>
<td align="left" valign="top">12. Meine Rechte werden hier angemessen respektiert</td>
<td align="left" valign="top">12. Meine Rechte werden hier angemessen respektiert</td>
<td align="left" valign="top">12. Meine Rechte werden hier angemessen respektiert</td>
</tr>
<tr>
<td align="left" valign="top">13. I am forced to do things I do not want to do</td>
<td align="left" valign="top">13. Ich werde gezwungen Dinge zu tun, die ich nicht tun will</td>
<td align="left" valign="top">13. Ich werde gezwungen Dinge zu tun, die ich nicht tun will</td>
<td align="left" valign="top">13. Ich werde gezwungen Dinge zu tun, die ich nicht tun will</td>
</tr>
<tr>
<td align="left" valign="top">14. The rules on the ward are <italic>fair</italic></td>
<td align="left" valign="top">14. Die Regeln auf Station sind <italic>gerecht</italic></td>
<td align="left" valign="top">14. Die Regeln auf Station sind <italic>gerecht</italic> (A) / <italic>fair</italic> (B)</td>
<td align="left" valign="top">14. Die Regeln auf Station sind <italic>fair</italic></td>
</tr>
<tr>
<td align="left" valign="top">15. The restrictions on the ward make sense</td>
<td align="left" valign="top">15. Die Einschr&#x00E4;nkungen auf Station sind sinnvoll</td>
<td align="left" valign="top">15. Die Einschr&#x00E4;nkungen auf Station sind sinnvoll</td>
<td align="left" valign="top">15. Die Einschr&#x00E4;nkungen auf Station sind sinnvoll</td>
</tr>
</tbody>
</table>
</table-wrap>
<sec id="sec12">
<title>3.2.1. Differences between <italic>Behandlung</italic> and <italic>Unterbringung</italic></title>
<p>In the pretest patients were given the questionnaire sentence on a showcard either with the word <italic>Unterbringung</italic> or <italic>Behandlung</italic>. After reading this sentence, another showcard was presented with both, the initial and the alternative option. Patients were asked if they see a difference in the meaning of the two sentences. Four of nine patients stated that they would not see a difference in the meaning (two of them had the initial sentence with <italic>Behandlung</italic>, two the alternative with <italic>Unterbringung</italic>). Five patients stated that for them there is a difference. Three of them had the initial option with <italic>Unterbringung</italic> (detention), two the alternative with <italic>Behandlung</italic> (treatment). Patients who made a difference were asked for more explanations. Three of the patients stated that they see <italic>Unterbringung</italic> as a broader term, that would include their treatment (in form of therapeutic activities, e.g., sessions with their psychologist, occupational therapy) and their spare time (e.g., visits by family members or having leave). Furthermore, for two patients the word <italic>Unterbringung</italic> had a more legal connotation and was associated with the court or the court order. One patient interpreted the word <italic>Behandlung</italic> as the way patients were treated generally (i.e., beyond the therapeutic interventions). This kind of interpretation makes sense in German but goes beyond the original intention of the question. Since the broader interpretation of <italic>Unterbringung</italic> and the potential for interpreting <italic>Behandlung</italic> in a non-intended way, we decided to use the term <italic>Unterbringung</italic> in the questionnaire. This question was not incluced in the second round of the pretest.</p>
</sec>
<sec id="sec13">
<title>3.2.2. Item 2 (I can express my feelings here enough)</title>
<p>In Item 2 a literal translation was possible. In the reviewer discussion it was mentioned that the word <italic>enough</italic> might lead to confusion amongst patients. Therefore, a category selection probe and, if necessary, a specific probe was used to explore patients&#x2019; interpretation of this statement. It was anticipated that, if patients understand the item according to the author&#x2019;s intention, a low rating (strongly disagree, disagree a little) would correspond to a low number of opportunities for expression of feelings, and a high rating (agree a little, strongly agree) would correspond to sufficient opportunities. From nine patients only one gave a low rating, giving as a reason the high fluctuation of staff at his ward at the time, including therapists and nurses, so he had to deal with most of his emotions by himself. Compared to this, four patients stated to agree (one patient strongly, three a little). They said that there were opportunities to express their feelings anytime and with several people (fellow patients or staff) or that they could get an additional appointment with their therapist very soon, if needed. Interestingly, the patients who stated to not be sure about this (rating of 3) stated that they were not sure about their feelings oftentimes and would generally prefer not to talk about them. On further questioning all of them stated that they felt that there was (at least) one person to turn to in case they needed someone to talk to, even if this was seldom the case. We interpreted the answers of these three patients in a way that some patients were not used to talk about their feelings and did not use this option often. Therefore, they might have used the middle category as an alternative for <italic>I do not know what to answer</italic>. Since this behavior, if used by other patients, too, could lead to an overestimation of the middle category, we decided to adapt Item 2 by the phrase <italic>wenn ich es m&#x00F6;chte</italic> (if I like to).</p>
<p>The original translation was tested against the adapted version in pretest round two. In two versions, half of the patients received the original translation and the other half the adapted translation. We used the same probes as in round one to explore patients&#x2019; interpretation of the item. Of the eight participants of the second pretest-round, seven gave a rating that was in line with the expected interpretation. Three patients rated this item on the middle category. All of them had the adapted version. Two patients stated that the expression of their feelings would not always be possible because a person of trust was sometimes not available (e.g., due to work schedule, illness or holiday). The remaining patient had the adapted version of the pretest. He stated that he would have difficulties in expressing especially negative emotions to others and he never did that in detention at the time of the interview. Therefore, answering the question would be speculative, even when he stated there would be some people who he could imagine to turn to. This patient used the middle category due to the absence of a more suitable answering option.</p>
<p>In the end, we decided to keep the adjusted item with the added phrase <italic>wenn ich es m&#x00F6;chte</italic> (if I like to). We think that this phrase can guide the answering behavior of patients who are not overly used to express their feelings but did that in the past. Nonetheless, this item could be difficult for patients who never express their feelings at all. These patients might use the middle answer category, as the patient in round two, or leave the question unanswered. The latter could be detected in an increased rate of missing answers in the pilot test.</p>
</sec>
<sec id="sec14">
<title>3.2.3. Item 3 (The hospital helps me practice hobbies I like)</title>
<p>According to the professional translator&#x2019;s objection, we wanted to evaluate how patients interpret the term <italic>Hobbys</italic>. If patients&#x2019; interpretation was according to the original item&#x2019;s intention, patients should think predominantly about leisure time activities they can do during their detention in the clinic. We evaluated this question using category selection and specific probes. In the first pretest round it turned out that patients indeed mixed-up activities they were offered in the clinic (e.g., table tennis, the clinic&#x2019;s gym) and activities they used to do before their detention but were not during their stay in the clinic (e.g., football, playing darts). Therefore, we decided to adapt the term <italic>hobbys</italic> by the term <italic>Freizeitaktivit&#x00E4;ten</italic> (leisure time activity) that better reflects the emphasis on clinic-based activities. The new wording was evaluated in the second round of the pretest.</p>
<p>Again, we tested the original translation with <italic>Hobbys</italic> against the adapted version with <italic>Freizeitaktivit&#x00E4;ten</italic> in pretest round two with half of the patients receiving the original translation and the other half the adapted translation. The same probes as in round one were used. From eight patients six focused on activities that are possible within the clinic. The remaining two patients additionally mentioned some activities they used to do before their detention. One of them was able to continue practicing this hobby (making music) in the clinic. The different wordings seemed to have no influence on the answering behavior, patients&#x2019; reasoning was in line with the intention of the item.</p>
<p>The issues found in pretest round one could not be found in round two. This could be a reflection of the higher intellectual abilities of the second sample (see WAIS-IV scores in <xref ref-type="supplementary-material" rid="SM1">Supplementary Appendix A</xref>). Since both wordings were well understood in round two and the wording <italic>Hobbys</italic> seemed an issue in round one, we decided to keep the alternative <italic>Freizeitaktivit&#x00E4;ten</italic> (leisure time activities) for the pilot study.</p>
</sec>
<sec id="sec15">
<title>3.2.4. Item 4 (I feel included in my care plan enough (CPA and Ward rounds))</title>
<p>The aim of this pretest was, similar to Item 2, to explore how patients interpret the term <italic>enough</italic>. According to the test of item 2, we expected low ratings of agreement to correspond with the report of limited inclusion (e.g., in form of communication, shared decision making or similar) in the probes and vice versa. Of nine patients, two gave low ratings of agreement, one patient used the middle category and the remaining six patients gave high ratings of (strong or a little) agreement. The following probes revealed that especially patients who agreed on this item predominantly mentioned the good information about their care. Since this is actually the content of Item 5 (<italic>I am given enough information about my care</italic>) we saw this evaluation as biased. This result might not have occurred if patients had known item 5 before, so we decided to ask the same probes of Item 4 again in the second pretest round but switch the order of Item 4 and Item 5. By doing so, we hoped that being aware of the content of Item 5 before Item 4 might lead patients to the intended interpretation of inclusion into their care so that the initially intended test of <italic>enough</italic> would become possible.</p>
<p>In round two, two patients disagreed to feeling included in their care plan whereas four agreed and two strongly agreed. Patients who disagreed stated that they did not have the feeling to be heard or got no or late information about their results of medical examinations. Furthermore, organizational issues were mentioned, e.g., not having a care plan due to frequent staff changes. In contrast, patients who agreed with that item reported regular meetings with staff in which they could talk about their treatment. Patients who strongly agreed also mentioned their opinion was heard when it came to treatment decisions. On further questioning, all of these six patients indicated their wishes regarding their treatment were respected.</p>
<p>The second pretest round indicated that patients interpret the item as intended. Therefore, no adaptations to item 4 appeared necessary. Nonetheless, we decided to switch items 4 and 5 in the original survey to avoid the positioning effects that were observed in the pretest.</p>
</sec>
<sec id="sec16">
<title>3.2.5. Item 6 (Staff respect me as an individual)</title>
<p>We used comprehension probes and category selection probes to explore how patients might understand the word <italic>Individuum</italic>. The pretest confirmed the professional translator&#x2019;s presumption. Of nine patients, five spontaneously asked about the word&#x2019;s meaning after hearing the Item. From the remaining three patients, only two gave an explanation of <italic>Individuum</italic> that was on target. One patient interpreted <italic>Individuum</italic> incorrectly. In conclusion, six of nine patients had issues understanding the word <italic>Individuum</italic>. Therefore, we adapted the item and evaluated the adaptation in the second round of the pretest.</p>
<p>In the second pretest round, we replaced the word <italic>Individuum</italic> (individual) by an explanation that followed the explanation of the Duden (German dictionary). The adjusted item was <italic>Das Personal respektiert mich mit all meinen Eigenschaften und Besonderheiten</italic> (Staff respect me with all my qualities and characteristics). None of the patients indicated issues in understanding there. Four of them agreed partially, three agreed and one patient agreed strongly. Again, we used a category selection probe to see how they came to their conclusion. Patients&#x2019; answers indicated that they interpreted the item as intended. Patients who agreed (strongly) stated, e.g., that they feel respected by staff the way they are and had a good relationship with them. Patients who agreed partly stated that this would apply at least for some members of staff. One patient additionally mentioned that the word <italic>Besonderheiten</italic> (characteristics) had a negative connotation to him. He explained that this could be interpreted like being special or &#x201C;nuts.&#x201D; Instead of that, he suggested <italic>Das Personal respektiert mich als Pers&#x00F6;nlichkeit</italic> (Staff respect me as a personality). We discussed that point during the analysis and agreed with the patient&#x2019;s view that an unintended negative connotation can be seen in this translation. Therefore, we adjusted the item again to <italic>Das Personal respektiert mich als Pers&#x00F6;nlichkeit mit all meinen Eigenschaften</italic> (about: Staff respect me as a personality with all my qualities). This version is based on the patient&#x2019;s suggestion and the Duden definition.</p>
</sec>
<sec id="sec17">
<title>3.2.6. Items 10 and 14 (It is fair I am here right now and the rules on the ward are fair)</title>
<p>The critical word in these items was <italic>fair</italic>, which can be translated into German literally as <italic>fair</italic> or &#x2013; according to the context &#x2013; as <italic>gerecht</italic> (just). Item 10 refers more to patients&#x2019; evaluation if their detention was justified, whereas Item 14 aims more at patients&#x2019; perception of the appropriateness of the wards rules and if they feel these rules are applied to all patients equally.</p>
<p>To explore if patients answering the FRQ also make a difference between the two terms <italic>fair</italic> and <italic>gerecht</italic>, we presented items 10 and 14 in both versions. Half of the pretest patients in round one were initially presented a version with <italic>fair</italic>, the remaining four patients with <italic>gerecht</italic>. After their initial rating, participants were presented the alternative and were asked if they had answered this question differently and if they saw a difference between the words <italic>fair</italic> and <italic>gerecht</italic>. Of nine patients in round one, eight replied that they would not answer the alternative question differently from the first one in Item 10. Nonetheless, three stated they see a difference between the words. These patients associated <italic>gerecht</italic> with reasonable consequences for their offences or justified by law. One of these patients noted that for them <italic>gerecht</italic> is more a term association with reason or cognition, <italic>fair</italic> more with emotional or sympathetic decision making. Two patients interpreted <italic>gerecht</italic> in a way that their detention is justified and that they can accept it. Defining the word <italic>fair</italic> was found to be difficult by the patients and only two were able to find a description. One described it as <italic>fair</italic> to be sent to a forensic hospital by court. The other one found <italic>fair</italic> to have a more positive, benevolent connotation than <italic>gerecht</italic>. In Item 14 only eight patients could answer this item (see below for explanation). From the eight patients seven replied they would not answer the alternative item differently from the initial wording. One patient stated he would answer both items differently. Again, three patients indicated they see a difference between <italic>fair</italic> and <italic>gerecht</italic>, although for one patient the difference was very small. Their explanations diverged. One patient described <italic>gerecht</italic> as a more objective term, whereas <italic>fair</italic> felt more subjective for him. The other two patients associated <italic>gerecht</italic> with consequences for violating rules and the absence of harassing behavior of staff. One of them additionally mentioned that fair would mean to treat everybody the same way.</p>
<p>In general, patients in round one described the terms <italic>fair</italic> and <italic>gerecht</italic> in a quite diverse way. Some of their descriptions were in line with our expectations, e.g., the association between <italic>gerecht</italic> and (objective, justified) court ruling where people receive punishment when breaking the law or <italic>fair</italic> to be more related to interpersonal fairness and treating everybody the same way. On the other way, patients also mentioned interpretations outside of our expectations. Because of the diverse interpretations and the difficulties to describe the term <italic>fair</italic>, we decided to test the item again in the second round to see if other patients agree with that interpretation.</p>
<p>The same procedure as in round one was applied in round two. Half of the patients were presented the version with <italic>fair</italic> first and then asked for the alternative with <italic>gerecht</italic> and the other half had the switched word order. Furthermore, we now asked all patients for their interpretation of <italic>fair</italic> and <italic>gerecht</italic>, and left out the question if they would see a difference between these terms.</p>
<p>For item 10 (<italic>It is fair that I am here right now</italic>) we found a larger variance in the answers in round two than in round one. Five patients interpreted the word <italic>gerecht</italic> in the legal context, e.g., they stated they accept the sentence to be in a forensic psychiatric hospital as justified and deserved. Another two patients mentioned a more distant legal context. One of them discussed the sentence in relation to the two people who were accomplices in his offence. Unlike his accomplices, who were sentenced to prison, the patient received a prison sentence and in addition was sent to a forensic psychiatric hospital, which he considered as unfair <italic>(ungerecht)</italic>. The other patient discussed the length of his sentence in relation to his victim&#x2019;s injuries. He felt the sentence length was disproportionate and therefore &#x2013; to some extent &#x2013; unfair (<italic>ungerecht</italic>). The remaining two patients discussed <italic>gerecht</italic> in a therapeutic interpersonal context. They were in forensic treatment repeatedly and considered that potentially unfair compared to other addicted offenders who offended for the first time. These people might also need treatment in a forensic psychiatric setting but could not be offered this because of the limited resources were are already taken up by them (the participating patients). The same explanation was given by three patients about their interpretation of the German word <italic>fair</italic>. They considered it <italic>unfair</italic> that they, as being repeatedly in forensic treatment, would take away a therapeutic option for first time offenders with a substance use disorder. The German <italic>fair</italic> was also mentioned by four patients in the context that they felt it was <italic>fair</italic> that their addiction was considered by the court and that they were given the opportunity for (forensic) treatment instead of a prison sentence only. One patient interpreted the German <italic>fair</italic> as justified, which implies a legal context.</p>
<p>Taken together both pretest rounds, for item 10 the majority of patients interpreted <italic>gerecht</italic> in a legal context as being justified or having a legal basis. <italic>Fair</italic> was more seen in an interpersonal context or in a way that individual circumstances were taken into consideration by the court. Other explanations also occurred that were not in line with our expectations.</p>
<p>Since the original item aims more for the patient&#x2019;s view on (legal) justice, which was mentioned by the professional translators as well as a reasonable number of patients, we decided for the alternative <italic>gerecht</italic> in item 10 (<italic>Es ist gerecht, dass ich zur Zeit hier bin</italic>).</p>
<p>With item 14 (<italic>The rules on the ward are fair</italic>) patients&#x2019; answers indicate that <italic>gerecht</italic> is more interpreted in the context of formal rules and that their violation has consequences whereas <italic>fair</italic> was described in several ways, e.g., as interpersonal fairness, the option to negotiate ward rules with staff but also as having consequences when violating ward rules.</p>
<p>Since the original item&#x2019;s intention aimed more for perception of interpersonal fairness and humane interaction than sticking to formal rules, the alternative <italic>fair</italic> appeared to be more appropriate for us. Unlike our initial intention for consistency, we decided to accept a different wording than in item 10 and choose the alternative <italic>fair</italic> for the FRQ (<italic>Die Regeln auf Station sind fair</italic>).</p>
<p>Furthermore, Item 14 revealed an unintended point that might be an issue and was not recognized by the translators before. This was the inappropriateness of some of the items for patients who are very advanced in their therapeutic process and might be allowed to leave the hospital for longer periods or reside outside the main hospital. Since these patients are visited by clinical staff at the facility they currently live in, they might not have contact to their former wards on a regular basis anymore. For these patients, items asking about their experiences during the last week on the ward does not make sense. These circumstances applied for one patient in pretest round one, who could not answer this item. We decided to take this into consideration in pretest round two and not invite patients in external living facilities to take part.</p>
</sec>
<sec id="sec18">
<title>3.2.7. 5-Point Likert scale, middle scale point (not sure)</title>
<p>During the first pretest round it turned out that some patients found the middle scale point to be inappropriate. For example, in Items 1 (<italic>I am treated like a human being here</italic>), 6 (<italic>Staff respect me as an individual</italic>), 8 (<italic>I am trusted by staff enough</italic>), and 12 (<italic>My rights are respected properly here</italic>) some patients indicated that there were differences in how they were treated by different members of staff or that some statements apply to their situation only sometimes. If the statement would apply for about half of the staff or about half the time, they tended to use the middle category. In that case, the German description of the middle scale point as <italic>unentschieden</italic> (undecided) did not match these thoughts. As one patient stated, he was not undecided, but had a clear opinion. Another patient mentioned that (regarding the hospital staff) some of them act in one way and some in another way. We saw the patients points as reasonable and, therefore, adjusted the middle scale point from <italic>unentschieden</italic> (undecided) to <italic>teils teils</italic> (partly). The term <italic>teils teils</italic> is a common alternative for the middle category in German questionnaires so we saw this as more appropriate and also as easy to accept by researchers and research participants. No issues occurred during the second round of the pretest so this adaptation was kept.</p>
</sec>
</sec>
</sec>
<sec id="sec19" sec-type="discussions">
<title>4. Discussion</title>
<p>This article describes the TRAPD approach developed by Harkness (<xref ref-type="bibr" rid="ref13">13</xref>, <xref ref-type="bibr" rid="ref22">22</xref>) as a translation approach and its application for the translation of the Forensic Restrictiveness Questionnaire [FRQ; (<xref ref-type="bibr" rid="ref14">14</xref>)] from English into German. In this approach, TRAPD is an acronym for the five steps of the process, namely translation, review, adjudication, pretest and documentation.</p>
<p>According to this approach, several translators with expertise in different fields (e.g., clinical, linguistic, cultural) translated the questionnaire first by themselves and then discussed the individual versions in a shared review discussion. The discussion was moderated by a person who was familiar with the overall project. The review moderator along with an adjudicator, who was also familiar with the project but not involved in the translation process so far, made the final decision about the translation. This draft was applied in a pretest with 17 forensic mental health patients in two rounds (with 9 and 8 patients each). The review discussion and the pretest rounds led to adaptations of the questionnaire, e.g., due to cultural differences, unintended implicit assumptions or ambiguous or difficult word choices. The result will be tested for its psychometric properties in a larger pilot study.</p>
<p>During the translational process the necessity and usefulness of different backgrounds of translators became obvious. The clinical expertise of two of the review translators supported appropriate cultural and contextual adaptations that could not be covered by the other review translators or the professional translators (e.g., finding an appropriate equivalent for CPA in item 4, which is a special component of Britain&#x2019;s health care system that has no equivalent in Germany). The lay translators&#x2019; translations tended to be shorter and more oriented towards everyday language that might be easier to understand and, therefore, more acceptable for patients. Finally, the professional translators contributed their expertise regarding linguistic topics like grammar, sentence structure and connotation. They were able to identify ambiguous wordings in the original or translated questionnaire (e.g., <italic>makes sense</italic> in item 15) as well as unintended connotations of words and phrases (e.g., in the translation of <italic>how you feel about</italic> in introductory sentence 2) and recognized potential issues with translated items due to unintended implicit assumptions (like the translation of <italic>hobbies</italic> in item 3). Furthermore, they had a better understanding of words that sound the same but have a broader or closer translation in one language (e.g., <italic>hobby</italic> in English versus <italic>Hobby</italic> in German, where Hobby has a closer meaning or <italic>fair</italic>, which has also a broader range of interpretations in English than it has in German). Combining all of this expertise enabled a translation ready for pretesting with the intended user population of forensic mental health patients.</p>
<p>The pretest with forensic mental health patients was done to check the professional translation for its comprehensibility. It revealed also further adaptation necessities. In some cases, patients&#x2019; answers confirmed assumptions that review or professional translators had before, e.g., that a literal translation of the English <italic>individual</italic> to <italic>Individuum</italic> in German (item 6) was not understood by a reasonable number of patients and, therefore, had to be altered. In other cases, patients pointed out shortcomings none of the translators had identified before, e.g., regarding an alternative translation of the Likert scale&#x2019;s midpoint that made more sense in their context or that some items are inappropriate for some patients, e.g., items 7, 14, and 15 which are statements about things on the ward and, therefore, are difficult to answer for patients already on a high level of leave and living in external facilities.</p>
<p>We conclude that the participation of translators with various backgrounds and a pretest with the intended user group (in this case, with forensic mental health patients) both added valuable input to the translation of the FRQ. Nonetheless, some limitations should be discussed. The number of translators who participated in that translation process was quite high. Also, the original TRAPD approach does not require an evaluation of the translation after the review discussion by further translators. This was done as an additional step of quality assurance. Since the professional translators added reasonable thoughts and ideas, it appears useful to include them in the team of initial translators so they can participate in the review discussion. Other limitations include the patient sample of the pretest. Despite an initial sampling plan, some subgroups were difficult to recruit for the patient pretest, especially women (one participant), but also patients with a migration background (two participants) who were underrepresented in the sample. Also, patients with schizophrenia were underrepresented (two participants). Since schizophrenia has an impact on peoples&#x2019; thinking (<xref ref-type="bibr" rid="ref23">23</xref>), we cannot rule out that some patients with schizophrenia might have issues in answering the FRQ. The fact that the FRQ is intended for respondents who are able to give informed consent might work against this. Therefore, the application of the FRQ will require careful participant selection with support of clinicians. The limited representation of these groups of patients is seen as a result of several factors. First, the treatment emphasis of the hospital the patients were recruited was on offender patients with substance use disorders. Therefore, the number of patients with schizophrenia was quite low. Second, the general proportion of females in forensic mental health institutions is quite low [about 5&#x2013;8%, (Statistisches (<xref ref-type="bibr" rid="ref15">15</xref>, <xref ref-type="bibr" rid="ref24">24</xref>))]. Furthermore, the clinic is located in a geographical an area with a quite low proportion of people with migration background (and hence, potential patients), compared to the rest of Germany.</p>
<p>Another limitation relates to the empirical background of the TRAPD approach. The TRAPD approach or comparable team approaches appear to be seldom used in psychological questionnaire translation but more often used in international survey research [e.g., (<xref ref-type="bibr" rid="ref25">25</xref>)]. We found almost no research on TRAPD or other team-based approaches being compared to more established translation approaches. This might be the reason why many translation guidelines for surveys and questionnaires do not make specific suggestions [e.g., (<xref ref-type="bibr" rid="ref7">7</xref>)]. There is some evidence that team-based approaches, such as the TRAPD, deliver the same or, in some points even superior results (<xref ref-type="bibr" rid="ref26">26</xref>, <xref ref-type="bibr" rid="ref27">27</xref>). Since the aim of this paper was the depiction of the TRAPD approach rather than a methodological comparison, we cannot say if a translation would have been superior if we used another approach. More research is needed that compares the several procedures and evaluate which one delivers reasonable translations along with an appropriate relation of effort and results.</p>
</sec>
<sec id="sec20" sec-type="data-availability">
<title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="sec21">
<title>Ethics statement</title>
<p>The studies involving human participants were reviewed and approved by Ethics Committee at the Rostock University Medical Center. The patients/participants provided their written informed consent to participate in this study.</p>
</sec>
<sec id="sec22">
<title>Author contributions</title>
<p>PW and BV contributed to conception and design of the study. PW organized and conducted the data collection and analysis and wrote the first draft of the manuscript. BV supervised the data collection and analysis process. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec id="conf1" sec-type="COI-statement">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="sec100" sec-type="disclaimer">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<sec id="sec24" sec-type="supplementary-material">
<title>Supplementary material</title>
<p>The Supplementary material for this article can be found online at: <ext-link xlink:href="https://www.frontiersin.org/articles/10.3389/fpsyt.2023.1199989/full#supplementary-material" ext-link-type="uri">https://www.frontiersin.org/articles/10.3389/fpsyt.2023.1199989/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Data_Sheet_1.PDF" id="SM1" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="ref1"><label>1.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sireci</surname> <given-names>SG</given-names></name> <name><surname>Harter</surname> <given-names>J</given-names></name> <name><surname>Yang</surname> <given-names>Y</given-names></name> <name><surname>Bhola</surname> <given-names>D</given-names></name></person-group>. <article-title>Evaluating the equivalence of employee attitude survey across languages, cultures, and administration formats</article-title>. <source>Int J Test</source>. (<year>2003</year>) <volume>3</volume>:<fpage>129</fpage>&#x2013;<lpage>50</lpage>. doi: <pub-id pub-id-type="doi">10.1207/S15327574IJT0302_3</pub-id></citation></ref>
<ref id="ref2"><label>2.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>B&#x00FC;hner</surname> <given-names>M</given-names></name></person-group>. <source>Einf&#x00FC;hrung in Die Test-Und Fragebogenkonstruktion</source>. <edition>3rd</edition> ed. <publisher-loc>M&#x00FC;nchen</publisher-loc>: <publisher-name>Pearson</publisher-name> (<year>2011</year>).</citation></ref>
<ref id="ref3"><label>3.</label><citation citation-type="book"><person-group person-group-type="author"><collab id="coll1">American Psychiatric Association</collab></person-group>. <source>Diagnostic and Statistical Manual of Mental Disorders</source>. <edition>5th</edition> ed. <publisher-loc>Arlington, VA</publisher-loc>: <publisher-name>American Psychiatric Association</publisher-name> (<year>2013</year>).</citation></ref>
<ref id="ref4"><label>4.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Niu</surname> <given-names>W</given-names></name> <name><surname>Brass</surname> <given-names>J</given-names></name></person-group>. <article-title>Intelligence in worldwide perspective</article-title> In: <person-group person-group-type="editor"><name><surname>Sternberg</surname> <given-names>RJ</given-names></name> <name><surname>Kaufman</surname> <given-names>SB</given-names></name></person-group>, editors. <source>The Cambridge Handbook of Intelligence</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name> (<year>2012</year>). <fpage>623</fpage>&#x2013;<lpage>46</lpage>.</citation></ref>
<ref id="ref5"><label>5.</label><citation citation-type="gov"><person-group person-group-type="author"><name><surname>Behr</surname> <given-names>D.</given-names></name> <name><surname>Braun</surname> <given-names>M.</given-names></name> <name><surname>Dorer</surname> <given-names>B.</given-names></name></person-group>. (<year>2015</year>). &#x201C;<article-title>Messinstrumente in Internationalen Studien</article-title>.&#x201D; <publisher-loc>Mannheim</publisher-loc>: <publisher-name>GESIS-Leibniz-Institut f&#x00FC;r Sozialwissenschaften</publisher-name>.</citation></ref>
<ref id="ref6"><label>6.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Behr</surname> <given-names>D</given-names></name></person-group>. <article-title>The team translation approach in questionnaire translation - a special form of expert collaboration</article-title> In: <person-group person-group-type="editor"><name><surname>Baur</surname> <given-names>W</given-names></name> <name><surname>Eichner</surname> <given-names>B</given-names></name> <name><surname>Kalina</surname> <given-names>S</given-names></name> <name><surname>Mayer</surname> <given-names>F</given-names></name></person-group>, editors. <source>&#x00DC;bersetzen in Die Zukunft. Dolmetscher Und &#x00DC;bersetzer: Experten F&#x00FC;r Internationale Fachkommunikation</source>. <publisher-loc>Berlin</publisher-loc>: <publisher-name>BD&#x00DC; Weiterbildungs- und Fachverlagsgesellschaft mbH</publisher-name> (<year>2012</year>). <fpage>644</fpage>&#x2013;<lpage>51</lpage>.</citation></ref>
<ref id="ref7"><label>7.</label><citation citation-type="book"><person-group person-group-type="author"><collab id="coll2">International Test Commission</collab></person-group>. <source>ITC guidelines for translating and adapting tests</source>. <edition>2nd</edition> ed. <publisher-loc>Hemel Hempstead</publisher-loc>: <publisher-name>International Test Commission</publisher-name> (<year>2017</year>).</citation></ref>
<ref id="ref8"><label>8.</label><citation citation-type="other"><person-group person-group-type="author"><collab id="coll3">Survey Research Center</collab></person-group>. (<year>2016</year>). Guidelines for best practice in cross-cultural surveys. Full Guidelines. Available at: <ext-link xlink:href="http://ccsg.isr.umich.edu/images/PDFs/CCSG_Full_Guidelines_2016_Version.pdf" ext-link-type="uri">http://ccsg.isr.umich.edu/images/PDFs/CCSG_Full_Guidelines_2016_Version.pdf</ext-link></citation></ref>
<ref id="ref9"><label>9.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Behr</surname> <given-names>D</given-names></name></person-group>. <source>Translationswissenschaft und international vergleichende Umfrageforschung: Qualit&#x00E4;tssicherung bei Fragebogen&#x00FC;bersetzungen als Gegenstand einer Prozessanalyse</source>. <publisher-loc>Bonn</publisher-loc>: <publisher-name>GESIS-Schriftenreihe</publisher-name> (<year>2009</year>).</citation></ref>
<ref id="ref10"><label>10.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maneesriwongul</surname> <given-names>W</given-names></name> <name><surname>Dixon</surname> <given-names>JK</given-names></name></person-group>. <article-title>Instrument translation process: a methods review</article-title>. <source>J Adolesc</source>. (<year>2004</year>) <volume>48</volume>:<fpage>175</fpage>&#x2013;<lpage>86</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1365-2648.2004.03185.x</pub-id></citation></ref>
<ref id="ref11"><label>11.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Behr</surname> <given-names>D</given-names></name></person-group>. <article-title>Assessing the use of Back translation: the shortcomings of Back translation as a quality testing method</article-title>. <source>Int J Soc Res Methodol</source>. (<year>2017</year>) <volume>20</volume>:<fpage>573</fpage>&#x2013;<lpage>84</lpage>. doi: <pub-id pub-id-type="doi">10.1080/13645579.2016.1252188</pub-id></citation></ref>
<ref id="ref12"><label>12.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Acquadro</surname> <given-names>C</given-names></name> <name><surname>Conway</surname> <given-names>K</given-names></name> <name><surname>Hareendran</surname> <given-names>A</given-names></name> <name><surname>Aaronson</surname> <given-names>N</given-names></name></person-group>. <article-title>Literature review of methods to translate health-related quality of life questionnaires for use in multinational clinical trials</article-title>. <source>Value Health</source>. (<year>2008</year>) <volume>11</volume>:<fpage>509</fpage>&#x2013;<lpage>21</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1524-4733.2007.00292.x</pub-id>, PMID: <pub-id pub-id-type="pmid">18179659</pub-id></citation></ref>
<ref id="ref13"><label>13.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Harkness</surname> <given-names>J</given-names></name></person-group>. <article-title>Translation</article-title> In: . <source>Guidelines for Best Practice in Cross-Cultural Surveys. Full Guidelines</source>. <edition>3rd</edition> ed. <publisher-loc>Ann Arbor</publisher-loc>: <publisher-name>Survey Research Center, Institute for Social Research, University of Michigan</publisher-name> (<year>2011</year>). <fpage>290</fpage>&#x2013;<lpage>351</lpage>.</citation></ref>
<ref id="ref14"><label>14.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Tomlin</surname> <given-names>J</given-names></name></person-group>. <source>Measuring Experiences of Restrictiveness in Forensic Psychiatric Care: Developing a Questionnaire</source>. <publisher-loc>Nottingham</publisher-loc>: <publisher-name>University of Nottingham</publisher-name> (<year>2019</year>).</citation></ref>
<ref id="ref15"><label>15.</label><citation citation-type="book"><person-group person-group-type="author"><collab id="coll4">Statistisches Bundesamt</collab></person-group>. <source>Strafvollzugsstatistik. Im Psychiatrischen Krankenhaus Und in Der Entziehungsanstalt Aufgrund Strafrichterlicher Anordnung Untergebrachte (Ma&#x00DF;regelvollzug)</source>. <publisher-loc>Wiesbaden</publisher-loc>: <publisher-name>Statistisches Bundesamt</publisher-name> (<year>2015</year>).</citation></ref>
<ref id="ref16"><label>16.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Petermann</surname> <given-names>F</given-names></name></person-group>. <source>WAIS-IV. Wechsler Adult Intelligence Scale</source>. <edition>4th</edition> ed. <publisher-loc>Frankfurt am Main</publisher-loc>: <publisher-name>Pearson Learning</publisher-name> (<year>2012</year>).</citation></ref>
<ref id="ref17"><label>17.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Berry</surname> <given-names>JW</given-names></name></person-group>. <article-title>Acculturation</article-title> In: <person-group person-group-type="editor"><name><surname>Grusec</surname> <given-names>JE</given-names></name> <name><surname>Hastings</surname> <given-names>PD</given-names></name></person-group>, editors. <source>Handbook of Socialization. Theory and research</source>. <edition>2nd</edition> ed. <publisher-loc>New York</publisher-loc>: <publisher-name>The Guilford Press</publisher-name> (<year>2015</year>). <fpage>520</fpage>&#x2013;<lpage>38</lpage>.</citation></ref>
<ref id="ref18"><label>18.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bongard</surname> <given-names>S</given-names></name> <name><surname>Etzler</surname> <given-names>S</given-names></name> <name><surname>Frankenberg</surname> <given-names>E</given-names></name></person-group>. <source>FRAKK. Frankfurter Akkulturationsskala</source>. <edition>1st</edition> ed. <publisher-loc>G&#x00F6;ttingen</publisher-loc>: <publisher-name>Hogrefe</publisher-name> (<year>2020</year>).</citation></ref>
<ref id="ref19"><label>19.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Behr</surname> <given-names>D</given-names></name> <name><surname>Zabal</surname> <given-names>A</given-names></name></person-group>. <source>Documenting Survey Translation</source>. <publisher-loc>Mannheim</publisher-loc>: <publisher-name>GESIS-Leibniz-Institut f&#x00FC;r Sozialwissenschaften</publisher-name> (<year>2020</year>).</citation></ref>
<ref id="ref20"><label>20.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Braun</surname> <given-names>V</given-names></name> <name><surname>Clarke</surname> <given-names>V</given-names></name></person-group>. <article-title>Using thematic analysis in psychology</article-title>. <source>Qual Res Psychol</source>. (<year>2006</year>) <volume>3</volume>:<fpage>77</fpage>&#x2013;<lpage>101</lpage>. doi: <pub-id pub-id-type="doi">10.1191/1478088706qp063oa</pub-id></citation></ref>
<ref id="ref21"><label>21.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Neuert</surname> <given-names>C</given-names></name> <name><surname>Lenzner</surname> <given-names>T</given-names></name> <name><surname>Hadler</surname> <given-names>P</given-names></name></person-group>. <source>ESS-Gerechtigkeit Und Fairness. Kognitiver Pretest</source>. <publisher-loc>Mannheim</publisher-loc>: <publisher-name>GESIS Projektbericht</publisher-name> (<year>2018</year>).</citation></ref>
<ref id="ref22"><label>22.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Harkness</surname> <given-names>J</given-names></name> <name><surname>Pennell</surname> <given-names>B</given-names></name> <name><surname>Schoua-Glusberg</surname> <given-names>A</given-names></name></person-group>. <article-title>Survey questionnaire translation and assessment</article-title> In: <person-group person-group-type="editor"><name><surname>Presser</surname> <given-names>S</given-names></name> <name><surname>Rothgeb</surname> <given-names>JM</given-names></name> <name><surname>Couper</surname> <given-names>MP</given-names></name> <name><surname>Lessler</surname> <given-names>JT</given-names></name> <name><surname>Martin</surname> <given-names>E</given-names></name> <name><surname>Martin</surname> <given-names>J</given-names></name> <etal/></person-group>, editors. <source>Methods for Testing and Evaluating Survey Questionnaires</source>. <publisher-loc>Hoboken</publisher-loc>: <publisher-name>Wiley &#x0026; Sons</publisher-name> (<year>2004</year>). <fpage>453</fpage>&#x2013;<lpage>73</lpage>.</citation></ref>
<ref id="ref23"><label>23.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schaefer</surname> <given-names>J</given-names></name> <name><surname>Giangrande</surname> <given-names>E</given-names></name> <name><surname>Weinberger</surname> <given-names>DR</given-names></name> <name><surname>Dickinson</surname> <given-names>D</given-names></name></person-group>. <article-title>The global cognitive impairment in schizophrenia: consistent over decades and around the world</article-title>. <source>Schizophr Res</source>. (<year>2013</year>) <volume>150</volume>:<fpage>42</fpage>&#x2013;<lpage>50</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.schres.2013.07.009</pub-id>, PMID: <pub-id pub-id-type="pmid">23911259</pub-id></citation></ref>
<ref id="ref24"><label>24.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Quereng&#x00E4;sser</surname> <given-names>J</given-names></name> <name><surname>Bulla</surname> <given-names>J</given-names></name> <name><surname>Hoffmann</surname> <given-names>K</given-names></name> <name><surname>Ross</surname> <given-names>T</given-names></name></person-group>. <article-title>Predictors of ReOffending in German substance-abusers in legal detention: a prospective population based cohort study</article-title>. <source>J Forensic Psychiatry Psychol</source>. (<year>2018</year>) <volume>29</volume>:<fpage>337</fpage>&#x2013;<lpage>50</lpage>. doi: <pub-id pub-id-type="doi">10.1080/14789949.2017.1387926</pub-id></citation></ref>
<ref id="ref25"><label>25.</label><citation citation-type="book"><person-group person-group-type="author"><collab id="coll5">European Social Survey</collab></person-group>. <source>ESS Round 8 Translation Guidelines</source>. <publisher-loc>London</publisher-loc>: <publisher-name>European Social Survey</publisher-name> (<year>2016</year>).</citation></ref>
<ref id="ref26"><label>26.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hagell</surname> <given-names>P</given-names></name> <name><surname>Hedin</surname> <given-names>PJ</given-names></name> <name><surname>Meads</surname> <given-names>DM</given-names></name> <name><surname>Nyberg</surname> <given-names>L</given-names></name> <name><surname>McKenna</surname> <given-names>SP</given-names></name></person-group>. <article-title>Effects of method of translation of patient-reported health outcome questionnaires: a randomized study of the translation of the rheumatoid arthritis quality of life (RAQoL) instrument for Sweden</article-title>. <source>Value Health</source>. (<year>2010</year>) <volume>13</volume>:<fpage>424</fpage>&#x2013;<lpage>30</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1524-4733.2009.00677.x</pub-id>, PMID: <pub-id pub-id-type="pmid">20070642</pub-id></citation></ref>
<ref id="ref27"><label>27.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname> <given-names>WL</given-names></name> <name><surname>Chinna</surname> <given-names>K</given-names></name> <name><surname>Abdullah</surname> <given-names>KL</given-names></name> <name><surname>Abidin</surname> <given-names>IZ</given-names></name></person-group>. <article-title>The forward-backward and dual-panel translation methods are comparable in producing semantic equivalent versions of a heart quality of life questionnaire</article-title>. <source>Int J Nurs Pract</source>. (<year>2019</year>) <volume>25</volume>:<fpage>e12715</fpage>. doi: <pub-id pub-id-type="doi">10.1111/ijn.12715</pub-id></citation></ref>
</ref-list>
</back>
</article>