ORIGINAL RESEARCH article
Sec. Drugs Outcomes Research and Policies
Development of a Complex Intervention to Improve Adherence to Antidiabetic Medication in Older People Using an Anthropomorphic Virtual Assistant Software
- 1Unidade de Investigação e Desenvolvimento em Enfermagem (UI&DE), Lisbon Nursing School, Lisbon, Portugal
- 2Centro de Investigação Interdisciplinar Egas Moniz (CiiEM), Instituto Universitário Egas Moniz, Monte de Caparica, Portugal
- 3iMed.ULisboa, Faculty of Pharmacy, University of Lisbon, Lisbon, Portugal
- 4Biosystems & Integrative Sciences Institute (BioISI), Faculty of Sciences, University of Lisbon, Lisbon, Portugal
- 5Sport Sciences School of Rio Maior, Polytechnic Institute of Santarém, Santarém, Portugal
Introduction: Improving adherence to antidiabetic medication is crucial, resulting in improved health outcomes, cost reduction, and minimization of waste. A lack of underlying theory in existing interventions may explain the limited success in sustaining behavior change. This paper describes the development of a theory and evidence-based complex intervention to improve adherence to oral antidiabetics in older people via a software prototype with an anthropomorphic virtual assistant.
Methods: The Behavior Change Wheel (BCW) was used to develop a theoretical understanding of the change process, corresponding to the first phase of the Medical Research Council Framework for developing and evaluating complex interventions. At the BCW core is a model of human behavior (COM-B), which posits that human behavior (B) results from the interaction between capabilities (C), opportunities (O), and motivation (M). Literature-derived medication adherence determinants were mapped onto COM-B components. Then, intervention functions (IFs) were selected employing the APEASE criteria. Finally, standardized behavior change techniques (BCTs) were chosen based on their suitability and their effectiveness on medication adherence trials. The prototype was developed for android devices; its core was implemented in Unity3D, using a female 3D virtual assistant, named Vitória.
Results: Two COM-B components were identified as main targets for behavior change—psychological capability and reflective motivation; these were linked with four IFs—education, persuasion, enablement, and environmental restructuring. Eleven BCTs were, in turn, linked with the IFs. An example of a BCT is “problem solving”; it requires users to pinpoint factors influencing non-adherence and subsequently offers strategies to achieve the desired behavior. BCTs were operationalized into the dialogues with Vitória and into supplementary software features. Vitória communicates with users verbally and non-verbally, expressing emotions. Input options consist of buttons or recording values, such as medication taken.
Conclusion: The present approach enabled us to derive the most appropriate BCTs for our intervention. The use of an explicit bundle of BCTs, often overlooked in interventions promoting medication adherence, is expected to maximize effectiveness and facilitates replication. The first prototype is being refined with users and health professionals’ contributions. Future work includes subjecting the prototype to usability tests and a feasibility trial.
Globally, diabetes affects more than 425 million people, of which one-third is older than 65 years (International Diabetes Federation, 2017). Type 2 diabetes (T2D) is the most prevalent form around the world, affecting 90% of the diabetic adults (Zheng et al., 2018). Glycemic control, which is key to prevent complications, requires sustained adherence to an appropriate diet, adequate physical activity, and, frequently, antidiabetic medication.
A systematic review including 27 studies found that adherence to antidiabetic medication can be as low as 38.5% (Krass et al., 2015). A recent study reported an overall antidiabetics adherence in older people of 72.4% (Juste et al., 2018). Additionally, Spanish elderly patients receiving oral antidiabetics showed rates of discontinuation for oral antidiabetics of 46.8% (Menditto et al., 2018).
Poor medication adherence in T2D is associated with negative outcomes, including increased morbidity and mortality, increased costs of ambulatory and hospital care, as well as loss of quality of life (Iuga and McGuire, 2014).
A wide array of factors associated with non-adherence has been described, which may differ according to study designs. For example, key nonpatient factors (e.g., healthcare systems limitations), non-modifiable patient factors (e.g., young age, low income level), and modifiable patient factors (e.g., beliefs about perceived treatment efficacy and medication burden) may be associated with non-adherence (Polonsky and Henry, 2016). Capoccia et al. (2016) mentioned lower adherence when medications were not tolerated or were taken more than twice daily.
Strategies to overcome poor medication adherence should consider the reduction of the medication burden, not only from a drug perspective (e.g., using fixed combinations) but also tools for an easier therapy management, plus responding to negative medication beliefs (Polonsky and Henry, 2016; Capoccia et al., 2016). Modifiable psychosocial factors belong to the overarching domains of knowledge, beliefs (and related cognitive constructs), behavioral skills, and coping (Gonzalez et al., 2016); thus, interventions targeting these aspects are expected to improve antidiabetic medication adherence.
Until recently, very few interventions to improve medication adherence were technology-based. Williams et al. (2014) reported a systematic review on effective interventions to improve medication adherence in T2D, in which the literature was searched from 2000 to 2013. The authors only found five studies using mobile phones or the Internet.
The advantages of technology-based interventions include automation and convenience of access. While simple electronic reminders, such as SMS, have shown improvement in medication adherence in chronic diseases (Vervloet et al., 2012), they are not without caveats. These reminders target essentially unintentional non-adherence and their long-term effects are uncertain (Vervloet et al., 2012). Technological development brought supplementary approaches, such as web-based interfaces, mobile applications, or smartwatches.
Currently, one of the most used technologies is referred to as mHealth apps (mobile health applications, typically for iOS or android devices). The rapid growth of these apps occurs in the context of aging population. The mHealth advances align well with the growing interest of older adults to integrate technology in the self-management of chronic conditions (Gilbert et al., 2015; Kim and Lee, 2017).
Concerning medication adherence, Anglada-Martinez et al. (2015) concluded that 65% of the mHealth application trials reported positive results. Virtual humans, designed to build long-term socioemotional relationships with users, can be incorporated in mHealth applications. Such virtual humans are commonly referred to as relational agents, although the term is often used interchangeably with virtual agent or assistant. There is a considerable body of knowledge on the effect or acceptability of relational agents in different populations. The acceptability to older people, including those with low literacy, has been studied (Bickmore et al., 2010). These authors found that individuals with inadequate literacy generally report higher levels of satisfaction with the relational agent and ask more questions than those with adequate health literacy. This has implications for our project, as the health literacy of older people in Portugal is limited (Mota-Pinto et al., 2010; Paiva et al., 2017).
Additionally, research suggests that a relational agent software is effective in promoting medication adherence and accepted by people with schizophrenia (Bickmore et al., 2010). Recently, the effect of an embodied conversional agent on antiretroviral therapy adherence was researched, using a 3-month pre-post design (Dworkin et al., 2019). This study demonstrated a positive effect on pill count, which improved from 62% at baseline to 88% at follow-up. The use of these agents to support diabetes self-care, including medication adherence, seems to have received less attention. Exceptions are papers describing coaching interventions for diabetes patients, which focus on medication adherence (op den Akker et al., 2011; Monkaresi et al., 2013). However, these papers lack data on usability or the effect on endpoints of interest.
The present paper aims to describe the development of a theory and evidence-based complex intervention to improve adherence to oral antidiabetics in older people via a software prototype with an anthropomorphic virtual assistant (VASelfCare). This is part of a wider intervention, targeting also lifestyle change of elderly T2D patients.
Materials and Methods
Complex interventions include several interacting components that impact on the length and complexity of the causal chain and are influenced by features of the local context (Craig et al., 2008). The components usually include behaviors, characteristics of behavior (e.g., timing) and methods of organizing, and delivering those behaviors (e.g., setting and location). Many healthcare interventions are considered complex. The Medical Research Council (MRC) framework for developing and evaluating complex interventions has been widely employed (Bleijenberg et al., 2018); it provides guidance on the methodological and practical decision-making on healthcare interventions. The rationale for resorting to this framework is that interventions carefully designed and tested in an early stage are more likely to prevent negative or inconclusive trials (Craig et al., 2008).
Figure 1 depicts the MRC framework phases. Phase 1 encompasses three elements (Craig et al., 2008), two of which are focused in the present paper: “identifying the existing evidence” and “identifying or developing theory.” Identifying the existing evidence included a mapping review on the effectiveness of relational agents, on the design of these interventions and on successful medication adherence interventions. We followed guidelines for self-management of people with T2D, focusing on key dimensions of lifestyle (diet and physical activity) plus medication adherence (Powers et al., 2015). It has been suggested that interventions targeting behaviors in a stepwise approach are more effective in promoting change than targeting multi-behaviors simultaneously (Sweet and Fortier, 2010).
Figure 1 Medical Research Council framework (Craig et al., 2008).
The mapping review informed the intervention components. One of the intervention components is the nurse interaction with older people upon referral from the software prototype, in predefined circumstances. Moreover, the experience of Bleijenberg and colleagues (2018) with the MRC framework indicates that it is important to consider the elements of context, e.g., how the receiver (older people with T2D) and the provider (nurse) interact within the intervention. In Portugal, diabetes nursing consultations in primary care have been formally established as supplementary to medical consultations.
Another key task in phase 1 (Figure 1) is to develop a theoretical understanding of the underlying processes of change. The section Deriving the Active Ingredients of the Intervention describes the use of theory for deriving the active ingredients of the intervention. Then the section Development of the VASelfCare Software Prototype provides a brief description of how the software prototype was developed.
Deriving the Active Ingredients of the Intervention
We chose the Behavior Change Wheel (BCW) (Michie et al., 2014) as the theoretical framework underpinning the intervention. The BCW is a recent approach to design research of behavior change interventions through a systematic and structured process (Michie et al., 2011; Cane et al., 2012). This process enables the evidence-based selection of intervention components, ensuring that the intervention targets the underlying determinants of behavior.
At the BCW core is a model of human behavior—the COM-B—which posits that human behavior (B) results from the interaction between physical and psychological capabilities (C), opportunities provided by the physical and social environment (O) and reflective and automatic motivation (M) (Michie et al., 2014). The COM-B is supported by the Theoretical Domains Framework (TDF), which describes 14 factors derived from 33 theories of behavior change. These factors fall under the categories of capability, opportunity, and motivation (Cane et al., 2012).
In the next sections, we will describe the stepwise approach to derive behavior change techniques (BCTs) for improving medication adherence based on the BCW.
Stage 1: Understanding the Behavior
We tackled this stage by reviewing the evidence on adherence and its determinants, which includes both barriers and facilitators to medication use. Several recent systematic literature reviews on determinants of adherence have been published. In particular, we draw on the seminal WHO on adherence determinants (Sabaté, 2003) and on systematic reviews and literature with the same scope to understand influences to medication use (Gellad et al., 2011; Kardas et al., 2013; Zeber et al., 2013; Capoccia et al., 2016; Yap et al., 2016; Choi and Smaldone, 2018). Subsequently, we mapped these determinants into the COM-B and identified key domains more influential to behavior change, through a multidisciplinary consensus discussion within the research team. This team has expertise in nursing, medication adherence, clinical pharmacology, and clinical communication.
Stage 2: Identifying Intervention Functions
Intervention functions (IFs) are defined as “broad categories of means by which an intervention can change behavior” (Michie et al., 2014, 192). Based on a systematic review of frameworks of behavior change interventions, Michie et al. (2011) put forward nine IFs. The BCW links COM-B domains to IFs and subsequent policy categories most likely to achieve behavioral change (Michie et al., 2011, 2014). Policy categories represent “types of decisions made by authorities that help to support and enact the intervention” (Michie et al., 2014, 235). We did not address these categories as they fell outside the scope of our intervention.
The IFs and their relation to the COM-B domains were organized in a mapping matrix (Michie et al., 2014). The former were selected based on their links to COM-B domains, as prescribed by the authors (Michie et al., 2014). The same IF can be linked to different COM-B domains. IFs most likely to affect behavior change were selected in a multidisciplinary consensus discussion within the research team, using the APEASE criteria: 1) affordability, 2) practicality, 3) effectiveness and cost-effectiveness, 4) acceptability, 5) side-effects/safety, and 6) equity (Michie et al., 2014).
Stage 3: Identifying Behavior Change Techniques
A BCT is an observable, replicable, and irreducible component of an intervention designed to change behavior (Michie et al., 2013). BCTs are known as the active ingredients of the intervention. They have been organized in a taxonomy, designated in brief by BCTTv1 (Michie et al., 2013; Cane et al., 2015), which provides a definition for each of the 93 techniques, enabling a consistent application.
There is guidance on the BCTs better suited to certain IFs and their underlying theoretical domains (Michie et al., 2008; Cane et al., 2015). From the list of 93 BCTs, the most appropriate for our intervention were selected based on:
● The most common BCTs under each IF (Michie et al., 2014).
● A multidisciplinary discussion informed by the APEASE criteria, in particular on the practicality of including the BCT in light of the automated nature of the intervention.
Development of the VASelfCare Software Prototype
We decided that the application would run in tablets with android system without requiring Internet connection. This decision was grounded on the need to secure inclusive access, considering that presently a significant percentage of older adults’ homes do not have Internet available (INE, 2014). Such decision, in turn, influenced software development options.
The overall development of the application was guided by usability principles for older people with T2D (Arnhold et al., 2014). For example, redundancy of both audio and written information may help reduce any communication shortcomings, such as lower eyesight accuracy and hearing deficits.
The core of VASelfCare solution was implemented in Unity3D (https://unity3d.com/pt), a software for the development of video games.
The virtual assistant chosen for this first prototype was a female 3D model with a realistic look, obtained from Daz3D (https://www.daz3d.com/). The choice for a 3D character is supported by studies that concluded that realistic-looking virtual agents are more appropriate for medical tasks (Ring et al., 2014; van Wissen et al., 2016). Other applications have also employed female figures as relational agents, for example (Bickmore et al., 2005a; Bickmore et al., 2005b).
Body animations and facial expressions are activated by the software that controls the virtual assistant behavior and verifies the context of the on-going interaction. Conveying emotions to users, beyond messages content, intends to establish an affective and effective communication. Furthermore, this has been acknowledged as the cornerstone for engagement and long-term use (Bickmore et al., 2010).
To support the virtual assistant speech, first dialogues had to be created, then the corresponding sound is generated and mouth animations that simulate the articulation of the sound were provided.
Dialogues were iteratively created by team members with a nursing and pharmacy background. Quality of the output was ensured by agreeing on principles at the outset of the process, by discussing dialogue structured regularly and through independent double-checking of scripts. To streamline this creative process, we adopted Yarn (https://github.com/InfiniteAmmoInc/Yarn), a graphical dialogue editor simple to use and compatible with the other software tools that were being used. Yarn provides an interface where the speech lines of the virtual assistant and the options that the user may choose (i.e., buttons in the interface) are inserted in text boxes. These are sequentially connected in a way that expresses the possible progressions of the dialogue during the interaction between the user and the virtual assistant.
General principles were deployed to write a comprehensive and optimal dialogue for each individual user (Migneault et al., 2006). One principle was tailoring content, which has been defined as “any combination of information and behavior change strategies intended to reach one specific person based on characteristics that are unique to that person related to the outcome of interest and derived from an individual assessment” (Kreuter et al., 2000). A meta-analysis showed that tailored web-based interventions have a significantly greater effect in health behavior outcomes than non-tailored counterparts (Lustria et al., 2013). Another principle was personalization, which broadly involves giving an indication that the software “knows who is talking to” (Migneault et al., 2006). A non-judgmental approach was employed to create the dialogues, resorting to a helpful-cooperative communication style (Niess and Diefenbach, 2016). Such an approach aims at creating rapport and a trust-bond, so that effectiveness of BCTs may be enhanced, along with other psychological benefits, as reported in the literature on virtual assistant-based interventions (Velicer et al., 2015).
A rule-based component was implemented to control the dialogue flow of the interaction. This component corresponds to the definition of a set of if–then rules (rules of the form “if some conditions hold then execute some action”), where the conditions may include context information regarding the interaction (e.g., user characteristics, such as age, or the date when interaction takes place) and the action represents the subsequent locutionary act performed by the virtual assistant. This approach allows greater flexibility in the dialogue definition and in the generation of diversified interactions.
Speech2Go from Harpo (https://harposoftware.com) was used to generate the audio files. This is a text-to-speech (TTS) software, which converts the written dialogues to audio speech. Since the virtual assistant is currently represented by a female character, the female voice of Inês, a European Portuguese voice, has been used. The speech rate has been slowed down, taking into consideration the target population.
Visemes describe the animations of the virtual assistant’s mouth that simulate phonemes’ articulation. Conversion of written dialogues to the viseme files is performed by a software developed in a previous project (Cláudio et al., 2015).
SQLite (https://www.sqlite.org/index.html) was the database engine chosen to control all the information stored locally in each tablet as it encompasses a secure storage mechanism. The local database, initially empty, will store clinical data registered by the care nurse, such as the prescribed antidiabetic medication, weight, and HbA1c. It will then be filled with data inserted during user interactions, including clinical data such as blood glucose levels, medication taken, and number of daily steps. These data are deployed in future interactions with the user and enable analysis at a later stage, contributing to the further development of the software prototype. Periodically, the database in each tablet is copied to an institutional computer using a secure connection and the access to this repository is reserved for credentialed personal. Privacy is further ensured by restricting access to this repository only to the researcher responsible for data analysis; data will be extracted omitting any reference that could identify the user.
Deriving the Active Ingredients of the Intervention
Stage 1: Understanding the Behavior
The target behavior of this intervention is medication adherence, defined briefly as the behavioral response to an agreed medical recommendation (Sabaté, 2003). Recently, medication adherence has been defined as a process consisting of three stages: initiation, implementation, and discontinuation (Vrijens et al., 2012). The target behavior for this intervention was further defined as taking between 80% and 100% of the prescribed antidiabetic doses. The 80% cut-off point is underpinned by previous research that stratified adherent and non-adherent individuals based on predicting subsequent hospital admission across prevalent chronic conditions, including diabetes (Karve et al., 2009). The clinical implications of non-adherence to antidiabetic agents have been discussed earlier in the Introduction section.
To be effective the software prototype should target modifiable determinants of adherence (Allemann et al., 2016). Therefore, determinants with a negative effect on adherence, amenable of change by the prototype or other intervention components, were extracted from the literature (Gellad et al., 2011; Kardas et al., 2013; Zeber et al., 2013; Capoccia et al., 2016; Yap et al., 2016; Choi and Smaldone, 2018). For example, medication cost is not directly modifiable by the software prototype, but can be addressed via referral to the primary care nurse. The same applies to suspected adverse drug reactions, which the prototype cannot manage on its own. Table 1 depicts the determinants influential on behavior change mapped into key domains of the COM-B.
Stage 2: Identifying Intervention Functions
Table 2 presents the IFs selected and the reasons for their inclusion or exclusion. Overall, two IFs—“modeling” and “training”—were excluded because they were deemed impracticable to be applied via the software.
Stage 3: Identifying Behavior Change Techniques
Eleven BCTs were selected to be included in the software prototype (Table 3).
The selected BCTs can serve more than one IF. For example, “feedback on behavior” could be linked to the “education” and “persuasion” functions. This BCT was operationalized by providing information on medication-taking behavior via a chart (Figure 2), described by the virtual assistant, plus giving supportive messages about the user’s abilities to perform the desired behavior. Figures 3, 4, and 5 depict software interfaces representing “biofeedback,” “self-monitoring of behavior,” and “problem-solving,” respectively. While the software prototype is in Portuguese, we present figures in English to facilitate readers’ understanding.
Figure 2 Calendar depicting antidiabetics-taking for one oral antidiabetic, two daily doses; question mark means no self-reported data (“feedback on behavior”).
Figure 4 Virtual assistant collecting information on antidiabetics-taking (“self-monitoring of behavior”).
Figure 5 Virtual assistant listing factors that influence antidiabetics adherence (“problem-solving”).
Development of the Medication Adherence Component of the VASelfCare Prototype
Prior to the user’s first interaction with the prototype, registration by a nurse providing care in diabetes consultations is required. There is a specific interface for this purpose that includes mandatory clinical information, such as the prescribed antidiabetic medication and the last HbA1c level.
When a user interacts with the prototype for the first time, a number of features are available. A key feature, described in the next section, is the dialogue view, in which the user interacts with Vitória, an anthropomorphic virtual assistant. Supplementary features are offered in other views. The prototype is designed to allow no more than one full interaction with Vitória per day. Access to the other views is unrestricted.
Interaction With the Dialogue View
Vitória is capable of speaking, by means of a synthetic voice, and features also text subtitles, reproducing the verbal content. Furthermore, Vitória expresses herself non-verbally with users, providing emotions through facial and body animations, depending on the user’s response. The user communicates with Vitória using buttons or by recording values, such as medication taken.
To attain a more convincing experience, the 3D scenario where Vitória is displayed changes, for example, according to the time of the day and season of the year.
Initially, the user is prompted to select a component to start with (medication adherence or lifestyle changes—diet or physical activity). Assuming the medication component is selected, the first 3 days are devoted to evaluation. The main purpose of this phase is to collect data on user’s knowledge about antidiabetic agents, current behavior on medication-taking and perceived self-efficacy in medication management, for future tailoring of the intervention.
The evaluation phase was structured as a six-step interaction: opening; social talk; assessment; feedback; pre-closing; and closing. This structure has been adapted from the literature (Bickmore et al., 2005b). The “opening” step consists of greeting the user and it is followed by the “social talk,” which includes inquiries about the user’s general emotional and physical state (e.g., “how are you feeling today?”). “Assessment” is the step in which questions about the aforementioned constructs are posed. In the “feedback” step, brief information on the answers is provided. Finally, the contents of the next interaction are described (“pre-closing”) and a farewell is delivered (“closing”).
The second phase, designated by follow-up, has a main purpose of promoting the desired behavior or to maintaining it. The dialogues in this phase are also structured in repeated sequential steps, described in the literature (Bickmore et al., 2005b). The first two (opening and social talk) and the last two steps (pre-closing and closing) correspond to those described in the evaluation phase. In the “review tasks” step, information is collected about previously agreed tasks or behaviors. Then, feedback is provided and behavior determinants are discussed where pertinent (“assess”). The “counseling” step has a twofold end. Firstly, it offers strategies to overcome previously identified adherence barriers, if applicable. Secondly, it provides tailored educational contents to users. This is exemplified by information about adverse drug reactions, according to knowledge gaps identified in the evaluation phase. In the “assign tasks” step, the user negotiate new behavioral goals and tasks with Vitória.
The selected BCTs are incorporated into different steps of the dialogues, as shown in Table 4.
Tailoring was applied not only at the information level, but also in what concerns specific BCTs. For instance, social support (Table 4) is only employed when non-adherence determinants cannot be addressed by the software prototype.
This article illustrates a systematic, evidence-driven, and theory-based approach to specify the content and active ingredients of a software prototype, devised to improve medication adherence in older adults with T2D.
Older age has been related to better medication adherence; for example, a systematic review identified increasing age as a factor positively associated with adherence to diabetes medication (Krass et al., 2015). Likewise, a meta-analysis by Choi and Smaldone (2018) indicates that the elderly are more likely to take diabetes medication as prescribed, when compared with younger adults. While per se older age seems to affect positively adherence, it is widely recognized that non-adherence is multidimensional. Other factors such as multiple morbidities, regimen complexity, cognitive decline, dexterity, and medication cost can impair adherence (Gellad et al., 2011). This case is illustrated by recent Portuguese data on medication adherence in type 2 diabetic patients measured by the Morisky Medication Adherence Scale (MMAS-4), which categorizes adherence in good, median, and bad (Pinto et al., 2019). The 60 to 79 years group presented both a higher proportion of good and bad medication adherence in relation to lower age groups. The fact that adherence interventions in older people merit research efforts is illustrated by the plethora of trials addressing this population group (Marcum et al., 2017).
We departed from published literature on potential determinants of medication adherence to ensure that the intervention targets known modifiable factors. Four IFs associated with psychological capability and reflective motivation in the COM-B model were subsequently selected—education, persuasion, enablement, and environmental restructuring—resorting to structured criteria (APEASE). Finally, 11 standardized BCTs were chosen from the BCTTv1, based on their suitability to the selected IFs and their effectiveness on medication adherence research trials. This developmental process was guided by the work of Cane and colleagues (2015) and the mapping work from Michie and collaborators (2008).
Morrissey et al. (2016) surveyed 166 smartphone medication adherence applications on the market to identify the BCTs present. From a range of 93 possible techniques (Michie et al., 2013), only 12 were found in the evaluated applications. In accordance with our work, the most common ones were “action planning” and “prompt/cues,” followed by “self-monitoring” and “feedback on behavior” (Morrissey et al., 2016).
Interventions to improve medication adherence often use BCTs combinations. Future research could examine which particular BCTs or combinations of BCTs are most effective in changing the medication-taking behavior in older people via a relational agent software. A recent study based on a different BCTs taxonomy found that specific BCTs configurations were effective in promoting medication adherence in the context of non-digital interventions (Kahwati et al., 2016). Overall, there is paucity of evidence on this topic, in particular concerning BCTTv1, maybe related to its novelty.
From the software standpoint, we have obtained a first prototype of a multi-behavior intervention, designed in light of usability requirements of older adults. It features an anthropomorphic virtual assistant, designed as a relational agent, able to communicate verbally and non-verbally in an empathic fashion. The agent tailors information to users’ level of knowledge, self-reported adherence, and perceived self-efficacy in managing medication. Moreover, it personalizes the interaction by, for example, mentioning the user’s name and referring to a relative or friend. The prototype offers several features in addition to the dialogue with the virtual assistant, such as a calendar depicting antidiabetics-taking behavior and a chart with HbA1C levels.
The question of whether applications to promote medication adherence using anthropomorphic virtual agents are advantageous when compared to their simpler, text-only counterparts, remains essentially unanswered. The few studies published present limitations, such as relatively small and younger non-clinical populations, which raises generalizability issues for older populations with prevalent chronic diseases. For instance, one study compared an application for behavior change in healthy eating using a female virtual agent versus simple text messages in a sample of 60 higher education students (Mazzotta et al., 2009); information quality and persuasion strength were better rated for the virtual agent modality. By contrast, a study comparing a virtual coach for healthy lifestyle versus text messages in a sample of 43 office workers was unable to demonstrate the virtual agent superiority (op den Akker et al., 2016). Once our intervention is matured, it can get trialed, contributing to answer this question.
Strengths and Limitations
One of the strong points of our work is the theory-driven approach we pursued to the development of the medication adherence intervention. Absence of a theoretical underpinning has been associated with limited effectiveness in these interventions in older people and other patient groups (Nieuwlaat et al., 2014; Patton et al., 2017). Resorting to theory enables a better understanding of the behavior change process (Patton et al., 2017) and tends to have a significant effect on outcomes (Webb et al., 2010).
Another strength is providing a detailed description of the chosen BCTs. Published work on the development of behavior change interventions does not always offer such a description (Wells et al., 2012; Glasziou et al., 2014), which is critical to tout reproducibility. Portraying the content used in an intervention is crucial for reporting, replication, and synthesizing evidence (Proctor et al., 2013; Hoffmann et al., 2014).
However, this work presents also limitations. One of the limitations is whether the behavior change strategies devised by us truly represents a particular BCT. For instance, we were of the understanding that monitoring and recording blood glucose levels did not represent “self-monitoring of outcomes of behavior (2.4)”, as we did not provide a method for that purpose, indicating timing and frequency, as others did (Goyal et al., 2016). We attempted to overcome this uncertainty by in-depth discussion within the research team, aided by examples of BCTs in the scientific literature.
Another drawback is the fact that evidence on the effect of BCTs in medication adherence is limited. For instance, while a Cochrane review reported that education, counseling, daily treatment support, and additional support from family or peers were effective for improving adherence (Nieuwlaat et al., 2014), the interventions description may be insufficient to allow coding with a taxonomy. Furthermore, there are cases in which no standardized description of the active components is provided, nor referenced to a taxonomy. This is exemplified by a systematic review on effective interventions to improve medication adherence in T2D (Williams et al., 2014). Problem-solving emerged as effective in improving medication adherence and HbA1c levels (Williams et al., 2014), but it is arguable what it actually means. In other studies interventions addressed problem-solving through action plans and goal setting (Walker et al., 2011; Bogner et al., 2012; Sapkota et al., 2015); it is unclear whether these techniques are identical to their counterparts in BCTTv1. Describing interventions using a comprehensive taxonomy with agreed definitions could promote a better integration of research findings into practice and consequently to building a cumulative knowledge of intervention effectiveness (Presseau et al., 2015).
From an operational standpoint, one of the limitations of the current prototype is that medication adherence and tolerability is assessed only in respect to oral antidiabetics. Future efforts should be directed to the full medication regimen of users and not only blood glucose lowering medication.
The virtual assistant was designed to establish rapport and trust and to provide automated, long-term support to older adults with T2D, supplementing nursing and other health consultations. As previously mentioned, the virtual assistant is able to discuss nonadherence determinants and, according to the adherence barrier identified, provides strategies to overcome them. For example, beliefs about medicines may be tackled by providing information about antidiabetics medication and the disease. This represents a step ahead of many currently available applications. However, it is unlikely that the relational agent is able to manage all instances of non-adherence. The prototype is programed to refer to the primary care nurse or other healthcare professional if problems persist, potentially preventing sustained lack of adherence.
We have obtained a first prototype of a software application with an anthropomorphic virtual assistant, which has been used to elicit informed opinions on pre-requisites from nine older people with T2D and 19 health professionals’ in five primary care units of the Portuguese national health service (ethical approval 6104/CES/2018/ARSLVT). Results were overall positive and highlighted opportunities for improvement. These were prioritized and actioned.
In parallel with the software development, we are conducting a cross-sectional study in three primary care units to characterize the study population in respect to variables of interest, such as functional and cognitive status, HbA1c levels, and medication adherence. These results will inform the feasibility trial.
The next step is subjecting the prototype to usability tests in a purposive sample of around 10 older patients with T2D, employing the Portuguese version of the System Usability Scale (SUS) (Martins et al., 2015). Usability will also be evaluated by up to five experts, chosen by their experience in aspects such as interface design and diabetes management. This iteration will contribute to further fine-tune the prototype.
Subsequently, the software prototype will be tested in a non-randomized, non-controlled feasibility trial in participating primary care units. For this trial, we envisage to recruit about 20 end users enrolled in nursing consultations. Inclusion and exclusion criteria will be informed by the aforementioned cross-sectional study. Acceptability to users will be researched by focus groups, conducted at the end of the feasibility trial. This represents the second phase of the MRC framework.
The BCW enabled the identification of the most appropriate BCTs for a novel intervention to promote adherence to antidiabetic medication in older people via an anthropomorphic virtual assistant. This stepwise approach involved the identification of four IFs, linked to two key COM-B categories (psychological capability and reflective motivation). Subsequently, 11 BCTs were considered potentially effective. The process outlined here can be used by researchers to guide a comprehensive intervention development, maximizing effectiveness, and facilitating replication.
IF, MG, and AH conceived the idea for the paper. IF guided the team through the behavior change wheel theoretical framework. All authors contributed to the first draft of the manuscript. IF and MG performed a first critical review, which was then commented by all authors. All authors approved the manuscript in its final version for submission and agreed to be accountable for the work presented.
This project is supported by FCT and Compete 2020 (grant number LISBOA-01-0145-FEDER-024250, 02/SAICT/2016). It is also supported by UID/MULTI/04046/2019 Research Unit grant from FCT, Portugal (to BioISI).
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The authors are indebted to other VASelfCare team members for their contribution to the software development (http://vaselfcare.rd.ciencias.ulisboa.pt/index-en.html).
Allemann, S. S., Nieuwlaat, R., van den Bemt, B. J., Hersberger, K. E., Arnet, I. (2016). Matching adherence interventions to patient determinants using the theoretical domains framework. Front. Pharmacol. 7, 429. doi: 10.3389/fphar.2016.00429
Anglada-Martinez, H., Riu-Viladoms, G., Martin-Conde, M., Rovira-Illamola, M., Sotoca-Momblona, J. M., Codina-Jane, C. (2015). Does MHealth Increase adherence to medication? Results of a systematic review. Int. J. Clin. Pract. 69 (1), 9–32. doi: 10.1111/ijcp.12582
Arnhold, M., Quade, M., Kirch, W. (2014). Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older. J. Med. Internet Res. 16 (4), 1–185. doi: 10.2196/jmir.2968
Bickmore, T. W., Caruso, L., Clough-Gorr, K. (2005a). Acceptance and usability of a relational agent interface by urban older adults. CHI ’05 Extended Abstracts on Human Factors in Computing Systems - CHI ’05, 1212. doi: 10.1145/1056808.1056879
Bickmore, T. W., Caruso, L., Clough-Gorr, K., Heeren, T. (2005b). ‘It’s just like you talk to a friend’ relational agents for older adults. Interact. Comput. 17 (6), 711–735. doi: 10.1016/j.intcom.2005.09.002
Bickmore, T. W., Mitchell, S. E., Jack, B. W., Paasche-Orlow, M. K., Pfeifer, L. M., O’Donnell, J. (2010). Response to a relational agent by hospital patients with depressive symptoms. Interact. Comput. 22 (4), 289–298. doi: 10.1016/j.intcom.2009.12.001
Bickmore, T. W., Pfeifer, L. M., Byron, D., Forsythe, S., Henault, L. E., Jack, B. W., et al. (2010). Usability of conversational agents by patients with inadequate health literacy: evidence from two clinical trials. J. Health Commun. 15 (S2), 197–210. doi: 10.1080/10810730.2010.499991
Bickmore, T. W., Puskar, K., Schlenk, E. A., Pfeifer, L. M., Sereika, S. M. (2010). Maintaining reality: relational agents for antipsychotic medication adherence. Interact. Comput. 22, 276–288. doi: 10.1016/j.intcom.2010.02.001
Bleijenberg, N., de Man-van Ginkel, J. M., Trappenburg, J. C. A., Ettema, R. G. A., Sino, C. G., Heim, N., et al. (2018). Increasing value and reducing waste by optimizing the development of complex interventions: enriching the development phase of the Medical Research Council (MRC) framework. Int. J. Nurs. Stud. 79, 86–93. doi: 10.1016/j.ijnurstu.2017.12.001
Bogner, H. R., Morales, K. H., de Vries, H. F., Cappola, A. R. (2012). Integrated management of type 2 diabetes mellitus and depression treatment to improve medication adherence: a randomized controlled trial. Ann. Fam. Med. 10 (1), 15–22. doi: 10.1370/afm.1344
Cane, J., O’Connor, D., Michie, S. (2012). Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement. Sci. 7 (37), 1–17. doi: 10.1186/1748-5908-7-37
Cane, J., Richardson, M., Johnston, M., Ladha, R., Michie, S. (2015). From lists of behaviour change techniques (BCTs) to structured hierarchies: comparison of two methods of developing a hierarchy of BCTs. Br. J. Health Psychol. 20 (1), 130–150. doi: 10.1111/bjhp.12102
Choi, Y. J., Smaldone, A. M. (2018). Factors associated with medication engagement among older adults with diabetes: systematic review and meta-analysis. Diabetes Educ. 44 (1), 15–30. doi: 10.1177/0145721717747880
Cláudio, A. P., Carmo, M. B., Pinto, V., Cavaco, A., Guerreiro, M. P., (2015). Virtual humans for training and assessment of self-medication consultation skills in pharmacy students, in 10th International Conference on Computer Science and Education, vol. no. ICCSE, Cambridge, UK: IEEE, 175–180. doi: 10.1109/ICCSE.2015.7250238
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., Petticrew, M. (2008). Developing and evaluating complex interventions: the new medical research council guidance. BMJ 337 (a1655), 979–983. doi: 10.1136/bmj.a1655
Dworkin, M. S., Lee, S., Chakraborty, A., Monahan, C., Hightow-Weidman, L., Garofalo, R., et al. (2019). Acceptability, feasibility, and preliminary efficacy of a theory-based relational embodied conversational agent mobile phone intervention to promote hiv medication adherence in young hiv-positive african american msm. AIDS Educ. Prev. 31 (1), 17–37. doi: 10.1521/aeap.2019.31.1.17
Gellad, W. F., Grenard, J. L., Marcum, Z. A. (2011). A systematic review of barriers to medication adherence in the elderly: looking beyond cost and regimen complexity. Am. J. Geriatr. Pharmacother. 9 (1), 11–23. doi: 10.1016/j.amjopharm.2011.02.004
Gilbert, B. J., Goodman, E., Chadda, A., Hatfield, D., Forman, D. E., Panch, T. (2015). The role of mobile health in elderly populations. Curr. Geriatr. Rep. 4 (4), 347–352. doi: 10.1007/s13670-015-0145-6
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., et al. (2014). Reducing waste from incomplete or unusable reports of biomedical research. The Lancet 383 (9913), 267–276. doi: 10.1016/S0140-6736(13)62228-X
Gonzalez, J. S., Tanenbaum, M. L., Commissariat, P. V. (2016). Psychosocial factors in medication adherence and diabetes self-management: implications for research and practice. Am. Psychol. 71 (7), 539–551. doi: 10.1037/a0040388
Goyal, S., Morita, P., Lewis, G. F., Yu, C., Seto, E., Cafazzo, J. A. (2016). The systematic design of a behavioural mobile health application for the self-management of type 2 diabetes. Can. J. Diabetes 40 (1), 95–104. doi: 10.1016/j.jcjd.2015.06.007
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., et al. (2014). better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ (Online) 348, 1–12. doi: 10.1136/bmj.g1687
Juste, A. M., Gimeno Miguel, A., Poblador Plou, B., González Rubio, F., Pascual-Salcedo, M. M., Menditto, E., et al. (2018). Adherence to treatment of hypertension, hypercholesterolaemia and diabetes in an elderly population of a spanish cohort. Medicina Clínica 29. doi: 10.1016/j.medcli.2018.10.023
Kahwati, L., Viswanathan, M., Golin, C. E., Kane, H., Lewis, M., Jacobs, S. (2016). Identifying configurations of behavior change techniques in effective medication adherence interventions: a qualitative comparative analysis. Syst. Rev. 5 (83), 1–9. doi: 10.1186/s13643-016-0255-z
Karve, S., Cleves, M. A., Helm, M., Hudson, T. J., West, D. S., Martin, B. C. (2009). Good and poor adherence: optimal cut-point for adherence measures using administrative claims data. Curr. Med. Res. Opin. 25 (9), 2303–2310. doi: 10.1185/03007990903126833
Kreuter, M., Farrell, D., Olevitch, L., Brennan, L., (2000). Tailoring Health Messages: Customizing Communication with Computer Technology. Mahwah New Jersey: Lawrence Erlbaum Associates. https://www.popline.org/node/174671.
Lustria, M. L. A., Noar, S. M., Cortese, J., Van Stee, S. K., Glueckauf, R. L., Lee, J. (2013). A meta-analysis of web-delivered tailored health behavior change interventions. J. Health Commun. 18 (9), 1039–1069. doi: 10.1080/10810730.2013.768727
Marcum, Z. A., Hanlon, J. T., Murray, M. D. (2017). Improving medication adherence and health outcomes in older adults: an evidence-based review of randomized controlled trials. Drugs Aging 34 (3), 191–201. doi: 10.1007/s40266-016-0433-7
Martins, A. I., Rosa, A. F., Queirós, A., Silva, A., Rocha, N. P. (2015). European Portuguese Validation of the System Usability Scale (SUS). Procedia Comput. Sci. 67 (Dsai), 293–300. doi: 10.1016/j.procs.2015.09.273
Mazzotta, I., Novielli, N., De Carolis, B., (2009). “Are ECAs more persuasive than textual messages?,” in Lecture Notes in Computer Science, vol. 5773. Eds. Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H. H. (Berlin, Heidelberg: Springer), 527–528. doi: 10.1007/978-3-642-04380-2_75
Menditto, E., Cahir, C., Aza-Pascual-Salcedo, M., Bruzzese, D., Poblador-Plou, B., Malo, S., et al. (2018). Adherence to chronic medication in older populations: application of a common protocol among three european cohorts. Patient Prefer. Adherence 12, 1975–1978. doi: 10.2147/PPA.S164819
Michie, S., Johnston, M., Francis, J., Hardeman, W., Eccles, M. (2008). From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. App. Psychol. 57 (4), 660–680. doi: 10.1111/j.1464-0597.2008.00341.x
Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., et al. (2013). The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann. Behav. Med. 46, 81–95. doi: 10.1007/s12160-013-9486-6
Michie, S., van Stralen, M., West, R. (2011). The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement. Sci. 6 (42), 1–11. doi: 10.1186/1748-5908-6-42
Monkaresi, H., Calvo, R. A., Pardo, A., Chow, K., Mullan, B., Lam, M., et al. (2013). “Intelligent diabetes lifestyle coach,” in Fifth International Workshop on Smart Healthcare and Wellness Applications (SmartHealth’13), Adelaide, Australia: OzCHI, 1–4.
Morrissey, E. C., Corbett, T. K., Walsh, J. C., Molloy, G. J. (2016). Behavior change techniques in apps for medication adherence: a content analysis. Am. J. Prev. Med. 50 (5), e143–e146. doi: 10.1016/j.amepre.2015.09.034
Mota-Pinto, A., Rodrigues, V., Botelho, A., Veríssimo, M. T., Morais, A., Alves, C., et al. (2010). A socio-demographic study of aging in the portuguese population: The EPEPP Study. Arch. Gerontol. Geriatr. 52 (3), 304–308. doi: 10.1016/j.archger.2010.04.019
Nieuwlaat, R., Wilczynski, N., Navarro, T., Hobson, N., Jeffery, R., Keepanasseril, A., et al. (2014). Interventions for enhancingmedication adherence (review). Cochrane Database Syst. Rev. 11, 1–730. doi: 10.1002/14651858.CD000011.pub4
op den Akker, R., Klaassen, R., Nijholt, A. (2016). “Virtual Coaches for Healthy Lifestyle,” in Toward Robotic Socially Believable Behaving Systems - Volume II. Modeling Social Signals, vol. 106. Eds. Esposito, A. L., Jain, C. (Switzerland: Springer International Publishing). doi: 10.1016/j.neulet.2006.07.043
op den Akker, R., Klaassen, R., Lavrysen, T., Geleijnse, G., van Halteren, A., Schwietert, H., et al. (2011). “A Personal Context-Aware Multi-Device Coaching Service That Supports a Healthy Lifestyle,” in BCS-HCI’11 Proceedings of the 25th BCS Conference on Human-Computer Interaction, Swinton, UK: British Computer Society, 443–448.
Paiva, D., Silva, S., Severo, M., Moura-Ferreira, P., Lunet, N., Azevedo, A. (2017). Limited health literacy in portugal assessed with the newest vital sign prevalência de literacia em saúde inadequada em portugal medida com o newest vital sign. Acta Med. Port. 30 (12), 861–869. doi: 10.20344/amp.9135
Patton, D. E., Hughes, C. M., Cadogan, C. A., Ryan, C. A. (2017). Theory-based interventions to improve medication adherence in older adults prescribed polypharmacy: a systematic review. Drugs Aging 34 (2), 97–113. doi: 10.1007/s40266-016-0426-6
Pinto, D. M., Santiago, L. M., Maurício, K., Silva, I. R. (2019). Health profile and medication adherence of diabetic patients in the portuguese population. Prim. Care Diabetes doi: 10.1016/j.pcd.2019.02.004
Polonsky, W. H., Henry, R. R. (2016). Poor medication adherence in type 2 diabetes: recognizing the scope of the problem and its key contributors. Patient Prefer. Adherence 10, 1299–1307. doi: 10.2147/PPA.S106821
Powers, M. A., Bardsley, J., Cypress, M., Duker, P., Funnell, M. M., Fischl, A. H., et al. (2015). Diabetes self-management education and support in type 2 diabetes: a joint position statement of the american diabetes association, the american association of diabetes educators, and the academy of nutrition and dietetics. J. Acad. Nutr. Diet. 115 (8), 1323–1334. doi: 10.2337/diaclin.34.2.70
Presseau, J., Ivers, N. M., Newham, J. J., Knittle, K., Danko, K. J., Grimshaw, J. M. (2015). Using a behaviour change techniques taxonomy to identify active ingredients within trials of implementation interventions for diabetes care. Implement. Sci. 10 (55), 1–10. doi: 10.1186/s13012-015-0248-7
Ring, L., Utami, D., Bickmore, T. (2014). The right agent for the job? The effects of agent visual appearance on task domain, in Lecture Notes in Computer Science, vol. 8637. Eds Bickmore, T., Marsella, S., Sidner, C. (Switzerland: Springer, Cham), 374–384. doi: 10.1007/978-3-319-09767-1_49
Sapkota, S., Brien, J. A. E., Greenfield, J. R., Aslani, P. (2015). A systematic review of interventions addressing adherence to anti-diabetic medications in patients with type 2 diabetes - components of interventions. PLoS ONE 10 (2), 1–17. doi: 10.1371/journal.pone.0128626
Sweet, S. N., Fortier, M. S. (2010). Improving physical activity and dietary behaviours with single or multiple health behaviour interventions? A synthesis of meta-analyses and reviews. Int. J. Environ. Res. Public Health 7 (4), 1720–1743. doi: 10.3390/ijerph7041720
van Wissen, A., Vinkers, C., van Halteren, A. (2016). “Developing a Virtual coach for chronic patients: a user study on the impact of similarity, familiarity and realism,” in Persuasive Technology. Eds. Meschtscherjakov, A., De Ruyter, B., Fuchsberger, V., Murer, M., Tscheligi, M. (Cham: Springer International Publishing), 263–275. doi: 10.1007/978-3-319-31510-2_23
Velicer, W., Redding, C., Blissmer, B., Babbin, S., Paiva, A., Bickmore, T., et al. (2015). Using relational agents to increase engagement in computer-based interventions: preliminary outcomes. Eur. Health Psychol. 17 (S), 451.
Vervloet, M., Linn, A. J., van Weert, J. C. M., de Bakker, D. H., Bouvy, M. L., van Dijk, L. (2012). The effectiveness of interventions using electronic reminders to improve adherence to chronic medication: a systematic review of the literature. J. Am. Med. Inform. Assoc. 19 (5), 696–704. doi: 10.1136/amiajnl-2011-000748
Vrijens, B., De Geest, S., Hughes, D. A., Przemyslaw, K., Demonceau, J., Ruppar, T., et al. (2012). A new taxonomy for describing and defining adherence to medications. Br. J. Clin. Pharmacol. 73 (5), 691–705. doi: 10.1111/j.1365-2125.2012.04167.x
Walker, E. A., Shmukler, C., Ullman, R., Blanco, E., Scollan-Koliopoulus, M., Cohen, H. W. (2011). Results of a successful telephonic intervention to improve diabetes control in urban adults. Diabetes Care 34 (1), 2–7. doi: 10.2337/dc10-1005
Webb, T. L., Joseph, J., Yardley, L., Michie, S. (2010). Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J. Med. Internet Res. 12 (1), 1–18. doi: 10.2196/jmir.1376
Wells, M., Williams, B., Treweek, S., Coyle, J., Taylor, J. (2012). Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions. Trials 13 (1), 1. doi: 10.1186/1745-6215-13-95
Williams, J. L. S., Walker, R. J., Smalls, B. L., Campbell, J. A., Egede, L. E. (2014). Effective interventions to improve medication adherence in type 2 diabetes: a systematic review. Diabetes Manag. 4 (1), 29–48. doi: 10.2217/dmt.13.62
Zeber, J. E., Manias, E., Williams, A. F., Hutchins, D., Udezi, W. A., Roberts, C. S., et al. (2013). A systematic literature review of psychosocial and behavioral factors associated with initial medication adherence: a report of the ispor medication adherence & persistence special interest group. Value Health 16, 891–900. doi: 10.1016/j.jval.2013.04.014
Keywords: relational agent, older adult, type 2 diabetes, medication adherence, virtual assistant, behavior change wheel, intervention development, complex intervention
Citation: Félix IB, Guerreiro MP, Cavaco A, Cláudio AP, Mendes A, Balsa J, Carmo MB, Pimenta N and Henriques A (2019) Development of a Complex Intervention to Improve Adherence to Antidiabetic Medication in Older People Using an Anthropomorphic Virtual Assistant Software. Front. Pharmacol. 10:680. doi: 10.3389/fphar.2019.00680
Received: 01 February 2019; Accepted: 24 May 2019;
Published: 21 June 2019.
Edited by:Silvio Barberato-Filho, Universidade de Sorocaba, Brazil
Reviewed by:Kurt Neumann, Independent Researcher, Hungary
Sabrina Anne Jacob, University of Strathclyde, United Kingdom
Copyright © 2019 Félix, Guerreiro, Cavaco, Cláudio, Mendes, Balsa, Carmo, Pimenta and Henriques. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Mara Pereira Guerreiro, firstname.lastname@example.org