Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 17 October 2019
Sec. Addictive Disorders

Prevalence of Coaddictions and Rate of Successful Treatment Among a French Sample of Opioid-Dependent Patients With Long-Term Opioid Substitution Therapy: The OPAL Study

Marie Grall-Bronnec,,*Marie Grall-Bronnec1,2,3*Edouard-Jules Laforgue,,Edouard-Jules Laforgue1,2,4Gaëlle Challet-Bouju,Gaëlle Challet-Bouju1,2Jennyfer CholetJennyfer Cholet1Jean-Benoit Hardouin,Jean-Benoit Hardouin2,5Juliette LeboucherJuliette Leboucher1Morgane Guillou-Landrat,,Morgane Guillou-Landréat3,6,7Caroline Victorri-Vigneau,Caroline Victorri-Vigneau2,4 on behalf of the OPAL group
  • 1Addictive Medicine and Psychiatry Department, CHU Nantes, Nantes, France
  • 2INSERM UMR 1246, SPHERE, Methods in Patient-Centered Outcomes and Health Research, Nantes and Tours University, Nantes, France
  • 3HUGOPSY Network, Nantes, France
  • 4Clinical Pharmacology Department, CHU Nantes, Nantes, France
  • 5Methodology and Biostatistic Department, DRCI, CHU Nantes, Nantes, France
  • 6Addictive Medicine Department, CHU Brest, Brest, France
  • 7Université de Bretagne Occidentale, ERCR SPURBO, Brest, France

Background: Opioid use disorder (OUD) is a worldwide major health concern due to increased early mortality and morbidity. Opioid substitution therapy (OST) is approved in the context of a global OUD treatment (OUDT), in conjunction with psychosocial interventions. Many factors can explain why unsuccessful treatment rates remain high. While the phenomenon of addiction switching is often proposed, it is not known whether this also includes gambling addiction. The primary objective of the OPAL study was to determine the prevalence of coaddictions, including problem gambling, among patients with OUDT. Secondary objectives were to assess the rate of unsuccessful OUDT and to characterize the associated factors.

Methods: For this observational transversal multicenter study, patients with OUDT including OST for at least 6 months were recruited. Clinical assessment was based on a clinically structured interview and a set of self-reported questionnaires. Coaddictions were screened using the Fagerström, the CRAFFT, and the Lie/Bet questionnaires. Unsuccessful OUDT was defined as the persistence of opioid use and/or the worsening of another substance use or gambling practice. After a descriptive analysis, a multivariate analysis was performed to identify the factors associated with unsuccessful OUDT.

Results: The sample consisted of 263 patients. Prevalence of coaddictions reached 97% of the sample. Problem gambling was associated with 10% of the patients. OUDT was considered as “unsuccessful” for 60% of the patients. Associated factors included having drug-using friends, psychiatric and professional negative consequences related to opioid use, more than one OST-prescribing physician, and impulsivity, especially high scores for lack of premeditation and sensation seeking.

Conclusions: This study provides further evidence of the need to consider coaddictions and the usefulness of global addictive evaluations. Poor prognostic factors must alert the clinician to initiate more sustained care. Further implications are discussed.

Introduction

Over the past decade, medical and nonmedical opioid use has soared dramatically (1). Resurgence of heroin use in some countries, such as the United States, and misuse of pharmaceutical opioids and illicit fentanyl derivatives are some of the reasons for the current “opioid crisis phenomenon” (2, 3). In 2018, the worldwide prevalence of opioid use disorder (OUD) was estimated at 0.7% for individuals aged 15 to 64 years (3). Opioid use is associated with increased early mortality and morbidity. Due to a dramatic increase in lethal overdose rates (4), OUD is a major, and increasing, public health concern. Moreover, due to medical complications, such as infections, and frequently associated socioprofessional issues, the burden of harm is estimated by the World Health Organization at 9.2 and 11.2 million disability-adjusted life-years for opioid use and opioid dependence, respectively (5, 6).

OUD is associated with strong withdrawal symptoms that are caused by cessation or reduction of opioid use and craving, both of which are responsible for continual use and unsuccessful attempts to stop consumption despite their awareness of the negative consequences. OUD treatment (OUDT) includes psychosocial treatment combined with a medication. The choice among the available treatment options should be a shared decision between the clinician and the patient. In France, two medications are available as opioid substitution therapy (OST): buprenorphine and methadone. Buprenorphine, which is a partial mu agonist, can be prescribed by any physician. Methadone, which is a full mu agonist, is less accessible, since it is a listed narcotic. Its prescription is initially restricted to physicians operating in specialized units or hospitals. After a period of stabilization, follow-up and prescription may be carried out by any physician. Methadone and buprenorphine are both approved as pharmacological treatments in the context of OUDT, in order to 1) suppress opioid withdrawal, 2) block the effects of illicit opioids, 3) reduce opioid craving and stop or reduce the use of illicit opioids and prevent relapse, 4) stop drug injection to reduce the spread of blood-borne viruses, and 5) promote and facilitate patient engagement in recovery-oriented activities including psychosocial intervention (79). Evidence suggests that the use of these medications is superior to other treatment options for most patients with OUD and that methadone and buprenorphine are equally effective (10, 11). In conjunction with pharmacotherapy, psychosocial treatment includes behavioral interventions by qualified healthcare providers in order to assess psychosocial needs, provide supportive counseling, and promote existing family support links and referral to community services (9).

Assessing the success of OUDT is challenging. The main issue resides in the selection of relevant outcome measures. From the perspective of population health, outcomes could be overdose mortality rate (12), prevalence of HIV (13) and hepatitis C virus infection acquisition (14), or cessation of injection drug use (15). From the perspective of the individuals health, controlled trials often assess the outcome as the time to opioid relapse (16), retention in treatment (17), self-reported craving and opioid withdrawal symptoms (18), opioid-positive urine drug tests (10), psychological and social well-being (19), or quality of life (20). However, there is no consensus as to which could be the most appropriate outcome measure. This is compounded by the difficulty in performing long-term studies with “real life” patients, i.e., complex patients with both somatic, psychiatric, and addictive comorbidities and social vulnerabilities. In particular, comorbid substance use disorders are frequent conditions among patients with OUD, as they may develop, persist, or worsen during or after the OUDT (2124). Studies measuring the propensity of patients with OUDT to resort to abuse of other substances are inconclusive; the published results report increased, decreased, or unchanged use (2527). The classic situation, however, is “switching addiction,” or the increased consumption over time of other substances. The scenario may be that OUDT is associated with clinical improvement and the cessation of opioid use; however, the onset or aggravation of other addictive disorders, such as alcohol or another substance use disorder, is often observed (25, 28, 29). Behavioral addictions seem to be less reported. Gambling disorder is the only disorder classified as a behavioral addiction in the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) (30). Despite the fact that it is known that patients treated for substance use disorders are at higher risk of gambling disorder than the general population (3133), scientific studies on the switch from OUD to gambling disorder are scarce.

To summarize, patients with OUD could be effectively treated regarding their use of opioids, but their long-term evolution could be hampered with comorbid addictions, mitigating their global improvement. The primary aim of our study was to determine the prevalence of coaddictions, including gambling disorder, in a large sample of patients treated for an OUD. Secondary objectives were to assess the rate of unsuccessful OUDT and to characterize the associated factors.

Materials and Methods

Procedure and Ethics

OPAL (NCT01847729) was an observational, cross-sectional, multicenter study involving 10 centers located in the Western region of France. It combined both a clinical evaluation and a prespecified ancillary pharmacogenetic study (34). OPAL was conducted in accordance with the Good Clinical Practice Guidelines and the Declaration of Helsinki and was approved by the local ethics committee. Written informed consent was collected from all participants.

Participants

The study included patients 18 years or older, receiving OST (methadone or buprenorphine) for at least 6 months for opiate dependence (according to the DSM-IV) (35). The period of 6 months was chosen since it is the time generally necessary to adapt and stabilize the dosage of the OST in the context of a global OUDT. Exclusion criteria were difficulties reading or writing in French and guardianship.

Measures

The clinical evaluation consisted of a hetero-assessment (structured interview conducted by one of the investigators) and a self-assessment (self-answered questionnaires completed by the patient). The following data were collected:

Sociodemographic Characteristics

We collected data including sex, age, educational level, marital and parental status, housing, social support, professional status, and financial situation.

Impulsivity Characteristics

Attention-deficit/hyperactivity disorder (ADHD) was assessed by two self-report questionnaires: the Wender Utah Rating Scale–Child (WURS-C) (36) to make a retrospective screening of ADHD in childhood and the Adult ADHD Self-report Scale Symptom Checklist (ASRS v1.1) (37), which screens ADHD in adulthood. The WURS-C specificity is satisfactory, which limits the risk of a wrong diagnosis. It is designed to assess ADHD symptoms represented by 25 items on 5-point Likert scales. This ASRS v1.1 is based on the 18 diagnostic criteria of the DSM-IV, Text Revision, scored according to their frequency. Some authors have concluded that the ASRS v1.1 screen is a simple screening tool that is useful and has an acceptable validity for the identification of ADHD among addicted patients. In particular, the sensitivity and negative predictive value are acceptable, as is required of a screening tool. Based on the results on these questionnaires, it was possible to screen ADHD in childhood (WURS-C score ≥46/100) and ADHD probably persistent at adulthood (WURS-C score ≥46/100 and ≥4/6 marks in the dark shaded boxes within part A of the ASRS v1.1). Impulsivity was scored using the short version of the UPPS Impulsive Behavior Scale (short UPPS-P) (38). The UPPS-P scale is a self-report questionnaire that interrogates five complementary impulsivity constructs: positive urgency, negative urgency, lack of perseverance, lack of premeditation, and sensation seeking. The short UPPS-P is a 20-item version reduced from the initial 59-item UPPS-P.

OUD Characteristics

The evaluation was performed on a single time point, but the patients were questioned on two distinct periods: before the OST initiation and since the OST initiation.

Before the OST initiation. We collected data including the age at first opioid experimentation, age at opioid dependence, age at the first attempt to stop opioid use (withdrawal or OST), main substance used (heroin, nonmedical use of codeine, morphine, buprenorphine, and methadone), main route of administration (nasal, intravenous, inhaled, oral), and negative consequences related to opioid dependence (financial, socioaffective, psychiatric, professional, legal, physical problems).

Since the OST initiation. We collected the characteristics of OST (type of medication, duration, OST initiation with daily supervised dosing by a qualified health professional, maximal daily dose, current daily dose, compliance, withdrawal symptoms, current opioid use despite OST or opioid abstinence, defined as the self-reported absence of opioid use over the previous 6 months). The 6-month period was chosen because it corresponds to the time usually required to stabilize the treatment dosage and because each patient could be asked about this period.

Use of Other Substances and Gambling Habits

Patients were asked about the current frequency of substance use [nicotine, alcohol (>3 standard units per day for the men and >2 for the women), cannabis, cocaine, amphetamines, lysergic acid diethylamide (LSD) or other synthetic drugs, benzodiazepines, or barbiturates] and gambling practice. Coaddictions were screened using the Fagerström nicotine dependence test, the CRAFFT (for Car, Relax, Alone, Forget, Family/Friends, Trouble) questionnaire, and the Lie/Bet questionnaire. The Fagerström test is a noninvasive and easy-to-obtain self-report tool that conceptualizes dependence through physiological and behavioral symptoms (moderate to high nicotine dependence if score ≥2/7) (39). The CRAFFT questionnaire is a powerful tool for the identification of alcohol and substance misuse among adolescent and young adult population. Two risk levels were thus defined: a moderate risk (score >2/6), largely identifying regular consumption of alcohol and substance, and a high risk (score >3/6), identifying the severity of consumption (40). The Lie/Bet questionnaire was used to differentiate problem and nonproblem gamblers. It was based on the following two criteria from the DSM-IV: “Have you ever had to lie to people important to you about how much you gambled?” (Lie) and “Have you ever felt the need to bet more and more money?” (Bet). We concluded that gambling was potentially problematic (currently or in the past) when at least one of the replies was positive. We chose this questionnaire because It has excellent sensitivity, which is crucial for a screening instrument, and because its specificity is also very good, (41). Patients were asked about the progression of their substance use or gambling habits since OST initiation (stability/improvement/worsening).

Outcome Measures

The primary outcome measure in this study was the presence of at least a coaddiction, defined by a moderate/high nicotine dependence and/or a high-risk substance use [alcohol (>2 or 3 standard units per day), cannabis, cocaine, amphetamines, LSD or other synthetic drugs, benzodiazepines, and/or barbiturates] and/or a problem gambling. The secondary outcome measure was the OUDT status: “successful OUDT” was defined by opioid abstinence (see above) and the stability or improvement of other substance use or gambling practice, and “unsuccessful OUDT” by the persistence of opioid use and/or the worsening of another substance use or gambling practice.

Statistical Analysis

A descriptive statistical analysis of the sociodemographic and clinical characteristics was conducted for the entire sample. Continuous variables were described by the mean and standard deviations, and categorical variables were presented by numbers and percentages.

We divided the sample into two groups according to status at inclusion (“successful OUDT” and “unsuccessful OUDT”) and then compared these groups. Bivariate analyses were conducted to explore the associations between the status at inclusion and the set of variables mentioned above. χ2 Tests or Fisher tests were used to analyze the qualitative variables, and Student or Wilcoxon tests for quantitative variables.

Thereafter, multivariate analyses were performed using an iterative selection procedure to select the variables that were significantly associated with the “unsuccessful OUDT” status, as assessed by the likelihood ratio test (variable candidates for the model were those associated with unsuccessful OUDT in bivariate analyses with the P < 0.20 criterion and subsequently selected in the model using the P < 0.05 criterion). The corresponding odds ratio and associated 95% confidence interval were estimated. The ability of the final logistic model to discriminate between successful or unsuccessful OUDT was assessed using the area under the receiver operating characteristic (ROC) curve, and the goodness of fit of the model was assessed using the Hosmer–Lemeshow test. The statistical analyses were carried out with SAS 9.1 and R statistical software (SAS Institute, Inc.).

Results

A total of 263 patients were included in the study.

Description of the Sample

Sociodemographic Characteristics

As shown in Table 1, 75% of the sample were men. The majority had an education level lower than year 12 and were unemployed. Almost all participants had stable housing, and about a third lived in a relationship. Almost all participants declared having social support. However, three-quarters had close friends who were drug users.

TABLE 1
www.frontiersin.org

Table 1 Sociodemographic and impulsivity characteristics of the sample (n = 263).

Impulsivity Characteristics

The profile of the patients is marked by impulsivity, as shown in Table 1. The average scores on the UPPS-P questionnaire were high for the five dimensions, but especially for the Urgency (positive and negative) and Sensation Seeking dimensions. In addition, almost half of the sample presented characteristics of ADHD in childhood, and ADHD probably persisted into adulthood for almost a third of the patients.

Opioid Use Disorder Characteristics

Before the OST initiation. The main stages (first experimentation, onset of dependence, first attempt to stop) of the opioid use trajectory followed each other at a rapid pace (Table 2). The vast majority (90%) of patients reported consuming mainly heroin, and the main route of opioid administration was the nasal route. Patients reported a number of negative consequences related to their opioid use, mainly financial (71%), socioaffective (70%), and psychiatric (69%).

TABLE 2
www.frontiersin.org

Table 2 Opioid use disorder characteristics of the sample (n = 263).

Since the OST initiation. At the time of inclusion in the study, the prescribed OST was methadone for two-thirds of patients, with average treatment duration of 51 months (Table 2). For most of them, OST was initiated with daily supervised dosing by a qualified health professional. OST compliance was rated as good by the clinician for the vast majority of patients. However, 17% reported signs of opioid withdrawal. A quarter of patients still reported opioid use.

Prevalence of Coaddictions

Two hundred forty of 263 patients completed self-report questionnaires that allowed current coaddiction assessment. Current substances misuse and problem gambling are described in Table 3. Nicotine dependence was present among more than three-quarters of the responders. Substance use other than nicotine was characterized as “high risk” for the majority of the responders [212 patients (88%)]. Substances mainly misused were alcohol [166 patients (70%)], cannabis [156 patients (65%)], and cocaine [107 patients (45%)]. Gambling was problematic for 23 patients (10% of the responders). In total, 232 of 240 patients (97%) were identified with nicotine dependence and/or high risk for other substance use and/or problem gambling.

TABLE 3
www.frontiersin.org

Table 3 Prevalence of current coaddictions (n = 240).

Evolution of Substance Use and Gambling Since OST Initiation

As previously mentioned, 63 of 252 patients (25%) still reported opioid use. Moreover, substance use (including nicotine) or gambling worsened for 112 of 240 patients (47%) since OST initiation. Results are presented in Table 4.

TABLE 4
www.frontiersin.org

Table 4 Evolution of substance use and gambling since OST initiation (n = 240).

Rate of Successful/Unsuccessful OUDT

Of the 23 patients who did not return their self-report questionnaires, 12 could be classified in the “unsuccessful OUDT” group as they reported continuing opioid use during the structured interview. We were therefore able to determine the OUDT status for 252 patients. OUDT was considered as “successful” for 101 (40%) and as “unsuccessful” for 151 (60%) of them. Conditions of “unsuccessful OUDT” are shown in Table 5.

TABLE 5
www.frontiersin.org

Table 5 Description of the OUDT status (n = 252).

Factors Associated With Unsuccessful Oudt

Characteristics related to sociodemographics, impulsivity, OUD, and other substance use or gambling were compared between the two groups of patients. Results are presented in Table 6.

TABLE 6
www.frontiersin.org

Table 6 Comparison of patients with successful or unsuccessful OUDT (n = 252).

Table 7 shows the results for the multivariate analysis of the “unsuccessful OUDT” model [only the significant variables (P < 0.05) at the end of the descending procedure are shown]. After excluding observations with missing data, 238 patients were included in the analysis. In our model, we observed factors associated with unsuccessful OUDT: having drug-using friends, having psychiatric and professional negative consequences related to opioid use, having more than one OST-prescribing physician, and having high scores for the UPPS-P lack of Premeditation and Sensation Seeking scales. In contrast, living as a couple and having somatic and financial negative consequences related to opioid use could be considered as protective factors.

TABLE 7
www.frontiersin.org

Table 7 Factors associated with unsuccessful OUDT—multivariate logistic regression model (n = 238).

The Hosmer–Lemeshow goodness-of-fit test showed that the final model was well calibrated with P = 0.33 (a large P value indicating a good model fit), and the area under the ROC curve was 0.79, showing that the model discriminated well between patients with “unsuccessful OUDT” and patients with “successful OUDT.”

Discussion

Main Results

In the present study, we estimated the prevalence of coaddictions, including problem gambling, and the rate of unsuccessful treatment in a large sample of patients with OUD. To the best of our knowledge, this is the first study to explore this topic in such a broad manner. First, we demonstrated that almost all patients who completed the self-report questionnaires could be considered as having at least another current coaddiction (nicotine dependence and/or high risk for other substances use and/or problem gambling). This observation should prompt us to consider the patient’s situation as a whole and not to focus only on OUD, even if it is the main disorder and the reason for referral. Furthermore, patients reported that substance use or gambling substantially worsened, especially considering nicotine and alcohol use. Pursuit of former substances use disorder, especially for alcohol, is not uncommon and has previously been described (25, 28, 29, 41). The “switching addiction” phenomenon could explain this aggravation. Addictive disorders share an underlying biopsychological process, resulting in an interaction of impairments of motivation-reward, affect regulation, and behavioral inhibition (42). This is all the more worrying as alcohol use is known to promote illicit drug relapse (23, 41). Alcohol acts on the opioid system, which could explain the propensity of opioid users to use alcohol when they quit opioids. A study showed that high-dose buprenorphine could be of superior effectiveness compared to methadone in alcohol use reduction (43). Our study was not designed to compare the relative efficacy of methadone and buprenorphine, but it seems that buprenorphine is more beneficial for concomitant alcohol use disorder.

Second, it is interesting to note that some patients reported that their substance use decreased, although reduction in other substance use is not an explicit goal of OUDT. Therefore, this represents a “secondary benefit” of OUDT that supports the importance of assessing nicotine, alcohol, and other substance use, as well as gambling, when considering the success or not of treatment. Contrary to Soyka and colleagues’ (6) study, decreased cocaine use was the one most observed in the “successful OUDT” group. In this case, it is possible that relapse prevention strategies (identification and prevention of high-risk situations to use illicit substances, development of new coping skills, etc.) associated with OUDT also promote the reduction of cocaine use. Possible reasons why cocaine use decreased while alcohol consumption worsened may be related to socioeconomic parameters; compared to cocaine, alcohol is cheaper, more readily available, and more socially acceptable.

Third, our results showed that only 40% of the patients were successfully treated for their OUD, as defined by our study design, despite a long duration of OST and, on a broader level, of global treatment. Nearly three-quarters of the sample were considered as opioid abstinent, but this result is falsely reassuring. Indeed, the main condition explaining the unsuccessful OUDT was not the persistence of opioid use, but the worsening of other substance use or gambling. This is an important novel finding of our study and demonstrates the need to consider a more comprehensive and global outcome measure of a patient’s real life conditions. We chose to use a composite criterion. Notably, expected improvement in the whole addictive situation cannot be directly and solely attributed to OST. From a pharmacological perspective, the primary efficacy of an agonist relies in the decreased consumption of substances acting on the same receptors.

There is no specific consensual criterion used to assess the treatment efficacy. Many studies have explored the follow-up of patients over several years, but with heterogeneous outcome measures and thus heterogeneous results. Regarding the relative effectiveness of OST, Nielsen et al. (11) performed a meta-analysis and used the rates of self-reported opioid use, opioid positive urine drug tests, and retention in treatment as outcomes. They did not find any difference between methadone and buprenorphine maintenance treatment (11). Another meta-analysis by Ma et al. (12) reported an all-cause crude mortality rate of 0.92, 1.69, and 4.89 per 100 person-years for those receiving OST, after cessation, and for the untreated period, respectively. In a cohort of 621 people who injected drugs in Tijuana, only 7.3% ceased intravenous drug use (IVDU) at 1 year, but following a methadone maintenance treatment was associated with a significant reduction of IVDU with an odds ratio of 2.04 (1.02–4.08) (15). A recent clinical trial comparing extended-release naltrexone and buprenorphine was based on time to opioid relapse as the outcome measure. It is now completed, but to date the results are not yet available (16). The study by Soyka et al. (6) is similar to ours, with a combination of multiple parameters including unsanctioned opioid abstinence and concomitant drug use. They found an OST retention rate of 70% at 6 years and a mortality rate of 1% per year for patients under OST. Other findings from this study were the rates of self-reported opioid use and of opioid positive urine samples at the end of evaluation, respectively, 5% and 12%. These rates were lower than those found in our sample, with 25% patients declaring the persistence of opioid use.

It is possible that our “hard” criterion could partially explain the low rate of successful OUDT. Patients were asked about the evolution of substance use and gambling since the OST initiation, on average 4 years before the inclusion in the study. The design of our study also allowed us to retrospectively analyze those patients who had ceased opioid use following treatment. It was conducive to observe changes, either improvement or worsening, unlike trials with only a 6-month follow-up design (6, 44). Nevertheless, the lack of a consensual definition of OUDT success enforces the need for a global and nonpartial evaluation of other substance use disorders and behavioral addiction.

Finally, we studied factors associated with successful/unsuccessful OUDT. Living as a couple was associated with successful OUDT. The absence of family support has already been described as predictive for unsuccessful OUDT by Hoang et al. (45) and Tran et al. (46, 47). Among all negative consequences, only somatic and financial issues were associated with successful OUDT. They helped the patients to quit opiates but also to improve or stabilize other substance use or gambling. We can assume that these types of negative consequences contribute to make OUD more significant, to limit the switching addiction phenomenon, and to increase intrinsic motivation to a regular medical and social management. On the contrary, factors that lead to substance use (drug-using friends) or to patient isolation (psychiatric and professional negative consequences) are associated with unsuccessful OUDT. Psychiatric issues related to substance use are associated with a lack of insight. OUD can induce psychiatric issues that can in turn promote opioid use, or other substance use and gambling, as a way to cope with negative feelings and emotions. Our patients were recruited in different healthcare centers, but all have a specialization in addiction medicine, so it is possible that patients were more likely to have more severe OUD and more psychiatric comorbidities that can explain the unsuccessful rate. Furthermore, psychiatric comorbidities were already described as factors associated with bad prognosis (6, 48). Professional issues mainly refer to the inability to find and keep a job, which may contribute to patient isolation, to increase boredom and to decrease self-esteem, all these conditions being risk factors for addictive disorders. To avoid these negative consequences, psychosocial treatment aims to modify the underlying processes that maintain or reinforce use behavior, encourage pharmacotherapy compliance, and treat any concomitant psychiatric disorders. It can help patients to manage cravings, reduce the likelihood of relapse, and assist them in coping with the emotional and social challenges (9). Impulsivity, especially high scores for lack of premeditation (tendency to act without thinking) and sensation seeking (tendency to seek out novel and thrilling experiences), was associated with unsuccessful OUDT. Opioid users are known to be impulsive and sensation seekers. Recent findings suggest, on the one hand, impairment in top-down executive control processing and, on the other hand a possible connection between the neuronal reward-signaling system and an excessive need to seek sensory experiences in heroin abusers (49). Other authors concluded that impulsivity, especially lack of premeditation and sensation seeking dimensions, influences the relationship between the desire to abstain from drug use and use in the past month (50). In reference to the Transtheoretical Model of Prochaska and DiClemente, our results confirm that these two facets of impulsivity account for the “intention–action” gap during OUDT. Finally, having more than one OST prescriber was also an important factor associated with unsuccessful OUDT. “Doctor shopping”—the process of seeking multiple prescriptions from multiple prescribers—is a proxy of poor compliance and may also reflect the OST resale on the black market. In France, methadone delivery regulation (51) generally limits this risk of OST misuse, reinforcing the relevance of those restrictive measures.

Strengths and Weaknesses

Our study has some limitations. First, its design was not longitudinal but cross-sectional, making survival analysis impossible. We overcome this obstacle by determining OUDT success at inclusion and assessing patients’ characteristics partially in a retrospective way. Our results must be interpreted with caution because retrospective data collection over two distinct periods at a unique time can be subject to memorization bias. In addition, the multiplicity of recruiting centers and practitioners means that we cannot provide a participation or refusal rate. Although this was not OPAL’s objective, the only effect of the OST cannot be asserted because of the methodology employed. In particular, the only judgment we can reliably conclude on is the results of the global support considered as successful or not, but not on the evolution through time or the improvement on some clinical characteristic like impulsivity. In this regard, a placebo-controlled randomized clinical trial would have been a way to overcome this methodological bias, which is difficult to conduct given the ethical issues. Second, we deliberately built a semistructured interview to explore OUD characteristics (and especially its negative consequences, for example, psychiatric one), supplemented by validated screening tools or self-rated questionnaires, rather than to use a validated psychiatric interview. We made this decision in order to shorten the assessment visit and to make it more acceptable for the patient. Hence, psychopathological evaluation can be considered as imprecise, and current or past psychiatric disorders were not specified. On the other hand, the patient was questioned about the psychiatric negative consequences of opioid use. No formal diagnosis was made during the interview, but examples such as “depression,” “anxiety,” or “sleep disorders” were proposed as possible consequences for a closer assessment of the patient’s experience. We relied on his/her own perception of the situation when he/she was still using opioid, before the OST initiation. In a large study by Carrà et al. (52), dependence was found to be associated with poorer quality of life and psychosocial adjustment in patients with schizophrenia, and we also know that mentally ill patients are more likely to have severe dependence (53). In light of our data, this means that the installation of a dependence in the presence of a psychiatric comorbidity establishes a vicious circle, making the possibility of therapeutic success even more complicated. Third, we did not perform urine tests to screen substance use in addition to declarative status. We may assume that the unsuccessful OUDT rate could be underestimated.

However, these limits are compensated by the strengths of the study. Despite a single-nation sample, which could limit the representativeness and extrapolation of the results, our recruitment was multicentric with various modalities of practice for services (hospital services, sanitary structures, prison, etc.) that made the population heterogeneous. Heterogeneity of the sample was reached in order to improve the representativeness of real-life OUD patients in treatment. Missing data were marginal, and moreover, the number of patients allowed statistical analyses with a sufficient power. This study was based on a global evaluation of the patients and exhaustive assessment of substance and behavioral addictive disorders at several times: before treatment, since OST initiation and inclusion in the study. Moreover, highlighting predictive factors is useful for the clinicians. Sociodemographic and clinical factors identified in this study are easily collectable for clinicians and may thus be easily monitored in routine care in order to adapt and improve treatment options.

Perspectives

By identifying factors associated with unsuccessful OUDT, our results provided sociodemographic and clinical features that physicians must be aware of. Also, they should consider these factors of poor prognosis in order to provide the most tailored patient care. OST must be part of a comprehensive treatment program that includes psychological and social interventions, with the aim of helping patients to quit opiates and to avoid switching to an alternative addiction. Enhancing motivation and developing new skills are important, but not sufficient. For some patients, those with low premeditation and high sensation seeking, strengthening executive functioning should be a promising avenue in addition to more conventional strategies. Future research should enhance psychiatric comorbidities in addition to having a most comprehensive evaluation of the patient.

Members of the OPAL-Group

Pierre Bodenez, Marie Grall-Bronnec, Morgane Guillou-Landréat, Bertrand Le Geay, Isabelle Martineau, Philippe Levassor, Paul Bolo, Jean-Yves Guillet, Xavier Guillery and Corine Dano.

Data Availability Statement

All datasets generated for this study are included in the manuscript.

Ethics Statement

The studies involving human participants were reviewed and approved by Groupe Nantais d’Éthique dans le Domaine de la Santé (GNEDS), the Advisory Committee on the Processing of Health Research Informa-tion (CCTIRS) and the Data Protection Commission (CNIL). The patients/participants provided their written informed consent to participate in this study.

Author Contributions

Conception and design of the study: MG-B, GC-B, JL, and CV-V. Acquisition and analysis of data: MG-B, JC, J-BH, JL, MG-L, CV-V, and the OPAL group (members of the OPAL-Group are PB, MG-B, MG-L, BL, IM, PL, PB, J-YG, XG, and CD). Drafting the manuscript or figures: MG-B, E-JL, GC-B, and CV-V.

Funding

This study was supported jointly by the Mission Interministérielle de Lutte contre les Drogues et les Conduites Addictives (MILDECA) and the Université Paris 13, as part of the call for research projects “PREVDROG” launched by these two organizations in 2011.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

1. Kolodny A, Courtwright DT, Hwang CS, Kreiner P, Eadie JL, Clark TW, et al. The prescription opioid and heroin crisis: a public health approach to an epidemic of addiction. Annu Rev Public Health (2015) 36(1):559–74. doi: 10.1146/annurev-publhealth-031914-122957

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Soelberg CD, Brown RE, Du Vivier D, Meyer JE, Ramachandran BK. The US opioid crisis: current federal and state legal issues. Anesth Analg (2017) 125(5):1675–81. doi: 10.1213/ANE.0000000000002403

PubMed Abstract | CrossRef Full Text | Google Scholar

3. United Nations Office on Drugs and Labors. World drug report 2018 (set of 5 booklets). UNITED NATIONS (2018). Available from: https://www.unodc.org/wdr2018

Google Scholar

4. Paulozzi LJ, Zhang K, Jones CM, Mack KA. Risk of adverse health outcomes with increasing duration and regularity of opioid therapy. J Am Board Fam Med JABFM (2014) 27(3):329–38. doi: 10.3122/jabfm.2014.03.130290

CrossRef Full Text | Google Scholar

5. World Health Organization. World Health OrgnaizationOrganization: the world health report. Geneva (2004). Available from: https://www.who.int/whr/2004/en/

Google Scholar

6. Soyka M, Strehle J, Rehm J, Bühringer G, Wittchen H-U. Six-year outcome of opioid maintenance treatment in heroin-dependent patients: results from a naturalistic study in a nationally representative sample. Eur Addict Res (2017) 23(2):97–105. doi: 10.1159/000468518

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Agence nationale d’accréditation et d’évaluation en santé. Stratégies thérapeutiques pour les personnes dépendantes des opiacés: place des traitements de substitution. Presse Médicale (2004) 33(18):41–7. doi: 10.1016/S0755-4982(04)72381-7

CrossRef Full Text | Google Scholar

8. Advisory Council on the Misuse of Drugs. How can opioid substitution therapy be optimised to maximise recovery outcomes for service users? GOV.UK. (2019) Available from: https://www.gov.uk/government/publications/how-can-opioid-substitution-therapy-be-optimised-to-maximise-recovery-outcomes-for-service-users.

Google Scholar

9. Comer S, Cunningham C, Fishman MJ, Gordon A, Kampman K, Langleben D, et al. American Society of Addiction Medicine (ASAM) National practice guideline for the use of medications in the treatment of addiction involving opioid use, (2015). Available from: https://www.asam.org/docs/default-source/practice-support/guidelines-and-consensus-docs/asam-national-practice-guideline-supplement.pdf.

Google Scholar

10. Nielsen S, Larance B, Lintzeris N. Opioid agonist treatment for patients with dependence on prescription opioids. JAMA (2017) 317(9):967–8. doi: 10.1001/jama.2017.0001

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Nielsen S, Larance B, Degenhardt L, Gowing L, Kehler C, Lintzeris N. Opioid agonist treatment for pharmaceutical opioid dependent people. Cochrane Database Syst Rev (2016) 9(5):CD011117. doi: 10.1002/14651858.CD011117.pub2

CrossRef Full Text | Google Scholar

12. Ma J, Bao Y-P, Wang R-J, Su M-F, Liu M-X, Li J-Q, et al. Effects of medication-assisted treatment on mortality among opioids users: a systematic review and meta-analysis. Mol Psychiatry (2018) doi: 10.1038/s41380-018-0094-5

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Bruce RD. Methadone as HIV prevention: high volume methadone sites to decrease HIV incidence rates in resource limited settings. Int J Drug Policy (2010) 21(2):122–4. doi: 10.1016/j.drugpo.2009.10.004

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Platt L, Sweeney S, Ward Z, Guinness L, Hickman M, Hope V, et al. Assessing the impact and cost-effectiveness of needle and syringe provision and opioid substitution therapy on hepatitis C transmission among people who inject drugs in the UK: an analysis of pooled data sets and economic modelling. Southampton (UK): NIHR Journals Library (2017).

Google Scholar

15. Horyniak D, Strathdee SA, West BS, Meacham M, Rangel G, Gaines TL. Predictors of injecting cessation among a cohort of people who inject drugs in Tijuana, Mexico. Drug Alcohol Depend (2018) 185:298–304. doi: 10.1016/j.drugalcdep.2017.12.034

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Lee JD, Nunes EV, Mpa PN, Bailey GL, Brigham GS, Cohen AJ, et al. NIDA Clinical Trials Network CTN-0051, extended-release naltrexone vs. buprenorphine for opioid treatment (X:BOT): study design and rationale. Contemp Clin Trials (2016) 50:253–64. doi: 10.1016/j.cct.2016.08.004

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Sheikh Fathollahi M, Torkashvand F, Najmeddin H, Rezaeian M. Predictors of one-year retention in methadone maintenance treatment (MMT) in Iran, Rafsanjan. Int J High Risk Behav Addict (2016) 5(3):e29121. doi: 10.5812/ijhrba.29121

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Wang X, Jiang H, Zhao M, Li J, Gray F, Sheng L, et al. Treatment of opioid dependence with buprenorphine/naloxone sublingual tablets: A a phase 3 randomized, double-blind, placebo-controlled trial. Asia-Pac Psychiatry Off J Pac Rim Coll Psychiatr (2018) 20:e12344. doi: 10.1111/appy.12344

CrossRef Full Text | Google Scholar

19. Ghaddar A, Abbas Z, Haddad R. Opiate agonist treatment to improve health of individuals with opioid use disorder in Lebanon. Harm Reduct J (2017) 14(1):78. doi: 10.1186/s12954-017-0204-8

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Ali N, Aziz SA, Nordin S, Mi NC, Abdullah N, Paranthaman V, et al. Evaluation of methadone treatment in Malaysia: findings from the Malaysian Methadone Treatment Outcome Study (MyTOS). Subst Use Misuse (2018) 53(2):239–48. doi: 10.1080/10826084.2017.1385630

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Han B, Compton WM, Blanco C, Crane E, Lee J, Jones CM. Prescription opioid use, misuse, and use disorders in U.S. adults: 2015 national survey on drug use and health. Ann Intern Med (2017) 167(5):293–301. doi: 10.7326/M17-0865

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Savant JD, Barry DT, Cutter CJ, Joy MT, Dinh A, Schottenfeld RS, et al. Prevalence of mood and substance use disorders among patients seeking primary care office-based buprenorphine/naloxone treatment. Drug Alcohol Depend (2013) 127(1–3):243–7. doi: 10.1016/j.drugalcdep.2012.06.020

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Stenbacka M, Beck O, Leifman A, Romelsjö A, Helander A. Problem drinking in relation to treatment outcome among opiate addicts in methadone maintenance treatment. Drug Alcohol Rev (2007) 26(1):55–63. doi: 10.1080/09595230601036994

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Teoh Bing Fei J, Yee A, Habil MHB. Psychiatric comorbidity among patients on methadone maintenance therapy and its influence on quality of life. Am J Addict (2016) 25(1):49–55. doi: 10.1111/ajad.12317

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Li L, Sangthong R, Chongsuvivatwong V, McNeil E, Li J. Multiple substance use among heroin-dependent patients before and during attendance at methadone maintenance treatment program, Yunnan, China. Drug Alcohol Depend (2011) 116(1–3):246–9. doi: 10.1016/j.drugalcdep.2010.12.007

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Rittmannsberger H, Silberbauer C, Lehner R, Ruschak M. Alcohol consumption during methadone maintenance treatment. Eur Addict Res (2000) 6(1):2–7. doi: 10.1159/000019003

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Srivastava A, Kahan M, Ross S. The effect of methadone maintenance treatment on alcohol consumption: a systematic review. J Subst Abuse Treat (2008) 34(2):215–23. doi: 10.1016/j.jsat.2007.04.001

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Chen I-C, Chie W-C, Hwu H-G, Chou S-Y, Yeh Y-C, Yu C-Y, et al. Alcohol use problem among patients in methadone maintenance treatment in Taiwan. J Subst Abuse Treat (2011) 40(2):142–9. doi: 10.1016/j.jsat.2010.09.004

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Nyamathi A, Cohen A, Marfisee M, Shoptaw S, Greengold B, de Castro V, et al. Correlates of alcohol use among methadone-maintained adults. Drug Alcohol Depend (2009) 101(1–2):124–7. doi: 10.1016/j.drugalcdep.2008.10.008

PubMed Abstract | CrossRef Full Text | Google Scholar

30. American Psychiatric Association AP. Diagnostic and statistical manual of mental disorders (DSM-5). American Psychiatric Association (2013). p. 1679. doi: 10.1176/appi.books.9780890425596

CrossRef Full Text | Google Scholar

31. Feigelman W, Kleinman PH, Lesieur HR, Millman RB, Lesser ML. Pathological gambling among methadone patients. Drug Alcohol Depend (1995) 39(2):75–81. doi: 10.1016/0376-8716(95)01141-K

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Spunt B, Lesieur H, Hunt D, Cahill L. Gambling among methadone patients. Int J Addict (1995) 30(8):929–62. doi: 10.3109/10826089509055821

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Castrén S, Salonen AH, Alho H, Lahti T, Simojoki K. Past-year gambling behaviour among patients receiving opioid substitution treatment. Subst Abuse Treat Prev Policy (2015) 2710:4. doi: 10.1186/1747-597X-10-4

CrossRef Full Text | Google Scholar

34. Victorri-Vigneau C, Verstuyft C, Bouquié R, Laforgue EJ, Hardouin JB, Leboucher J, et al. Relevance of CYP2B6 and CYP2D6 genotypes to methadone pharmacokinetics and response in the OPAL study. Br J Clin Pharmacol (2019) 85(7):1538–43. doi: 10.1111/bcp.13936

PubMed Abstract | CrossRef Full Text | Google Scholar

35. American Psychiatric Association APA. Diagnostic and statistical manual of mental disorders: DSM-IV-TR. American Psychiatric Association (2000). p. 1002.

Google Scholar

36. Ward MF, Wender PH, Reimherr FW. The Wender Utah Rating Scale: an aid in the retrospective diagnosis of childhood attention deficit hyperactivity disorder. Am J Psychiatry (1993) 150(6):885–90. doi: 10.1176/ajp.150.6.885

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Kessler RC, Adler L, Ames M, Demler O, Faraone S, Hiripi E, et al. The World Health Organization Adult ADHD Self-report Scale (ASRS): a short screening scale for use in the general population. Psychol Med (2005) 35(2):245–56. doi: 10.1017/S0033291704002892

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Billieux J, Rochat L, Ceschi G, Carré A, Offerlin-Meyer I, Defeldre A-C, et al. Validation of a short French version of the UPPS-P Impulsive Behavior Scale. Compr Psychiatry (2012) 53(5):609–15. doi: 10.1016/j.comppsych.2011.09.001

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Heatherton TF, Kozlowski LT, Frecker RC, Fagerström KO. The Fagerström test for nicotine dependence: a revision of the Fagerström Tolerance Questionnaire. Br J Addict (1991) 86(9):1119–27. doi: 10.1111/j.1360-0443.1991.tb01879.x

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Karila L, Legleye S, Beck F, Corruble E, Falissard B, Reynaud M. Validation of a questionnaire to screen for harmful use of alcohol and cannabis in the general population: CRAFFT-ADOSPA. Presse Medicale Paris Fr 1983 (2007) 36(4 Pt 1):582–90. doi: 10.1016/j.lpm.2007.01.005

CrossRef Full Text | Google Scholar

41. Johnson EE, Hamer R, Nora RM, Tan B, Eisenstein N, Engelhart C. The Lie/Bet Questionnaire for screening pathological gamblers. Psychol Rep (1997) 80(1):83–8. doi: 10.2466/pr0.1997.80.1.83

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Goodman A. Neurobiology of addiction. An integrative review. Biochem Pharmacol (2008) 75(1):266–322. doi: 10.1016/j.bcp.2007.07.030

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Nava F, Manzato E, Leonardi C, Lucchini A. Opioid maintenance therapy suppresses alcohol intake in heroin addicts with alcohol dependence: preliminary results of an open randomized study. Prog Neuropsychopharmacol Biol Psychiatry (2008) 32(8):1867–72. doi: 10.1016/j.pnpbp.2008.08.019

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Soyka M. Alcohol use disorders in opioid maintenance therapy: prevalence, clinical correlates and treatment. Eur Addict Res (2015) 21(2):78–87. doi: 10.1159/000363232

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Hoang T, Nguyen H, Shiraishi RW, Nguyen M, Bingham T, Nguyen D, et al. Factors associated with concurrent heroin use among patients on methadone maintenance treatment in Vietnam: A a 24-month retrospective analysis of a nationally representative sample. Int J Drug Policy (2018) 55:113–20. doi: 10.1016/j.drugpo.2018.02.020

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Tran BX, Ohinmaa A, Mills S, Duong AT, Nguyen LT, Jacobs P, et al. Multilevel predictors of concurrent opioid use during methadone maintenance treatment among drug users with HIV/AIDS. PloS One (2012) 7(12):e51569. doi: 10.1371/journal.pone.0051569

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Tran BX, Nguyen LT. Impact of methadone maintenance on health utility, health care utilization and expenditure in drug users with HIV/AIDS. Int J Drug Policy (2013) 24(6):e105–110. doi: 10.1016/j.drugpo.2013.07.007

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Peles E, Schreiber S, Adelson M. 15-Year survival and retention of patients in a general hospital-affiliated methadone maintenance treatment (MMT) center in Israel. Drug Alcohol Depend (2010) 107(2–3):141–8. doi: 10.1016/j.drugalcdep.2009.09.013

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Cheng GLF, Liu Y-P, Chan CCH, So K-F, Zeng H, Lee TMC. Neurobiological underpinnings of sensation seeking trait in heroin abusers. Eur Neuropsychopharmacol J Eur Coll Neuropsychopharmacol (2015) 25(11):1968–80. doi: 10.1016/j.euroneuro.2015.07.023

CrossRef Full Text | Google Scholar

50. Moshier SJ, Ewen M, Otto MW. Impulsivity as a moderator of the intention–behavior relationship for illicit drug use in patients undergoing treatment. Addict Behav (2013) 38(3):1651–5. doi: 10.1016/j.addbeh.2012.09.008

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Delorme J, Chenaf C, Kabore J-L, Pereira B, Mulliez A, Tremey A, et al. Incidence of high dosage buprenorphine and methadone shopping behavior in a retrospective cohort of opioid-maintained patients in France. Drug Alcohol Depend (2016) 162:99–106. doi: 10.1016/j.drugalcdep.2016.02.035

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Carrà G, Johnson S, Crocamo C, Angermeyer MC, Brugha T, Azorin J-M, et al. Psychosocial functioning, quality of life and clinical correlates of comorbid alcohol and drug dependence syndromes in people with schizophrenia across Europe. Psychiatry Res (2016) 239:301–7. doi: 10.1016/j.psychres.2016.03.038

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Carrà G, Scioli R, Monti MC, Marinoni A. Severity profiles of substance-abusing patients in Italian community addiction facilities: influence of psychiatric concurrent disorders. Eur Addict Res (2006) 12(2):96–101. doi: 10.1159/000090429

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: opioid use disorder, opioid substitution therapy, opioid use disorder treatment, coaddictions, problem gambling, unsuccessful treatment

Citation: Grall-Bronnec M, Laforgue E-J, Challet-Bouju G, Cholet J, Hardouin J-B, Leboucher J, Guillou-Landréat M and Victorri-Vigneau C (2019) Prevalence of Coaddictions and Rate of Successful Treatment Among a French Sample of Opioid-Dependent Patients With Long-Term Opioid Substitution Therapy: The OPAL Study. Front. Psychiatry 10:726. doi: 10.3389/fpsyt.2019.00726

Received: 15 May 2019; Accepted: 10 September 2019;
Published: 17 October 2019.

Edited by:

Amine Benyamina, Assistance Publique Hopitaux De Paris (AP-HP), France

Reviewed by:

Giuseppe Carrà, University of Milano Bicocca, Italy
Chiara Montemitro, G. d’Annunzio University of Chieti and Pescara, Italy

Copyright © 2019 Grall-Bronnec, Laforgue, Challet-Bouju, Cholet, Hardouin, Leboucher, Guillou-Landréat and Victorri-Vigneau. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Marie Grall-Bronnec, marie.bronnec@chu-nantes.fr

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.