Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 31 August 2017
Sec. Addictive Disorders

Malmö Treatment Referral and Intervention Study—High 12-Month Retention Rates in Patients Referred from Syringe Exchange to Methadone or Buprenorphine/Naloxone Treatment

\r\nMartin Brbck,*Martin Bråbäck1,2*Lars Ekstrm,Lars Ekström2,3Katja Troberg,Katja Troberg1,2Suzan Nilsson,Suzan Nilsson1,2Pernilla Isendahl,Pernilla Isendahl2,4Louise BrdvikLouise Brådvik2Anders Hkansson,\r\nAnders Håkansson1,2
  • 1Addiction Center Malmö, Division of Psychiatry, Malmö, Sweden
  • 2Faculty of Medicine, Department of Clinical Sciences, Psychiatry, Lund University, Lund, Sweden
  • 3Department of Clinical Pathology, Sahlgrenska University Hospital, Gothenburg, Sweden
  • 4Department of Infectious Diseases, University Hospital Skåne, Malmö, Sweden

Background: Heroin dependence is associated with high mortality. Opioid agonist treatment (OAT) with methadone or buprenorphine has strong evidence for treatment of this relapsing condition. In our setting, OAT has been associated with strict and demanding intake procedures, often with requirements of social stability, but also high, approximately 80 percent 12-month retention rates. In a recent randomized controlled trial, we demonstrated high rates of successful rapid referral from a syringe exchange programme (SEP) to treatment with methadone or buprenorphine, including actual treatment initiation. The objectives of this study were to assess 12-month retention rates, in order to assess whether a novel referral program of current drug users at a SEP would achieve retention rates comparable to more traditional intake procedures.

Methods: The present report is a 12-month follow-up of 71 patients who successfully started treatment with methadone or buprenorphine/naloxone. Patient data from baseline and at 12 months were collected.

Results: Out of the 71 patients who started treatment, 58 (82%) were still in treatment after 12 months.

Conclusion: This was a population, referred from a SEP, with a high drug use severity on admission and no pretreatment requirement for social stability, but there were still high retention rates at 12 months comparable to regular opioid agonist clinics in our setting.

Introduction

Heroin dependence is a chronic relapsing disorder with high mortality (1, 2). In several clinical trials, opioid agonist treatment (OAT) with methadone or buprenorphine have been shown to reduce mortality and also to be efficient with regard to reduced drug use criminal activity, HIV risk behavior, and to suppress symptoms of the addictive disorder itself (313). Retention in treatment is critical and the benefits of remaining in OAT for at least 1 year is well established (1417). The mean 12-month retention is approximately 50–60% (1722).

Patients at syringe exchange programme (SEP) may seem a rational target population for recruitment to methadone and buprenorphine treatment programs, but successful recruitment in this setting may be a challenge. Individuals attending a SEP report a high degree of drug use severity and a high prevalence of psychiatric comorbidity compared to other out-of-treatment or treatment seeking opioid users (2327). There is also evidence that when referred to OAT, SEP participants have a poorer treatment response (28). In contrast, in the recently published Malmö Treatment Referral and Intervention Study (MATRIS), we showed that SEP can be efficient for rapidly transferring heroin-dependent patients to evidence-based treatment with methadone and buprenorphine with high rates of referral (99%) and treatment entry (96%) (29). Previous data from the present setting, traditionally characterized by less rapid and high-threshold intake procedures, have demonstrated high rates of treatment retention for patients included in methadone or buprenorphine treatment (30).

In the present study, we aimed to study whether the rapid intake procedure—without the requirement for social stability in a population with a high degree of substance-related problems—could still be associated with high 12-month retention rates.

Materials and Methods

Study Design

The present study is a 12-month follow-up of the patients who started treatment at an outpatient clinic for OAT is a result of our two-group randomized controlled trial MATRIS. Inclusion took place at the SEP in Malmö, Sweden, and all participants were referred to the same research treatment facility run by Malmö Addiction Center. Inclusion for the study took place between October 21, 2011 and April 1, 2013, and all participants signed informed consent. MATRIS was designed to test the effectiveness of a SEP for referring patients to treatment with methadone or buprenorphine but also to assess the effect of a strength-based case management intervention (CMI) with regard to treatment entry (3133). The participants were randomized to a CMI (intervention group) or to a referral-only condition (control group). Regardless of intervention type, we saw high referral rates with 71 patients successfully starting maintenance treatment. The present study is a follow-up to 12 months with regard to retention in treatment. The study was approved by the regional ethics board Lund, Sweden and registered at www.clinicaltrials.gov with nr NCT01457872.

Setting

This study took place in Malmö, which is situated in the region of Skåne in the southern part of Sweden. Skåne has a population of around 1.3 million and the biggest city is Malmö with a population of approximately 300,000. SEPs were established in two Swedish cities (Malmö and Lund) in the 1980s and in addition to exchange of syringes and needles, the programs offer interventions aimed at motivating the individual to accept care and treatment. The SEP in Malmö is run by the Department of Infectious Diseases. In Sweden, methadone, as treatment for opioid dependence was introduced as early as the late 1960s and buprenorphine in 1999. OAT is only allowed at special addiction treatment units, the thresholds for treatment have been high and availability low resulting in waiting lists at many treatment facilities. The retention rates for patients admitted to maintenance treatment have, however, traditionally been high in Sweden (30).

Participants and Recruitment

Participants were individuals who had been enrolled in OAT with buprenorphine/naloxone or methadone through the MATRIS study. Eligible participants for that study were opioid-dependent individuals enrolled in the SEP. About 1,000 individuals were actively participating in the SEP during the time of the study and about half of them stated their drug of choice to be heroin. Eligible participants were initially approached by the SEP staff and if interested in participating within days scheduled for formal study inclusion and baseline interview, which was conducted by two social workers trained in case management. Exclusion criteria were pregnancy, severe unstable psychiatric condition, inability to understand information, and to provide informed consent, and if the patient was already formally participating in treatment. At the baseline interview, the participants were asked about medical, psychiatric, and drug use history. After finishing the baseline interview, the participants were randomized. Both groups also received an appointment to the physician at the outpatient clinic for OAT 7 days after the randomization. At the medical examination, at the outpatient clinic, the participants provided a urine sample for urine toxicology and the physician assessed whether the participants were eligible for OAT with methadone or buprenorphine according to national regulations. OAT was started 4 days after the medical examination if the participant was deemed eligible. The choice of medication was based on clinical characteristics and outside of the study protocol. The methods for this part of the study are described in detail elsewhere (29). Out of the 75 recruited and randomized patients, 71 started treatment with methadone or buprenorphine. The patients who entered treatment had a mean age of 39 with a range from 23 to 65. Of the participants, 52 (73%) were males and 19 (27%) females. Thirty-one per cent reported that they had their own apartment and 9% were employed. The patients were allowed to state multiple primary sources of income and the most common were social welfare (61%), crime (55%), and from family or partner (39%). On average, they started using heroin at age 21 and reported injecting, 21 of 30 days prior to study inclusion. Eighty per cent reported hepatitis C infection, 70% reported previous defined overdoses, and 31% previous suicide attempts. On average, they rated their quality of life on a visual analog scale 32 of 100.

The patients received standard care at the outpatient clinic for OAT and were followed up with regard to retention in treatment.

Statistical Analysis

Survival analysis was conducted. The number of days in treatment was used as the time-dependent variable. The outcome variable was treatment retention at 12 months. The statistical analysis was made with IBM SPSS Statistics (version 22).

Results

Out of the 71 patients who entered treatment, 67 (94%) were still in treatment after 3 months, 63 (89%) after 6 months, and 58 (82%) after 12 months (Figure 1).

FIGURE 1
www.frontiersin.org

Figure 1. Patients retained in treatment over time.

Discussion

In a previous publication, our group showed that SEPs can be efficient for structured referral of opioid-dependent individuals to evidence-based treatment (29). In this 12-month follow-up of the patients who entered treatment, we demonstrate high-retention rates despite having a study population with a high degree of substance-related problems at baseline, and despite using a rapid referral procedure from an out-of-treatment SEP setting.

Studies examining retention rates when it comes to SEP referrals are scarce, and to our knowledge, this is the first one outside the US. Neufeld et al. reported that SEP referrals in Baltimore were less likely to complete 1 year in treatment (35%), compared to other referrals (56%). Referral condition was, however, not associated with outcome when it was adjusted for baseline variables known to be associated with poorer response to OAT, such as high drug use severity, injection drug use, and unemployment (28, 34, 35). The average 12-month retention overall, not for subjects specifically referred from SEPs, have in different studies been shown to be approximately 50–60% (1722). In our population, 82% were still in treatment after 1 year, which is comparable (80% or higher) to regular opioid agonist clinics in Sweden (30). Thus, we draw the conclusion that SEPs may be feasible for treatment referral even with respect to longer course in treatment, and that they should be used as a link to treatment for people who inject drugs, as suggested also by other authors (36).

Our study has several limitations. One is that the relatively small total number of included subjects, which together with the high retention rate at 12 months prevented us from looking at variables potentially predicting retention. The setting being in Sweden, where all the included subjects were covered by the National Swedish Health Insurance, is another factor that might have influenced our retention rates and means that we cannot generalize our findings to settings where the cost for treatment could potentially influence retention rates. A strength, however, is that all the patients were referred to the same outpatient clinic with the same physician (the first author of this paper), which made follow-up easier and certain.

In summary, the present study was a 12-month follow-up of patients who had been rapidly transferred from a SEP to evidence-based treatment with methadone or buprenorphine/naloxone. In addition to previous data indicating that this may be an effective way of referral to treatment, we now also demonstrate that referral from SEP holds promise with respect to 12-month retention in treatment, demonstrating high retention comparable to that reported from more traditional and extensive intake procedures. This was found in a population with a high drug use severity on admission and no requirement for social stability. This highlights the importance of regarding SEPs not only as a harm reduction measure but also as a concrete possible link to effective evidence-based treatment.

Ethics Statement

This study was carried out in accordance with the recommendations of the regional ethics board Lund, Sweden with written informed consent from all subjects in accordance with the Declaration of Helsinki. The protocol was approved by the regional ethics board Lund, Sweden.

Author Contributions

MB: Ph.D. student in the project. Physician responsible for formal inclusion and evaluation of included patients. Principal writer of the manuscript. LE: did, as a medical student, preliminary statistical calculations and also took part in a preliminary draft of the manuscript. SN and PI: project assistant responsible for recruitment, randomization and assessment of patients, and provider of the studied intervention. Coworker in the follow-up of patients. KT: manager of the outpatient facility responsible for medical evaluation and treatment of included patients. Substantial activity in the practical setup of the study procedures and arrangements for medical evaluation and treatment. Coworker in the follow-up of patients and in randomization procedures. LB: co-supervisor of Ph.D. student MB. Scientific contributions related to manuscript writing and interpretations of results and limitations. AH: principal investigator of the project. Supervisor of Ph.D. student MB. Main responsible for study design including recruitment and randomization procedures, interventions, and scientific planning for the receiving treatment facility. All authors contributed to, approved of the manuscript, approved of submission to the journal.

Conflict of Interest Statement

MB was invited to speak at the 7th Nordic Opioid Addiction Treatment Conference 2014, Helsinki, Finland. The conference was supported by RB Pharmaceuticals. MB received travel funds but no speaker fee. MB was also invited speaker at the Scottish Needle Exchange Conference 2014. The conference supported by Reckitt Benckiser, neo360, www.exchangesupplies.org, methameasure Ltd., pasante and solutions action management. MB did not receive any speaker fee but travel and accommodation was covered by the organizers. KT received travel funds from Nordic Drugs to attend ISAM in Malaysia 2014. According to Swedish legislation, her public employer paid for half of the amount. AH has no conflicts of interest to report related to the present study. He is involved in collaborations with two pharmaceutical companies in the preparation of clinical trials unrelated to the present paper and without receiving any personal salary from these bodies. He has been the local co-investigator in an epidemiological survey conducted by the independent research institute Research Triangle Institute (RTI), in a study for which RTI received funding from Shire, without any personal salary paid to the co-investigators. AH holds a position in addiction medicine as an employed researcher at Lund University. For this employment, the university receives funding from the national Swedish gaming operator (Svenska spel) owned by the Swedish government, as part of the company’s legislation-based responsibility for prevention and research against gambling problems. The other authors report no relevant financial conflicts.

Funding

The sponsor of the study (the National Swedish Research Council for Working Life and Social Sciences, grant number 2009/1725) had no role in study design, data collection, data analysis, data interpretation, or writing of the report.

References

1. Goldstein A, Herrera J. Heroin addicts and methadone treatment in Albuquerque: a 22-year follow-up. Drug Alcohol Depend (1995) 40(2):139–50. doi:10.1016/0376-8716(95)01205-2

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Hser YI, Hoffman V, Grella CE, Anglin MD. A 33-year follow-up of narcotics addicts. Arch Gen Psychiatry (2001) 58(5):503–8. doi:10.1001/archpsyc.58.5.503

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Grönbladh L, Öhlund LS, Gunne LM. Mortality in heroin addiction: impact of methadone treatment. Acta Psychiatr Scand (1990) 82(3):223–7. doi:10.1111/j.1600-0447.1990.tb03057.x

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Fugelstad A, Rajs J. Mortality among HIV-infected intravenous drug addicts in Stockholm in relation to methadone treatment. Addiction (1995) 90(5):711–6. doi:10.1111/j.1360-0443.1995.tb02209.x

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Caplehorn JR, Dalton MS, Haldar F, Petrenas AM, Nisbet JG. Methadone maintenance and addicts’ risk of fatal heroin overdose. Subst Use Misuse (1996) 31(2):177–96. doi:10.3109/10826089609045806

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Brugal MT, Domingo-Salvany A, Puig R, Barrio G, García de Olalla P, De La Fuente L. Evaluating the impact of methadone maintenance programmes on mortality due to overdose and aids in a cohort of heroin users in Spain. Addiction (2005) 100(7):981–9. doi:10.1111/j.1360-0443.2005.01089.x

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Kakko J, Grönbladh L, Svanborg KD, von Wachenfeldt J, Rück C, Rawlings B, et al. A stepped care strategy using buprenorphine and methadone versus conventional methadone maintenance in heroin dependence: a randomized controlled trial. Am J Psychiatry (2007) 164(5):797–803. doi:10.1176/ajp.2007.164.5.797

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Mattick RP, Breen C, Kimber J, Davoli M. Buprenorphine maintenance versus placebo or methadone maintenance for opioid dependence. Cochrane Database Syst Rev (2014) 2:CD002207. doi:10.1002/14651858.CD002207.pub4

CrossRef Full Text | Google Scholar

9. Metzger DS, Navaline H, Woody GE. Drug abuse treatment as AIDS prevention. Public Health Rep (1998) 113(Suppl 1):97–106.

PubMed Abstract | Google Scholar

10. Stark K, Müller R, Bienzle U, Guggenmoos-Holzmann I. Methadone maintenance treatment and HIV risk-taking behaviour among injecting drug users in Berlin. J Epidemiol Community Health (1996) 50(5):534–7. doi:10.1136/jech.50.5.534

CrossRef Full Text | Google Scholar

11. Gowing L, Farell MF, Bornemann R, Sullivan LE, Ali R. Oral substitution treatment of injecting opioid users for prevention of HIV infection. Cochrane Database Syst Rev (2011) (8):CD004145. doi:10.1002/14651858.CD004145.pub4

CrossRef Full Text | Google Scholar

12. McLellan A, Lewis DC, O’Brien CP, Kleber HD. Drug dependence, a chronic medical illness: implications for treatment, insurance, and outcomes evaluation. JAMA (2000) 284(13):1689–95. doi:10.1001/jama.284.13.1689

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Dole VP, Nyswander ME, Kreek MJ. Narcotic blockade. Arch Intern Med (1966) 118(4):304–9. doi:10.1001/archinte.1966.00290160004002

CrossRef Full Text | Google Scholar

14. Simpson DD, Joe GW. Regular article: a longitudinal evaluation of treatment engagement and recovery stages. J Subst Abuse Treat (2004) 27:89–97. doi:10.1016/j.jsat.2004.03.001

CrossRef Full Text | Google Scholar

15. Peles E, Schreiber S, Adelson M. Factors predicting retention in treatment: 10-year experience of a methadone maintenance treatment (MMT) clinic in Israel. Drug Alcohol Depend (2006) 82(3):211–7. doi:10.1016/j.drugalcdep.2005.09.004

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Levine AR, Lundahl LH, Ledgerwood DM, Lisieski M, Rhodes GL, Greenwald MK. Gender-specific predictors of retention and opioid abstinence during methadone maintenance treatment. J Subst Abuse Treat (2015) 54:37–43. doi:10.1016/j.jsat.2015.01.009

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Kelly SM, O’Grady KE, Mitchell SG, Brown BS, Schwartz RP. Predictors of methadone treatment retention from a multi-site study: a survival analysis. Drug Alcohol Depend (2011) 117(2–3):170–5. doi:10.1016/j.drugalcdep.2011.01.008

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Ball JC, Ross A, editors. The Effectiveness of Methadone Maintenance Treatment: Patients, Programs, Services, and Outcomes. New York: Springer-Verlag (1991).

Google Scholar

19. Hubbard RL, Craddock SG, Flynn PM, Anderson J, Etheridge RM. Overview of 1-year follow-up outcomes in the Drug Abuse Treatment Outcome Study (DATOS). Psychol Addict Behav (1997) 11(4):261–78. doi:10.1037/0893-164X.11.4.261

CrossRef Full Text | Google Scholar

20. Joe GW, Simpson DD, Broome KM. Retention and patient engagement models for different treatment modalities in DATOS. Drug Alcohol Depend (1999) 57(2):113–25. doi:10.1016/S0376-8716(99)00088-5

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Villafranca SW, McKellar JD, Trafton JA, Humphreys K. Predictors of retention in methadone programs: a signal detection analysis. Drug Alcohol Depend (2006) 83(3):218–24. doi:10.1016/j.drugalcdep.2005.11.020

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Bart G. Maintenance medication for opiate addiction: the foundation of recovery. J Addict Dis (2012) 31(3):207–25. doi:10.1080/10550887.2012.694598

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Brooner R, Kidorf M, King V, Beilenson P, Svikis D, Vlahov D. Drug abuse treatment success among needle exchange participants. Public Health Rep (1998) 113(Suppl 1):129–39.

PubMed Abstract | Google Scholar

24. Henderson LA, Vlahov D, Celentano DD, Strathdee SA. Readiness for cessation of drug use among recent attenders and nonattenders of a needle exchange program. J Acquir Immune Defic Syndr (2003) 32(2):229–37. doi:10.1097/00126334-200302010-00017

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Hahn JA, Vranizan KM, Moss AR. Who uses needle exchange? A study of injection drug users in treatment in San Francisco, 1989-1990. J Acquir Immune Defic Syndr Hum Retrovirol (1997) 15(2):157–64.

Google Scholar

26. Bruneau J, Lamothe F, Franco E, Lachance N, Désy M, Soto J, et al. High rates of HIV infection among injection drug users participating in needle exchange programs in Montreal: results of a cohort study. Am J Epidemiol (1997) 146(12):994–1002. doi:10.1093/oxfordjournals.aje.a009240

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Kidorf M, Disney ER, King VL, Neufeld K, Beilenson PL, Brooner RK. Prevalence of psychiatric and substance use disorders in opioid abusers in a community syringe exchange program. Drug Alcohol Depend (2004) 74(2):115–22. doi:10.1016/j.drugalcdep.2003.11.014

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Neufeld K, King V, Peirce J, Kolodner K, Brooner R, Kidorf M. A comparison of 1-year substance abuse treatment outcomes in community syringe exchange participants versus other referrals. Drug Alcohol Depend (2008) 97(1–2):122–9. doi:10.1016/j.drugalcdep.2008.03.026

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Bråbäck M, Nilsson S, Isendahl P, Troberg K, Brådvik L, Håkansson A. Malmö Treatment Referral and Intervention Study (MATRIS)—effective referral from syringe exchange to treatment for heroin dependence: a pilot randomized controlled trial. Addiction (2016) 111:866–73. doi:10.1111/add.13249

CrossRef Full Text | Google Scholar

30. Romelsjö A, Engdahl B, Stenbacka M, Fugelstad A, Davstad I, Leifman A, et al. Were the changes to Sweden’s maintenance treatment policy 2000–06 related to changes in opiate-related mortality and morbidity? Addiction (2010) 105(9):1625–32. doi:10.1111/j.1360-0443.2010.02999.x

CrossRef Full Text | Google Scholar

31. Rapp RC, Siegal HA, Fisher JH. A strengths-based model of case management/advocacy: adapting a mental health model to practice work with persons who have substance abuse problems. NIDA Res Monogr (1992) 127:79–91.

Google Scholar

32. Rapp RC, Otto AL, Lane DT, Redko C, McGatha S, Carlson RG. Improving linkage with substance abuse treatment using brief case management and motivational interviewing. Drug Alcohol Depend (2008) 94:172–82. doi:10.1016/j.drugalcdep.2007.11.012

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Smith L, Newton R. Systematic review of case management. Aust N Z J Psychiatry (2007) 41:2–9. doi:10.1080/00048670601039831

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Magura S, Nwakeze PC, Demsky S. Pre- and in-treatment predictors of retention in methadone treatment using survival analysis. Addiction (1998) 93(1):51–60. doi:10.1046/j.1360-0443.1998.931516.x

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Morral AR, Belding MA, Iguchi MY. Identifying methadone maintenance clients at risk for poor treatment response: pretreatment and early progress indicators. Drug Alcohol Depend (1999) 55(1–2):25–33. doi:10.1016/S0376-8716(98)00176-8

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Kidorf M, King VL. Expanding the public health benefits of syringe exchange programs. Can J Psychiatry (2008) 53(8):487–95. doi:10.1177/070674370805300803

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: opioid dependence, syringe exchange, methadone, buprenorphine, maintenance treatment

Citation: Bråbäck M, Ekström L, Troberg K, Nilsson S, Isendahl P, Brådvik L and Håkansson A (2017) Malmö Treatment Referral and Intervention Study—High 12-Month Retention Rates in Patients Referred from Syringe Exchange to Methadone or Buprenorphine/Naloxone Treatment. Front. Psychiatry 8:161. doi: 10.3389/fpsyt.2017.00161

Received: 11 May 2017; Accepted: 14 August 2017;
Published: 31 August 2017

Edited by:

Alain Dervaux, Centre hospitalier Sainte-Anne, France

Reviewed by:

Mercedes Lovrecic, National Institute for Public Health, Slovenia
Alexandre Dumais, Université de Montréal, Canada

Copyright: © 2017 Bråbäck, Ekström, Troberg, Nilsson, Isendahl, Brådvik and Håkansson. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Martin Bråbäck, martin.braback@med.lu.se

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.