ORIGINAL RESEARCH article

Front. Med., 07 May 2019

Sec. Regulatory Science

Volume 6 - 2019 | https://doi.org/10.3389/fmed.2019.00073

Alignment of European Regulatory and Health Technology Assessments: A Review of Licensed Products for Alzheimer's Disease

  • 1. Medicines Evaluation Board, Utrecht, Netherlands

  • 2. National Institute for Health and Care Excellence, London, United Kingdom

  • 3. National Institute for Health and Care Excellence, Manchester, United Kingdom

  • 4. Biogen, Baar, Switzerland

  • 5. National Health Care Institute, Diemen, Netherlands

Abstract

Aims: To facilitate regulatory learning, we evaluated similarities and differences in evidence requirements between regulatory and health technology assessment (HTA) bodies of Alzheimer's disease (AD) approved products.

Methods: The European marketing authorisation application dossiers and European public assessment reports (EPARs) of the licensed AD drugs were screened to identify the phase III randomised controlled trials (RCTs) and outcomes used. We also screened the assessment reports of the National Institute of Health and Care Excellence (NICE, England) and the National Health Care Institute (ZiN, the Netherlands) to identify the studies and outcomes used in HTA assessments.

Results: The application dossiers of donepezil, galantamine, rivastigmine, and memantine contained 16 phase III RCTs in total. These trials were also included in HTA assessments except that NICE excluded studies that were not published (n = 2) or trials that included patients with other types of dementia (n = 3). In the regulatory assessments the focus was on cognitive and global outcomes, and to some extent on function. In the HTA assessments of clinical effectiveness other domains were also covered including: function, behaviour and mood, and, occasionally, quality of life. In the economic analyses of NICE the domains cognition, function, and quality of life were included.

Conclusion: There was a large overlap in inclusion of trials in regulatory and HTA assessments, although the focus on specific outcomes slightly differed. Understanding the methods and perceptions of both authorities can stimulate regulatory and HTA cross-talk and further alignment, and therefore more rapid patient access to new treatments.

Introduction

Alzheimer's disease (AD) is the most common cause of dementia worldwide and in Europe; the estimated prevalence of the disease ranges from 1 to 2% in persons aged 60 years and older, and the prevalence of AD is expected to increase substantially in the next decade (). Currently, two different classes of AD drugs are available on the European market: the cholinesterase inhibitors (rivastigmine, donepezil, and galantamine) and one non-competitive N-methyl-D-aspartate receptor antagonist (NMDA; memantine) (). As these drugs are symptomatic treatments, providing only temporary and modest improvement in AD symptoms, a large unmet medical need remains in AD. There are now around 100 AD drugs in the drug-development pipeline, of which around 70% are disease-modifying agents ().

Patient access to new drugs requires marketing authorisation from a regulatory authority and reimbursement by a payer. In the European Union (EU), the centralised marketing authorisation procedure is compulsory for drugs that treat neurodegenerative disorders in humans (). Under this procedure, the company submits a single marketing authorisation dossier to the European Medicines Agency (EMA) and will be granted a marketing authorisation for the European Economic Area if the drug's benefit-risk profile is positive. Health technology assessments (HTA) and reimbursement decisions take place at a national or regional level and methods vary between regions. The focus is usually on clinical effectiveness, cost-effectiveness and budget impact of a drug as compared to existing treatment options (, ).

Due to differences in evidence requirements it can be challenging for pharmaceutical companies to design clinical trials that meet the needs of both regulatory and HTA agencies (). Several initiatives have been launched in recent years to increase the interaction between medicines' developers, regulators and HTA bodies and the EMA now offers joint scientific advice with the European Network for Health Technology Assessment (EUnetHTA), allowing companies to obtain feedback on their development plans from both regulators and HTA bodies ().

Narrowing the gap in evidence requirements between regulatory and HTA agencies could facilitate more efficient drug development and earlier patient access to promising treatments. To inform constructive collaborations between all stakeholders it is important to determine what differences in evidence requirements actually exist. Therefore, the objective of this study was to assess differences and similarities in inclusion of clinical trials, outcome domains, and the use of real world evidence in regulatory and HTA assessments of the four currently available AD drugs.

Methods

We included the three cholinesterase inhibitors (donepezil, galantamine, and rivastigmine) and the NMDA antagonist memantine in this study as they are the currently authorised drugs for AD. Donepezil and galantamine were approved through the European mutual recognition procedures in 1997 (2011 in the Netherlands) and 2000, respectively, and rivastigmine and memantine through the European Medicines Agency's (EMA) centralised procedures in 1998 and 2002.

Regulatory Assessments

We collected all information from the application dossiers for marketing authorisation, regulatory assessment reports, and the European public assessment reports (EPARs) that were accessed through the Dutch Medicines Evaluation Board database (application dossiers for marketing authorisation of the mutual recognition procedures (donepezil and galantamine), the summary of the application dossiers for the centralised procedures (rivastigmine and memantine), and the regulatory assessment report of galantamine), or the EMA website (EPARs, rivastigmine and memantine) (, ). See Figure 1 for an overview of all included data sources.

Figure 1

We extracted the following information on the marketing authorisation procedures of AD products: year of approval, product name, and the indication for which a product was approved. Additionally, detailed information was collected from the phase III randomised controlled trials included in the application dossiers: name of the study, study design, drugs and dosages, number of participants, primary and secondary endpoints, and whether the study had been published in a peer reviewed journal. Furthermore, from the EPARs and the regulatory assessment report we extracted which outcome domains were used in the regulatory assessments.

HTA Assessments

We included the HTA reports from The National Institute of Health and Care Excellence (NICE; England's HTA body) and from the National Health Care Institute (ZiN; Dutch HTA body) as the authors had access to the assessment reports required for this study. NICE's most recent assessment encompassed all four AD drugs and is publically available (Technology Appraisal TA217: Donepezil, galantamine, rivastigmine and memantine for the treatment of Alzheimer's disease). The ZiN assessment report of donepezil was accessed through the ZiN website (), but the galantamine and memantine reports were not publicly available and were obtained from ZiN directly. In the current study, we included both the first ZiN assessment report of memantine (2003) and the reassessment report of 2004, as memantine was only reimbursed in the Netherlands after the second assessment. We could not access the ZiN assessment report of rivastigmine and therefore it was not included in this study (Figure 1).

We extracted the following data from the HTA reports: publication date, indication(s) for which the product was assessed, overview of included studies, outcome domains of the assessment, and use of real world evidence. For the NICE appraisals we also evaluated the effectiveness measures used in the economic analyses. No economic analyses were used in the available ZiN assessments.

Results

Clinical Trials Included in Regulatory and HTA Assessments

We found that out of the 16 phase III trials that were included in the marketing authorisation application dossiers of the four drugs, 12 were included in the ZiN appraisals (no data available for rivastigmine) and 11 were included in the most recent NICE appraisal (Table 1). The reasons for exclusion of five trials in the NICE report were that patients with other types of dementia were included (n = 3) or the results of those trials were not, or only partially, published in peer-reviewed journals (n = 2) (Table 2). Supplementary Table 1 gives an overview of the characteristics of all 16 phase III RCTs included in the marketing authorisation application dossiers, including information on the trial arms, number of participants, disease severity of included patients, and primary and secondary outcome measures.

Table 1

AD productRegulatory assessmentNICE, TA217ZiN
Donepezil
- Year assessment199720112013
- Main Sources of evidence3 phase III RCTsa:
- E2020-A0001-302 ()
- E2020-A0001-301 ()
- E2020-A0001-304 ()
19 RCTs (–), including:
- E2020-A0001-302 ()
- E2020-A0001-301 ()
- E2020-A0001-304 () 7 head-to-head comparisons (–)b
systematic reviews (, )
Submissions of consultees and personal statementsc
1 Systematic review (), including:
- E2020-A0001-302 ()
- E2020-A0001- - 301 ()
- E2020-A0001-304 ()
- 45 additional RCTs
2 head-to-head comparisons (, ) Registration textsd
- Main outcome domainsCognition
Global effect
Cognition
Global Effect
Function
Behaviour and mood
Quality of Life
Cognition
Global effect
Function
Behaviour and mood
Rivastigmine
- Year assessment19982011Report not available
- Main Sources of evidence4 phase III RCTs:
- B351 ()
- B352 ()
- B303 ()
- B304 ()
7 RCTs (–), including:
- B352 ()
- B303 ()
- B304 ()
5 head-to-head comparisons (, , , , )b
3 systematic reviews (, , )
Submissions of consultees and personal statementsc
- Main outcome domainsCognition
Global effect
Cognition
Global Effect
Function
Behaviour and moode
Galantamine
- Year assessment200020112003
- Main Sources of evidence5 phase III RCTs:
- GAL-95-05 - GAL-INT-1 ()
- GAL-INT-2 ()
- GAL-USA-1 ()
- GAL-USA-10 ()
8 RCTs (–), including:
- GAL-INT-1 ()
- GAL-INT-2 ()
- GAL-USA-1 ()
- GAL-USA-10 ()
4 head-to-head comparisons (, , , )b
2 systematic reviews (, )
Submissions of consultees and personal statementsc
6 RCTs (–, ), including:
- GAL-INT-1 ()
- GAL-INT-2 (
- GAL-USA-1 ()
- GAL-USA-10 ()
2 systematic reviews (, ): () included all regulatory phase III trials including GAL-95-05
NICE TA19 ()
Registration textsd
- Main outcome domainsCognition
Global effect
(Function)f
Cognition
Global Effect
Function
Behaviour and moode
Cognition
Global effect
Function
Memantine
- Year assessment20022011g2003 and 2004
- Main Sources of evidence4 phase III RCTs
- MRZ-9605 ()
- MRZ-9403 ()
- MRZ-9202 ()
- MRZ-9408 ()
2 RCTs (, ), including:
- MRZ-9605 ()
1 systematic review that included all four AD products ()
Submissions of consultees and personal statementsc
Registration textsd, that included results of:
- MRZ-9605 ()
- MRZ-9403 ()
- MRZ-9202 ()
- MRZ-9408 ()
1 RCT ()
Post-hoc analyses on RCT-data (, )
- Main outcome domainsCognition
Global effect
Function
Cognition
Global Effect
Function
Behaviour and moode
Cognition
Global effect
Function

Alignment of regulatory and HTA assessments of NICE and ZiN.

a

RCTs randomised controlled trials.

b

three head-to-head trials (, , ) were described in detail in the NICE assessment report, however they were considered to be of insufficient quality to inform the review.

c

consultees include submissions from patient and professional organisations and manufacturers; personal statements include statements from patient and professional experts.

d

registration texts included EPARs (when available) and summaries of product characteristics (SmPC).

e

NICE intended to assess quality of life, but there was not enough randomised controlled evidence available to perform this assessment.

f

the outcome domain ‘function' was mentioned in the summary of the regulatory assessment report, but it was not mentioned in the section of the risk-benefit analysis.

g

NICE additionally assessed the effectiveness of memantine in combination with a cholinesterase inhibitor versus cholinesterase inhibitor monotherapy separately. In this assessment 2 RCTs were included (, ).

Table 2

DrugTrialReason for exclusion in the NICE assessment
GalantamineGAL-95-05Trial was not published
RivastigmineB351, Schneider et al. ()In the publication of this trial the results are pooled with the results of two other trials (, ) and the results from this individual trial could not be extracted from this publication
MemantineMRZ-9403, Winblad et al. ()Next to patients with probable AD, patients with probable vascular of mixed type dementia were included
MRZ-9202, Wilcock et al. ()Only patients with vascular dementia were included
MRZ-9408, Orgogozo et al. ()Only patients with vascular dementia were included

Reason of exclusion of phase 3 trials of the marketing authorisation dossiers in the NICE assessment of clinical effectiveness.

Outcome Measures and Domains Included in Regulatory and HTA Assessments

Overall, a large variety of different outcome measures were used in both the HTA assessments and the phase III trials of the marketing authorisation dossiers. Five main outcome domains could be identified: cognition, function, global effect, behaviour and mood, and quality of life. Supplementary Table 2 gives an overview and glossary of the outcome measures used per outcome domain.

We identified slight differences in outcome domains that were included in the regulatory assessments compared with the HTA assessments (Table 1). In the risk-benefit analyses of the regulatory assessments, only primary outcomes of the registration trials were considered; namely cognition and global effect for mild-to-moderate AD (donepezil, galantamine, rivastigmine, and memantine) and function and global effect for moderate-to-severe AD (memantine). However, in the only available regulatory assessment report (galantamine), the results of the secondary outcome measures (function and behaviour and mood) were also mentioned, and thus implicitly assessed. In the assessment of clinical effectiveness, NICE evaluated the totality of evidence, including the outcome domains cognition, function, global effect, behaviour and mood, and quality of life, however, due to a lack of randomised evidence, quality of life could only be assessed for donepezil. In the economic analyses of NICE the domains cognition, function, and health related quality of life were included. In the model, health-related quality of life (EuroQol-5 Dimensions, EQ-5D) was mapped from cognition values.

ZiN assessed the outcome domains cognition, function, and global effect. Additionally “behaviour and mood” was assessed in the report of donepezil.

Types of Evidence Included in HTA Assessments

The NICE assessment (TA217) evaluated the clinical effectiveness of the AD products by a systematic review of research evidence. Only systematic reviews of RCTs and RCTs were included (Table 1). Where data permitted, the results of the individual trials were pooled using meta-analyses (). The manufacturers of donepezil submitted a systematic review that included both RCTs and observational studies. Results from observational data were specifically used to support the effectiveness of donepezil beyond 6 months of use, its effect on mortality, impact on care-giver stress and carer-time, and symptoms after withdrawal (). The other manufacturers did not submit observational data. The submissions of the manufacturers were mainly used to compare their findings with the results of the systematic review of NICE.

In the ZiN assessment of galantamine the main evidence sources were the summary of product characteristics (SmPC) from the registration dossier and two Cochrane reviews of galantamine and rivastigmine (, ). In addition, a systematic review that included all three cholinesterase inhibitors (), six randomised controlled trials (–, ), and the 2001 NICE appraisal () were included. In the ZiN assessment report of donepezil (2013), comparators were rivastigmine and galantamine and main evidence sources were SmPC's, two head-to-head trials (, ), and one meta-analysis (). The main source of evidence for the ZiN assessment of memantine in 2003 was the EPAR. In the reassessment of memantine (2004) one additional RCT was included and two publications that included post-hoc analyses on RCTs that were already included in the first assessment (–). ZiN did not include observational studies or other types of real-world evidence in any of the assessments.

Discussion

The current study shows that the gap between regulatory and HTA assessments of approved AD drugs was not as large as it might be perceived. There was a large overlap in inclusion of RCTs, although the focus on specific outcomes slightly differed between regulatory and HTA assessments. In the assessment of clinical effectiveness, HTA evaluates the totality of evidence, including the outcome domains cognition, function, global effect, behaviour and mood, and, occasionally, quality of life and observational data. In the economic assessment of NICE only the dimensions cognition, function, and quality of life were included in the model. In contrast, in the risk benefit analyses of the regulatory assessments only primary outcomes of the registration trials were taken into account, namely cognition and global effect for mild-to-moderate AD and function and global effect for moderate-to-severe AD. Secondary endpoints were mentioned in the regulatory assessment report and are thus implicitly assessed as well.

All four drugs included in this study have been available for many years. In September 2018 the new EMA guideline on the clinical investigation of medicines for the treatment of AD came into effect, which distinguishes between patients with established AD, prodromal AD or mild cognitive impairment, and preclinical disease (). For patients with established AD efficacy should be specified for the domains cognition, function, and global effect, with secondary endpoints including health-related quality of life, and behavioural and psychiatric symptoms. All these outcome domains were part of the HTA assessments included in our study, suggesting that for AD, regulatory and HTA requirements might not be far apart with respect to preferred endpoints.

The majority of AD drugs that are currently in the pipeline are disease-modifying agents that intend to prevent or slow disease progression and usually target underlying pathophysiologic mechanisms (e.g., amyloid and/or tau) early in the disease course (). The EMA guideline indicates that in earlier disease stages, such as mild cognitive impairment (MCI) and prodromal AD, the use of primary endpoints assessing cognition and function or global might be difficult due to limitations of the currently available instruments. However, it remains important to demonstrate that the effects of treatments are clinically relevant. Possible solutions could be constructing more sensitive scales, investigating in detail only those domains that have been shown to be impaired in the early disease stages or the use of composite scales assessing both cognition and daily functioning as a single primary endpoint (). Currently, there is no gold standard for the assessment of treatment effects in patients with preclinical AD. Prevention trials require at least large samples and long follow-up until a reliable and meaningful outcome is reached. In the EMA guideline, the main treatment goal remains prevention of cognitive decline. However, since a firm regulatory framework is lacking, no firm recommendation could be made in the guideline and therefore scientific advice is recommended (). In addition, for the HTA perspective it will be essential to define what a clinically meaningful benefit might be for a disease-modifying drug that prevents or delays cognitive symptoms.

One of the main differences between regulatory and HTA assessments is that the latter will compare new drugs to the standard of care, whereas in regulatory assessments treatments are often compared with placebo. In general, HTA bodies will assess whether the new drug is more effective than the current standard of care, but a marketing authorisation does not require a drug to demonstrate superiority against comparators. In case of the current AD drugs, the standard of care was “best supportive care,” which meant that the RCTs used for marketing approval were also used for HTA appraisals, although the HTA assessments also compared the AD drugs with each other. The relative effectiveness of the different cholinesterase inhibitors was assessed using head-to-head trials or indirect evidence, i.e., RCTs with placebo arms or systematic reviews and meta-analyses.

Absence or poor quality of head-to-head comparisons might impact reimbursement decisions, because indirect comparisons might introduce uncertainty of the added therapeutic value of new treatments. In the evaluated HTA assessments of NICE and ZiN only a few good quality head-to-head trials were available. However, this did not impact reimbursements decisions, since there was sufficient evidence that demonstrated the clinical effectiveness of the different cholinesterase inhibitors was comparable (NICE and ZiN) and all treatments were considered cost-effective (NICE). However, it is important to note that the last NICE appraisal was concluded several years after the introduction of the drugs to the market, and the first HTA of a new, disease-modifying treatment might have to rely on less comprehensive evidence than that was available for this appraisal.

Another difference between regulatory and HTA assessments is that some HTA bodies, like NICE, reassess technologies over time (). NICE appraised the approved AD drugs in 2001, 2006, and 2011. As more evidence on the effectiveness and safety of the AD drugs had become available, a large number of RCTs, systematic reviews, and head-to-head trials were included in the most recent NICE appraisal. The use of real world evidence was limited, probably due to the availability of a large amount of RCT evidence (). The role of real world data in both regulatory and HTA assessments may increase once new treatments for AD need to be assessed. Currently, there are no gold standards for efficacy parameters for people with preclinical AD and long term studies will be needed to validate surrogate endpoints and model disease progression, preferably in a real world setting. Also, the latest EMA guideline on good pharmacovigilance practices states that in the post-marketing risk benefit analyses both clinical trial and real world data should be included ().

Over the past decade, several initiatives have been launched to better align the assessments of regulatory and HTA bodies. In 2010, the EMA started a pilot on parallel regulatory-HTA scientific advice. As of July 2017, this procedure was replaced by the EMA-EUnetHTA Parallel Consultation, which is a single gateway for scientific advice from EMA and HTA bodies (). In addition, EMA launched PRIME (PRIority MEdicines) in 2016 to promote early access to medicines that offer clear benefit over existing treatments or benefit for patients with no current treatment options (). PRIME helps medicines developers with their development plans, offers continuous support, provides regulatory guidance, and consults other stakeholders including HTA bodies.

Wang et al. studied the impact of all these initiatives in different regions. They found that all stakeholders confirmed that gaps in evidence requirements between both regulators and HTA bodies had narrowed over the past 5 years (). However, several divergences with relevance for AD were identified. Conditional or accelerated regulatory approvals were not well-aligned with flexible HTA approaches, possibly hampering early patient access. Furthermore, areas for improvement included acceptable primary and surrogate endpoints, inclusion of an active comparator arm in the trial, definition of unmet medical need, and post-marketing evidence generation.

Although regulatory approval of drugs is harmonised within the European Union, reimbursement decisions are still the responsibility of the individual member states, and different countries use different methods and processes for making these decisions. This can result in different reimbursement recommendations between countries or sometimes even regions when decision making is decentralised (). In addition to EUnetHTA, other initiatives have also emerged to promote collaboration between countries and regions. The Beneluxa collaboration was launched in 2015 by the Netherlands and Belgium, and since then Luxembourg, Austria, and Ireland have joined. This initiative aims to ensure sustainable access to innovative medicine at affordable costs. Beneluxa encompasses joint horizon scanning, joint writing and mutual recognition of HTA assessments, information sharing, and collaboration on price negotiations (). Other national initiatives, such as the Danish Medicines Council, have also emerged to ensure fast and homogeneous use of expensive treatments across hospitals and geographical regions in Denmark ().

Our study has several limitations. First, we only included the assessments of AD drugs and therefore our findings on regulatory and HTA alignment may not fully apply to other disease areas. Furthermore, since no new AD drugs were approved recently, this study only included assessments of relatively old drugs, whilst regulatory and HTA processes will have evolved in recent years. Lastly, we only included two HTA bodies: NICE and ZiN. A large number of HTA bodies exist in Europe and we did not explore important differences in evidence requirements that might exist between European HTA bodies.

In conclusion, our study shows that in the case of established AD, evidence requirements of regulatory and HTA assessments were not that far apart. There was a large overlap in inclusion of phase III trials and use of outcome domains, although the focus on specific outcomes slightly differed. Further alignment might be possible if regulatory authorities use the totality of evidence, including secondary endpoints, explicitly in their benefit-risk assessments and anticipate on collecting real world data to monitor drugs over their life-cycle. New challenges will arise with disease-modifying AD drugs that are currently in development and no gold standard for efficacy measures have been established for these patient groups. These drugs will target people before showing symptoms or when they only experience mild cognitive impairment. Parallel scientific advice and regulatory-HTA cross-talk can facilitate alignment of regulatory and HTA evidence requirements when informed with data that provide evolving insight in regulatory decisions from the past.

Statements

Author contributions

All authors contributed substantially to the conception and design of the work. MD, AM, and DO collected the data. MD, JB, DO, PJ, and CG were involved in the interpretation of the data. MD drafted the work and the remainder of the authors (JB, DO, RT, AM, PJ, and CG) revised the manuscript critically. All authors read and approved the final version of the manuscript.

Funding

This project has received funding from the Innovative Medicines Initiative 2 Joint Undertaking under grant agreement No 116020 (Real world Outcomes across the Alzheimer's Disease spectrum for better care: Multi-modal data Access Platform, ROADMAP). This Joint Undertaking receives support from the European Union's Horizon 2020 research and innovation programme and European Commission and the European Federation of Pharmaceutical Industries and Associations (http://www.imi.europa.eu/).

Conflict of interest

RT is employed by Biogen, Switzerland. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2019.00073/full#supplementary-material

References

Summary

Keywords

health technology assessments, regulatory assessments, alignment, Alzheimer's disease, regulatory science

Citation

Dekker MJHJ, Bouvy JC, O'Rourke D, Thompson R, Makady A, Jonsson P and Gispen-de Wied CC (2019) Alignment of European Regulatory and Health Technology Assessments: A Review of Licensed Products for Alzheimer's Disease. Front. Med. 6:73. doi: 10.3389/fmed.2019.00073

Received

08 February 2019

Accepted

26 March 2019

Published

07 May 2019

Volume

6 - 2019

Edited by

Steffen Thirstrup, NDA Advisory Services Ltd., United Kingdom

Reviewed by

Mira Pavlovic, NDA Advisory Services Ltd., United Kingdom; Lise Aagaard, Havemann Ltd., Denmark

Updates

Copyright

*Correspondence: Marieke J. H. J. Dekker

This article was submitted to Regulatory Science, a section of the journal Frontiers in Medicine

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics