Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3...

96
An agency of the European Union Marketing Authorisation Application Survey results Survey to Industry, Rapporteurs and EMA Platform meeting with pharmaceutical industry - 3 rd July 2017 Industry speakers: Fiona Reekie EMA speakers: Marie-Helene Pinheiro, Thomas Castelnovo, Gaelle Andriantafika and Mia Van Petegem

Transcript of Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3...

Page 1: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

An agency of the European Union

Marketing Authorisation Application Survey results

Survey to Industry, Rapporteurs and EMA Platform meeting with pharmaceutical industry - 3rd July 2017

Industry speakers: Fiona Reekie

EMA speakers: Marie-Helene Pinheiro, Thomas Castelnovo, Gaelle Andriantafika and Mia Van Petegem

Page 2: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Direct feedback from Applicants/CHMP Rapporteurs/EMA on the process

Enable continuous improvement of MAAs submissions, processes and guidance related to centralised procedures

Understanding the performance of the initial Marketing Authorisation application procedure

Further increase transparency in interactions between EMA and its network and industry stakeholders.

Survey Objectives

Marketing Authorisation Application Survey results 1

Page 3: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

EMA Survey Initial MAA

Period 6 Month period covered September 2016 –February 2017

Methodology Web based survey, coordinated by EMA

Survey Drafting Group CHMP representatives consulted EFPIA Working Group and Industry Stakeholder

Associations consulted

Survey Analysis Group EMA & Industry Stakeholder Associations Working Group

Survey combined the following response formats: Dichotomous scale (Yes/No) 5-point rating scale (1 Strongly disagree; 2 disagree;

3 Neither agree nor disagree, 4 Agree; 5 Strongly agree) For the analysis : 1&2 rating=disagree; 4&5=agree; 3=neither/nor

Multiple choices and multiple responses Free text

Scope Initial Marketing Authorisation Application: Procedural & content questions covering Pre-submission to validation phase PAG PSM AA

Validation Interactions

Primary evaluation phase: Day 1 to 121 Dossier Labelling Adherence SA

clarification meetings Interactions

Opinion finalisation phase: Day 121 to 210 Responses Clarification

meeting

SAG OE Interactions

Scope, methodology, timing (1/3)

Marketing Authorisation Application Survey results 2

Page 4: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Survey methodology (1)

Target Stakeholders surveyed

50% any ongoing MAA (40 to 50 MAA) reaching either Validation, D121 or

Opinion stage

Validation Late in

clock-stop or after LoQ

responses

Opinion Innovative Generic Biosimilar

Big Pharma and SMEs

EMA INDUSTRY RAPPORTEURS

• Industry • EMA

• (Co-)Rapporteurs • Industry • EMA

• (Co-)Rapporteurs • Industry • EMA

Marketing Authorisation Application Survey results 3

Survey methodology (2/3)

Page 5: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

MAA Survey – Sample analysed and completion rate (3/3) Target: capture 50% of any ongoing MAA (~ 50 MAAs) reaching either Validation, D121 or Opinion

EMA survey completed Applicants survey completed 100% 97%

EMA survey completed Applicants survey completed Rapp/Co-Rapp survey completed

100% 87% 76%/79%

EMA survey completed Applicants survey completed Rapp/Co-Rapp survey completed

100% 92% 88%/90%

Marketing Authorisation Application Survey results 4

Results: Excellent completion rate overall for the 3 phases across participants

Validation: 65 MAAs

Day 1-121: 45 MAAs

49 MAAs for Rapp.

Day 121-Opinion: 48 MAAs

Disclaimer: Number of procedures, products, meetings etc. presented by stakeholders may vary due to the

differences of response rates.

Page 6: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Survey methodology (1)

Stakeholders surveyed

EMA INDUSTRY RAPPORTEURS

Marketing Authorisation Application Survey results

Pre-submission meeting -validation phase

This is a joint industry presentation on behalf of the trade associations shown

INDUSTRY

5

Page 7: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Topics covered through 27 questions:

1. Applications details

2. Procedural advice Q&A guidance

3. Pre-submission meeting

4. Accelerated assessment

5. Validation – Impact on procedure

6. Overall feedback on the interaction with EMA during pre-submission phase

63 MAA captured

Industry completion rate: 97%

Marketing Authorisation Application Survey results 6

PSM to Validation survey to Industry: Results

INDUSTRY

Page 8: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

2. Pre-submission guidance

• 97% of applicants consulted the procedural advice Q&A

• 80% easily found the information* • 79% found the information clear* • For 77% information addressed the

needs* * Excludes 2 applicants who did not provide ratings

EMA Q&A guidance is a valuable aid to submission preparation

Marketing Authorisation Application Survey results 7

Page 9: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

3. Pre-submission Meeting (1/3)

Marketing Authorisation Application Survey results 8

70% of applicants had a pre-submission meeting

Vast majority of respondents (90%, 4+5) considered the advice on their questions was clear

68% of applicants had separate pre-submission meeting with (co-) rapporteur

100% with rapporteur

86% with co-rapporteur

23% with PRAC rapporteur

7% had other contact

33% of applicants had further advice from EMA (not SA) * In 1 procedure there was no co-rapporteur

Page 10: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

• EMA pre-submission advice is highly appreciated and considered useful

• Most frequently mentioned additional aspects to be covered are:

• Sharing of recent EMA experience on common validation issues

• Discussion of the eAF submitted by the applicant

3. Pre-submission Meeting (2/3)

Marketing Authorisation Application Survey results 9

Page 11: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Most valuable aspects of pre-submission meetings with members of the assessment team include:

• Possibility to introduce product, development strategy and dossier

• Face to face interaction with assessors appreciated

• Interaction with assessment team allows to:

– Exchange points of focus during dossier review and potential issues

– Address specific questions on clinical package, address potential gaps in submission package and already discuss intent to provide updated information at day 121

– Get better knowledge of (co-)rapporteur expectations

3. Pre-submission Meeting (3/3) - Feedback from (Co-)Rapporteur

Marketing Authorisation Application Survey results 10

Page 12: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

4. Accelerated Assessment

From 14/63 (22%) requesting accelerated assessment:

• The majority found that guidance and reasons for acceptance/rejection were clear

• However, 14% (n=2) did not agree that guidance was clear:

• ‘Clearer guidance on user testing

requirements under accelerated assessment procedure.’

• ’We found the template for the accelerated assessment request difficult to complete.’

Marketing Authorisation Application Survey results 11

Page 13: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

• 37 applicants (59%) submitted the application on the date indicated with the letter of intent.

• 17 of the 26 who did not submit on the predicted date (65%) informed EMA and rapporteurs about the potential delay.

• The gateway is working well in the majority of cases with 83% of responders reporting no difficulties that delayed submission, however, this leaves 17% reporting delays due to the gateway

5. Validation (1/2) - Submission timing and gateway

Marketing Authorisation Application Survey results 12

Page 14: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

The majority of validation comments (89%) were related to amendments needed for documents.

Missing documents were at the basis of 48% of validation comments.

• These deficiencies were not necessarily flagged at the pre-submission meeting.

• In only 5% of the applications, did they delay the procedure start

• Questions regarding validation were dealt with satisfactorily in 96% of 53 cases where question was deemed applicable.

5. Validation (2/2) - Dossier content

Marketing Authorisation Application Survey results 13

Page 15: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

6. Interaction with EMA contacts

The guidance on who to contact at EMA is generally clear (90% agree)

• Most applicants are satisfied with the quality (92%) and timeliness (87%) of the interaction

• In a minority of cases, experience is less satisfactory (2% and 3% give a score of 2 to quality and timeliness respectively)

Marketing Authorisation Application Survey results 14

Page 16: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Industry conclusions pre-submission - validation phase

• Overall, responses indicate that the pre-submission to validation phase does not cause major difficulties

• Pre-submission Q&A’s received good ratings but written comments indicate that improvement is possible in terms of clarity, access to the right information and level of detail.

• The opportunity to meet with EMA, (co-)rapporteur or other members of the assessment team is frequently used and highly valued

• 40% of Marketing Applications were not made on the date given in the Letter of Intent and the EMA was not consistently informed of changes in date

• Although the pre-submission meeting generally is highly graded, it does not pick up all validation issues which included missing documents in almost half of submissions

• The Submission gateway is working well in the majority of cases but 17% encountered issues Marketing Authorisation Application Survey results 15

Page 17: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

• PSMs beneficial • Validation issues – too frequent and creating administrative burden for both

Industry and EMA

Possible solutions

– Attendance by the EMA validation team at the PSM or better communication to validation team; some agreements that are made at the pre-submission are raised during validation

– A more direct focus on validation and more structured discussion of the draft application form is proposed as a fixed item on the pre-submission meeting agenda

– Better awareness of the pre-authorisation Q&A (4.3) which lists the most common validation issues

– Applicants to request clarifications prior submission

Overall recommendations - PSM to validation

Marketing Authorisation Application Survey results 16

Page 18: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Survey methodology (1)

Stakeholders surveyed

EMA INDUSTRY RAPPORTEURS

Marketing Authorisation Application Survey results

EMA

Pre-submission meeting -validation phase

EMA

17

Page 19: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Pre-submission to validation survey to EMA - Results

Topics covered through 24 questions:

1. Applications details

2. Validation – Impact on procedure

3. Pre-Authorisation guidance

4. Pre-submission meeting

5. Accelerated assessment

6. Overall feedback on the interaction with applicants during pre-submission phase

65 MAA captured

EMA completion rate: 100%

Marketing Authorisation Application Survey results 18

EMA

Page 20: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Marketing Authorisation Application Survey results

New Active substance: NAS, Known Active substance: KAS, Well-Established Used: WEU, Fixed Dose Combination: FDC, Informed Consent: IC,

19

33

3

9

2 3 3 4 8

51%

5% 14% 3% 5% 5% 6% 12%

MAA legal basis covered (N=65) Orphan

29% (19)

Non Orphan

71% (46)

(Non-) Orphan Medicinal Products rate

SME 26% (17)

Non SME

74% (48)

(Non-)SME rate

1. Applications details (1/2)

Page 21: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Orphan products & SME applicants: in line with EMA records of previous years

Sample surveyed captured significant numbers of orphan and SME

Majority of NAS legal bases (51%), followed by Generics (14%) and Biosimilars (12%) in line with current trends

Overall, sample captured can be considered representative

Marketing Authorisation Application Survey results 20

2015 (full year) 2016 (full year) Survey (6 months)

Orphan 23 19 19

SME 14 31 17

1. Applications details (2/2)

Page 22: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Marketing Authorisation Application Survey results

A short majority agreed that the dossier was complete & presented in a satisfactory way; non negligible proportion of “neither agree or disagree” rating

2. Validation: impact on the procedure (1/3)

21

AGREE 38%

AGREE 51%

37%

37%

25% 12%

0%10%20%30%40%50%60%70%80%90%

100%

Dossier complete /justifications present

(N=65)

Dossier satisfactory /justification easy to find

(N=65)

Disagree

Neither agree nordisagree

Agree

Page 23: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

22

Validation comment in almost all cases (97%) – Only 2 applications with no question. Vast majority of applicants respond accordingly to the agreed timelines (94%)

In half of the applications (44%) the responses were incomplete and required a follow up

Issues most commonly seen are purely administrative & non blocking issues Quality + GMP aspects (92%): most frequent issues relate to inconsistencies of the Application Form

(90%) with qualitative and quantitative composition of the medicinal product (62%)

(Non) clinical/GLP/GCP issues (83%): more than half of the issues relates to GLP/GCP information, as much as observed for issues related to Module 5

Product Information (30%):95% relate to inconsistencies with the application form (ATC, strength, pharmaceutical form, route of administration, container, pack size, product name)

Validations issues almost systematically on the application form Most queries related to quality & GMP matter (81%)

Applicant’s contact person & details & (75%)

Nonclinical/clinical and GCP/GLP aspects (65%)

2. Validation: impact on the procedure (2/3)

Marketing Authorisation Application Survey results

Page 24: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Marketing Authorisation Application Survey results 23

EMA should investigate opportunities to increase awareness on:

the validation process

the most common issues encountered at validation (published on EMA website)

the procedural pre-submission guidance

Applicant should also increase awareness on the EMA requirements; particular focus could be on reducing discrepancies in the application form and the dossier submitted

Applicants are encouraged to request clarifications prior submission

2. Validation: impact on the procedure (3/3)

Page 25: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Marketing Authorisation Application Survey results

Short majority (57%) agreed that applicants

were aware of the procedural guidance (Q&A on

EMA website)

Non negligible proportion of “neither agree nor

disagree” rating

Analysis per legal basis and SME vs non SME did

not show a clear pattern

Combined with the almost 100% validation

questions rate, these results indicate the need for EMA to increase general awareness and ease access to the procedural presubmission guidance

24

AGREE 57%

32%

11%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Applicant aware of the procedural guidanceQ&A on the EMA website to prepare MAA

submission (N=65)

Disagree

Neither agree nordisagree

Agree

3. Pre-authorisation Guidance

Page 26: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Pre-submission dialogue in almost 85% applications surveyed

Pre-submission meeting in almost 75% (48/65) of the submitted dossier

Almost 10% of interactions through written/verbal advices (when no meeting took place)

Approximately 15% of applications with no interaction prior submission with EMA (mainly Generics and informed consent)

A follow-up advice necessary in more than 50% of the PSM

Most of SME (14/17) and orphan applications (17/19) had a PSM

PSM with EMA was requested for all biosimilar applications

Marketing Authorisation Application Survey results 25

4. Pre-submission Meeting (1/4)

Page 27: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

More than 92% of the PSM topics with EMA relates to (Non)Clinical + Clinical, GLP/GCP information followed by the PI aspects: - (Non)Clinical+GLP/GCP:92%

- Product Information: 77%

- Regulatory/Procedural:75%

- Quality+GMP: 67%

- Administrative: 65%

- Pharmacovigilance: 52%

- Transparency:23%

- Other: 19%

(Non) Clinical + Clinical, GLP/GCP topics (N=44)

Product Information topics (N=37)

Various topics are discussed but mainly related to the development programme and the SmPC for the PI

4. Pre-submission Meeting – Topics (2/4)

Marketing Authorisation Application Survey results 26

Page 28: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

SAMPLE COMMENTS

Most valuable aspects gathered: Advice provided on regulatory requirements e.g. legal basis and its requirements, orphan similarity/maintenance, accelerated assessment, GMP, RMP. Face to face meeting with the applicant Clarification on the procedure Presentation of the product and the development programme

Short majority agreed that the meeting helped identified validation issue & assessment issue; non negligible proportion of “neither agree or disagree” & “Disagree” rating

AGREE 56%

AGREE 52%

31% 33%

13% 15%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Meeting helped identifyvalidation issue (N=48)

Meeting helped identifyassessment issues (N=48)

Disagree

Neither agree nordisagree

Agree

4. Pre-submission Meeting – Usefulness (3/4)

Marketing Authorisation Application Survey results 27

Page 29: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Marketing Authorisation Application Survey results 28

Overall, there is a very high level of interaction with EMA prior to submission, mostly via pre-submission meetings

Meetings helped identified validation issues as no blocking validation questions raised; however ~100% non-blocking validation issues

Investigate opportunities to make better use of pre-submission meeting to further anticipate and identify the non-blocking validation issues (right forum?)

Over 65 applications, 22% [14] requested an accelerated assessment

All justifications for requesting AA were in line with available template, 13 were discussed at PSM meeting and were timely received

Very good level of awareness from applicants on the AA process & early dialogue occurred

4. Pre-submission Meeting (4/4)

5. Accelerated Assessment

Page 30: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Overall EMA feedback positive

Overall interaction during pre-submission activities could be improved

EMA satisfied with the quality of the information & timeliness of interactions during the pre-submission phase

AGREE 65%

AGREE 62%

29% 29%

6% 9%

0%10%20%30%40%50%60%70%80%90%

100%

Satisfied with the quality ofthe information (N=65)

Satisfied with the timelinessof the interaction (N=65)

Disagree

Neither agree nordisagreeAgree

6. Satisfaction on interaction with applicants

Marketing Authorisation Application Survey results 29

Page 31: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Survey methodology (1)

Marketing Authorisation Application Survey results

This is a joint industry presentation on behalf of the trade associations shown

Primary evaluation phase: DAY 1-121

INDUSTRY Survey methodology (1)

Stakeholders surveyed

EMA INDUSTRY RAPPORTEURS

30

Page 32: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Day 1 to 121 survey to Industry - Results

Topics covered through 13 questions:

1. Applications details

2. Assessment reports in primary phase

3. Labelling review in primary phase

4. Clarification meeting

5. Overall feedback on the interaction with EMA during the primary assessment phase

39 MAA captured

Industry completion rate: 87%

Marketing Authorisation Application Survey results 31

INDUSTRY

Page 33: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Majority of Assessment Reports received within 2 days of the due date

54% of Day 80 Rapp Assessment Reports

67% of Day 80 CoRapp Assessment Reports

79% of Day 94 PRAC Rapp Assessment Reports

30% of respondents were proactively informed of a delay

2. Assessment phase: AR circulation timeliness

Marketing Authorisation Application Survey results 32

Page 34: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Clarity of assessment reports was reported as a positive in the majority of cases

2. Assessment phase: AR Clarity

Marketing Authorisation Application Survey results 33

Page 35: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

The majority of respondents received a single file encompassing comments from both the CHMP and EMA

2. Assessment phase: product information circulation

Marketing Authorisation Application Survey results 34

Page 36: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

The clarity of comments on Product Information was considered positive by the majority of respondents

3. Assessment phase: product information clarity

Marketing Authorisation Application Survey results 35

Page 37: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Clarification meetings more common for NCE MAAs

4. Clarification meetings (1/2)

Marketing Authorisation Application Survey results 36

Page 38: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Clarification meetings are well regarded

4. Clarification meetings (2/2)

Marketing Authorisation Application Survey results 37

Page 39: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Contact with the EMA was

generally positive

4. Interaction during primary phase

Marketing Authorisation Application Survey results 38

Page 40: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Conclusion

• Overall, responses indicate that Day 0 to Day 120 of the Centralised Procedure is well run

• Although assessment reports are usually provided in accordance with the timetable, delays are not uncommon and are not always proactively communicated to the Applicant

• The Assessment reports, questions and major objections are of high quality (clarity, consistency etc) as are the comments on the Prescribing information and mock ups

• The clarification meetings are particularly valued for their usefulness, especially for discussing the Applicant’s response strategy

• Interactions with EMA are very positive

Marketing Authorisation Application Survey results 39

Page 41: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Investigation into the delay of the (Co-)Rapp Assessment Reports may be warranted

• Is sufficient time included for EMA legal review or is this a resource issue for the Rapporteurs?

• Should this be reflected in the published procedure timetables?

• Consistency of communication from EMA to Applicant regarding delays would be appreciated

EMA Contact Points

• Although 82% of responders thought the guidance clear on who to contact at the EMA, the comments referred to some uncertainty regarding contacting EPL/EPM

40

Overall recommendations

Marketing Authorisation Application Survey results 40

Page 42: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Marketing Authorisation Application Survey results

EMA EMA

Primary evaluation phase:

DAY 1-121

Survey methodology (1)

Stakeholders surveyed

EMA INDUSTRY RAPPORTEURS

41

Page 43: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Day 1 to 121 survey to EMA - Results

Topics covered through 13 questions:

1. Applications details

2. Labelling review in the primary assessment phase

3. Clarification meeting

4. Overall feedback on the interaction with applicants during the primary assessment phase

45 MAA captured

EMA completion rate: 100%

Marketing Authorisation Application Survey results 42

EMA

Page 44: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Marketing Authorisation Application Survey results

Orphan 24% (11)

Non Orphan

76% (34)

Proportion of Orphan Medicinal Products

SME 27% (12)

Non SME 73% (33)

Proportion of SME

30

3 7

1 0 0 0 4

67%

7% 16% 2% 0% 0% 0% 9%

8(3) NAS 8(3) KAS 10(1)Generic

10a WEU 10b FDC 10c IC 10(3)Hybrid

10(4)Biosimilar

MAA legal basis covered (N=45)

New Active substance: NAS, Known Active substance: KAS, Well-Established Used: WEU, Fixed Dose Combination: FDC, Informed Consent: IC,

43

1. Application details

Page 45: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Marketing Authorisation Application Survey results

EMA mainly neither agrees nor disagrees (rated 3)

• Most relevant comments: “almost empty SmPC”; principle of SmPC guideline not always correctly implemented; poor compliance with the QRD template & SmPC guideline”

Adherence to guidance & template could be improved

EMA should investigate opportunities to increase awareness on existing guidances

44

AGREE 38%

49%

13%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

PI presented in a satisfactory way &followed the relevant guidances [QRD,

SmPC] (N=45)

Disagree

Neither agree nordisagree

Agree

2. Labelling review

Page 46: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

SAMPLE COMMENTS

“Written clarification substituted meeting in 2 occasions;

Very positive feedback on the usefulness of the meeting;

Meeting clearly needed & much facilitated the understanding of major issues.”

Meeting in 62% [28] of applications (<2/3 applications)

• Applicants clearly specified scope & topics to be discussed – 93%

• Briefing document a week before the meeting – 79%

Most of the meeting happened for NAS (85%); and/or orphan product (82%) and/or SME applicants (83%)

EMA considered that the meeting facilitated the progress of the procedure in almost ¾ of the meetings

Majority of applicants displayed very good adherence to the

guidance with the requirements (clarity of scope & topics and briefing documents provided timely)

(across 45 applications) 3. Clarification meetings

Marketing Authorisation Application Survey results 45

Page 47: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

SAMPLE COMMENTS

“Applicant communicated well, in a timely and pro-active manner; No problems identified with the interaction with the applicant at all.”

Overall EMA feedback positive

EMA satisfied with the quality of the information (69%) & timeliness of interactions (73%) during the 1st phase of assessment

AGREE 69%

AGREE 73%

16% 22%

15% 5%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Satisfied with the quality ofthe information (N=45)

Satisfied with the timelinessof the interaction (N=45)

Disagree

Neither agree nordisagree

Agree

4. Satisfaction on interaction with applicants

Marketing Authorisation Application Survey results 46

Page 48: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Survey methodology (1) Stakeholders surveyed

EMA INDUSTRY RAPPORTEURS

Marketing Authorisation Application Survey results

(Co-)RAPPORTEURS

Primary evaluation phase: DAY 1-121

47

Page 49: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Day 1 to 121 survey to Rapporteurs- Results

Topics covered through 11 questions:

1. Applications details

2. Satisfaction with relevant parts of the dossier (Quality, Non-clinical, Clinical, Product Information, RMP)

3. Adherence to scientific advice

4. Labelling review in primary phase

5. Clarification meeting

6. Overall feedback on the interaction with applicants during the primary assessment phase

49 MAA captured

Completion rate: 76/79% (Rapporteur/Co-Rapporteur)

Marketing Authorisation Application Survey results 48

RAPPORTEURS

Page 50: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

2 & 4. Dossier content satisfaction level Positive ratings varied from 32% to 65% of responses (lowest: Clinical Overview and PI well substantiated in

overview) Large proportion “undecided/3” ratings

20 17 23 19 18 13

21 20 19 15 16

8

11 8 5 8

10 12

8 8

9 11 12 15

3 4 7 2

8 5 4 1

7 4 7 2

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Rapp Co-Rapp Rapp Co-Rapp Rapp Co-Rapp Rapp Co-Rapp Rapp Co-Rapp Rapp Co-Rapp

Quality Overallsummary

Non clinicaloverview

Clinical Overview Non-clinicalSummaries

Clinical Summaries PI wellsubstantiated in

overview

Disagree

Neitheragree/disagreeAgree

Marketing Authorisation Application Survey results 49

Page 51: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

17 17 19 13 17 14

7 7 9 10 9 8

7 7 9 8 11 9

0%10%20%30%40%50%60%70%80%90%

100%

Rapp Co-Rapp Rapp Co-Rapp Rapp Co-Rapp

Easy locatinginformation

Dossier mature High quality overallcontent

Disagree

Neither agree/disagree

Agree

Average level of satisfaction of initial MAAs content [45-55%]

Considerations: in 20-25% responses rapporteurs considered dossier not mature enough and information not easy to find. In 30% responses rapporteurs were not satisfied with the quality of the overall content.

2. Dossier overall content quality

Marketing Authorisation Application Survey results 50

Page 52: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

3. Adherence & scope of scientific advice

18.85%

14.75%

15.57% 27.05%

19.67%

4.10%

QualityNon clinicalClinical PK/PDClinical EfficacyClinical Safety/RMPOther

6

4

7

4 4 6 10

8

9

9

2

5

1

3 2

5

3 6

2

5

2 2 1 1 1

0

4 3

0 0

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Rapp Co-Rapp Rapp Co-Rapp Rapp Co-Rapp Rapp Co-Rapp Rapp Co-Rapp

Quality Non clinical Clinical PK/PD Clinical efficacy Clinical safety/ RMP

Agree Neither agree/disagree DisagreeMarketing Authorisation Application Survey results 51

Page 53: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Adherence to Scientific Advice in the majority of the cases

Examples of non-adherence :

• Quality : Process validation package; definition of starting materials; amount of stability data

• Clinical : disease model; choice of comparator; choice of endpoint

If deviating justification to be presented in Overview

3. Adherence to scientific advice: scope details

Marketing Authorisation Application Survey results 52

Page 54: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Overall feedback Day 1-121

Overall ± 60% satisfaction with information on response date change and response to ad-hoc clarification requests

6. Interaction with applicants

Marketing Authorisation Application Survey results 53

Page 55: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Conclusions and recommendations Responses indicate moderate level of satisfaction with the content of the initial dossier (40-50% positive ratings on

overall content, 30% negative) Improvements could be made in the presentation of the application, e.g. clinical overview including

substantiating the information proposed for the PI.

Applicants are encouraged to ensure all relevant data can be easily located and include clear references to the location of relevant data/information in CTD (hyperlinks).

The need for mature dossiers was highlighted.

Most applications considered adherent to Scientific Advice

In the event of deviation(s), a clear and sound justification is recommended in the MAA; this is likely to facilitate the proceeding of the assessment

Feedback on interaction with applicants generally positive

Applicants should provide accurate estimates of the planned submission dates – be as realistic as possible. This is important for the work schedules of the assessment teams.

In case of changes to submission deadlines, EMA and Rapporteur teams should be informed asap.

Marketing Authorisation Application Survey results 54

Page 56: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Survey methodology (1) Stakeholders surveyed

EMA INDUSTRY RAPPORTEURS

Marketing Authorisation Application Survey results

This is a joint industry presentation on behalf of the trade associations shown

Opinion finalisation phase:

Day 121-210

INDUSTRY

55

Page 57: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Topics covered through 25 questions:

1. Applications details

2. Assessment reports in final assessment phase

3. Clarification meeting

4. SAGs/Ad-hoc experts groups

5. Oral explanation at committee plenaries

6. Finalisation of commitments and opinion documents

7. Overall feedback on interactions with applicants during the final assessment phase

44/48 MAA captured

Industry completion rate: 92%

Marketing Authorisation Application Survey results 56

Day 121 to CHMP Opinion survey to Industry: Results

INDUSTRY

Page 58: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Majority of Assessment Reports

received within 2 days of the due date

51% of Day 150 Rapp Assessment Reports (n=37)

68% of Day 194 Rapp Assessment Reports (n=31)

30% of respondents were proactively informed of a delay

2. Assessment phase: AR circulation timeliness

Marketing Authorisation Application Survey results 57

Page 59: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Comments and questions were

clear and substantiated in

assessment reports

2. Assessment phase: LoQ clarity

Marketing Authorisation Application Survey results 58

Page 60: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

In most cases, a single consolidated assessment report

was received at D180

2. Assessment phase: 180 AR circulation timeliness

Marketing Authorisation Application Survey results 59

Page 61: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Clarification meetings were

held for: 9 ‘Other’ licences

5 NCEs 2 Biosimilars

3. Clarification meetings (1/3)

Marketing Authorisation Application Survey results 60

Page 62: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Clarification meetings are

particularly useful for discussing

response strategy

3. Clarification meetings usefulness (2/3)

Marketing Authorisation Application Survey results 61

Page 63: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Clarification meetings are well

regarded

3. Clarification meetings usefulness (3/3)

Marketing Authorisation Application Survey results 62

Page 64: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Only 2 SAGs and 3 Oral explanations were held - too few for any conclusions

4 & 5. SAGs and oral explanation

Marketing Authorisation Application Survey results 63

Page 65: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Changes in type of MA can occur

during assessment

6. Opinion category switch

Marketing Authorisation Application Survey results 64

Page 66: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

65

More conditions on the licences are imposed during assessment

than are foreseen by the Applicant

6. Opinion category

Marketing Authorisation Application Survey results 65

Page 67: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

66

There are high levels of satisfaction with

EMA interaction during finalisation stages to

CHMP Opinion

6. Interaction level of satisfaction

Marketing Authorisation Application Survey results 66

Page 68: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

CHMP Opinion was not received within 2 working

days in a number of cases

6. Opinion receipt timeliness

Marketing Authorisation Application Survey results 67

Page 69: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Contact with the EMA was generally

positive

7. Interaction with EMA

Marketing Authorisation Application Survey results 68

Page 70: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Conclusion (1/2)

• Overall, responses indicate that Day 121 to Day 210 of the Centralised Procedure is well run.

• Delays in assessment reports are similar to those seen earlier in the procedure and again, are not always proactively communicated to the Applicant

• The Assessment reports, questions and major objections are of high quality (clarity, consistency etc)

• As for D0 – D120, the clarification meetings are particularly valued for their usefulness, especially for discussing the Applicant’s response strategy, too few SAGs and Oral Explanations were held to draw any conclusions

Marketing Authorisation Application Survey results 69

Page 71: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Conclusion (2/2)

• Standard licences were granted in the majority of cases, however, a few applications for standard licences were granted Conditional approval/approval under Exceptional Circumstances

• More conditions (ANX, Specific Obligations, RMP studies) were imposed during assessment than had been proposed in initial applications

• Interactions with EMA and their facilitation of documents for opinion are very positive

• However, the actual opinion was quite often received at least 4 days post CHMP meeting leading to concerns regarding the timelines for providing translated annexes and there was a lack of awareness regarding timing/content of the EMA CHMP meeting Press Release

Marketing Authorisation Application Survey results 70

Page 72: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Again, investigation into delay of Assessment Reports may be warranted

• Is sufficient time included for EMA legal review or is this a resource issue for the Rapps?

• Should this be reflected in the published procedure timetables?

• Consistency of communication from EMA to Applicant regarding delays would be appreciated

There was a lack of awareness of the possibility of further rounds of D180 questions

• Perhaps a Q and A in Pre-authorisation guidance, including the timetables for assessment, would be helpful

The timing of receipt of CHMP Opinion was not consistent and there was a lack of awareness of the timing/content of the Press release from the CHMP meeting

• Perhaps a Q and A in Pre-authorisation guidance would be helpful

Overall recommendations

Marketing Authorisation Application Survey results 71

Page 73: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Survey methodology (1) Stakeholders surveyed

EMA INDUSTRY RAPPORTEURS

Marketing Authorisation Application Survey results

EMA EMA

OPINION FINALISATION PHASE: DAY 121-210

72

Page 74: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Day 121 to 210 survey to EMA - Results

Topics covered through 25 questions:

1. Applications details

2. Clarification meeting

3. SAGs/Ad-hoc experts groups

4. Oral explanation at committee plenaries

5. Finalisation of commitments and opinion documents

6. Overall feedback on interactions with applicants during the final assessment phase

48 MAA captured

EMA completion rate: 100%

Marketing Authorisation Application Survey results 73

EMA

Page 75: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Marketing Authorisation Application Survey results

New Active substance: NAS, Known Active substance: KAS, Well-Established Used: WEU, Fixed Dose Combination: FDC, Informed Consent: IC,

74

14

3

15

1 2 4 3

6 29%

6%

31%

2% 4% 8% 6% 13%

MAA legal basis covered (N=48) Orphan 17% (8)

Non Orphan

83% (40)

Proportion of Orphan Medicinal Products

SME 10% (5)

Non SME 90% (43)

Proportion of SME vs. non SME

1. Application details (1/2)

Page 76: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Orphan products & SME applicants: in line with EMA records of previous years

High proportion of generic and informed consent (IC) applications: almost 40% of the opinions

May explain certain results of this survey phase: low number of clarification meetings, SAGs/Ad-hoc expert groups and oral explanations.

Marketing Authorisation Application Survey results 75

2015 (full year) 2016 (full year) Survey (6 months)

Orphan 18 (8 in 1st 6 months) 16 (8 in 1st 6 months) 8

SME 9 5 5

1. Application details (2/2)

Page 77: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

SAMPLE COMMENTS

“Meeting was crucial; Meeting particularly useful as allowed applicant to define their strategy and led to the cancellation of the Oral Explanation; Meeting needed to clarify complex issues and explore options for a conditional approval.”

Meeting in 42% [20] of applications (<50% applications)

• Applicants clearly specified scope & topics to be discussed – 100%

• Briefing document a week before the meeting – 80%

Approximately 50% of the meeting happened for NAS; almost all orphan had a clarification meeting; 2 SME had a meeting

EMA considered that the meeting facilitated the progress of the procedure in almost all meetings – 85%

Majority of applicants displayed excellent adherence to the

guidance very good level of awareness

High proportion of generics and informed consent may explain the low number of meetings

(across 48 applications)

2. Clarification meetings

Marketing Authorisation Application Survey results 76

Page 78: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Only 2 meetings captured in the survey

Briefing documents & applicant presentations considered informative and clear for one meeting, no opinion for the 2nd meeting

In both cases: debriefing meeting occurred as per EMA process & EMA strongly agreed that the discussion contributed to reaching the final outcome

Results showed that Applicants, Rapporteurs and EMA showed excellent process compliance

No conclusion can be drawn from the only 2 cases

Marketing Authorisation Application Survey results 77

3. SAGs or Ad Hoc expert group meetings

Page 79: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Only 3 OEs captured in the survey; OE scopes: Quality / Efficacy / Bioequivalence

Objections subject to the OE raised from D180 in 2 cases, from D120 for the quality objection.

Applicants submitted presentations in a timely fashion in all cases. A debriefing meeting after the OE occurred systematically as per EMA process; with systematic attendance from the Rapporteurs, EPL and PM. Other specialists (Regulatory, Quality, RMS) attended on an ad-hoc basis.

Results showed that Applicants, Rapporteurs and EMA showed excellent process

compliance

No conclusion can be drawn from the only 3 cases

Marketing Authorisation Application Survey results 78

4. Oral explanation

Page 80: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

SAMPLE COMMENTS

“Exchange of information and documents with applicant and rapporteurs as well as finalisation was very smooth and efficient; Company was quick to implement requested changes in RMP and PI, prior to opinion; The revised RMP came late which resulted in a delay in sending out final documents.”

Significant majority of applicants provided the requested PI (79%)

and RMP (75%) revisions for opinions finalisation in a timely manner

AGREE 79%

AGREE 75%

15% 19%

6% 6%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Revised PI timely provided(N=48)

Revised RMP timely provided(N=48)

Disagree

Neither agree nordisagree

Agree

5. Finalisation of commitments and opinion documents (1/2)

Marketing Authorisation Application Survey results 79

Page 81: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Timing for Annex II conditions

Marketing Authorisation Application Survey results 80

15% (7)

6% (3)

15% (7)

64% (31)

D120

D180

AfterD180

Nocondition

Annex II condition in 35% (n=17) of the opinion

Almost 60% conditions were raised from D180 only i.e. last stages of the evaluation

EMA could investigate with Committees

opportunities to prompt earlier potential need for conditions to the marketing authorisation

5. Finalisation of commitments and opinion documents (2/2)

Page 82: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

SAMPLE COMMENTS

“Applicant was professional & pro-active; Company was fully aware of EMA processes & procedures, timelines and interactions with committees; Interaction with company was very good and with quick responses, information submitted was clear and well organised.”

Overall EMA feedback very positive (multiple positive comments)

EMA highly satisfied with the quality of the information (86%) & timeliness of interactions with applicants (84%) during the last phase of assessment

AGREE 86%

AGREE 84%

12% 10% 2% 6%

0%10%20%30%40%50%60%70%80%90%

100%

Satisfied with the quality ofthe information (N=48)

Satisfied with the timelinessof the interaction (N=48)

Disagree

Neither agree nordisagree

Agree

6. Satisfaction on interaction with applicants

Marketing Authorisation Application Survey results 81

Page 83: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Survey methodology (1) Stakeholders surveyed

EMA INDUSTRY RAPPORTEURS

Marketing Authorisation Application Survey results

(Co-)RAPPORTEURS

Opinion finalisation phase: Day 121-210

82

Page 84: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Day 121 to Opinion survey to Rapporteurs- Results

Topics covered through 11 questions:

1. Applications details

2. Satisfaction with responses (Quality, Non-clinical, Clinical, Product Information, RMP)

3. Clarification meeting

4. Scientific Advisory Group/Ad-hoc Expert Group

5. Oral explanation

6. Overall feedback on the interaction with applicants during the final assessment phase

48 MAA captured

Completion rate: 88/90% (Rapporteur/Co-Rapporteur)

Marketing Authorisation Application Survey results 83

RAPPORTEURS

Page 85: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Positive ratings in 60-80% suggest high level of satisfaction with the responses to LOQ/LoOIs. PI & RMP responses scored slightly lower compared to other areas.

22 19

18 13 24 21

20 17 17 12

11 4

3 4 5

3

9

8 9

6

2 2 0 0 2 1

6 1 2 0

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Rapp Co-Rapp Rapp Co-Rapp Rapp Co-Rapp Rapp Co-Rapp Rapp Co-Rapp

Quality Questions Non-clinicalQuestions

Clinical Questions Product Information RMP

Disagree

Neitheragree/disagreeAgree

2. Applicant’s responses to LoQ/LoOI - satisfaction level

Marketing Authorisation Application Survey results 84

Page 86: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Overall, 28/70 responses confirmed that a clarification meeting was held during the second phase of the assessment.

60% agree meeting is helpful. Only ± 40% considered response strategy was well substantiated in the briefing documents

10 11 8 9

5 6

9 8

1 4

3 5

6 7

3

3

2 0

2 1

2 2 1 4

0%10%20%30%40%50%60%70%80%90%100%

Co-RappRappCo-RappRappCo-RappRappCo-RappRapp

d) Rapp feedback reflectedin responses

c) Helpfulness of Meetingb) Response Strategy wassubstantiated

a) Briefing Document wasclear

Disagree

Neitheragree/disagree

Agree

3. Clarification Meetings

Marketing Authorisation Application Survey results 85

Page 87: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Only 2 SAGs and 3 Oral Explanations covered by the survey.

Generally positive ratings for SAGs:

Informative briefing documents and presentation by applicant.

Expert discussion helpful to reach final outcome.

Mixed feedback on helpfulness of Oral Explanations.

Overall, numbers too low to draw firm conclusion.

4 & 5. SAGs and oral explanation

Marketing Authorisation Application Survey results 86

Page 88: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

19 18

23 21

2 5

1 3

2 2 1 1

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Co-RappRappCo-RappRapp

b) Adequate responses by applicant toRapp requests for clarification

a) Good info on change in D181response submission date

Disagree

Neither agree/disagree

Agree

Very positive, higher satisfaction level compared to primary assessment phase

6. Overall feedback on interaction with applicant

Marketing Authorisation Application Survey results 87

Page 89: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Conclusions and recommendations

Better level of satisfaction with responses to LOQ & LoOIs (approx.

70% positive ratings)

PI & RMP responses scored slightly lower compared to other areas, but still good ratings carefully consider all CHMP comments on the PI/RMP - when deviating from CHMP requests, clearly explain reasons why.

Same recommendations as at D1-121 regarding need for information to be easy to locate and maturity of the dossier/responses.

Late submission of large datasets are problematic and should be avoided.

Marketing Authorisation Application Survey results 88

Page 90: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Clarification meetings generally considered helpful. However, some negative ratings.

The need for a clarification TC/meeting should be carefully considered.

The main purpose of the meeting is to make sure that the issues with the application are well understood and to facilitate the preparation of responses.

No pre-assessment/endorsement of responses.

If Applicants wish to have a clarification TC/meeting, a clear outline of the response strategy should be presented to make the most of the meeting.

Feedback on interaction with applicant at Opinion stage very positive. Same recommendations as for Day 1-121.

Marketing Authorisation Application Survey results 89

Conclusions and recommendations

Page 91: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Survey methodology (1) Stakeholders surveyed

EMA INDUSTRY RAPPORTEURS

Marketing Authorisation Application Survey results

General conclusions

90

Page 92: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

General conclusions

91

Overall very good level of satisfaction across the 3 phases (increase from validation to opinion)

High level of interaction during pre-submission phase (PSM)

Good quality of information and timeliness of the interaction (especially at opinion phase)

Very good level of awareness of applicants on guidance for clarifications meeting and accelerated assessment

Clarification meeting generally considered helpful

Most applications considered adherent to scientific advices

EMA & (Co-)Rapporteurs’ positive feedback across the 3 phases of the procedure

Marketing Authorisation Application Survey results

Page 93: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

92

EMA

Increase awareness on validation process (most common issues encountered)

Will help identification of non blocking validation issue prior submission

Increase awareness on SmPC guidance & QRD template and pre-authorisation guidance.

Assessment Reports/ final opinion - Circulation timelines and communication of delays

Optimise timing for Annex II condition request

Clarify role EPL vs PM

Areas identified for optimisation

Marketing Authorisation Application Survey results

General conclusions

Page 94: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

93

Industry

Accuracy of MAA submission date – communications of delays to EMA & Rapporteurs

Validation: increase awareness on guidance & consistency between application form, PI and dossier

Improve the presentation of the application (data easily located, hyperlinks etc.)

Adherence to PI guidelines (SmPC & QRD) & better substantiate the proposed PI in the clinical overview and address CHMP comments

Need for mature dossier & responses – late submission of large datasets should be avoided

Areas identified for optimisation

Marketing Authorisation Application Survey results

General conclusions

Page 95: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Acknowledgement

Susan Bhatti (Merck KGaA, EFPIA)

Sally Bruce (GSK, EFPIA)

Nadege Leroux (Celgene, EFPIA)

Katarina Jelic Maiboe (Novonordisk, EuropaBio)

Vesna Schauer-Vukasinovic (Sandoz, Medicines for Europe)

Kevin Sinnett (Amgen, EFPIA)

Marketing Authorisation Application Survey results 94

Evdokia Korakianiti

Gaelle Andriantafika

Jordi Linares Garcia

Marie-Helene Pinheiro

Mia Van Petegem

Michael Berntgen

Pavel Balabanov

Stefanie Prilla

Agnes Gyurasics

Andrea Laslop

Concepcion Prieto Yerro

Daniela Melchiorri

Greg Markey

Karsten Bruins

Pierre Demolis

Tomas Salmonson

Survey responders

Industry Team CHMP sponsors EMA Team Survey developers:

Aline Caromelle, Simona Simoiu

Thomas Castelnovo

Victoria Palmi Reig

Vilma Pakenyte

Zigmar Zebris

Aliki Sydoninou

Page 96: Marketing Authorisation Application Survey results · September 2016 –February 2017 ... 3 Marketing Authorisation Application Survey results Survey methodology (2/3) MAA Survey

Thank you for your attention

European Medicines Agency 30 Churchill Place • Canary Wharf • London E14 5EU • United Kingdom Telephone +44 (0)20 3660 6000 Facsimile +44 (0)20 3660 5555 Send a question via our website www.ema.europa.eu/contact

Further information

Follow us on @EMA_News