Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire...

17
An agency of the European Union Parallel Consultations Parallel Consultations Feedback Questionnaire Preliminary results and initial reflections. Presented by Jane Moseley on 23 November 2018 Senior Scientific Officer – Scientific Advice Office

Transcript of Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire...

Page 1: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

An agency of the European Union

Parallel Consultations Parallel Consultations Feedback Questionnaire Preliminary results and initial reflections.

Presented by Jane Moseley on 23 November 2018 Senior Scientific Officer – Scientific Advice Office

Page 2: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Parallel Consultations Feedback Questionnaire

Parallel Consultations Feedback Questionnaire Results

Parallel Consultation pathway requested and allocated

The results shared in this presentation were based in 15 contributions to the Parallel Consultations Feedback Questionnaire received by EMA and are related to Parallel Consultations that took place between August 2017 and August 2018. The response rate to the first batch of questionnaires was 68% (15 out of 22).

Table 1. Parallel Consultation pathway requested and allocated (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures.

1

PC pathway Requested Allocated

Consolidated (PCC) 15 6

Individual (PCI) 0 9

Page 3: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Please classify the quality of communications during the entire

procedure, in terms of timely and useful answers to queries

Parallel Consultations Feedback Questionnaire Results

Communications with EMA

Communications with EUnetHTA ED Secretariat

Figure 1. Communications with EMA (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures.

Figure 2. Communications with EUnetHTA ED Secretariat (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures.

2

93%

7%

Satisfactory

Not satisfactory

87%

13%

Satisfactory

Not satisfactory

Page 4: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Regarding your experience related to the F2F meeting, please

rate your satisfaction with the aspects below

Parallel Consultations Feedback Questionnaire Results

Figure 3-5. Satisfaction with the experience related to the F2F meeting (information exchanged, chairing and duration of the meeting) (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures.

3

12

3

0 02468

101214

Satisfied Partly satisfied Not at all satisfied

Information Exchanged

11

3 1

02468

101214

Satisfied Partly satisfied Not at all satisfied

Chairing of the meeting

13

2

0 02468

101214

Satisfied Partly satisfied Not at all satisfied

Duration of the meeting

Page 5: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Were you satisfied with the number of

HTAB taking part in your PCI procedure?

Were you satisfied with which HTABs

took part in the PCC or PCI procedures

procedure?

Parallel Consultations Feedback Questionnaire Results

Figure 6. Satisfaction with the number of HTAB taking part in the procedures (n=9). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from PCI procedures. Only put to PCI.

Figure 7. Satisfaction with which HTABs took part in the procedures (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures.

4

Yes 33%

No 67% Yes

87%

No 13%

Page 6: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Please rate the topics below regarding the alignment

between EUnetHTA/HTABs' and EMA's opinion

Parallel Consultations Feedback Questionnaire Results

Figure 8. Alignment between HTABs' and EMA's opinion (Population) (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures. This question registered 1 “Not applicable” answer.

Figure 9. Alignment between HTABs' and EMA's opinion (Comparator) (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures. This question registered 3 “Not applicable” answers.

Figure 10. Alignment between HTABs' and EMA's opinion (Endpoints) (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures. This question registered 3 “Not applicable” answers.

Figure 11. Alignment between HTABs' and EMA's opinion (Overall Package) (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures. This question registered 1 “Not applicable” answer.

5

8

3 3 02468

10

Above average Average Below average

Population

4 2

6

02468

10

Above average Average Below average

Comparator

4 5

3 02468

10

Above average Average Below average

Endpoints

7

4 3

02468

10

Above average Average Below average

Overall Package

Page 7: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Please rate the written advices received based on the clarity of

the letters

Parallel Consultations Feedback Questionnaire Results

CHMP final advice letter EUnetHTA final recommendations (PCC)

and HTABs written replies (PCI)

Figure 12. Clarity of the CHMP final advice letter (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures.

Figure 13. Clarity of the EUnetHTA final recommendations (PCC) and HTABs written replies (PCI) (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures.

6

10

5

0 0

2

4

6

8

10

12

Above average Average Below average

7 6

2 0

2

4

6

8

10

12

Above average Average Below average

Page 8: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Regarding the advice received from the CHMP and related to

specific topics below

Parallel Consultations Feedback Questionnaire Results

Figure 14-17. Implementation of specific topics (Population, Comparator, Endpoints and Overall Package) regarding the advice received from the CHMP (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures. Each of the following topics registered 1 “Not applicable” answer: Population, Comparator. Each of the following topics registered 2 “Not applicable” answers: Endpoints.

7

71%

29%

0% 0% Population

Will likely beimplemented

Will be partiallyimplemented

Will not beimplemented

Not yet known79%

14%

7%

0%

Comparator

Will likely beimplemented

Will be partiallyimplemented

Will not beimplemented

Not yet known

61%

31%

8%

0%

Endpoints

Will likely beimplemented

Will be partiallyimplemented

Will not beimplemented

Not yet known

53%

47%

0%

0% Overall Package

Will likely beimplemented

Will be partiallyimplemented

Will not beimplemented

Not yet known

Page 9: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Regarding the written advices received from EUnetHTA/HTABs that

took part in your procedure and related to the specific topics below

Parallel Consultations Feedback Questionnaire Results

Figure 18-21. Implementation of specific topics (Population, Comparator, Endpoints and Overall Package) regarding the written advices received from HTABs that took part in the procedures (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures. Each of the following topics registered 1 “Not applicable” answer: Population, Comparator. Each of the following topics registered 2 “Not applicable” answers: Endpoints.

8

50% 43%

0% 7%

Population

Will likely beimplemented

Will be partiallyimplemented

Will not beimplemented

Not yet known

22%

64%

14%

0% Comparator

Will likely beimplemented

Will be partiallyimplemented

Will not beimplemented

Not yet known

38%

54%

0%

8%

Endpoints

Will likely beimplemented

Will be partiallyimplemented

Will not beimplemented

Not yet known

20%

53%

7%

20%

Overall Package

Will likely beimplemented

Will be partiallyimplemented

Will not beimplemented

Not yet known

Page 10: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Parallel Consultations Feedback Questionnaire Results

Themes for reflection based on feedback

9

EMA-EUnetHTA Communication and organisation • Communication regarding logistics?

• Procedure duration, timelines, PRIME scheme?

• Coordination between EMA and EUnetHTA/HTA Bodies regarding List of

Issues?

Page 11: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Parallel Consultations Feedback Questionnaire Results

Themes for reflection based on feedback

10

EMA-EUnetHTA Communication and organisation - F2F Meeting • Participants, topics and questions?

• Organisation of the F2F meeting? • Including clinical experts and payers?

Page 12: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Parallel Consultations Feedback Questionnaire Results

Themes for reflection based on feedback

11

Re EMA-EUnetHTA Outcomes • Follow-up mechanisms (to further address differing evidence needs)?

• Challenges in addressing the evidentiary needs of the involved stakeholder

when there are remaining divergences between EUnetHTA’s/HTA Bodies’ and EMA’s opinions

Page 13: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Parallel Consultations Feedback Questionnaire Results

Themes for reflection based on feedback

12

HTA Bodies participation in Parallel Consultations • Decision criteria for the allocation of the Parallel Consultation procedure

pathways (Individual or Consolidated); feedback?

• HTA Bodies participation; more/representativeness?

Page 14: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Parallel Consultations Feedback Questionnaire Results

Themes for reflection based on feedback

13

HTA Bodies deliverables • Consolidation of HTA validation comments?

• Scientific discussion section for HTA in List of Issues for context?

• Addressing variability amongst the HTA Bodies involved in the procedures?

Page 15: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Did the advice meet your expectations?

Parallel Consultations Feedback Questionnaire Results

Figure 23. Did the advice meet your expectations? (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures.

Figure 22. Facilitation of a single development trial/plan approach for the product to meet the evidentiary needs of the involved stakeholders (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures.

PC facilitated a single development trial/plan approach for our product to

meet the evidentiary needs of the involved stakeholders

Figure 24. Would you repeat the process for another product/indication? (n=15). n represents the number of contributions to the Parallel Consultations Feedback Questionnaire from both PCC and PCI procedures.

Yes 100%

Would you repeat the process for another product/indication?

14

Yes 67%

Partially 33%

46%

27% 27%

0

2

4

6

8

Agree Neutral Disagree

Page 16: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Conclusions

Important to strive for continuous improvement; feedback is helpful

There are areas for further reflection – Admin. TCs EMA and EUnetHTA

Overall positive message on benefits of parallel consultation:

• “Aligned feed-back was received from the CHMP & HTABs on many topics”

• “The procedure itself ran efficiently from both the EMA & EUnetHTA”

• “The procedure was beneficial even though the outcomes may at points not be satisfactory or be challenging. It is important to be aware of the implications of the development plan on the post-approval phase. HTAs may have a different set of expectations than the Regulators”

Parallel Consultations Feedback Questionnaire Results 15

Page 17: Parallel Consultations - European Medicines Agency · Parallel Consultations Feedback Questionnaire Results ... The results shared in this presentation were based in 15 contributions

Thank you for your attention

Contact me at [email protected]

European Medicines Agency 30 Churchill Place • Canary Wharf • London E14 5EU • United Kingdom Telephone +44 (0)20 3660 7149 Facsimile +44 (0)20 3660 5555

Send a question via our website www.ema.europa.eu/contact

Further information

Follow us on @EMA_News