The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ......

29
The outcome of the 2010 TEN-T Calls for Proposals Anna Panagopoulou TEN-T Executive Agency Head of Unit –Technical & Financial Engineering, GIS & Monitoring TEN-T Project Management Workshop, 15-16 February 2011

Transcript of The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ......

Page 1: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

The outcome of the 2010 TEN-TCalls for Proposals

Anna PanagopoulouTEN-T Executive AgencyHead of Unit –Technical & Financial Engineering, GIS & Monitoring

TEN-T Project Management Workshop, 15-16 February 2011

Page 2: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

2

Outline

• Brief presentation of the 2010 Calls (FAB/ATM, RIS/MoS and Annual Call)

• Main steps of evaluation and selection process • Organisation of the 2010 external evaluation and key

figures• Guiding principles of the external evaluation and the

role of experts • Outcome of the 2010 evaluation/selection exercise• Conclusions

Page 3: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

3

TEN-T Calls 2010

• Multi-Annual Call Functional Airspace Blocks/Air Traffic Management (FAB/ATM) – up to €20 million

• Multi-Annual Call River Information Services (RIS) – up to €10 millionMotorways of the Sea (MoS) – up to €85 million

Page 4: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

4

TEN-T Calls 2010• Annual Call – up to €77 million

For the first time, the Annual Call targeted specific priorities: – Priority 1: Development of an integrated &

environmentally friendly transport system multimodal transport + decarbonisation of transport

– Priority 2: Acceleration/facilitation of TEN-T project implementation studies for all transport modes + works for mature projects notably in the rail and inland waterways sectors + projects supporting the Single European Sky policy

– Priority 3 : Support to Public-Private Partnerships (PPPs)

Page 5: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

5

TEN-T EA was responsible for:• checking the eligibility of the proposals:

- arrived on time, were complete, signed by the applicant, approved by the Member State… - in compliance with EU legislation (environment…), applicants have the financial and technical capacity to carry out the project…

• conducting the external evaluation:- proposals were reviewed independently by at least three external experts- the external experts met in a "consensus meeting" to reach a consensus recommendation and score for each proposal - DG MOVE participated to the consensus meetings

Evaluation and Selection of Proposals Step 1 - External evaluation

Page 6: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

6

DG MOVE was responsible for the:• Internal evaluation and final selection of proposals (with

the assistance of the TEN-T EA), based on the:- recommendations of the external evaluation- available budget, strategic objectives of the calls and the policy relevance of the proposals/EU relevance

• consultation of other EU services (DG Environment, DG REGIO…)

• consultation of:- Financial Assistance Committee (Member States)- European Parliament (one month right of scrutiny)

Evaluation and Selection of Proposals Step 2 - Internal evaluation/Selection

Page 7: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

7

2010 external evaluation exercise “at a glance” (1)

• External evaluation took place between:– 17 and 21 May 2010 for FAB/ATM Call – 27 September and 8 October 2010 (2 weeks) for

MoS, RIS and 2010 Annual Calls• Out of the 126 proposals submitted 2 were not eligible

(no evidence of the submission date, proposal not approved by MS involved)

• Around 56 Agency staff members were directly involved in the external evaluation exercise, from secretaries to IT staff, project managers (as moderators) and evaluation managers

Page 8: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

8

2010 external evaluation exercise “at a glance” (2)

• 37 experts, of which 33 experts from the EC Cordis database and 4 experts from EU Agencies/initiatives (European Maritime Safety Agency- EMSA, European Railway Agency-ERA, European Agency of Competitiveness and Innovation-EACI, European Private Public Partnership Expertise Centre-EPEC) worked individually and in panels of three experts to assess each of the 124 eligible proposals

• The process was examined by an independent observer, whose observations and recommendations are detailed in a report

Page 9: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

9

External evaluation: the process• Individual assessment

Each proposal was assessed independently by at least three external experts

• Consensus meetingThe three experts met in a “consensus meeting" to agree on:→ comments and scores for each of the 4

criteria→ a general recommendation This agreement is reflected in a « consensus form »

Page 10: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

10

External evaluation: 4 blocks of criteria

1. Relevance: contribution of the Action to the TEN-T policyand the objectives of the calls, and EU dimension

2. Maturity of the Action: is the Action ready to go?

3. Impact of the Action: anticipated socio-economic effectsand impact on the environment

4. Quality of the Action: completeness and clarity of theproposal, description of the planned activities, coherencebetween objectives, activities and planned resources,soundness of the project management process

For Annual Call Priority 1b, Priority 3 and MOS, further guidance wasprovided in the Call text on the interpretation of the award criteria

Page 11: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

11

External evaluation: guiding principles

• Objectivity: each proposal shall be evaluated as it is written

• Accuracy: experts’ evaluation shall be made against the official award criteria, and nothing else

• Consistency: the same standards of evaluation shall be applied to all proposals

Page 12: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

12

External evaluation: the role of experts• External experts are at the heart of the evaluation

of proposals under the TEN-T programme

Experts are responsible for the in-depth technical assessment of proposals submitted by the Member States Experts provide independent, impartial and objective recommendations Experts represent neither their employer, nor their country The opinion of external evaluators is the basis for the final selection made at Commission level

Page 13: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

13

External evaluation: proposal scoring under each of the 4 criteria

Experts awarded a score for each of the 4 criteria on a six-point scale from 0 to 5:0 - Insufficient. The proposal fails to address the criterion under examination or cannot be judged due to missing or incomplete information1 - Poor. The criterion is addressed in an inadequate manner, or there are serious inherent weaknesses.2 - Fair. While the proposal broadly addresses the criterion, there are significant weaknesses.3 - Good. The proposal addresses the criterion well, although improvements could be made.4 - Very good. The proposal addresses the criterion very well, although certain improvements might still be possible.5 - Excellent. The proposal successfully addresses all relevant aspects of the criterion in question. Any shortcomings are minor.

Proposals scoring <3 points for one or more of the four criteria are not recommended for funding

Page 14: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

14

Overview of the results of the external evaluation of the 2010 Calls

Page 15: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

15

Internal evaluation An Internal Evaluation Panel composed of representatives of DGMOVE, TEN-T EA and DG ENV reviewed each proposal individuallyto:

– consider each proposal in view of the TEN-T objectives, priorities and restrictions, as defined in the TEN-Guidelines, the work programmes and the call texts

– cut any costs and/or activities that would be not eligible or not recommended for funding

– recommend a selection of proposals for funding

Page 16: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

16

Inter-service consultation

The proposed selection of projects for funding was then reviewed and agreed by other DGs, in particular:

- DG ENV- DG BUDG- DG REGIO

Page 17: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

17

Overview of the results of the 2010 MAP Calls evaluation/selection

Page 18: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

18

Overview of the results of the 2010 MAP Calls evaluation/selection

Page 19: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

19

Overview of the results of the 2010 Annual Call evaluation/selection

- Priority 1: Promoting the development of an integrated and environmentally friendly transport system – 13 projects selected, €32.1 million in funding

- Priority 2: Accelerating/facilitating the implementation of TEN-T projects (studies for all modes, works for mature projects, notably in the rail and inland waterways sectors), as well as projects supporting the Single European Sky policy - 18 projects selected, €41.1 million in funding

- Priority 3: Studies to support Public-Private Partnerships (PPPs) - 3 projects selected, €4.9 million in funding

Page 20: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

20

Overview of the results of the 2010 Annual Call evaluation/selection

Page 21: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

21

Overview of the results of the 2010 Annual Call evaluation/selection

Page 22: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

22

Overview of the results of the 2010 Annual Call evaluation/selection

Page 23: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

23

Overview of the results of the 2010 CallsOversubscription

Page 24: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

24

Overview of the results of the 2010 CallsLeverage effect

Page 25: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

25

Success of targeted 2010 Annual Call

• For the first time, the Annual Call contained three specific priorities, including priorities addressing the climate change challenge, acceleration and facilitation of the implementation of TEN-T projects and support to Public-Private partnerships

• One project was retained for funding addressing the decarbonisation of transport

• A dedicated workshop on PPPs organised prior to the submission of proposal - 3 out of 5 proposals were selected under the PPP priority-promote the participation of private sector to TEN-T funding

• Better use of limited EU funds by supporting mature projects and/or studies that accelerate the maturity of works and thus maximise the impact of the expected results in specific areas of TEN-T policy.

Page 26: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

26

Success of targeted 2010 MoS Call

• For the 2010 MoS call focus was broadened to:– wider benefits projects – and pilot actions to bridge the gab between studies and full scale

implementation – facilitate to introduction of new concepts and technologies

• The successful establishment of the “MoS One Stop Help Desk”: further explain the rules and requirements for the MoS implementation

• Better communication with applicants-more proposals submitted in line with the MoS concept

• A high leverage effect is foreseen • TEN-T calls remain popular - oversubscription is high

Page 27: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

27

Last steps for the 2010 Annual and RIS/MoS Calls

- Transmission of draft selection proposals to European Parliament which had the “right of scrutiny” until 20 January 2011

- Interim contact between TEN-T EA and MS on projects where environmental clarifications are awaited (ongoing)

- Assuming positive outcome to above steps, TEN-T EA will enter into negotiations on individual funding decisions with a view to finalising them as soon as possible in the spring (ongoing)

Page 28: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

28

TENT-T Calls for Proposals 2010 Feedback form

- What? Web survey to obtain feedback on 2010 TEN-T Call for Proposals

- Why? To help us improve the process for future calls

- Who? All those who applied to a TEN-T Call in 2010

- When? end February to mid-March

- How? Applicants will receive an email with weblink to questionnaire

Page 29: The outcome of the 2010 TEN-T Calls for Proposals · PDF fileThe outcome of the 2010 TEN-T ... • Brief presentation of the 2010 Calls (FAB/ATM, ... Studies to support Public-Private

TEN-T Project Management Workshop15-16 February 2011

29

Thank you for your attention

[email protected]://tentea.ec.europa.eu