EGEE-III INFO-RI-222667 Enabling Grids for E-sciencE EGEE and gLite are registered trademarks...

EGEE-III INFO-RI-222667

Enabling Grids for E-sciencE

www.eu-egee.org

EGEE and gLite are registered trademarks

EGEE-III Status

Bob Jones – Project Director - CERN

EGEE-III first review (CERN)24-25 June 2009


EGEE-III INFO-RI-222667 Project Status - Bob Jones - EGEE-III First Review 24-25 June 2009 2

Contents

• General Status of the project, providing an overview of:– Review Agenda– Project Objectives– Activities– Consortium– Management Structure– NA1 activity 1st year achievements– Deliverables/milestones, contract status– Financial status– Manpower levels



Review agenda

Status of the projectTechnical Status

TrainingApplications

Closed sessionFeedback from reviewersCocktail

Demos

OperationsNetworking SupportDissemination (scientific & business)

Middleware Re-engineeringIntegration, Testing and Certification

Policy & Collaboration Plans for the 2nd yearGeneral discussion

Tuesday Wednesday

The follow-up of recommendations from the final review of EGEE-II is documented in the periodic report (DNA1.7.1) and are implicitly covered in the presentations



Project Objectives

• Expand/optimise existing EGEE infrastructure, include more resources and user communities

• Prepare migration from a project-based model to a sustainable federated infrastructure based on National Grid Initiatives– Collaborate with strategic user communities– Provide high-quality support to a wide range of VOs by offering training,

dissemination of information, application porting and online user helpdesks– Encourage and establish best security practices– Provide reliable and performant Grid middleware foundation services and key

high-level middleware services, to users with integration and deployment facilities

– Enhance technology transfer to business communities– Ensure overall world-wide coherence of the developments through

collaboration with other Grid projects, networking and standards organisations– Implement structural changes in concertation with the EGI_DS project, to

facilitate the move towards sustainable Grid infrastructures in Europe– Encourage the formation of National Grid Infrastructures (NGIs) through the

use of Joint Research Unit (JRU)



Activities

Grid operations & Networking support 51%

User Com-munitysup-port 19%

Training8%

Middlewa-reeng. 5%

Integration and test-ing9%

Management 2%

Dissemination & In-ternational Coop-

eration6%

NetworkingNA1: Project Management

NA2: Dissemination, Communication and Outreach

NA3: User Training and Induction

NA4: User Community Support and Expansion

NA5: Policy and International Cooperation

ServicesSA1: Grid Operations, Support and Management

SA2: Networking Support

SA3: Integration, Testing and Certification

Joint ResearchJRA1: Middleware Re-engineering



Interaction between the activities

Project Status - Bob Jones - EGEE-III First Review 24-25 June 2009 6



• From 91 partners in EGEE-II (+ further 48 JRU members)

• To 42 Beneficiaries in EGEE-III (+ 100 JRU members)– This change has been made in preparation for a sustainable infrastructure

based on a federation of national e-Infrastructures

• Joint Research Units (precursors to National Grid Initiatives):– Austria– Belgium– Bulgaria– Croatia– Cyprus– France– Germany– Greece– Hungary– Israel– Italy

• JRU members are invited to Collaboration Board meetings as Observers

7

Consortium

– Netherlands– Norway– Poland– Romania– Russia– Spain – Sweden– Switzerland– Turkey– United Kingdom

Project Status - Bob Jones - EGEE-III First Review 24-25 June 2009


EGEE-III INFO-RI-222667 8

Consortium - 2

• USA: mware development, interoperability, Support to new user communities– UWM – RENCI

• Asia Pacific: expanding EGEE infrastructure within Asia

Pacific– ASGC (SA1 Regional Operations Centre)– KISTI – CNU– New partners: KEK (Japan), UNIMELBOURNE (Australia)

• Commonwealth of Independent States (CIS)– Initial contact to encourage them to join the infrastructure

• For these regions the NA1 budget includes limited funds to provide financial assistance to attend EGEE events




EGEE-III federations

• Beneficiaries & JRU members, academic & business, organised in

regional federations:– Asia Pacific (Australia, Japan, Korea, Taiwan)– Benelux (Belgium, the Netherlands)– Central Europe (Austria, Croatia, Czech Republic, Hungary, Poland, Slovakia,

Slovenia)– France– Germany/Switzerland– Italy– Nordic countries (Finland, Sweden, Norway)– South West Europe (Portugal, Spain)– South East Europe (Bulgaria, Cyprus, Greece, Israel, Romania, Serbia, Turkey)– Russia – United Kingdom/Ireland– USA




EGEE-III management structureP. Andrews (Univ Ten.)C. Goble (Man. Uni)E. Jessen (DFN) R. Kubli (EDS)

L. Robertson (CERN):Meets at annual conference & user forum

Meets bi-weeklyby phone

Meets bi-weeklyby phone

1 representative per federation: Meets quarterly

1 representative per federation: Meets quarterly

1 rep./partner:Meets at annual conf. & user forum




NA1: 1st year achievements• contract amendments

– Explain the contents of the amendments

• All activity meetings– May 2009: EGEE-II/EGEE-III transition meeting– Jan 2009: Revise EGEE->EGI planning based on endorsed EGI blueprint document

• Gender Action Plan– xxxxxxxxxxxxxxxxxxx

• Sustainability– EGEE has been the driving force behind the transition to the European Grid Initiative



Quality Assurance

• Need to add a couple of slides in agreement with Gabriel about QA covering:– Creation of QA plan for each activity– Metrics programme and its tracking

Any issues found from the metrics

– Country review process

Project Status - Bob Jones - EGEE-III First Review 24-25 June 2009 12


EGEE-III INFO-RI-222667 13• 13

Country Reports

• The EGEE-III consortium is notable by its size and the inclusion of Joint Research Units and National Grid Initiatives facilitating the evolution to national structures

• Take into account the experience gained from the activity and partner reviews introduced during EGEE-II

• Goals– Monitor the progress of the programme of work in each country and the

involvement of individual partners– Provide a forum to discuss issues, examine progress and contribution and

establish better communication between individual partners, the activity managers and project management

– Identify and promote regional successes and initiatives for re-use in other countries

– Encourage national responsibility and reporting– Verify the state of readiness for the transition to EGI

• Output– Publishable report at the end of each year




Country Reports - 2• Timeline:

• Q1-Q2: Guidelines for the Country review process presented at the Transition meeting, Template for the Country Status Report distributed for testing with CERN & 3 countries

• Q3-Q4 Each country provided Country Report, summary of analysis presented at the CB meeting (at the user forum); DNA1.6.1 Summary report published

• Key finding:• Effort for setting up NGIs not foreseen in DoW

• Diversion of effort from the programme of work• Start up problems due to contracts recognised

• Permanent/unfunded effort used to fill the gap• proof there is a pool of resources available for NGIs to get up and

running• Harmonized infrastructure metrics collection in year 2 is a priority• More EGEE sites in each country should sign the site SLA• Training: each country needs a pool of accredited trainers• Good dissemination efforts locally, translations, webpages, event attendance

• Next Steps:• Country reports used to modify plans for the second period of EGEE-III



Sustainability• Need to prepare permanent, common Grid infrastructure• Ensure the long-term sustainability of the European e-Infrastructure

independent of short project funding cycles• Coordinate the integration and interaction between National Grid

Infrastructures (NGIs)• Operate the production Grid infrastructure on a European level for a

wide range of scientific disciplines

• Must be no gap in the support of the production grid



EGEE→EGI transition planning

• Transition plan produced

(DNA1.4) in Dec’08

• This plan details the steps

needed to migrate EGEE’s

operation to EGI, identified major

risks and shortcomings.

• Used as input for the final version

of the EGI Blueprint (endorsed

Jan’09)

• Subject of All-activity meeting held

in Jan’09 (Amsterdam)




Deliverables and milestones

• Effective review procedure in place– Activity → nominated reviewers → AMB → PMB

• All PM1-PM12 deliverables submitted– All milestones achieved and documented by this review

• The recommendations from the EGEE-II final review have been addressed and documented (DNA1.7.1)



Provisional Financial Status

104 Form C’s received so far (out of 119)

• Total Costs: 55,588,637 EUR (excluding cost of computing resources provided

by partners → estimated at 50 million EUR)– 24,161,421 EUR - Period 1– 31,427,216 EUR - Period 2

2.98M EUR over total cost budget (5.7%)

• Total Requested Contribution as shown on the partners’ Form C’s: 38,509,048 EUR – 16,530,669 EUR – Period 1 – 21,978,378 EUR – Period 2 (including 1 month extension)

1,537,684 EUR over budgeted Max. EC Contribution (4%)

• Personnel is 91% of total costs• All costs and effort are cross checked against work performed

UPDATE



CERN17%

CE7%

NE8%

UK/I13%

DECH6%

FRANCE19%

ITALY11%

NRENS1%

RUSSIA3%

SEE8%

SWE7%

EGEE-II Total Project Costs by Federation

CERN includes NA1 (3%) + USA & Asia Collabo-ration costs


19

NA13%

NA2-NA527%

SA1-SA357%

JRA1, JRA213%

EGEE-II Total Project Costs by Activity

NA1: Project Management

NA2: Dissemination, Outreach and Communication

NA3: Training and Induction

NA4: Application Identification and Support

NA5: Policy and International Cooperation

SA1: Grid Operations, Support and Management

SA2: Networking Support

SA3: Integration, Testing and Certification

JRA1: Middleware Re-engineering

JRA2: Quality Assurance

CE: Austria, Croatia, Czech Republic, Hungary, Poland, Slovakia, Slovenia

NE: Belgium, Denmark, Finland, Netherlands, Norway, Sweden

UK/I: United Kingdom & Ireland

DECH: Germany & Switzerland

NRENS: National Research and Education Networks

SWE: Portugal & Spain

SEE: Bulgaria, Cyprus, Greece, Israel, Romania, Serbia, Turkey

Asia (Korea & Taiwan) & USA: No funded effort only travel money

UPDATE




20

Most overspending partners

Budget Consumption Overspent by (k EUR)

CNRS 126% 1,505

STFC 124% 983

CGG Services 165% 329

Most under-spending partners

Budget Consumption Under-spent by (k EUR)

ICI 62% 224

FZK 90% 168

GSI 69% 137

UPDATE



Effort Consumption

Legend:• F: Funded effort• M: Matching effort• PM: Person Months• FTE: Full time equiv.

• 1419 members registered• 526 FTEs (115% of total PMs budget)

Budgeted PMs

Actual PMs

Difference % Consumption of budget

Funded 8106 9288 1182 115%

Matching (partners with AC cost model)

2879 3324 445 115%

Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q80

2,000

4,000

6,000

8,000

10,000

12,000

14,000

Total (Funded+Matching) Effort in PMs

Consumed F+M Effort

Expected F+M Effort

PM

s

Incl

udes

Apr

il 20

08

UPDATE



Funded and Matching Effort

22

JRA111%JRA2

1%

NA12%

NA25%

NA35%

NA415%

NA51%

SA153%

SA22%

SA35%

Funded Effort by Activity (in PMs)

JRA18%

JRA20%

NA12%

NA25%

NA36%

NA423%

NA51%

SA146%

SA20%

SA39%

Matching Effort by Activity (in PMs)

NA1 includes additional matching effort from CERN on tool support and from CNRS for user registration

UPDATE



Total Effort by Activity

23

105%

84% 135%

123% 93%

121%

99%

120%

106%

100%

% - consumption of the PM budget

UPDATE



NA1 Issues• Manpower

– Change of Technical director– Swiftly hired new technical director

– Nomination of NA2 activity manager– In place by summer 2008

– Start-up issues for some partners due late signature of Grant Agreement Compensated by use of matching manpower

• Consortium Size– Financial reporting difficult to achieve in short timeframe

Internal quarterly cost estimates provided early indications Provisional financial statement provided at this review

– Difficult to monitor tasks of ALL partners in ALL activities Introduced country reviews

Activity-specific issues are addressed in the corresponding presentations



Summary

• EGEE-III has successfully completed its first period– All deliverables have been produced and milestones met

Metrics Targets at end of

Year 1

Targets at end of

Year 2

Status at the end of

the project

Number of users 1750 2100 >9000 Number of people benefiting from the existence of the EGEE infrastructure

4000 5000 10000s

Number of application domains making use of the EGEE infrastructure

7 8 10

Number of organisations making use of the EGEE infrastructure

75 100 ~140

Number of languages in which material is available

10 12 Up to

15

Number of attendees trained

750 1500 3079

Dissemination events in which EGEE-II is represented

200 400 622

Metrics Targets at end of Year 1

Targets at end of Year 2

Status at the end of

the project

Peak number of jobs running simultaneously

9000 12000 46000

Number of sites certified as production quality

180 200 255

Percentage of sites certified as production quality

60% 80% 90%

Number of countries connected to the EGEE

infrastructure 40 45 49

UPDATE

EGEE-III INFO-RI-222667 Enabling Grids for E-sciencE EGEE and gLite are registered trademarks...

Documents

Transcript of EGEE-III INFO-RI-222667 Enabling Grids for E-sciencE EGEE and gLite are registered trademarks...