Fabrizio GagliardiEU DataGrid Project LeaderEGEE Project Coordinator

EGEE is proposed as a project funded by the European Union under contract IST-2003-508833

From Grid Prototypes to Grid Infrastructures

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 2

EGEE Goal & Strategy

• Goal:• Create a wide European Grid Infrastructure for the support of research in all scientific area, built on top

of present and future EU RN infrastructure

• Strategy:• Leverage current and planned national and regional Grid programmes• Build on EU and EU member states major investments in Grid Technology• Work closely with relevant industrial Grid developers, NRENs and US-AP projects• Exploit International connections (US and AP)• Take advantage of pioneering prototype results

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 3

Why EGEE? Impact on Society

• Access to a production quality grid will change the way science and business is done in Europe

An international network of scientist will be able to model a new flood of the Danube in real time, using meteorological and geological data from several centers across Europe

A team of engineering students will be able to run the latest 3D rendering programs from their laptops using the Grid

A geneticist at a conference, inspired by a talk she hears, will be able to launch a complex biomolecular simulation from her mobile phone

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 4

Why EGEE? Political context

• Current Grid R&D projects run out within few months

• The EGEE partners have already made major progress in aligning national and regional Grid R&D efforts, in preparation for EGEE

• EGEE will preserve the current strong momentum of the European Grid community, and the enthusiasm of the hundreds of young European researchers already involved in EU Grid projects (>150 in EDG only)

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 5

Why EGEE? Historical analogy

• Prior to the EU Geant programme ,there was in Europe a multitude of exploratory projects in networking technology. Geant was truly production oriented, and brought European telecom operators actively into the picture

• In a similar way, EGEE can ensure preservation of current investments in European Grid R&D, extending the present infrastructure and focussing all activities towards establishing a production quality Grid

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 6

EGEE forerunner: DataGrid (I)

• 9.8 M Euros EU funding over 3 years (twice as much from partners)

• 90% for middleware and applications (High Energy Physics, Earth Observation, Genomic Exploration)

• Total of 21 partners, over 150 programmers from research and academic institutes as well as industrial companies

• Three year phased developments & demos (2001-2003)

• Several improved versions of middleware software (final release end 2003)

• Several components of software integrated in LCG

• Software used by partner projects: DataTAG, CROSSGRID

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 7

EGEE forerunner: DataGrid (II)

• DataGrid testbed:approximately 1000 CPUs at 15 sites

• Connections made possible by the EU-funded GEANT project • connecting more than 30 countries across Europe

• speeds of up to 10 Gbit/s

• high data throughput

• quality of Service

Site Country CPUs Storage

CC-IN2P3* FR 620 192 GB

CERN* CH 138 1321 GB

CNAF* IT 48 1300 GB

Ecole Poly. FR 6 220 GB

Imperial Coll. UK 92 450 GB

Liverpool UK 2 10 GB

Manchester UK 9 15 GB

NIKHEF* NL 142 433 GB

Oxford UK 1 30 GB

Padova IT 11 666 GB

RAL* UK 6 332 GB

SARA NL 0 10000+ GB

TOTAL 5 1075 14969 GB

*also Dev. TB; +200 TB including tape

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 8

EGEE Partner Federations

• Integrate regional Grid efforts

• Represent leading grid activities in Europe

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 9

EGEE Activity Areas

• Services• Deliver “production level” grid services (manageable, robust, resilient to failure)• Ensure security and scalability

• Middleware• Professional Grid middleware re-engineering activity in support of the production

services• Networking

• Proactively market Grid services to new research communities in academia and industry

• Provide necessary education

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 10

ResourceCenter

(Processors, disks)

Grid server Nodes

ResourceCenter

ResourceCenter

ResourceCenter

OperationsCenter

Regional SupportCenter

(Support for Applications

Local Resources)

Regional Support

Regional Support

Regional Support

EGEE Operations Structure

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 11

EGEE Service Activity

• Create, operate, support and manage a production quality infrastructure

• Structure: • EGEE Operations Management at CERN • EGEE Core Infrastructure Centres in the UK, France,

Italy, Germany and CERN (leveraging LCG at the start), responsible for managing the overall Grid infrastructure

• Regional Operations Centres, responsible for coordinating regional resources, regional deployment and support of services in all other countries

• Offered services:• Middleware deployment and installation• Software and documentation repository• Grid monitoring and problem tracking• Bug reporting and knowledge database• VO services• Grid management services

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 12

EGEE Networking Activity

• Dissemination and outreach

• User training and induction

• Application identification and support

• Two pilot application centers (for high energy physics and biomedical grids)

• One more generic component dealing with longer term recruitment and support of other communities

• Policy and International cooperation

rely on a supporting network in the partner regions

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 13

EGEE Middleware Activity

• Hardening and re-engineering of existing middleware functionality, leveraging the experience of partners

• Activity concentrated in few major centers

• Key services: Resource Access• Data Management• Information Collection and Accounting• Resource Brokering (Italy)• Quality Assurance• Grid Security• Middleware Integration• Middleware Testing

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 14

EGEE & Industry

• Industrial participation encouraged both as potential end-users and IT technology and service suppliers

• Normally through national and regional Grid EGEE federations

• EGEE will maintain an Industry Forum to keep selected Industrial and Commercial interested parties in close contact

• Services developed in first EGEE 2 years phase (2004-5) might be tendered to Industry in second phase (2006-7)

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 15

EGEE Timeline

• May 2003: proposal submitted

• July 2003: proposal accepted

• September 2003: start negotiation

• April 2004: start project

NORDUnet 2003 - Reykjavík, Iceland – 24/27 August 2003- 16

Conclusions

• The EU DataGrid project has successfully fulfilled its role of EU Grid flagship project in collaboration with several other EU and international projects

• Essential to keep the momentum and the current lead in production Grids in Europe

• Important to build an international cooperation between European and US/AP Grid infrastructure projects

• The scientific user communities are already international (HEP is an excellent example) and so the computing resources and most of the experimental instruments

• EGEE proposes the right framework and plans to accomplish the above objectives