EGEE – Grid project

INFSO-RI-031688

Enabling Grids for E-sciencE

www.eu-egee.org

eGY Meeting Boulder – M. Petitdidier –March 2008

EGEE – Grid project

M. Petitdidier (IPSL/CETP)

Coordinator of Earth science [email protected]

In collaboration with EGEE and DEGREE EU-project

eGY – Boulder – M. Petitdidier –March 2008


INFSO-RI-031688

Acute Questions for Earth Science

Forecasting of meteorological eventsExtreme events: storm, tornado, hurricane, earthquake, tsunami…Water management: precipitations, flood, aquifer..Pollution,,…

=> To provide real time information: real time data access, data assimilation and modelling

Long term prediction : Climate ChangeClimatology i.e. trend of parameter variations like temperature, precipitations….Polar ozone holeImpact on weather, agriculture…

=> Long series of multiple data sets, Intense processing,

Discoveries and Dissemination of the knowledgeHow it works, Why….

These are Questions for Operational and Science

organisations



INFSO-RI-031688

GRID: a solution

• GRID infrastructure Since 2000– Considered an “open platform” for handling computing resources,

data, tools…

• Partner can use a lot more resources than the ones he (she) brings in– Impressive number of shared resources

§ EGEEII around 40,000 CPUS distributed in 200 sites§ 5 PB storage

• A collaborative possible platform among teams and/or countries

§ interactive collaboration to avoid effort duplication

• Secure and restricted access to resources, data, tools…§ Same data and software policy as outside Grid

• Grid will open new fields of investigation on Earth Science



INFSO-RI-031688

EGEE Production Grid Infrastructure Steady growth over the lifetime of the project Improved reliability

Highlights of EGEE-II

Data TransferM

B/s

04/2006 08/2006



INFSO-RI-031688

Operations Size of the infrastructure today:

• 237 sites in 45 countries

• ~36 000 CPU

• ~ 5 PB disk, + tape MSS

• distributed operations

• copes well with increase in size and usage

98k jobs/day



INFSO-RI-031688

Registered Collaborating Projects

Applicationsimproved services for academia,

industry and the public

Support Actionskey complementary functions

Infrastructuresgeographical or thematic coverage

24 projects have registered as on February 2007: web page



INFSO-RI-031688

GRID: Nearly world-wide deployment

– European Union§ BalticGrid§ EELA§ EUChinaGrid§ EUIndiaGrid§ EUMedGrid§ SEE-GRID§ NorduGrid

– USA§ OSG§ TeraGrid

– Japan§ Naregi

– Africa- Unesco Programme§ Algeria, Ghana, Nigeria, § Senegal, Zimbabwe

– Sub-Saharian Africa§ Possible pilot project

eGY Boulder – M. Petitdidier – March 2008


INFSO-RI-031688

Earth Science Applications in EGEEII

ESA, UTV(IT), ESA, UTV(IT), KNMI(NL), IPSL(FR)- KNMI(NL), IPSL(FR)- Production and Production and validation of 7 years of validation of 7 years of Ozone profiles from Ozone profiles from GOMEGOME

Rapid Earthquake Rapid Earthquake analysis analysis (mechanism and (mechanism and epicenter) epicenter) 50- 100CPUs 50- 100CPUs IPGP(FR)IPGP(FR)

Modelling seawater Modelling seawater intrusion in costal intrusion in costal aquifer (SWIMED) aquifer (SWIMED) CRS4(IT),INAT(TU),CRS4(IT),INAT(TU),Univ.Neuchâtel(CH)-Univ.Neuchâtel(CH)-

Geocluster for Geocluster for Academy and Academy and industry CGG(FR)-industry CGG(FR)-

Flood of a Danube river-Flood of a Danube river-Cascade of models Cascade of models (meteorology,hydraulic ,(meteorology,hydraulic ,hydrodynamic….) hydrodynamic….) UISAV(SK)-UISAV(SK)-

Specfem3D: Specfem3D: Seismic Seismic application. application. Benchmark for Benchmark for MPI (2 to 2000 MPI (2 to 2000 CPUs) (IPGP,FR)CPUs) (IPGP,FR)

DKRZ(DE)- Data access DKRZ(DE)- Data access studies, climate impacts on studies, climate impacts on agricultureagriculture

Data mining Data mining Meteorology & Meteorology & Space Weather Space Weather (GCRAS, RU)(GCRAS, RU)

Air Pollution Air Pollution model- BAS(BG)model- BAS(BG)Mars atmosphere CETP(

FR):



INFSO-RI-031688

Final Remarks• New tools needed to use the whole Grid potential

– Due to Change in scale of computing power– Need of Exploration of huge data sets– Creation of Platform integrating web services, computing power,

information systems….

• New conceptual approach of Earth Science– Role of Scientist– Application development

DEGREE EU project is preparing the future

Dissemination and Exploitation of GRids in Earth sciencE

SSA- IST 2005-034619 eGY Boulder – M. Petitdidier –March 2008

• Strategic objectives– Bridge the ES and GRID communities throughout Europe – Ensure that ES requirements are satisfied in next Grid generation– Ensure the integration of emerging technologies for managing ES

knowledgeThe DEGREE team:The DEGREE team:

IISAS, IISAS, Slovakia Slovakia (Coordinator)(Coordinator)

CNRSCNRS, France , France KNMI, KNMI, The Netherlands The Netherlands UNINEUNINE, Switzerland, SwitzerlandCRS4CRS4, Italy, ItalySCAI, SCAI, Germany Germany GCRASGCRAS, Russia, RussiaESA-ESRIN, ESA-ESRIN, ItalyItalyCGGCGG, France, FranceDutch Space, Dutch Space, The NetherlandsThe Netherlands

Project Vision

Build a bridge linking the ES and Grid communitiesBuild a bridge linking the ES and Grid communities

http://www.eu-degree.eu



INFSO-RI-031688

European Grid Initiative

• Need to prepare permanent, common Grid infrastructure

• Ensure the long-term sustainability of the European e-Infrastructure independent of short project funding cycles

• Coordinate the integration and interaction between National Grid Infrastructures (NGIs)

• Operate the production Grid infrastructure on a European level for a wide range of scientific disciplines

Must be no gap in the support of the

production grid



INFSO-RI-031688

Evolution

Testbeds Utility ServiceRoutine Usage

National

Global

European e-Infrastructure



INFSO-RI-031688

38 European NGIs

+ Asia, US, Latin America

+ PRACE

+ OGF-Europe

+ …



INFSO-RI-031688

Meetings

• European Geophysical Union General Assembly• 2 Grid sessions on Wednesday 16 April 2008

• Vienna, Austria



INFSO-RI-031688

Earth Science Expectations

• Pushing frontiers of scientific discovery by exploiting advanced computational methods.

EGEE – Grid project

Documents

Transcript of EGEE – Grid project