Co-ordination & Harmonisation of Advanced e-Infrastructures

Research Infrastructures – Grant Agreement n. 260011

The CHAIN Project: Technical

Achievements Federico Ruggieri, INFN – Project Director

NKN Annual Conference 2012 Mumbai, 1 November 2012

Outline

Reasons behind e-Infrastructures and benefits

Regional e-Infrastructures

The need for a project like CHAIN

General information about CHAIN

Technical Achievements

Conclusions

2

Computing-intensive science

Many research challenges require community effort Fundamental properties of matter

Genomics

Climate change

Medical diagnostics

Research is increasingly digital, with increasing amounts of data

Computation ever more demanding

Example: experimental science uses ever more sophisticated sensors

Huge amounts of data

Serves user communities around the world

International collaborations

3 1st CHAIN Review – Athens, 03 Feb. 2012

The many faces of

eInfrastructures

The High Speed Communication Network

The High Performance Computing for highly

parallel applications

The Grid for High Throughput Computing and

resource sharing

The Clouds for elastic resource provisioning

Data Infrastructures with several issues such as:

Large data volumes, Curation, Access, High

Availability, etc.

The Human Network: researchers working

together sharing motivations, objectives, tools

and resources 4

Why ?

The e-Infrastructures promote the usage of network connectivity and stimulate scientific and technical

development of countries

contribute to fight the digital divide and brain drain.

e-Infrastructures support wide geographically

distributed communities

enhance international

collaboration of scientists

promote collaboration in

other fields.

Grids and networks allow the access of

many researchers to scientific resources (laboratories and

data)

Disparity can be reduced and larger participation and contributions to high

quality research.

5

Regional Grid infrastructures

CNGrid

NKN &

Garuda

EUAsiaGrid

SAGrid &

SANREN

GISELA

6

CHAIN: global coverage

7

Project information

Grant Agreement for a total EC contribution of 1.1 M€

Total cost: about 1.9 M€

Start Date: 1st December 2010 - Duration 24 Months

Partners:

1) INFN (Italy - Coordinator)

2) CESNET (Czech Rep.)

3) CIEMAT (Spain)

4) GRNET (Greece)

5) IHEP (China)

6) UBUNTUNET (Africa)

7) CLARA (Latin America)

8) PSA (India)

9) ASREN (Med./Middle East/Gulf) Since 1 August 2011 8

Project objectives

9

Define a strategy and a model for external collaboration, in close collaboration with EGI.eu which will enable operational and organisation interfacing of EGI and external eInfrastructures

Validate this model, as a proof-of-principle, by supporting the extension and consolidation of worldwide Virtual Research Communities

Explore and propose concrete steps forward towards the coordination with other projects and initiatives (e.g. EGI.eu, NKN & Garuda, CNGrid etc.)

Disseminate (WP5)

Project workplan

State of the Art Assessment

(WP2)

Analyse the different

Regional Approaches

(WP2, WP4)

Make

Recommendations

(WP2, WP3, WP4)

Involve the VRCs

(WP3)

Propose a Road-Map and

Intermediate solutions

(WP4, WP3)

Demonstrate the

usefulness of

interoperation

(WP3, WP4)

10 1st CHAIN Review – Athens, 03 Feb. 2012

State of the art analysis (WP2)

Analysis of existing NGI literature and related questionnaires

Creation of the regional and NGI questionnaires

Questionnaires being implemented and published online

Collection of contact points from all

continents

Questionnaire is kept open and

collection of contact points from all

continents is continued

Questionnaire data provided

through the CHAIN Knowledge

Base

11 1st CHAIN Review – Athens, 03 Feb. 2012

Knowledge base (WP2, WP5)

12

www.chain-project/knowledge-base

Country view

13

Data analysis (WP4, WP2)

Nuber of sites and number of CPU - Mediterranean

0

1

2

3

4

5

6

7

8

Algeria

Egypt

Tunisia

Morocco

IranUnited Arab E

mirates

Jordan

Sit

es

0

100

200

300

400

500

600

700

CP

U c

ore

s

Number of Grid sites / clusters: Number of CPU cores:

Number of sites and number of CPUs

14 1st CHAIN Review – Athens, 03 Feb. 2012

Nuber of sites and number of CPU - Latin America

0

10

20

30

40

50

60

Brazil

Ecuador

Colom

bia

Argentina

Panamá

Paraguay

Mexico

Cuba

Venezuela

Costa R

ica

Guatem

ala

Peru

Sit

es

0

1000

2000

3000

4000

5000

6000

CP

U c

ore

s

Number of Grid sites / clusters: Number of CPU cores:

Nuber of sites and number of CPU - Asia

Pacific

0

1

2

3

4

5

6

7

8

Indonesia

Singapore

Vietnam

New

Zealand

Taiwan

Sit

es

0

1000

2000

3000

4000

5000

6000

7000

CP

U c

ore

s

Number of Grid sites / clusters: Number of CPU cores:

WP2 Recommendations

74 Detailed recommendations classified by:

Short (1 year), Medium (3 years) and Long term (5 years)

High, Medium, Low priority

National Grid Initiatives (9):

General (5); Regional (4)

Interoperations (14):

General (1), ROC (3), User Support (1), Monitoring (3), Security (2),

Core Services (2); Middleware (2)

Interoperability (2): General (1), Input/Output (1)

Virtual Research Communities’ perspective: General (2)

Regional planning (47):

Africa (9), Asia Pacific (6), Central Asia (5), China (7), India (4), Latin

America (5), Mediterranean & Arab Countries (11) 15 1st CHAIN Review – Athens, 03 Feb. 2012

Africa & Arabia Regional Operation Centre

http://roc.africa-grid.org

16

VRCs (WP3)

Agreements with reference communities signed

WeNMR 21/09/2011

WRF4G 19/09/2011

jModelTest 21/02/2012

LSGC 27/03/2012

INDICATE 28/03/2012

DECIDE 13/04/2012

SuperB (on the way)

Earth Science (ICTP) (on the way)

17

Worldwide Interoperability Demo

18

....... Scie

nce

Gate

wa

y

App. 1 App. 2 App. N

Embedded Applications Administrator Power User Basic User

Users from

different

organisations

having different

roles and

privileges

Access: the Science Gateway model

(WP3, WP4)

Standard-based

middleware-independent

Grid Engine

19

Europe, Africa, Asia

Pacific, Latin America

Brasil China

India

20

science-gateway.chain-project.eu

www.chain-project.eu

21

Clouds and Grids

Grid has been conceived as a resource sharing

infrastructure

Grids provide High Throuput Computing that fits many

applications

Clouds have a clear business model that allowed

companies to provide services on the market

Virtualisation and elastic computing are needed by several

scientific domains (e.g. interactive and web based

applications)

Clouds and Grids can cohexist in the Research &

Education domain provided that the strenghts of both can

be merged 22

R&E Clouds

Cloud infrastructure for R&E should be based on Open SW

& Standards

Financial:

Public institutions are frequently receiving projects’ driven funding.

Difficult to fund long term contracts with Cloud providers

Technical:

Resource sharing is an issue if institutions get services from

different providers. Building securely across several administrative

domains is difficult: Federation of Clouds is still not a reality

Long term preservation of data has still many issues to be

addressed (e.g. what happens to the data after the project end ?)

Requirements of scientists evolve and new technical challenges

appear that will push for innovation 23

Conclusions

The CHAIN project has gathered the experience and knowledge of regional Grid infrastructures around the world

CHAIN has made useful recommendations on several aspects of regional e-Infrastructures and specifically to their sustainability

CHAIN has successfully agreed with other projects (EUMEDGRID-Support, GISELA, INDICATE, DECIDE) on the SG approach

The first usage of SG in these projects has been very encouraging

An Interoperability demo has been demonstrated at the EGI TF 2012 in Prague and is still available (R. Barbera talk in the CHAIN WS of 2 November here at the NKN 2012 Conference in Mumbai)

A Road-Map for the interaction between EGI and other regional infrastructures is being finalised

New activities will be performed in the CHAIN-REDS project (talk in the CHAIN WS)

24

Co-ordination & Harmonisation of Advanced e-Infrastructures

Research Infrastructures – Grant Agreement n. 260011

Thank you