GISELA: A Resource Infrastructure Provider An opportunity for VRCs

www.gisela-grid.eu

Grid Initiatives for e-Science virtual communities in Europe and Latin America

GISELA:

- A Resource Infrastructure Provider

- An opportunity for VRCsPhilippe Gavillet (Deputy Project Coordinator)

EGI User Forum, 11th-14th April 2011Vilnius (Lithuania)

www.gisela-grid.eu EGI User Forum (11-14 April 2011 - Vilnius / Lithuania) 2

Outline

• GISELA as Resource Infrastructure Provider:– General

is much experienced in Grid computing has a powerful Infrastructure complies with EGI policies & recommendations

– Specificities Both Service (gLite) and Opportunistic Computing (OurGrid) supported

• GISELA: an opportunity for VRCs– Platform for all kinds of Applications– Offers a series of new, well-supported Services (e.g. DIRAC)– VRC Training & Support– Collaborates with EGI and Regional Initiatives

• GISELA interests– Welcome international VRCs– Interest in VRCs collaborating with LA– Create emulation process in LA

• GISELA concerns– Efficient communication scheme between VRCs and GISELA – Efficient collaboration with EGI on VRC support


GISELA as Resource Infrastructure Provider


Long record in e-Science support

• Fruit of 5-6 year experience of successful e-Science EU-LA Collaboration, through EU funded projects (EELA, EELA-2, GISELA)

• Present in almost all LA countries

• Most encompassing e-Infrastructure for scientific collaborations between Latin America and Europe

• Sound long-term sustainability approach rooted on CLARA, NRENs, LA NGIs


Powerful e-Infrastructure in Latin America

Summary of committed Computing and Storage Resources (DoW)

Country CPUs TBs RCs Country CPUs TBs RCs

Argentina 130 0 5 Mexico 198 2 8

Brazil 1212 25 9 Peru 110 8 7

Colombia 200 2 6 Panama 100 1 2

Cuba 50 0 1 Portugal 100 0 3

Ecuador 100 1 5 Spain 100 20 2

France 40 0 1 Uruguay 100 10 1

Italy 100 30 1 Venezuela 120 6 3

CPUs TBs RCs

Total 2660 105 56


EGI compliant Infrastructure

• EGI - GISELA Resource Infrastructure Provider MoU signed

• EGI compliance is based on the adoption of common services and practices

– The Operational Level Agreement (OLA) (http://documents.gisela-grid.eu/record/87?ln=en)

– Monitoring System (Nagios)

– Ticket System (GGUS)

– Accounting System (APEL)

– Middleware (gLite)

– Resource database (GOCDB)

– Operations Dashboard


Specificity: gLite <-> OurGrid interoperability

• Latin American context:– Large Universities (UFRJ, USP,…) in International collaborations thus

complying with the corresponding computing model and middlewares (gLite, OSG,..)

– Several small Universities naturally adopting the Desktop-based opportunistic Grid approach and using the OurGrid middleware


GISELA: an opportunity for VRCs


Platform for all kinds of Applications / VRCs

• VRC initial situation: – EELA-2 ended up supporting 61 Applications from 78 Institutions

• Emerging VRCs– Legacy: EELA-2 User Communities, typically 1-2 Institution group(s), largely located in Latin America,

alone or collaborating with a few Institutions.

– A few large VRCs from Life Sciences (e.g. WeNMR, Biomed), Earth Sciences (WRF4G, Seismic simulations) and HEP (Auger, LHC expts)

– More than 200 scientific contacts in LA e.g. CLARA surveyed communities

– Promising connection with Mexican Industry

– Others VRCs as from this meeting


Comprehensive framework for VRC support

LA Site running HEP, Life Sciences and Industry VRCs


Rich portfolio of new, well supported Services

• Broad range of services, covering both Application and Infrastructure support

• Examples of services for which support is available are:– Application-related Services

Job, Catalogue, File and Data Management• Digital archives, Secure storage, WatchDog, lcg-rec toolkit

– Infrastructure-related Services Support for opportunistic resources (OurGrid middleware) Support for infrastructure bridging (OurGrid and gLite) Support for Storage Accounting (SAGE)

– Data processing and distributed user analysis services DIRAC: workload and data management system


DIRAC as a complete VRC solution

• DIRAC is a complete VRC Grid solution

• Already used by several large VRCs:– HEP (LHCb, Belle, ILC, Magic)

– BIOMED(VIP)

• Development coordinated by CPPM (Marseille), a GISELA Partner

• Fully supported within WP6


Comprehensive VRC Training & Support (1)

Tailorable to VRCs needs


Adaptable to VRCs

Comprehensive VRC Training & Support (2)


Collaboration with EGI & Regional

projects • EGEE, EGI

– EGEE: Long, outstanding interaction (MoU) in collaboration with other related projects (EUMedGrid, EU-IndiaGrid, EUAsiaGrid, SEE-Grid-2, BalticGrid, BELIEF,..)

– EGI: Natural follow up of the EGEE cooperation Infrastructure Providers MoU, signed with EGI-eu Project MoU (Dissemination, Training, Support tools & Services), signed with

EGI-InSPIRE

• EGI-related projects / Regional Initiatives

– DEGISCO (UFCG-Brazil also partner) Volunteer computing support (gLite <-> OurGrid bridge)

– CHAIN (CLARA, INFN, CIEMAT also partners) (MoU under preparation) Focus on VRC support

– EPIKH (Brazil: CEFET/RJ, UFRJ, Chile: UTFSM, Mexico: UNAM) Joint sponsoring /organisation of Tutorials & Workshops (MoU signed)

– EU-IndiaGrid2 (MoU signed)


GISELA specific interests


GISELA interests

• Welcome international VRCs– A few large VRCs already on board such as from Life Sciences (e.g. WeNMR,

Biomed), Earth Sciences (WRF4G, Seismic simulations) and HEP (Auger, LHC experiments)

– Other production from (Academia Sinica), Astrophysics team (UFRJ-BR), Solid state physics team (UFRJ-BR)

– DoW: “GISELA is open to collaboration with institutions / projects, public or private, whose activities are compatible with its Objectives

Collaborate means using the GISELA infrastructure, submitting applications and benefiting from technical support

Terms of the collaboration to be discussed”

• Interest in VRCs collaborating with Latin America– GISELA is naturally (but not exclusively) looking for existing or foreseen

collaborations with Latin America

• Create emulation process in Latin America– Not enough intensive productions from LA VRCs– Wish to stimulate LA Institutions to move on from small tests to evaluate the Grid

technology to mass production as exemplified by the large VRCs.– Hope to stimulate new collaborations.


GISELA concerns


• GISELA <-> VRC: Simple, albeit efficient communication scheme

– At an early stage have a concise Technical document defining the characteristics of VO, Applications, WE, SE, batch queues, support aspects,…

– One point-to-point interface covering all matters (VO-related, training,...)

– Definition of a simple follow-up scheme, monitoring of activities based on standard tools (e.g. NAGIOS screen…)

GISELA concerns (1)


GISELA concerns (2)

• GISELA – EGI: Efficient cooperation via the User Community Support Team (UCST) and the User Communities Board (UCB):

– EGI-InSPIRE – GISELA Project MoU as instrument for VRC coordination:

“GISELA to provide EGI-InSPIRE for regular communication about active or potential VRCs

GISELA User Communities are able to search and discover related communities in Europe through the EGI User Community services

GISELA User Communities become connected to the EGI user communities working in the same discipline (the connection points will include UCB at the user level)

Connect the GISELA research groups with their local Resource Infrastructure Providers”

– From Monday 11th April Session: “User Support Services: Applications and Communities”

VO Services through VO Service Team

EGI Application data base with the possibility to include GISELA Applications.

NGI-based User Support (UCST) evolving towards VO-based support


• Common (RIPs – VRCs – EGI) dissemination / outreach activities – Common participation in UCST, UCB

– GISELA – e-ScienceTalk MoU (signed) as instrument of coordinated dissemination

Use channels as the GridCafé, GridCast, iSGTW and GridGuide

– Cross participation in Forum, Conferences,…

GISELA concerns (3)


Conclusions• GISELA:

• is much experienced in Grid computing (EELA, EELA-2)• has a powerful Infrastructure• complies with EGI policies & recommendations• provides a comprehensive DCI environment• collaborates with EGI related Initiatives e.g. VRC support• provides a platform for all kinds of Applications• offers a series of new, well-supported Services (e.g. DIRAC)• supports opportunistic computing (OurGrid)• ensures standard and customised VRC Training & Support

D.Carvalho(WP3): VRC Support

B.Marechal: The Boss

R.Diacovo

(WP4): Infrastructure Support

F.Brasileiro(WP6): New Services

A.Tsaregorodtsev (WP6): DIRAC

Ph.Gavillet(WP1): Deputy Boss

• Hence, don’t hesitate anymore to become a GISELA User

GISELA: A Resource Infrastructure Provider An opportunity for VRCs

Documents

Transcript of GISELA: A Resource Infrastructure Provider An opportunity for VRCs