Grid INFN virtual Laboratory for Dissemination Activities

47
EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi Grid INFN virtual Laboratory for Dissemination Activities Leandro Neumann Ciuffo [email protected] INFN-Catania - Italy

description

 

Transcript of Grid INFN virtual Laboratory for Dissemination Activities

Page 1: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Grid INFN virtual Laboratory for Dissemination Activities

Leandro Neumann Ciuffo

[email protected]

INFN-Catania - Italy

Page 2: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

• Introduction• Figures• How to join GILDA• How to access GILDA• User assistance• Demonstrative Applications• Tutorial layout• Summary and conclusions

Outline

Page 3: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Introduction

Bogotá, Colombia

Page 4: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Getting started

• GILDA is a complete Grid test-bed

• GILDA is an international effort funded by multiple sources

• Demonstrate/disseminate grid computing

• Adopted by several Grid projects worldwide

• It runs the latest version of the gLite middleware

• Using GILDA is free of charge

Page 5: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Why t-Infrastructure?

• Avoid disruption of production systems of Grid projects

• Users can practice prior to run their codes on the production e-Infrastructures

• Prepare users for future middleware releases

• Easy entry point for new users/communities

Page 6: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

The GILDA Project – web portal

https://gilda.ct.infn.it

Page 7: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

General grid services available on GILDA

MIDDLEWARE VERSION:

gLite 3.1

Page 8: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Interoperable with other middlewares

Super UI

Condor OMII-UK Globus gLite UNICORE

Condor OMII-UK Globus gLite UNICORE

Super CE

Single

Authorization

Framework

Page 9: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Figures

Beijing, China

Page 10: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Figures (1)

• Used in more than 300 tutorials in 52 countries– From 2004 onwards

Page 11: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Figures (2)

• More than 10000 certificates issued to users• ~30% renewed at least once

Page 12: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Test-bed

• Current test-bed (best effort maintenance)– 5 Grid sites– 148 CPUs– 455 TB of disk storage

• GILDA is “bookable on-demand” and “clonable on-demand”– Several GILDA-like insfrastructures are often created and last for a

short period of time

Page 13: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to join GILDA

Istanbul, Turkey

Page 14: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to join GILDA (1)

• Step 1: Head to the GILDA CA website https://gilda.ct.infn.it/CA/

CERTIFICATION

AUTHORITYGILDA

Don’t panic!

continue anyway / add an exception

Page 15: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to join GILDA (2)

• Step 2: Download the GILDA CA certificate

CERTIFICATION

AUTHORITYGILDA

Page 16: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to join GILDA (3)

• Step 3: Ask for a GILDA personal certificate

– Wait a couple of days. You will receive an e-mail from the GILDA CA with the URL from where you can download your GILDA Personal Certificate.

– You MUST always use the same computer and web browser you used to request your GILDA personal certificate.

Page 17: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to join GILDA (4)

• Step 4: Install your GILDA Personal Certificate in your web browser (Just follow the instructions you will receive in your e-mail).

Page 18: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to join GILDA (5)

• Step 5: Accept the GILDA Use Policy:https://gilda.ct.infn.it/aup.php

Page 19: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to join GILDA (6)

• Step 6: Register with the GILDA Virtual Organization (VO) :https://gilda.ct.infn.it/vo.html

Page 20: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to join GILDA - help yourself

Clear instructions for diffe

rent kinds of

learners (users, sysadmins) about

how to access the t-Infrastructure.

Page 21: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to access GILDA

Prague, Czech Republic

Page 22: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to access GILDA (1/5)

1. Connecting to the GILDA User Interface via SSHglite-tutor.ct.infn.it / glite-tutor2.ct.infn.it

Page 23: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to access GILDA (2/5)

2. Login in to the Grid Tutor portalhttps://glite-tutor2.ct.infn.it

Page 24: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to access GILDA (3/5)

3. Using the Grid2Win user interfacehttp://grid2win.forge.eu-eela.eu

Page 25: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to access GILDA (4/5)

4. Installing the User Interfaces Plug & Play https://gilda.ct.infn.it/UIPnP.html• compliant with Scientific Linux 4.5/6 and Fedora Core 8

[lciuffo@myPc]$ voms-proxy-init --voms gildaEnter GRID pass phrase:Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN/CN=Leandro CiuffoCreating temporary proxy ........................................................ DoneContacting voms.ct.infn.it:15001 [/C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it] "gilda" DoneCreating proxy ................................................... DoneYour proxy is valid until Tue Nov 4 03:44:14 2008

Page 26: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

How to access GILDA (5/5)

5. Installing the User Interface Virtual Machine https://gilda.ct.infn.it/VirtualServices.html• VMware player required

(free downloadable from www.vmware.com/products/player)

Page 27: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

User assistance

La Plata, Argentina

Page 28: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

User Assistance

• Training material– Wiki page– Video tutorials– Step by step instructions

• Support system • GILDA Forge

Page 29: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Support System

• http://gilda-support.ct.infn.it– Create a ticket under the category "Grid User Environment"

– Indicate the IP number(s) from where you would like to ssh to glite-tutor2.ct.infn.it User Interface

Page 30: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Wiki pages

+90 topics (usage instructions, grid services installation and

management, application development) with plenty of

exercises. Three levels of difficulty:

Basic, Medium, and Advanced

Page 31: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Demonstrative Applications

Madrid, Spain

Page 32: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

“Virtuous cycle” of applications on GILDA

Dissemination Training events

“Gridification”Deployment on large

Infrastructures and inclusion in the portfolio

of demonstrative applications

Page 33: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Applications: RASTER-3D

• Set of tools for generating high quality raster images of molecules

Page 34: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Applications: Volcano Sonification

(Picture: M. Monzier IRD/IG-EPN)(Picture: g1.globo.com)

Etna, Italy Tungurahua, Ecuador

• “Sonified” data from geophysical data collected by digital seismographs placed on volcanoes.

Page 35: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Applications: Volcano Sonification

• Seismograms Melodisation

5s = 20h processing in a simple PC

Page 36: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Applications: hadronTherapy

• Employed for the treatment of some kind of ocular tumours• Used to calibrate the proton beam line in reality

Page 37: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Applications: DEMTOOLs

• Satellite image rendering program• Input: ASCII file in DEM format (Digital Elevation Model) • Output: VRML file

Page 38: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Tutorial layout

Kuala Lumpur, Malaysia

Page 39: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Standard tutorial layout

User Interface

BDIIInformation System

Worker nodes

Worker nodes

CEComputing

Elements

VOMS

GILDA t-Infrastructure

laptops

LFCFile catalogue

WMSResource Broker

ssh

SE

Storage Elements

local Infrastructure

Page 40: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

This room layout

malawi03 malawi04 malawi05 malawi06

User Credentials:

Username: malawiXXPassword: GridMALXX(where XX in [01..30])

Grid Passphrase: MALAWI

malawi07 malawi08

malawi11 malawi12 malawi13 malawi14 malawi15 malawi16malawi09 malawi10

malawi17 malawi18

malawi01 malawi02

Page 41: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Conclusions

Cairo, Egypt

Page 42: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Summary and Conclusions (1/2)

• GILDA is a "de facto" standard t-Infrastructure adopted by several EU-FP6 and FP7 projects;

• It is a complete suite of grid elements (test-bed, CA, VO,

monitoring system, web portal, user interfaces, support system) and applications fully dedicated to dissemination purposes and pre-porting of new applications to EGEE-like Infrastructures;

• It is also a digital inclusion tool by helping to spread Grid Computing knowledge around the world.

Page 43: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Summary and Conclusions (2/2)

• GILDA and Africa– African scientific communities can use GILDA to “gridify” and run

applications of local interest;

– Institutions can setup “clones” of GILDA locally to implement campus grids or even nation-wide e-infrastructures (we are already doing so in South Africa and Cuba);

– GILDA can offer free technical support for anyone willing to organize local training events on Grid computing

• It can be undergraduate courses, M.Sc courses, tutorials, Grid Schools etc.

Page 44: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Request a Tutorial

https://gilda.ct.infn.it

Page 45: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Events curricula

• Customized training events: from 1 day tutorial to 2 weeks Grid School

• Can be done without outside internet connection

Mérida, Venezuela Cairo, Egypt

Catania, ItalyBeijing, China

Page 46: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Bookmarks

• GILDA home page– https://gilda.ct.infn.it

• GILDA Support System– http://gilda-support.ct.infn.it

• GILDA Form for tutorial bookings– http://gilda-support.ct.infn.it

• GILDA Repository of Training Material– https://grid.ct.infn.it/twiki/bin/view/GILDA/WebHome

• ICEAGE Library– http://www.iceage-eu.org/library

• GILDA Virtual Services– https://gilda.ct.infn.it/VirtualServices.html

Page 47: Grid INFN virtual Laboratory for Dissemination Activities

EELA-2 Workshop – Grid Computing EU 6th International Conference on Open Access, Lilongwe, Malawi

Thank you! - Q&A

Lilongwe, Malawi