CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting...

31
HEP 2000, 10.02.2000 Roberto Barber Roberto Barbera (*) GENIUS: a Web Portal for the GRID ing Grid.it, Bologna, 14.02.2003 work in collaboration with A. Falzone and A. Rodoli Dipartimento di Fisica dell’Università di Catania and INFN Catania - Ital DataGRID Project

Transcript of CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting...

Page 1: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

CHEP 2000, 10.02.2000 Roberto Barbera

Roberto Barbera(*)

GENIUS: a Web Portal for the GRID

Meeting Grid.it, Bologna, 14.02.2003

(*)work in collaboration with A. Falzone and A. Rodolico

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Page 2: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Job Submission work-flow

UIJDL

Logging &Logging &Book-keepingBook-keeping

ResourceResourceBrokerBroker

Job SubmissionJob SubmissionServiceService

StorageStorageElementElement

ComputeComputeElementElement

Information Information ServiceService

Job Status

ReplicaReplicaCatalogueCatalogue

DataSets info

Author.&Authen.

Job S

ub

mit

Even

t

Job

Qu

ery

Job

Stat

us

Input “sandbox”

Input “sandbox” + Broker InfoGlobus RSL

Output “sandbox”

Output “sandbox”

Job Status

Pu

blis

h

grid

-pro

xy-in

it

Exp

and

ed J

DL

SE & CE info

Roberto BarberaMeeting Grid.it, Bologna, 14.02.2003

Page 3: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

EDG m/w has been released but…EDG software (Globus, UI, JDL, WP2, WP3, etc.) contains tens of commands/switches which also have their own logical sequences (“B” after “A”, “C” before “D” and so on).

Browsing Grid VO “directories” (users, RC’s, DB’s, etc.) requires LDAP “speaking” and tomorrow could require SQL “speaking”.

“User gridification” is a tough task for a “rookie” this does not fit with the claim that “grids” are for everybody and that grid computing will be as easy as surfing the Internet ?

Furthermore, all this holds for DataGrid. What will happen when other grids’ software (especially UI’s) will come up (PPDG, iVDGL, etc.) ? Will users have to learn tens of “grid dialects” ?

Today “grid computing” is a rather complicated experience only possible at selected machines (UI’s) this does not fit with the claim that one could do “grid computing” even from a PDA ?

Is there any way to set-up a “user-friendly” grid ?

Prague, 12.12.2002

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Roberto BarberaMeeting Grid.it, Bologna, 14.02.2003

Page 4: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

A web portal: why and how ?It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, WAP phone).It can keep the same user interface to several back-ends (grid “dialects” command-line UI’s).It must be redundantly “secure” at all levels: 1) secure for web transactions, 2) secure for user credentials, 3) secure for user authentication, 4) secure at VO level.All available grid services must be incorporated in a logic way, just “one mouse click away”.Its layout must be easily understandable and user friendly.

Prague, 12.12.2002

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Roberto BarberaMeeting Grid.it, Bologna, 14.02.2003

Page 5: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

GENIUS®

(Grid Enabled web eNvironment for

site Independent User job Submission)

[https://genius.ct.infn.it]

INFN/NICE collaboration

OS & Net services

Basic Services

High level GRID middleware

ALICE ATLAS CMS LHCbApplications’specific layer

Other apps

GLOBUS

toolkit

DataGRID architectur

e

GENIUS web portal

Prague, 12.12.2002

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Meeting Grid.it, Bologna, 14.02.2003

Page 6: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

GENIUS: how it works

Apache

EnginFrame

GENIUShttps+java/xml+rfb

WEB Browser

EDGUI

Local

WS

the GridEDG+GSI

3-tier model

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Roberto Barbera

Page 7: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

New grid authentication “à la MyProxy”

EDGUI

Local

WS

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Roberto Barbera

MyProxy

Server

GENIUS

Server(EDG

UI)

grid-proxy-initmyproxy-init

any grid service

myproxy-get-delegatio

n

output

the Grid

execution

WEB Browser

Page 8: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

GENIUS show: the main page

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Page 9: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

GENIUS show: the authentication

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Page 10: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

GENIUS show: file services

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Page 11: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

GENIUS show: the authentication

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

New MyPro

xy authentic

ation !

Page 12: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

GENIUS show: job submission

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Page 13: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

GENIUS show: job queue

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Page 14: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

GENIUS show: job output

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Page 15: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

GENIUS show: job data

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Page 16: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

GENIUS show: personal spooler

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Page 17: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

GENIUS show: interactive analysis

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Page 18: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.
Page 19: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.
Page 20: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.
Page 21: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.
Page 22: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.
Page 23: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.
Page 24: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.
Page 25: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.
Page 26: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.
Page 27: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.
Page 28: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.
Page 29: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.
Page 30: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

Present status and perspectivesCurrent implementation of GENIUS already includes: secure web transactions, user authentication and

authorization; Grid authentication “à la MyProxy” ! remote interaction with the user’s and “grid” file system; interfaces for job submission/control, data

management, VO servers, and to monitoring systems; Several Resource Brokers available; persistent (user’s) book-keeping and spooler system; secure interactive analysis with TightVNC ! CVS available !

Todo: web-guided creation of a job (soon !). multi-jobs (parallel and sequential); more application-specific customizations;

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Roberto BarberaMeeting Grid.it, Bologna, 14.02.2003

Page 31: CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

Roberto Barbera

GENIUS installation and contributionSend an email to [email protected] and/or [email protected] to get an account on the GENIUS CVS server;Checkout GENIUS from its CVS server;Ask your CA for a server certificate for the EDG UI on which you want to install GENIUSSend an email to [email protected] to get a free EnginFrame license;Install and start GENIUS as described on the reference site https://genius.ct.infn.it;New Virtual Organizations can easily be added to GENIUS and developpers of new applications can contribute to the portal code in a straightforward way;Due to its modularity, GENIUS can also be interfaced with new Resource Brokers or any other grid services.

Prague, 12.12.2002

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

DataGRID Project

Roberto BarberaMeeting Grid.it, Bologna, 14.02.2003