CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003...

41
HEP 2000, 10.02.2000 Roberto Barber Roberto Barbera The AliEn GENIUS interface CE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project work in collaboration with A. Falzone and A. Rodoli

Transcript of CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003...

Page 1: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

CHEP 2000, 10.02.2000 Roberto Barbera

Roberto Barbera

The AliEn GENIUS interface

ALICE Offline Week, CERN, 10.03.2003

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

(*)work in collaboration with A. Falzone and A. Rodolico

Page 2: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

Outline

Introduction

Grid portal architecture and requirements

GENIUS: current status and supported applications

GENIUS – AliEn interface (live demo!)

Future developments

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

ALICE Offline Week, CERN, 10.03.2003

Page 3: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

DataGrid job submission work-flowReplicaReplicaCatalogueCatalogue

UIJDL

Logging &Logging &Book-keepingBook-keeping

ResourceResourceBrokerBroker

Job SubmissionJob SubmissionServiceService

StorageStorageElementElement

ComputeComputeElementElement

Information Information ServiceService

Job Status

DataSets info

Author.&Authen.

Job S

ub

mit

Even

t

Job

Qu

ery

Job

Stat

us

Input “sandbox”

Input “sandbox” + Broker InfoGlobus RSL

Output “sandbox”

Output “sandbox”

Job Status

Pu

blis

h

grid

-pro

xy-in

it

Exp

and

ed J

DL

SE & CE info

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Roberto Barbera

Page 4: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

localdisk

StorageStorageElementElement

StorageStorageElementElement

StorageStorageElementElement

ReplicaReplicaCatalogueCatalogue

UIdisk

ResourceResourceBrokerBroker

ComputeComputeElementElement

ComputeComputeElementElement

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Grid transparent access VOVO

colleagecolleage

VOVOcolleagecolleage

Page 5: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

GENIUS®

(Grid Enabled web eNvironment for

site Independent User job Submission)

[https://genius.ct.infn.it]

INFN/NICE collaboration

OS & Net services

Basic Services

High level GRID middleware

ALICE ATLAS CMS LHCbApplications’specific layer

Other apps

GLOBUS

toolkit

DataGRID architectur

e

GENIUS web portal

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

ALICE Offline Week, CERN, 10.03.2003

Page 6: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

GENIUS: how it works

Apache

EnginFrame

GENIUShttps+java/xml+rfb

WEB Browser

EDGUI

Local

WS

the GridEDG+GSI

3-tier model

Roberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Page 7: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

GENIUS show: grid authentication

MyProxy auth

enticatio

n !

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Page 8: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

Grid authentication with MyProxy

EDGUI

Local

WS

Roberto Barbera

MyProxy

Server

GENIUS

Server(EDG

UI)

grid-proxy-initmyproxy-init

any grid service

myproxy-get-delegatio

n

output

the Grid

execution

WEB Browser

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Page 9: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

GENIUS/AFS interface (BaBar)

Page 10: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

GENIUS: remote file browser

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Page 11: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

GENIUS: VO Selection

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Page 12: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

GENIUS: RB Selection

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Page 13: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

GENIUS: RLS Selection

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Page 14: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Graphic job description (1)

In c

oll

abo

rati

on

wit

h D

AT

AM

AT

, It

aly

Page 15: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

Graphic job description (2)

In c

oll

abo

rati

on

wit

h D

AT

AM

AT

, It

aly

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Page 16: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

GENIUS multi-jobs (1)

Page 17: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

GENIUS multi-jobs (2)

Page 18: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

GENIUS: file browsing (1)

Page 19: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

GENIUS: file browsing (2)

Page 20: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

GENIUS: file replication

Page 21: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

GENIUS: testbed navigation

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Page 22: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

GENIUS: P2P services

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Page 23: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

GENIUS: GridICE monitoring

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Page 24: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

GENIUS: PDA version (1)Home Page

ServicesRemote filebrowsing Remote file

inspection

ALICE Offline Week, CERN, 10.03.2003

Page 25: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

GENIUS: PDA version (2)

GridICEintegration

RC browsing

Job monitoring

Job submission

ALICE Offline Week, CERN, 10.03.2003

Page 26: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

GENIUS: PHONE version

ALICE Offline Week, CERN, 10.03.2003

Page 27: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Interactive analysis (via TightVNC)

Exported by NICE

to FERRARI Motors

Page 28: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

CMS: CMSprod configuration

Page 29: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

CMS: GENIUS/Boss interface

Page 30: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

BaBar: multi-job submission

Page 31: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

BaBar: multi-job queue

Page 32: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

GENIUS app.: Earth Ob. app.

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Page 33: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

GENIUS app.: 3D rendering

Page 34: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

GENIUS: L-QCD integration

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Page 35: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

Present statusCurrent implementation of GENIUS includes more than 100 services. Among them: grid authentication with MyProxy ! several Resource Brokers, VO’s and RLS available; full support for “interactive” and “parallel” multi-jobs web guided job description, submission and

monitoring (in collaboration with DATAMAT) P2P services added PDA version available (runs also on last generation

cellular phones, e.g. Sony Ericsson P800 and Nokia 3650)

Transparently compliant with EDG2b, LCG1/2 and Grid.it middlewares/VO’s

Interfaced to many generic applications and to the CMS and BaBar grid environments

Roberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

ALICE Offline Week, CERN, 10.03.2003

Page 36: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

GENIUS and AliEn

ALICE Offline Week, CERN, 10.03.2003

Page 37: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

GENIUS has been targeted as the grid portal for EGEE NA2 (dissemination/tutorials) and NA4 (generic applications) activities:Graphic creation/publication of new services Integration of VOMS/VOX and DGAS tools for AAACustomized version for the GILDA dissemination

test-bed (http://gilda.ct.infn.it) Integration with GAT from GridLab (in the context of

EGEE NA4/NA5) for graphic description of DAGsClose look at the technology of portlets as

containers of grid services (see how to match them with GENIUS services)

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

Future devel. and activities

ALICE Offline Week, CERN, 10.03.2003

Page 38: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto Barbera

Future dev.: GENIUS-VOMS integration

VOMSServer

Local

WS

Roberto Barbera

MyProxy

Server

GENIUS

Server(EDG

UI)

any grid service

myproxy-get-delegatio

n

output

the Grid

execution

WEB Browser

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

edg-voms-proxy-init

Page 39: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

GENIUS and GAT

Page 40: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Q: I want to use GENIUS. Do I have to pay for it ?A: No. GENIUS is “open source” and the underlying portal framework EnginFrame is freefree for education and research communities.Q: I want to use GENIUS. Do I need any software running on my laptop ?A: No client software needs to be installed apart from the web browser. GENIUS can really be accessed from everywhere.Q: Do I have to be afraid about cached password sent over the web ?A: Access passwords are securely “streamed” only when needed and then destroyed. Only temporary sessions are possible.Q: Can new authentication methods implemented into GENIUS ?A: Of course. Kerberos V is a good example. EnginFrame is compliant with Kerberos authentication and GENIUS with AFS.

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

FAQ’s…and answers (1)

Page 41: CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

Roberto BarberaRoberto Barbera

Università di Catania and INFN Catania - Italy

ALICE Collaboration and DataGrid Project

FAQ’s…and answers (2)Q: I want to add a new VO to GENIUS and customize new services for that VO. How can I do that ?A: A new VO can be added to GENIUS in just minutes. New VO specific services can be added just modifying only two files: an XML file and a shell script.Q: Can I use GENIUS to interface other m/w’s ?A: Yes. Although GENIUS is currently based on the DataGrid middleware(w/ and w/o GLUE extensions), it can be very easily interfaced to others. A direct interface to the Globus Toolkit already exists and another one to Condor is in progress.Q: How can I start downloading/using GENIUS ?A: Go to the reference site https://genius.ct.infn.it, click on “GENIUS CVS available” and follow the instructions.

ALICE Offline Week, CERN, 10.03.2003