A E G I S

11 December 2008

Grid servisi prilagoGrid servisi prilagođđeni korisnicima i eni korisnicima i digitalni identitet istradigitalni identitet istražživaivaččaa

Services oriented towards grid users Services oriented towards grid users and researchers' digital identityand researchers' digital identity

Branko Marović, Marina Vermezović

Belgrade University Computing Center, Serbia

branko@rcub.bg.ac.rs

A E G I S

11 December 2008

e-Science infrastructure National level

GridPP– UK, particle physicists

D-Grid INFN Grid - Italy AustrianGrid OSG – US Open

Science Grid AEGIS …

Regional SEE-GRID BalticGrid NorduGrid …

European level EGEE Deisa - HPC …

Worldwide WLCG - Worldwide LHC

Computing Grid …

A E G I S

11 December 2008

Grid market

A E G I S

11 December 2008

The reality for the user Many application domains start using

Grid infrastructures But…

Grid technology is complex Different systems are used

Middleware (Unicore, gLite, Globus) Installation (rpm, tar, Quattor, …) Monitoring

Different programming paradigms Batch type systems vs. service oriented systems Many programming languages

The threshold is too high for the “standard” user!

Grid project

StorageStorage

Resource BrokerResource Broker Replica ManagerReplica Manager

PoliciesPoliciesInfrastructureProvidersInfrastructureProviders

Service ProvidersService Providers

RolesRolesMembersMembers

VirtualOrganisationsVirtualOrganisations

WorkflowsWorkflows

Programming languages

Programming languages

Domain servicesDomain services

InfrastructureInfrastructure

ComputingComputing

ApplicationsApplications

Batch appsBatch apps

Web servicesWeb services

Interactive appsInteractive apps

Grid projectGrid project

A. Gap.

(Grid) Middleware

User Applications

Resources

Resource Providers

Application Developers

Application Users

User Applications using Grid

Grid Applications

A E G I S

11 December 2008

Barriers to adoption Gap between the resource providers and

the application developers Infrastructure perspective - not a user

perspective Grid applications instead of User

applications that use a Grid

Tooling is necessary! Wizards, Editors, … Hide the complexity Agile and Rapid development Rapid assembly of content and functionality Stable, Open 3rd party Familiar and reliable abstraction

Grid Web portals do not fulfill all above requrements

A E G I S

11 December 2008

Can we learn from others?

Are there other distributed systems supported by different middleware systems? J2EE Web services

Based on specifications Implemented by different Vendors

Customers don’t want to be vendor dependent Use a generic middleware independent

development tools Use vendor neutral APIs

A E G I S

11 December 2008

Grid and SOA Web

Perpetual Beta Cloud content and functionality Services, standards, protocols, .. Mash-ups: wikis, blogs, communities, Google Earth

Service Oriented Architectures and Web Service Loose coupling Directly and immediately useable Deliver high level services to the user Facilitate automation & advanced functionality.

Grid and Services OGSA - Open Grid Service Architecture Better abstractions Loose coupling - there are still grids stacks “gLite is a collection of web services”

Development platforms Lightweight programming models Front end simple API access to data and jobs Standard interfaces

A E G I S

11 December 2008

The g-Eclipse projectEC STREP, 24 months, 2 M€, 6 Partnershttp://www.geclipse.eu Eclipse based framework for other EC Grid

projects and Using EGEE infrastructure Middlewares

gLite GRIA Amazon cloud Webservices (AWS): Elastic Compute

Cloud (EC2), the Simple, Storage Service (S3), SimpleDB and the Simple QueueService (SQS)

UNICORE, Globus Toolkit? Open for contributions - integration support for

third party developments Fostering an open source project within the

Eclipse community

Screenshots I Grid project view

Glue Info view

Editor

VOMS Web view

Cheat Sheets

Auth Token View

A E G I S

11 December 2008

Grid debugging

A E G I S

11 December 2008

GumTree ISEE Integrated Scientific Experiment Environment

concept Single virtual environment for users to access all

aspect of a scientific experiment Consistent look & feel reduce user error / support Centralised control to a complex system Application level data flow between different

domains

The basic Eclipse workbench provides Tomcat based Help System Cheatsheets Online Update Manager Wizard API Abstract File System Text Editor Built-in Browser ActiveX / OLE (win32 only) Application Scripting Graphical Editing Framework

A E G I S

11 December 2008

TeraGrid Science Gateways

Desktop application

Web portal Grid-bridging

gateway

SecuritySecurity Data Management

Service

Data ManagementService

AccountingService

AccountingService

Notification ServiceNotification Service

PolicyPolicy

Administration& Monitoring

Administration& Monitoring

Grid OrchestrationGrid OrchestrationResource

Allocation

ResourceAllocation

Reservations And Scheduling

Reservations And Scheduling

TeraGrid Gateway Services

Web Services Resource Framework – Web Services Notification

Grid Portal Server

Grid Portal Server

Physical Resource Layer

Core Grid Services

Proxy CertificateServer / vault

Proxy CertificateServer / vault

Application EventsApplication Events

Resource BrokerResource Broker

User MetadataCatalog

User MetadataCatalog

Replica MgmtReplica Mgmt

ApplicationWorkflow

ApplicationWorkflow

App. Resourcecatalogs

App. Resourcecatalogs

ApplicationDeployment

ApplicationDeployment

Courtesy Jay Boisseau

Users Desktop

A E G I S

11 December 2008

DGI D-Grid Middleware Infrastructure

Generic Grid infrastructure for German research communities

Nutzer

ApplicationDevelopment

and User Access

GAT API

Data/Software

Resourcesin D-Grid

High-levelGrid

Services

Basic Grid Services

DistributedData Archive

User

NetworkInfrastructur

LCG/gLite

Globus 4.0.1

AccountingBilling

User/VO-Mngt

SchedulingWorkflow Management

Data management

Security

Plug-In

UNICORE

DistributedCompute Resources

GridSphere

Monitoring

A E G I S

11 December 2008

SEEGRID-SCI JRA1 Capture commonalities across scientific fields in terms of application

requirements on Grid middleware Define development areas for middleware plug-ins and application-level

services to cater to application demands and provide improvements to current infrastructure services

Implement application-specific services and middleware extensions Coordinated by .RS partner

AS

Application

AW

T

DM

-Web

ES

IP

Even

t Log

ger

FM

-J-A

PI

MEW

S

P-G

RA

DE

Port

al

RA

S

SD

SA

S

UP

M

Work

B

ind

er

Tota

l

CHERS 4 4 10 4 4 4 10 10 0 4 4 58 ELF 10 0 0 0 0 0 0 0 30 0 0 40 FPS 4 0 0 0 0 0 0 0 30 0 0 34 GreenView 4 10 30 4 10 4 4 0 4 4 4 78 Lizza-PAKP 4 4 4 4 10 4 4 0 0 10 30 74 MCSAES 0 0 0 4 0 0 0 0 0 30 0 34 MDSSP-WA 10 0 0 4 4 4 4 4 30 4 4 68 MSACM 0 30 0 0 0 0 0 0 0 30 0 60 MSERRHSA 0 0 0 4 0 4 0 0 0 30 0 38 NMMC3D 0 0 0 4 0 0 30 0 0 0 0 34 REFS 0 10 0 4 0 0 4 4 0 4 4 30 RESEWA 4 4 0 10 0 4 4 4 0 10 4 44 SDS 0 4 0 0 4 0 0 0 30 0 0 38 SRA 4 0 0 4 0 4 10 0 30 0 0 52 WRF-ARW 4 0 0 0 4 0 4 10 0 10 10 42 Total 48 66 44 46 36 28 74 32 154 136 60

A E G I S

11 December 2008

AMRES AAI and IdMAMRES AAI and IdM Academic Network of Serbia (AMRES) has

moved its focal point of interest from infrastructure to user services development

Operation of several attractive services relies on AAI (Authentication & Authorisation Infrastructure) and reliable Identity Management as its core part

Current situation AEGIS CA for AEGIS Grid community in

operation since 2007 IdP and IdM (identity providing and

management) decentralized between four AMRES service centers

All service centers already have AAA in different levels of development

Belgrade University service center has largest end-user community

AEGIS 2008 Annual Assembly

A E G I S

11 December 2008

Vision of AMRES AAI Establish IdM in AMRES Belgrade

University (BU) service centre Share experiences and gained knowledge

with other service centres Establish federation policies between

AMRES service centers Current efforts

Reliable and accurate database of AMRES users

Make this process as automatic as possible AAA federation between AMRES service

centers Deploy AMRES CA Join eduroam infrastructure

Later Full decentralization of AAI Many services using AMRES AAI

A E G I S

11 December 2008

Deployment of AMRES CA Development of several user services

depends on AAI and certification authority

Only CA that is being used among AMRES user community is AEGIS CA deployed for Grid users and infrastructure

Good practice is not to use GRID CA, but to deploy AMRES dedicated CA

AEGIS CA policies will probably be more restrictive than those in AMRES CA AMRES certificates could be accepted by

AEGIS infrastructure AEGIS certificates could be accepted by

AMRES services

A E G I S

11 December 2008

AMRES and eduroam One of motivation factors for establishing AAI in

AMRES is to become equal member of GN3 community

The European eduroam Service Activity (SA) is a GN2 service, launched in September 2007

eduroam (EDUcation ROAMing) is the roaming infrastructure used by the international research and education community

eduroam paradigm: open your laptop and be online

Being part of eduroam allows users to access a wireless network at a visited institution simply using the same credentials the users would use if they were at their home institution