Tony Doyle [email protected] GridPP2 Specification Process Grid Steering Committee Meeting,...

Tony [email protected]

“GridPP2 Specification Process” Grid Steering Committee Meeting, MRC, London, 18 February 2004

Tony Doyle - University of Glasgow

ContentsContents

• Context

• GridPP2 Posts Allocation

• Board Structure

• Deployment Board

• User Board

• Planning Status


3. Background…3. Background…A Year in the Life of GlobusA Year in the Life of Globus


2. Background… 2. Background… UK e-Science DevelopmentUK e-Science Development

1. The UK e-Science Production Grid will have significant overlap with the GridPP2 Production Grid – Mutual benefit to engagement– e.g. convergence talks organised prior to

Christmas– GT2-based approach

2. OMII developments will be based upon the Web Services Resource Framework– The OMII delivery timescales are in 2005 onwards– Incorporates e.g. OGSA-DAI – Limited overlap with our proposed programme


1. Background… 1. Background… LCG DevelopmentLCG Development

1. AliEn provided a pre-Grid implementation

2. ARDA provides a framework for PP application middleware – We can and should (and do)

participate here– Identify your development within

this structure


0. Background…0. Background…GridPP2 steps towards project spec. GridPP2 steps towards project spec.

0. PPARC Call (February 2003)1.GridPP2 Proposal (30/5/03)2. Feedback from Reviewers3. Responses from the PMB See http://www.gridpp.ac.uk/docs/gridpp2/

4. Projects Peer Review Panel (14-15/7/03)5. Grid Steering Committee (28-29/7/03)See http://www.gridpp.ac.uk/talks/GridPP_GSC_030728.ppt

6. Tender Document (11/11/03)See http://www.gridpp.ac.uk/cb/doc/GridPP2_Tender.doc7. Science Committee (17-18/11/03)8. PPARC (25/11/03)9. CB (4/12/03) 10.PRSC (16/1/04). PRSC summary11.PMB (26/1/04). Work area effort tables12. GridPP9 Collaboration Meeting (4-5/2/04)13. Grid Steering Committee Meeting (18/2/04)

2003 2004 2005 2006 2007 2008

Middleware Deployment Operations

ResourceProvider

UserCommunity

EDG

LCG

LCG

EGEE

EGEE

HEP/BIOMED/…

Prototype-1EDG 1.x

(GT2, Condor-G)

Prototype-2LCG-1 (EDG-2)

Prototype-3LCG-2 Releases

Production-1LCG-3

Production-2 Production-3

Migrate to OGSA/F. Follow GGF Standards


GridPP2 PostsGridPP2 Posts

• GridPP2 Approved - £15.9m plus a possible further £1m to LCG at CERN subject to strong case to Science Committee*– Essentially the so-called "Regained Programme"

• GridPP2 Tendering Process– Proforma-1s (Report on GridPP1 Work) received by 12

December• Assessed by PMB by 9 January• Currently feedback being sent to PIs by TD

– Proforma-2s (Specification of future work) available by 19 December

– Proforma-3s (Bids for posts) received by 9 January• Assessed by Peer Review Selection Committee (PRSC) on 16

January

*Planned for next PPARC committee meetings


PRSC Outcome and PRSC Outcome and Future TimelineFuture Timeline

• 33 Bids approved – subject to varying amounts of iteration on deliverables

• 4 Bids not yet approved– but should be - subject to successful renegotiation of

deliverables• 2 part bids to be re-tendered for one post (BaBar)• 7 bids rejected• 1 new post to be re-tendered for one post (Portal)• By 1 March

– DB to develop detailed Financial Plan (against which new PPARC grants can be signed off)

• After 1 March– iteration/discussion on Project Map deliverables

• Mid March to Mid April – JES Submission as soon as discussions complete

• Need to assess impact of ARDA, Metadata Group....


Patchwork Quilting Patchwork Quilting the GridPP2 HourGlassthe GridPP2 HourGlass

Tender Document Outcome

Tier-1 Tier-1

Applications Applications

Middle/Sec/NetMiddle/Sec/Net

Tier-2 Tier-2

+ 1 Portal+ 1 PhenoGrid

-0.5 BaBar

-1 LHC Deployment

+1 LHC Deployment-1 Network-0.5 Workload

-1 Data Management

+1 Data Management

III. Grid Middleware

e.g. Information Services

I. Experiment Layer

e.g. Portals

II. Application Middleware

e.g. Metadata

IV. Facilities and Fabrics

e.g. Storage Services


SysMan Experiments

Developers

Deployment

Board

User

Board

Dissemination

Team

Developer

Team

GridPP2 PMB GridPP2 PMB High Level ViewHigh Level View

Project Management

Board

(PMB)

Collaboration Board

(CB)

Production Grid Deployment

Board

(DB)

User Board

(UB)

Project Management

Board

(PMB)

Collaboration Board

(CB)

Production Grid Deployment

Board

(DB)

User Board

(UB)

“Opinion

Formers”

PMB


• The PMB is the central part of the management structure. • The Project Management Board meets approximately

weekly to:1. determine the detailed objectives of the project;

2. approve the allocation of resources to meet these objectives;

3. ensure timely progress is made towards meeting the objectives;

4. report on progress to the Oversight Committee;

5. inform the community of progress, formally via the Collaboration Board;

6. establish an identity for GridPP2 reflecting the set of GridPP deliverables;

7. ensure that GridPP2 is visible externally and is recognised

as a flagship project.

GridPP2 Project Management BoardGridPP2 Project Management Board Terms of Reference Terms of Reference


e.g. Information Services

I. Experiment Layer

e.g. Portals


e.g. Metadata


e.g. Storage Services

PMB

UserBoard

DeploymentBoard

PMB


SysMan

GridPP2 Deployment Board GridPP2 Deployment Board Terms of ReferenceTerms of Reference

• The Deployment Board is the body at which technical developments and problems wider than a single Working Group or Tier Centre are discussed and solved.

• The Deployment Board meets approximately quarterly to:1. determine and execute the technical project plan necessary to implement the strategy of

the Project Management Board on the deployment of a production quality grid for Particle Physics;

2. report to the Project Management Board, through its chair, on progress towards this goal;

3. ensure that problems and ideas with implications beyond individual working groups are discussed and solved in the most efficient manner;

4. provide a forum in which all constituent parts of the project can exchange information on technical issues of mutual interest;

5. manage the deployment of GridPP2 hardware resources in the UK, ensuring they are efficiently and effectively used to deliver the Particle Physics Grid with the minimum of duplication;

6. deal with matters of coordination and liaison between UK Tier1 and Tier2 centres;

7. ensure that technical developments elsewhere, particularly at CERN, are efficiently integrated into the project.

Deployment

Board


User

Board

Experiments

• The User Board ensures that the requirements for the major Particle Physics experiments that will use the Grid are properly taken into account in the strategy of the PMB.

• The User Board meets approximately quarterly to:1. ensure that the GridPP2 project remains science driven and that the

project develops to meet the needs of the UK Particle Physics community;

2. keep an overview of both technical and experimental software developments, ensuring these developments are compatible;

3. facilitate close working relationships between the UK experimental collaborations to identify common areas for the development of Grid-enabled experimental software;

4. overview the major hardware purchases within GridPP2 to ensure compatibility with the needs of the experimental collaborations and between collaborations;

5. promote the use of the developing Grid structures for a wide variety of computing needs in the whole of the UK Particle Physics community.

GridPP2 User Board Terms of ReferenceGridPP2 User Board Terms of Reference

I. Experiment Layer

e.g. Portals


e.g. Metadata


Deployment TeamDeployment Team

Grid Support Centre5 FTE

Core Grid Coordinator1 FTE

Security Officer

RAL

Data and Storage Management

Glasgow, Bristol, Edinburgh

VO Management and ServicesNorth (0.5 FTE)

Workload Management ServicesLondon

Network ManagementLondon (0.5 FTE)

MiddleWare Specialist Support6 FTE

2 Tier1 Deployment

4 Tier 2 UK Coordinators

LondonGrid,NorthGridScotGrid, SouthGrid

1 Tier2 CoordinatorIreland

Applications Expert

Deployment Team8 FTE Grid Operations Centre

Production Manager

EGEEGridPPJISCCore UK

Manager

Operations (2)

Technical Writer

Network Support

Helpdesk

Network Monitoring


In LCG In LCG ContextContext

Proposed Proposed StructureStructure

ARDA

Ex

pm

tsEG

EE LCG

Deployment Board

Tier1/Tier2,Testbeds,

Rollout

Servicespecification& provision

User Board

Requirements

ApplicationDevelopment

Userfeedback

Metadata

Workload

Network

Security

Info. Mon.

PMB

CB

Storage


ARDA

Expmts

EGEE

LCG

Dep

loym

ent

Bo

ard

Tie

r1/T

ier2

,T

estb

eds,

Ro

llou

t

Ser

vice

spec

ific

atio

n&

pro

visi

on

Use

r B

oar

d

Req

uir

emen

ts

Ap

plic

atio

nD

evel

op

men

t

Use

rfe

edb

ack

Met

adat

a

Wo

rklo

ad

Net

wo

rk

Sec

uri

ty

Info

. M

on

.

PM

B

Sto

rag

e


I. Experiment Layer



UserBoard

DeploymentBoard

GridPP2 Project GridPP2 Project Managing the MiddlewareManaging the Middleware


coherent coherent deploymentdeployment and and useuse

GridPP Middleware Workshop 4/5th March

To review:1. achievements and lessons

learned from GridPP participation in DataGrid

2. Proforma-2 planning in light of LCG/EGEE

3. short-term plans between end of DataGrid and the start of GridPP2

4. Transition of the TB/DB In context of WSRF and ARDA

Ongoing discussions within EB

To review: 1. transition of the EB/UB2. possible role of

“applications manager”3. job scheduling and

priority grid time 4. metadata system5. generic portal6. widening the ARDA

computing model beyond LCG?


GridPP2 PlanningGridPP2 Planning

• We will specify management/technical roles in advance of GridPP2 to ensure we are successful in developing/deploying the Production Grid

• By the end of this GridPP2 specification process we will be able to:– Continue the work started in GridPP1 (by many people)– Define the GridPP2 Project Map tasks and metrics– Appoint additional people in recognised areas to contribute to

agreed tasks/roles– Contribute fully to EGEE/LCG– Start to go from Prototype to Production

• Anticipate new management/technical posts and holders are defined before GridPP10 meeting at CERN in June

Tony Doyle [email protected] GridPP2 Specification Process Grid Steering Committee Meeting,...

Documents

Transcript of Tony Doyle [email protected] GridPP2 Specification Process Grid Steering Committee Meeting,...