28 March 2001F Harris LHCb Software Week1 Overview of GGF1 (Global Grid Forum) and Datagrid meeting,...

28 March 2001 F Harris LHCb Software Week 1

Overview of GGF1 (Global Grid Forum) and Datagrid meeting,

NIKHEF, Mar 5-9

http://www.globalgridforum.nl/

F Harris(Oxford)


Overview of presentation

• Programme and purpose of meetings

• Summary of WP8 (HEP applications) reaction

• Some specific LHCb reaction

• Actions arising out of meeting - the LHCb programme of work


Programme and Purpose of meetings

• GGF1 (Mar 5-7)– First in sequence of ‘global’ meetings -US and Europe coming

together. Origins in US.

– Attendance ~ 400

– Working groups to develope GRID Services and Applications

– Tutorials (Globus, Advanced XML etc.)

• Datagrid (Mar 7-9)

– First meeting since contract start Jan 1,2001

– Attendance ~200; LHCb~12 - Nikhef,UK,Fr, It,CERN

– Working groups on middleware,testbeds, networking,applications


The Grid from a Services View

:

:E.g.,

Applications

Resource-specific implementations of basic servicesE.g., Transport protocols, name servers, differentiated services, CPU schedulers, public keyinfrastructure, site accounting, directory service, OS bypass

Resource-independent and application-independent services authentication, authorization, resource location, resource allocation, events, accounting,

remote data access, information, policy, fault detection

DistributedComputing

Toolkit

Grid Fabric(Resources)

Grid Services(Middleware)

ApplicationToolkits

Data-Intensive

ApplicationsToolkit

CollaborativeApplications

Toolkit

RemoteVisualizationApplications

Toolkit

ProblemSolving

ApplicationsToolkit

RemoteInstrumentation

ApplicationsToolkit

Applications Chemistry

Biology

Cosmology

High Energy Physics

Environment


Five Emerging Models of Networked Computing From The Grid

• Distributed supercomputing

– synchronous processing

• High-Throughput Computing

– large scale asynchronous processing

• On-Demand Computing (and interactive)

– dynamic resources

• Data-Intensive Computing

– databases

• Collaborative Computing (sharing)

– scientists

• Last 4 models apply to HEP


Reminder of WP8 aims, and the LHCb rolehttp://datagrid-wp8.web.cern.ch/DataGrid-WP8/

• Interfacing HEP applications to GRID, and developing the applications to take advantage of GRID

• Year 1 milestones

– end June Planning doc ‘ Requirements for GRID services ’

– end Dec Report on Run 0 with M9 release

• Activity in several institutes (e.g interfacing MC production to GRID; thinking about analysis model and data management)


Relationship of applications to GRID Architecture Group

HEP application

s

EO application

s

Biology application

s

TWGI.Augustin(Chair, CERN)C.Charlot (CNRS)A.Tricomi (INFN)K.Bos (NIKHEF)D.Newbold (PPARC)P.Cerello (ALICE)C.Tull (ATLAS)A.Sciabà (CMS)E.VanHerwijnen(LHCb)D.Brugnoni (WP9)R.Medina (WP10)

ATF


The multi-layer hourglass

OS & Net services

Bag of Services (GLOBUS)

DataGRID middleware

PPDG, GriPhyn, EuroGRID

HEPVO common application layer

Earth Obs. Biology

ALICE ATLAS CMS LHCb

Specific application layer WP9 WP 10

GLOBUS team

DataGRID ATF

WP8-9-10 TWG


Status of WP 8-10 use case and requirements documents

• ‘User cases and urgent requirements for Test Bed 0 & 1’ (meet with ATF 26 Mar and security Mar 29)

– Available for WP8– Available for WP9(ESA)

• User cases for Test Bed 2 & 3 (analysis etc..)– Draft in one month for WP8– There will be discussions next week in WP8

• Common user requirements (Specifications)– Together with WP9 and WP10– First draft in one month– First release at PM6 (EU reqt)


Strategy for Test Beds• Need test beds to

– Validate existing software (applications & DataGRID)

– Develop our long-term vision (not only use cases)

• Move to at least one site per ‘active’ country - but carefully, otherwise chaos!– Start first serious tests for CERN and RAL. Move to

others (Liverpool,Lyon,Nikhef,Bologna...) according to success

• Usable environment for test– High-availability stable release of GLOBUS– Separation from development and production


Minimal Requirements for Testbed 0 (NOW!)

• Working release of GLOBUS– Plus support for it!

• Uniform, dependable () certification / authentication mechanism– One single login good for all test bed sites– Possibility to add users from experiments


Test bed installation kits• Products requiring root(system privileges)

access

– OS, compilers, Objectivity…

– To be installed by WP6

• CERN products installation kits

– CLHEP, GEANT4, CERNLIB…

– Kits provided by CERN / IT and installed by WP6

• Experiment environment installation kits

– Kits provided by experiment and installed by WP8 funded effort


Some Reactions to ATF (preliminary)

• Do we really want to use files?– ??Higher level data handling concept needed– We may want to use objects when

interacting with DataGRID middleware– We may need UML/IDL models

• Is interactive use taken into account in the design?– We need to talk more here– We will propose interactive use cases


Reactions to ATF (preliminary)

• MPI and CORBA will be needed (Biology)• There will be read/write databases!

– Database update has to be taken into account

• Concerns on portability– Running on Linux and Solaris is not enough– The code should be written to run on any machine

with a reasonable cc/java

• Worries about the use of CONDOR– Will we all have to install CONDOR?– Is the code Open Source?


Reactions to ATF (preliminary)

• Security is a concern for the M9 release– All implementations should go via some

secure mechanism (globus init?)

• We met with ATF Mar 26 to discuss our reaction to M9 deliverables draft– ‘Decided’ to decouple M9 deliverables and

long term architecture planning


Specific LHCb reactions (post Amsterdam)

• We should broaden the GRID involvement of LHCb sites ( but maybe not make all of them part of first Datagrid Testbed?)

– installation of Globus and LHCb s/w at our sites

• In parallel broaden our production but separate from GRID tests to start with

• We must develop our data and analysis models and map them to the GRID– Atlas are looking at mapping Athena/GAUDI to GRID

– ?our physics application layer running above GAUDI


Execution Control/Location (some thoughts from C Tull(Atlas)

• Execution in a fully grid-enabled manner involves locating, authenticating, brokering, and scheduling the use of appropriate grid resources (Security Services should be included here).

• The Athena/Gaudi Application Manager as the entity responsible for execution control in the framework might interface to appropriate grid services.


More on actions arising out of meeting - the LHCb programme of work

• Setting up LHCb GRID testbed (see Eric’s and Martin’s talks)

• Developing our analysis model (see Glenn’s talk)

• Interfacing our OO software to the GRID (see Pere’s talk)

• Hoping to organise brainstorming workshop ( ? Bologna late May/early June)

28 March 2001F Harris LHCb Software Week1 Overview of GGF1 (Global Grid Forum) and Datagrid meeting,...

Documents

Transcript of 28 March 2001F Harris LHCb Software Week1 Overview of GGF1 (Global Grid Forum) and Datagrid meeting,...