The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .
-
date post
18-Dec-2015 -
Category
Documents
-
view
216 -
download
2
Transcript of The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 .
The DataGrid Project
http://www.eu-datagrid.org/
NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
http://www.dutchgrid.nl
Presentation “a quatre mains”
NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
EDG and the testbed KorsJob submission (slides) JeffJob submission (hands on) David100 Atlas jobs on the Grid Stan
…… and all this in 20’
The Project status
at 2/3 of its lifetime
second EU review February 4 and 5 2003
writing started on a follow-up project in the 6th FP for 2005
LHC has accepted grid technology for its computing challenge: LCG
EDG software release 1.4 on the testbed
on the testbed: CERN, CNAF, CCIn2P3, NIKHEF, RAL prime sites
currently stress tested by Atlas and CMS with their prod.programs
others, D0, Earth Observ, biologists, etc. are testing as well
EDG tutorials given everywhere, last week at NIKHEF
What we will show you
the layout of the testbed
how to submit a job on the Grid
what modules/services are involved in job submission
how to get/look at the output of your job
how to deal with in- and output- files
Security is very important, but will not be shown
We assume Authentication and Authorisation are done
Once authorised a user can access all resources on the grid
Authentication: once a year, Authorisation: once per session
Current EDG Testbed
CERNLyon
RAL
Manchester NIKHEF
Reference site CERN
Testbed1 EDG sites NorduGrid
21 sites
8 sites are in Europe
About 340 machines are available.
Some of them are dual processor.
Some machines are only used for
EDG.
They are split into:
- Production
- Development
NorduGrid is as a Grid infrastructure in the Nordic countries
CNAF
Tutorial and Core site
A 3 Tier ArchitectureA 3 Tier Architecture
Client Application Server
Data Server
Request
ResultData
Request
User Interface
Computing Element/Worker Nodes
Storage Element
On the EDG testbed:On the EDG testbed:
EDG Logical Machine Types
1. User Interface (UI)
2. Resource Broker (RB)
3. Information Service (IS)
4. Computing Element (CE) Gatekeeper
(Front-end Node)
Worker Nodes (WN)
5. Storage Element (SE)
6. Replica Catalog (RC)
Job Submission Scenario
UIJDL
Logging &Bookkeeping(LB)
ResourceBroker (RB)
Job SubmissionService (JSS)
StorageElement(SE)
ComputeComputeElement CE)Element CE)
Information Service (IS)
ReplicaCatalogue(RC)
A Job Submission Example
UIJDL
Logging &Bookkeeping(LB)
ResourceBroker (RB)
Job SubmissionService (JSS)
StorageElement(SE)
ComputeComputeElement (CE)Element (CE)
Information Service (IS)
ReplicaCatalogue(RC)
Job SubmitEvent
Input Sandbox
Job Status
submitted
A Job Submission Example
UIJDL
Logging &Bookkeeping(LB)
ResourceBroker (RB)
Job SubmissionService (JSS)
StorageElement(SE)
ComputeComputeElement (CE)Element (CE)
Information Service (IS)
ReplicaCatalogue(RC)
Job Status
submitted
waiting
A Job Submission Example
UIJDL
Logging &Bookkeeping(LB)
ResourceBroker (RB)
Job SubmissionService (JSS)
StorageElement(SE)
ComputeComputeElement (CE)Element (CE)
Information Service (IS)
ReplicaCatalogue(RC)
Job Status
submitted
waiting
ready
A Job Submission Example
UIJDL
Logging &Bookkeeping(LB)
ResourceBroker (RB)
Job SubmissionService(JSS)
StorageElement (SE)
ComputeComputeElement (CE)Element (CE)
Information Service (IS)
ReplicaCatalogue(RC)
Job Status
submitted
waiting
ready
BrokerInfo
scheduled
A Job Submission Example
UIJDL
Logging &Bookkeeping(LB)
ResourceBroker (RB)
Job SubmissionService (JSS)
StorageElement(SE)
ComputeComputeElement (CE)Element (CE)
Information Service (IS)
ReplicaCatalogue(RC)
Job Status
submitted
waiting
ready
scheduledInput Sandbox
running
A Job Submission Example
UIJDL
Logging &Bookkeeping(LB)
ResourceBroker (RB)
Job SubmissionService (JSS)
StorageElement(SE)
ComputeComputeElement (CE)Element (CE)
Information Service (IS)
ReplicaCatalogue(RC)
Job Status
submitted
waiting
ready
scheduled
Job Status
running
A Job Submission Example
UIJDL
Logging &Bookkeeping
ResourceBroker
Job SubmissionService
StorageElement
ComputeComputeElementElement
Information Service
ReplicaCatalogue
submitted
waiting
ready
scheduled
running
Job Status
done
Job Status
A Job Submission Example
UIJDL
Logging &Bookkeeping
ResourceBroker
Job SubmissionService
StorageElement
ComputeComputeElementElement
Information Service
ReplicaCatalogue
submitted
waiting
ready
scheduled
running
done
Job Status
Job Status
outputready
Output Sandbox
A Job Submission Example
UIJDL
Logging &Bookkeeping(LB)
ResourceBroker (RB)
Job SubmissionService (JS)
StorageElement(SE)
ComputeComputeElement (CE)Element (CE)
Information Service (IS)
ReplicaCatalogue(RC)
Output Sandbox
cleared
submitted
waiting
ready
scheduled
running
done
Job Status
outputready
Sites Used in this Demo
CERN Production test bed RB, II, CE, SE and a couple of worker nodes
CNAF Bologna CE, SE and worker nodes
Rutherford Appleton Lab (GridPP) CE, SE and worker nodes
CC IN2P3 Lyon CE and worker nodes
NIKHEF UI, CE, SE, worker nodes, Replica Catalogue
Local Application Test Bed
ui02 (a.k.a. tbn08)
ce02
node18-*.farmnet.nikhef.nl
se02edgmds.dutchgrid.nl
lxshare0382
grid-vo.nikhef.nlRC
application test bed
ui01,ce01,se01RB IS
CERN
Higgs analysis at Atlas
Example of a Higgs analysis
Search in 4-electron channel Choose decay via HZZ e+e-
e+e-
~80% of background given by qq ZZ e+e-e+e-
Fast Atlfast simulation Pythia event generation Parameterization detector response
Selection criteria on ‘Reconstructed’ Electron cluster
EM Calorimeter information All electrons pT>7 GeV 2 electrons pT>20 GeV Even number of electrons Al least 1 Z with |91.175-m(Z*)|<15 GeV Both Z’s: m(Z*)>20 GeV
Cross sections: Background: BR ~ 17
fb
Signal (mH=130-200): BR ~ 1-3 fb
Luminosity:
One grid job of 500 events corresponds to approximately 1 year of running (low luminosity, 30 fb-1) with LHC