Session 23 - Intro to EGEE-III
10
EGEE-III INFSO-RI-222667 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks Steven Newhouse Technical Director CERN Distributed Data and gLite
-
Upload
issgc-summer-school -
Category
Education
-
view
501 -
download
6
Transcript of Session 23 - Intro to EGEE-III
EGEE-III INFSO-RI-222667
Enabling Grids for E-sciencE
www.eu-egee.org
EGEE and gLite are registered trademarks
Steven Newhouse
Technical Director
CERN
Distributed Data and gLite
Enabling Grids for E-sciencE
EGEE-III INFSO-RI-222667
The Data Deluge
• Astronomy
• Genomics
• Earth Observation
• Digitisation
Data Day - Grid School 2009 2
Crab Nebula
OpticalX-ray
Enabling Grids for E-sciencE
EGEE-III INFSO-RI-222667
... And the LHC
Data Day - Grid School 2009 3
XX
Enabling Grids for E-sciencE
EGEE-III INFSO-RI-222667
High throughput data analysis
• Analysing the data
– Large ensemble calculations (100’s10,000’s jobs)
– Complex workflows – dependent on previous steps
• High Throughput
– Exploit distributed computing and storage resources
Data replicated (multiple locations)
Resources selected through a broker
• WMS: Workload Management System
• Higher level tools: GANGA, DIANE, ...
– Information system records the available resources
– File catalogue records the location of replicated files
• Data stored in files
– Growing interest in relational data access
– Stored on tape (long-term) or disk (immediate access)
Data Day - Grid School 2009 4
Enabling Grids for E-sciencE
EGEE-III INFSO-RI-222667
Project Overview
17000 users
136000 LCPUs (cores)
25Pb disk
39Pb tape
12 million jobs/month
+45% in a year
268 sites
+5% in a year
48 countries
+10% in a year
162 VOs
+29% in a year
Data Day - Grid School 2009 5
Enabling Grids for E-sciencE
EGEE-III INFSO-RI-222667
So what does EGEE actually do?
• Builds and supports user communities on the grid
• Integrates and provides a worldwide infrastructure
• Collaboration and Technical Leadership worldwide
Technical Status - Steven Newhouse - EGEE-III First Review 24-25 June 2009 6
TrainingApplication
PortingUser
Support
Software
Development
Integration,Test &
CertificationDeployment Operations
Collaborating
ProjectsStandards Policy
Enabling Grids for E-sciencE
EGEE-III INFSO-RI-222667
Supporting Science
Data Day - Grid School 2009 7
• Archeology
• Astronomy
• Astrophysics
• Civil Protection
• Comp. Chemistry
• Earth Sciences
• Finance
• Fusion
• Geophysics
• High Energy Physics
• Life Sciences
• Multimedia
• Material Sciences
Resource Utilisation
Proportion of HEP usage ~77%
End-user activity
• 13,000 end-users in 112 VOs
• +44% users in a year
0 1 2 3 4 5 6 7
Other Areas
Fusion
Earth Science
Astronomy & Astrophysics
Multidisciplinary
Life Sciences
Computational Chemistry
March 2008 to February 2009 (%) March 2007 to February 2008 (%)
Enabling Grids for E-sciencE
EGEE-III INFSO-RI-222667
Physical Resources
Connecting Users to Resources
Data Day - Grid School 2009 8
Computers Disks Tape
Middleware
Applications
Enabling Grids for E-sciencE
EGEE-III INFSO-RI-222667
EGEE Maintained Components External Components
gLite Middleware
Data Day - Grid School 2009 9
Physical Resources
General Services
LHC File
Catalogue
Hydra
Workload
Management
Service
File Transfer
Service
Logging &
Book keeping
Service
AMGA
Storage
Element
Disk Pool
Manager
dCache
Info
rmatio
n S
erv
ices
BDII
MON
User InterfaceUser Access
Security
Services
Virtual
Organisation
Membership
Service
Authz. Service
SCAS
Proxy Server
LCAS &
LCMAPS
Compute Element
CREAM LCG-CE
gLExec
BLAH
Worker Node
User Interface
Enabling Grids for E-sciencE
EGEE-III INFSO-RI-222667
• Contact:
Data Day - Grid School 2009 10
