The EGEE Project from South East European Perspective

23
INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org NEC 2005 Varna, Bulgaria The EGEE Project from South East European Perspective Emanouil Atanassov, Ivan Dimov, Todor Gurov, and Aneta Karaivanova Institute for Parallel Processing - BAS

description

The EGEE Project from South East European Perspective. Emanouil Atanassov, Ivan Dimov, Todor Gurov, and Aneta Karaivanova Institute for Parallel Processing - BAS. Overview. South East Europe Federation in EGEE Organization of operations Resources in SEE Federation Applications Challenges. - PowerPoint PPT Presentation

Transcript of The EGEE Project from South East European Perspective

Page 1: The EGEE Project from South East European Perspective

INFSO-RI-508833

Enabling Grids for E-sciencE

www.eu-egee.org

•NEC 2005 Varna, Bulgaria

The EGEE Project from South East European Perspective

Emanouil Atanassov,

Ivan Dimov, Todor Gurov, and Aneta Karaivanova

Institute for Parallel Processing - BAS

Page 2: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 2

Enabling Grids for E-sciencE

INFSO-RI-508833

Overview

• South East Europe Federation in EGEE• Organization of operations• Resources in SEE Federation• Applications• Challenges

Page 3: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 3

Enabling Grids for E-sciencE

INFSO-RI-508833

EGEE Partner Federations

All work in EGEE will be carried out by the 70 partners grouped in 12 federations.

Page 4: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 4

Enabling Grids for E-sciencE

INFSO-RI-508833

Structure of EGEE operations

• Operations Management Centre (OMC):

– At CERN – coordination etc

• Core Infrastructure Centres (CIC)– Manage daily grid operations –

oversight, troubleshooting– Run essential infrastructure services– Provide 2nd level support to ROCs

• Regional Operations Centres (ROC)– Act as front-line support for user and

operations issues– Provide local knowledge and

adaptations– One in each region

• User Support Centre (GGUS)

Page 5: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 5

Enabling Grids for E-sciencE

INFSO-RI-508833

Participants from SEE federation

Page 6: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 6

Enabling Grids for E-sciencE

INFSO-RI-508833

Operations monitoring maps

• In EGEE/LCG:

• > 150 sites, 34 countries

• > 15,000 cpu

• ~5 PB storage

• In EGEE/LCG:

• > 150 sites, 34 countries

• > 15,000 cpu

• ~5 PB storage

Page 7: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 7

Enabling Grids for E-sciencE

INFSO-RI-508833

Example grid site - BG01-IPP

UI

Terminals

enterGrid

enterGrid

enterGrid

enterGrid

UI WN

WN

WN

WN

WN

WNRB/II

CESE

BDII

Page 8: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 8

Enabling Grids for E-sciencE

INFSO-RI-508833

SEE ROC activities

• Introduce new RCs • Pro-active monitoring of grid services at RC• React and solve problems, reported by users or CIC• Validate new middleware releases• Provide feedback to middleware developers through

the pre-production service• Interfaces: Savannah at CERN, GGUS at FZK• Negotiate and deploy new VOs at RC level

Page 9: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 9

Enabling Grids for E-sciencE

INFSO-RI-508833

SEE Regional Operations Centre – distributed organizational structure

• Central ROC in Greece• Security Contact in Bulgaria • Helpdesk developed by Romania• Core services run at Cyprus, backup core services in

Greece and Bulgaria (BDII, RB)• Local customised monitoring from Greece• Regional SEE VO deployed• SEE VO services available - VOMS, myproxy, LFC, etc.• Localized web sites at each country• Stable SEE-GRID sites are also incorporated

Page 10: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 10

Enabling Grids for E-sciencE

INFSO-RI-508833

SEE sites

Page 11: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 11

Enabling Grids for E-sciencE

INFSO-RI-508833

Selection of Monitoring tools

GIIS Monitor GIIS Monitor graphs Sites Functional Tests

GOC Data BaseScheduled Downtimes Live Job Monitor

GridIce – VO view GridIce – fabric view Certificate Lifetime Monitor

Note: Those thumbnails are links and are clickable.

Page 12: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 12

Enabling Grids for E-sciencE

INFSO-RI-508833

User support

New experimental

users

New production users/apps

EGAAP

Join existing VO with your

application

Qualify as new VO

Join SEE-VO

Experienced production

users

Join existing VO as a member

Play on GILDA: RO, GR

Help with app development Help with EGAAP application

Our ROC core servicesOur ROC core servicesUser support per country

User support per country

User support per country

Page 13: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 13

Enabling Grids for E-sciencE

INFSO-RI-508833

BG EGEE production infrastructure

  BG01-IPP BG02_IM BG-INRNE BG04-ACAD

alice 344 0 0 336

atlas 4066 34 0 4

biomed 7301 721 0 602

cms 3856 0 390 131

magic 703 0 0 0

dteam 127 39 27 38

esr 85 0 0 0

lhcb 3901 0 0 5123

•Sites – 4 (3 EGEE, 1 SEE-GRID)

•CPUs – 45

•VOs supported – HEP, BioMed, ESR, magic, regional

•The table shows the total summed CPU time

Page 14: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 14

Enabling Grids for E-sciencE

INFSO-RI-508833

VOs supported at the first BG EGEE site – BG01-IPP

• BG01-IPP was the first SEE site to support:– biomed VO – since Nov 2004– ESR – since Jan 2005– magic – since Mar 2005.

• High Energy Physics support - Alice, Atlas, LHCb, CMS software deployed at the site.– LHCb production jobs since October 2004.– CMS and Atlas jobs running at this moment:

Page 15: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 15

Enabling Grids for E-sciencE

INFSO-RI-508833

VOs supported at the first BG EGEE site – BG01-IPP

Installed VO software:

Page 16: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 16

Enabling Grids for E-sciencE

INFSO-RI-508833

BG application in ESR VO – air pollution prediction

• Under development by Tzvetan Ostromsky from IPP• Transition from HPC to Grid computing. Use of MPI

Page 17: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 17

Enabling Grids for E-sciencE

INFSO-RI-508833

Challenges before SEE ROC

• Security Service Challenges Level 1 – passed by me as BG01-IPP security contact in 2 hours.

• I participate in Operational Security Coordination Group.

• Biomedical Data Challenge – passed succesfully in July and August. 15 Institutes donated resources for the challenge, among them Institute for Parallel Processing and Institute of Mechanics (http://public.eu-egee.org/news/fullstory.php?news_id=53)

• Increase number of users and available resources

Page 18: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 18

Enabling Grids for E-sciencE

INFSO-RI-508833

SEE-GRID Contractors

• GRNET (Co-ord.) Greece• CERN

Switzerland• SZTAKI Hungary • IPP-BAS Bulgaria• ICI Romania• TUBITAK Turkey• INIMA Albania• BIHARNET Bosnia-

Herzegovina• UKIM FYROM• UOB Serbia-

Montenegro• RBI Croatia

Page 19: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 19

Enabling Grids for E-sciencE

INFSO-RI-508833

SEE-GRID current snapshot

• LCG-2 clusters installed in all sites. – 9 SEE-GRID sites – ( with >80 CPUs) in

participating countries in the first project year;

• Regional SEEGRID VO is supported with 3 Grid apps:– Volumetric Image Visualization

Environment (VIVE);– Search Engine for South Eastern Europe

(SE4SEE); – Stochastic ALgorithms for Ultra-fast

Transport in sEmiconductors (SALUTE). • EGEE VOs supported -

– HEP, biomed.• Significant human capital & tech expertise

– emphasis on software development– extend the objective to build additional

Grid applications of regional interest

Page 20: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 20

Enabling Grids for E-sciencE

INFSO-RI-508833

BgGrid Consortium• Members

Founders: Institute for Parallel Processing (former CLPP-BAS) and Institute for Nuclear Research and Nuclear Energy (INRNE-BAS) – (Agreement signed in September 2002)

Joined by (Agreements signed in January 2004): Institute of Mathematics and Informatics (IMI), Bulg. Academy of

Sciences Institute of Mechanics (IM), Bulgarian Academy of Sciences Faculty of Mathematics and Informatics (FMI), Plovdiv University Computer Science Department (CSD), American University in

Bulgaria (AUBG) Department of Information Technologies at the Faculty of

Mathematics and Informatics (DIT-FMI), Sofia University. Institute of Electrochemistry and Energy Systems (IEES), BAS.

• Main purpose Sharing of resources and expertise in Grid Development of Grid-enabled algorithms

Page 21: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 21

Enabling Grids for E-sciencE

INFSO-RI-508833

Presentations and workshops Invited presentations at national and international

conferences Workshop at Institute of Mechanics, Nov 2004 International Conference Sofia University, Feb 2005 Workshop at AUBG, Mar 2005 MIPRO, Opatija, Croatia, May 2005 LSSC Sozopol June 2005

EGEE/SEE-GRID workshop Borovetz, Oct 2004 NA2 meeting in Sofia, June 2005 Newspaper and radio interviews

Page 22: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 22

Enabling Grids for E-sciencE

INFSO-RI-508833

During the first year of EGEE

• Two new members of BgGRID Consortium Institute of Astronomy (IA), BAS Space Research Institute (SRI), BAS

• Specific agreements with two Institutions to install Grid sites and support regional and EGEE applications Institute of Mechanics – BG02-IM – production site running since

January 2005, support for seegrid VO. Faculty of Physics and Faculty of Mathematics, Sofia University –

agreement and work in progress.

• Grid sites Four EGEE production sites One EGEE Grid site under construction

• Grid applications – SALUTE (Stochastic ALgorithms for Ultra-fast Transport in sEmiconductors) in SEE-GRID and EnvMod in ESR.

Page 23: The EGEE Project from South East European Perspective

NEC 2005 Varna Bulgaria 23

Enabling Grids for E-sciencE

INFSO-RI-508833

Contact information

Contact persons: • Emanouil Atanassov,

EGEE SA1 representative for Bulgaria

[email protected]

• Aneta Karaivanova,

NA2 Activity Leader,

[email protected]

• Todor Gurov, Alternate BG EGEE

representative [email protected]

• Ivan Dimov, EGEE Project manager for

BG

[email protected]

•http://www.grid.bas.bg/ http://www.egee-see.org