Overview of EGEE and gLite-1.ppt - Indico 2018. 11. 16.¢  Enabling Grids for E-sciencE NA3...

download Overview of EGEE and gLite-1.ppt - Indico 2018. 11. 16.¢  Enabling Grids for E-sciencE NA3 activity:

of 27

  • date post

    27-Jan-2021
  • Category

    Documents

  • view

    0
  • download

    0

Embed Size (px)

Transcript of Overview of EGEE and gLite-1.ppt - Indico 2018. 11. 16.¢  Enabling Grids for E-sciencE NA3...

  • Enabling Grids for E sciencEEnabling Grids for E-sciencE

    Overview of the EGEE project and the gLite middlewareand the gLite middleware

    www eu egee org

    EGEE-III INFSO-RI-222667

    www.eu-egee.org

  • Enabling Grids for E-sciencE

    Outline

    • What is EGEE?What is EGEE? – The project – The infrastructure

    • gLite middlewareg

    • EGEE applicationspp

    • Sources of further informationSources of further information

    EGEE-III INFSO-RI-222667 2

  • Enabling Grids for E-sciencE

    Defining the Grid

    • A Grid is the combination• A Grid is the combination of networked resources and the corresponding middleware, which provides services for the userprovides services for the user.

    EGEE-III INFSO-RI-222667 3Providing a Production Grid Infrastructure for Collaborative Science 3

  • Enabling Grids for E-sciencE

    The EGEE Project • Aim of EGEE:

    “to establish a seamless European Grid infrastructure for the support of the European Research Area (ERA)”

    • EGEE – 1 April 2004 – 31 March 2006 – 71 partners in 27 countries, federated in regional Grids71 partners in 27 countries, federated in regional Grids

    • EGEE-II – 1 April 2006 – 30 April 2008

    E d d ti– Expanded consortium

    • EGEE-III – 1 May 2008 – 30 April 2010y p – Transition to sustainable model

    EGEE-III INFSO-RI-222667 4Providing a Production Grid Infrastructure for Collaborative Science 4

  • Enabling Grids for E-sciencE

    Defining the Grid

    • A Grid is the combination• A Grid is the combination of networked resources and the corresponding middleware, which provides services for the userprovides services for the user.

    EGEE-III INFSO-RI-222667 5Providing a Production Grid Infrastructure for Collaborative Science 5

  • Enabling Grids for E-sciencE

    EGEE working with related infrastructure projects

    GIN EGEE-III INFSO-RI-222667 6Providing a Production Grid Infrastructure for Collaborative Science 6

    GIN

  • Enabling Grids for E-sciencE

    What is happening now?

    Real Time Monitor – Java tool – Displays jobs

    running (submitted through RBs)g )

    – Shows jobs moving around

    ld iworld map in real time, along with changes in status

    EGEE-III INFSO-RI-222667 7

    http://gridportal.hep.ph.ic.ac.uk/rtm/ (snapshot 16 January 2007)

  • Enabling Grids for E-sciencE

    EGEE Infrastructures

    • Production service – Scaling up the infrastructure with resource centres around the globe – Stable, well-supported infrastructure, running only well-tested and

    reliable middleware

    • Pre-production service – Run in parallel with the production service (restricted nr of sites) – First deployment of new versions of the gLite middleware – Test-bed for applications and other external functionality

    • T-Infrastructure (Training&Education) – Complete suite of Grid elements 20 sites on 3 continentsp

    and application (Testbed, CA, VO, monitoring, support, …)

    – Everyone can register and use

    EGEE-III INFSO-RI-222667 8Providing a Production Grid Infrastructure for Collaborative Science 8

    Everyone can register and use GILDA for training and testing

  • Enabling Grids for E-sciencE

    NA3 activity: User training and induction

    • Expand portfolio of training materials & courses T i id i f EGEE

    NA1 2%

    NA2 5%

    NA3 8%

    NA4 19%

    SA2 2%

    SA3 9%

    JRA1 5%

    • Train a wide variety of EGEE users (internal/external)

    • Develop effective mechanisms SA1 49%

    for training end-users of the EGEE infrastructure

    • Collaborate in cross-activity

    NA5 1%29 Active

    partners ~ 29 FTEsyinitiatives

    – ICEAGE Project Digital Library – http://library.iceage-eu.org/

    ~ 29 FTEs 89 Individuals 6 Federations

    y g g – Videos, MP3 talks on grid computing

    • http://www.egee.nesc.ac.uk/ – Training eventsg – Training material repository

    • http://egee.lib.ed.ac.uk/ – EGEE Digital Library

    EGEE-III INFSO-RI-222667 9

    EGEE Digital Library – Repository of training materials

  • Enabling Grids for E-sciencE

    NA4 Activity: Application identification and support

    • Application Identification and Support (NA4) – 25 countries, 40 partners, 280+ participants, 1000s of users

    S t th l d di EGEE it• Support the large and diverse EGEE user community: – Promote dialog: Users’ Forums & EGEE Conferences – Technical Aid: Porting support, procedural issues – Liaison: Software and operational requirements

    • Main activities: – 5 application clusers: HEP Life sciences Astronomy & astrophysics5 application clusers: HEP, Life sciences, Astronomy & astrophysics, Earth science, Computational chemistry, Fusion, Grid observatory – Support:

    Application porting supportApplication porting support www.lpds.sztaki.hu/gasuc

    VO support Direct user supportDirect user support

    www.ggus.org Regional support

    • http://egeena4 lal in2p3 fr

    EGEE-III INFSO-RI-222667 10

    http://egeena4.lal.in2p3.fr

  • Enabling Grids for E-sciencE

    EGEE Infrastructure

    Country participating

    in EGEE

    60000 70000 80000

    No. Cores

    0 10000 20000 30000 40000 50000 60000

    300 No. Sites

    0

    A pr

    -0 4

    Ju l-0

    4

    O ct

    -0 4

    Ja n-

    05 A

    pr -0

    5

    Ju l-0

    5

    O ct

    -0 5

    Ja n-

    06

    A pr

    -0 6

    Ju l-0

    6

    O ct

    -0 6

    Ja n-

    07

    A pr

    -0 7

    Ju l-0

    7

    O ct

    -0 7

    Ja n-

    08

    A pr

    -0 8

    > 200 sites in 40 countries 38 000 CPU

    50 100 150 200 250 300 ~ 38 000 CPUs

    ~ 5 PB storage 98k jobs/day > 200 Virtual Organizations

    EGEE-III INFSO-RI-222667 11Providing a Production Grid Infrastructure for Collaborative Science 11

    0 50

    A pr

    -0 4

    Ju l-0

    4

    O ct

    -0 4

    Ja n-

    05

    A pr

    -0 5

    Ju l-0

    5

    O ct

    -0 5

    Ja n-

    06

    A pr

    -0 6

    Ju l-0

    6

    O ct

    -0 6

    Ja n-

    07

    A pr

    -0 7

    Ju l-0

    7

    O ct

    -0 7

    Ja n-

    08

    A pr

    -0 8

    > 200 Virtual Organizations⇨The world’s largest multi-disciplinary Grid

  • Enabling Grids for E-sciencE

    Resource management: structure

    • Operations Coordination Centre (OCC)

    – management oversight of– management, oversight of all operational and support activities• Regional Operations

    Centres (ROC)Centres (ROC) – providing the core of the

    support infrastructure, each supporting a number of resource centres within its region

    – Grid Operator on Duty • Resource centres – providing resourcesproviding resources

    (computing, storage, network, etc.);• Grid User Support

    (GGUS)(GGUS) – At FZK, coordination and

    management of user support, single point of contact for users

    EGEE-III INFSO-RI-222667 12

  • Enabling Grids for E-sciencE

    VO concept

    • gLite middleware runs on each shared resource to provideresource to provide – Data services – Computation

    services

    INTERNET

    services – Security service

    • Resources and users form Virtual organisations: basis for collaboration

    • Distributed services (both people and middleware) enable

    EGEE-III INFSO-RI-222667 13

    ) the grid

  • Enabling Grids for E-sciencE

    Defining the Grid

    • A Grid is the combination• A Grid is the combination of networked resources and the corresponding middleware, which provides services for the userprovides services for the user.

    EGEE-III INFSO-RI-222667 14Providing a Production Grid Infrastructure for Collaborative Science 14

  • Enabling Grids for E-sciencE

    Grid middleware

    • The Grid relies on advanced software, called middleware, which interfaces between resources and the applications

    Th G id iddl• The Grid middleware: – Basic services

    Secure and effective access Secu e a d e ect e access to resources

    – High level services Optimal use of resourcesOptimal use of resources Authentication to the different sites that are used Job execution & monitoringJob execution & monitoring of progress Problem recovery T f f lt b k t th

    EGEE-III INFSO-RI-222667 15

    Transfer of results back to the user

  • Enabling Grids for E-sciencE

    Grid Middleware

    • When using a PC or workstation you

    • When using a Grid you – Login with digitalworkstation you

    – Login with a username and password (“Authentication”)

    Login with digital credentials – single sign- on (“Authentication”)

    ( Authentication ) – Use rights given to you

    (“Authorisation”)

    – Use rights given you (“Authorisation”)

    – Run jobs– Run jobs – Manage files: create

    them, read/write, li