INFSO-RI-508833 Enabling Grids for E-sciencE EGEE and the National Grid Service Mike Mineter...

INFSO-RI-508833

Enabling Grids for E-sciencE

www.eu-egee.org

EGEE and the National Grid ServiceMike Mineter

[email protected]

EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 2


INFSO-RI-508833

Acknowledgements

• This talk was prepared by Mike Mineter of NeSC and includes slides from talks delivered by:– Neil Geddes, GOSC Face-to-Face, NeSC, November 2004– Andy Richards, GOSC Face-to-Face, NeSC, November 2004– Tony Hey, AHM 2004, Nottingham, http://

www.allhands.org.uk/programme/programme.html

http://www.allhands.org.uk/programme/programme.html

http://www.allhands.org.uk/programme/programme.html



INFSO-RI-508833

Goals of this module

• To outline the National Grid Service

• To summarise its relationship with EGEE



INFSO-RI-508833

Contents

• Snapshots of the UK e-infrastructure

• The UK e-Science programme

• The National Grid Service

• The NGS and EGEE



INFSO-RI-508833

Snapshots of UK e-infrastructure

• The JISC view

• Digital curation

• Networks – We’ve been (mainly) ignoring networks today!– A sign of their success!!

• Grids

6

The JISC Communities

• Portals• Applications• Content• Meta Data &

Delivery tools• Finding /Access

tools•

E-l

earn

ing

•D

igit

al l

ibra

ries

•E

-res

earc

h

• Internet

• AAA Services

7

Digital Curation Centre

• Actions needed to maintain and utilise digital data and research results over entire life-cycle– For current and future generations of users

• Digital Preservation– Long-run technological/legal accessibility and usability

• Data curation in science – Maintenance of body of trusted data to represent current

state of knowledge in area of research

• Research in tools and technologies– Integration, annotation, provenance, metadata,

security…..



INFSO-RI-508833

Communicating across 3 dimensions:

• Space and organisational boundaries: Grids

• Time : curation

• Domains of knowledge: semantics

• (With thanks to Peter Burnhill, EDINA)



INFSO-RI-508833


• The JISC view


• Networks – We’ve been (mainly) ignoring networks today!– A sign of success!!

• Grids

10GEANT

UKLightLondonStarLight

Chicago

NetherLightAmsterdam

CERN

CzechLight

UK Researchers

Extended JANETDevelopment Network

Local Research Equipment

International Point-of-Access

CA*net

Abilene

JISC £6.5M for UKLight ‘Lambda’ Network

10Gb/s

10Gb/s

10Gb/s

10Gb/s

10Gb/s

2.5Gb/s

Existing connections

Proposedconnections



INFSO-RI-508833


• The JISC view


• Networks – We’ve been (mainly) ignoring networks today!– A sign of success!!

• Grids



INFSO-RI-508833

The UK e-Science programme

• Goal• Where we are today• Web services and Grids



INFSO-RI-508833

The UK e-Science programme

• “We are attempting to build an infrastructure comprised of a set of middleware services capable of supporting the dynamic 'virtual organisations' required by scientists, engineers and industry. As a shorthand for this core middleware infrastructure I often use the controversial term ‘Grid’”

Professor Tony Hey, September 2004

• £250M UK e-Science Initiative



INFSO-RI-508833

UK Core e-Science programme - Situation Today

* LeedsManchester *

* OxfordRAL *

Level-2 Gridhttp://www.grid-support.ac.uk/l2g/ National Grid Service

* DL

Tony Hey, AHM 2004 http://www.allhands.org.uk/programme/programme.html 15

Web Services and Grids

• Computing models developed for sequential machines led to the distributed object model of distributed computing represented by Java and CORBA

• Experience has shown that the distributed object model ties distributed entities together too tightly

• Resulted in ‘fragile’ distributed software systems when going from LANs to WANs

Replace distributed objects by ‘services’ connected by “one-way” messages and not by request-response messages

IT industry has ‘united’ around Web Services


The Web Services ‘Magic Bullet’

Web services

Company A(J2EE)

Company B(ONE)

Company C(.Net)


‘WS-I+’profile

Web Service Grids: An Evolutionary Approach

WS-I

Standards that havebroad industry support

and multiple interoperableimplementations

Specifications that are emergingfrom standardisation process

and are recognised as being ‘useful’

Specifications that have/will enter a standardisation processbut are not stable and are still experimental


WS-I+ Grid Interoperability Profile

• WS-I identifies XSD, WSDL, SOAP, UDDI • WS-I+ adds minimum additional capabilities to WS-

I to allow development of Grid Services– BPEL and extensions for scientific workflows– WS-Addressing for virtualization of messaging– WS-ReliableMessaging/Reliability to provide basis for

fault tolerant and efficient Grid services

• Expect progress in– WS-ResourceFramework – submitted to OASIS– Notification – dialogue between IT companies– Security – need to understand better relationship of Web

Services and Grid approaches– Portlets – generic toolkit for portal construction



INFSO-RI-508833

The NGS and GOSC

• The NGS is the core UK grid, intended for the production use of computational and data grid resources. NGS is the core service resulting from the UK's e-Science programme. NGS is supported by JISC, and is run by the Grid Operations Centre (GOC).

• http://www.ngs.ac.uk/

• The UK Grid Operations Support Centre is a distributed "virtual centre" providing deployment and operations support for the UK e-Science programme. The core of the GOSC is built around operation of the National Grid Service (NGS). The GOSC will support UK services for user authentication, user authorization and project organization, credential management, resource discovery, access portal and more, to be driven by the user requirements.

• http://www.grid-support.ac.uk/



INFSO-RI-508833

UK e-Infrastructure

LHC ISIS TS2HPCx + HECtoR

Regional and Campus grids

Users get common access, tools, information, Nationally supported services, through NGS

Integratedinternationally

VRE, VLE, IE

UofA

HPCx

UofD

GOSC

NGS Core Nodes: Host core services, coordinate integration, deployment and support+free to access resources for all VOs. Monitored interfaces + services

NGS Sites: Integrated with NGS, some services/resources available for all VOs Monitored interfaces + services

NGS Connected Sites: Integrated with NGS, support for some VO’sMonitored interfaces (+security etc.)

RAL Oxford

LeedsMan. CSAR

UofB

UofC

CommercialProvider

PSRE



INFSO-RI-508833

NGS Hardware

Compute Cluster

•64 dual CPU Intel 3.06 GHz (1MB cache) nodes

Data Cluster

•20 dual CPU Intel 3.06 GHz nodes •18TB Fibre SAN ( Infortrend F16F 4.1TB Fibre Arrays (UltraStar 146Z10 disks)

•Oracle 9i RAC •Oracle Application server



INFSO-RI-508833

• Core NGS– VDT (Globus 2) Middleware– OGSA-DAI implementation (pre-production)– Data Services – Oracle, SRB– Various Applications…

• GOSC – GSC Supported services for the NGS– MyProxy Service – myproxy.grid-support.ac.uk– BDII / MDS Information Service (Production and

Development)– VOM (LCG-VO) Service– Monitoring tools

• GOSC (GSC, NGS) Developing expertise with EGEE software / middleware – resource broker – and testing gLite

NGS Middleware



INFSO-RI-508833

GOSC Timeline

Q2 Q4 Q2 Q3Q1Q4Q3Q2Q1Q3

2004 20062005

EGEE gLite alpha release

gLite release 1

OMII release

NGS Expansion(Bristol, Cardiff…)

OGSA-DAI

WS plan

NGS ProductionService

NGS WS Service

EGEE gLite releaseOMII Release

NGS Expansion

WS2 plan

NGS WS Service 2

“Tomorrow”

Web Services based National Grid Infrastructure



INFSO-RI-508833

Summary

• e-infrastructure is being developed and used to support knowledge creation (research), curation, and dissemination

• In the UK, the National Grid Service provides the middleware services that uses the network infrastructure and enables application services (computation, data, collaboration,…)

• NGS will interoperate with EGEE

• Grid Operations Support Centre is the initial source for further information http://www.grid-support.ac.uk/

INFSO-RI-508833 Enabling Grids for E-sciencE EGEE and the National Grid Service Mike Mineter...

Documents

Transcript of INFSO-RI-508833 Enabling Grids for E-sciencE EGEE and the National Grid Service Mike Mineter...