HEAnet Conference 2006 John Walsh Grid-Ireland Grid Manager Trinity College Dublin The Grid...

HEAnet Conference 2006HEAnet Conference 2006

John WalshJohn Walsh

Grid-Ireland Grid ManagerGrid-Ireland Grid Manager

Trinity College DublinTrinity College Dublin

The Grid Computing Infrastructure in Ireland and

Abroad

What is a Grid?What is a Grid?

• Collection of shared resources + infrastructure Collection of shared resources + infrastructure – Cooperating across multiple administrative domainsCooperating across multiple administrative domains– Secured with PKI (AAA)Secured with PKI (AAA)– Group Collaboration (Virtual Organisations)Group Collaboration (Virtual Organisations)

• Compute and/or Data orientated Compute and/or Data orientated – Batch queue, Storage and Worker nodesBatch queue, Storage and Worker nodes

• Infrastructure to support Infrastructure to support – Authentication and Authorisation (VOMS, MYPROXY)Authentication and Authorisation (VOMS, MYPROXY)– Recognised Trust Authorities (Asia, Europe, US)Recognised Trust Authorities (Asia, Europe, US)– Resource discovery (BDII, LFC catalogs)Resource discovery (BDII, LFC catalogs)

• Current Grid projects are the drivers for Current Grid projects are the drivers for massive distributed data access over the next massive distributed data access over the next few yearsfew years

Grid-Ireland: InfrastructureGrid-Ireland: Infrastructure

• NRENs+Grid+HPC == NRENs+Grid+HPC == e-Infrastructuree-Infrastructure• Grid-Ireland:Grid-Ireland:

– The national computational Grid for IrelandThe national computational Grid for Ireland

• UK:UK:– UK e-Science: NGSUK e-Science: NGS– GridPP: partners in EGEEGridPP: partners in EGEE

• LCG/EGEE:LCG/EGEE:– 200+ sites and 31,124 CPUs worldwide200+ sites and 31,124 CPUs worldwide– 32 countries, 11 federations32 countries, 11 federations– TCD is Regional Operations Centre for IrelandTCD is Regional Operations Centre for Ireland

• int.eu.grid:int.eu.grid:– European Interactive GridEuropean Interactive Grid– 13 countries, no federations13 countries, no federations


26-OCT-06:26-OCT-06:200+ sites200+ sites31,124 CPUs31,124 CPUs

Centralservices

SitesClusters


Grid-Ireland

Centralservices

SitesClusters

Gridnm (NM) Gridui (UI)

Gridmon (test WN)Gridstore (SE)Gridgate (CE)

Gridinstall (Quattor)

Network switch UPS Gridfw (firewall)

Gateway

Cluster


Installation serverInstallation server






Computing elementComputing element






Storage elementStorage element






Test worker nodeTest worker nodeGridnm (NM) Gridui (UI)





User interfaceUser interfaceGridnm (NM) Gridui (UI)





Network monitor:Network monitor:

Not currently Not currently installedinstalled






Cluster(s):Cluster(s):Managed by local adminsManaged by local admins

OpsCentre supports integrationOpsCentre supports integration

Various config & install optionsVarious config & install options






Grid Gateway:All Virtual machines

All run on 1 physical machine

Remotely managed by OpsCentre

• OpsCentre:OpsCentre:• Management of Grid-IrelandManagement of Grid-Ireland

• Testing, porting, customisationTesting, porting, customisation

• Deployment to remote sitesDeployment to remote sites

• Remote management of sitesRemote management of sites

• Monitoring of Grid servicesMonitoring of Grid services

• National services (e.g. CA)National services (e.g. CA)

• Dissemination and trainingDissemination and training• Grid courses and e-Learning (soon)Grid courses and e-Learning (soon)

• Links to EU Grids:Links to EU Grids:• EGEE-IIEGEE-II• int.eu.gridint.eu.grid

OpsCentre

Grid-Ireland: OperationsGrid-Ireland: Operations


Transactional DeploymentTransactional DeploymentGeoff Quigley, TCD

Typical Grid Typical Grid service software service software stack.stack.

LCG M/W stack LCG M/W stack depends depends partially on partially on Globus stack Globus stack

Grid-Ireland: Operations


Remote Site OpsCentre

Service monitoringService monitoring

15,000 service checks per day15,000 service checks per day

Keith Rochford, TCD


• National Trouble Ticketing:National Trouble Ticketing:– HEAnet tickets -> HEAnet tickets -> [email protected] (people) (people)– Grid-Ireland alerts -> Grid-Ireland alerts -> [email protected] (people) (people)– Grid-Ireland tickets -> Grid-Ireland tickets -> [email protected]

(OpsCentre RT)(OpsCentre RT)• Global Trouble Ticketing:Global Trouble Ticketing:

– HEAnet tickets -> Global Grid User Support (GGUS)HEAnet tickets -> Global Grid User Support (GGUS)– Selected OpsCentre RT tickets <--> GGUSSelected OpsCentre RT tickets <--> GGUS

mailto:[email protected]

mailto:[email protected]

Grid-Ireland: IntrusionsGrid-Ireland: Intrusions

R-GMASecondaryProducer

Alert Archive

R-GMAAPI

Snort

OpsCentre

Site A

R-GMAAPI

Snort

Site B

R-GMAAPI

Snort

Site C

R-GMAAPI

Site D

Snort

GSMI Alert Layer

Stuart Kenny, TCD


GSMI Analysis Layer

R-GMASecondaryProducer

Alert Archive

GOC

AlertAnalyser

AlertAnalyser

AlertAnalyser

Grid-WideAlerts

CorrelationEngine

Low / med priority Grid alerts

high priority Grid alerts

OpsCentre

Stuart Kenny, TCD


• Deployed on Grid-IrelandDeployed on Grid-Ireland– since July 2005since July 2005– 18 Irish sites18 Irish sites– ~500,000 alerts so far~500,000 alerts so far

• Being deployed on int.eu.gridBeing deployed on int.eu.grid– 13 EU sites13 EU sites

• Next:Next:– Tripwire sensorsTripwire sensors– Active SecurityActive Security

4 week period: 25,378

Stuart Kenny, TCD

• Certification Authorities (CAs) issue digital Certification Authorities (CAs) issue digital certificates:certificates:– Grid CAs are recognized internationally:Grid CAs are recognized internationally: http://

www.gridpma.org/– e.g. Grid-Ireland CA: e.g. Grid-Ireland CA: http://www.grid.ie/certauth.html

• Globus GSI softwareGlobus GSI software– basis of most production grid securitybasis of most production grid security

• NRENs are investigating pan-EU federated identityNRENs are investigating pan-EU federated identity– HEAnet and Grid-Ireland are proactively tracking thisHEAnet and Grid-Ireland are proactively tracking this– Primary issue: users must keep their digital certificate Primary issue: users must keep their digital certificate

secure !!!secure !!!

Grid-Ireland: TrustGrid-Ireland: Trust

http://www.gridpma.org/





Grid-Ireland: ApplicationsGrid-Ireland: Applications

• AstrophysicsAstrophysics

• Computational ChemistryComputational Chemistry

• Earth Sciences - Earth Observation, Solid Earth PhysicsEarth Sciences - Earth Observation, Solid Earth Physics

• GeophysicsGeophysics

• High Energy PhysicsHigh Energy Physics

• Life Sciences - Bioinformatics (Drug discovery, etc)Life Sciences - Bioinformatics (Drug discovery, etc)

• Medical ImagingMedical Imaging

• MultimediaMultimedia

A J-band extinction map showing the Chameleon dark clouds extracted from our

map created using the Grid-enabled program - G Murphy, D Froebrich, J Walsh (2005).

Grid-Ireland: ApplicationsGrid-Ireland: Applications

Advances in Application Advances in Application SupportSupport

MPIMPI• Currently not supported wellCurrently not supported well• TCD involved in working group to rectify thisTCD involved in working group to rectify this• Will support multiple MPI implementationsWill support multiple MPI implementations• TCD modified Resource BrokerTCD modified Resource Broker

Remote PBSRemote PBS• Secure Job submission to remote PBS serversSecure Job submission to remote PBS servers• Standard PBS server with GSI-sshd + basic info Standard PBS server with GSI-sshd + basic info

publisherspublishers• Worker nodes have standard Glite WN M/W (e.g. tar Worker nodes have standard Glite WN M/W (e.g. tar

ball)ball)• Developed at TCDDeveloped at TCD• Can be adapted to support other job managersCan be adapted to support other job managers• Currently beta (tested at TCD/UCD)Currently beta (tested at TCD/UCD)

Questions?

Grid-IrelandGrid-Ireland

HEAnet Conference 2006 John Walsh Grid-Ireland Grid Manager Trinity College Dublin The Grid...

Documents

Transcript of HEAnet Conference 2006 John Walsh Grid-Ireland Grid Manager Trinity College Dublin The Grid...