Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science...
Transcript of Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science...
![Page 1: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/1.jpg)
Man
chest
er
Co
mp
uti
ng
Super
com
puting,
Vis
ual
izat
ion &
eSci
ence
Mike Pettipher([email protected])
Date 15th May 2003Event: Cray User GroupVenue: OSC, Columbus, Ohio
Managing SupercomputingManaging SupercomputingResources at the University ofResources at the University of
ManchesterManchester
![Page 2: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/2.jpg)
Man
chest
er
Co
mp
uti
ng
Super
com
puting,
Vis
ual
izat
ion &
eSci
ence
The University of Manchesterand Manchester Computing
![Page 3: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/3.jpg)
Managing Supercomputing Resources, CUG May 20033
University of Manchester
� Established 1851
� One of the largest in the UK– Student numbers
– Research Income
– …
� One of the best in the UK– Research quality
– Graduates getting jobs
– Teaching
![Page 4: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/4.jpg)
Managing Supercomputing Resources, CUG May 20034
Manchester Computing users
� University of Manchester– Administrative computing, academic
computing, telecoms
� UK Academia– Supercomputing (CSAR)
– Information & data services(MIMAS)
– Major node in UK AcademicNetwork
• Managing agent for Net NorthWest
– Used by HE, FE & RCs
� International– MIMAS
– International AVS Centre
� Government, Commerce &Industry– Supercomputing
– Networks and hosting• IFL
– R&D
![Page 5: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/5.jpg)
Managing Supercomputing Resources, CUG May 20035
SGI Origin3800, 512 PE~0.5M2001
Williams-Kilburn Baby0.00071948
SGI Origin2000, 128 PE0.1M2000
T3E upgrade to 816 PE1M2000
Cray T3E 1200e, 576 PE0.7M1998
Fujitsu VPX 240/102,2001993
Fujitsu VP12005761988
CDC Cyber 205/Amdahl 4701921983
CDC 7600/ICL1904S121977
CDC 7600/ICL1906A121972
MachineMFlopsYear
Supercomputing @ Manchester:A Brief History
OthersSunCray CS6400Meiko (80PE)KSRIBM SP (146PE)Cray EL98CompaqAmdahlFujitsuDigital
![Page 6: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/6.jpg)
Managing Supercomputing Resources, CUG May 20036
National Datasets
![Page 7: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/7.jpg)
Managing Supercomputing Resources, CUG May 20037
Machine Room
� MIMAS– Sun E6500 (MIMAS), E4500, E4000 (JSTOR)
� CSAR– Cray T3E-1200E
– SGI Origin 3800
– SGI Origin 2000
– SGI Altix (soon)
� Manchester– IBM RS6000/SP 146 PEs
– Beowolf cluster 204 Pentiums
– SGI Origin : >5
![Page 8: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/8.jpg)
Managing Supercomputing Resources, CUG May 20038
Manchester Computing –Managing Resources
� Structure– Administration– Communications, Operations and Systems (COS)– Information Services (IS)– Manchester Computing Informations System Office (MCISO)– Manchester Information and Associated Services (MIMAS)– Supercomputing, Visualization and e-Science (SVE)
� System administration managed by COS group at MC,except for CSAR – managed by CSC.
� Devolvement– Faculty Support Units– Principal Investigators– End users
![Page 9: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/9.jpg)
Man
chest
er
Co
mp
uti
ng
Super
com
puting,
Vis
ual
izat
ion &
eSci
ence
Introduction to UK (Academic) High End Computing
![Page 10: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/10.jpg)
Managing Supercomputing Resources, CUG May 200310
UK High End Computing
� High End Computing– National supercomputing facilities
– SRIF/JREI funded local HPC/cluster facilities
– Locally/other funded institution/department HPC/cluster facilities
� Money from Research Councils UK (RCUK)– Managing agent is EPSRC
� Strategy and implementations formed by– HPC Strategy Committee
– Technology Watch Panel
– Private Consultants
– National HPC Services
![Page 11: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/11.jpg)
Managing Supercomputing Resources, CUG May 200311
National HPC services
� UK has 2 national supercomputing services:
� CSAR, provided by CfS consortium:– University of Manchester (SVE Group)– Computer Sciences Corporation (CSC)– SGI– A Private Finance Initiative (PFI) procurement.
� HPCx, provided by HPCx consortium:– Edinburgh Parallel Computing Centre (EPCC)– Daresbury Laboratory (DL)– IBM– Not a PFI
![Page 12: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/12.jpg)
Man
chest
er
Co
mp
uti
ng
Super
com
puting,
Vis
ual
izat
ion &
eSci
ence
CSAR Access
![Page 13: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/13.jpg)
Managing Supercomputing Resources, CUG May 200313
How it works
� Principal Investigator– Scientific Case
– Justify resources
– List of resources
� RC– Referees report
– Comments from CSAR
� Allocation of Tokens
![Page 14: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/14.jpg)
Managing Supercomputing Resources, CUG May 200314
Applying for Resources
� CSAR Resource Application Form
� Class 1: Full Peer Review
� Class 2: Pump-priming
� Class 3: New application areas
� Class 4: ‘Commercial’ use
![Page 15: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/15.jpg)
Managing Supercomputing Resources, CUG May 200315
Getting Resources
� PI applies to RCs (with advice/help from us)� We comment upon application� We enter resources into database (as proposed)� We complete initial capacity plans� RCs approve grant. PI gets tokens� We change proposed -> live� We perform trades and update capacity plans if necessary� PI invited to register – we approve� PI invites colleagues to register� User fills in web page� PI gets email and through web page approves user� User gets email with username
� Every month RCs are invoiced for tokens used
![Page 16: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/16.jpg)
Managing Supercomputing Resources, CUG May 200316
‘Purchasable’ Resources
� Turing, Fermat, Green and Wren cpu time
� Turing, SAN (Origin) disk– (can use either on the ‘other’ machine)
� Tape storage– (much cheaper than disk)
� Training Courses
� Optimisation/Application support
� Guest System resources
![Page 17: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/17.jpg)
Managing Supercomputing Resources, CUG May 200317
CSAR Resource Calculator
![Page 18: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/18.jpg)
Managing Supercomputing Resources, CUG May 200318
Resources Applied For
![Page 19: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/19.jpg)
Man
chest
er
Co
mp
uti
ng
Super
com
puting,
Vis
ual
izat
ion &
eSci
ence
Registration (Resource Management) System
![Page 20: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/20.jpg)
Managing Supercomputing Resources, CUG May 200320
General Requirements
� Minimise administration
� Make it `easy’ to register
� Rapid response
� Web based
� Hierarchical structure to allow delegation/devolvement.‘Approved users’ (e.g. Principal Investigator) should beable to manage as many of the resources as possible.
![Page 21: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/21.jpg)
Managing Supercomputing Resources, CUG May 200321
CSAR Requirements
� Self Registration.� Allocate any resource.� Resource trading.� Facility for sub-project management.� Individual user allocations.� Usage reporting.� Capacity Planning.� Principal Investigator is primary administrative level. Must
be able to:– Authenticate users.– Sub-allocate resources within group or consortium.– Change users allocations and disk quotas.
![Page 22: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/22.jpg)
Managing Supercomputing Resources, CUG May 200322
Local HPC Requirements
� Subset of CSAR facilities:– Similar organisation using PIs, but registration managed centrally.
![Page 23: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/23.jpg)
Managing Supercomputing Resources, CUG May 200323
MIMAS Requirements
� Registration of the MIMAS service users (~7500 users).– Central registration.
– Resource management (changing passwords, disk quota etc.) devolved tosite representatives
� Crossfire service:– Self registration for users (~13000 users).
– Authentication by Athens service.
� Some requirements shared with CSAR; others specific toMIMAS.
![Page 24: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/24.jpg)
Managing Supercomputing Resources, CUG May 200324
Other Requirements
� Logging of all transactions.
� Live and test sites to allow continued development.
� On-line help.
� Compatiblity with Grid activities.
� Integration with query management system.
� Feedback from user community.
![Page 25: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/25.jpg)
Managing Supercomputing Resources, CUG May 200325
Self Registration
![Page 26: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/26.jpg)
Managing Supercomputing Resources, CUG May 200326
Single person,multiple usernames
![Page 27: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/27.jpg)
Managing Supercomputing Resources, CUG May 200327
Project Resources - PIs
![Page 28: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/28.jpg)
Managing Supercomputing Resources, CUG May 200328
Usage Report - daily
![Page 29: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/29.jpg)
Managing Supercomputing Resources, CUG May 200329
Capacity Plans
![Page 30: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/30.jpg)
Managing Supercomputing Resources, CUG May 200330
Additional Reporting– Select Turing
![Page 31: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/31.jpg)
Managing Supercomputing Resources, CUG May 200331
Select Home Directory Quota
![Page 32: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/32.jpg)
Managing Supercomputing Resources, CUG May 200332
Individual quotas on Turing
![Page 33: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/33.jpg)
Managing Supercomputing Resources, CUG May 200333
Trading Resources
![Page 34: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/34.jpg)
Managing Supercomputing Resources, CUG May 200334
Transaction logging
![Page 35: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/35.jpg)
Managing Supercomputing Resources, CUG May 200335
Managing Queries
![Page 36: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/36.jpg)
Man
chest
er
Co
mp
uti
ng
Super
com
puting,
Vis
ual
izat
ion &
eSci
ence
Structure
![Page 37: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/37.jpg)
Managing Supercomputing Resources, CUG May 200337
Structure ofRegistration System
� Helpdesk service used for all queries managed by MC,based on Action Remedy System (ARS)
� Underlying database package – Oracle.
� Registration system written in Perl in and built as a layer ontop of ARS.
� Executes commands on different systems. Feedback toensure integrity between database and actual systems.
� Person based – single entry in database for person with(potentially) multiple usernames.
� 4 components:– People, affiliation, systems, resources
![Page 38: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/38.jpg)
Man
chest
er
Co
mp
uti
ng
Super
com
puting,
Vis
ual
izat
ion &
eSci
ence
Future Developments
![Page 39: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/39.jpg)
Managing Supercomputing Resources, CUG May 200339
Future Developments
� New version under development.
� General enhancements:– Structural:
• Host machines <-> programs <-> OO Library <-> Database access module <->database
– Independence from underlying software – ARS and Oracle.
– Improve performance for transactions (recent move to multithreadedversion of Oracle gave substantial improvements.)
– Role association, as well as personal.
� Merger of the University of Manchester and UMIST(University of Manchester Institute of Science andTechnology) – project Unity.
� Specific Grid-motivated enhancements.
![Page 40: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/40.jpg)
Managing Supercomputing Resources, CUG May 200340
Project Unity
� University of Manchester – one of the largest universities inUK.– University registration scheme for all students and staff.– Unix user registration scheme for a variety of services managed by
Manchester Computing.
� UMIST– University registration scheme for all students and staff.– Another registration scheme for specific services managed by local
computing support unit.
� A new registration scheme, based on the MC unix userregistration system, is being developed. This will providethe capability to manage all of the separate schemesmentioned above.
![Page 41: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/41.jpg)
Managing Supercomputing Resources, CUG May 200341
UK Grid Environment
� 2002/2005 – significant funding for e-Science projects andcentres.
� How can real science exploit the grid?
� e-Science projects:– Industrial projects
– Pilot projects
– Interdisciplinary Research projects
– Demonstrator projects
– International projects
![Page 42: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/42.jpg)
Managing Supercomputing Resources, CUG May 200342
UK e-Science Centres
![Page 43: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/43.jpg)
Managing Supercomputing Resources, CUG May 200343
UK Grid Resources
� Most e-Science centres have committed resources for griduse.
� The National HPC providers – CSAR and HPCX are bothcommitted to supporting activities on the grid, and willmake some national resources available.– Globus and UNICORE are installed on the CSAR systems.
� Most e-Science pilot projects have been awardedsignificant resources on the national HPC services (CrayT3E, SGI Origin, IBM, SGI Altix), and have access to otherlocal and e-Science facilities.
![Page 44: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/44.jpg)
Managing Supercomputing Resources, CUG May 200344
Grid Registration – The Challenges
� Potentially thousands rather than hundreds of HPC users,and tens of thousands social science and library users.
� Centres in general do not own resources being madeavailable to e-Science programme, nor do they necessarilyhave direct administrative control of them.
� Authentication, Authorisation and Accounting are potentialadministrative nightmares…
![Page 45: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/45.jpg)
Managing Supercomputing Resources, CUG May 200345
Authentication, Authorisation,…
� A Globus-based Grid user requires, for each system to be used:– A username on the system– A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority
(operated by the UK Grid Support Centre).– An entry in the grid-mapfile (to map the certificate name to the username).
� Typically entries in the grid-mapfile are managed by the systemadministrator (by default, the grid-mapfile is owned by root). Need toensure that the user making the request is the same person as ownsthe private key of the certificate. Note that a user may legitimatelypossess multiple certificates, issued by different certificationauthorities.
� Current, informal procedures where grid-mapfile maintainer knowsusers personally cannot scale for projected numbers of Grid users.
� Similar model exists in UNICORE, with the UNICORE User Data Base(UUDB) replacing the grid-mapfile.
� …leads to complicated and excessive administration.
![Page 46: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/46.jpg)
Managing Supercomputing Resources, CUG May 200346
So …
� As we delegate username creation (to the PI), it makessense also to similarly delegate control of the grid-mapfileor UUDB entries.
� Can also add digital certificate authentication, as analternative means to access the registration system (userimports X 509 certificate into browser).
� Can associate one (or more) certificates with the personthat owns the accounts.
![Page 47: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/47.jpg)
Managing Supercomputing Resources, CUG May 200347
Accounting
� Most sites providing resources on the Grid need to know towhom the usage should be charged, which means knowingat least the user and the amount of each resource used.
� In the longer term, we need:– A logging infrastructure that records resource usage.
– A commonly understood means of describing charges.
– A mechanism to negotiate charges between the consumer and the serviceprovider.
– A secure payment mechanism.
� We are pursuing these issues through the UK e-Scienceproject ‘A Market for Computational Services’.
![Page 48: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/48.jpg)
Managing Supercomputing Resources, CUG May 200348
UoM/CSAR ResourceManagement
� The University of Manchester Unix User RegistrationSystem (UURS) already contains many of the featuresrequired:– Delegate authority/administration as far as possible down the tree – to the
Principal Investigator and the end user, thus reducing the burden onsystem administrators.
– A single personal authentication, for use with many systems.
– A charging mechanism for all resources, with the ability to trade resourcesas required.
– Capacity planning to address future requirements.
– Modularity to maximise flexibility.
![Page 49: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/49.jpg)
Managing Supercomputing Resources, CUG May 200349
Summary
� University of Manchester Unix User Registration Systemhandles wide range of resource management activities.
� A major objective has been to devolve administrative tasksas much as possible, to reduce the burden on systemadministrators and to give the users more control.
� New version under development will provide more flexibilityand be capable of supporting a wider range of servicesboth for local and national users of systems based atManchester, and hopefully also in the Grid environment.
� We are open to suggestions …
![Page 50: Manchester Computing · A personal certificate (X 509), issued (e.g) by the UK e-Science certificate authority (operated by the UK Grid Support Centre). – An entry in the grid-mapfile](https://reader034.fdocuments.net/reader034/viewer/2022051806/6002099c12a4a045e34c8a39/html5/thumbnails/50.jpg)
Man
chest
er
Co
mp
uti
ng
Super
com
puting,
Vis
ual
izat
ion &
eSci
ence
World Leading SupercomputingService, Support and Research
Bringing Science andSupercomputers Together
www.man.ac.uk/[email protected]
SVE @ Manchester ComputingSVE @ Manchester Computing