SURA NMI Utility Grid: Sharing Resources, Sharing Results SURA Cyberinfrastructure Workshop:

SURA NMI Utility Grid: Sharing Resources, Sharing Results

SURA Cyberinfrastructure Workshop:

Grid Application Planning & ImplementationJanuary 5-7, 2005

Art Vandenberg [email protected]

Director, Advanced Campus Services Georgia State University

Southeastern Universities Research Association


2SURA Cyberinfrastructure Workshop

January 5-7, 2005

The NMI Integration Testbed

• Managed by SURA under NSF ANI-0123937• Testbed Sites evaluate NMI components• Real life research and enterprise contexts• www.nsf-middleware.org/testbed

NMI Participation

DEVELOPERS

SUPPORTERS

CONTRIBUTORS

?

futureexpansion

UABUAHUFLFSUGSU

UMichTACCUVA

Sites

NMI Integration Testbed

(USC)

REUStudents

Testbed Grid

USERS

Implementers

Target Communities

NMI Integration Testbed



January 5-7, 2005

SURA NMI Testbed Grid

• Initiated as a sub-project in September 2003

• Captured dispersed activity into meaningful deliverables• Integrate NMI grid components into the enterprise

• Leverage the NMI Testbed experience

• Identified leads for key areas:• Georgia State University

– “Grid-building” (identifying participants, resources)

– application development (cataloging, exploration)

• University of Virginia– Scaling the Grid

– Technology & policies for cross-certification

– Secure inter-institutional access



January 5-7, 2005

SURA NMI Testbed GRID: vision & action

• Vision – build a model of future grid• Address interoperation - Bridge CA

• Persistent, available resources

• Applications run transparently

• Policy is one of cooperative computing

• SURA NMI Testbed Grid• Continuing NMI Integration Testbed work

• Persistent resources for research and education

• Research, learning, outreach



January 5-7, 2005

What we’ll review…

• Catalog of Grid Applications: data

• SURA NMI Testbed GRID: participants & resources

• Applications: value proposition / outreach

• Portals: eye of the beholder

• Authentication: BridgeCA

• Policy: boundary conditions

• Current status



January 5-7, 2005

Catalog of Grid Applications: data

• Information is a resource– researchers, grids, applications (existing & potential)– 20 Universities, 475 researchers as of Oct 28, 2004…

http://art12.gsu.edu:8080/grid_cat/index5.jsp



January 5-7, 2005

Query: computational fluid dynamics

• Search by name, institution, keywords



January 5-7, 2005

Possible collaboration, information exchange

• Computational fluid dynamics + parallel computing



January 5-7, 2005

Grid Catalog: Coming up

• Online submission of information

• Additional search function: clustering around target info

• Information on resources



January 5-7, 2005

SURA NMI Testbed GRID: participants…

GSU

UAH

UAB

UMICH

UVA

USC

TACC

LSU

GPN

GaTech

SC

DUKE

GMU

Tulane

UARK

TTU



January 5-7, 2005



January 5-7, 2005

Applications: multiple genome alignment

Computation time of multiple sequence alignment program - varying number of elements per processor in different configurations - using 9 processors in each config (cluster, grid cluster, multi-grid cluster)NOTE improvement using MPICH-G2 across multiple clusters (research follow up…?)

Multiple Genome Alignment

Grid-enabled algorithm

Nova Ahmed, Masters CS (Ph.D. student as of Jan 2005); Dr. Yi Pan, Computer Science

UAB Clusters and collaboration

0

20

40

60

80

100

120

140

160

0 10 20 30 40 50

Number of elements per processor

Computation time (sec)

Single Cluster

Single Clustered Grid

Multi Clustered Grid



January 5-7, 2005

Task Farming & Cross Certification

• LSU: Center for Computation & Technology

• Supercomputing 2004 –demonstration

• Explore parameter space for black hole simulation

• Task farming• Submit tasks to grid• Tasks run on various available nodes• Tasks can be transitioned to another node “if needed”

• Cross certification at SURA NMI Testbed Grid BridgeCA• Enables transparent authentication



January 5-7, 2005

Information Technology & Systems Center Global Hydrology Resource Center

• Interactive data search by product, instrument, platform, and date

• Multiple views of data, e.g. search, ftp or calendars

• Automated order packaging for FTP delivery

• Direct FTP access to online data sets

• Subsetting capability

• Shopping cart style order creation

• DODS/OPeNDAP data access

DISCOVER - Distributed Information Services for Climate and Ocean Products and Visualizations for Earth Research

http://datapool.nsstc.nasa.gov



January 5-7, 2005

• Dr. Xiaochun He, Georgia State, Physics – research, outreach...

Muon-detector Grid – Georgia high schools, middle schools

Georgia State Cosmic Ray Lab



January 5-7, 2005

• Dr. Amy Apon – Grid Education• International Workshop on Grid Education

– Grid.Edu 2004 (April 2004) • NSF CCLI: Adaptation of GT3 Tutorials for undergrad CS

– Collaborative with Jens Mache, Lewis & Clark College– http://csce.uark.edu/~aapon/courses/gridcomputing/

• Member TCSC subcommittee on grid computing education

• Great Plains Network Consortium, Extending the Reach Project

• Goal: region-wide collaboration• Goal: middleware infrastructure to share resources• Deployment of Shibboleth (model for Grid AuthN/AuthZ?)• http://archie.csce.uark.edu/gpn/

• Grid resources for graduate education

University of Arkansas



January 5-7, 2005

• University of Alabama – BLAST• Texas Tech – math and statistics, approximation theory• George Mason University – geospatial data services• Texas Advanced Computing Center – computational fluid dynamics• Tulane – computational fluid dynamics• UMich – ATLAS, G4Sims• Georgia State – particle simulation• Georgia Tech – network end-to-end performance

And more application potentials…



January 5-7, 2005

Portals: eye of the beholder

•OGCE – http://www.collab-ogce.org/nmi/index.jsp



January 5-7, 2005

UTGrid: http://www.utgrid.utexas.edu/



January 5-7, 2005

Mgrid: http://www.mgrid.umich.edu/



January 5-7, 2005

U. Alabama at Birmingham: http://uabgrid.uab.edu/



January 5-7, 2005

Georgia State: http://acsgridhead.gsu.edu



January 5-7, 2005

U. of Southern California: http://www.usc.edu/uscgrid



January 5-7, 2005

Portal considerations…• Common portal for SURA NMI Testbed Grid

or

• Portal of Portals

• Integration with Authentication

• “Just give me a command line!”

• Identity for SURA NMI Testbed Grid• Our policy• Our members• Our resources• Our applications



January 5-7, 2005

Typical Hierarchical PKI

Typical Bridge PKI

Authentication: Bridge CA



January 5-7, 2005

AuthN: BridgeCA it works!

• Jim Jokl, UVA, supports BridgeCA

• LSU Center for Computation & Technology – Task farming demo Supercomputing 2004

• Tasks submitted to various grid-enabled clusters• LSU submitted to UVA cluster with cross-certification• LSU credential accepted by UVA cluster via BridgeCA

• Current Status cross-certification with BridgeCA:• UVA, UAB, LSU (completed)• TACC, USC are nearly done• UAH, UARK, GSU, UMICH next phase

• Next: automatic provisioning of Globus Grid Mapfile



January 5-7, 2005

AuthN: additional links

• SURA NMI Testbed cross certification processhttps://www.pki.virginia.edu/nmi-bridge/

• PKI-Lite policy, practices, profileshttp://middleware.internet2.edu/hepki-tag/#PKI_Lite

• CA Software (Options for Enterprise CA)http://middleware.internet2.edu/hepki-tag/opensrc.html

• SURA “Thinking Group” report: SURA Certificate AuthorityJan. 26 – Mar 29, 2004See Appendix A at:

http://www2.gsu.edu/~wwwacs/GRID_Group/min2Dec2004.htm



January 5-7, 2005

Policy: from Formal…

• Policies vary around the Testbed

• Formal policy – USC (http://www.usc.edu/hpcc/)• “The use of rcf-01 and hpc is controlled by the HPCC Allocations

Committee, under the authority of the HPCC Steering Committee. You must fill out an application and submit it to the Allocation Committee to obtain permission to use these facilities.

• HPCC Allocation Policy • HPCC Allocation Request Forms”

• See also http://www.usc.edu/isd/services/accounts/

• Formal policy – Grid3 (http://www.ivdgl.org/grid3/userinfo/)• Project specific (ATLAS, LIGO, iVDGL…)

• General Grid3 user registration (1 page guide)



January 5-7, 2005

Policy: … In-process, informal, none…

• In-Process Policy – UAB• “UABGrid is currently available to members of the UAB community

and we are working on extending its availability across partner institutions and beyond.” http://uabgrid.uab.edu/

• No Grid specific policy – default user account policies

• No formal policy, but may have consequences:



January 5-7, 2005

Policy: evolving model…

• What is SURA NMI Testbed Site policy?

• Observation on Policy for Grid based resources• Must address assumption of local use only

• Absent Grid policy, default to “computer usage” policy

• Cross-boundary use of local credentials not norm

• Social factors (Sharing resources – Yours? vs. Mine?)

• Current SURA NMI Testbed Model• Contribute some, use some

• Cross certify via BridgeCA

• Allow over-subscribing and then address how to handle

• Cooperative Computing – self-organizing/regulating?

• Demonstrate value…



January 5-7, 2005

Post-NMI Integration Testbed Award

• SURA “Grid Think” Working Groups (Jan 2003)• Authentication/CA recommendations

• Grid application analysis

• Workshop planning (Like this event!)

• NMI Submission for “Utility Grid” (May 2004)• Grids for broad, shared use across institutions (not just “big science”)

• Focus on education, research, outreach

• No award, but important development of concepts

• Foundational resource for SURA HPC-Grid Planning Group



January 5-7, 2005

• Dedicated cluster• Persistence is important• Number of nodes: whatever you can manage

• Linux• Globus• Compiler• Cross certification with BridgeCA preferred (other options ok)

• [email protected] list• Biweekly conference calls• Minutes: http://www2.gsu.edu/~wwwacs/GRID_Group/NMI.html

• Join US

SURA Testbed Grid: Basic approach…



January 5-7, 2005

Q&A?

Art Vandenberg [email protected]

Director, Advanced Campus Services

Georgia State University

SURA NMI Utility Grid: Sharing Resources, Sharing Results SURA Cyberinfrastructure Workshop:

Documents

Transcript of SURA NMI Utility Grid: Sharing Resources, Sharing Results SURA Cyberinfrastructure Workshop: