GraDS MacroGridCarl KesselmanUSC/Information Sciences Institute

MacroGrid GoalsRuntime environment for Grads ExperimentsInfrastructure services for higher-level GraDS functionClearinghouse for user-oriented resource informationSide effect:Develop technology and tools to support specialized Grid communities

Previous Testbed ExperiencesGUSTO, National Technology GridMany sites, no attempt to specialize, no software resources.Scalablity issues highlighted (e.g. N2 network performance data).IPG, ASCIClosed testbeds, smaller scale, stand-alone information services

GraDS MacroGrid ApproachCustomized information space to capture execution spaceGraDS testbed as a virtual organizationWeb based tools to disseminate informationOriented towards users and administratorsAdditional services to support software distribution and other group activities

What is a Virtual Organization?Facilitates the workflow of a group of users across multiple domains who share [some of] their resources to solve particular classes of problemsCollates and presents information about these resources in a uniform view

Virtual Organization StructureRRRRRRRRRRRRRRRRR

Characteristics of VOsShared resources (hardware, software, tools)Geographically dispersedAcross administrative domainsDiffering policies for accessHeterogeneousCommon tasks and goalsCommunity of usersPOC, web pages, mailing lists etc

Requirements for Creating a VOUnified view of collated hardware resourcesView of software on each resource (software, versions, patches, include libraries)Local environment infopolicies, installation locations Resource availability within the nodes

Use Information Services as basis for creating and organizing virtual organizations.

Two Classes Of Information ServersResource Description Services (ResDesc)Supplies information about a specific resource (e.g. Globus 1.1.3 GRIS).Aggregate Directory Services (AggDir)Supplies collection of information which was gathered from multiple GRIS servers (e.g. Globus 1.1.3 GIIS).

Information ProtocolsGrid Resource Registration ProtocolSupport information/resource discoveryDesigned to support machine/network failureGrid Resource Inquiry ProtocolQuery resource description server for informationQuery aggregate server for informationLDAP V3.0 in Globus 1.1.3

VO ArchitectureAAVO-specific AggDirsRRRRStandard ResDesc ServicesRegistrationProtocolUsersEnquiryProtocol

GrADs VO ServicesTestbed statusSoftware informationAdministrative InformationResource AvailabilityTwo VO servers set up:USC/ISIUIUC

VO ServerServer at ISI and U. IllinoisMultiple registrations per GRISInformation cached in VO serverTTL associated with each piece of informationAccess time bounded by slowest GRISProblems with GIIS timeout discovered and fixedFaulty nodes discoveredSimplified configuration in next version of server

GraDS Testbed StatusEnumerate resources available on testbedBased on service registration protocolAvailable via Web page and programmatically via LDAP protocolLimitations in current approachDont have notion of GraDS compliant systems Filtering based on basic software and functionalityDont distinguish between systems that are down and systems that are in the testbed

System Status

Software InformationA customized software object for GrADSProvided by GRIS and accessed via Web page and LDAP protocolLimited tools provided:Template that is filled in manuallyLimitations of current approach These must be automatically generatedNot used by runtime tools. This is partly a communication issue

Software Status Page

Resource AvailabilityInformation published through GRISLoad averagesSystem configuration (CPU type, OS, etc)Links to registered softwareNWS informationPartially integratedEasily extensible to incorporate other information

Resource Status Information

Administrative InformationStandard account pool and common map fileNo tools to support mapfile disseminationProbably adequate for current GraDS testbed

Project MilestonesYear one:define.interfaces that enable information sharing across Grid compilers, runtime systems, and libraries.Year two: create early prototypes of runtime and testbed components,

MacroGrid SummaryTestbed operational for nine monthsUsed for two application experiments to dateStarting second iteration of testbed technologyPerformance tuning, feature enhancementExtend scope

Resources are often administered by organizations(vendors, manufacturers)Resources are often administered by organizations(vendors, manufacturers)Let us look at a GrADS software object in some detail

New Resources could be mechanisms for Data Storage: Say Unitree, we can specify available space, simple policy attributes as required