GraDS MacroGrid

of 22 /22
GraDS MacroGrid Carl Kesselman USC/Information Sciences Institute

Embed Size (px)


GraDS MacroGrid. Carl Kesselman USC/Information Sciences Institute. MacroGrid Goals. Runtime environment for Grads Experiments Infrastructure services for higher-level GraDS function Clearinghouse for user-oriented resource information Side effect: - PowerPoint PPT Presentation

Transcript of GraDS MacroGrid

  • GraDS MacroGridCarl KesselmanUSC/Information Sciences Institute

  • MacroGrid GoalsRuntime environment for Grads ExperimentsInfrastructure services for higher-level GraDS functionClearinghouse for user-oriented resource informationSide effect:Develop technology and tools to support specialized Grid communities

  • Previous Testbed ExperiencesGUSTO, National Technology GridMany sites, no attempt to specialize, no software resources.Scalablity issues highlighted (e.g. N2 network performance data).IPG, ASCIClosed testbeds, smaller scale, stand-alone information services

  • GraDS MacroGrid ApproachCustomized information space to capture execution spaceGraDS testbed as a virtual organizationWeb based tools to disseminate informationOriented towards users and administratorsAdditional services to support software distribution and other group activities

  • What is a Virtual Organization?Facilitates the workflow of a group of users across multiple domains who share [some of] their resources to solve particular classes of problemsCollates and presents information about these resources in a uniform view

  • Virtual Organization StructureRRRRRRRRRRRRRRRRR

  • Characteristics of VOsShared resources (hardware, software, tools)Geographically dispersedAcross administrative domainsDiffering policies for accessHeterogeneousCommon tasks and goalsCommunity of usersPOC, web pages, mailing lists etc

  • Requirements for Creating a VOUnified view of collated hardware resourcesView of software on each resource (software, versions, patches, include libraries)Local environment infopolicies, installation locations Resource availability within the nodes

    Use Information Services as basis for creating and organizing virtual organizations.

  • Two Classes Of Information ServersResource Description Services (ResDesc)Supplies information about a specific resource (e.g. Globus 1.1.3 GRIS).Aggregate Directory Services (AggDir)Supplies collection of information which was gathered from multiple GRIS servers (e.g. Globus 1.1.3 GIIS).

  • Information ProtocolsGrid Resource Registration ProtocolSupport information/resource discoveryDesigned to support machine/network failureGrid Resource Inquiry ProtocolQuery resource description server for informationQuery aggregate server for informationLDAP V3.0 in Globus 1.1.3

  • VO ArchitectureAAVO-specific AggDirsRRRRStandard ResDesc ServicesRegistrationProtocolUsersEnquiryProtocol

  • GrADs VO ServicesTestbed statusSoftware informationAdministrative InformationResource AvailabilityTwo VO servers set up:USC/ISIUIUC

  • VO ServerServer at ISI and U. IllinoisMultiple registrations per GRISInformation cached in VO serverTTL associated with each piece of informationAccess time bounded by slowest GRISProblems with GIIS timeout discovered and fixedFaulty nodes discoveredSimplified configuration in next version of server

  • GraDS Testbed StatusEnumerate resources available on testbedBased on service registration protocolAvailable via Web page and programmatically via LDAP protocolLimitations in current approachDont have notion of GraDS compliant systems Filtering based on basic software and functionalityDont distinguish between systems that are down and systems that are in the testbed

  • System Status

  • Software InformationA customized software object for GrADSProvided by GRIS and accessed via Web page and LDAP protocolLimited tools provided:Template that is filled in manuallyLimitations of current approach These must be automatically generatedNot used by runtime tools. This is partly a communication issue

  • Software Status Page

  • Resource AvailabilityInformation published through GRISLoad averagesSystem configuration (CPU type, OS, etc)Links to registered softwareNWS informationPartially integratedEasily extensible to incorporate other information

  • Resource Status Information

  • Administrative InformationStandard account pool and common map fileNo tools to support mapfile disseminationProbably adequate for current GraDS testbed

  • Project MilestonesYear one:define.interfaces that enable information sharing across Grid compilers, runtime systems, and libraries.Year two: create early prototypes of runtime and testbed components,

  • MacroGrid SummaryTestbed operational for nine monthsUsed for two application experiments to dateStarting second iteration of testbed technologyPerformance tuning, feature enhancementExtend scope

    Resources are often administered by organizations(vendors, manufacturers)Resources are often administered by organizations(vendors, manufacturers)Let us look at a GrADS software object in some detail

    New Resources could be mechanisms for Data Storage: Say Unitree, we can specify available space, simple policy attributes as required