SRB inSRB in EcogridEcogrid

Bing Zhu

San Diego Supercomputer Center

May 14, 2004

Ecogrid Level I ServicesEcogrid Level I Services

MetacatJava

C

Java

C++

Python

Web services

…

Ecogriduser

user

useruser

user

SRB

DiGIRXanthoria

query

get

Java

SDSC Storage Resource Broker & Meta-data Catalog

SRBArchives

HPSS, ADSM,UniTree, DMF

DatabasesDB2, Oracle,

Sybase

File SystemsUnix, NT,Mac OSX

Application

C, C++, Linux I/O

Unix Shell

Dublin Core

Resource,User

User Defined

ApplicationMeta-data

RemoteProxies

DataCutter

Third-partycopy

Java, NTBrowsers

WebPrologPredicate

MCAT

HRM

MCAT1

MCAT2

MCAT3Server1.1

Server1.2

Server2.1Server2.2

Server3.1

Peer to peer Federated MCAT (3.0 +)Peer to peer Federated MCAT (3.0 +)

Ecogrid Query Service Ecogrid Query Service implementation for SRB systemimplementation for SRB system

Ecogrid Query for SRB data source is based on search on metadata data which includes

system metadata (create date, owner, size, etc)

user metadata

SRB Server

Flow of SRB QueryFlow of SRB Queryuser

Ecogrid node

SEEK Query document

SeekXMLQueryDocSRBParser

SRB MCAT

Submit SRB Query

Jargon

Translate SRB query result to Ecogrid ResultSet SRB Query

results

Ecogrid Resultsets

Query Example 1Query Example 1

Ecogrid Query adopts a query schema, Query Document Schema, as a common query language within Ecogrid.

<?xml version="1.0" encoding="UTF-8"?>

…

<egq:query queryId="test.1.1" system="http://knb.ecoinformatics.org"

xmlns:egq="ecogrid://ecoinformatics.org/ecogrid-query-1.0.0beta1"

xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"

xsi:schemaLocation="ecogrid://ecoinformatics.org/ecogrid-query-1.0.0beta1 ../../src/xsd/query.xsd">

<namespace prefix="eml"> … </namespace>

<title>metadata query for Eco Models</title>

<AND>

< condition operator=“LIKE" concept=" srbUR”I>srb://testuser.sdsc:passwd@srb.sdsc.edu:6617/home/testuser.sdsc</condition>

<condition operator="EQUALS" concept="Number of Species">2</condition>

<condition operator="LIKE" concept="file name">%Model%</condition>

</AND>

</egq:query>

<AND>

< condition operator=“LIKE" concept=" srbUR”I>srb://testuser.sdsc:passwd@srb.sdsc.edu:6617/home/testuser.sdsc</condition>

<condition operator="EQUALS" concept="Number of Species">2</condition>

<condition operator="LIKE" concept="file name">%Model%</condition>

</AND>

Query Example 2Query Example 2<?xml version="1.0" encoding="UTF-8"?>

…

<AND>

<condition operator=“EQUALS" concept=“srbUser”>testuser</condition>

<condition operator=“EQUALS" concept="MdasDomain”>sdsc</condition>

<condition operator=“LIKE" concept="MdasHome”>/home/testuser.sdsc</condition>

<condition operator=“EQUALS" concept=“srbPort”>6617</condition>

<condition operator=“EQUALS" concept=" srbPasswd”>passwd</condition>

<condition operator=“EQUALS" concept=" AuthScheme”>encrypt1</condition>

<AND>

<condition operator="EQUALS" concept="Number of Species">2</condition>

<condition operator="LIKE" concept="file name">%Model%</condition>

</AND>

</AND>

</egq:query>

Ecogrid Services implementation for Ecogrid Services implementation for SRB system (get)SRB system (get)

A ‘get’ call from ecogrid to SRB system means to retrieve the content of a dataset.

The ‘get’ function can also be used to submit a SQL query for a relational database (Oracle, DB2, etc), which is pre-registered as a data source in SRB.

SRB getSRB getuser

Ecogrid node

Jargon

Bytes or a text string for a DB SQL

file system

SRB MCAT

SEEK get request

bytes

OracleSRB

Server

SRB Server

SRB file I/O

Submit SQL query

Wrapped results

Resolve SRB file name

srb.sdsc.edu

ec.wisc.edu