GCE Shell?GGF6 Chicago

October 16 2002

Geoffrey FoxMarlon Pierce

Indiana Universitygcf@indiana.edu

Raw (HPC) Resources

Middleware

Database

PortalServices

SystemServices

SystemServices

SystemServices

Application Service

SystemServices

SystemServices

GridComputing

Environments

UserServices

“Core”Grid

41 GCE Papers• 28 to be published in Concurrency and

Computation:Practice and Experience next issue(s)http://aspen.ucs.indiana.edu/gce/gce2001index.html

• 13 (overlapping somewhat with first set) in "Grid Computing: Making the Global Infrastructure a Reality " edited by Fran Berman, Geoffrey Fox and Tony Hey – http://www.grid2002.org Wiley January 2003

• Classification (Gannon, Thomas) of these found inhttp://aspen.ucs.indiana.edu/CCPEwebresource/c648gridgceoverview/c648gcesurvey.pdfhttp://aspen.ucs.indiana.edu/CCPEwebresource/c650gridgcespcissueoverview/c650gcesurvey.pdf

– Will make into GGF document(s)

Classification of Areas of GCE Papers

• Technology for building GCE systems -Interface with backend Infrastructure e.g. Community Grid Kits, GPDK

• Problem Solving Environments– Domain specific collection of tools and user interface. E.g. XCAT,

Polder, SCIRun, Astrophysics Collaboratory

• GCE Tools– Support parameter sweep, visualization, job status, files, security,

workflow ..

• GCE Shell Portals providing a general interface to many Grid capabilities– Analogous (not usually command line) to role of UNIX shell providing

access to UNIX tools and user programs, files …– Note UNIX has core system and higher level tools accessed by Shell– E.g. Unicore, Hotpage, Mississippi Portal– PSE’s often built on top of GCEShell portals

GCE Shell Issues• Familiar way of thinking and suggests organizational

principles• Note we can learn from

– UNIX shell– Legion shell– JXTA Shell

• Multi-tier model adds richness as need to support “views” and “resources” at user, middle tier (portal itself) and back-end– gce_cat would need to know about files at each level– gce_cp would copy inside and between three levels

• Need to distinguish and manipulate both “real objects” and their meta-data

• GCE Shell Portals provide interface to GCE Shell and specify “programming model” for interaction of objects and meta-data” and between 3 tiers

Interaction in Middle Tier

Shell Command 1 Shell Command 2

Service Implementation Service Implementation

WSDL Interface 1 WSDL Interface 2

Local Pipe

GCE Shell Engine

ApplicationGridServices

Portal(Middle)Tier

More Complicated Interaction

Shell Command 1 Shell Command 2

Service Implementation Service Implementation

WSDL Interface 1 WSDL Interface 2

Local Pipe

Remote Pipe

File Transfer Service Binding

Shell Engine

proxy

GCEShell Areas• File Manipulation• Search• Discovery• Registration• Security• Better workflow than pipe or tee in UNIX shell• Groups and other collaboration features as in JXTA• Meta-data handling• Management and Scheduling• Networks• Profiles• Interaction between User, Middleware and Grid Resources