EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3...

13
EGEE is funded by the European Union under contract IST-2003- 508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided by the Grid

Transcript of EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3...

Page 1: EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.

EGEE is funded by the European Union under contract IST-2003-508833

Elena SlabospitskayaIHEP

NA3 manager for Russia

An inroduction to services provided

by the Grid

Page 2: EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.

LCG-2 User Guidehttps://edms.cern.ch/file/454439//LCG-2-UserGuide.html

LCG Releaseshttp://grid-deployment.web.cern.ch/grid-deployment/cgi-bin/index.cgi?var=releasesLCG-2 Install Notes (for administrators)

LCG-2 Manual Installation Guide (for administrators)https://edms.cern.ch/file/434070//LCG2Install.htmlSite with EDG

Tutorialshttp://hep-proj-grid-tutorials.web.cern.ch/hep-proj-grid-tutorials/

Sources of the information

Page 3: EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.

- Generate a certificate request grid-cert-request -int- Modify the passphrase of your private key grid-change-pass-phrase- Check the content of your credentials grid-cert-info & grid-proxy- Log into the Grid: create proxy grid-proxy-init & edg-voms-proxy-init- Long-tem proxy( > 12hours) myproxy-init -s lcg14.sinp.msu.ru -d -v -n myproxy-info -s lcg14.sinp.msu.ru -d

Exercise: Credentials

Page 4: EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.

Exercise: Job Description

The language used to describe a job is Job Description Language (JDL) Mandatory ( test.jdl)Executable = "/bin/hostname";StdOutput = "std.out";StdError = "std.err";OutputSandbox = {"std.out","std.err"}; OptionalOutputSE -specifies the SE where the user wants to store output data.OutputData – automatically registeres data files in the GridEnvironment = {"CMS_PATH=$HOME/cms", "CMS_DB=$CMS_PATH/cmdb"};Arguments = "Hello Grid";

Page 5: EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.

CLIedg-job-list-match -vo <VO> test.jdledg-job-submit -vo <VO> test.jdl edg-job-status <edg_JobId> edg-job-get-logging-info <edg_JobId> edg-job-get-output <edg_JobId>edg-job-submit -vo <VO> interactive.jdledg-job-submit -vo <VO> perltest.jdl

GUI edg-wl-ui-jdleditor.sh edg-wl-ui-jobmonitor.sh edg-wl-ui-jobsubmitter.sh

Exercise: Job Submission

Page 6: EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.

Exercise: Data Management

edg-rm --vo <VO> printInfo

edg-rm –vo <VO> listReplicas <GUID>

edg-rm --vo <VO> copyAndRegisterFile file:<full path>/LCG-2-UserGuide.html -l lfn:LCG-2-UserGuide.html -d <CloseSE>

edg-rm --vo <VO> replicateFile <guid> -d <SE>

edg-rm --vo <VO> getTurl <SURL> <protocol>

globus-url-copy -vb file://`pwd`/LCG-2-UserGuide.html <TURL>

edg-rm --vo <VO> del <GUID> --all-available

edg-rm --vo dteam ls <SURL>

Page 7: EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.

Exercise: Put a file to Storage

copyAndRegisterFile

getTurl

globus-url-copy & copyFile <LFN> <local> & rfcp

CloseSE SRM

GUID

listReplicas & replicateFileSURL

TURL

MSS

edg-gridftp-exists, rm, ls

Page 8: EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.

Exercise: Information System

ldapsearch -x -h lxb0738.cern.ch -p 2135 -b "mds-vo-name=local, o=grid"

The local GRISes running on Computing Elements and Storage Elements

In LDAP, a special attribute objectClass is defined for each directory entry

At each site, a site GIIS collects information about all resources

ldapsearch -x -h lxb0738.cern.ch -p 2135 -b "mds-vo-name=LCGCERTTB2P, o=grid"

ldapsearch -x -h lxb0738.cern.ch -p 2135 -b "mds-vo-name=local, o=grid" 'objectClass=SiteInfo' SiteName

Page 9: EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.

Appendix A. Test.jdl

Executable = "/bin/hostname";StdOutput = "std.out";StdError = "std.err";OutputSandbox = {"std.out","std.err"};

Page 10: EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.

Appendix B. interactive.jdl & interactive.sh

JobType = "Interactive" ;Executable = "interactive.sh" ;InputSandbox = {"interactive.sh"} ;

interactive.jdl

interactive.sh#!/bin/sh

echo "Welcome!"echo -n "Please tell me your name: "read nameecho "That is all, $name."echo "Bye bye."exit 0

Page 11: EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.

Executable = "perltest.pl";InputSandbox = {"perltest.pl"} ;Arguments = "Grid";StdOutput = "std.out";StdError = "std.err";OutputSandbox = {"std.out","std.err"};

#!/usr/bin/perl -s

if ($ARGV[0]) {$argument= $ARGV[0];}print "Your argument is $argument","\n";

perltest.jdl

perltest.pl

Appendix C. perltest.jdl & perltest.pl

Page 12: EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.

Requirements = other.GlueCEInfoLRMSType == "PBS" && other.GlueCEInfoTotalCPUs > 1;

Requirements = other.GlueCEUniqueID == "lxshare0286.cern.ch:2119/jobmanager-pbs-short";Requirements = Member("CMSIM-133",other.GlueHostApplicationSoftwareRunTimeEnvironment);Requirements = RegExp("cern.ch", other.GlueCEUniqueId);

Appendix Y. Useful examples

Requirements = anyMatch(other.storage.CloseSEs,target.GlueSAStateAvailableSpace > 204800);

InputData = {"lfn:doe/prod/kin_1", "guid:136b48a64-4a3d-87ud-3bk58gnn46m49f3"};DataAccessProtocol = {"rfio", "gsiftp"};

Page 13: EGEE is funded by the European Union under contract IST-2003-508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.

Appendix Z. Possible Job States

SUBMITTED

WAITING

READY

SCHEDULED

RUNNING

DONE(ok)DONE(failed)

OUTPUTREADY

CLEARED

ABORTEDDONE(cancelled)