Bouchra RAHIM([email protected]) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

18
www.epikh.eu The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Bouchra RAHIM([email protected]) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011 gLite UI Installation

description

gLite UI Installation. Bouchra RAHIM([email protected]) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011. gLite UI. The access point to the glite Grid is the User Interface This can be any machine where users have an account and where their user certificate is installed - PowerPoint PPT Presentation

Transcript of Bouchra RAHIM([email protected]) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

Page 1: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

www.epikh.eu

The EPIKH Project(Exchange Programme to advance e-Infrastructure Know-How)

Bouchra RAHIM([email protected])

Joint EPIKH/EUMEDGRID-Support Event in Rabat

Morocco, 30.05.2011

gLite UI Installation

Page 2: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

gLite UI

• The access point to the glite Grid is the User Interface– This can be any machine where users have an account and

where their user certificate is installed• From a UI, a user can be authenticated and authorized to use the glite

Grid resources• It provides CLI tools to perform some basic Grid operations:

– list all the resources suitable to execute a given job;– submit jobs for execution;– cancel jobs;– retrieve the output of finished jobs;– show the status of submitted jobs;– retrieve the logging and bookkeeping information of jobs;– copy, replicate and delete files from the Grid;– retrieve the status of different resources from the Inforamtion

System

2

Page 3: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

• The instructions provided in this presentation assume that you are going to use a machine with Scientific Linux 5.4 installed.

– Virtual Machine image (GILDA VM Base_SLC5.4_x86_64) available at:https://gilda.ct.infn.it/VirtualServices.html

3

Preliminaries

Page 4: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

Login as [email protected]

XX = 01, 02, 03, ….., 28

Password: grid2011

Preliminaries

Preliminaries

Page 5: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

5

System requirements

• Check if exists the ntp service otherwise install that:yum install ntp

• Check that public machine name is NOT an alias for “localhost”, but appears on a line by its own, like in the following:

• Please check:– If you have a valid hostname

– To verify, type: hostname -f– To edit the hostname:

• Disable Selinux: make sure /etc/selinux/config contains line:

• REBOOT your server, for changes to take effect

vim /etc/hostname vim /etc/sysconfig/network hostname <pc_name> service network restart

vim /etc/hostname vim /etc/sysconfig/network hostname <pc_name> service network restart

root# cat /etc/hosts

213.92.16.191 servername.some.domain.org servername

127.0.0.1 localhost.localdomain localhost

root# cat /etc/hosts

213.92.16.191 servername.some.domain.org servername

127.0.0.1 localhost.localdomain localhost

SELINUX=disabled SELINUX=disabled

Page 6: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

• Disable automatic yum update:

– chkconfig yum off ; service yum stop

• Similarly disable other useless services (sendmail, pcmcia, isdn,...): see for example http://wiki.eumedgrid.eu/twiki/bin/view/InfrastructureStatus/SiteSecurityAndPerformance

• Cleanup yum cache:

– yum clean all

• Download list of important packages from CIC portal, https://cic.gridops.org/index.php?section=vo&vo=eumed see section “Other requirements” and save to a file, then issue command:

– cat <file.txt> | xargs -i yum -y install {}

6

System requirements (2/2)

Page 7: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

7

Repository settings

• Specify the mrepo host:export MREPO=http://repo.magrid.ma/yumrepo/glite32

• Configure the repository as follows:REPOS="dag glite-GENERIC lcg-CA glite-UI"

• Get repositories with:for name in $REPOS;do wget $MREPO/$name.repo -O /etc/yum.repos.d/$name.repo; done

• Install CAs (this need to be done for ANY profile):

yum install lcg-CA ca-policy-egi-core ca-policy-lcg

Page 8: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

• Glite UI Metapackage installation:

yum groupinstall glite-UI– we use groupinstall command to install all the packages for

the glite-UI group of packages, read from the comps.xml file on the repo server.

– glite-UI: all the software needed to install and run a gLite User Interface, yaim-utilities for the configuration of the UI, libraries, and all the CLI tools to interact with the gLite Grid services.

8

YUM install

Page 9: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

9

site-info.def

• All the configuration samples files are located in /opt/glite/yaim/examples/siteinfo directory

• it’s better to make a copy of the original files

• Open your own site-info.def and customize it:

vi /opt/glite/yaim/etc/siteinfo/site-info.defvi /opt/glite/yaim/etc/siteinfo/site-info.def

mkdir /opt/glite/yaim/etc/siteinfo/

cp /opt/glite/yaim/examples/siteinfo/site-info.def /opt/glite/yaim/etc/siteinfo/site-info.def

mkdir /opt/glite/yaim/etc/siteinfo/

cp /opt/glite/yaim/examples/siteinfo/site-info.def /opt/glite/yaim/etc/siteinfo/site-info.def

Page 10: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

https://twiki.cern.ch/twiki/bin/view/LCG/Site-info_configuration_variables#UI

BDII_HOST=bdii.eumedgrid.eu (or your own if you have one)WMS_HOST=wms-01.eumedgrid.eu (or your own if you have one)LB_HOST=wms-01.eumedgrid.eu (or your own if you have one)PX_HOST=myproxy.ct.infn.itLFC_HOST=lfc.ulakbim.gov.tr (or your own if you have one)DPM_HOST=torik1.ulakbim.gov.tr (or your own if you have one)

10

EUMED Settings - Setup site-info.def

Page 11: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

Add EUMED Settings

VOS="eumed" Add eumed hereVO_EUMED_SW_DIR=$VO_SW_DIR/eumed

VO_EUMED_DEFAULT_SE=$SE_HOST

VO_EUMED_STORAGE_DIR=$CLASSIC_STORAGE_DIR/eumed

VO_EUMED_VOMS_SERVERS="'vomss://voms2.cnaf.infn.it:8443/voms/eumed?/eumed' 'vomss://voms-02.pd.infn.it:8443/voms/eumed?/eumed'"

VO_EUMED_VOMSES="'eumed voms2.cnaf.infn.it 15016 /C=IT/O=INFN/OU=Host/L=CNAF/CN=voms2.cnaf.infn.it eumed' 'eumed voms-02.pd.infn.it 15016 /C=IT/O=INFN/OU=Host/L=Padova/CN=voms-02.pd.infn.it eumed'"

VO_EUMED_VOMS_CA_DN="'/C=IT/O=INFN/CN=INFN CA' '/C=IT/O=INFN/CN=INFN CA'"

VO_EUMED_WMS_HOSTS="wms-4.dir.garr.it wms.ulakbim.gov.tr wms-01.eumedgrid.eu wms.grid.arn.dz rb-eugrid.eri.sci.eg“

!Make sure to comment VO_<vo_name>...

11

Page 12: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

Add EUMED Settings-users

• Add following lines to users.conf file pointed to by variable USERS_CONF in your siteinfo.def file– 3101:eumed001:2418:eumed:eumed::– 3102:eumed002:2418:eumed:eumed::– 3103:eumed003:2418:eumed:eumed::– 3104:eumed004:2418:eumed:eumed::– 3105:eumed005:2418:eumed:eumed::– …..– 3201:sgmeumed001:2419,2418:sgmeumed,eumed:eumed:sg

m:– 3202:sgmeumed002:2419,2418:sgmeumed,eumed:eumed:sg

m:– 3203:sgmeumed003:2419,2418:sgmeumed,eumed:eumed:sg

m:

See ftp://repo.magrid.ma/pub/GridSchoolConfFiles/Location, Meeting title, dd.mm.yyyy 12

Page 13: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

Add EUMED Settings-groups

• Add following lines to groups file pointed to by variable GROUPS_CONF in your site-info.def

– "/eumed/ROLE=SoftwareManager":::sgm:– “/eumed"::::

– See ftp://repo.magrid.ma/pub/GridSchoolConfFiles/

Location, Meeting title, dd.mm.yyyy 13

Page 14: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

14

Configuring UI• Update the date (ftp://repo.magrid.ma/pub/GridSchoolConfFiles/)

configure ntp : /etc/ntp.conf , /etc/ntp/step-tickers

/etc/init.d/ntpd stop

ntpdate ntp.marwan.ma

/etc/init.d/ntpd start

• Disable iptables

• service iptables stop

• Chkconfig iptables off

• Configure the UI with YAIM (To check the syntax : source <path_to_siteinfo>/site-info.def )

/opt/glite/yaim/bin/yaim -c -s <path_to_siteinfo>/site-info.def -n glite-UI

• If everything is ok, the UI is now READY for testing

YAIM does not configure the LFC_HOST variable; please edit the file

/opt/glite/etc/profile.d/grid-env.sh and add the following for eumed:

gridenv_set "LFC_HOST" "lfc.ulakbim.gov.tr"gridenv_set "LFC_HOST" "lfc.ulakbim.gov.tr"

Page 15: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

15

[root@pc01 ~]# adduser grid01

[root@pc01 ~]# mkdir /home/grid01/.globus

[root@pc01 ~]# cp /root/user_cert/usercert.pem /home/grid01/.globus/usercert.pem

[root@pc01 ~]# cp /root/user_cert/userkey.pem /home/grid01/.globus/userkey.pem

[root@pc01 ~]# chown grid01 /home/grid01/.globus/usercert.pem

[root@pc01 ~]# chown grid01 /home/grid01/.globus/userkey.pem

[root@pc01 ~]# chmod 400 /home/grid01/.globus/userkey.pem

[root@pc01 ~]# su – grid01

[grid01@pc01 ~]$ voms-proxy-init --voms eumed

Enter GRID pass phrase: [grid2011]

Your identity: /C=MA/O=MaGrid/OU=CNRST/CN=Grid School

Creating temporary proxy .................................................................

....................................... Done

Contacting voms2.cnaf.infn.it:15016 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=voms2.cnaf.infn.it] "eumed" Done

Creating proxy ........................................................................................ Done

Your proxy is valid until Sun May 29 04:25:35 2011

[root@pc01 ~]# adduser grid01

[root@pc01 ~]# mkdir /home/grid01/.globus

[root@pc01 ~]# cp /root/user_cert/usercert.pem /home/grid01/.globus/usercert.pem

[root@pc01 ~]# cp /root/user_cert/userkey.pem /home/grid01/.globus/userkey.pem

[root@pc01 ~]# chown grid01 /home/grid01/.globus/usercert.pem

[root@pc01 ~]# chown grid01 /home/grid01/.globus/userkey.pem

[root@pc01 ~]# chmod 400 /home/grid01/.globus/userkey.pem

[root@pc01 ~]# su – grid01

[grid01@pc01 ~]$ voms-proxy-init --voms eumed

Enter GRID pass phrase: [grid2011]

Your identity: /C=MA/O=MaGrid/OU=CNRST/CN=Grid School

Creating temporary proxy .................................................................

....................................... Done

Contacting voms2.cnaf.infn.it:15016 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=voms2.cnaf.infn.it] "eumed" Done

Creating proxy ........................................................................................ Done

Your proxy is valid until Sun May 29 04:25:35 2011

Testing UI

Page 16: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

Testing UI for GILDA

• OtherTests:

Copy a jdl file:

Password [grid01]

Submit a job:

16

scp [email protected]:/home/grid01/hostname.jdl .scp [email protected]:/home/grid01/hostname.jdl .

lfc-ls /gridlfc-ls /grid

glite-wms-job-submit -a –o jobid hostname.jdl glite-wms-job-submit -a –o jobid hostname.jdl

Page 17: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

• For the real installation you have to export you personal certificate from web browser to the UI and than have a look at the following: ATTENTION USE eumed INSTEAD gilda

• Certificate management:

https://grid.ct.infn.it/twiki/bin/view/GILDA/HowToConvertPkcs12ToPem

• Voms creation with extentions

https://grid.ct.infn.it/twiki/bin/view/GILDA/AuthenticationAuthorization#Creation_of_a_proxy_with_voms_ex

• Job Submission

https://grid.ct.infn.it/twiki/bin/view/GILDA/SimpleJobSubmission

• Data Management

https://grid.ct.infn.it/twiki/bin/view/GILDA/DataManagement

17

Testing UI for EUMED Installation

Page 18: Bouchra RAHIM(rahim@cnrst.ma) Joint EPIKH/EUMEDGRID-Support Event in Rabat Morocco, 30.05.2011

18

References

INFNGrid installation http://igrelease.forge.cnaf.infn.it/doku.php?id=doc:guides:install-3_2

EUMED wiki for system administrators: http://wiki.eumedgrid.eu/twiki/bin/view/InfrastructureStatus/EumedSiteInstallation