Information & Monitoring Services

Bob Jones – Project Architecture - 1 March 2002 - n° 1

Information & MonitoringServices

Antony WilsonWP3, RAL

[email protected]

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 2

Introduction

information systems – LDAP (Lightweight Directory Access Protocol)

Ftree Globus MDS

information providers RPMs configuration

starting ftree configuration of the GRIS/GIIS registration starting Globus MDS example searches summary


LDAP Information Systems

2 configuration files /etc/edg/info-mds.conf /etc/globus.conf

info-mds.conf configuration of the information providers

globus.conf configuration of Globus MDS

includes registration details


Information Providers - RPMs

configuration edg-info-main-*.i386.rpm

computing element information provider CEInformationProviders-*.i386.rpm

netmon information provider edg-info-netmon-*.i386.rpm

storage element information provider edg-info-se-*.i386.rpm

replica catalogue information provider edg-info-rc-*.i386.rpm


Information Providers - Configuration

configuration via /etc/edg/info-mds.conf generic information site information provider computing element information provider netmon information provider storage element information provider replica catalogue information provider

static data via /opt/edg/info/mds/etc/ldif/*.ldif computing element replica catalogue


info-mds.conf - Generic

WP3_DEPLOY=/opt/edg/info/mdsFTREE_INFO_PORT=2171FTREE_DEBUG_LEVEL=0

# the default value is "Mds-Vo-name=local,o=grid“SITE_DN=Mds-Vo-name=local,o=grid


info-mds.conf - Site

Note this is usually combined with computing element

SITE_INFO=yesSITE_NAME=RALSITE_INSTALLATION_DATE=20011115123410ZSITE_SYSADMIN_CONTACT=grid.sysadmin@gridpp.rl.ac.ukSITE_USER_SUPPORT_CONTACT=grid.support@gridpp.rl.ac.ukSITE_SECURITY_CONTACT=grid.security@gridpp.rl.ac.ukSITE_DATAGRID_VERSION=1SITE_NETMON_HOST=gppnetmon.gridpp.rl.ac.uk

# comma separated list with no spacesSITE_SE_HOSTS=gppse05.gridpp.rl.ac.uk

# comma separated list with no spacesSITE_CE_HOSTS=gppce05.gridpp.rl.ac.uk


info-mds.conf – Computing Element

CE_PRESENT=yesCE_HOST=gppce05.gridpp.rl.ac.ukCE_BATCHSYSTEM=pbsCE_CLUSTER_BATCH_SYSTEM_BIN_PATH=/usr/pbs/bin

# comma separated list with no spacesCE_QUEUE=workq

# comma separated list with no spacesCE_CLOSE_SE_ID=gppse05.gridpp.rl.ac.uk

# comma separated list with no spaces, these values must relate to the corresponding CLOSE_SE_ID

CE_CLOSE_SE_MOUNT_POINT=data


info-mds.conf – Netmon

This will be changing in the next release This is also usually combined with computing elementNETMON_PRESENT=yesNETMON_PINGER_HOST=gppnetmon.gridpp.rl.ac.uk


info-mds.conf – Storage Element

SE_PRESENT=yesSE_ID=gppse05.gridpp.rl.ac.ukSE_SIZE=500000SE_CONTACT=grid.support@gridpp.rl.ac.ukSE_TYPE=disk

# comma separated list with no spaces, this is a list of Vos supported by the SESE_VO=alice,atlas,biomedical,cms,earthob,lhcb

# comma separated list with no spaces, values used in df to obtain freespaceSE_FILESYSTEMS=/dev/hda2,/dev/hda4

# comma separated list with no spacesSE_CLOSE_CE=gppce05.gridpp.rl.ac.uk:2119/jobmanager-pbs-workq

# comma separated list with no spacesSE_PROTOCOLS=gridftp,rfio,file

# comma separated list with no spaces, these values must relate to the corresponding SE_PROTOCOLS

SE_PROTOCOL_PORTS=2811,3147,


info-mds.conf – Replica Catalogue

RC_PRESENT=yesRC_HOST=gpprc05.gridpp.rl.ac.uk

# comma separated list with no spacesRC_VO=alice,atlas,biomedical,cms.earthob,lhcb


Static Information – Computing Element

makes use of static information /opt/edg/info/mds/etc/ldif/ce-static.ldif this will be changing to /opt/edg/etc/info/mds/ce-static.ldif

ldif file can be customized for a queue /opt/edg/info/mds/etc/ldif/ce-static-queuename.ldif

Architecture: intelOpSys: RH 6.2MinPhysMemory: 512MinLocalDiskSpace: 24000NumSMPs: 2MinSPUProcessors: 2MaxSPUProcessors: 2AverageSI00: 450MinSI00: 450MaxSI00: 450RunTimeEnvironment: CMS4.2RunTimeEnvironment: ATLAS1.1AFSAvailable: FALSEOutboundIP:TRUEInboundIP: TRUE

The architecture of the hosts composing the CE

The operating system of the hosts composing the CE

The minimum value of the physical memory among the hosts composing the CE

The minimum local disk footprint

Number of SMP hosts

The minimum number of SPU processors (for SMP hosts)

The Maximum number of SPU processors (for SMP hosts

The Average of the SpecInt2000 benchmark of the nodes associated with the CE

The minimum value of the SpecInt2000 benchmark of the nodes associated with the CE

The maximum value of the SpecInt2000 benchmark of the nodes associated with the CE

A List of software/packages installed on this CE

A List of software/packages installed on this CE

Defines if AFS is installed

Defines if outbound connectivity is allowed

Defines if inbound connectivity is allowed


Static Information – Replica Catalogue

makes use of static information /opt/edg/info/mds/etc/ldif/rc-static.ldif this will be changing to /opt/edg/etc/info/mds/rc-static.ldif

ldif file can be customized for a virtual organization /opt/edg/info/mds/etc/ldif/rc-static-vo.ldif

Rcport: 2001RCmanagerDN: cn=manager,rc=AliceReplicaCatalogue,dc=eu-

datagrid,dc=orgRcurl:

ldap://grid-vo.nikhef.nl:10389/rc=AliceReplicaCatalog,dc=eu-datagrid,dc-org


Starting Ftree

/etc/rc.d/init.d/edginfo-mds start stop restart status

use information provided in /etc/edg/info-mds.conf produces 2 ldif files

one for ftree one for Globus MDS both point to the same information providers

starts/stops ftree


Configuration of the GRIS/GIIS Registration

GRIS Grid Resource Information Server GIIS Grid Index Information Server there is a GRIS on any machine running an information provider there is a GIIS at site level the GRIS’s register with the site GIIS the site GIIS registers with the country GIIS/VO GIIS registration is controlled via /etc/globus.conf


globus.conf - Resource

GRID_INFO_DEBUG_LEVEL=0

GRID_INFO_USER=infouserGRID_INFO_GRIS=yesGRID_INFO_EDG=yes

GRID_INFO_GRIS_REG_GIIS=ralGRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk


globus.conf - Site



GRID_INFO_GRIS_REG_GIIS=ralGRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk

GRID_INFO_GIIS_1=ral#Register with the country GIISGRID_INFO_REG_GIIS_1=ukGRID_INFO_REG_HOST_1=gppinfo.gridpp.rl.ac.uk


globus.conf - Country



GRID_INFO_GRIS_REG_GIIS=ukGRID_INFO_GRIS_REG_HOST=gppinfo.gridpp.rl.ac.uk

GRID_INFO_GIIS_1=uk#Register with the top level GIIs for the testbedGRID_INFO_REG_GIIS_1=datagridGRID_INFO_REG_HOST_1=lxshare0225.cern.ch


Starting Globus MDS

/etc/rc.d/init.d/globus-mds start stop restart status

use information provided in /etc/globus.conf starts/stops Globus MDS


Example Searches

Ftree is on port 2171 Globus MDS is on 2135 search a resource:ldapsearch -x -H ldap://gppse05.gridpp.rl.ac.uk:2135-b 'Mds-Vo-

name=local,o=grid‘ objectclass=* search a site:ldapsearch -x -H ldap://gppce05.gridpp.rl.ac.uk:2135-b 'Mds-Vo-

name=ral,o=grid‘ objectclass=* search a country/VO:ldapsearch -x -H ldap://gppinfo.gridpp.rl.ac.uk:2135-b 'Mds-Vo-

name=uk,o=grid‘ objectclass=* or use an LDAP browser such as mapcentre as provided by WP7

http://ccwp7.in2p3.fr/mapcenter/







Summary

edit /etc/edg/info-mds.conf /etc/globus.conf /opt/edg/info/mds/etc/ldif/*.ldif

this will be changing to /opt/edg/etc/info/mds/*.ldif produce ldifs and start ftree

/etc/rc.d/init.d/edginfo-mds start Globus MDS

/etc/rc.d/init.d/globus-mds documentation available at:

http://hepunx.rl.ac.uk/edg/wp3/








Information & Monitoring Services

Documents

Transcript of Information & Monitoring Services