Neng XUUniversity of Wisconsin-Madison

X D

This instruction is for beginners to setup and test an Xrootd/PROOF pool quickly.

Following up each step and you should be able to get it work. If not, the main problem may be the Firewall.

There is no explanation of configuration files. To understand more, please check: http://root.cern.ch/twiki/bin/view/ROOT/ProofInstallation

If you have further questions, this forum can help you: http://root.cern.ch/phpBB2/

The text in those grey boxes are the commands you need to run.

Xrootd Redirector(PROOF Master)Recommend hardware: Dual Core 2.0GHz, 2GB RAM, 80GB Hard driver.

Data Servers(PROOF Slaves) Recommend hardware: 4xCore 2.4GHz, 8GB RAM, 80GB system hard driver, 500GB data disk or RAID.

pcuw101

pcuwsun01 pcuwsun02

Get ROOT binary package on EVERY machine:If you have 32bit SLC4:> su> cd /opt > wget ftp://root.cern.ch/root/root_v5.18.00.Linux.slc4.gcc3.4.tar.gz > tar zxvf root_v5.18.00.Linux.slc4.gcc3.4.tar.gz

If you have 64bit SLC4:> su> cd /opt > wget ftp://root.cern.ch/root/root_v5.18.00.Linux.slc4_amd64.gcc3.4.tar.gz > tar root_v5.18.00.Linux.slc4_amd64.gcc3.4.tar.gz

Add user “xrootd” on EVERY machine:> su> /usr/sbin/adduser xrootd> mkdir /var/log/xrootd> chown xrootd /var/log/xrootd

pcuw101

pcuwsun01 pcuwsun02

Mount your data disk on Data servers.(In this sample, the data disk (/dev/sdb1) always mount on /xrootd directory.)

> su> mkdir /xrootd> chown xrootd /xrootd> mount /dev/sdb1 /xrootd> df /xrootd

pcuw101

pcuwsun01 pcuwsun02

They are SAME on ALL the nodes. The main configure files are:

◦ /etc/xrootd.cf◦ /etc/proof.conf

The start scripts are:◦ /etc/init.d/xrootd◦ /etc/init.d/olbd

pcuw101

pcuwsun01 pcuwsun02

xrootd.fslib /opt/root/lib/libXrdOfs.so

xrd.port 1094

olb.port 3121

if exec olbd

xrd.sched mint 10 maxt 100 avlt 20

fi

xrootd.export /xrootd/

if pcuw101.cern.ch

ofs.redirect remote

ofs.forward all

else

ofs.redirect target

fi

oss.path /xrootd/ r/w

olb.path rw /xrootd/

if pcuw101.cern.ch

olb.role manager

else

olb.role server

fi

olb.subscribe pcuw101.cern.ch 3121

odc.manager pcuw101.cern.ch 3121

olb.delay startup 30

olb.space 20g 1g

if exec xrootd

xrd.protocol xproofd:1093 /opt/root/lib/libXrdProofd.so

fi

xpd.rootsys /opt/root

xpd.workdir /xrootd/

xpd.intwait 20

xpd.resource static /etc/proof.conf

xpd.role worker

xpd.role master if pcuw101.cern.ch

xpd.allow pcuw101.cern.ch

xpd.poolurl root://pcuw101.cern.ch

xpd.namespace /home/xrootd/proofpool

pcuw101

pcuwsun01 pcuwsun02

Change “pcuw101” to your own Xrootd Redirector’s hostname.

master pcuw101.cern.ch workdir=/xrootd

worker pcuwsun01.cern.ch workdir=/xrootd

worker pcuwsun02.cern.ch workdir=/xrootd

worker pcuwsun01.cern.ch workdir=/xrootd

worker pcuwsun02.cern.ch workdir=/xrootd

worker pcuwsun01.cern.ch workdir=/xrootd

worker pcuwsun02.cern.ch workdir=/xrootd

worker pcuwsun01.cern.ch workdir=/xrootd

worker pcuwsun02.cern.ch workdir=/xrootd

pcuw101

pcuwsun01 pcuwsun02

Change “pcuw101” to your own Xrootd Redirector’s hostname.

Change “pcuwsun01” and “pcuwsun02” to your own Xrootd data servers’ hostname.

> su> cd /etc/init.d> wget http://wisconsin.cern.ch/~nengxu/xrootd_install/xrootd> wget http://wisconsin.cern.ch/~nengxu/xrootd_install/olbd> chmod 755 xrootd> chmod 755 olbd

Go to each machine and do:

> su > cd /etc/init.d > xrootd start > olbd start

pcuw101

pcuwsun01 pcuwsun02

Follow STEP 2 to install ROOT on your desktop or laptop.

After installation, you can start the test.> source /opt/root/bin/thisroot.sh

> xrdcp anyfile.txt root://pcuw101.cern.ch//xrootd/test/anyfile.txt

[xrootd] Total 36.03 MB |====================| 100.00 % [49.6 MB/s]

> xrdcp root://pcuw101.cern.ch//xrootd/test/anyfile.txt anyfile_back.txt

[xrootd] Total 36.03 MB |====================| 100.00 % [49.6 MB/s]

pcuw101

pcuwsun01 pcuwsun02your laptop

source /opt/root/bin/thisroot.sh mkdir ~/proof_test cd ~/proof_test wget http://wisconsin.cern.ch/~nengxu/xrootd_install/PROOF_test.tgz tar zxvf PROOF_test.tgz cd PROOF_test xrdcp proof_test._00001.root root://your_redirector//xrootd/test/proof_test/proof_test._00001.root xrdcp proof_test._00002.root root://your_redirector//xrootd/test/proof_test/proof_test._00002.root

Modify run.C, change TProof::Open("nengxu@pcuw101.cern.ch") to TProof::Open(“yourname@your_redirector")

Modify makechain.C, change chain->Add("root://pcuw101.cern.ch//xrootd/test/proof_test/"+filename) to chain->Add("root://your_redirector//xrootd/test/proof_test/"+filename)

Start running the PROOF job:

Then, you should be able to see these windows.

> source /opt/root/bin/thisroot.sh> root –l[root] .x run.CStarting master: opening connection ...Starting master: OKOpening connections to workers: 1 out of 8 (10 %)PROOF set to parallel mode (8 workers)