Rucio Commissioning

ADC Operations

Rucio Commissioning Won’t go into the details of the commissioning • ToDo list and priorities didn’t change respect to 6 weeks

ago https://indico.cern.ch/event/276501/session/1/contribution/3/materia

l/slides/1.pdf https://indico.cern.ch/event/276501/session/17/contribution/58/mate

rial/slides/1.pdf

• But a lot of work has been done in the meanwhile!

28 October 2014ADC Ops 2

..

28 October 2014ADC Ops 3

..

28 October 2014ADC Ops 4

ProdSys2 task with input/output in Rucio

Full chain is ongoing• Not all task finished (evgen and simul OK)

not a real issue, more an error while defining the chain.

• Still assigned manually

Not spot up to now real issues related to Rucio

28 October 2014ADC Ops 5

Horizontal scalability Present situation:

• possible to scale horizontally with “fixed” configuration Judge: rucio-daemon-prod-01, singleprocess, multithread Conveyor: rucio-daemon-prod-02,06,07,08, multiprocess, multithread Hermes: rucio-daemon-prod-02, singleprocess, singlethread Undertaker: rucio-daemon-prod-03, singleprocess, multithread Kronos: rucio-daemon-prod-03, singleprocess, singlethread Automatix: rucio-daemon-prod-04, singleprocess, multithread Transmogrifier: rucio-daemon-prod-04, singleprocess, singlethread Necromancer: rucio-daemon-prod-04, singleprocess, singlethread Reaper: rucio-daemon-prod-05, multiprocess, multithread

• Trying to increase the available VMs now

“Automatic” scalability: • The database change for automatic configuration of scalability of daemons is in

production. The patch to support this is implemented, not in production yet.

28 October 2014ADC Ops 6

Rucio Tape management: stagein Blocker issues resolved• Retries with timestamp

• Bringonline parameters passed to FTS3

Sorting out now details of RSEs for tapes• One RSE for “staging area”

• Mostly internal, between judge and conveyor

28 October 2014ADC Ops 7

Rucio *now*

28 October 2014ADC Ops 8

ongoing Ongoing: spot inconsistencies, under fixing

done

donedone

tested

28 October 2014ADC Ops 9

Still to be done

Ongoing

done

To be validated

Recovery done, monitoring ongoingongoing

Still to be done

OngoingSee rucio-ui

Patched, not deployed

Rucio “others”

ongoing

DQ2 – Rucio migration

28 October 2014ADC Ops 10

Backup

Horizontal scalability from Vincent

28 October 2014ADC Ops 11

.. .• .

• .

.• .

• .

.

28 October 2014ADC Ops 12