Architecture

7
Software Sustainability Institute www.software.ac. uk Architecture InputPySpillGener ator ReducePyDoNoth ing OutputPyJS ON MapPyGroup MapPyBeamMapper MapCppSimulat ion MapCppTrackerDigitiza tion spill N (spill N)’ In-memory cache DAQ InputCppDAQOnline Data ReducePyTOFPlo t OutputPyIma ge MapPyGroup MapCppTOFDigits MapCppTOFSlab Hits MapCppTOFSpacePoints spill N (spill N)’ In-memory cache INPUT MERGE OUTPUT TRANSFORM In-memory cache

description

Architecture. DAQ. INPUT. InputPySpillGenerator. InputCppDAQOnlineData. spill N. spill N. MapPyGroup. MapPyGroup. TRANSFORM. MapPyBeamMapper. MapCppTOFDigits. MapCppSimulation. MapCppTOFSlabHits. MapCppTrackerDigitization. MapCppTOFSpacePoints. (spill N)’. (spill N)’. - PowerPoint PPT Presentation

Transcript of Architecture

Software Sustainability Institute

www.software.ac.uk

Architecture

InputPySpillGenerator

ReducePyDoNothing

OutputPyJSON

MapPyGroupMapPyBeamMapper

MapCppSimulation

MapCppTrackerDigitization

spill N

(spill N)’

In-memory cache

DAQ

InputCppDAQOnlineData

ReducePyTOFPlot

OutputPyImage

MapPyGroupMapCppTOFDigits

MapCppTOFSlabHits

MapCppTOFSpacePoints

spill N

(spill N)’

In-memory cache

INPUT

MERGE

OUTPUT

TRANSFORM

In-memory cache

Software Sustainability Institute

www.software.ac.uk

Software development

Input

Output

Celery

DAQ

Web front-end

Transform

spill N

Transform

spill N+1

Transform

spill N-1

(spill N)’ (spill N+1)’(spill N-1)’

Merge

parallel transform execution

histogram mergers

web front-end

document-oriented database

Software Sustainability Institute

www.software.ac.uk

Celery and RabbitMQ

RabbitMQ Celery Worker

Celery Worker

Celery Worker

Software Sustainability Institute

www.software.ac.uk

Celery workers and tasks

RabbitMQ Celery Worker

Go.py

spill

spill’

Celery Proxy

spill

spill’

Celery Worker

Celery WorkerTransform

spill

spill’

Transform

Transform

Transform

Transform

Transform

Software Sustainability Institute

www.software.ac.uk

Celery workers and broadcasts

RabbitMQ

Go.py

configuration

Celery Proxy

configuration

configuration

configuration

configuration

status

status

status

status

status

Celery Worker

Celery Worker

Celery WorkerTransform

Transform

Transform

Transform

Transform

Transform

Software Sustainability Institute

www.software.ac.uk

Histogram mergers

Software Sustainability Institute

www.software.ac.uk

Current state