Architecture
-
Upload
dustin-carlson -
Category
Documents
-
view
10 -
download
0
description
Transcript of Architecture
Software Sustainability Institute
www.software.ac.uk
Architecture
InputPySpillGenerator
ReducePyDoNothing
OutputPyJSON
MapPyGroupMapPyBeamMapper
MapCppSimulation
MapCppTrackerDigitization
spill N
(spill N)’
In-memory cache
DAQ
InputCppDAQOnlineData
ReducePyTOFPlot
OutputPyImage
MapPyGroupMapCppTOFDigits
MapCppTOFSlabHits
MapCppTOFSpacePoints
spill N
(spill N)’
In-memory cache
INPUT
MERGE
OUTPUT
TRANSFORM
In-memory cache
Software Sustainability Institute
www.software.ac.uk
Software development
Input
Output
Celery
DAQ
Web front-end
Transform
spill N
Transform
spill N+1
Transform
spill N-1
(spill N)’ (spill N+1)’(spill N-1)’
Merge
parallel transform execution
histogram mergers
web front-end
document-oriented database
Software Sustainability Institute
www.software.ac.uk
Celery and RabbitMQ
RabbitMQ Celery Worker
Celery Worker
Celery Worker
Software Sustainability Institute
www.software.ac.uk
Celery workers and tasks
RabbitMQ Celery Worker
Go.py
spill
spill’
Celery Proxy
spill
spill’
Celery Worker
Celery WorkerTransform
spill
spill’
Transform
Transform
Transform
Transform
Transform
Software Sustainability Institute
www.software.ac.uk
Celery workers and broadcasts
RabbitMQ
Go.py
configuration
Celery Proxy
configuration
configuration
configuration
configuration
status
status
status
status
status
Celery Worker
Celery Worker
Celery WorkerTransform
Transform
Transform
Transform
Transform
Transform