PowerPoint (8.6 MB)

28
© 2013 Paul Scherrer Institut Slides available at http://people.web.psi.ch/ischebeck Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner, Helge Brands, Rasmus Ischebeck > The Past > Accelerator Data Acquisition > Design Ideas > The Present > Available Tools > Demo > The Future > Data Acquisition with Large Data Sets at 100 Hz 1

Transcript of PowerPoint (8.6 MB)

Page 1: PowerPoint (8.6 MB)

© 2013 Paul Scherrer Institut Slides available at http://people.web.psi.ch/ischebeck

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

ADAQAAn Accelerator Data Acquisition & Analysis FrameworkBolko Beutner, Helge Brands, Rasmus Ischebeck

>The Past>Accelerator Data Acquisition>Design Ideas

>The Present>Available Tools>Demo

>The Future>Data Acquisition with Large Data Sets at 100 Hz

1

Page 2: PowerPoint (8.6 MB)

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

What Came Before…(my personal collection of accelerator data acquisition)

>TESLA Test Facility at DESY, Hamburg>Access to accelerator process variables from MATLAB, C++ (read/write)>Easy to write data acquisition software, scan parameters, record variables…>Data stored in .MAT, ASCII & ROOT files>No common data format>Experts required to set up scan, analyze data…

>SLAC LINAC at Stanford, California>VAX-based control system>Scan software to determine the dependency of a variable on a parameter>On-line display & fits>Writes MATLAB 4 files for further analysis

2

Page 3: PowerPoint (8.6 MB)

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

Design Goals>Have a universal scan and data acquisition software

>Well-tested scan core>Universal GUI to set up scan easily>Specialized GUIs for easy access for regularly performed scans

>Error checking and treatment

>Common HDF5-based file format for easy access from any data analysis code

>Automatic generation of logbook entries

>Link to auxiliary information on accelerator configuration

>Synchronized data acquisition

3

Page 4: PowerPoint (8.6 MB)

Rasmus Ischebeck

Data File Format>Hierarchical format to store Instruments>Based on HDF5>Readable from Matlab, Root, Mathematica…

4www.nexusformat.org

Page 5: PowerPoint (8.6 MB)

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

Accelerator Data AcquisitionMany accelerator measurements consist of the following tasks:

>Control 0…N actuators>Acquire 1…M measurements>Analyze data

Important features>On-line analysis>Reasonable error handling>Robust code for use by other persons than the programmer

5

Page 6: PowerPoint (8.6 MB)

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

ADAQA Layers>ADAQA consists of several

separate building blocks>Applications, written by different

programmers, make use of the same data acquisition code

>Instruments gather connected devices

>Logbook>Common data storage format>Online model*>Device information server*>Synchronized data acquisition

* ongoing work, not yet ready for prime time

6

Page 7: PowerPoint (8.6 MB)

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

ADAQA Layers >Tree-like structure:

>Many devices (roots)>One data acquisition core (trunk)>Many applications (branches)

>Building blocks can be exchanged

7

Devices

DataAcquisitio

n

Applications

Wikipedia

Page 8: PowerPoint (8.6 MB)

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

Synchronized Data Acquisition>All VME crates for diagnostics are equipped

with an Event Receiver>Connected with a star topology network to

the Event Generator>Supported for:

>BPMs, Bunching monitor, RF, …>Ongoing work:

>Laser shutter, oscilloscopes, cameras

8Sven Nordquist

Page 9: PowerPoint (8.6 MB)

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

• ScreenMonitorTool• General Purpose Scan Tools• Specialised Scan Tools

–Slice Emittance–Optics Matching–Slit Scan–…

• “Do it yourself! - Scan Tools

ADAQA Applications

Page 10: PowerPoint (8.6 MB)

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

• General purpose camera display andanalysis tool

• In every day use for different kinds of cameras and screen monitors

ScreenMonitorTool

Dione and Saturnhttp://www.ciclops.org

Page 11: PowerPoint (8.6 MB)

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

General Purpose Scan Tool

Page 12: PowerPoint (8.6 MB)

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

the future…

Page 13: PowerPoint (8.6 MB)

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

• Scans can be stored in Template files• The last scan is always stored as template

–“Repeat Last Scan…”-Button• Data files are scan templates as well

–All scans can be exactly repeated

• Templates can handed over to the scan tool at startup–example: extracted charge vs. gun phase scan

Scan Templates

Page 14: PowerPoint (8.6 MB)

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

Specialised Scan Tools

Page 15: PowerPoint (8.6 MB)

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

Specialised Scan Tools

Page 16: PowerPoint (8.6 MB)

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

Automatised logbook entries

Page 17: PowerPoint (8.6 MB)

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

• General and specialised scan tools are possible with ADAQA–a wide variety of tools is available

• Common data format• Templates

–data files are templates – for all tools• Actions

–e.g. automatic screen insertion or background subtraction• Analysis functions

• Automatic logbook entries

Scan Tools Summary

Page 18: PowerPoint (8.6 MB)

+ SwissFEL+ SwissFEL

SwissFEL Meeting 24.1.2013

knob{1} = LoadKnobDefinition('ManagementKnob'); % setup Knob and Instrumentknob{1}.SetpointValues = [1, 2.4, 3, 3.78, 92]; % scan setpoints

instrument{1} = LoadInstrumentDefinition('SwissFEL_Meeting_Demo');

Setup.Function = 'scan'; % define scan setupSetup.Repeat = 10; % “shots” per scan step

Info.Author = 'Beutner'; % human readable infoInfo.Title = 'SwissFEL Meeting Demo';Info.Purpose = 'this is a small scan tool for demo...';

[DAQFileName, Setup, knob, instrument, Info] = ... daq(Setup,knob,instrument,Info); % execute scan

% …insert your analysis code here…

Do it yourself! - Scan Tools

Page 19: PowerPoint (8.6 MB)

Image based measurements: today

IOC

AFS

EPICS Control+Data

cameraworkstation

Helge Brands

control room

Page 20: PowerPoint (8.6 MB)

Image based measurements: today

Problems:• available buffers on IOC are not used• „lost“ of measured data• high frequencies can‘t be reached• high CPU load on workstations

Helge Brands

IOC

AFS

EPICS Control+Data

cameraworkstation

control room

Page 21: PowerPoint (8.6 MB)

Image based measurements : future

DATA

Compute-Node

Results

Results+Data

IOC

AFS

EPICS Control+Preview

cameraworkstation

Helge Brands

control room

Page 22: PowerPoint (8.6 MB)

Why?

•less radiation•higher recording speed (10Hz/100Hz)•independent of the workstation (CPU and memory)•system is similar to SLS (Tomcat, in operation, 1* PCO Edge)

Helge Brands

Page 23: PowerPoint (8.6 MB)

Why?

•less radiation•higher recording speed (10Hz/100Hz)•independent of the workstation (CPU and memory)•system is similar to SLS (Tomcat, in operation, 1* PCO Edge)

BUT

Helge Brands

Page 24: PowerPoint (8.6 MB)

Technical values

example: ~30TB/week

more storage needed

Helge Brands

Page 25: PowerPoint (8.6 MB)

Specs

storagesize/speed

network(camera IOC)

IOClocal memory

compute nodes

WHLATest-Injector

558 GB/50MB/s

1Gb/s 16GB~3000 pic

1-2

SwissFEL (?)/(?) 10Gb/s (?) min. 5-10

Helge Brands

Page 26: PowerPoint (8.6 MB)

Current situation

•WHLA: each Camera-IOC has 1GB/s (enough for 10Hz) •3 PCO Edge in operation + 1 PCO Edge in preperation•upload to AFS max 50MB/s•software is ready for 100Hz•needed network speed 10GBit/s for 100 Hz•other GIGE cameras can be used too•additional compute nodes should be planned•storage policies are needed

Helge Brands

Page 27: PowerPoint (8.6 MB)

>Project started in 2008, always between 5 and 10 developers>Written mostly in Matlab>89093 lines of code (including code sourced from MathWorks Central and other external sources)>Performed 22775 scans, resulting in 558 GB of data>A joint project between the Controls, Beam Dynamics & Diagnostics Sections at PSI

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

ADAQA

31

ADAQADiagnostic

sControl

sBeam

Dynamics

Page 28: PowerPoint (8.6 MB)

© 2013 Paul Scherrer Institut Slides available at http://people.web.psi.ch/ischebeck

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

Outlook> We are looking forward to many new

applications for SwissFEL!

> Thank You to:> all ADAQA programmers and users, in

particular Eduard Prat, Marta Divall, Peter Peier, Marc Guetg, Gian Luca Orlandi, Bennie Smit & Thomas Schietinger

> support from Jan Chrin & Babak Kalantari

32Sven Nordquist