Elder MatiasCanadian Light Source

University of Saskatchewan

CLS – Control System Overview

Agenda

• The CLS Facility

• Control System– Remote Access– Safety Critical Software

Applications: Proteins & Disease

Applications: Medical Studies

Applications: Mining & Petroleum

Applications: Better Satellites, Planes and Cars

Applications: Nano-Technology

Why Saskatoon?

• 1964 the Saskatchewan Accelerator Lab (SAL) was established for chemistry and nuclear physics research.

• Saskatoon was chosen for the CLS due to the existing complement of staff and facilities

Machine Layout

What are the CLS Objectives?

170.88 m circumference 2.9 GeV DBA lattice with 12-fold periodNominal Tune:

x = 10.22 y = 3.26

Eloss per turn: > 0.876 MeVBend magnet radiation:

c = 1.6 Å Ec = 7.6 keV

x = 18.1 nm•radDamping times:

x = 2.4 ms, y = 3.8 ms, E = 2.7 ms~10 mm bunch length

MAX-II

TLS-I

BESSY-IIALS

ELETTRA

PLS

SLS(240m)

ANKA

ESRFAPS

Spring-8

CLS (171m)SPEAR3 (240m)

Super-SORLSB

BOOMERANGTLS-II

SOLEIL(2006,354m)

NSLS-II

DIAMOND(2007,562m)

ESRFAPS Spring-8ELETTRA

1

10

100

0 1 2 3 4 5 6 7 8 9Energy(GeV)

Em

ittan

ce(n

m·r

ad)

KSRS (124m)

Agenda

• The CLS Facility

• Control System– Remote Access– Safety Critical Software

Statistics….

• Over 15,000 Data Points• 40+ Telemecanique Momentum PLCs• 9 Siemens S7 300/400/400 F PLCs• 30+ VME Crates & 1 VME Crate• 60+ IOC for Serial Communication• 500+ Stepper Motors• 5 Servo Motors• 20+ Operator Workstations

(http://www.lightsource.ca/operations/controlinstrumentations.php)

Architecture

• EPICS based DCS

• Sub-system control– Machine Protection (Industrial PLCs)– Process Control (Industrial PLCs)– Scientific Data Acquisition (VME)– Motion Control (VME)– Timing System (VXI)

• Operator Workstation and Servers– Scientific Linux

What is EPICS ?

• Experimental Physics and Industrial Control System Platform

• A series of tools and libraries for building distributed control system

• Originally developed by Los Alamos• Widely used in the Accelerator Control and

Radio Telescope Areas• Some industrial use• Open Source

(http://www.aps.anl.gov/epics/)

EPICS

ProfibusTCP/IP

Siemens S7/300 PLC

ModbusTCP/IP

GPIB

RS-232

Channel A

ccess Protocol

IOC

IOC

IOC

IOC

State MachineEngine

CA

CA

CA

CA

CA

Single BoardComputer

CA

Operator WorkstationUser Applications

TouchPanels

CA

CA

Telemecanique Momentum PLC

VME

IOC

CA

Control Room/Areas

• Quad Headed Scientific Linux workstations in the accelerator control room and Dual Headed workstations on the beamlines.

• Scientific Linux (CERN/Fermilab)(https://www.scientificlinux.org/)

• Human Factors Engineering

• EPICS Tools– EDM (Display Manager)– Strip Tool (Data Trending)

• CLS Specific– Audio Alarm Annunciation– Legacy hard-wired controls

from older Linac Equipment

Design – LINAC Master Display

Moxa

• Linux based – Intel X-Scale Processor

• EPICS with the asyn driver and older CLS serial drivers

• Used extensively for RS-232/422/485

• Commercial-off-the-shelf

Orbit Correction

• Beam required to stay within the “golden orbit”• Designed for correction at up to 100 Hz• Digital Signal Condition required to suppress

electrical noise and mechanical vibration• Protects Chamber from Off-orbit Beam at high

current

• VME hardware connected to a Linux PC.

• SIS1100 PCI card <-> fiber optic link <-> SIS3100 VME module

• Maps VME backplane to IOC memory.

• Advantages:– PC can be physically separated from VME crate.– More than one VME crate per PC.– Multiple applications can access the same crate.– High throughput 25 to 80 Mbytes/sec block

transfer.

• Using RTEMS Real-time operating system.(www.rtems.org)

/dev/SIS1100_2(descriptor 2)

VME CRATE 1:Hardware

mapped memory

VME CRATE 2:Hardware

VME CRATE 3:Hardware

Fiber Optic link

FiberOptic Link

Fiber Optic Link

/dev/SIS1100_1(descriptor 1)

/dev/SIS1100_3(descriptor 3)

EPICSApplication

PV record read

routines

PV record write

routines

Linux or RTEMS IOC

sis1100 PCI card

sis1100 PCI card

sis1100 PCI card

VME

• The options: (1) Matlab, (2) SciLab, or (3) root.

• Matlab was selected primarily because of the availability of the accelerator toolbox and staff experience.

• Matlab is commercial, the accelerator toolbox is open source.

• Software originates from ALS and SPEAR III.

• Augmented with other CLS specific utilities.

• Also being used as a commissioning tool for beamlines.

• Special care is required to maintain consistency with other parts of the control system.

Online scripting environment

• Provides fiber optic signal distribution of triggers.

• VXI based hardware• Custom Electronics

used where jitter is a critical factor

• Starting to beused for timeresolveexperiments

Timing System

Safety Critical Software

• Applications:– Lockup system (ACIS)– Oxygen monitoring– BMIT human studies (under development)

• IEC 61508 – SIL 3 based system• Siemens S7/400 F• Redundant Second Chain• Fail-safe design• Independent

Verification

Motion Control

• MaxV VME Controllers

• Power Electronics(Parker + others)

• Software/HardwareMulti-Axis Control

• Average Beamline50-100 motors

• Beamline Controls are based on the same software and hardware as the accelerator systems.

• Each beamline is on a separate virtual network.

• The EPICS Gateway provides links between the different networks.

• Matlab is used for scripting.

Beamlines

Mechanical Services

• Telemecanique MomentumPLCs

• Ring temperature stabilityrequirement +/- 0.1 C.

• Geographically Distributed• Legacy Systems:

– Most 1960s equipment upgradedin 2005

– Most 1980s equipment upgradedin 2004

– Limited number of systemsstill using Invensys DMS DCS

Remote Beamline Access Prototype Architecture

BrowserJavascript/Ajax

Netw

ork

Web Server

Other Services- SOAP, etc.

RDBMS

ApplicationLogic SOAP

Beamline - EPICS

J2EE - SPRING

restUI - jaxscript

Persistence - Spring DB

(DERBY)

Spring MVCEPICS Spring

Bridge

POJOs

Login

Selecting a Scan Region

Lightpath Accelerator controls a software virtual cross-connect that commands UCLP.

User Configurable Light Paths

In effect, CA*Net4 is treated as a single lightpath cross-connect

real device real devicevirtual device

domain manager process

UCLPcommands

The End