Post on 11-Jan-2016
SNS Integrated Control System
EPICS Collaboration Meeting
SNS Machine Protection SystemSNS Timing System
Coles Sibley
2000-0xxxx/vlb
SNS Integrated Control System
MPS Design Assumptions
Machine Protection System is not a “Safety Class” or “Safety Significant” System.
SNS will be built and commissioned in Phases, MPS must accommodate this schedule.
Reliability – The Machine Protection System must inhibit the beam when required. It must fail in a SAFE state.
Availability – The machine availability should be as high as possible. The MPS must be easy to configure and have a “friendly” operator interface. False trips must be minimized.
SNS Integrated Control System
MPS - Layered Protection
PersonelProtection
System
Fast ProtectLatched
Fast ProtectAuto Reset
Run Permit
Incr
easi
ng
QA
Hard Wired and PLCapplication
3 MHz carrier linkKEY BypassingPLC Bypassing
8 MHz carrier linkSoftware bypassSoftware Trips
EPICS ApplicationEPICS Channel Access
Inputs
Loss MonitorsRF Status
Machine Mode
Valve StatusPower Supply StatusMachine Mode Inputs
Chipmunks,Doors, etc.
AC Breakers in frontend electronics &power supplies
65 KV supplyRFQ Power Supply
RFQ Drive
Fast Protect SystemBeam Permit System
ProtectionSystem
Shutdownmechanism
SystemDescription
System Inputs
TargetProtection
SystemHard Wired
Target Sensors
TemperatureFlow
AC Breakers
No
n S
afet
y C
lass
Sys
tem
sS
afe
tyS
ign
ific
an
tS
afet
yC
lass
Hard WiredPermit
KEY BypassingPower Supply Shunts
PPS InputsBergoz MPCT
Front End PSHardwire interlocks
SNS Integrated Control System
Machine Protection System
Run Permit System (1 second)» Coordinates machine mode changes.» Scans IOC configurations for Software Configuration errors.» EPS interface for masking equipment inputs.
Hard Wired Protect (~ 33 msec)» Latched in Hardware» Redundancy through FPLS inputs
Fast Protect Latched System (< 20 microseconds)» Latches fault conditions until fault clears and Operator resets
condition. FPS_PERMIT_LINK_A carrier interrupted and inhibits beam through front end devices.
Fast Protect Auto Reset (20 microseconds)» Inhibits beam for duration of macro pulse by disabling
FPS_PERMIT_LINK_B carrier to the front end. Restores Fast Protect link for next pulse if fault restored to normal.
SNS Integrated Control System
Machine Protection System Layout
RING
RFQDrive
HEBT
Ldump
SRF
CCL
DTL
65 kV
RFQHVPPS
MPS Inputs
MPS Inputs
MPS InputsMPS Inputs
MPS Inputs
MPS Inputs
MPS Inputs
Beam OffLogic
Machinemode
RING
RTBT
Xdump
MPS Inputs
MPS Inputs
MPS Inputs
Idump
RTBT
MPS Inputs
MPS Inputs
Target
Fa
st
Pro
tec
tIn
pu
ts
FrontEnd
LINAC RING RTBT
Fa
st
Pro
tec
tIn
pu
ts
Fa
st
Pro
tec
tIn
pu
ts
Fa
st
Pro
tec
tIn
pu
ts
Target
LEBTChopper
RFQDrive
Fa
st
Pro
tec
tIn
pu
ts
Fa
ult
Be
am
Pe
rmit
Inp
uts
FrontEnd
LINAC RING RTBT Target
Ion Source65 Kv PS
RFQPower Supply
Fa
ult
Be
am
Pe
rmit
Inp
uts
Be
am
Pe
rmit
Inp
uts
Be
am
Pe
rmit
Inp
uts
Be
am
Pe
rmit
Inp
uts
ExtractionKickersFault
EventSystem
"ABORT"
5.6 us 5.8 us 8.2 us 8.2 us
27.3 us
MEBTMPS Inputs
RFQ
LEBT
Src
MPS Inputs
MPS Inputs
MPS Inputs
0.8 us
SNS Integrated Control System
Fast Protect – Auto Reset
ALARA – Pulse Width Modulation
Concentrates Permit Inputs
Inhibits carrier link to disable Beam
Inputs:» Loss Monitors
– Software trip points, bypass
» Beam position monitors– Software trip points, bypass
» RF Low level Controls
SNS Integrated Control System
Fast Protect - Latched System
Concentrates Permit Inputs
Inhibits carrier link to disable beam
Devices bypassed by Key or PLC
Inputs disabled by machine mode (event link)
Equipment maintained in locked racks
Documentation control of changes
System verification after changes
SNS Integrated Control System
Fast Protect Inputs
RF PS I Wire Harp Loss Kick Dumps Vac Total BPM Loss LLRF Tor. TotalMon. Scan. Targets
LEBT 1 1 1 3MEBT 2 17 1 20 2 2RFQ 1 0 1 1 1 1 5 1 1 2DTL 6 0 1 6 2 1 16 12 6 2 20CCL 4 73 8 1 86 24 4 2 30SRF 92 58 1 29 1 1 182 2 58 92 152HEBT 2 54 1 14 2 2 2 77 39 2 41RING 4 66 1 2 8 1 2 84 2 96 4 2 104RTBT 55 2 4 2 4 14 2 2 85 4 48 4 56Total 112 324 7 62 7 8 22 4 12 558 8 277 109 13 407
Fast Protect Latched Inputs Fast Protect Auto reset
SNS Integrated Control System
MPS Input Bypass Mechanisms
Mode Mask» Global database contains operating mode dependant devices.
Devices not required for present mode are masked through hardware. Masks changed with database reconfiguration and IOC reboot.
Jumper / Key / PLC Bypass» Software bypass requires set of closed contacts from a jumper,
key, or PLC contacts.
Software Bypass» If hardware configuration allows, input bypassed through software
with appropriate EPICS Access Security permissions.
SNS Integrated Control System
MPS Input channels
Signal IO type
R,W or RW
Comments
PMC ID 16 bits R SNS –PMC ##### -Serial numberSoftware version 16 bits R Software revision #Date Code 16 bits R Date codeFPS Input Carrier Status 1 bit R 1 = OKBPS Input Carrier Status 1 bit R 1 = OKFPS Output Carrier Status 1 bit R 1 = OKBPS Output Carrier Status 1 bit R 1 = OKIOC Heartbeat Status 1 bit R 1 = OKIOC Heartbeat Enable 1 bit R IOC heartbeat jumperFPS Software Mask jumper 8 bits R 1 = OK (jumper setting)BPS Software Mask Jumper 8 bits R 1 = OK (jumper setting)Fast Protect Input Status 8 bits R 1 = OK (1 bit per input)Beam Permit Input Status 8 bits R 1 = OK (1 bit per input)Mask readback 16 bits R Mode mask readback of mask in useEVL Mode Readback 8 bits R Mode in use from EVENT_LINKRTDL Mode Readback 8 bits R Mode in use from RTDLInput connection status 16 bits R Input cable connection detectedChannel fault Timer 32 bits R 1 per input
SNS Integrated Control System
MPS Configuration Data
Signal IO type
R,W or RW
Comments
PMC ID 16 bits R SNS –PMC ##### -Serial numberSoftware version 16 bits R Software revision #Date Code 16 bits R Date codeHeartbeat time 16 bits RW 16 MHz ticks for the IOC heartbeat
frequency, i.e. at 2 msec, 32000 or 0x7d00 hex
FPS Mode Mask Write Enable 16 bit RW Enable bit for downloading mode BPS Mode Mask Write Enable 16 bit RW Enable bit for downloading mode Interrupt Enable 1 bit RW Interrupt Enable bit
16 bits per channel0xA5A5 = Channel Enabled1 word per channel0x5AA5 = masked1 word per channel0xA5A5 = maskedLow byte MMHi Byte /MMLow byte MMHi Byte /MM
Channel Enable 16 bits RW
FPS Software Mask 16 bits RW
Beam Permit Mode Mask 16 bits RW
BPS Software Mask 16 bits RW
Fast Protect Mode Mask 16 bits RW
SNS Integrated Control System
MPS PMC Module (Also nice generic digital IO module)
PCI to LocalSlave
Bus Bridge
ProgramablePLL ClockGenerator
AlteraFLEX 10K
FPGA
2 - 100 nsec5 tap Delay
lines
128K x 16SRAM
SpecialReceiver
74FCT16245Buffers
Serial EPROM
68 Pin Front PanelConnector
64 Pin (P2)Rear IO connector
32 bit PCI Bus
16 Data
96
2
322
xx MHz
1 5
18 Addr12
64
33MHz
+5
1 5
Technobox Reconfigurable Digital IO PMC
SNS Integrated Control System
MPS System Hardware
1
32
MV2100 PPC Board
PC-MIP
PC-MIP
PMC Board
Technobox 96 channelreconfigurable IO module
P14
VME 64XBackplane
VME Chassis
FPS inputs
Latched inputs
RTDL
Event Link
FPS Carrier
FPS Carrier
LatchedCarrier
B
A C
D
A C
Z
Z
MPS Transition ChassisD
MPS InterfaceChassis
#1
LEDDiagnostic
Display
160 pin J2/P2Connector
Commercial HardwareSoftware design in progress
Design in progress(LANL)
Waiting for PrototypeQuote (Oak Ridge)
SNS Integrated Control System
MPS Software
Database (Oracle)» Access Security Files
» EPICS database
» RPS configuration database
» Alarms, IOC startup scripts, Archives
Run Permit System» SNL programs
» Machine mode changes
» System Verification
Beam current (Loss) accounting system
Operator Interface - EDM
Device / Driver support routines.
SNS Integrated Control System
EPICS CA Security
Hackers
ORNL Personnel
SNS Staff EE's
Operations
ChannelAccessServer Local OPI'sEPICS
File Server
Controls Network
IOC
C.A.S.
Run PermitSystem
SNS Network
World
MPSHardware
FPS InputsMPS Inputs
UAG - User AccessGroup
HAG - Host AccessGroup
ASG - Access securityGroup
ASL - Access SecurityLevel
ORNL Network
Telnetsession
Router
Firewall
WorkstationFirewall
EE @ home
DialupModem
SNS Integrated Control System
SNS Timing System
Modified Brookhaven Design
Timing Master (60 Hz PLL) - LANL
RTDL Master – BNL
Event Link Master – BNL
Utility Module – LANL
Timing Slaves (V124-S) - BNL
Machine Protection – SNS
Diagnostics EL-RTDL receivers - LBNL
SNS Integrated Control System
Timing System Components
GPS
Ring RF
MasterTimingmodule
NeutronChoppers
ACLine
SNS EventLink
Master
*16 PLL(16 MHz)
SNS RealTime Data
LinkMaster
10 MHzCrystal
Osc.
TimingSlave
(V124S)
MachineProtection
System
ICS IOC'sSNS Utility
Module
LEBTChopper
*4 PLL(64 MHz)
ExperimentalHalls
Diagnostics
RF GatesExtraction Kickers
TxHV gates
High resolutiontimestamps
Machine Modes
SNS TimestampsRemote Reset
Synchronous ISR's
Beam delayBeam Phase
Micro pulse widthMacro pulse width
SNS Time stampsDelaysGates
TriggersReboots
SNS Time stampsBeam data
RTDLEventLink
MasterTiming IOC
Phase Adjust
SNS Integrated Control System
Neutron Selection, Timing
Fast Neutrons suppressed by ToChopper
Neutrons suppressed by To Chopper
Slow neutrons allowedto pass
At Moderator face
10's ofusec.
Neutrons suppressed by Fermi Chopper
Neutrons at Sample
(Accelerator, T0 Chopper, and Fermi Chopper slaves to Timing master)
SNS Integrated Control System
Timing Master
Power grid
Zero crossing
Reference
Chopper
Accelerator tracking
Chopper tracking
Provides 60 / 120 Hz system pulses Follows line to within +/- 500 usec Extraction time fixed ~5 msec in advance Neutron Choppers follow Timing Master (60 Hz system pulses) Accelerator timing follows Timing Master
SNS Integrated Control System
SNS Timing Links (Drivers in progress at BNL)
Event Link (16 x Ring RF frequency)» Phase locked to Ring RF
» 256 Events or triggers, 64 hardware – 192 software
» Events Prioritized (High priority, no jitter)
RTDL – Real Time Data Link (10 MHz Carrier)» Design based on RHIC RTDL System
» Up to 256 Frames (1 start bit, 8 address bits, 24 data bits, 8 CRC bits per frame)
» Provides Synchronous data facility wide.
» One broadcast per machine cycle
SNS Integrated Control System
SNS Timing Encoder
1x 8 fan out
F/oTx
F/oTx
To FrontEnd
For local use
Multimode fiber
F/oTx
To HEBT
ToMCR
DELAYMODULE
ToRing
SNS Timing Distribution
SNS Integrated Control System
Event Link
Event link – PLL 16 * Ring RF» LEBT Chopper – 4 * EL carrier to create mini and macro pulses» Event link distributes timing for accelerator, diagnostics, extraction
and high resolution time stamps» Diagnostics – PLL 4 * EL carrier
Timing Slave (V124S module - BNL)» Gate Width – 16 bits, Carrier * 2 (~33.9 MHz)» Gate Delays
– Revolution delay - 16 bit, Ring RF frequency– Sub revolution delay – 8 bit, 16 * RF– Line delay – delays from 12 to 139 nsec
» Jitter < 5 nsec
SNS Integrated Control System
Data Transmitted on RTDL
Time of day (IOC time stamps)
Event Link Period (psecs) to converts counts to real time
Operating Mode (beam area, beam power, pulse length limits)
60 Hertz phase difference
Beam Parameters for LEBT Chopper
Previous pulse beam data
Data acquisition mode
Beam profile ID
IOC Reset Address
(Beam aborted if CRC error detected)
SNS Integrated Control System
Macro Pulse Shape
1 msec
16.67 msec
645 nsec945 nsec50 usec
Macro Pulse
Mini Pulse
402.5 MHz
Ring RF PLL SignalPhasedelay
Mini Pulseduty factor
75 %
65 %
divide by "n"Every "nth" pulse blanked
Beam Characterization Parameters(All in terms of 64 * RF ticks)Ÿ Phase DelayŸ Start WidthŸ Stop WidthŸ Macro DelayŸ Macro Full LengthŸ Macro WidthŸ End Width
SNS Integrated Control System
SNS Accelerator Timing Sequence
Real-TimeData Link
(RTDL)
RTDL parametertransmission
0-1 ms-2 ms 1 ms 3 ms2 ms 4 ms
RTDLtransmit
RTDL valid
System xxxTrigger
5 ms 6 ms
mode
snapshot,1Hz, 10Hz,
etc... linac beamend extract
beamaccumulation
Rf, High voltageGates
-3 ms
MPS Fault
Anytime
MPS Inhibit
Anytime
cycle start
Anytime
event link
machine
Informational Events, non critical timing Time Critical Events, (Hardware is counting)
Master Trigger Generator
SNS Integrated Control System
RPS – Beam Mode Parameters
Safe Operating Reqion
0.1
1
10
100
0 200 400 600 800 1000
# of turns injected
Bea
m in
ject
ion
Rat
e
7.5 kW envelope
200 kW envelope
2 MW envelope
60 Hertz
Safe Operation
Wire Scanners
SNS Integrated Control System
System Sequencer – (pulse scheduling)
120 Hz
60 Hz
Beam
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
123456789
101112131415161718
Off
RTDL Frames
Daq mode
OffLdump-7.5 kW
Mode
Off
RF OnlyOff
Off
Off
OffRF Process
Ldump-7.5 kWOff
Off
RF
Ldump-7.5 kWRF Process
Off
Off
Ldump-7.5 kW
Timetimetimetimetime
timetime
time
timetimetimetimetimetimetimetime
time
timetime
Ring rev T59062 psec
59062 psec
Beam data Last Pulse
A=123,B=22, etc
A=10,B=13, etc
A=123,B=22, etc
19Off
A=123,B=22, etctime
Line Error237400 nsec
237420 nsec
237420 nsec
237430 nsec
237560 nsec
237590 nsec
237520 nsec
237440 nsec
237500 nsec
237490 nsec
237510 nsec
237480 nsec
237460 nsec
237490 nsec
237500 nsec
237540 nsec
237610 nsec
237600 nsec
237610 nsec
59063 psec
59063 psec
59064 psec
59064 psec
59064 psec
59065 psec
59066 psec
59066 psec
59062 psec
59062 psec
59062 psec
59062 psec
59062 psec
59062 psec
59062 psec
59062 psec
59066 psec
P=249, Q=1230
P=248, Q=1226
P=43, Q=245
cal
normal
normal
calsnapshot,1Hz
cal
cal
cal
cal
normal
User ID
Table 1
Table 3
Table 1
Table 1
19
300 time Off59066 psec BEAM INHIBIT cal237490 nsecScheduledScheduledP - P P - P Scheduled P - PP - P Scheduled
IOC reset
IOC_13
on request
Table 0
Table 0
Table 0
SNS Integrated Control System
Application Interface
CP
UE
PS
VME
Tim
ing
EP
S
LEBTChopper
PhysicsApplication
Event linkEncoder
SystemSequencer
Control Room
RTDLMaster
DataServer
DiagnosticsIOC's
UserProfile,
Raterequest
User ID
ControlsIOC's
Control SystemNetwork
User IDSynchronous
Data
TimingDistribution
System
DiagnosticsIOC's
CP
UE
PS
VME
Tim
ing
EP
S
ControlsIOC's
1 Hz EventProcessing
WireScannerRequest
SNS Integrated Control System
SNS Job Openings www.sns.gov/jobs/jobs_AMT.htm
Accelerator Physicist (9292)
Accelerator Systems Hardware Engineer (1050)
Beam Diagnostics Engineer (1846)
Chief Accelerator Operators (1552)
Control Systems Software Engineer (3343)
Engineering Assistant—LLRF (1630)
Engineering Assistants—Power Supply (6334)
Engineering Assistant—Pulsed Power Systems (7630)
Engineering Assistants—Survey and Alignment (3891)
Mechanical Engineer—Cryogenics (5061)
Mechanical Engineering Team Leaders (9983)
Pulsed-Power Engineer ((1379)
RF Engineer—High Power (1052)
RF Engineers—Low Level (1229)
Senior Mechanical Designers (3172)
Senior Power Supply Engineers (6310)
Vacuum Engineers (4257)