Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020....

21
Duc Hoang (Rhodes College); Sujay Kazi (MIT); Nhan Tran, Cristian Boffo, Steve Krave, Vittorio Marinozzi, Stoyan Stoynev (Fermilab). SIST/GEM Final Presentation. 8/5/2020 Intelliquench – Real Time detection of magnet quenches in superconducting accelerator magnets. FERMILAB-SLIDES-20-069-CMS-SCD-TD

Transcript of Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020....

Page 1: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Duc Hoang (Rhodes College); Sujay Kazi (MIT); Nhan Tran, Cristian Boffo, Steve Krave, Vittorio Marinozzi, Stoyan Stoynev (Fermilab). SIST/GEM Final Presentation.8/5/2020

Intelliquench – Real Time detection of magnet quenches in superconducting accelerator magnets.

FERMILAB-SLIDES-20-069-CMS-SCD-TD

Page 2: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

I. Overview of magnet quenchesII. Deep neural network for anomaly detectionIII. ResultsIV. Summary & Outlook

Outline

8/5/2020 Duc Hoang | Intelliquench2

Page 3: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Ø Superconducting accelerator magnets must operate at very low temperatures to maintain superconductivity (no resistance).

Ø Due to several reasons (mechanical imperfections, conductor motion, …), a specific spot in the magnet heats up.

Ø This causes the magnet to become resistive, and with huge amount of current pumping through, it can be catastrophic.

8/5/2020 Duc Hoang | Intelliquench3

Magnet quenches

Wilson et al. Superconduc2ng magnets for accelerators.

🔥

Page 4: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

r/CatastrophicFailure

8/5/20204

In 2008, magnet quench occurred in 100 magnets at the LHC at CERN, leading to a loss of approximately six tonnes of liquid helium.

The escaping vapour expanded with explosive force, damaging a total of 53 superconducting magnets (each costs several millions dollar.)

Duc Hoang | Intelliquench

Page 5: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

• We placed 5 acoustic sensors around the magnet to detect abnormal sound signatures.

Acoustic sensors

8/5/20205 Duc Hoang | Intelliquench

Page 6: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

• We placed 5 acoustic sensors around the magnet to detect abnormal sound signatures.

Acoustic sensors

8/5/206 Duc Hoang | Intelliquench

Sensor

Page 7: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Deep Neural Network to detect anomaly in the signal.

8/5/20207 Duc Hoang | Inteilliquench

Deep Neural Network

Abnormal sound signals?

Page 8: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

• Each input multiplied by a weight.

• Weighted values are summed, Bias is added.

• Non-linear activation function is applied

• Trained by varying the parameters to minimize a loss function (quantifies how many mistakes the network makes)

Deep Neural Networks

8 8/5/2020 Duc Hoang | Intelliquench

Page 9: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Deep Neural Network Auto-encoder

8/5/2020 Duc Hoang| Intelliquench9

SignalsRoot mean square error (RMS)

Large error? Anomaly

Encoder Decoder

Compressed info

📚🙇

🧠

✍📝

Page 10: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Reconstruction loss visualization

8/5/2020 Duc Hoang | Intelliquench10

0 is quench timeAnomaly point

Page 11: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Results

8/5/2020 Duc Hoang | Intelliquench11

Page 12: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Zoomed in -25s near the quench

8/5/2020 Duc Hoang | Intelliquench12

Page 13: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Results – summary

8/5/2020 Duc Hoang | Intelliquench13

Page 14: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Ø Magnet quenches are expensive.

Ø We are using Deep Neural Network to detect anomaly sound signals, which hopefully enable us trigger before the quench happens.

Ø We’ve achieved some promising results and will be moving on to verification step on unseen data.

Ø Eventually, we want to have a real-time system deployed on FPGAs to process streaming acoustic data.

Summary & Outlook

8/5/202014 Duc Hoang | Intelliquench

Page 15: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

• My supervisor: Dr. Nhan Tran & other collaborators in the superconducting technology division: Sujay, Cristian, Steve, Vittorio, Stoyan.

• The SIST committee & my mentor group. • Other awesome interns:

Acknowledgements

8/5/20 Presenter | Presentation Title or Meeting Title15

2019 2020

Page 16: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Back-ups

8/5/2020 Duc Hoang | Intelliquench16

Page 17: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Signals’ statistical features

7/21/2020 Duc Hoang | Intelliquench17

- From the main signals, we calculate two features, standard deviation and mean of the amplitude. s

- These features are calculated using a rolling window.

:LQGRZ�VL]H����PV

6WHS�VL]H������V

7LPH�ODEHO�DVVRFLDWHG�ZLWK�WKH�ZLQGRZ

Page 18: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

• To adapt to increasing higher level of noise as we get to higher current, we also implement a dynamic learning algorithm.

Dynamic learning

7/21/2020 Duc Hoang | Intelliquench18

Training model

Evalua6on of error.

For each 10-second sec/on

Preprocessing

> 3.3 log loss median of previous distribu6on? trigger!

Base model

Page 19: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Reconstruction loss visualization

7/21/2020 Duc Hoang | Intelliquench19

0 is quench timeAnomaly point

Page 20: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Problems with static learning

7/21/2020 Duc Hoang | Intelliquench20

You generally see very clean signal when doing static learning (just learn on the firs few seconds)

However, the loss scale is different in each ramp and it’s hard to set a consistent threshold.

Page 21: Intelliquench–Real Time detection of magnet quenches in superconducting accelerator ... · 2020. 8. 5. · ØSuperconducting accelerator magnets must operate at very low temperaturesto

Dynamic threshold

7/21/2020 Duc Hoang | Intelliquench21

Training started

Reached previous quench’s max current

Thre

shol

d

Time/Current