Mechatronics with Machine Learning (+ Deep...
Transcript of Mechatronics with Machine Learning (+ Deep...
![Page 1: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/1.jpg)
Mechatronics with Machine Learning
04/10/2017
Prof. Seungchul Lee
(+ Deep Learning)
![Page 2: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/2.jpg)
Introduction
• Since 2013 July: UNIST
– iSystems Design Lab.
• 2010, Ph.D. from the University of Michigan, Ann Arbor
– S. M. Wu Manufacturing Research Center
– The Center of Intelligent Maintenance Systems (IMS)
• 2007, M.S. from the University of Michigan, Ann Arbor
• 2005, B.S. of Electrical Engineering from Seoul National University
• 2001, B.S. of Mechanical Engineering from Seoul National University
2
![Page 3: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/3.jpg)
My Research Areas
• Mechatronics (mechanics + electronics)– Undergraduate can do this with fun
– Robotics
– Hardware + coding
– Circuit + digital logic + signal processing + control
• Machine Learning and Deep Learning– A level of graduate study
– New research field for mechanical engineering
– Will bring lots of potentials
– Math + coding
3
![Page 4: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/4.jpg)
Today
• Physical Computing
• Kinematics in Robotics
• Parallel Manipulator (Delta Robots)
• Dynamics and Control
• Cyber-Physical Systems (CPS)
• Signal Processing
• Intelligence with Machine Learning
• Deep Learning
• Epilog
4
![Page 5: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/5.jpg)
Arduino and Raspberry Pi
• Open-source platform used for building electronics projects
• Micro-controller/micro-computer
• Physical computing
• Easy to use even for non-professionals
• Maker Faire
5
![Page 6: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/6.jpg)
Physical Computing: Sensors and Actuators
• Sensor: allow the microcontroller to receive information about the environment
• Actuator: devices that cause something to happen in the physical world
6
![Page 7: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/7.jpg)
Flex Sensor and Servo Motor
7
![Page 8: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/8.jpg)
Sensors + Actuators + Microcontroller
8
3D Printed Prototype
![Page 9: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/9.jpg)
Today
• Physical Computing
• Kinematics in Robotics
• Parallel Manipulator (Delta Robots)
• Dynamics and Control
• Cyber-Physical Systems (CPS)
• Signal Processing
• Intelligence with Machine Learning
• Deep Learning
• Epilog
9
![Page 10: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/10.jpg)
(Industrial) Robot Arms
10
![Page 11: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/11.jpg)
Robot Arms
11
1 2 3
![Page 12: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/12.jpg)
Kinematics
12
• “Introduction to Robotics” Course in Mechanical Engineering
![Page 13: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/13.jpg)
Robot Playing Piano
• Inverse kinematics
13
![Page 14: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/14.jpg)
Today
• Physical Computing
• Kinematics in Robotics
• Parallel Manipulator (Delta Robots)
• Dynamics and Control
• Cyber-Physical Systems (CPS)
• Signal Processing
• Intelligence with Machine Learning
• Deep Learning
• Epilog
14
![Page 15: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/15.jpg)
Delta Robot
15
![Page 16: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/16.jpg)
Inverse Kinematics of Parallel Manipulator
16
work space
![Page 17: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/17.jpg)
Dancing Robot with Signal Processing
• Dancing with music (rule-based and -programmed)
• Signal processing (FFT)
17
![Page 18: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/18.jpg)
Multi-Agent System
18
• Wireless network
• Internet of Things
• Control strategy
• Cooperation
• 국립부산과학관전시예정
![Page 19: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/19.jpg)
Mobility: Mecanum Wheel
19
![Page 20: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/20.jpg)
Mobile Delta Robot
20
![Page 21: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/21.jpg)
Idol Robot Group (?)
21
• Korean idol girl groups
• Dance with changing formation
• Mobile: position and orientation control
• Localization + Robot Navigation (→ self driving car)
![Page 22: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/22.jpg)
Robot and Light
22
![Page 23: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/23.jpg)
23
![Page 24: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/24.jpg)
Today
• Physical Computing
• Kinematics in Robotics
• Parallel Manipulator (Delta Robots)
• Dynamics and Control
• Cyber-Physical Systems (CPS)
• Signal Processing
• Intelligence with Machine Learning
• Deep Learning
• Epilog
24
![Page 25: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/25.jpg)
Control: PID
• Require more advanced system design
• From open-loop to closed-loop systems
• 코딩으로어떻게구현하는지는대부분모른다
25
![Page 26: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/26.jpg)
Inverted Pendulum
26
• A famous control problem
• Feedback control: – angle from encoder command to servo motor
![Page 27: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/27.jpg)
Ball and Plate
27
• Position Feedback: vision in the loop– Location identification via Computer Vision
![Page 28: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/28.jpg)
Drone and Dynamics
• Quadcopter
28
![Page 29: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/29.jpg)
(Simpler) Unicopter
• Angle from encoder
• DC motor
![Page 30: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/30.jpg)
Drone Control
30
• Drifting Issue: Hovering and Tracking via vision
• Aerial Surveillance & Monitoring, Observation with Drone
![Page 31: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/31.jpg)
Reinforcement Learning
• Require more advanced control scheme– State space representation
– Optimized control scheme (LQR)
– Deep learning (reinforcement learning): totally different approach
31
![Page 32: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/32.jpg)
Today
• Physical Computing
• Kinematics in Robotics
• Parallel Manipulator (Delta Robots)
• Dynamics and Control
• Cyber-Physical Systems (CPS)
• Signal Processing
• Intelligence with Machine Learning
• Deep Learning
• Epilog
32
![Page 33: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/33.jpg)
New Concept: Cyber-Physical System (CPS)
• Physical and virtual components are deeply intertwined
33
![Page 34: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/34.jpg)
Augmented Reality (AR) and Virtual Reality (VR)
34
![Page 35: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/35.jpg)
35
(Big) Data InformationIntelligence
• Signal Processing (DSP) • Data Analytics
• Machine Learning and Deep Learning
Machines
![Page 36: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/36.jpg)
Today
• Physical Computing
• Kinematics in Robotics
• Parallel Manipulator (Delta Robots)
• Dynamics and Control
• Cyber-Physical Systems (CPS)
• Signal Processing
• Intelligence with Machine Learning
• Deep Learning
• Epilog
36
![Page 37: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/37.jpg)
Noise Reduction (Smoothing)
37
![Page 38: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/38.jpg)
Detection of Abrupt Changes
38
![Page 39: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/39.jpg)
Vibration Issue on SRT High Speed Train
39
![Page 40: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/40.jpg)
Vibration Issue on SRT High Speed Train
40
![Page 41: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/41.jpg)
Measured Data: SRT
41
![Page 42: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/42.jpg)
Measured Data: KTX
42
![Page 43: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/43.jpg)
Kalman Filter
43
![Page 44: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/44.jpg)
Today
• Physical Computing
• Kinematics in Robotics
• Parallel Manipulator (Delta Robots)
• Dynamics and Control
• Cyber-Physical Systems (CPS)
• Signal Processing
• Intelligence with Machine Learning
• Deep Learning
• Epilog
44
![Page 45: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/45.jpg)
Robot Playing Piano
45
![Page 46: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/46.jpg)
Robot Playing Piano
46
![Page 47: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/47.jpg)
How to Make Robots Intelligent
• It was programmed by users
• From music notes to autonomously playing– Artificial Intelligence from Computer Science
47
Perception with deep learning
![Page 48: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/48.jpg)
Machine Learning for Machine Intelligence
48
Classification
Regression
Clustering Dim reduction
![Page 49: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/49.jpg)
Deep Learning for Machine Intelligence
49
CNN
RNN
![Page 50: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/50.jpg)
Web-based Monitoring Dashboard
50
Probability of Classification
normal
unbalance
misalignment
![Page 51: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/51.jpg)
Motor in Robot
• Load (anomaly) generation– Anomaly is induced through manual press
51
![Page 52: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/52.jpg)
Demo for Unsupervised Learning
52
Th
reshold
![Page 53: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/53.jpg)
Anomaly Detection
53
normal abnormal
![Page 54: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/54.jpg)
Anomaly Detection
54
normal abnormal
![Page 55: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/55.jpg)
Data Science and Analytics in Engineering
• Industrial 4.0
55
Plant and facility Manufacturing
![Page 56: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/56.jpg)
Today
• Physical Computing
• Kinematics in Robotics
• Parallel Manipulator (Delta Robots)
• Dynamics and Control
• Cyber-Physical Systems (CPS)
• Signal Processing
• Intelligence with Machine Learning
• Deep Learning
• Epilog
56
![Page 57: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/57.jpg)
Convolutional Neural Networks (CNN)
• 이미지분류에서높은성능을보인 CNN 기법을진동신호기반결함진단에사용제안
57
Training Data
Feature Extraction Classification
DiagnosticsDeep Learning
![Page 58: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/58.jpg)
CNN on STFT Image
• 기본 CNN구조를활용하기위하여신호를이미지화 (STFT spectrogram)
58
STFT image
signal
![Page 59: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/59.jpg)
Dimension Reduction
• Principal Component Analysis (PCA)– Dim reduction without losing too much information
59
u1
u2
1
1
2
xu
x
![Page 60: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/60.jpg)
Dimension Reduction
• PCA in time signals
60
![Page 61: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/61.jpg)
61
Provide compressed representations
Deep Learning: Autoencoder
![Page 62: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/62.jpg)
Tutorials on Deep Learning
62
![Page 63: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/63.jpg)
Today
• Physical Computing
• Kinematics in Robotics
• Parallel Manipulator (Delta Robots)
• Dynamics and Control
• Cyber-Physical Systems (CPS)
• Signal Processing
• Intelligence with Machine Learning
• Deep Learning
• Epilog
63
![Page 64: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/64.jpg)
Failure, Success and the drive to keep Creating
64
![Page 65: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/65.jpg)
Failure, Success and the drive to keep Creating
65
Version 1 Version 2
![Page 66: Mechatronics with Machine Learning (+ Deep Learning)isystems.unist.ac.kr/wp-content/uploads/sites/209/2017/... · 2018-12-28 · Mechatronics with Machine Learning 04/10/2017 Prof.](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f851e0831d0956555687482/html5/thumbnails/66.jpg)
http://isystems.unist.ac.kr/
All materials (codes + hardware design) are available
66