Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment...
Transcript of Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment...
![Page 1: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/1.jpg)
1
Deploying AI for Near Real-
Time Manufacturing
DecisionsPierre Harouimi
![Page 2: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/2.jpg)
2
The Need for Large-Scale Streaming
Predictive MaintenanceIncrease Operational Efficiency
Reduce Unplanned DowntimeMedical Devices
Patient Safety
Better Treatment Outcomes
Connected CarsSafety, Maintenance
Advanced Driving Features
FinanceHigh Frequency Trading
Sentiment Analysis
![Page 3: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/3.jpg)
3
Example Problem: develop and operationalize a machine
learning model to predict failures in industrial pumps
Current system requires Operator to manually monitor operational metrics for
anomalies. Their expertise is required to detect and take preventative action.
System ArchitectProcess Engineer Operator
Develops models
in MATLAB and
Simulink
Deploys and
operationalizes model
on Azure cloud
Makes operational
decisions based
on model output
![Page 4: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/4.jpg)
4
➔
Project statement: develop end-to-end predictive maintenance
system and demo in one 3-4 week sprint
Operator
![Page 5: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/5.jpg)
5
Project statement: constraints & solution
Process Engineer
Architect IT
Process Engineer
![Page 6: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/6.jpg)
6
Edge Production System Analytics Development
MATLAB Production Server
Request
Broker
Worker processes
Compiler SDK MATLAB
Business Decisions
Package
& DeployModel
Predictive Maintenance Architecture on Azure
State Persistence
Storage Layer
Connector
Presentation Layer
![Page 7: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/7.jpg)
7
Time-windowing
Out-of-order delivery
Review model requirements
Test code Scalable codeType of fault RUL
Operator System Architect
Process
Engineer
![Page 8: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/8.jpg)
8
A complete end-to-end workflow
Multiple formats
Messy Data
Arrange data
Preprocess
Files
Database & Cloud
Sensors
Access Data
Model Creation
Machine Learning
Model
Validation
Parameter
Optimization
Predictive
Analytics
Data
Transformation
Feature Extraction
Identify
Features
Feature Selection
Deploy &
Integrate
Enterprise Scale
System
Web Apps
Visualization
![Page 9: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/9.jpg)
9
Component
FailureCrankshaft drives three plungers➔ Three types of failures
Outlet
AlgorithmPressure
Sensor
Failure
Diagnosis
Inlet
Bearing Friction
Blocking Fault
Leak Area
Access/Generate data
Crankshaft
Access/
Generate Data
Process
Engineer
![Page 10: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/10.jpg)
10
Access/Generate data
Data & Failures
Simulation
Bearing Friction
Blocking Fault
Leak Area
Run many
parallel simulations
Digital Twin Parallel Computing
Process
Engineer
![Page 11: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/11.jpg)
11
Preprocessing data
timetable
Process
Engineer
![Page 12: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/12.jpg)
12
Identify Condition Indicators
Feature
Diagnostic
Designer
Visualize data
Extract features
Select the most useful features
Process
Engineer
![Page 13: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/13.jpg)
13
Predictive Analytics: regression
= Remaining Useful Life
RUL
Process
Engineer
![Page 14: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/14.jpg)
14
Predictive Analytics: classification
Type of fault
Process
Engineer
![Page 15: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/15.jpg)
15
Integrate with Production Systems
Messaging ServiceContinuous Data
f(x)
Streaming
FunctionMake
DecisionsUpdate State
Pump Sensor Data
Stream Processing: apply model to sensor data in near real-time
Process
Engineer
System
Architect
![Page 16: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/16.jpg)
16
Process each window of
data as it arrives
Current window of data to
be processed
Previous state
Develop a streaming function
![Page 17: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/17.jpg)
17
Package Stream Processing Function easily
![Page 18: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/18.jpg)
18
High frequency Big Data ScalablilityAlerts
Operator Engineer
Review System Requirements
Type of fault
System
Architect
![Page 19: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/19.jpg)
19
Integrate Analytics with Production Systems
Edge Production System Analytics Development
MATLAB Production Server
Request
Broker
Worker processes
Compiler SDK MATLAB
Business Decisions
Package
& DeployModel
State Persistence
Storage Layer
Connector
Presentation Layer
System
Architect
![Page 20: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/20.jpg)
20
Production System
Management Server
https management endpoint
MATLAB
Production
Server(s)
scaling group
Virtual Network
Enterprise Applications
Connectors for
Streaming/Event
Data
Connectors for Storage & Databases
Application
Gateway Load
Balancer
State Persistence
Configure MATLAB Production Server in the cloud
https://github.com/mathworks-ref-archSystem
Architect
![Page 21: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/21.jpg)
21
Production System
MATLAB Production Server
Request Broker
Worker processes
ConnectorPump
fleet
timetable
Pump
results
Zoom on Kafka connector to MPS
System
Architect
![Page 22: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/22.jpg)
22
Event
Time
Pump Id Flow Pressure Current
… … … … …
… … … … …
… … … … …
… … … … …
… … … … …
… … … … …
… … … … …
… … … … …
… … … … …
… … … … …
… … … … …
MATLAB
Function
State
State
18:01:10 Pump1 1975 100 110
18:10:30 Pump3 2000 109 115
18:05:20 Pump1 1980 105 105
18:10:45 Pump2 2100 110 100
18:30:10 Pump4 2000 100 110
18:35:20 Pump4 1960 103 105
18:20:40 Pump3 1970 112 104
18:39:30 Pump4 2100 105 110
18:30:00 Pump3 1980 110 113
18:30:50 Pump3 2000 100 110
MATLAB
Function
State
MATLAB
Function
State
Input Stream
Time window Pump Id Bearing
Friction
… … …
18:00:00 18:10:00 Pump1 …
Pump3 …
Pump4 …
18:10:00 18:20:00 Pump2 …
Pump3 …
Pump4 …
18:20:00 18:30:00 Pump1 …
Pump3 …
Pump4 …
18:30:00 18:40:00 Pump5 …
Pump3 …
Pump4 …
Output Stream
5
7
3
9
4
5
Streaming data is treated as an unbounded Timetable
![Page 23: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/23.jpg)
23
Debug your streaming function on live data
Edge Analytics Development
Compiler SDK MATLAB
Business Decisions
Model
Storage Layer
Connector
Presentation Layer
Production System
![Page 24: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/24.jpg)
24
Complete your application
Edge Analytics Development
MATLAB Production Server
Request
Broker
Worker processes
Compiler SDK MATLAB
Business Decisions
Package
& DeployModel
Connector
Presentation Layer
Production System
Storage Layer
Operator
![Page 25: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/25.jpg)
25
Access Data
Build Machine Learning models
Deployment
Web apps
![Page 26: Deploying AI for Near Real- Time Manufacturing Decisions...High Frequency Trading Sentiment Analysis. 3 Example Problem: develop and operationalize a machine learning model to predict](https://reader034.fdocuments.net/reader034/viewer/2022050100/5f3f9902c19684674d152d5e/html5/thumbnails/26.jpg)
26
We saw three advantages in using MATLAB
[…]. The first is speed; development in C or
other language would have taken longer. The
second is automation. The third is the wide
variety of technologies.
Reduce pump equipment costs & downtime
Use MATLAB to analyze 1 TB of data and create a neural network to predict machine failures
Follow this link to read the complete user story of Gulshan Singh
Savings of more than
$10 million projected
Development time
reduced tenfold
Ease of use
Multiple types of data