From IoT Security to NRT Compute in the Rules...
Transcript of From IoT Security to NRT Compute in the Rules...
From IoT Security to NRT Compute in the Rules Engine inside AWS IoTJan Metzner,Specialist Solutions Architect IoT, EMEA
@janmetzner
WhattoExpectfromtheSession
• Bring Devices Online Everywhere on the Globe• React instantly on incoming Data• IoT Rules Engine insights• IoT Streaming Analytics Globally• Central IoT Data Lake
AWS IoT Recap
AWS IoT Recap
AWS IoT Recap
AWS IoT Recap
AWS IoT Recap
AWS IoT Recap
AWS IoT Recap
AWS IoT – Connect Billions of Things – Globally
Just-In-Time Registration
ManufacturingLine
ProvisioningoftheIdentitiessignedwithCustomersCA
FirstDataConnection
JITRegistration
Just-In-Time Registration – ProvisioningCustomersHardwareSecurityModule(HSM) CS
R
CSR
CSR
Just-In-Time Registration – CA Registration
getRegistrationCode()
CustomersHardwareSecurityModule(HSM) CS
R
CSR
CSR
registerCACertificate(CACert,RegCert)
Just-In-Time RegistrationCustomersHardwareSecurityModule(HSM)
checkYourCRL()updateCertificate(Cert, ACTIVE)attachPrincipalPolicy(Cert, IoTPolicy)updateERP()
FunctionhandlingPENDING_ACTIVATIONState
AWS IoT – Rules Engine
Rules engine
Rules engine: Extracting value from messages
• Filter messages with certain criteria
• Transform the payload of messages
• React based on messages• Move messages to other topics• Move messages to other systems
• Predict changes based on trends
Rules engine: Move messages to other systems
InvokeaLambda function
PutobjectinanS3bucket
Insert,updateaDynamoDB table
PublishtoanSNStopicorendpoint
PublishtoanAmazonKinesisstream(andtoEMRandSpark)
PublishtoFirehose
RepublishtoAWSIoT
PublishtoAmazonES
CaptureaCloudWatchmetricorchangeanalarm
WritetoSQSqueue
A rule in AWS IoT
aws iot create-topic-rule --rule-name WindFarmData --topic-rule-payload {
"sql": "SELECT datapoint_id, current, rotation_speed, location,topic(2) as turbine_id, timestamp() as time,
FROM 'wind-farm/+/data'","description": "Save data from wind turbines into Elasticsearch","actions": [
{"elasticsearch": {
"roleArn": "arn:aws:iam::123456789012:role/aws_iot_windfarm","endpoint": "https://my-es-endpoint.eu-west-1.es.amazonaws.com","index": "turbine-data","type": "measurement","id": "${CONCAT(datapoint_id, '_', turbine_id)}"
}}]}
RouteFilter,transform
Live Demo
IoT – Streaming Analytics
IoT – Global Data Collection – Where to Process the Data
Example Data Flow with AWS IoT
Amazon S3
AmazonDynamoDB
Kinesis Analytics(Time Series Aggregation)
Kinesis Stream(Buffer)
IoT
InstantReaction
PostProcessing
optimize
Machine Learning
Lambda
Firehose(Buffer + Batch)
EMR(Hadoop/Spark/Presto)
Lambda
Machine Learning
optimize
Global Data Ingest and Processing
IngestRegion ProcessingRegion
StorageRegion
Live Demo
Now Build a Global IoT Solution!