连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT...

20
AWS中国(宁夏)区域由西云数据运营 AWS中国(北京)区域由光环新网运营 连接物理世界和云 获享互联世界价值 初探AWS IoT平台 张洋 AWS架构师 Yang Zhang, AWS Solution Architect 201865June 5, 2018

Transcript of 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT...

Page 1: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

连接物理世界和云获享互联世界价值

初探AWS IoT平台

张洋 AWS架构师Yang Zhang, AWS Solution Architect

2018年6月5日June 5, 2018

Page 2: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

一个例子 – Alexa Turn On (the) Light

物与物之间的网络:• Alexa,灯等智能硬件

• 信息处理平台

• 数据分析展示平台

Page 3: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

AWS IoT 整体架构 –设备端Enterprise Applications

Enterprise Users

Corp Apps

Amazon

QuickSight

Amazon

EMR

Amazon Redshift

Amazon

S3

Machine Learning

AWS Lambda

All

AWS

IoT Partners

Edge

ARM, Broadcom, Digi,

Expressif, Intel, MediaTek,

Microchip, NXP, ST, TI,

Qualcomm, …

Gateway

Adlink Technology,

Advantech, MachineShop,

Samsung, Technicolor, …

ISV (Platform)

Ayala, Bright Wolf,

BSquare, C3IoT, Mnubo,

Salesforce, Splunk,

Thinglogix, …

Connectivity

Amdocs, Asavie, AT&T,

Eseye, Soracom, TATA

Communications, Telus,

Verizon, …

Consulting / SI

Accenture, Aricent,

Clearscale, CTP, Luxoft,

Mobiquity, Solstice,

Storm Reply, Sturdy

Networks, TCS, Trek10, …

Cloud

Device Shadow

RulesEngine

AWS IoT

Core

Certificate Authority

AWS IoTDevice

Management

AWS

IoT Users

Over-The-Air (OTA) Updates

Analytics Data Store

Data Pipelines

Templated Reports

Batch Fleet Provisioning

Real-Time Fleet Index &

Search

AWS IoTDevice

Defender

Ad-hoc & In-depth Analysis

Risk Mitigation

Monitor Device

Behavior

Alerts

Message Broker

Audit Device Configurations

Amazon Kinesis

AWS IoT

Analytics

AWS IoT 1-Click

MQTT

MQTT

Endpoints Gateway/PLC

DeviceShadow

LambdaFunctions

Local Comms Long-range Comms

Amazon FreeRTOS

Certificate Authority

Local Resources

IoT SDK

OPC-UA

MQTT

Edge

Users

Cert

WiFi

MQTT

Edge

OTAOTA

Amazon FreeRTOS

Integrated

Client

SnowballEdge

AWS Greengrass

MQTT

AWS Greengrass

Message Broker

ʥA

ProtocolAdapter

Page 4: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

如何上手?一个端到端的案例

https://github.com/cncoder/aws-iot-raspberrypi

手机端查看树莓派的温控探测并控制灯开关。

Page 5: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

设备端AWS SDK

AWS IoT SDK

Amazon FreeRTOS

AWS Greegrass

• C++, Java, .Net, Node.js, Python, PHP, Ruby, Go, iOS/Android

• embedded C, Node.js, java, Python, Arduino Yun, iOS/android

Data and State Sync

Security Over the Air

Updates

Protocol Adapters

LocalActions

LocalMessages

and Triggers

Machine Learning Inference

Local Resource

Access

ʥA

Local Connectivity

Libraries

Cloud Connectivity

Libraries

Security Connectivity

Libraries

OTA Beta &Code Signing

API GatewayLambdaRedShiftS3 Machine LearningKinesisAWS IoT EMR DynamoDB

Page 6: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

AWS IoT 端到端的安全与策略

策略Private Key& Certificate& CA-Root

设备

规则引擎

IAM 角色

策略SDK

AWS IoT AWS 服务& App

执行角色

策略TLS

Page 7: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

AWS IoT 整体架构 – IoT平台Enterprise Applications

Enterprise Users

Corp Apps

Amazon

QuickSight

Amazon

EMR

Amazon Redshift

Amazon

S3

Machine Learning

AWS Lambda

All

AWS

IoT Partners

Edge

ARM, Broadcom, Digi,

Expressif, Intel, MediaTek,

Microchip, NXP, ST, TI,

Qualcomm, …

Gateway

Adlink Technology,

Advantech, MachineShop,

Samsung, Technicolor, …

ISV (Platform)

Ayala, Bright Wolf,

BSquare, C3IoT, Mnubo,

Salesforce, Splunk,

Thinglogix, …

Connectivity

Amdocs, Asavie, AT&T,

Eseye, Soracom, TATA

Communications, Telus,

Verizon, …

Consulting / SI

Accenture, Aricent,

Clearscale, CTP, Luxoft,

Mobiquity, Solstice,

Storm Reply, Sturdy

Networks, TCS, Trek10, …

Cloud

Device Shadow

RulesEngine

AWS IoT

Core

Certificate Authority

AWS IoTDevice

Management

AWS

IoT Users

Over-The-Air (OTA) Updates

Analytics Data Store

Data Pipelines

Templated Reports

Batch Fleet Provisioning

Real-Time Fleet Index &

Search

AWS IoTDevice

Defender

Ad-hoc & In-depth Analysis

Risk Mitigation

Monitor Device

Behavior

Alerts

Message Broker

Audit Device Configurations

Amazon Kinesis

AWS IoT

Analytics

AWS IoT 1-Click

MQTT

MQTT

Endpoints Gateway/PLC

DeviceShadow

LambdaFunctions

Local Comms Long-range Comms

Amazon FreeRTOS

Certificate Authority

Local Resources

IoT SDK

OPC-UA

MQTT

Edge

Users

Cert

WiFi

MQTT

Edge

OTAOTA

Amazon FreeRTOS

Integrated

Client

SnowballEdge

AWS Greengrass

MQTT

AWS Greengrass

Message Broker

ʥA

ProtocolAdapter

Page 8: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

AWS IoT设备网关标准协议支持(无锁定)

数百万计的设备和应用程序可以通过MQTT, WebSockets, HTTP 协议进行连接

长连接、双向的消息Pub/Sub 代理

客户端(设备和应用程序)可以从云中接收命令和控制信号

默认安全

通过 X509 证书和 TLS 1.2 客户端双向身份验证进行安全连接

可以对数据和控制指令采用不同channel

高度可扩展设备网关

基于主题的架构(raspberryXX/sensor/data)

Page 9: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

AWS IoT 设备影子工作原理

Shadow

Device SDK

1.设备发布当前状态

2.持久化JSON 数据存储

3.应用程序请求设备的当前状态

4.应用程序请求更改设备状态5. 设备影子同步更新的状态

6.设备发布当前状态7.设备影子确认状态更改

AWS IoT

Page 10: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

设备组与设备组策略

白炽灯

荧光灯

Page 11: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

设备更新

IoT thing

AWS IoT

Job Execution

Notify topic

(per thing)

Status Update

Accepted topic

(per thing)

Rejected topic

(per thing)

Accepted

Rejected

S3 Bucket

(Job Artifacts)

Optional Downloads

Job DocumentIoT rule

IoT rule

IoT rule

• 设备监听 Job 通知• 设备根据 Job 内容进行更新,并上报自身的 Job 执行结果

• AWS IoT Device Management 可以对单个设备,或者一批设备进行更新操作

• 可以在 Job 文件中包含更新链接进行下载

$aws/things/MyThing/jobs/notify

$aws/things/MyThing/jobs/notify-next

$aws/things/MyThing/jobs/jobId/get/accepted

$aws/things/MyThing/jobs/jobId/get/rejected

Page 12: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

AWS IoT Analytics 介绍

AWS IoT设备

AWS IoT Core

数据收集 数据处理存储 数据集

数据分析

可视化

AWS IoT Analytics

消息网关

Page 13: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

为任意设备一键创建 AWS Lambda 触发器

AWS IoT 1-Click 是一项新服务,可让简单设备轻松触发Lambda 函数等操作。借助 AWS IoT 1-Click,简单设备开箱

即可安全连接到 AWS IoT Core

AWS IoT 1-Click

Page 14: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

选择设备 选择要触发的操作类型

选择Lambda设置Device ID

激活

部署过程

Page 15: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

AWS IoT 整体架构 –数据分析Enterprise Applications

Enterprise Users

Corp Apps

Amazon

QuickSight

Amazon

EMR

Amazon Redshift

Amazon

S3

Machine Learning

AWS Lambda

All

AWS

IoT Partners

Edge

ARM, Broadcom, Digi,

Expressif, Intel, MediaTek,

Microchip, NXP, ST, TI,

Qualcomm, …

Gateway

Adlink Technology,

Advantech, MachineShop,

Samsung, Technicolor, …

ISV (Platform)

Ayala, Bright Wolf,

BSquare, C3IoT, Mnubo,

Salesforce, Splunk,

Thinglogix, …

Connectivity

Amdocs, Asavie, AT&T,

Eseye, Soracom, TATA

Communications, Telus,

Verizon, …

Consulting / SI

Accenture, Aricent,

Clearscale, CTP, Luxoft,

Mobiquity, Solstice,

Storm Reply, Sturdy

Networks, TCS, Trek10, …

Cloud

Device Shadow

RulesEngine

AWS IoT

Core

Certificate Authority

AWS IoTDevice

Management

AWS

IoT Users

Over-The-Air (OTA) Updates

Analytics Data Store

Data Pipelines

Templated Reports

Batch Fleet Provisioning

Real-Time Fleet Index &

Search

AWS IoTDevice

Defender

Ad-hoc & In-depth Analysis

Risk Mitigation

Monitor Device

Behavior

Alerts

Message Broker

Audit Device Configurations

Amazon Kinesis

AWS IoT

Analytics

AWS IoT 1-Click

MQTT

MQTT

Endpoints Gateway/PLC

DeviceShadow

LambdaFunctions

Local Comms Long-range Comms

Amazon FreeRTOS

Certificate Authority

Local Resources

IoT SDK

OPC-UA

MQTT

Edge

Users

Cert

WiFi

MQTT

Edge

OTAOTA

Amazon FreeRTOS

Integrated

Client

SnowballEdge

AWS Greengrass

MQTT

AWS Greengrass

Message Broker

ʥA

ProtocolAdapter

Page 16: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

1. AWS 服务(直接集成)

Rules Engine

操作

消息加工处理 --- AWS IoT规则引擎

AWS

LambdaAmazon

SNS

Amazon

SQS

Amazon

S3

Amazon

Kinesis

Amazon

DynamoDB Amazon RDS

Amazon

Redshift

Amazon Glacier

Amazon

EC2

3. 外部终端节点(通过 Lambda 和 SNS)

规则引擎 将 AWS IoT 连接到外部终端节点和 AWS 服务。

2. AWS 的其余部分(通过 Amazon Kinesis、AWS Lambda、Amazon S3

及其他服务)

Page 17: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

简单且熟悉的语法

- 使用SQL语句来定义筛选条件

- 可选 WHERE 子句

函数改进了信号/噪音

- 数十种 functions() 可用

- 字符串操作(正则表达式支持)

- 数学运算

- UUID、Timestamp、rand 等

多个/同时操作

- 有时需要您采取多种操作

AWS IoT规则引擎

SELECT DATA FROM TOPIC WHERE FILTER

Page 18: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

IoT 规则样例

Page 19: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

AWS IoT 整体架构 –总结Enterprise Applications

Enterprise Users

Corp Apps

Amazon

QuickSight

Amazon

EMR

Amazon Redshift

Amazon

S3

Machine Learning

AWS Lambda

All

AWS

IoT Partners

Edge

ARM, Broadcom, Digi,

Expressif, Intel, MediaTek,

Microchip, NXP, ST, TI,

Qualcomm, …

Gateway

Adlink Technology,

Advantech, MachineShop,

Samsung, Technicolor, …

ISV (Platform)

Ayala, Bright Wolf,

BSquare, C3IoT, Mnubo,

Salesforce, Splunk,

Thinglogix, …

Connectivity

Amdocs, Asavie, AT&T,

Eseye, Soracom, TATA

Communications, Telus,

Verizon, …

Consulting / SI

Accenture, Aricent,

Clearscale, CTP, Luxoft,

Mobiquity, Solstice,

Storm Reply, Sturdy

Networks, TCS, Trek10, …

Cloud

Device Shadow

RulesEngine

AWS IoT

Core

Certificate Authority

AWS IoTDevice

Management

AWS

IoT Users

Over-The-Air (OTA) Updates

Analytics Data Store

Data Pipelines

Templated Reports

Batch Fleet Provisioning

Real-Time Fleet Index &

Search

AWS IoTDevice

Defender

Ad-hoc & In-depth Analysis

Risk Mitigation

Monitor Device

Behavior

Alerts

Message Broker

Audit Device Configurations

Amazon Kinesis

AWS IoT

Analytics

AWS IoT 1-Click

MQTT

MQTT

Endpoints Gateway/PLC

DeviceShadow

LambdaFunctions

Local Comms Long-range Comms

Amazon FreeRTOS

Certificate Authority

Local Resources

IoT SDK

OPC-UA

MQTT

Edge

Users

Cert

WiFi

MQTT

Edge

OTAOTA

Amazon FreeRTOS

Integrated

Client

SnowballEdge

AWS Greengrass

MQTT

AWS Greengrass

Message Broker

ʥA

ProtocolAdapter

Page 20: 连接物理世界和云 获享互联世界价值 · AWS IoT Analytics AWS IoT 1-Click MQTT MQTT Endpoints Gateway/PLC Device Shadow Lambda Functions Local Comms Long-range Comms

AWS中国(宁夏)区域由西云数据运营AWS中国(北京)区域由光环新网运营

Thank You!