Integration of Things (Sam Vanhoutte @Iglooconf 2017)

INTEGRATION OF THINGS: INDUSTRIAL IOT SOLUTIONS ON

AZURE

@SamVanhoutte, CTO Codit

Hello world

[email protected]+32 474 849 [email protected]/in/samvanhoutte

4th year Azure MVP

2000 Belgium2004 France2013 Portugal2016 Netherlands2016 Swiss2016 UK

Microsoft Integration

IoT Integrati

onAPI

MgmtAzure

@CoditCompany 120 employees

3

IoT Scenarios

4

IoT Scenarios

Industrial IoT

5

Industrial IoT

It’s not about Arduino’s or Raspberry Pi’s

Very diverse landscape of machinery

Multi-tenancy on data (customer vs manufacturer)

6

Industrial IoT

Very often legacy systems, not build with connectivity in mind

Remote monitoring & predictive maintenance

Standardization efforts: OPC-UA

IoT Value chain

7

The IoT

value

chain

Nebulus Cloud

Gateway

Bridge local protocols to cloud

Cross-plat, Azure connected

Device & gateway management

Cloud gateway connectivity

Gateway portal

Manage & provision configure & secure

gateways

NebulusField

Gateway

Adding value to

Azure

Project effort per phase

Connectivity

10

Direct connectivity➔ Easiest to install and configure➔ Mixing machine logic with IoT

logic➔ Complexity of IoT (retries,

command handling…) on every machine

➔ Not possible for legacy systems➔ “Feels” less secure

Connect machines directly with the internet

Azure IoT Hub

Cloud gateways➔ Devices come with embedded

connectivity (LoRa, SigFox…) to a propriatary cloud

➔ Cloud to Cloud integration needed➔ Forwarding capabilities from platforms

available to ➔ Azure IoT, Amazon, custom HTTP endpoints

➔ Easy to start in the cloud

Out of the box cloud connectivity with cloud gateway forwarding

Azure IoT Hub Protocol Gateway SDK

https://github.com/Azure/azure-iot-protocol-gateway/blob/master/README.md

https://github.com/Azure/azure-iot-protocol-gateway/blob/master/README.md

Field gateways➔ Requires extra hardware

➔ industrial PC, physical gateway➔ Machine logic seperated from

IoT logic➔ Complexity of IoT in one single

place➔ Retries, command handling…

➔ Way to Internet-enable legacy systems

➔ “Feels” more secure

Connect (multiple) machines through a gateway with the internet

Azure IoTGateway SDK

https://github.com/Azure/azure-iot-gateway-sdk

https://github.com/Azure/azure-iot-gateway-sdk

Nebulus IoT Gateway designNebulus IoT Field Gateway

Microsoft Azure IoT Gateway SDK (module)

Channel

ModBusModule

FilteringModule

CompressionModule

IoTHubModule

Channel

DeviceModel Module

Identity Module

IoTHubModule

Nebulus channels can contain custom modules and standard modules and will be mapped to runtime SDK modules.

pub/sub

Dyna

mic

Com

man

d Di

spat

cher

Com

man

d lis

tene

r tha

t disp

atch

es C

2D c

omm

ands

to d

iffer

ent m

odul

es

Activation Logic Secure bootstrapper for initial activation & identity logic

Module Repository Manager Downloads and updates modules from the cloud, on new versions

Configuration Manager Listens for configuration updates to the cloud and dispatches to the runtime

Gateway Information Manager Returns information about the health of the device on which the Gateway runs

Port forwarder (remote access) Allows remote connections on the local network for remote desktop & other tools

Device Discovery agent Listens for requests to scan network for devices and reports back to backendBuilt and provided by Codit

Provided by Microsoft SDK

Nebulus IoT Gateway is a supported, full product, using the Microsoft Azure IoT Gateway SDK (which is a framework), provided by Microsoft.

Nebulus IoT Gateway is backed by a Cloud API that allows customers to interact with their gateways.

Data

15

Data structures➔ Canonical data structures needed

➔ Device representation (structure)➔ Field parameters

➔ Two directions of telemetry➔ Persist native stream➔ Normalize towards ‘canonical data structure’

Data storage options

Source: https://biz-excellence.com/2016/08/30/big-data-dt/

https://biz-excellence.com/2016/08/30/big-data-dt/

Integrate & Act

18

Business Rules➔ Seperate rules evaluation

from action processing➔ Require flexibility & dynamic

creationAzure Stream Analytics

Azure Service Fabric

Integration➔ An IoT solution should not be isolated➔ Integration with other systems

➔ Ticketing systems➔ Maintenance➔ Command and control

Azure Logic Apps

Azure Service Bus& Routes !

Device Management

21

Device lifecycle PlanGroup devices and control access according to your

organization's needs

ProvisionSecurely authenticate devices, on-board for management and

provision for service

ConfigureProvide updates, configuration

& applications to assign the purpose of each device

MonitorMonitor device inventory, health & security while

providing proactive remediation of issues

RetireReplace or decommission

devices after failure or service lifetime

Device management, challenges

23

➔ Scale & Automation➔ Less complex tools which enable management of millions of devices with a

small staff ➔ Open & Compatible

➔ Tools provide tailored management for many different hardware, software, and protocol platforms

➔ Context aware➔ Management operations adjust to dynamic conditions: downtime windows,

network/power conditions, usage patterns, and device geolocation ➔ Serve many roles

➔ Including traditional IT, support for the workflows and processes of admin and operations roles are crucial (IT + OT)

Azure IoT

24

Platform Services

Infrastructure ServicesOS/Server Compute Storage

Datacenter Infrastructure (24 Regions, 22 Online)

Web and Mobile

Web Apps

MobileApps

APIManagement

API Apps

Logic Apps

Notification Hubs

Media & CDNContent DeliveryNetwork (CDN)

Media Services

Integration

HybridConnections

Service Bus

StorageQueues

HybridOperations

Backup

StorSimple

Azure SiteRecovery

Import/Export

Networking

Data

SQL Database

DocumentDB

RedisCache Azure

SearchStorageTables

DataWarehouse Azure AD

Health Monitoring

Virtual Network

ExpressRouteBLOB

StorageAzureFiles

PremiumStorage

Virtual Machines

AD PrivilegedIdentity Management

Traffic Manager

AppGateway

OperationalAnalytics

Services ComputeCloud Services

Batch RemoteApp

ServiceFabric

Developer Services

Visual Studio

AppInsights

Azure SDK

VS Online

ContainerService

DNS VPN Gateway

Load Balancer

Domain Services

Analytics & IoT

HDInsight MachineLearning

StreamAnalytics

Data Factory

EventHubs

MobileEngagement

Data Lake

IoT Hub

Data Catalog

Security & Manageme

nt

Azure ActiveDirectory

Multi-FactorAuthentication

Automation

Portal

Key Vault

Store/Marketplace

VM Image Gallery& VM Depot

Azure ADB2C

Scheduler

Logic Apps

Azure IoT HubIoT Hub

Twin 0

Tags

Properties

Desired

Reported

Methods

Device 0 (or GW)

edge cloud back-end

Edge-visible metadata/config

Edge reported state/condition

…

Telemetry

Edge-opaque metadata

Cloud initiated device actions

Device metadata & organisation

28

IoT Hub

Twin 0

Tags

Properties

Desired

Reported

Methods…

Telemetry

Jobs

Queries

Set tags on twins to simplify the task of finding and targeting devices

Device management & configuration

29

IoT Hub

Twin 0

Tags

Properties

Desired

Reported

Methods…

Telemetry

Jobs

Queries

Set desired properties on twins to set common policy across a large group of devices

Device querying & compliance

30

IoT Hub

Twin 0

Tags

Properties

Desired

Reported

Methods…

Telemetry

Jobs

Query desired and reported properties to attest device compliance and surface problems Queries

Device troubleshooting & updating

31

IoT Hub

Twin 0

Tags

Properties

Desired

Reported

Methods…

Telemetry

Jobs

Queries

Initiate an action directly on a device or schedule an action with a job

demo

32

• Telemetry & routes• File upload•Device twins•Device queries•Direct methods•Device jobs

demo

33

Cognitive services (ADLA)

link

https://gist.github.com/SamVanhoutte/eec797c6c709c8ce26c92896fa75bec4#file-getimageinformation-sql

THANK YOU!

Integration of Things (Sam Vanhoutte @Iglooconf 2017)

Internet

Transcript of Integration of Things (Sam Vanhoutte @Iglooconf 2017)