CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout...

21
Sergio Gusmeroli CREATE the Next Generation IoT eXperience for the Future European Industry Partnership Collaborative Event Strategic Directions and Research Priorities. Amsterdam, April 17 th 11:20 EFFRA Roadmap and Connected Factories 2025 pathways materialization [email protected]

Transcript of CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout...

Page 1: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

Sergio Gusmeroli

CREATE the Next Generation IoT eXperience for the FutureEuropean Industry Partnership Collaborative EventStrategic Directions and Research Priorities. Amsterdam, April 17th 11:20

EFFRA Roadmap and Connected Factories 2025 pathways materialization

[email protected]

Page 2: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

Who We Are

European Factories of the Future Research Association (EFFRA)

▪ Industry-led association representing private side in the

‘Factories of the Future’ Public-Private Partnership with

European Commission

▪ 170+ members from across Europe (a network of experts)

▪ Members include large, small & medium industrial

enterprises, research organisations, universities, industrial

associations and clusters

▪ Full time secretariat: Connecting with members, coordinating

research agenda & liaising with the European Union

▪ Support wider Factories of the Future community

Page 3: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027Nr of

projects

Cumulative

total

FoF-2010 25 25

FoF-2011 36 61

FoF-2012 37 98

FoF-2013 53 151

FoF-2014 29 180

FoF-2015 28 208

FoF-2016 37 245

FoF-2017 23 268

FoF-2018 15 283

25 projects

36 projects

37 projects

53 projects

29 projects

28 projects

post-project impact & investments

post-project impact & investments

post-project impact & investments

post-project impact & investments

post-project impact & investments

post-project impact &investments

37 projects post-project impact & investments

post-project impact & investments23 projects

post-project impact & investm15 projects

▪ 283 Projects to date.

▪ > 2,000 organisations participating

▪ High involvement of SMEs: >30% of funding

▪ Projects feature demo activities

▪ >1000 results have been reported on EFFRA Innovation Portal (portal.effra.eu)

The Factories of the Future PPP - Some figures…

Page 4: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

From FoF 2020 roadmap to Factories 4.0 & Beyond 1

2

3

Page 5: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

I4MS Programme: ICT Innovation for Manufacturing SMEs

CloudiFacturing

1

Phase II BEinCPPS, Success Stories Industrial Cases

Phase III MIDIH, DIHs Networks, Reference Architecture, Open Calls

Phase IV DT-ICT-03-2020 Uptake digital game changers

Page 6: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

Cloud

Factory Gateway

NGSI

OPC-UA

122,5 125T1 (°C) T2 (°C)

Date Time Alert

25/04/16 14h56 A1

25/04/16 08h45 A1

26/04/16 15h12 A2

Alerts

Sensor data

Top closing mold A6

Pull out ejection B4

Injection machine data

Pull in ejection B3EUROMAP67

Smart MoldInjection Machine

6

Data visualization

Data storage

Data analysis

860P1 (bar)

Motor following

3,4I1 (A) 2,7I2 (A)

17C1 (mm) 67C2 (mm)

Smart Moulds in Plastic Industry

Motor Command

Local FiwareComponents

http://www.beincpps.eu/

Page 7: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

7

On-field Experimentation

x2Serial Bus

5v -> 24V(Transistors)

24V -> 5V(Opto Couplers)

Wires

Socket

Orchestrator

ControlerWires

Encoder

Current Sensor

Wires

Thermal Sensor x 2

Stepper

Local WireCloudserver

NGSI / OPC-UA

SPI

ADC

Serial Bus

Pressure Sensor

Page 8: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

8

NPE 2018: Orlando OCCC

Page 9: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

White Goods Zero Defect Quality process

15/05/20199

Q-Box 2

OPC UA Server

Box Handler

Executor

Advantech Interface

WH Network

Adam6017

Adam6018

Adam6051

Adam6052

EKI 3728

EKI 6332

Power Measure

Temperaure Measure

4 DI & 4 DO

4 AI & 2 Counters

A-Box2Actuator/Sensors

Test Plan Configurator

Operator IntelligenceDashboard

Page 10: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

Experimentation / Cassinetta Refrigeration Lab

15/05/201910

• Appliances in preparation for testing

• 4 Temperatures in cooling areas

• 2 Temperatures in warm areas

• Electrical Parameters

• Appliances Under Test• Type Built-in• Testing Time duration

from 20 to 120 minutes in according with the model and the specific procedures

Page 11: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

Cloud

Computing

(Hybrid Clouds)

Industrial AnalyticsAnalytics Middleware

DaR Security DaR Offline Processing

DaR Visualization DaR ServicesDaR Information Bus

Data

-at-

Res

tData Semantic Models

Edge

Computing

(Local Clouds)

Industrial IoTIoT Middleware

DiM Security DiM Offline Processing

DiM Visualization DiM ServicesDiM Events Broker

Data

-in

-Moti

on

Field Gateway

Data Persistence

Middleware

Str

eam

ing

and

Bat

chA

nal

yti

cs

(Dat

a M

anag

emen

t &

In

teg

rati

on

)

Zeppelin Flume Sqoop

Hadoop HBase

Cassandra Pheonix

KAFKA Zeppelin

Mahout

SPARK Flink Hive

Pig Tez

NiFiEdgentFlume STORM SPARK Flink

Samza

MIDIH Analytics Framework- Apache Implementation

Page 12: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

Cloud

Computing

(Hybrid Clouds)

Industrial AnalyticsAnalytics Middleware

DaR Security DaR Offline Processing

DaR Visualization DaR ServicesDaR Information Bus

Data

-at-

Res

tData Semantic Models

Edge

Computing

(Local Clouds)

Industrial IoTIoT Middleware

DiM Security DiM Offline Processing

DiM Visualization DiM ServicesDiM Events Broker

Data

-in

-Moti

on

Field Gateway

Data Persistence

Middleware

Str

eam

ing

and

Bat

chA

nal

yti

cs

(Dat

a M

anag

emen

t &

In

teg

rati

on

)

WILMAAuthZForce

KeyRock

WILMAAuthZForce

KeyRock

Knowage

WirecloudKurento

(DATA MODELS)

CKAN

STH-Comet Cygnus

Biz Ecosys.

Biz Ecosys.

Proactive Cepheus

Perseo

Cosmos

IoT BrokerOrion CB

IDAS IoT Discov.

MIDIH Analytics Framework- FIWARE Implementation

MIDIH Second Wave OPEN CALLS: from May 6th 2019

Page 13: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

Digital Manufacturing Platforms in DT-ICT-07-18/19 2

• Explicit connections between users

• Network is key value

Adapted from http://platformed.info/platform-stack/

"Operating system" "Middleware"

Examples of how different platforms fill in roles in different ways and to varying degrees

Network/Marketplace/Community

Technology infrastructure

Data• Unlock data

• Integration

• Complementary applications

• Development platforms

Ro

les

of

dig

ital

in

du

stri

al p

latf

orm

s

Network/Marketplace/Community

Technology infrastructure

Data

"Marketplace"

Network/Marketplace/Community

Technology infrastructure

Data

Network/Marketplace/Community

Technology infrastructure

Data

eFactory is the Marketplace for Agile Value Networks in Lot Size 1 Production

ZDMP is the Operating System for developing ZDM systems of systems

QU4LITY is the cross-platforms Middleware for operating ZDM systems of systems

Page 14: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

OPEN DEI CSA in DT-ICT-13 3

Page 15: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

Pathways to digital manufacturing + enablers and critical success factors

CPPS in Data-driven Architectures

Video on https://www.connectedfactories.eu/pathways-digitalisation-manufacturing

Page 16: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

Three major pathways towards Digital Manufacturing

Collaborative Product-Service Factories: Inter-operability of Personal and Industrial IoT Data Spaces along the Product / Material lifecycle for Sustainable Value Networks (Circular Economy)

Autonomous Smart Factories: Collaborative Intelligence between humans and IoT-driven Autonomous Systems (Collaborative Robots, Humans in the Loop) considering Human Factors and Skills gaps

Hyper-connected Factories: Interoperability between IoT Open Platforms and Proprietary Systems through pan-EU Data-Service Marketplaces (IoT Catalogue)

Page 17: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

The SMI Discussion Paper 1.0: FoF backgroundThe FoF background is materialised by its validation business scenarios of Smart Factory, Smart Product and Smart Supply Chains as projected to 2025 by the pathways

• Autonomous Smart Factories, • Collaborative Product-Service Factoriesand • Hyperconnected factories

FoF is also providing its reference architectures, originated e.g. from RAMI 4.0 PlattformIndustrie 4.0 and the Industrial Internet Consortium, and data-driven implementation guidelines such as the layered data-buses architecture of IIRA 1.8.

Page 18: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

SMI Reference Framework

Smart Factory(data is generated inside

production lines)

Smart Product(data is generated by

product-service itself along its lifecycle)

Smart Supply Chain(data is generated by

ecosystems of suppliers, providers, distributors,

retailers, etc.)

Data Management and Lifecycle

Data Processing Architectures

Data Analytics

Data Protection

Data Visualization and User Interaction

56 big data research and

innovation challengesrelated to Smart Manufacturing

Grand Scenarios

BDVA Data Priority Tech areas

Page 19: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

Towards a Manufacturing Partnership under Horizon Europe (2021 – 2027)

Page 20: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

Sergio Gusmeroli

CREATE the Next Generation IoT eXperience for the FutureEuropean Industry Partnership Collaborative EventStrategic Directions and Research Priorities. Amsterdam, April 17th 11:20

EFFRA Roadmap and Connected Factories 2025 pathways materialization

[email protected]

Page 21: CREATE the Next Generation IoT eXperience for the Future · Cassandra Pheonix KAFKA Zeppelin Mahout SPARK Flink Hive Pig Tez NiFi Flume Edgent STORM SPARK Flink Samza MIDIH Analytics

Thank You

[email protected]

EFFRA.EU

@EFFRA_Live

EFFRA.LiveTM

TM

TM