Powering Smart Cities with IoT, Real-Time and an Agile...
Transcript of Powering Smart Cities with IoT, Real-Time and an Agile...
![Page 1: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,](https://reader031.fdocuments.net/reader031/viewer/2022022700/5a9e96fa7f8b9a89178b8c87/html5/thumbnails/1.jpg)
Oct 31-Nov 2 2017
Powering Smart Cities with IoT, Real-Time and an Agile Data Platform
Cloud Expo
![Page 2: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,](https://reader031.fdocuments.net/reader031/viewer/2022022700/5a9e96fa7f8b9a89178b8c87/html5/thumbnails/2.jpg)
By 2050, around 70% of the world’s population will be
concentrated in urban areas, compared with 54% in 2014
![Page 3: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,](https://reader031.fdocuments.net/reader031/viewer/2022022700/5a9e96fa7f8b9a89178b8c87/html5/thumbnails/3.jpg)
Opportunities at Scale
Smart City:
$27.5B Market& $174B
Investment
$1.9 TrillionImpact on
GlobalEconomy
180 Zetabytesof actionable
data
9.7 BillionConnectedDevices by
2020
2020 - 2025
![Page 4: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,](https://reader031.fdocuments.net/reader031/viewer/2022022700/5a9e96fa7f8b9a89178b8c87/html5/thumbnails/4.jpg)
The Challenge
Complex Technology
LimitedAccess
IT struggle to deliver fast
enough
How to get VALUE
quicker?
![Page 5: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,](https://reader031.fdocuments.net/reader031/viewer/2022022700/5a9e96fa7f8b9a89178b8c87/html5/thumbnails/5.jpg)
Johnson Controls
InternationalA global leader in building products and technology,
integrated solutions and energy storage.
![Page 6: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,](https://reader031.fdocuments.net/reader031/viewer/2022022700/5a9e96fa7f8b9a89178b8c87/html5/thumbnails/6.jpg)
JCI Smart Building
![Page 7: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,](https://reader031.fdocuments.net/reader031/viewer/2022022700/5a9e96fa7f8b9a89178b8c87/html5/thumbnails/7.jpg)
End-to-End IoT Platform
Capture
High-scale messaging, mediation,
data services
Stream
Transform, cleanse, load, update
Processing & Accessing
Talend ESB
NoSQL
Store & Query
MQTT
Thousand of sources
producing 100s of TB/hr
IoT / Sensors
Real-Time View____________
Precomputed
Views
Incremental Data
All DataHistorical
Data
Real-time
Dashboards
APP
Serving Layer
Sliding WindowAnalytics
MachineLearning
Speed Layer
Data
Batch Layer
Azure
Storage
Hive
![Page 8: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,](https://reader031.fdocuments.net/reader031/viewer/2022022700/5a9e96fa7f8b9a89178b8c87/html5/thumbnails/8.jpg)
Key Requirements
1. Must be compatible with Hadoop (Ability to run native Hadoop code)
2. Must be extensible to the Cloud
3. Must be aligned as close as possible to open source technology trends specific to Hadoop/ Big Data
4. Must support our Data Lake data flow architecture
5. Must be able to connect with disparate data sources
6. Must be able to establish a long lasting strategic partnership
7. Must be able to affordably scale to meet anticipated demand
8. Should have an easy to understand user interface
9. Should have minimal proprietary components/ functions
10. Should have no performance degradation compared to direct code run on Hadoop
INGESTION FRAMEWORK SOLUTION for JCI
![Page 9: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,](https://reader031.fdocuments.net/reader031/viewer/2022022700/5a9e96fa7f8b9a89178b8c87/html5/thumbnails/9.jpg)
9
SUPPLIERS
CUSTOMERS
CLOUD
SENSORS
PREMISE
From this …
![Page 10: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,](https://reader031.fdocuments.net/reader031/viewer/2022022700/5a9e96fa7f8b9a89178b8c87/html5/thumbnails/10.jpg)
• Integrated some 200 + Systems into the newly minted data lake
• Hadoop development became 3 to 10x faster
• 100 developers generating insight for 1000 consumers
To a versatile Platform for JCI
![Page 11: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,](https://reader031.fdocuments.net/reader031/viewer/2022022700/5a9e96fa7f8b9a89178b8c87/html5/thumbnails/11.jpg)
Why Talend for JCI?
Platform independence & future proof
Run on Big Data platforms, on prem and in the Cloud
SPARK code generation (Staying Native)
Faster performance, less overhead
Unified
1 unified platform for all integration use cases: batch real-time, on prem, hybrid, Cloud, Big Data, IoT, Machine Learning, self-service, data governance
![Page 12: Powering Smart Cities with IoT, Real-Time and an Agile ...res.cdn.sys-con.com/session/3646/Nick_Piette.pdf•Integrated some 200 + Systems into the newly minted data lake ... real-time,](https://reader031.fdocuments.net/reader031/viewer/2022022700/5a9e96fa7f8b9a89178b8c87/html5/thumbnails/12.jpg)
Free Trial: Talend Big Data Sandbox
• A ready-to-run Dockerenvironment leveraging Cloudera
• A step-by-step expert guide
• Real-world scenarios using Spark,Kafka, MapReduce & NoSQL
www.talend.com/BigDataSandbox
Hit the Easy Button for Hadoop, Spark and Machine Learning