IoT and Big Data
Transcript of IoT and Big Data
IoT And Big Data
Sanjay -‐Enterprise Data Architect and Analy:cs, Arrayent Inc. @sabhub1
A R R A Y E N T
• About Sanjay – Enterprise Data Architect and Analy:cs, Arrayent Inc.
– More than 20 years in IT and mostly dealing with some form of data
– Worked at Apple, Accenture, WesternUnion – Ac:ve Open Source Junky à Download, Compile, Install, Ask Ques:ons and Help Improve it
Agenda
• IoT • Impact • Use Cases • Data • Readiness • Conclusion
What is IoT?
“The Internet of Things (IoT) is a scenario in which objects, animals or people are
provided with unique iden>fies and the ability to transfer data over a network without requiring human-‐to-‐human or
human-‐to-‐computer interac>on”
IoT?
Future is here, you like it or not, you will be sucked into it
We are all I(di)oT’s?
• We called the Big Box the Idiot Box • Now we all have smaller version of Big Box in our hands and pockets • We are glued to it all the :me • We want more of it • And we had enough of it • We started to think OOTB…
What We Want Next? • We want everything around us connected. • We want to control things around us • We are asking for it • We were actually doing it.
IoT Is Large Space All Use Cases You Can Think of
The Good, The Bad
• Good News is IoT is coming, it is happening • Bad News is IoT is coming faster • As Per Gartner – Internet of Things Installed Base Will Grow to 26 Billion Units By 2020
Value Add
• Distribu:on/Logis:cs • Brand Adapta:on • Feature Op:miza:on • Usage Pa`ern • Cross Sell Opportuni:es • Power Usage/Op:miza:on • Recall Logis:cs/Service Logis:cs • …
Analy:cs
Use Cases
• Retail and Logis:cs – Tracking of goods on an item-‐level a feasible business case, including inventory accuracy, reduc:on of administra:ve overhead, automated customer check-‐out processes and a reliable an:-‐thea system.
– In-‐store beacons
Data Life Cycle
Devices
Sense What is
Happening
Decide What to do
Build Your
Context
Act Quickly
& Consistently
• Context Aware
• Predic:ve and Rules Driven
• Con:nuous real-‐:me at scale
Real Time Ac:onable Insights
Latency Needs are Milliseconds or less
Are We Ready?
• Big Data is like you have never seen before • Gathering data from previously unexplored areas. • Not the absence of data. • It is about not missing on data that you really need
Use Cases • Assisted living
– Cost of nursing home is increasing. – Need for round the clock monitoring is challenging
• Smart Ligh:ng – Op:mize use of street and building lights based on current
condi:ons • Traffic Monitoring – Monitoring and analyzing traffic pa`erns to reroute drivers
• Waste Management – Op:mizing waste pickup by measuring container levels
• Security & Emergency Detec:on – Detec:ng radia:on, gases, and other hazardous condi:ons in
real :me.
Test • Data Centers will be overwhelmed by Data Deluge
– Exis:ng Data Center Capacity will be put to test • A new focus of real :me analy:cs
– Exis:ng Real Time Components will have to rethink what actually means in IoT • Data Reten:on/Storage reach a new level
– Cloud Storage Needs will surpass what we have now • Network Bandwidth
– New inven:ons are needed • Privacy/Security
– End of the Day Consumer will take control • Skill Set
– We need lot more data engineers and scien:sts • Data Science
– Need “Data Science on the Wire” • Value of Data/Time to react
– Window is Gefng Shorter
What We Do Arrayent PlaMorm enables trusted consumer brands to implement connected products and
systems
Home
15,000 !Messages per Sec!
~200 Milliseconds!Round Trip Latency!
How we are Connected
Device Virtualiza:on
Arrayent Data Architecture
Real Time Replica:on Data Center 1 Data Center 2
Data Center 3
Batch Analy:cs
Quick Search/Query
Device Status
Region 1 Region 2
Region 3
Using Cassandra
• Isolated Work Loads • Easy to Manage • Scalable • Mul: DC-‐Region
Deployment • Use Network Anycast
Other Components • Apache Usergrid – Using it as RBAC – It can do lot more than that. It is fancy data store running on Cassandra, Highly Scalable
• ELK Stack – For massive log pipelining, Storage, Indexing and pre`y neat UI.
– Used in NOC • Kaia – For persistent distributed pub/sub
Landscape
Arrayent
Periodic Table of IoT
Thank You
Rush to Home Depot. The MyQ Connected Garage from Chamberlain, supported By Arrayent