Sense and Sensors - From Perception to Personality

Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

Sense and Sensors - From Perception to Personality

Adrian Bowles, PhDFounder, STORM Insights, Inc.

[email protected]

mailto:[email protected]


Sensor…

A device that detects the presence of a signal and reports/signals data about that signal/event

Sensors are Event-driven

May be Stationary or Mobile

Sensors Algorithms Data


AlgorithmsSignal Sensors

Insights

Noi

se


How We Imagine & Implement the User Interface Constrains HCI


How We Imagine & Implement the User Interface Constrains HCI

Batch Command Line

GUI Gestures

Input Output

Human

Machine Batch Streams


CCTV SmartPhone

Traffic Counter Fitbit

Data Complexity

Stationary Mobile

Low

High

Weather Station

Telematic Device


In the news…


Alex Coppel / Herald Sun/Getty Images

Fernando Alonso Walks Away from a 46G Impact


Sensors in Your Smartphone (iPhone example)Type Typical Current Use Potential Use

Accelerometer/motion Rotate screen, Switch screen to landscape/portrait

Ambient Light Adjust screen brightness

Barometer Measure altitude

Geo-Location (wifi/cellular) Location/Alerts

3-Axis Gyroscope Rotation rate for games, VR…

Proximity Turn off screen when phone is by your head

Touch ID fingerprint Security


So your phone/app knows your

Location Acceleration

.

.

.

. Motivation?

Motivation

reflection

inference

Natural Cognitive Processes

deduction

reasoning

Learning

Perception

Narrative Generation

Voice/NLP

Video/Images

Gestures

Emotions

Text/NLP

• Affectiva • BeyondVerbal • Emotient Apple! • Nviso

• Gridspace • IBM• Maluuba • Nuance • PopupArchive • Skymind • Viv Labs • Wit.ai

• ABBYY• Altilia• Cortical.io• IBM• Kaypok• Luminoso • Maluuba• Wit.ai

• APX Labs• BRS Labs• Clarifai• Dextro• Madbits (twitter)• Mindops• Skymind• Teradeep• Visenze

• Narrative Science• OnlyBoth

• APX Labs • EyeSight • LeapMotion • Nod • Intel


Analytics/Visualization• 1010data• Adatao• Alpine Data Labs• Alteryx • Altilia• Angoss• Attivio • Birst• Civis Analytics• ClearStoryData• Connotate• Context Relevant• Dataiku• Datameer• Emerald Logic • Finch Computing

(was Synthos)• First Rain• ForeSee• Fractal Analytics • Guavus• IBM• indico• KNIME• KXEN (SAP)• LiftIgniter

• MathWorks (Matlab)• Microsoft• Mu Sigma Nara Logics• NuTonian• Opera Solutions• Oracle• Palantir• Pentaho • Prediction IO• Predixion• Qliktech • Quid • Rapid Miner• Revolution Analytics(MSFT)• Salford Systems• SAP• SAS Institute• SiSense • Spark Beyond• Spotfire (Tibco)• StatSoft (Dell)• Teradata• Versium• Wolfram Mathematica• Yhat

Data Management• Actian • Aerospike • Alation• Basho• Caspio • Cognizant Technology• Couchbase• CrowdFlower• CumuLogic• Data Bricks• DataRPM • DataStax• DataWeb, Inc.• DDN • diffbot• GigaSpaces• GridGain• Hortonworks• IBM• import io• kimono• MapR

• MarkLogic • MongoDB• NeoTechnology• Oracle• Paxata• RainStor• SAP

Alt/Neuromorphic Hardware

• Artificial Learning• DWave• HRL Laboratories• IBM• Nervana Systems• Nvidia• Qualcomm• Teradeep


Sentiment/Emotion Analysis vs

Theme/Concept Analysis

Ges

ture

Rec

ogni

tion/

Anal

ytic

s



Emot

ion

Reco

gniti

on/A

naly

tics


My Results on the

Affectiva Demo

Affectiva: 7 EmotionsAnger Sadness Disgust Joy Surprise Fear Contempt


Sense and Sensors - Findings & Recommendations


Sometimes the wisdom of crowds leads to

Unintended Consequences

Findings & Recommendations


According to MaxMind…

This farm is home to 600,000,000 IP Addresses

Watch Out for Unintended Consequences, Especially With Big Data



Where there are sensors, there are data. Where there are data, there should be sensors.


More applications create more value for data, more data create more value for applications.

Evaluate all data sources for new applications, always look to expand your data portfolio.

For more information:


[email protected]

Twitter @ajbowles Skype ajbowles

Upcoming Webinar Dates & Topics

July 13 Modern AI & the Future of Work August 11 Advances in Natural Language Processing September 8 Autonomous Systems, from Science Fiction to Commercial Solutions October 13 Deep QA (Question/Answer) - Lessons From Watson and Jeopardy! November 10 Emerging Hardware Choices for Modern AI Data Management December 8 Leverage the IOT to Build a Smart Data Ecosystem

mailto:[email protected]?subject=

Sense and Sensors - From Perception to Personality

Technology

Transcript of Sense and Sensors - From Perception to Personality