Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

26
Artificial Intelligence: Building Emotion & Context aware Real-time Applications Filip Maertens Founder http://www.arguslabs.com [email protected] @fmaertens

Transcript of Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Page 1: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Artificial Intelligence: Building

Emotion & Context aware

Real-time Applications

Filip Maertens

Founder

http://www.arguslabs.com

[email protected]

@fmaertens

Page 2: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

A CURRENT STATE OF AFFAIRS

Page 3: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

The perfect storm called ubiquitous computing

“ Computing is everywhere

and anywhere. ”

Page 4: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Artificial Intelligence Affective Computing

Clarifying the ambient intelligence paradigma pervasive computing principle that is sensitive and responsive

Page 5: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Putting some numbers in perspective

Wearables

30B units by 2018

Up to 10 sensors

Connected Devices

US$ 290B by 2018

Up to 6 sensors

Smart-phones

2,8B units by 2016

Up to 12 sensors

Page 6: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Context-awareness explainedwhat I tell my grandma what I do

“ We help your phone know you so

well, it helps you to interface with

the world in a much more natural,

proactive, and personalized

manner, so it behaves

like a sixth sense ”

Page 7: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

The era of a smart-phone agent

Intelligent capabilities need to be interfacing with the end user, as

an overall service layer. Good privacy controls are required, but

most importantly added value must be shown through the use of

intelligent and sensing apps.

This might feel strange today, but remember the last time you didn’t

allow this?

Page 8: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Engage in a context-aware manner

moment circumstancesEngaging at the right , under the right .

Time

Feeling

Activities

Habit

Mood

Weather

Road type

Behavior

Page 9: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

How context upgrades your content

Know what you are

listening toUnderstand the

circumstances you

are listening to

Page 10: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

CONTEXTUAL COMPUTING WITH ARGUS LABS

Page 11: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

“ Argus Labs has created a sensor fusion platform

capable of near real-time contextualization

and profiling using deep learning ”

Page 12: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

“ Argus Labs is capable of sensing, understanding

and predicting the context, behavior and mood

of a mobile audience ”

Page 13: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

The sensor storm: sensors are everywhere

Sensors are a device’s equivalent to possessing human-like sensing

capabilities and allow to sense and understand contextual cues.

Automatic gender detection, through walking patterns

Mood detection, through mobile handling

Sound source detection (gyroscope sampling)

Activity detection (walking, running, sitting, …)

Automatic in- versus outdoor detection

Mood detection, through heart rate and oxygen level detection

@arguslabs

Page 14: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

ARGUS MOBILE SENSING

SD

K

ARGUS

PLATFORM

Turning sensor data into behavioral, context,

and emotional awareness

…EVENTS

MOMENTS

PROFILE

S

LVL 3

LVL 2

LVL 1

Page 15: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

EVENTS

Sense and interpret the

contextual cues of a mobile user

MOMENTS

Uncover habits and predict

human behavior

PROFILES

Learn about the ever-

changing personalities of a

mobile user

LAYER 1

LAYER 2

LAYER 3

DRIVING STYLE BEHAVIOUR

…WAKING UP

SOCIALNESS

SLEEPING

WALKING RUNNING

DRIVING (CAR) SUBWAYTRAIN

BUS

MOTORCYCLETRAM

SITTING STANDING

AIRPLANE BIKING

ARRIVING AT HOME, WORK, ..

BUSY

TIREDBORED

LOUD ENVIRONMENT

IN A MEETING

ALONE

HOME

WORK

COMPANY

COMMUTING TYPE

ACTIVENESS

CHATTY

CALM

DRIVING

BEHAVIOUR

PROFILESFOR EXAMPLE

Page 16: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Self-learningbiking – running – depression – stress – happy – excited –

petrol head – soccer mom – car – party – music – meeting

room – busy

day – and much, much more

Page 17: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

2013

processing nonverbal

cues

2000

carrying verbal

communication

Page 18: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Know who you’re sharing a ride with

Has the driver a normal driving style? Or is the passenger heading home

after a stressful and long day at the office. Wouldn’t you want to know

who you’re getting in the car with? Being able to use these kinds of

behavioral insights and use this to make a safer or more personalized

rideshare, can make the difference between a ride from hell or a high

quality experience.

Added value features

1. Profile and score the driving behavior

2. Learn what influences the passenger’s behavioral

3. Negotiate better insurance premiums based on actual driver risk

scores

Case study: driving behavior

Industries: Insurance, Fleet, Peer to Peer Ride Sharing

Page 19: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Industries: Context-aware recommender systems

Case study: emotions in music

Page 20: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Apps are changing

Service layers are emerging as background apps that only

interface with a mobile users when it’s really relevant.

User experiences become non-linear.

Page 21: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Turning context-awareness in mobile engagement

Page 22: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Argus Labs is already transforming industries …

Usage Based Insurance // Insurance

Transforming the insurance industry into a personalized care taker.

Context-Aware Media Recommendations // Media

Providing personalized and intelligent media discovery experiences

Consumer & Professional Healthcare // Healthcare

Turning multi-dimensional sensor layers into a reliable diagnosis

Page 23: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

… and growing in following industries

Deep Platform Integration // IOT/OEM

Being the cognitive layer that understands sensor packed wearables

Mobile Fleet Tracking // Fleet & Mobility

Combining driver and vehicle behavior in a new and holistic manner.

Mobile Advertising // Advertising & Marketing Automation

Turning ads into meaningful and precision targeted advice.

Page 24: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Every object becomes a

channel

Page 25: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

We did it !The first time ever people can start

making machines and software cognitive,

context and emotionally aware of their human users

Page 26: Filip Maertens - Artificial Intelligence: Building Emotion & Context aware Real-time Applications

Artificial Intelligence: Building

Emotion & Context aware

Real-time Applications

Filip Maertens

Founder

http://www.arguslabs.com

[email protected]

@fmaertens