Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent...

37
Amigo in Hindsight Maddy D. Janse January 2012 Lessons learned

Transcript of Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent...

Page 1: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Amigo in Hindsight

Maddy D. Janse

January 2012

Amigo in Hindsight

Lessons learned

Page 2: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Content

Lessons learned

1. Intelligent home environments

2. Vision and timing

3. User-centered approach

4. Complexity at many levels

5. System and application

Maddy D. Janse, November 2012

5. System and application

developers needs

6. Creating impact

7. Technology moves on

8. Differences in time to market

Page 3: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Lesson 1

Intelligent Home

Environments

Tati

1958

Maddy D. Janse, November 2012

Old concept !!!!!!!!Amigo

2008

Page 4: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Intelligent Home anno 1958

Context

Maddy D. Janse, November 20124

Products

Agents

Page 5: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Lesson 2

Vision and Timing

huge discrepancy

between

Maddy D. Janse, November 2012

research and reality

Page 6: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Future Enabling Applications

User content

User content

Maddy D. Janse, November 20126

CommunicateShare experiencesBe entertained

TV, STB, phone, uWand, AmbX, photo frame,…

Devices

between

Page 7: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Amigo Home Network

Access ControlFirewall

Home Gateway

Internet

Wired backbone(Ethernet)

Wireless infrastructure(WLAN)

Maddy D. Janse, November 2012

Home Gateway

Home Control

(WLAN)

Personal network(Blue tooth)

Home control network(Power line)

Page 8: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Intelligent Home: Reality in 2004

Different Domains - Not Interoperable -

PC domain

Cable or 802.11

Blue tooth

Maddy D. Janse, November 2012

CE domainHome automation

PC domain

Mobile domain

Page 9: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Services: To the Home

• down/up loading content

Maddy D. Janse, November 2012

Not Not withinwithin the homethe home

Not Not betweenbetween homeshomes

• down/up loading content

• Internet

• communication

– email, chat, voice-IP, skype• multi-user gaming

• adaptation of personal content

– photo, video• customization

– ring tones, wallpaper

Page 10: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

End-Users

Do not distinguish between the

sharing ambience and activities

Maddy D. Janse, November 2012

Do not distinguish between the

technical Amigo domains

Desire control over the overall

comfort and social integrity of their

home environment

Interoperability is obvious and natural

for users

pictures and text docs

Page 11: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Project Goals

Service oriented architecture for intelligent future home networks,

• use available context information

• use different devices

• provide intelligent and attractive user services

Maddy D. Janse, November 201211

• provide intelligent and attractive user services

• compose and integrate new devices and services

Enable the development of context-aware applications

• provide users with experience sharing, social presence,

and responsive home environments

• extend their home to other homes, car, hotel, office, ….

Page 12: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Amigo ProjectIST-2004-004182

Philips

Maddy D. Janse, November 201212

VTT , Telematica Instituut

Fraunhofer, Microsoft,

Univ. Paderborn, INRIA,

France Telecom, Italdesign

Fagor, Ikerlan, Telefonica

LogicDis, ICCS

42 Months (Sept04 – Feb08)2021 Person months4 Home labs

Page 13: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Lesson 3

User-centered Approach

Maddy D. Janse, November 2012

• field studies

• user needs: caring & sharing

• requirements

• scenarios

• storyboards

• personas

Page 14: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Keep in mind

• ‘‘‘‘You can’t just ask customers what

they want and then try to give that to

Responses

• based on past and current

experiences

• questionable fit for the project

objectives and context

But

• crucial for project team,

Maddy D. Janse, November 2012

they want and then try to give that to

them. By the time you get it built,

they‘ll want something new’’’’

• ‘‘‘‘It's really hard to design products

by focus groups. A lot of times,

people don't know what they want

until you show it to them’’’’

Steve Jobs

– to gain end-user insights

• essential for getting

– user requirements

– evaluation procedures

and criteria

– design iterations

Page 15: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Lesson 4

Complexity at many

levels

Difference in perception

• user needs & requirements

• system requirements &

specs.

• developer visions &

implementations

Maddy D. Janse, November 2012

taming technology

Underestimated challenge

• huge number of variables

• causing an exploratory

explosion of problems

Page 16: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Complexity for User

Maddy D. Janse, November 2012

Page 17: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Complexity for Developers

Building blocks & subsystems Toolkits

Maddy D. Janse, November 201217

Page 18: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Complexity in Communication

Access ControlFirewall

Home Gateway

Internet

Wired backbone(Ethernet)

Home Control

Wireless infrastructure

(WLAN)

Maddy D. Janse, November 201218

Personal network(Blue tooth)

Home control network(Power line)

Page 19: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Middlewarebuilding blocks

Lesson 5

System & application

developers needsdeplo

ym

ent

fram

ew

ork

context-aware applications

Maddy D. Janse, November 2012

Smart homes are dynamic

environments

deplo

ym

ent

fram

ew

ork

base middleware

intelligent user services

• interoperability framework

• service oriented architecture

Page 20: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Base Middleware

• service discovery and interaction

interoperability

• enhanced discovery and service

composition

• domotic infrastructure

Maddy D. Janse, November 2012

• functionality for networked

environment

• Open Source Software• security and privacy

• content distribution / data store /

QoS

Page 21: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Intelligent User

Services

• context management

• broker

• source

• wrapper

• reasoner

• history

• user modeling and profiling

Maddy D. Janse, November 2012

• functionality for ambient environment

• user modeling and profiling

• awareness and notification

• user interface services

• privacy and personal security

Page 22: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Programming &

Deployment

Framework

• reduction of programming effort

• enforcing interoperability

• common set of protocols

– discovery

– remote procedure calls

Maddy D. Janse, November 2012

• no care about underlying

protocols

– remote procedure calls

– asynchronous event delivery

Page 23: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Service Oriented

Architecture

• on demand

– development

discover

client

Maddy D. Janse, November 2012

– development

– delivery

– use

• loosely coupled components

• dynamic configuring of services and devices

• multiple protocols

– discovery: UPnP, SLP, WebServices

– interaction: RMI, SOAP

use

advertise

network

service

Page 24: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Domotic Service

• expose devices as UPnP or Web

API’s, protocols, networks (e.g., BDF)

low level drivers

Maddy D. Janse, November 2012

• expose devices as UPnP or Web

services

• low-level and high-level drivers

are completely decoupled

– depend only on common

specification

UPnP

devices

Web

services

UPnP factory WS Factory

commonspecification

high level drivers

Page 25: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Context

Management

Service

Maddy D. Janse, November 2012

• open infrastructure

• acquires information from various

sources

– physical sensors,

– user activities,

– applications

• abstracts into "context information"

• provides to context aware services

Interpreting low level context

to high level context

Page 26: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Use-it

• training modules and tutorials for

all SW modules

• available on the Amigo website

Example of how to start building an

application:

1. deployment framework,

• discovery mechanism &

ontologies

• context management service

Maddy D. Janse, November 2012

• available on the Amigo website

• easy to build an Amigo service

– ~ 1 day

• understanding the concepts takes

longer

– ~ weeks

2. security & enhanced discovery

• user modeling & profiling service

• awareness & notification service

3. user interface service

• community sharing service

Page 27: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Lesson 6Create Impact

Must have examples

• timely, • relevant • appropriate • easy to understand

Maddy D. Janse, November 2012

Exploit applications & services

Trade-off between stakeholders and developers

• illustrative for showing technical tour de force

• do-able and achievable

• Customized to your client needs!!!!!!!!!!!!!!!!!!

Page 28: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Appliances

Management

• appliances exchange information and communicate via existing power

Maddy D. Janse, November 2012

and communicate via existing power lines

• use case examples:

– programming appliances from mobile devices

– creating scenes like wake-up in the morning and setting the toaster and coffee machine

– holidays settings at home

Page 29: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Daily Life Cycle

Monitor

• monitors the behavior of inhabitants

Maddy D. Janse, November 2012

• monitors the behavior of inhabitants

• data from different sensors and information from Amigo middleware services

• detects deviations from normal behavior and takes appropriate action

• components

– domotic gateway

– history database

– behavior analyzer

– outlier detector

– controler

Page 30: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Food Management

• each user’s

– personal preferences

Maddy D. Janse, November 2012

– personal preferences

– health diets

– burned calories

– weight evolution

• how many people are going to eat and who they are

• available goods in the fridge.

• expiration date of the products

Page 31: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Home Information &

Entertainment

• Amigo Box applications

• Standard protocols: wifi,

Maddy D. Janse, November 2012

• Standard protocols: wifi,

ethernet, UPnP

• applications are web-based

• no need to buy new devices to

connect

• any device with a web browser

will do

• Home agenda

• MyNews

• Media Manager Core

• Multimedia manager

• Context-dependent

personalization

Page 32: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Home-to-HomeUPnP

router

My Home

Maddy D. Janse, November 2012

feel at home

• have access to your services

– applications can use

exported services just like

local services

Your Home

UPnP

router

Page 33: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Away-not-Away

• sharing presence and activities

Maddy D. Janse, November 2012

• independent of location and

devices

– using TV with PC, TV with

hotel-TV, or mobile with TV,

etc.

Page 34: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Lesson 7Technology moves on

Now, but not then

• Sensor network technologies• Web 2.0 • .NET• Social networking

Stay up to speed

Maddy D. Janse, November 2012

Fast

Technology moves onStay up to speed

• Be adaptable and flexible• to R&D community

• to future market needs

• to end-user customers

• to existing situations

Page 35: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Lesson 8Differences in time to market

Middleware and application

elements have different time to

market

Existing infrastructures

• buildings are ‘hard’

• power lines

• different practices • Timing

Maddy D. Janse, November 2012

Stakeholders and their needs

change over time

• energy consumption

• sustainability concerns

• demographic changes

• elderly homes

• home health care

• nursing homes

• No start from ‘scratch’

• Changing application demands

• Take-up of technology is not about technology

Page 36: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

Watch it

Iceberg

Intelligent home environmentsVision and concepts

Management

Maddy D. Janse, November 2012

IcebergUser-centered approachComplexity at many levels

Developers needs

TimingCreating impact

Technology moves onDifferences in time to market

Page 37: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at

System concepts

adaptable

be flexible

Key to Amigo

• unified middleware

• across application domains

• across homes and environments

• connects other networks (e.g.,

sensors)

Maddy D. Janse, November 2012

• interoperable – existing

technologies

• intelligence in the middleware

• reusable by thin applications

• generalized use of semantics

• Open Source Software

infrastructure