Wireless Sensor and Consumer Multimedia Networks

A Story of Converging Trajectories?

Wireless Sensor and Consumer Multimedia Networks

A Story of Converging Trajectories?

CCNC, Las Vegas – January 4, 2005

Jan M. RabaeyBerkeley Wireless Research CenterDepartment of EECS, University of California, Berkeleyhttp://bwrc.eecs.berkeley.edu

CCNC, Jan. 2005

2

Year

log

(peo

ple

per c

ompu

ter)

Meaning in the Device

Meaning in the Connection

Meaning in the Collection

Bell’s Law: A New Computer Class Every 10 Years

Courtesy: R. Newton

1940’s 2000’s

CCNC, Jan. 2005

3

Enabling “Ambient Intelligence”

• An environment where technology is embedded, hidden in the background

• An environment that is sensitive, adaptive, and responsive to the presence of people and objects

• An environment that augments activities through smart non-explicit assistance

• An environment that preserves security, privacy and trustworthiness while utilizing information when needed and appropriate

Courtesy: Fred Boekhorst, Philips, ISSCC02

CCNC, Jan. 2005

4

The Two Faces of Ambient Intelligence

Sensor andActuatorNetworks

MultimediaNetworks

What do those have in common, if anything,what are their key challenges and potential solutions,and can they learn from and build on each other?

CCNC, Jan. 2005

5

Wireless Sensor and Actuator Networks

$150 millions sales in 2003

$7 billion in sales in 2010On World Emerging Wireless Research, Feb 2004

A collection of cooperating algorithms (controllers) designed to achieve a set of common goals, aided by interactions with the environment through distributed measurements (sensors) and actions (actuators).

Controllers (Monitors, Compute Nodes)

SensorsActuators

CCNC, Jan. 2005

6

Creating a Whole New World of Applications

From MonitoringFrom MonitoringFrom Monitoring To AutomationTo AutomationTo Automation

CCNC, Jan. 2005

7

The “Smart” Home — A Prime Target

• Security• Environment control• Energy management• Object tracking/inventory• Advanced user interfaces• Sense of presence and space

CCNC, Jan. 2005

8

Energy Management and Conservationas the Initial Driver

Cal ISO Daily Peak LoadsJanuary 1, 2000 - December 31, 2000

Jan-00

Feb-00

Mar-00

Apr-00

May-00

Jun-00

Jul-0

0Aug-00Sep

-00Oct-

00Nov-0

0Dec

-00

20

25

30

35

40

45

50

GW

Peak Day August 16 -43.5 GW

Commercial AC

Residential AC

• Advanced thermostats operate on required level of comfort, energy cost, weather forecast and distributed measurements to offload peak times• Appliances are energy and cost aware

Demand response:Make energy pricesdependent upon time-of-use

CCNC, Jan. 2005

9

Enabled by Synergetic Technology Advancements

Moore’s law and size

Moore’s law and cost

Ubiquitous wireless as the glue

True system integration

CCNC, Jan. 2005

10

Challenges in Wireless Sensor Networks

• Power, Cost, Size (Disappearing Electronics)

• Reliability

• Portability, Scalability and Configurability

• Security and Privacy

CCNC, Jan. 2005

11

How to Make Electronics Truly Disappear?

From 10’s of cm3 and 10’s to 100’s of mW

To 10’s of mm3 and 10’s of µW

CCNC, Jan. 2005

12

Adopt Non-Orthodox Technologies and Approaches

A 100 µW self-containedsensor node

CTS (Tb)

DATA (Tp)Ton

Ton

Ton

TX

RX

T

Tb

Tl Tsleep

ACK (Tb)CTS (Tb)

DATA (Tp)Ton

Ton

Ton

TX

RX

T

Tb

Tl Tsleep

ACK (Tb)

Architectures that maximize standby time

Energy scavenging

Simple radio’s with minimal external components

64Kmemory DW8051

µc

BaseBand

SerialInterface

GPIOInterface

LocationingEngine

Neighbor List

SystemSupervisor

DLL

NetworkQueues

VoltageConv

64Kmemory DW8051

µc

BaseBand

SerialInterface

GPIOInterface

LocationingEngine

Neighbor List

SystemSupervisor

DLL

NetworkQueues

VoltageConv

Ultra-low power processorswith low standby power

UC Berkeley PicoRadio

CCNC, Jan. 2005

13

Reliability: A Serious Threat to Wireless Sensor Networks

Unreliability is intrinsic to the disappearing electronics concept.

• Nodes may appear at will, may move, may fail and (temporarily) run our of energy

• Problem aggravated by cost, power and size constraints

The wrong answer: over-designThe right answer: exploit nature of Ambient Intelligence

CCNC, Jan. 2005

14

Multi-hop sensornetwork

Reliability through Redundancy

dest

source

Redundancy is a core concept of Sensor Networks,enabling high quality reliable service with cheap unreliable components.

Courtesy Rahul Shah, UCB

Opportunistic routing: choose any node that is available and goes in the right direction. Reduces energy and latency as well.

CCNC, Jan. 2005

15

Scalability, Portability and Configurability

A plethora of implementation strategies emerging at all layers, some of them being translated into standards

SELECT tempFROM sensorsWHERE temp > threshTRIGGER ACTION SndPktEPOCH DURATION 5 s

• Bottom-up definition without perspective on interoperability and portability• Mostly “stovepipe” solutions• Little reflection on how this translates into applications

CCNC, Jan. 2005

16

The Only Real Option: Raise the Abstraction Level!

C2

C3C1

Environment

Sensor Network: A set of distributed compute functions cooperating to achieve a set of common goals through interactions with the environment

C2

C3C1

Environment

sensor

actuator

Application

through a set of distributed sensorsand actuators

CCNC, Jan. 2005

17

Focus on a Functional Application Interface

C2

C3C1

Application interface (AI)

sensor

actuator

Application • Defines the servicesneeded to operate a sensor network• Independent of network architecture and hardware platform• Enabling interoperability and innovation

Similar in concept to the socket interface in the internet

The SNSP Interface - BWRC & TU Berlin

CCNC, Jan. 2005

18

The Sensor Network as a Distributed Database

Typical application call: “Get the temperature in the kitchen”

Originated from TinyDB (UC Berkeley)

QS allows a controller to obtain the state of a group of components

Controller

Query Service (QS)

S1

S2

Application

ApplicationInterface

The Query as the basic accessmechanism (“Get”)

(Equivalent Command Service interacts with actuators)

Using Semantic Addressing(“temperature in the kitchen”)

Name = Attribrute (temperature)

+ Scope (kitchen)

• Names are not unique and may change during operation• Enables ad-hoc operation and provides robustness

CCNC, Jan. 2005

19

Auxiliary Services provide “Awareness”:Sense of Space, Capabilities and Concepts

“turn on bedroom lights at dusk”

C

Location service Time synchronization service

Concept repository service

“bedroom ≡ (x1,y1), (x2,y2)”CRS maintains a (distributed) repository of capabilities of the network and meta-objects, enabling true ad-hoc configuration

Essential for a true Ambient Intelligence Experience

CCNC, Jan. 2005

20

The Other Side of Ambient Intelligence: Ubiquitous multimedia networks

Value is in ad-hoc connection of gadgets, not in individual components (AGAIN)

Photos

An explosion of input, output, storage

and processing devices

CCNC, Jan. 2005

21

Leading to Entirely New Application Scenarios

A multimedia experience that• adapts to capabilities at hand• is aware of space and topology• is intuitive and self-configuring

Courtesy Fred Boekhorst, Philips

CCNC, Jan. 2005

22

Enabled by Synergetic Technology Advancements

Plenty of cheap storage

1

10

100

1000

10000

100000

1995 2000 20051

10

100

1000

10000

1000003.5" Cap. (Bytes)

1.3" Cap. (Bytes)

Bits /sq. in.

Data-rate (Bytes /s)

Ubiquitous media I/O

Aggressive signal processingAggressive signal processing

Wireless galore

CCNC, Jan. 2005

23

Challenges in MultiMedia Networks

• Bandwidth

• Reliability and Quality-of-Service

• Portability, Scalability, and Configurability

• Security and Privacy

CCNC, Jan. 2005

24

Bandwidth still Limiting factor

Current LAN/PAN Wireless Standards

1-24IrDA

5054802.11g

10011802.11b

2054802.11a

10100-500Ultra Wide Band

1001-2Blue Tooth

Range (Meters)

Data Rate (Mb/sec)

Technology

IEEE Spectrum 9/2003

Largely deficient for support of multiple simultaneous streams and QOS guarantees

CCNC, Jan. 2005

25

Bandwidth will be free!

Improved spectral efficiencyMIMO to the rescue (802.11n)

New frequency realms4 to 7 Ghz available at 60 GHzPossible in today's CMOS!

Spectrum recyclingaka “Cognitive radio”Temporarily re-use idle spectrum

CCNC, Jan. 2005

26

Reliability and Quality-of-Service

Similar to sensor networks, redundancy the best means in providing a reliable and enjoyable user experience

• Dependable system operation best supported by the availability of ample and redundant source, processing and destination functions.

• Providing ample redundant bandwidth and connectivity the simplest and most effective technique to ensure QOS in a “best-effort” way.

CCNC, Jan. 2005

27

Portability and ScalabilityThe Home Network as the new Tower of Babel

• New devices are entering the home environment at an ever increasing rate.• Standards are proliferating –interconnect, recording and playback, display• Devices do not necessarily interconnect easily

CCNC, Jan. 2005

28

The Current Options

Cover all the bases …• Clearly not scalable, extensible and upgradable• Not applicable to light-weight devices

Stovepipe solutions• Fix the complete stack and hope that the rest of the world will adopt

HAVi Software Architecture - FAVHAVi Software Architecture - FAV

CCNC, Jan. 2005

29

The Configuration Challenge

Current model:• Connection oriented

“Connect the DVD through the AV to the display in the living room”Requires intimate knowledge of network – excludes ad-hoc.

• Device, not function dependent

CCNC, Jan. 2005

30

A Recognized Window of Opportunity

Example: Microsoft MediaCenter• Standard PC with Windows OSextended with accelerator and enhancements on I/O cards• Full UI and graphics

But:• The user is the system and configuration manager (still connection and device oriented)• Centralized and not spatially aware• Star connection

CCNC, Jan. 2005

31

The Only Real Option: Raise the Abstraction Level!

C2

C3C1

Application interface (AI)

Output devices

Media sources

Applications • Defines the servicesneeded to operate a media network• Independent of network architecture and hardware platform• Enabling interoperability and innovation

A Functional Application Interface for Multimedia Home Networks?

Semantic addressing again at the core of interface“Play Yesterday from the Beatles at the highest possible fidelity level atmy current location”

CCNC, Jan. 2005

32

Awareness is Key Again!Auxiliary Services provide Sense of Space, Capabilities and Concepts

“Play Yesterday at highest fidelity at my current location”

C

Location service

Concept repository service

CRS maintains a (distributed) repository of capabilities of the network (types of input and output devices) and meta-objects, enabling true ad-hoc configuration

Sensor networks an essential element to provide spatial awarenessand enhanced user interface.

CCNC, Jan. 2005

33

Leaves one Crucial Question:How to Deal with the Myriad of Protocols and Formats?

Put the Intelligence in the Network: “Smart Home Routers”

Courtesy: SIA-MARCO GSRC

Home routers: Provide on-the-fly protocol conversion and trans-codingbased on properties of source and destination devices

“Routers”

Media Sources(camera, internet, DVD) Output Devices

(displays, speakers,disks)

CCNC, Jan. 2005

34

A Simple Example

MPEG4 LCD Display with 802.11 interface

PRISM (light weight video encoder) phone camera with Bluetooth interface

?Bluetooth

802.11

PRISMto

MPEG4

Smart Home Router

Enabled by advances in configurable processingand software-definable interfaces

Xilinx Virtex Pro

BWRC multi-purposeRF front-end

CCNC, Jan. 2005

35

Summary and Perspectives

• Ambient Intelligence: A new paradigm in information and media processing– Function defined by collection of elements, not by the

individual components

– Driven by technology progress on multiple fronts (wireless communication, computation, storage and input/output functionality)

• Harvesting the offered opportunities requires bold top-down vision with raised levels of abstraction– The only option in addressing interoperability, portability,

management, configurabilty and reliability issues.

• Sensor and multimedia networks and their concepts are truly synergetic

CCNC, Jan. 2005

36

Thank you!

"Chaos at least has an open architecture. Chaos has always been the native home of the infinitely possible.”― John Perry Barlow

The contributions of the BWRC and GSRC faculty to this presentation are greatly appreciated. The stimulating discussions with Ken Lutz , Kannan Ramchandran, Alberto Sangiovanni-Vincentelli, John Wawrzynek (UCB) and Adam Wolisz (TU Berlin) are especially valued.