CMU Wearable Computers and Pervasive Computing Asim Smailagic Institute for Complex Engineered...

21
CMU Wearable Computers and Pervasive Computing Asim Smailagic Institute for Complex Engineered Systems Carnegie Mellon June 28, 2001

Transcript of CMU Wearable Computers and Pervasive Computing Asim Smailagic Institute for Complex Engineered...

CMU Wearable Computers and Pervasive

Computing

Asim SmailagicInstitute for Complex Engineered Systems

Carnegie Mellon

June 28, 2001

Laboratory for Interactive Computer Systems

2

Approach

• The three labs have collaborated in design and prototyping of more than 20 generations of wearable computers

• Design and prototyping of complex systems require one interdisciplinary approach and multi-technology capabilities

• Rapid prototyping, concurrent design methodology has been applied and refined.

Laboratory for Interactive Computer Systems

3

Complexity• The complexity of the prototype architects

has increased by over two orders of magnitude, the total design effort has increased less than a factor of two.

• Over five generations of wearable computers for speech recognition and translation, yielding 4.5 orders of magnitude improvement in performance.

Laboratory for Interactive Computer Systems

4

1991 – 2001Ten Years of Wearable Computing at Carnegie Mellon

Laboratory for Interactive Computer Systems

5

jhgkjhg

Wearable and Handheld Computers

Laboratory for Interactive Computer Systems

6

Production vest will go under “Float Coat”

Laboratory for Interactive Computer Systems

7

Spot

Laboratory for Interactive Computer Systems

8

Laboratory for Interactive Computer Systems

9

Electronics ArchitectureVGA Display

Palm/PDA

Jog Dial/ Mouse Wheel

Microphone Speakers

Finger Print Recognition

Digital Camera

Temperature Sensor

CDPD Modem

GPS Receiver

PDA Cradle BlueTooth, WaveLan

Vehicle’s ECU - RPM, MPH, etc

USB Controller

Firewire Controller

Serial Controller

Sound Card

VGA Controller

Touch Screen

Wireless Adapter

Computer

Radio Card

Laboratory for Interactive Computer Systems

10

ApplicationsA number of previously untried application areas introduced.

-Maintenance, Inspection-Repair, Troubleshooting -Augmented Manufacturing -Plant Operations-Real-time Speech Translation-Navigation-Context-Aware Computing-Collaboration-Ubiquitous Computing-Telematics

Laboratory for Interactive Computer Systems

11

Context Aware Computing• Knowledge of the user’s context

– Location

– Orientation

– Audio samples from the user environment

– Static data

• Context sensitive help– Proactive smarter assistant offering useful

information (whispering in your ear)

• Multiple sensors can be used to infer user’s intent– Wireless Card, Digital Compass, Thermometer, Camera

Laboratory for Interactive Computer Systems

12

PhD Features and Interaction

User’s List:• Items can be added,moved, and removed• Only “checked” items appear on the map

Description:• Information on the currently selected item • Dynamic information automatically updated

Map:• Dynamic information automatically updated

Map Controls: Zoom & Pan

Laboratory for Interactive Computer Systems

13

Virtual Whiteboard Supports Design Meetings

• Menu Commands– Session management

– Geometric tools

– Expandable plug-ins

Laboratory for Interactive Computer Systems

14

Virtual Whiteboard Architecture Overview

Service broadcasts received coordinates to all clients via CMU’s Wireless Andrew

Client sends a user’s drawing to the service as a series of coordinates

Clients draw received

coordinates on screen; all

clients are synchronized

Laboratory for Interactive Computer Systems

15

ClientsThe clients have included:

-NSF, DARPA, ONR-Boeing-Adtranz-U.S. Air Force-U.S. Marine Corps-Lockheed-Martin-IBM-Chevron

-General Motors-Daimler-Benz-Compaq-Shell-AT&T-Intel-General Dynamics

Electric Boat

Laboratory for Interactive Computer Systems

16

Collaborative HelpThe labs have supported additional activities on

campus

• Electronic design in robotics projects

• Use of fabrication machines

• Interaction Design Studio helped other projects

• Multi-departmental projects

Formalize, advertise and open all these capabilities to other projects in ICES and CIT.

Laboratory for Interactive Computer Systems

17

Awards

Three prestigious international design awards have been received:

• VuMan 3

• MoCCA

• Digital Ink

Laboratory for Interactive Computer Systems

18

Visionary Research Projects

• Aura: Pervasive Invisible Computing

• Handy Andy Ubiquitous Computing

• Context-Aware Computing

• Augmented Reality

Laboratory for Interactive Computer Systems

19

Goals• Provide expertise in interdisciplinary design, rapid

prototyping and user evaluation• Promote more interdisciplinary design projects• Provide methodology, measurements, and tools to

support and teach these methods and to support design meetings

• Provide a physical space and equipment to support design and fabrication

• Study interdisciplinary design through practicing it• Develop a metric to compare the prototypes and show a

performance increase by several orders of magnitude.• Educational support

Laboratory for Interactive Computer Systems

20

Research Directions

• Pervasive Computing– Invisibilty, Minimizing User Distraction– User / Virtual Information Space Interaction– Enhance Human Capabilities

• Context Aware Computing• Visionary Interaction Design • Rapid Prototyping of Artifacts Involving

Multidisciplinary, Multi-technology Approach

Laboratory for Interactive Computer Systems

21

Research Directions

• Near Zero Energy / Weight / Volume Wearable Computers

• Quick Evaluation Methodology

• New Areas and Applications– New Technologies– New Modalities of Interaction– Help for Elderly – Medical Applications