The Ultimate Wearables: Interactive Implants - Tony Fernandes

135
ULTIMATE WEARABLES: INteractive Implants June 24, 2015

Transcript of The Ultimate Wearables: Interactive Implants - Tony Fernandes

Page 1: The Ultimate Wearables: Interactive Implants - Tony Fernandes

ULTIMATE WEARABLES: INteractive ImplantsJune 24, 2015

Page 2: The Ultimate Wearables: Interactive Implants - Tony Fernandes

2

UEGroup SILICON VALLEY

[email protected]

Page 3: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 4: The Ultimate Wearables: Interactive Implants - Tony Fernandes

4

Page 5: The Ultimate Wearables: Interactive Implants - Tony Fernandes

5

Page 6: The Ultimate Wearables: Interactive Implants - Tony Fernandes

7

Page 7: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 8: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 9: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 10: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 11: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 12: The Ultimate Wearables: Interactive Implants - Tony Fernandes

today’s talk๏ The opportunity

๏ Our work

๏ What we learned

๏ Reality

๏ Implications for UX and the future

Page 13: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Light surgical imagery

Page 14: The Ultimate Wearables: Interactive Implants - Tony Fernandes

14

Page 15: The Ultimate Wearables: Interactive Implants - Tony Fernandes

15

Page 16: The Ultimate Wearables: Interactive Implants - Tony Fernandes

16

Page 17: The Ultimate Wearables: Interactive Implants - Tony Fernandes

17

Page 18: The Ultimate Wearables: Interactive Implants - Tony Fernandes

18

Page 19: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 20: The Ultimate Wearables: Interactive Implants - Tony Fernandes

20

Page 21: The Ultimate Wearables: Interactive Implants - Tony Fernandes

the opportunity

Page 22: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Identity

Page 23: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 24: The Ultimate Wearables: Interactive Implants - Tony Fernandes

24

Page 25: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Augmented memory

Page 26: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Disease sensors

Page 27: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Blood glucoseKidney function

Liver function

Heart rate Hydration

Cancer cellsPredict heart attack

O2

Page 28: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Onboard information: medical alerts and records

Page 29: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Augmented function

Page 30: The Ultimate Wearables: Interactive Implants - Tony Fernandes

A cure for paralysis

Page 31: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Communication

Page 32: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Internet of things

Page 33: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Internet of us

Page 34: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Information sharing

Page 35: The Ultimate Wearables: Interactive Implants - Tony Fernandes

our work

Page 36: The Ultimate Wearables: Interactive Implants - Tony Fernandes

desktop mobile wearable biometric wearable

inert implant

passive implant

active implant

augmenting implant cyborg

Page 37: The Ultimate Wearables: Interactive Implants - Tony Fernandes

5 minute backgrounder

Page 38: The Ultimate Wearables: Interactive Implants - Tony Fernandes

BCI

Page 39: The Ultimate Wearables: Interactive Implants - Tony Fernandes

BCI

Brain-Computer Interface

Page 40: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Neuroprosthetics

Page 41: The Ultimate Wearables: Interactive Implants - Tony Fernandes

41

Page 42: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 43: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Neurostimulators

Page 44: The Ultimate Wearables: Interactive Implants - Tony Fernandes

44

Page 45: The Ultimate Wearables: Interactive Implants - Tony Fernandes

45

Page 46: The Ultimate Wearables: Interactive Implants - Tony Fernandes

46

Page 47: The Ultimate Wearables: Interactive Implants - Tony Fernandes

47

Page 48: The Ultimate Wearables: Interactive Implants - Tony Fernandes

48

Page 49: The Ultimate Wearables: Interactive Implants - Tony Fernandes

49

Page 50: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 51: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 52: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 53: The Ultimate Wearables: Interactive Implants - Tony Fernandes

53

Page 54: The Ultimate Wearables: Interactive Implants - Tony Fernandes

benefits include๏ Reduction in drugs

๏ Improved quality of life

๏ Prevent amputation

๏ Prevent suicide

Page 55: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Project APPROACH๏ Understand the technology

• A lot of research and conversations in advance

๏ Understand the people • Surgeons • Nurses and PAs • Patients • Family members

๏ Develop initial design ideas • Covering entire ecosystem

Page 56: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Project APPROACH

๏ Models and prototypes • Also covering entire ecosystem

๏ Iterative testing • Patients and medical professionals

๏ Deliver production designs

๏ Go on to next generation

Page 57: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Discovery

Page 58: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Understand the native environment

Page 59: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 60: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 61: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 62: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 63: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 64: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 65: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 66: The Ultimate Wearables: Interactive Implants - Tony Fernandes

WHAT WAS LEARNED

Page 67: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Things are complicated

Page 68: The Ultimate Wearables: Interactive Implants - Tony Fernandes

doctors and clinician๏ Effectiveness trumps all other considerations

๏ Technology not clearly understood • Limited research • Therapy varies

๏ Need/want simplicity

๏ Speed is critical

๏ Patients viewed as weak link • “Can’t be trusted”

Page 69: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Patients๏ Technology beyond their comprehension

๏ Education resources limited

๏ Often not using device correctly

๏ Pieces often misplaced

Page 70: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Patients๏ Effectiveness can diminish

๏ The younger, the more control desired

๏ Don’t want to stand out

๏ Family support is critical

Page 71: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Power is a huge issue

Page 72: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Choices๏ Primary cell

• Does not require charging • Requires surgery to replace

๏ Recharging • Longer device lifetime • Charging depends on use

Page 73: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Recharging๏ Direct connection

• Quick • Causes heat inside body • Very prone to infection

๏ Inductive • Device completely inside body • Longer recharge • Accurate placement needed • Has to be close to the surface

Page 74: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 75: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Feelings can be profound

Page 76: The Ultimate Wearables: Interactive Implants - Tony Fernandes

People don’t want to criticize what have given

them so much

Page 77: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Emotional demanding for researchers

Page 78: The Ultimate Wearables: Interactive Implants - Tony Fernandes

OUR DESIGNS

Page 79: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 80: The Ultimate Wearables: Interactive Implants - Tony Fernandes

80

Page 81: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 82: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 83: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Industrial Design

Page 84: The Ultimate Wearables: Interactive Implants - Tony Fernandes

55 %

1 MorningLevel

Main Menu

i-Sculpt

Restore to Clinic Settings

SelectBack

Spread

EGL Scan

French

AcceptSpread

120 µS

Strength

Programs

ProgramsP

Stimulation Areas

Main Menu

System Settings

Programs

Stimulation Areas

Main Menu

System Settings

Programs

Stimulation Areas

Main Menu

System Settings

Morning1Night2Program 33

4

Options

Change Programs

Program / copy to: Available program slot

Active Program

Empty Program Slot / copy to: Clinician program can not be overwritten

Save

Copy to ...

Copy to ...

Delete

Program

ActivatedProgram

SavedProgram

RestoredProgram

DeletedYes

No

RestoreProgram 1‘Morning’

to Clinic Settings?

Yes

No

OverwriteProgram 4

‘Empty’

Yes

No

Delete‘Program 3’ ?

Stimulation Areas Lower Back

Lower BackAHipBLeft LegCLeft Leg 2D

Sensation

i-Sculpt

Compare

Lower Back

Strength

4.6 mA

Lower Back

Sensation

200 Hz

Lower BackLower Back

Return to i-Sculpt

Discard and Exit

Compare to Old

Lower Back

StimulatingNew

Settings

Yes

No

Lower Back

DiscardChanges to

‘Lower Back’?

Yes

No

Lower Back

AcceptChanges to

‘Lower Back’?

Press Side Button

to Unlock

Stimulation

OFF

Stimulation

ON

Unlock

All top bars change to red when Adv. Mode is activated.

Home

Programs P

System Settings

Remote Settings

System Info

Clinician Mode

Remote Settings

Alert Volume

Screen Brightness

Languages

Alert Volume Screen Brightness

Alert VolumeScreen Brightness

Italian

Spanish

Languages

German

SelectBack

English

Englishselected

System Info

Remote Info

Implant Info

Impedances

Remote InfoSerial NumberSC-508392938 Battery Voltage

4.5 VBattery Status

?Firmware Version

1.2

Implant InfoSerial NumberSC-508392938 Battery Voltage

4.5 VBattery Status

?Implant Type

1.2

Implant InfoLead Type

M-2357IPG Temperature

40.3 CBattery Impedance

?Reset Counter

1.2

Impedances

12341234123412341234123412341234

12345678

12341234123412341234123412341234

InfoInfo

-

Telemetry TestInfo

-

910111213141516

12341234123412341234123412341234

12345678

12341234123412341234123412341234

910111213141516

Impedances

EGL Scan

Rescan

Cancel Cancel

Offset:

4.5

EGL Scan

Rescan

Offset:

-

Main Menu

85 %

1 MorningLevel

IPG Charge Test

CoilDetected

Coil Frequency0123456

Peak Current Found0123456

ADC0123456

+-

Lead Config

Single LeadSelected

Lead Config

Yes

No

Enable EGL Scan

for iSculpt?

Password Clinician Mode

Adv. Mode: ON

Diagnostics

Impedances

CP Mode

Lock-Out

Lead Config

Clear Link

EGL Scan

Lower Back

Clear Linkto Stimulator

ID 123456

Clear Link

Yes

No

Link This Remoteto Stimulator

ID 123456

Link

Yes

No

Diagnostics

Button Test

LCD Test

Telemetry Test

IPG Charge Test

Lead Config

Next Config

Select

Lock Out

Spread

Sensation

i-Sculpt

Advanced User

FeelingArea Strength Coverage

SelectBack

SelectBack

SelectBack SelectBack SelectBack SelectBack SelectBack

SelectBack

SelectBack SelectBack

SelectBack

Back

Strength

4.6 mA

Back

Back Back Select SelectBackReturn SelectBack SelectBack

SelectBack

SelectBack SelectBack

Back Back Back

Back

MoreBack Back

Back Back

MeasureBack

MeasureBack

SelectBack SelectBack

SelectBack SelectBack SelectBack SelectBack SelectBack

Empty5

Programs

Morning1Night2Program 33Empty4

SelectBack

1 1 1

55 %

1 1MorningLevel

Main Menu

Stimulation

ONStimulation

ONStimulation

OFFStimulation

OFFStimulation

ONStimulation

OFF

1 1 1 1 1 1

Compare to New

Lower Back

StimulatingOld

Settings

SelectBack

1 1 11

4.6 mA

Lower Back1

Finish

Scroll

Select / Next

Backspace

1

P

A _ _ _ _

Option A Option B Option C

Page 85: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Rethinking of feedback

Page 86: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 87: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 88: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 89: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 90: The Ultimate Wearables: Interactive Implants - Tony Fernandes

reality

Page 91: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Medical procedure

Page 92: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Risks and dangers

Page 93: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Power source is an issue

Page 94: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Wifi and Bluetooth

Page 95: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Movement within body

Page 96: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Long-term comfort

Page 97: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Psychological impact

Page 98: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Regret

Page 99: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Security

Page 100: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Hacking danger

Page 101: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Privacy

Page 102: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Upgrading

Page 103: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Needing an implant is not the same as wanting an

implant

Page 104: The Ultimate Wearables: Interactive Implants - Tony Fernandes

The future

Page 105: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Injectables

Page 106: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Soft materials

Page 107: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Nano devices

Page 108: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Kinetic power

Page 109: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Last thought

Page 110: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 111: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 112: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 113: The Ultimate Wearables: Interactive Implants - Tony Fernandes

113

Page 114: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Thank you

Page 115: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Questions?

[email protected]

Page 116: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Explore flow

116

Page 117: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Robust prototypes

117

Page 118: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Remote Control Testing

Page 119: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 120: The Ultimate Wearables: Interactive Implants - Tony Fernandes

120

Page 121: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Surgical Tablet Interface

Page 122: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Consumer Tablet

Page 123: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 124: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 125: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Cranial Electrodes

Page 126: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Imaging

Page 127: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 128: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 129: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 130: The Ultimate Wearables: Interactive Implants - Tony Fernandes

Before and After

Page 131: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 132: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 133: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 134: The Ultimate Wearables: Interactive Implants - Tony Fernandes
Page 135: The Ultimate Wearables: Interactive Implants - Tony Fernandes