Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse...

31
© 2013 Toshiba Corporation Personal Smart Healthcare using Body Area Network April 4, 2014 Hirokazu Tanaka Telecommunications Research Laboratory Toshiba Research Europe, Ltd.

Transcript of Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse...

Page 1: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation

Personal Smart Healthcare using Body Area Network

April 4, 2014

Hirokazu Tanaka Telecommunications Research Laboratory Toshiba Research Europe, Ltd.

Page 2: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 2

1. Wireless Healthcare Overview

2. Toshiba’s Solution to the Wireless Healthcare

Business

3. Body Area Network (BAN) Standardization in ETSI

Page 3: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 3

What is Our Goal for Wireless Healthcare?

Safe and health society

connected to advanced medical and

healthcare for 24 hours unconsciously.

Internet

Short Range Wireless

Coordinator

Healthcare

Cloud

Page 4: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 4

Use Cases for Wireless Healthcare

6. Lifestyle diseases Measuring amount of activity during exercise and alarming when

overloaded. Collecting necessary vital data.

7. Elderly adults Elderly adults’ location and activity monitoring. Transmitting an alert

signal to their family, in case of emergency. Detect and notify risks of

accidents.

Children’s health monitoring , checking their location and checking

whether they have any accidents. Transmitting an alert signal to their

parents, in case of emergency.

2. Children

1. Infants Careful infants’ health monitoring (e.g. body temperature, pulse,

respiration rate, etc.).

5. Basal body temperature Attaching a patch-type sensors during sleep, measuring basal body

temperature and pulse for checking daily physical conditions or for

fertility treatment.

4. Sports Measuring amount of activity and estimating calories burned up

during sports.

3. Diet Monitoring amount of exercise, and bodily weight in order for checking

energy consumption volume and calorie intake.

In every life stage,

potential demands for

wireless healthcare

applications are rapidly

increasing.

Potential number of

Users are estimated

more than 100 mil.

people.

Page 5: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 5

Use Case Example 1: Safety Confirmation Safety Confirmation

Category Healthcare Elderly care

Situations Home Outdoor

Example of Use case

Attaching patch-type sensors on an elderly adult body, an alert signal and his/her pulse data are transmitted to the data server when he/she feels physically sick. These data and signal are also reported to care workers immediately.

Sensors Sampling

rate / quantization

bit rate Communi

cation distance

# of Nodes

Real time/ Non real time

pulse wave or ECG 10-16bit / 64Hz-1kHz

640bps-16kbps up to 1.5m 1 to 12 Real time

Accelerometer (body motion, posture)

10-16bit, 64Hz-1kHz

640bps-16kbps up to 1.5m 1 to 5 Real time

Page 6: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 6

Stress Monitoring

Category Healthcare

Situations Home Outdoors Office

Example of Use case

Logging daily physical and emotional stress and use the data for health management.

Sensors Sampling rate / quantization bit rate

Communication

distance

# of Nodes Real time/ Non real time

pulse wave or ECG 10-16bit, 64Hz-1kHz

640bps-16kbps up to 1.5m 1 to 3 Non real time

Use Case Example 2: Stress Monitoring

Page 7: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 7

Use Case Example 3: Sleep Monitoring

Sleep Monitoring

Category Healthcare Medical

Situations Home Hospital

Example of Use case

Checking asleep conditions and use the data for people's need for better sleep. The data is utilized for insomnia treatment.

Sensors Sampling rate / quantization bit rate

Communication

distance

# of Nodes Real time/ Non real time

pulse wave or ECG 10-16bit, 64Hz-1kHz

640bps-16kbps up to 1.5m 1 Non real time

Accelerometer (body motion, posture)

10-16bit, 64Hz-1kHz

640bps-16kbps up to 1.5m 1 Non real time

Page 8: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 8

Use Case Example 4: Sports Monitoring

Sports Monitoring Category Sports

Situations Outdoors Indoors

Example of Use case

Measuring amount of activity and estimating calories burned up during sports. Checking pitching form and avoid dropping into a bad habit.

Sensors Sampling rate / quantization bit rate

Communication

distance

# of Nodes Real time/ Non real time

pulse wave or ECG 10-16bit, 64Hz-1kHz

640bps-16kbps up to 1.5m 1 to 4 Real time

Accelerator (body motion, posture)

10-16bit, 64Hz-1kHz

640bps-16kbps up to 1.5m 3 to 6 Real time

Page 9: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 9

Future Wireless Healthcare Eco-system (AV2E)

眼鏡イヤホン型

時計型

24 hours monitoring of human AV2E information and its record contribute

future medication as well as current and emergency medication.

Audio

Visual

Vital

Environmental

Feedback: medication /Health-Care/Wearable Device

Healthcare

Cloud Server

Data Mining

Medical

Decision

Health Care

Advice

Personal

Health Record

Noisy Sound

Hearing Impairment

Body Internal Sound

Damaging Day Light

Vision Impairment

Even Un-Visual Light Wave

ECG/EEG/Pulse

BodyTemeperature

SPO2 etc……..

Gas Sensor

Smell Sensor

Radiation Sensor

Page 10: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 10

Almost all wearing goods could be sensor nodes

眼鏡イヤホン型

時計型

ジョギングパートナー

AV2E Communication between human and health-care cloud server

should be carried out un-consciously .

Page 11: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 11

Data rate from wearable sensors*

Brain

Wave

Electical Image/Video Pressure

Variation Acceleration

1kbps

100kbps

1Mbps

ECG

EMG

EOG ENG

Brain

Blood

Stream

Pulse

SPO2

Breath

Pulse Blood

Pressure

Body

Movemen

t

Sound

Sound

0.1kbps

10kbps

Image/Video

Light

Reflection

Group1: 0.1kbps Avg.

Group-2: 1kbps Avg.

Group-3: 10kbps Avg.

Group-4: 100kbps Avg.

Group-5: 1Mbps Avg. Group-6: 10Mbps Avg. Group-7: 100Mbps Avg.

Group-0: 0.01kbps Avg.

Sesor out data rate

Body Temperature

* Depend on application

and /or sensor type

Type of sensors

Page 12: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 12

AV2 E Communication System Diagram

Vital Sensor

Data /

Models

Sensor

Data

Coding

Error

Control

& Wireless

Error

Control

& Wireless

Error

Control

& Wireless

Error

Control

& Wireless

Error

Control

& Wireless

Sensor

Data

Decoding

Sensor

Data

Decoding

Video

Data

Decoding

Audio

Data

Decoding

AV2 (Audio Visual & Vital) Wireless Sensor Systems AV2 (Audio Visual & Vital) Sensor Coordinator

BAN

Wireless

Network

Model

with

Interference

Env. Sensor

Data /

Models

Sensor

Data

Coding

Error

Control

& Wireless

・・・・

Audio

Sensor

Data /

Models

Audio

Data

Coding

Error

Control

& Wireless

Visual

Sensor

Data /

Models

Visual

Data

Coding

Error

Control

& Wireless

Evaluation

Video

Audio

Env.

Vital

Video

Audio Vital xN

Video

Audio Vital xN

Error

Protection

Video

Audio Vital xN

Video

Audio

Vital

Vital Transmission

Error Decoding

(Compression

Noise)

Encoding

Quality

Evaluation

From

Medical View Point

Encoding Cost (Power) Transmission

Cost (Power)

Decoding

Cost (Power)

Dynamically

Changing

Dynamically

Changing

・・・・

Page 13: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 13

1. Wireless Healthcare Overview

2. Toshiba’s Solution to the Wireless Healthcare

Business

3. Body Area Network (BAN) Standardization in ETSI

Page 14: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 14

SilmeeTM Engine and Prototype Small Size Module of Integrated Functions for Wearable Vital Signs Sensor

4 Sensors : ECG (Electrocardiograph), Pulse wave, Acceleration, Body Surface Temperature

Analog Front End (ECG, Pulse) made by Compact Implementation Technology ‘Pseudo-SoC’

Triaxial accelerometer

Thermometer

MCU : ARM Cortex-M3 (Sensor Control and Signal Processing)

Bluetooth (Ver4.0 Dual mode)

Silmee-Egg as Concept Working Model of Patch Type Sensor with in Silmee Engine Putting on Chest for ECG

Rechargeable Button Battery

Bluetooth

MCU

(ARM)

Acc

Temp

LED PD

Silmee Engine

ECG

(AFE)

Pulse

(AFE)

Pulse

Electrode

Electrode

ECG

14.5mm-14.5mm

Silmee Egg

(Concept Model as flagship)

Page 15: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 15

Target Applications

Self Care Remote Care Sports Beauty

Diet Healthcare

Childcare/Nursing Care

Home Monitoring

Monitoring of

Basic Vital Signs Trend

ECG

breathing

blood pressure

body temperature

Monitoring for babies and Elderlies

Degree of

Tension

Interest

Surprise

Home Medical Care/Community

Medical Cooperation

Sleep Apnea Syndrome

Morning/Masked Hypertension

Assistance for

“Beautiful “ Walk

“Beautiful” Posture

Notice of Time &

Exercise Load

to Lose Weight

Measurement of

Exercise Stress

Exercise Quantity

Measurement of

Calories

Basal Body Temperature

Autonomic Nerves

Detection and Notification of

Deterioration in Physical Condition

to Distant Family

Motion of Character followed by

vital sings

Medical Entertainment

Game/Contents

Page 16: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 16

1. Wireless Healthcare Overview

2. Toshiba’s Solution to the Wireless Healthcare

Business

3. Body Area Network (BAN) Standardization in ETSI

Page 17: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 17

Silmee’s Challenges for the Future Steps

Cloud

Server

NFC

LAN

BT

NFC

Net Service

Health care

Cloud Services

Smart BAN

眼鏡イヤホン型

Not only daily life usage,

but also emergency cases

Ultra-Low Power (ULP) Sensor Node Implementation.

Data Compression and ULP Signal Processing.

Data Security & Dependability under required QoS.

Smart BAN should support wide range of data rates and QoS levels. Also, it

should be power-efficient.

Coordinator

1. BAN Coordinator

2. PAN Communicator

3. Signal Processing

Page 18: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 18

What is ETSI TC Smart BAN?

TC Smart BAN is a vertical technical committee with

responsibilities for development and maintenance of ETSI

Standards, Specifications, Reports, Guides and other

deliverables to support the development and implementation of

Smart Body Area Network technologies (Wireless BAN, Personal

BAN, Personal Networks etc.)

Target applications include health, wellness, leisure, sport and

other relevant domains.

TC SmartBAN's scope includes communication media, and

associated physical layer, network layer, security, QoS and

lawful intercept, and also provision of generic applications and

services (e.g. web) for standardisation in the area of BAN

technologies.

ETSI/BOARD(13)94_0XX

Use what exists, fill in the gaps, and make it work better.

This is the mission of the new ETSI TC SmartBAN

Page 19: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 19

Acting Working Items (TC Smart BAN)

5 Work Items have been created so far:

1. Smart BAN Data representation and transfer, service and application;

Standardized interfaces, APIs and infrastructure for heterogeneity

management (TR)

2. Smart BAN Low Complexity Medium Access Control and Routing

(TS)

3. Smart BAN Measurements and Modelling of Smart BAN RF

environment (TR)

4. Smart Body Area Networks Enhanced Ultra-Low Power Physical

Layer (TS)

5. Smart BAN System Description (TR)

Page 20: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 20

ETSI TC Smart BAN

Technical Committee (TC) was officially started in March

2013

So far 3 face to face meetings

–#1 @ ETSI, 28 May 2013

–#2 @ TREL-TRL, 5 Sep 2013

–#3 @ ETSI, 12 Dec 2013

Next face to face meeting in May 2014

Planned to finalize in 2015

2014 Jan Dec Jan Dec Jan Mar

May.28 Sep.05 Dec.12 May 07

2013

TC started

(established )

2015~

Planned

Finalization

Page 21: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 21

1. Ultra Low Power Design

HUB/Node Role Sharing

HUB takes care of MAC operation functionality as much as

possible. Node operation is designed to be minimum.

Simple Access Scheme

Minimum power consumption of node.

Support Long Time Sleep Node

Sustainable connection of long-time sleep nodes

Simple Star Network

Technical Requirements for Smart (1)

Page 22: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 22

2. Timely Accessible Mechanism

Emergency Signal Transmission

Anytime possible to send.

Smart Connection Setup

Minimizing setup time of multiple number of nodes.

3. Co-existence Robustness

Co-existence between HUBs

Technical Requirements for Smart (2)

Page 23: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 23

2-ch Concept

Control Channel (C-ch)

Data Channel (D-ch)

D-ch Frame Structure

Timely Accessible

Mechanism

Co-existence

Robustness

Ultra Low Power

Technical

Requirements Smart BAN Solutions

Solutions in Smart

Page 24: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 24

Channel access

Frequency

Spectrum band: ISM 2.4GHz (2400 – 2483.5 MHz)

1 MHz each (e.g. 79 data + 3 control channels) ; f = 2400 + 1 * n, n = 1,…,79

2 MHz each (e.g. 37 data + 3 control channels) ; f = 2400 + 2 * n, n = 1,…,37

Page 25: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 25

Relationship between C-ch and D-ch

C-ch :

Scatter D-ch information

D-ch : Data transmission

and receipt

C-ch beacon

D-ch beacon

C-ch beacon

time

time

= Downlink packet (hub to node)

Channel access

TDMA based access in data channel and slotted ALOHA based

access in Control channel (2 channel Concept)

1 channel for Data (D-ch) and 1 channel for shared common

control(C-ch).

C-ch is an announcement channel and provides D-ch information

for initial connection setup.

Page 26: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 26

D-ch Frame Structure

Data

Transmission Continuous Data

Instantaneous Data

(Emergency Data)

Control /

Management e.g. Initial Connection

Contention-free period (CFP)

D-ch beacon

D-ch

Contention period (CP)

timeTDMA slotD-ch

TDMA Slotted-

ALOHA

CFP(Contention-free period) : Each node is assigned exclusive TDMA slots

CP(Contention period) : Sharing time slots by Slotted-ALOHA

Page 27: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 27

Initial Connection Setup Procedure

Contention-free period (CFP)

C-ch beacon

C-ch

D-ch beacon

D-ch

C-req C-res

C-ch beacon

Contention period (CP)

Slot assignment time

time

= Downlink packet (hub to node) =Uplink packet (node to hub)

TDMA slot

Node Opertions

① Detect RF channel# for D-ch by reading C-ch beacon

② Receive D-ch beacon

③ Connection Request (C-req*1) is transmitted during CP

④ Connection Response (C-res*2) is received

⑤ C-res indicates assigned slot numbers in CFP and data

transmission can be done using the assigned Slot numbers

④ ⑤

*1 Connection request

*2 Connection response

Page 28: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 28

Multi-use access mode (1)

B … …

Contention Free Period Contention Period

P

S

R

S

Emergency transaction

Sensing Contention access user transaction

PHY header + PSDU + PHY preamble + PHY header +

ACK + IFS + PHY preamble + transceiver turnaround

PHY preamble Transceiver

turnaround

Slot owner and contention

access user sensing

B

SSP#1 SSP#2 SSP#n SC/M#1 SC/M#m

PHY preamble Transceiver

turnaround

Beacon interval

Inactive period

Page 29: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 29

Multi-use access mode (2)

B

… …

Contention Free Period Contention Period

P

S

S

O

S

R

S

Emergency transaction

Sensing Slot owner transaction

Sensing Sensing Contention access user transaction

PHY header + PSDU + PHY preamble +

PHY header + ACK + IFS

PHY preamble Transceiver

turnaround

Slot owner may use additional headers to request

changes in allocations Slot owner and contention

access user sensing

Contention access user

sensing

B

SSP#1 SSP#2 SSP#n SC/M#1 SC/M#m

PHY preamble PHY preamble Transceiver

turnaround Transceiver

turnaround

Inactive period

Beacon interval

Page 30: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 30

Summary

24 hour monitoring and its record contribute future medication as

well as current and emergency medication.

Toshiba proposes a solution called SilmeeTM that can collect and

analyze vital signals in real time.

Toshiba contributes BAN standardization in ETSI TC Smart BAN.

Ultra Low Power Design

Timely Accessible Mechanism

Co-existence Robustness

Page 31: Personal Smart Healthcare using Body Area Network · Temp LED PD Silmee Engine ECG (AFE) Pulse (AFE) Pulse Electrode Electrode ECG 14.5mm-14.5mm ... deliverables to support the development

© 2013 Toshiba Corporation 31

Thank you