Remote monitoring of biomedical signals using 3G -...

43
Remote Monitoring of Biomedical Signals Using 3G Agustín J. González Department of Electronics Universidad Técnica Federico Santa María

Transcript of Remote monitoring of biomedical signals using 3G -...

Page 1: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Remote Monitoring of Biomedical Signals Using 3G

Agustín J. González

Department of Electronics

Universidad Técnica Federico Santa María

Page 2: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Outline

Previous work

Remote monitoring of environment variables using WSN and 2G

Remote monitoring of pulse rate using 2G

ERPHA: Emergency Remote Pre-Hospital Assistance

ERPHA demo

2

Page 3: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Using Wireless Metropolitan Area Networks

2006

2007

2010

Environment signals monitoring for

Precision Agriculture

Remote monitoring of pulse rate using 2G

Biomedical signals monitoring using 3G:

Emergency Remote Pre-Hospital Assistance

3

Page 4: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Remote monitoring of environment variables using

WSN and 2G

4

Page 5: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Remote monitoring of environment variables using WSN and 2G

In collaboration with a local company, we developed WiseField, a system to monitor relevant agro-climatic variables using Wireless Sensor Networks.

An extended version also uses 2G.

The system is working today in different farms.

5

Page 6: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Precision Agriculture Application V1.0

Nodo

Nodo

Nodo

Nodo

Nodo

Nodo

Nodo

Nodo

Nodo

Nodo

GTW

Nodo

6

Page 7: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Issues we addressed Application driven by interaction with the

environment Limited resources (power, memory, CPU) Reliability (long-lived application) Soft real-time requirements RF Signal propagation and interference

Any similarity with remote biofeedback ?

7

Page 8: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Extension: Many fields 2G

Using a WSN-GPRS gateway in each field

Region A

Region B

Region C

Headquarters

8

Page 9: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Using Wireless Metropolitan Area Networks

2006

2007

2010

Environment signals monitoring for

Precision Agriculture

Remote monitoring of pulse rate using 2G

Biomedical signals monitoring using 3G:

Emergency Remote Pre-Hospital Assistance

9

Page 10: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Mobile devices and phones over time

We have developed applications using their acquisition, processing, storing, and communications capabilities.

‘90 2011

10

Page 11: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Remote Monitoring of Biomedical Signals Using 2G

(only pulse rate)

11

Page 12: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Patient Telemonitoring

GSM/GPRS

INTERNET

WMAN

Communication

provider

SENSOR

CAPTURE

CIRCUIT

Mobile Device

-Acquisition

-Processing

-Transmission

Pablo Roncagliolo

WEB Monitoring

12

Page 13: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

First prototype

Adaptation Circuit (Homemade)

Sensor Nellcor Oximax

MAX-N

13

Page 14: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

System prototype

SonyEricsson637

Nokia 6620 IPAQ 3715

Nokia 6670

We tested it with all these phones.

14

Page 15: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Results

Phone capture and display

WEB monitoring

15

Page 16: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Using Wireless Metropolitan Area Networks

2006

2007

2010

Environment signals monitoring for

Precision Agriculture

Remote monitoring of pulse rate using 2G

Biomedical signals monitoring using 3G:

Emergency Remote Pre-Hospital Assistance

16

Page 17: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Remote Monitoring of Biomedical Signals Using 3G,

ERPHA project In collaboration with the Instituto Tecnológico de Monterrey, Mexico

Funded by

17

Page 18: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Motivation

Vehicular accidents with traumatic results are among the main causes of death in the world.

Emergency care provided during the first hour, the “golden hour”, determines if the life of the most severely injured people can be saved.

Neither Chile nor Mexico provides pre-hospital continuous monitoring.

18

Page 19: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Emergency Remote Pre-Hospital Assistance

Pulse oximetry

Blood pressure

ERPHA

WEB view

ERPHA

Server

Remote

monitoring

Overall view

19

Page 20: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

What biomedical signals are important ?

Emergency specialists requested us:

Pulse rate

Pulse oximetry

Blood pressure

Electrocardiogram (ECG)

Geographic position

Patient’s pictures

20

Page 21: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Sensors and phones

Vital signs sensors

Oximetry: Nonin 4100

Blood pressure: Corscience BOSO Medicus Prestige

ECG: Corscience BT 3/6

Smartphone

Samsung i637

GPS, 3-Mpixel camera

Bluetooth, 3G, Wifi

21

Page 22: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Sensors and phones

22

Page 23: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Acquisition and storage architecture …

Pulse oximetry

Blood pressure

ERPHA

WEB view

ERPHA

Server

Remote

monitoring

23

Page 24: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Acquisition and storage architecture

Pulse oximetry

ECG

Blood pressure

Bluetooth

+ Pictures + GPS

Sensors Acquisition and communication

control

3G

Storage Server + DB + WEB server

Storage server

24

Page 25: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Monitoring architecture …

Pulse oximetry

Blood pressure

ERPHA

WEB view

ERPHA

Server

Remote

monitoring

25

Page 26: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Monitoring Architecture

Internet

• Blood oxygen monitoring • Pulse plethysmography • Pulse rate (oximeter, EGC, pressure sensor) • EGC • Blood pressure • Pictures • Patient trajectory

Storage Server + DB + WEB server

26

Page 27: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

ERPHA local Demo

27

Page 28: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Software tools

ERPHA Mobile

ERPHA server

3G Internet

Push server

Internet Information

Service

ERPHA Monitoring

Languages: C#+ XAML

Internet Sensors

TCP

IPC

28

Page 29: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Work in progress

Idea: by controlling the allocated bit rate to each sensor flow, we can reduce the latency of the critical flow.

ERPHA Mobile

ERPHA server

3G Internet

Sensors

5 sensors flows

29

Page 30: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Final comments

In normal conditions, current 3G service provides enough throughput and latency for this type of applications.

In congested links, managing the available bit rate can reduce the latency of a critical signal flow while delaying the others.

The prototype has been already validated by emergency physicians in the lab.

30

Page 31: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

ERPHA team

31

Page 32: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Thanks for your attention Agustín J. González

32

Page 33: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Using augmented reality for

neurosurgical planning :Craniotomy

Objective: To help surgeon to find attach point (opening point)

33

Page 34: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Propose system

34

Page 35: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Use scenario

35

Page 36: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Expected result

36

Page 37: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Some Results: Image projection over a 2D pattern

37

Page 38: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Now 3D projection

38

Page 39: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

39

Page 40: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

ERPHA Servers

40

Page 41: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

ERPHA WEB Monitoring

41

Page 42: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Client Thread 2

Tx Proxy - Architecture

3G

Scheduler Thread

Client Thread 1

Client 1

Client 2

Client N

Leaky

Bucket 1

Leaky

Bucket 2

Leaky

Bucket N

Logger

Control

Channel

TCP 1 TCP 2 TCP N TCP C

Tx Proxy

42

Page 43: Remote monitoring of biomedical signals using 3G - Inicioprofesores.elo.utfsm.cl/...Chile_Seminar_May2012.pdf · Remote Monitoring of Biomedical Signals Using 3G ... Remote Monitoring

Client Thread 2

Rx Proxy - Architecture

Client Thread 1

TCP 2

TCP N

Logger Control

Channel

TCP 1

Rx Proxy

3G

Quality of

Service

Estimation

TCP C

43