Mirror Neurons

and Human Telemetry

for Rehabilitation

ALESSANDRO LOMBARDI, DIGITAL ADVISOR | ITALY

KHARE

THE

TEA

M

2

The team: Microsoft

Microsoft enables health sector’s digital transformation by

helping care organizations better engage patients, empower

care teams, optimize clinical and operational effectiveness, and

transform the care continuum.

Alessandro

Lombardi

Digital Advisor

Luca

di Biagio

Solution Architect

Paolo

Mele

Sr Consultant

Pedro

Fortes

Sr Consultant

Saverio

Guardato

Consultant

Roberto

Robustelli

Delivery Manager

THE

TEA

M

3

The team: INAIL

Crucial for them to help people get back to work as soon as

possible

THE

TEA

M

4

The team: University of Parma

Mirror neuron discovery and continued research

20141995

How it all began

5

The “innovation hack”

“What a piece of work is a man! How noble in reason, how

infinite in faculty! In form and moving how express and

admirable!” - William Shakespeare

Meet Gotz:he got hurt

Happiness

Reassurance

Hope

Fear

Meet Hans:he is Gotz doctor

Happiness

Empowered

Givespersonalized

care

Unfulfilled

Meet the real Gotz

10

What is KHARE?

TechnologyNeuroscience

Medical expertise

• Average decrease of healing

times and increased movement

functionality; movements quality,

from the most approximate to the

most refined ones, for the normal

daily activities through the ones

needed for working.

• Increased number of

rehabilitations services that are

distributable by a single health

structure and subsequent costs

reduction for the patients and the

healthcare system.

• Patients and helpers satisfaction;

mainly because of the rehab

treatment continuum, given by the

relationship between the patient

and the health structure that

initially took the patient,

rehabilitation is also obtained with

the right psychological

contribution.

What are the advantagesof KHARE?

“Knowledge should be seen as

networked communication.” - Esko Kilpi

EmpathyTrigger of

mirror neurons

AOTProximal approach

13

The SCIENCE factor

Thevideo

stimulusIntensity

Humantelemetry

Predictivehuman

telemetry

14

Definitionsof indicators

The TECH factor

15

The HUMAN factor

INAIL CRM Volterra

16

KHARE as a platform

“All our dreams can come

true, if we have the courage to

pursue them.” - Walt Disney

COLLECTdata from the patients while they

are executing their physical

therapy exercises

TRANSFORMdata into a

standardized format

MANAGEdata as real-time streams and

store as relational or non-

relational datasets

in the cloud

ANALYZEand predict with machine

learning and custom

queries and algorithms

VISUALIZEthrough

dashboards, reports

to easily study data

DECIDEThe doctors

will be able

to increase the

therapies effectiveness

IOT HUB

Stream analytics

Azure StorageEvent

HUB

Api AppMachine Learning

• Windows 8.1 app (Kinect SDK)

• Event Hub to collect data from Kinect in real time

• Table storage

• Integration with Microsoft Band

• Measure angles and distances between joints

• Create complex exercises

• Measure quality

App

Features

The proof of concept, scope

The proof of concept, data sheet

Input ValuesAverage message size every

secondNumber of captured Joints

Average length of rehabsession (active time)

45.000 bytes 25 30 minutes

Average data size per rehabsession

Average data size per hour Therapy length

81 MB 162 MB 20 sessions per patient

Information per year

Number of expected patients Total sessions Total ingested data

50.000 1 M 81 TB

23

Moving on with INAIL

Medical Experimentation set up (2016)

DCOD (IT) department focuses on building a

Minimum Viable Product to be used in

experimentation

Rehabilitation department finalizes the new

medical protocol for AOT with Parma

Video preparation

Medical Experimentation (2017)

CRM Volterra starts experimentation

according to the new protocol on a controlled

group with the support of Parma

Technological POC

Envisioning

ForumPA divulgation

Analysis and design

Implementation and release

“Empower every

person and every

organization on the

planet to achieve

more.” - Satya Nadella

Next goal: extending telemetry

Measuring strength and fine finger detection

Human telemetry: going beyond rehab.

Empowering every human to improve performances and

learn new skills

Thanks.

Alessandro Lombardi

Alessandro.lombardi@microsoft.com