Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E,...

35
Using Technology to Assess Upper Extremity Function (Reachable Workspace) in Neuromuscular Disorders Jay J. Han, MD Professor Dept. of Physical Medicine & Rehabilitation UC Irvine

Transcript of Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E,...

Page 1: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Using Technology to Assess Upper Extremity Function (Reachable Workspace) in Neuromuscular Disorders

Jay J. Han, MD

Professor

Dept. of Physical Medicine & Rehabilitation

UC Irvine

Page 2: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Advances in Neuromuscular field

• Recent advances in therapeutic developments

– Neuromuscular field has been active

– Drug therapies & pharmacologic interventions

– Gene and cell therapies

– But also assistive devices and robotics

• Highlight the need for effective outcome measures

– Improve monitoring of disease severity and progression

– Better characterization for natural history studies

– Identify clinical outcome measures for planned efficacy trials

Page 3: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Traditional tools

Page 4: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

III (I)

IV (II) II (IV)

I (III)

R

x

z

x

z

L

Traditional Motion Capture Lab

van Andel et al. Gait & Posture (2008) 27:120-127

•Large cost•Space & equipment requirements•Not very portable•Marker-based (active or passive)

Example output

Page 5: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

• Development of algorithm and methods to reconstruct an individual’s

reachability (Reachable workspace).

• Graphical visualization of reachable workspace (3D)

-1000-500

0 -1000-50005001000

-1000

-500

0

500

1000

y(mm)

Movement Trajectory

x(mm)

z(m

m)

Page 6: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Steps to determining the Reachable Workspace

1. Area obtained

2. Normalized by

the area of the

hemisphere

(2r2)

3. Allows

comparison

between

individuals

Relative Surface

Area (RSA)

Kurillo G, Chen A, Bajcsy R, Han JJ. Evaluation of upper extremity reachable workspace using Kinect camera. Technol Health Care. 2013;21(6):641-56

Page 7: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Kurillo, Han et al. Development and Application of Stereo Camera-Based Upper Extremity Workspace Evaluation in Patients with Neuromuscular Diseases. PLoS One 2012

Page 8: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Kurillo G, Chen A, Bajcsy R, Han JJ. Evaluation of upper extremity reachable workspace using Kinect camera. Technol Health Care. 2013;21(6):641-56

Page 9: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in
Page 10: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in dystrophinopathyusing Kinect. Muscle Nerve. 2015 Sep;52(3):344-55

Page 11: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Set up(sensor + display + computer)

• Simple• Quick• Low-cost• Unobtrusive (no markers)• Intuitive (visualization of reachable workspace)

Page 12: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Kinect Reachable Workspace

RSA - Reliability testing

Kinect vs.

Test and retest

R=0.891R=0.891

R=0.858

R=0.930

Motioncapture

Kurillo G, Chen A, Bajcsy R, Han JJ. Evaluation of upper extremity reachable workspace using Kinect camera. Technol Health Care. 2013;21(6):641-56

Page 13: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Also, Test re-test reliability in DMD

ICC=0.935

Han JJ, Kurillo G et al. Muscle Nerve. 2015 Sep;52(3):344-55

Han JJ et al. Muscle Nerve. 2016 Apr;53(4):545-54

Page 14: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Reachable Workspace Differences between:

DMD, BMD, FSHD, and ALS

Page 15: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

RSAvs.Brooke

(DMD)

Han JJ, Kurillo G et al. Muscle Nerve.

2015 Sep;52(3):344-55

Page 16: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

ElbowFlexion

ShoulderAbduction

Combined

Elbow Flexion % - predicted MVIC

0 20 40 60 80 100 120 140 160

Cohort

%

0

5

10

15

20

25

30

FSHD

CTRL

Shoulder Abduction % - predicted MVIC

0 20 40 60 80 100 120 140 160

Co

ho

rt %

0

5

10

15

20

25

30

FSHD

CTRL

Combined (Elbow Flexion + Shoulder Abduction) % - predicted MVIC

0 20 40 60 80 100 120 140 160

Cohort

%

0

5

10

15

20

25

30

FSHD

CTRL

RSA vs. Strength(FSHD)

Han JJ, de Bie E, Nicorici A, Abresch RT,

Bajcsy R, Kurillo G. Muscle Nerve. 2015

Dec;52(6):948-55.

Page 17: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

No Weight (no loading)

Page 18: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

500 Gram wrist weight (~1 lb loading)

Page 19: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in dystrophinopathyusing Kinect. Muscle Nerve. 2015 Sep;52(3):344-55

Using simple wrist-weight to detect subtle differences in Reachability

Page 20: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

FSHD:

Reachable workspace

by

QMT

• Shoulder Abduction

• Elbow Flexion

Page 21: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Han JJ, de Bie E, Nicorici A, Abresch RT, Anthonisen C, Bajcsy R, Kurillo G, Mcdonald CM. Reachable workspace and performance of upper limb (PUL) in Duchenne muscular dystrophy. Muscle Nerve. 2016 Apr;53(4):545-54

R= 0.945, P<0.001

RSA correlates well with PUL

Page 22: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Mapping ADL functions (PRO – NeuroQOL)to Reachable workspace Quadrants

Page 23: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in dystrophinopathy using Kinect. Muscle Nerve. 2015 Sep;52(3):344-55

Reachable workspace correlation with

ADLs

Page 24: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

FSHD: Longitudinal study (18 subjects: 8mo-5yrs, ave 2.5yrs)

Hatch et al. Longitudinal Study of Upper Extremity Reachable Workspace in FSHD. Neuromuscular Disorders (2019). doi: https://doi.org/10.1016/j.nmd.2019.05.006

Page 25: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

FSHD: Longitudinal (8mo-5 years follow up)

Hatch et al. Longitudinal Study of Upper Extremity Reachable Workspace in FSHD. Neuromuscular Disorders (2019). doi: https://doi.org/10.1016/j.nmd.2019.05.006

Page 26: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Hatch et al. Longitudinal Study of Upper Extremity Reachable Workspace in FSHD. Neuromuscular Disorders (2019). doi: https://doi.org/10.1016/j.nmd.2019.05.006

FSHD Longi: 500g weight

Page 27: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Hatch et al. Longitudinal Study of Upper Extremity Reachable Workspace in FSHD. Neuromuscular Disorders (2019). doi: https://doi.org/10.1016/j.nmd.2019.05.006

FSHD Longitudinal: 18 subjects followed 8mo-5yrs (ave. 2.5 years)

∆-1.63%/yr

∆-1.82%/yr

Page 28: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Hatch et al. Longitudinal Study of Upper Extremity Reachable Workspace in FSHD. Neuromuscular Disorders (2019). doi: https://doi.org/10.1016/j.nmd.2019.05.006

Entire cohort

w/o High-function

Page 29: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

ALS longitudinal data

de Bie E, Oskarsson B, Joyce NC, Nicorici A, Kurillo G, Han JJ. Longitudinal evaluation of upper extremity reachable workspace in ALS by Kinect sensor. Amyotroph Lateral Scler Frontotemporal Degener. 2017 Feb;18(1-2):17-23

Oskarsson B, Joyce NC, De Bie E, Nicorici A, Bajcsy R, Kurillo G, Han JJ. Upper extremity 3-dimensional reachable workspace assessment in amyotrophic lateral sclerosis by Kinect sensor. Muscle Nerve. 2016 Feb;53(2):234-41.

∆ -19.3%/year

Page 30: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Pompe patients: pre- & post-ERT

Pre

3 months post

6 months post

Subject 105 Subject 107

Page 31: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Clinical Trial & in-clinic RWS system

• >20 systems deployed around the world (NA, South America, Asia, Europe)

– Neuromuscular conditions

– Neurological

– Orthopedic & musculoskeletal

– Post breast cancer rehab

– Drug trial

• Portable system can be taken to patient’s home (laptop, tripod+Kinect)

• Cloud-based system– Internet sign-on

– Automatic data upload to cloud server

Page 32: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in
Page 33: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Acknowledgement

• These studies were supported by grants from:

– NIH, NIAMS U01-AR065113-01

– NSF, #1111965

– NIDRR, #H133B090001

– CITRIS seed grant

– PPMD exploratory grant

• UC Berkeley/ Tele-immersion Lab

Gregorij Kurillo

Ruzena Bajcsy

Posu Yan

Robert Matthew

• UC Davis NIDRR RRTC in NMD

Craig McDonald

Ted Abresch

Colleen Anthonisen

Michelle Cregan

Evan deBie

Erica Goude

Erik Henricson

Linda Johnson

Alina Nicorici

Sean Sumner

Page 34: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in

Thank you !

Page 35: Using Technology to Assess Upper Extremity Function ... · Han JJ, Kurillo G, Abresch RT, de Bie E, Nicorici Lewis A, Bajcsy R. Upper extremity 3D reachable workspace analysis in