Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head...

138
Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar – Fall 2013

Transcript of Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head...

Page 1: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Sparse Modeling for Prospective Head MotionCorrection

Daniel S. Weller

University of Michigan

September 26, 2013

CSP Seminar – Fall 2013

Page 2: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Motivation

• Head motion reduces the sensitivity of functional magneticresonance imaging (fMRI) experiments.

• I propose a motion compensation method that uses justthe data collected during a conventional fMRI.

True correlations (red) After head motion

CSP Seminar – Fall 2013 2

Page 3: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Motivation

• Head motion reduces the sensitivity of functional magneticresonance imaging (fMRI) experiments.

• I propose a motion compensation method that uses justthe data collected during a conventional fMRI.

True correlations (red) With proposed correction

CSP Seminar – Fall 2013 2

Page 4: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Outline

Magnetic Resonance Imaging

Functional MRI

Head Motion in fMRI

Proposed Method for Prospective Correction

Real Time Implementation

Simulation Results

Conclusions and Future Work

Summary

CSP Seminar – Fall 2013 3

Page 5: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

What is MRI?

MRI Scanner Axial brain images show different soft tissue contrast.

• Magnetic resonance imaging (MRI) provides excellent softtissue contrast.

• Densities and magnetic properties of particles tell us a lotabout organ structure and composition.

• Dynamic/functional MRI time series capture organ function.

CSP Seminar – Fall 2013 4

Page 6: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

What is MRI?

MRI Scanner Axial brain images show different soft tissue contrast.

• Magnetic resonance imaging (MRI) provides excellent softtissue contrast.

• Densities and magnetic properties of particles tell us a lotabout organ structure and composition.

• Dynamic/functional MRI time series capture organ function.

CSP Seminar – Fall 2013 4

Page 7: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

What is MRI?

MRI Scanner Axial brain images show different soft tissue contrast.

• Magnetic resonance imaging (MRI) provides excellent softtissue contrast.

• Densities and magnetic properties of particles tell us a lotabout organ structure and composition.

• Dynamic/functional MRI time series capture organ function.

CSP Seminar – Fall 2013 4

Page 8: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

What does MRI measure?

• Certain particles have magnetic moments (spins), whichtend to align with a strong external magnetic field B0.

• When excited by a radiofrequency (RF) pulse, these spinstip away from the main field.

• They precess at the Larmor frequency γB0, proportional tothe main field, as they return to equilibrium (relax).

• These spins induce an emf in a nearby receiver loop coil.

CSP Seminar – Fall 2013 5

Page 9: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

What does MRI measure?

• Certain particles have magnetic moments (spins), whichtend to align with a strong external magnetic field B0.

• When excited by a radiofrequency (RF) pulse, these spinstip away from the main field.

• They precess at the Larmor frequency γB0, proportional tothe main field, as they return to equilibrium (relax).

• These spins induce an emf in a nearby receiver loop coil.

transmittip

CSP Seminar – Fall 2013 5

Page 10: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

What does MRI measure?

• Certain particles have magnetic moments (spins), whichtend to align with a strong external magnetic field B0.

• When excited by a radiofrequency (RF) pulse, these spinstip away from the main field.

• They precess at the Larmor frequency γB0, proportional tothe main field, as they return to equilibrium (relax).

• These spins induce an emf in a nearby receiver loop coil.

precess

relax

CSP Seminar – Fall 2013 5

Page 11: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

What does MRI measure?

• Certain particles have magnetic moments (spins), whichtend to align with a strong external magnetic field B0.

• When excited by a radiofrequency (RF) pulse, these spinstip away from the main field.

• They precess at the Larmor frequency γB0, proportional tothe main field, as they return to equilibrium (relax).

• These spins induce an emf in a nearby receiver loop coil.

precess

relax

receiver

CSP Seminar – Fall 2013 5

Page 12: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Generating an MR image

• The received signal superimposes contributions from allthe precessing spins in the excited slice S:

s(t) = e−jγB0t

∫∫Sm(x, y) dx dy.

• Gradient coils control additional spatially varying magneticfields Gx, Gy to acquire images: Bz = B0 +Gxx+Gyy.

• The received signal is called k-space:

ejγB0ts(t) =

∫∫Sm(x, y)e−jγ(

∫ t0 Gx(τ)x+Gy(τ)y dτ) dx dy.

• By adjusting the gradients, we effectively sample k-space.• Applying z-gradient Gz during excitation selects a slice.

CSP Seminar – Fall 2013 6

Page 13: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Generating an MR image

• The received signal superimposes contributions from allthe precessing spins in the excited slice S:

s(t) = e−jγB0t

∫∫Sm(x, y) dx dy.

• Gradient coils control additional spatially varying magneticfields Gx, Gy to acquire images: Bz = B0 +Gxx+Gyy.

• The received signal is called k-space:

ejγB0ts(t) =

∫∫Sm(x, y)e−jγ(

∫ t0 Gx(τ)x+Gy(τ)y dτ) dx dy.

• By adjusting the gradients, we effectively sample k-space.• Applying z-gradient Gz during excitation selects a slice.

CSP Seminar – Fall 2013 6

Page 14: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Generating an MR image

• The received signal superimposes contributions from allthe precessing spins in the excited slice S:

s(t) = e−jγB0t

∫∫Sm(x, y) dx dy.

• Gradient coils control additional spatially varying magneticfields Gx, Gy to acquire images: Bz = B0 +Gxx+Gyy.

• The received signal is called k-space:

ejγB0ts(t) =

∫∫Sm(x, y)e−jγ(

∫ t0 Gx(τ)x+Gy(τ)y dτ) dx dy.

• By adjusting the gradients, we effectively sample k-space.• Applying z-gradient Gz during excitation selects a slice.

CSP Seminar – Fall 2013 6

Page 15: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Generating an MR image

• The received signal superimposes contributions from allthe precessing spins in the excited slice S:

s(t) = e−jγB0t

∫∫Sm(x, y) dx dy.

• Gradient coils control additional spatially varying magneticfields Gx, Gy to acquire images: Bz = B0 +Gxx+Gyy.

• The received signal is called k-space:

ejγB0ts(t) =

∫∫Sm(x, y)e−jγ(

∫ t0 Gx(τ)x+Gy(τ)y dτ) dx dy.

• By adjusting the gradients, we effectively sample k-space.• Applying z-gradient Gz during excitation selects a slice.

CSP Seminar – Fall 2013 6

Page 16: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Generating an MR image

• The received signal superimposes contributions from allthe precessing spins in the excited slice S:

s(t) = e−jγB0t

∫∫Sm(x, y) dx dy.

• Gradient coils control additional spatially varying magneticfields Gx, Gy to acquire images: Bz = B0 +Gxx+Gyy.

• The received signal is called k-space:

ejγB0ts(t) =

∫∫Sm(x, y)e−jγ(

∫ t0 Gx(τ)x+Gy(τ)y dτ) dx dy.

• By adjusting the gradients, we effectively sample k-space.• Applying z-gradient Gz during excitation selects a slice.

CSP Seminar – Fall 2013 6

Page 17: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Accelerating MR imaging

• The sampling process is sequential, relatively slow.• We must wait between excitations for the signal to relax.• To accelerate imaging:

• increase sample spacing, causing aliasing,• reduce the sampling extent, decreasing resolution,• sample half of k-space, assuming a real-valued image, or• traverse more of k-space during each shot

CSP Seminar – Fall 2013 7

Page 18: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Accelerating MR imaging

• The sampling process is sequential, relatively slow.• We must wait between excitations for the signal to relax.• To accelerate imaging:

• increase sample spacing, causing aliasing,• reduce the sampling extent, decreasing resolution,• sample half of k-space, assuming a real-valued image, or• traverse more of k-space during each shot

CSP Seminar – Fall 2013 7

Page 19: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Accelerating MR imaging

• The sampling process is sequential, relatively slow.• We must wait between excitations for the signal to relax.• To accelerate imaging:

• increase sample spacing, causing aliasing,• reduce the sampling extent, decreasing resolution,• sample half of k-space, assuming a real-valued image, or• traverse more of k-space during each shot

CSP Seminar – Fall 2013 7

Page 20: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Accelerating MR imaging

• The sampling process is sequential, relatively slow.• We must wait between excitations for the signal to relax.• To accelerate imaging:

• increase sample spacing, causing aliasing,• reduce the sampling extent, decreasing resolution,• sample half of k-space, assuming a real-valued image, or• traverse more of k-space during each shot

CSP Seminar – Fall 2013 7

Page 21: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Accelerating MR imaging

• The sampling process is sequential, relatively slow.• We must wait between excitations for the signal to relax.• To accelerate imaging:

• increase sample spacing, causing aliasing,• reduce the sampling extent, decreasing resolution,• sample half of k-space, assuming a real-valued image, or• traverse more of k-space during each shot

CSP Seminar – Fall 2013 7

Page 22: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Accelerating MR imaging

• The sampling process is sequential, relatively slow.• We must wait between excitations for the signal to relax.• To accelerate imaging:

• increase sample spacing, causing aliasing,• reduce the sampling extent, decreasing resolution,• sample half of k-space, assuming a real-valued image, or• traverse more of k-space during each shot

CSP Seminar – Fall 2013 7

Page 23: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Contrast and relaxation

• The signal model assumed m(x, y) is constant over time.• However, the spin magnitude varies over time due to

relaxation:• longitudinal component recovers (∝ 1− e−t/T1 ), and• transverse component decays (∝ e−t/T2 )

• Signal dephasing due to local field inhomogeneity alsomanifests as transverse relaxation (time constant T ′2):

• total transverse relaxation rate 1/T ∗2 = 1/T2 + 1/T ′2

• Repetition time TR is time between excitations; shorter TR⇒ greater T1 contrast.

• Echo time TE is time between excitation and samplingcenter of k-space; longer TE ⇒ greater T ∗2 contrast.

CSP Seminar – Fall 2013 8

Page 24: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Contrast and relaxation

• The signal model assumed m(x, y) is constant over time.• However, the spin magnitude varies over time due to

relaxation:• longitudinal component recovers (∝ 1− e−t/T1 ), and• transverse component decays (∝ e−t/T2 )

• Signal dephasing due to local field inhomogeneity alsomanifests as transverse relaxation (time constant T ′2):

• total transverse relaxation rate 1/T ∗2 = 1/T2 + 1/T ′2

• Repetition time TR is time between excitations; shorter TR⇒ greater T1 contrast.

• Echo time TE is time between excitation and samplingcenter of k-space; longer TE ⇒ greater T ∗2 contrast.

CSP Seminar – Fall 2013 8

Page 25: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Contrast and relaxation

• The signal model assumed m(x, y) is constant over time.• However, the spin magnitude varies over time due to

relaxation:• longitudinal component recovers (∝ 1− e−t/T1 ), and• transverse component decays (∝ e−t/T2 )

• Signal dephasing due to local field inhomogeneity alsomanifests as transverse relaxation (time constant T ′2):

• total transverse relaxation rate 1/T ∗2 = 1/T2 + 1/T ′2

• Repetition time TR is time between excitations; shorter TR⇒ greater T1 contrast.

• Echo time TE is time between excitation and samplingcenter of k-space; longer TE ⇒ greater T ∗2 contrast.

CSP Seminar – Fall 2013 8

Page 26: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Contrast and relaxation

• The signal model assumed m(x, y) is constant over time.• However, the spin magnitude varies over time due to

relaxation:• longitudinal component recovers (∝ 1− e−t/T1 ), and• transverse component decays (∝ e−t/T2 )

• Signal dephasing due to local field inhomogeneity alsomanifests as transverse relaxation (time constant T ′2):

• total transverse relaxation rate 1/T ∗2 = 1/T2 + 1/T ′2

• Repetition time TR is time between excitations; shorter TR⇒ greater T1 contrast.

• Echo time TE is time between excitation and samplingcenter of k-space; longer TE ⇒ greater T ∗2 contrast.

CSP Seminar – Fall 2013 8

Page 27: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Contrast and relaxation

• The signal model assumed m(x, y) is constant over time.• However, the spin magnitude varies over time due to

relaxation:• longitudinal component recovers (∝ 1− e−t/T1 ), and• transverse component decays (∝ e−t/T2 )

• Signal dephasing due to local field inhomogeneity alsomanifests as transverse relaxation (time constant T ′2):

• total transverse relaxation rate 1/T ∗2 = 1/T2 + 1/T ′2

• Repetition time TR is time between excitations; shorter TR⇒ greater T1 contrast.

• Echo time TE is time between excitation and samplingcenter of k-space; longer TE ⇒ greater T ∗2 contrast.

CSP Seminar – Fall 2013 8

Page 28: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Outline

Magnetic Resonance Imaging

Functional MRI

Head Motion in fMRI

Proposed Method for Prospective Correction

Real Time Implementation

Simulation Results

Conclusions and Future Work

Summary

CSP Seminar – Fall 2013 9

Page 29: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

The BOLD effect for fMRI

• Neuronal impulses are too short, weak to register usingconventional MRI.

• Instead, indirectly measure activity by tracking bloodoxygen metabolism.

• Hemoglobin has two states:• with bound oxygen is diamagnetic, and• without bound oxygen is paramagnetic (↑ 1/T ∗2 )

• BOLD contrast results from increased blood flow, andincreased metabolism:

• ↑ blood flow⇒ ↓ deoxygenated blood⇒ ↓ 1/T ∗2 , and• ↑ metabolism⇒ ↑ deoxygenated blood⇒ ↑ 1/T ∗2

CSP Seminar – Fall 2013 10

Page 30: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

The BOLD effect for fMRI

• Neuronal impulses are too short, weak to register usingconventional MRI.

• Instead, indirectly measure activity by tracking bloodoxygen metabolism.

• Hemoglobin has two states:• with bound oxygen is diamagnetic, and• without bound oxygen is paramagnetic (↑ 1/T ∗2 )

• BOLD contrast results from increased blood flow, andincreased metabolism:

• ↑ blood flow⇒ ↓ deoxygenated blood⇒ ↓ 1/T ∗2 , and• ↑ metabolism⇒ ↑ deoxygenated blood⇒ ↑ 1/T ∗2

CSP Seminar – Fall 2013 10

Page 31: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

The BOLD effect for fMRI

• Neuronal impulses are too short, weak to register usingconventional MRI.

• Instead, indirectly measure activity by tracking bloodoxygen metabolism.

• Hemoglobin has two states:• with bound oxygen is diamagnetic, and• without bound oxygen is paramagnetic (↑ 1/T ∗2 )

• BOLD contrast results from increased blood flow, andincreased metabolism:

• ↑ blood flow⇒ ↓ deoxygenated blood⇒ ↓ 1/T ∗2 , and• ↑ metabolism⇒ ↑ deoxygenated blood⇒ ↑ 1/T ∗2

CSP Seminar – Fall 2013 10

Page 32: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

The BOLD effect for fMRI

• Neuronal impulses are too short, weak to register usingconventional MRI.

• Instead, indirectly measure activity by tracking bloodoxygen metabolism.

• Hemoglobin has two states:• with bound oxygen is diamagnetic, and• without bound oxygen is paramagnetic (↑ 1/T ∗2 )

• BOLD contrast results from increased blood flow, andincreased metabolism:

• ↑ blood flow⇒ ↓ deoxygenated blood⇒ ↓ 1/T ∗2 , and• ↑ metabolism⇒ ↑ deoxygenated blood⇒ ↑ 1/T ∗2

CSP Seminar – Fall 2013 10

Page 33: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Modeling the BOLD signal

0 50 100 150 200

0

0.01

0.02

0.03

Time (s)

Activa

tio

nActivations from block design convolved with canonical hrf from SPM81

• The functional MRI process is modeled as an LTI systemwith an impulse response known as the hemodynamicresponse function (hrf).

• In reality, the hrf varies spatially and over time.• It changes from subject-to-subject and scan-to-scan.• Software like SPM81 use basis functions for the hrf.

1 http://www.fil.ion.ucl.ac.uk/spm/

CSP Seminar – Fall 2013 11

Page 34: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Modeling the BOLD signal

0 50 100 150 200

0

0.01

0.02

0.03

Time (s)

Activa

tio

nActivations from block design convolved with canonical hrf from SPM81

• The functional MRI process is modeled as an LTI systemwith an impulse response known as the hemodynamicresponse function (hrf).

• In reality, the hrf varies spatially and over time.• It changes from subject-to-subject and scan-to-scan.• Software like SPM81 use basis functions for the hrf.

1 http://www.fil.ion.ucl.ac.uk/spm/

CSP Seminar – Fall 2013 11

Page 35: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Modeling the BOLD signal

0 50 100 150 200

0

0.01

0.02

0.03

Time (s)

Activa

tio

nActivations from block design convolved with canonical hrf from SPM81

• The functional MRI process is modeled as an LTI systemwith an impulse response known as the hemodynamicresponse function (hrf).

• In reality, the hrf varies spatially and over time.• It changes from subject-to-subject and scan-to-scan.• Software like SPM81 use basis functions for the hrf.

1 http://www.fil.ion.ucl.ac.uk/spm/

CSP Seminar – Fall 2013 11

Page 36: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Modeling the BOLD signal

0 50 100 150 200

0

0.01

0.02

0.03

Time (s)

Activa

tio

nActivations from block design convolved with canonical hrf from SPM81

• The functional MRI process is modeled as an LTI systemwith an impulse response known as the hemodynamicresponse function (hrf).

• In reality, the hrf varies spatially and over time.• It changes from subject-to-subject and scan-to-scan.• Software like SPM81 use basis functions for the hrf.

1 http://www.fil.ion.ucl.ac.uk/spm/

CSP Seminar – Fall 2013 11

Page 37: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Functional MRI analysis

• To identify activated brain regions, we correlate the idealtime series activations against the time series for eachvoxel in the brain.

• This analysis yields the general linear model (GLM):

Y︸︷︷︸data

=[G 1

]︸ ︷︷ ︸regressors

β︸︷︷︸weights

+ ε︸︷︷︸error

.

• Software packages like SPM8 implement this analysis andprovide visualization tools.

CSP Seminar – Fall 2013 12

Page 38: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Functional MRI analysis

• To identify activated brain regions, we correlate the idealtime series activations against the time series for eachvoxel in the brain.

• This analysis yields the general linear model (GLM):

Y︸︷︷︸data

=[G 1

]︸ ︷︷ ︸regressors

β︸︷︷︸weights

+ ε︸︷︷︸error

.

• Software packages like SPM8 implement this analysis andprovide visualization tools.

CSP Seminar – Fall 2013 12

Page 39: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Functional MRI analysis

• To identify activated brain regions, we correlate the idealtime series activations against the time series for eachvoxel in the brain.

• This analysis yields the general linear model (GLM):

Y︸︷︷︸data

=[G 1

]︸ ︷︷ ︸regressors

β︸︷︷︸weights

+ ε︸︷︷︸error

.

• Software packages like SPM8 implement this analysis andprovide visualization tools.

CSP Seminar – Fall 2013 12

Page 40: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Pre-processing fMRI data

Conventionally, data are pre-processed in the following ways:1. Slice-by-slice acquisitions are time-shifted to account for

different slice timings.2. Head motion is estimated and used to register volumes to

the first/middle volume of the time series.3. Time series can be realigned to a separate reference

volume for visualization purposes.4. Volumes are normalized to a fixed coordinate system (e.g.,

Tailarach) in group studies.5. Data can be smoothed/blurred using a Gaussian kernel to

reduce noise, cross-subject variance.

Our single-subject simulations require only step #2.

CSP Seminar – Fall 2013 13

Page 41: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Pre-processing fMRI data

Conventionally, data are pre-processed in the following ways:1. Slice-by-slice acquisitions are time-shifted to account for

different slice timings.2. Head motion is estimated and used to register volumes to

the first/middle volume of the time series.3. Time series can be realigned to a separate reference

volume for visualization purposes.4. Volumes are normalized to a fixed coordinate system (e.g.,

Tailarach) in group studies.5. Data can be smoothed/blurred using a Gaussian kernel to

reduce noise, cross-subject variance.

Our single-subject simulations require only step #2.

CSP Seminar – Fall 2013 13

Page 42: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Pre-processing fMRI data

Conventionally, data are pre-processed in the following ways:1. Slice-by-slice acquisitions are time-shifted to account for

different slice timings.2. Head motion is estimated and used to register volumes to

the first/middle volume of the time series.3. Time series can be realigned to a separate reference

volume for visualization purposes.4. Volumes are normalized to a fixed coordinate system (e.g.,

Tailarach) in group studies.5. Data can be smoothed/blurred using a Gaussian kernel to

reduce noise, cross-subject variance.

Our single-subject simulations require only step #2.

CSP Seminar – Fall 2013 13

Page 43: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Pre-processing fMRI data

Conventionally, data are pre-processed in the following ways:1. Slice-by-slice acquisitions are time-shifted to account for

different slice timings.2. Head motion is estimated and used to register volumes to

the first/middle volume of the time series.3. Time series can be realigned to a separate reference

volume for visualization purposes.4. Volumes are normalized to a fixed coordinate system (e.g.,

Tailarach) in group studies.5. Data can be smoothed/blurred using a Gaussian kernel to

reduce noise, cross-subject variance.

Our single-subject simulations require only step #2.

CSP Seminar – Fall 2013 13

Page 44: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Pre-processing fMRI data

Conventionally, data are pre-processed in the following ways:1. Slice-by-slice acquisitions are time-shifted to account for

different slice timings.2. Head motion is estimated and used to register volumes to

the first/middle volume of the time series.3. Time series can be realigned to a separate reference

volume for visualization purposes.4. Volumes are normalized to a fixed coordinate system (e.g.,

Tailarach) in group studies.5. Data can be smoothed/blurred using a Gaussian kernel to

reduce noise, cross-subject variance.

Our single-subject simulations require only step #2.

CSP Seminar – Fall 2013 13

Page 45: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Pre-processing fMRI data

Conventionally, data are pre-processed in the following ways:1. Slice-by-slice acquisitions are time-shifted to account for

different slice timings.2. Head motion is estimated and used to register volumes to

the first/middle volume of the time series.3. Time series can be realigned to a separate reference

volume for visualization purposes.4. Volumes are normalized to a fixed coordinate system (e.g.,

Tailarach) in group studies.5. Data can be smoothed/blurred using a Gaussian kernel to

reduce noise, cross-subject variance.Our single-subject simulations require only step #2.

CSP Seminar – Fall 2013 13

Page 46: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Outline

Magnetic Resonance Imaging

Functional MRI

Head Motion in fMRI

Proposed Method for Prospective Correction

Real Time Implementation

Simulation Results

Conclusions and Future Work

Summary

CSP Seminar – Fall 2013 14

Page 47: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Head motion in fMRI

• Head motion causes several problems in brain imaging:• Misaligned time series have inconsistent brain coordinates.• Motion distorts the main field and alters the dephasing rate.• Nonuniform excitation from inter-slice motion introduces

“spin history” effects.

Simulated brain with motion.

1 J Maclaren et al., Mag. Res. Med., 69(3), 2013.

CSP Seminar – Fall 2013 15

Page 48: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Head motion in fMRI

• Head motion causes several problems in brain imaging:• Misaligned time series have inconsistent brain coordinates.• Motion distorts the main field and alters the dephasing rate.• Nonuniform excitation from inter-slice motion introduces

“spin history” effects.

Simulated brain with motion.

1 J Maclaren et al., Mag. Res. Med., 69(3), 2013.

CSP Seminar – Fall 2013 15

Page 49: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Head motion in fMRI

• Head motion causes several problems in brain imaging:• Misaligned time series have inconsistent brain coordinates.• Motion distorts the main field and alters the dephasing rate.• Nonuniform excitation from inter-slice motion introduces

“spin history” effects.

Figure 9 in 1

URL: http://dx.doi.org/10.1002/mrm.24314

Head motion causes field map distortions1.

1 J Maclaren et al., Mag. Res. Med., 69(3), 2013.

CSP Seminar – Fall 2013 15

Page 50: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Head motion in fMRI

• Head motion causes several problems in brain imaging:• Misaligned time series have inconsistent brain coordinates.• Motion distorts the main field and alters the dephasing rate.• Nonuniform excitation from inter-slice motion introduces

“spin history” effects.

Slice selection without (left) and with (right) motion.

1 J Maclaren et al., Mag. Res. Med., 69(3), 2013.

CSP Seminar – Fall 2013 15

Page 51: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Head motion correction

Retrospective image registration/interpolation.

• Retrospective correction (post-scan):• registration: spatial interpolation of reconstructed images• motion estimates as nuisance regressors in the GLM

• Prospective correction (during the scan):• slice prescription, k-space trajectory adjusted between

frames or slices• corrupted data re-scanned (rare in fMRI)

CSP Seminar – Fall 2013 16

Page 52: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Head motion correction

Y =[G 1

]β +

−α0−...

−αNF−1−

βmotion + ε.

Nuisance regressors in the GLM.

• Retrospective correction (post-scan):• registration: spatial interpolation of reconstructed images• motion estimates as nuisance regressors in the GLM

• Prospective correction (during the scan):• slice prescription, k-space trajectory adjusted between

frames or slices• corrupted data re-scanned (rare in fMRI)

CSP Seminar – Fall 2013 16

Page 53: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Head motion correction

Frame t Frame t+1

Gradients, slice prescriptions adjusted.

• Retrospective correction (post-scan):• registration: spatial interpolation of reconstructed images• motion estimates as nuisance regressors in the GLM

• Prospective correction (during the scan):• slice prescription, k-space trajectory adjusted between

frames or slices• corrupted data re-scanned (rare in fMRI)

CSP Seminar – Fall 2013 16

Page 54: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Head motion correction

Gx

Gz

Gx

Gz

Frame t Frame t+1

Gradients, slice prescriptions adjusted.

• Retrospective correction (post-scan):• registration: spatial interpolation of reconstructed images• motion estimates as nuisance regressors in the GLM

• Prospective correction (during the scan):• slice prescription, k-space trajectory adjusted between

frames or slices• corrupted data re-scanned (rare in fMRI)

CSP Seminar – Fall 2013 16

Page 55: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Prospective correction methods

• Retrospective methods are suboptimal.• registration: interpolation smears activations across voxels• regression: activations mistaken for task-correlated motion

• Prospective motion estimation methods include:• external tracking: markers, cameras, etc.• navigational techniques using MRI data

Figure 2b in 1

URL: http://dx.doi.org/10.1002/mrm.24314

Methods for prospective motion estimation1.1 J Maclaren et al., Mag. Res. Med., 69(3), 2013.

CSP Seminar – Fall 2013 17

Page 56: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Prospective correction methods

• Retrospective methods are suboptimal.• registration: interpolation smears activations across voxels• regression: activations mistaken for task-correlated motion

• Prospective motion estimation methods include:• external tracking: markers, cameras, etc.• navigational techniques using MRI data

Figure 2b in 1

URL: http://dx.doi.org/10.1002/mrm.24314

Methods for prospective motion estimation1.1 J Maclaren et al., Mag. Res. Med., 69(3), 2013.

CSP Seminar – Fall 2013 17

Page 57: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Prospective correction methods

• Retrospective methods are suboptimal.• registration: interpolation smears activations across voxels• regression: activations mistaken for task-correlated motion

• Prospective motion estimation methods include:• external tracking: markers, cameras, etc.• navigational techniques using MRI data

Figure 2b in 1

URL: http://dx.doi.org/10.1002/mrm.24314

Methods for prospective motion estimation1.1 J Maclaren et al., Mag. Res. Med., 69(3), 2013.

CSP Seminar – Fall 2013 17

Page 58: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Navigation

• Image-based navigators align the MR time series images.• Fast k-space navigators have static contrast, versus

time-varying BOLD contrast found in fMRI data.• With multi-channel receivers, relative intensity changes in

received signals (called FID signals) can signify motion.

Figure 2a in 1

URL: http://dx.doi.org/10.1002/mrm.24314

K-space, image-space, and FID navigator methods1.1 J Maclaren et al., Mag. Res. Med., 69(3), 2013.

CSP Seminar – Fall 2013 18

Page 59: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Navigation

• Image-based navigators align the MR time series images.• Fast k-space navigators have static contrast, versus

time-varying BOLD contrast found in fMRI data.• With multi-channel receivers, relative intensity changes in

received signals (called FID signals) can signify motion.

Figure 2a in 1

URL: http://dx.doi.org/10.1002/mrm.24314

K-space, image-space, and FID navigator methods1.1 J Maclaren et al., Mag. Res. Med., 69(3), 2013.

CSP Seminar – Fall 2013 18

Page 60: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Navigation

• Image-based navigators align the MR time series images.• Fast k-space navigators have static contrast, versus

time-varying BOLD contrast found in fMRI data.• With multi-channel receivers, relative intensity changes in

received signals (called FID signals) can signify motion.

Figure 2a in 1

URL: http://dx.doi.org/10.1002/mrm.24314

K-space, image-space, and FID navigator methods1.1 J Maclaren et al., Mag. Res. Med., 69(3), 2013.

CSP Seminar – Fall 2013 18

Page 61: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Outline

Magnetic Resonance Imaging

Functional MRI

Head Motion in fMRI

Proposed Method for Prospective Correction

Real Time Implementation

Simulation Results

Conclusions and Future Work

Summary

CSP Seminar – Fall 2013 19

Page 62: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Related work

• Image-space navigators were used with a linear motionmodel1.

• Two-dimensional k-space navigators were used with anextended Kalman filter2.

• Sparse residual models were employed in retrospectivejoint reconstruction/registration methods3,4.

• I propose using image-space navigators and combining asparse residual model with Kalman-like filtering5.

1 S Thesen et al., Mag. Res. Med., 44(3), 2000.

2 N White et al., Mag. Res. Med., 63(1), 2010.3 H Jung et al., Mag. Res. Med., 61(1), 2009.4 MS Asif et al., Mag. Res. Med., in press.5 DSW et al., Proc. SPIE Wavelets and Sparsity XV, in press.

CSP Seminar – Fall 2013 20

Page 63: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Related work

• Image-space navigators were used with a linear motionmodel1.

• Two-dimensional k-space navigators were used with anextended Kalman filter2.

• Sparse residual models were employed in retrospectivejoint reconstruction/registration methods3,4.

• I propose using image-space navigators and combining asparse residual model with Kalman-like filtering5.

1 S Thesen et al., Mag. Res. Med., 44(3), 2000.2 N White et al., Mag. Res. Med., 63(1), 2010.

3 H Jung et al., Mag. Res. Med., 61(1), 2009.4 MS Asif et al., Mag. Res. Med., in press.5 DSW et al., Proc. SPIE Wavelets and Sparsity XV, in press.

CSP Seminar – Fall 2013 20

Page 64: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Related work

• Image-space navigators were used with a linear motionmodel1.

• Two-dimensional k-space navigators were used with anextended Kalman filter2.

• Sparse residual models were employed in retrospectivejoint reconstruction/registration methods3,4.

• I propose using image-space navigators and combining asparse residual model with Kalman-like filtering5.

1 S Thesen et al., Mag. Res. Med., 44(3), 2000.2 N White et al., Mag. Res. Med., 63(1), 2010.3 H Jung et al., Mag. Res. Med., 61(1), 2009.4 MS Asif et al., Mag. Res. Med., in press.

5 DSW et al., Proc. SPIE Wavelets and Sparsity XV, in press.

CSP Seminar – Fall 2013 20

Page 65: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Related work

• Image-space navigators were used with a linear motionmodel1.

• Two-dimensional k-space navigators were used with anextended Kalman filter2.

• Sparse residual models were employed in retrospectivejoint reconstruction/registration methods3,4.

• I propose using image-space navigators and combining asparse residual model with Kalman-like filtering5.

1 S Thesen et al., Mag. Res. Med., 44(3), 2000.2 N White et al., Mag. Res. Med., 63(1), 2010.3 H Jung et al., Mag. Res. Med., 61(1), 2009.4 MS Asif et al., Mag. Res. Med., in press.5 DSW et al., Proc. SPIE Wavelets and Sparsity XV, in press.

CSP Seminar – Fall 2013 20

Page 66: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Coordinate systems

Consider images xt|t=0,...,NF−1 in 3 coordinate systems:1. xt0 has the same physical coordinate system for all t.

• true motion αt: rigid head motion from frame 0 to t

2. xtreg = T ((αt)(−1))xt0 is registered to x0 with estimate αt.

• α(−1) is the inverse motion of α• T (αn, . . . ,α1)x transforms x by motions α1, . . . ,αn

3. Measure xtmeas = T ((αt−1)(−1))xt0 prospectively correctedusing the previous frame’s motion.

t = 0 Fixed Registered Measured

t = 1

t = 2

CSP Seminar – Fall 2013 21

Page 67: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Coordinate systems

Consider images xt|t=0,...,NF−1 in 3 coordinate systems:1. xt0 has the same physical coordinate system for all t.

• true motion αt: rigid head motion from frame 0 to t

2. xtreg = T ((αt)(−1))xt0 is registered to x0 with estimate αt.

• α(−1) is the inverse motion of α• T (αn, . . . ,α1)x transforms x by motions α1, . . . ,αn

3. Measure xtmeas = T ((αt−1)(−1))xt0 prospectively correctedusing the previous frame’s motion.

t = 0 Fixed Registered Measured

t = 1

t = 2

CSP Seminar – Fall 2013 21

Page 68: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Coordinate systems

Consider images xt|t=0,...,NF−1 in 3 coordinate systems:1. xt0 has the same physical coordinate system for all t.

• true motion αt: rigid head motion from frame 0 to t

2. xtreg = T ((αt)(−1))xt0 is registered to x0 with estimate αt.• α(−1) is the inverse motion of α• T (αn, . . . ,α1)x transforms x by motions α1, . . . ,αn

3. Measure xtmeas = T ((αt−1)(−1))xt0 prospectively correctedusing the previous frame’s motion.

t = 0 Fixed Registered Measured

t = 1

t = 2

CSP Seminar – Fall 2013 21

Page 69: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Coordinate systems

Consider images xt|t=0,...,NF−1 in 3 coordinate systems:1. xt0 has the same physical coordinate system for all t.

• true motion αt: rigid head motion from frame 0 to t

2. xtreg = T ((αt)(−1))xt0 is registered to x0 with estimate αt.• α(−1) is the inverse motion of α• T (αn, . . . ,α1)x transforms x by motions α1, . . . ,αn

3. Measure xtmeas = T ((αt−1)(−1))xt0 prospectively correctedusing the previous frame’s motion.

t = 0 Fixed Registered Measured

t = 1

t = 2

CSP Seminar – Fall 2013 21

Page 70: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Measurement model

• Sample k-space in measurement coordinates:dt = Fxtmeas + nt,

where F is the Discrete Fourier Transform (DFT), andnt is iid zero-mean complex Gaussian

with variance σ2.• To estimate αt, relate xtmeas to registered coordinates:

dt = F T ((αt−1)(−1),αt)xtreg + nt.

• Define the residual image st in measurement coordinates:

st = xtmeas − T ((αt−1)(−1),αt)xt−1reg .

• Model st as sparse, which is equivalent to using the SADregistration cost function:

C(α) = ‖xtmeas − T ((αt−1)(−1),α)xt−1reg ‖1.

CSP Seminar – Fall 2013 22

Page 71: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Measurement model

• Sample k-space in measurement coordinates:dt = Fxtmeas + nt,

where F is the Discrete Fourier Transform (DFT), andnt is iid zero-mean complex Gaussian

with variance σ2.• To estimate αt, relate xtmeas to registered coordinates:

dt = F T ((αt−1)(−1),αt)xtreg + nt.

• Define the residual image st in measurement coordinates:

st = xtmeas − T ((αt−1)(−1),αt)xt−1reg .

• Model st as sparse, which is equivalent to using the SADregistration cost function:

C(α) = ‖xtmeas − T ((αt−1)(−1),α)xt−1reg ‖1.

CSP Seminar – Fall 2013 22

Page 72: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Measurement model

• Sample k-space in measurement coordinates:dt = Fxtmeas + nt,

where F is the Discrete Fourier Transform (DFT), andnt is iid zero-mean complex Gaussian

with variance σ2.• To estimate αt, relate xtmeas to registered coordinates:

dt = F T ((αt−1)(−1),αt)xtreg + nt.

• Define the residual image st in measurement coordinates:st = xtmeas − T ((αt−1)(−1),αt)xt−1reg .

• Model st as sparse, which is equivalent to using the SADregistration cost function:

C(α) = ‖xtmeas − T ((αt−1)(−1),α)xt−1reg ‖1.

CSP Seminar – Fall 2013 22

Page 73: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Measurement model

• Sample k-space in measurement coordinates:dt = Fxtmeas + nt,

where F is the Discrete Fourier Transform (DFT), andnt is iid zero-mean complex Gaussian

with variance σ2.• To estimate αt, relate xtmeas to registered coordinates:

dt = F T ((αt−1)(−1),αt)xtreg + nt.

• Define the residual image st in measurement coordinates:st = xtmeas − T ((αt−1)(−1),αt)xt−1reg .

• Model st as sparse, which is equivalent to using the SADregistration cost function:

C(α) = ‖xtmeas − T ((αt−1)(−1),α)xt−1reg ‖1.

CSP Seminar – Fall 2013 22

Page 74: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Kalman-like motion filtering

• To enforce smoothness, we model motion {αt} as afirst-order random walk:

αt = αt−1 + at,

where innovations at are iid (over time) Normal(0,Q).• Subtracting the sparse residual image component of the

data yield Kalman filter-like measurements of the motion:

dt −Fst = F T ((αt−1)(−1),αt)xt−1reg + nt.

• Knowing st yields an extended Kalman filter:

αt = arg minα

12σ2 ‖F T ((αt−1)(−1),α)xt−1reg − (dt −Fst)‖22

+ 12‖α− α

t−1‖2(P

t|t−1α )−1

,

where P t|t−1α is the filter’s prediction error covariance.

CSP Seminar – Fall 2013 23

Page 75: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Kalman-like motion filtering

• To enforce smoothness, we model motion {αt} as afirst-order random walk:

αt = αt−1 + at,

where innovations at are iid (over time) Normal(0,Q).• Subtracting the sparse residual image component of the

data yield Kalman filter-like measurements of the motion:dt −Fst = F T ((αt−1)(−1),αt)xt−1reg + nt.

• Knowing st yields an extended Kalman filter:

αt = arg minα

12σ2 ‖F T ((αt−1)(−1),α)xt−1reg − (dt −Fst)‖22

+ 12‖α− α

t−1‖2(P

t|t−1α )−1

,

where P t|t−1α is the filter’s prediction error covariance.

CSP Seminar – Fall 2013 23

Page 76: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Kalman-like motion filtering

• To enforce smoothness, we model motion {αt} as afirst-order random walk:

αt = αt−1 + at,

where innovations at are iid (over time) Normal(0,Q).• Subtracting the sparse residual image component of the

data yield Kalman filter-like measurements of the motion:dt −Fst = F T ((αt−1)(−1),αt)xt−1reg + nt.

• Knowing st yields an extended Kalman filter:

αt = arg minα

12σ2 ‖F T ((αt−1)(−1),α)xt−1reg − (dt −Fst)‖22

+ 12‖α− α

t−1‖2(P

t|t−1α )−1

,

where P t|t−1α is the filter’s prediction error covariance.

CSP Seminar – Fall 2013 23

Page 77: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Joint registration and reconstruction

Jointly minimize f(xtmeas,αt) to estimate motion αt:

f(xtmeas,αt) = 1

2σ2 ‖Fxtmeas − dt‖22+ λ‖xtmeas − T ((αt−1)(−1),αt)xt−1reg ‖1+ 1

2‖αt − αt−1‖2

(Pt|t−1α )−1

The objective function has three parts:

1. the data fidelity term,• equivalent to 1

2σ2 ‖xtmeas −F−1dt‖22 (with unitary DFT);

2. the registration cost function, which also regularizes xtmeas;3. the Kalman consistency term, promoting smoothness.

CSP Seminar – Fall 2013 24

Page 78: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Joint registration and reconstruction

Jointly minimize f(xtmeas,αt) to estimate motion αt:

f(xtmeas,αt) = 1

2σ2 ‖Fxtmeas − dt‖22+ λ‖xtmeas − T ((αt−1)(−1),αt)xt−1reg ‖1+ 1

2‖αt − αt−1‖2

(Pt|t−1α )−1

The objective function has three parts:1. the data fidelity term,

• equivalent to 12σ2 ‖xtmeas −F−1dt‖22 (with unitary DFT);

2. the registration cost function, which also regularizes xtmeas;3. the Kalman consistency term, promoting smoothness.

CSP Seminar – Fall 2013 24

Page 79: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Joint registration and reconstruction

Jointly minimize f(xtmeas,αt) to estimate motion αt:

f(xtmeas,αt) = 1

2σ2 ‖Fxtmeas − dt‖22+ λ‖xtmeas − T ((αt−1)(−1),αt)xt−1reg ‖1+ 1

2‖αt − αt−1‖2

(Pt|t−1α )−1

The objective function has three parts:1. the data fidelity term,

• equivalent to 12σ2 ‖xtmeas −F−1dt‖22 (with unitary DFT);

2. the registration cost function, which also regularizes xtmeas;

3. the Kalman consistency term, promoting smoothness.

CSP Seminar – Fall 2013 24

Page 80: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Joint registration and reconstruction

Jointly minimize f(xtmeas,αt) to estimate motion αt:

f(xtmeas,αt) = 1

2σ2 ‖Fxtmeas − dt‖22+ λ‖xtmeas − T ((αt−1)(−1),αt)xt−1reg ‖1+ 1

2‖αt − αt−1‖2

(Pt|t−1α )−1

The objective function has three parts:1. the data fidelity term,

• equivalent to 12σ2 ‖xtmeas −F−1dt‖22 (with unitary DFT);

2. the registration cost function, which also regularizes xtmeas;3. the Kalman consistency term, promoting smoothness.

CSP Seminar – Fall 2013 24

Page 81: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Outline

Magnetic Resonance Imaging

Functional MRI

Head Motion in fMRI

Proposed Method for Prospective Correction

Real Time Implementation

Simulation Results

Conclusions and Future Work

Summary

CSP Seminar – Fall 2013 25

Page 82: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Variable splitting

• The residual image is a natural split variable:st = xtmeas − T (xt−1reg ; (αt−1)(−1),αt).

• The augmented Lagrangian has scaled dual u, penalty µ:

AL(xtmeas,αt, st;u) = 1

2σ2 ‖xtmeas −F−1dt‖22 + λ‖st‖1+ µ

2‖xtmeas − T ((αt−1)(−1),αt)xt−1reg − st + u‖22

+ 12‖α

t − αt−1‖2(P

t|t−1α )−1

.

• The choice of penalty µ > 0 controls the overallconvergence rate, by trading off minimizing the objectivefunction and satisfying the variable-split constraint.

CSP Seminar – Fall 2013 26

Page 83: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Variable splitting

• The residual image is a natural split variable:st = xtmeas − T (xt−1reg ; (αt−1)(−1),αt).

• The augmented Lagrangian has scaled dual u, penalty µ:

AL(xtmeas,αt, st;u) = 1

2σ2 ‖xtmeas −F−1dt‖22 + λ‖st‖1+ µ

2‖xtmeas − T ((αt−1)(−1),αt)xt−1reg − st + u‖22

+ 12‖α

t − αt−1‖2(P

t|t−1α )−1

.

• The choice of penalty µ > 0 controls the overallconvergence rate, by trading off minimizing the objectivefunction and satisfying the variable-split constraint.

CSP Seminar – Fall 2013 26

Page 84: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Linearizing the motion transform

• The transform T ((αt−1)(−1),αt) is nonlinear andnonconvex in αt.

• Assuming smooth motion, αt is close to αt−1, soinitializing with αt−1 likely yields a global minimum.

• Linearize the transform T ((αt−1)(−1),αt) aroundαt = αt−1, and define at = αt − αt−1:

T ((αt−1)(−1),αt)xt−1reg ≈ xt−1reg + JT at,

where JT is the Jacobian matrix of T ((αt−1)(−1),αt)xt−1reg

evaluated at αt = αt−1.

• The resulting approximation to the augmented Lagrangianis convex.

CSP Seminar – Fall 2013 27

Page 85: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Linearizing the motion transform

• The transform T ((αt−1)(−1),αt) is nonlinear andnonconvex in αt.

• Assuming smooth motion, αt is close to αt−1, soinitializing with αt−1 likely yields a global minimum.

• Linearize the transform T ((αt−1)(−1),αt) aroundαt = αt−1, and define at = αt − αt−1:

T ((αt−1)(−1),αt)xt−1reg ≈ xt−1reg + JT at,

where JT is the Jacobian matrix of T ((αt−1)(−1),αt)xt−1reg

evaluated at αt = αt−1.

• The resulting approximation to the augmented Lagrangianis convex.

CSP Seminar – Fall 2013 27

Page 86: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Linearizing the motion transform

• The transform T ((αt−1)(−1),αt) is nonlinear andnonconvex in αt.

• Assuming smooth motion, αt is close to αt−1, soinitializing with αt−1 likely yields a global minimum.

• Linearize the transform T ((αt−1)(−1),αt) aroundαt = αt−1, and define at = αt − αt−1:

T ((αt−1)(−1),αt)xt−1reg ≈ xt−1reg + JT at,

where JT is the Jacobian matrix of T ((αt−1)(−1),αt)xt−1reg

evaluated at αt = αt−1.• The resulting approximation to the augmented Lagrangian

is convex.

CSP Seminar – Fall 2013 27

Page 87: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Linearizing the motion transform

• The transform T ((αt−1)(−1),αt) is nonlinear andnonconvex in αt.

• Assuming smooth motion, αt is close to αt−1, soinitializing with αt−1 likely yields a global minimum.

• Linearize the transform T ((αt−1)(−1),αt) aroundαt = αt−1, and define at = αt − αt−1:

T ((αt−1)(−1),αt)xt−1reg ≈ xt−1reg + JT at,

where JT is the Jacobian matrix of T ((αt−1)(−1),αt)xt−1reg

evaluated at αt = αt−1.• The resulting approximation to the augmented Lagrangian

is convex.

CSP Seminar – Fall 2013 27

Page 88: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Alternating minimization

Use alternating directions method of multipliers (ADMM)1,2.Each iteration consists of three steps:

1. Update xtmeas, at together (least-squares problem):

{xtmeas, at} ← arg min

x,a

12σ2 ‖x−F−1dt‖22 + 1

2‖a‖2

(Pt|t−1α )−1

+ µ2‖x− JT a− (xt−1reg + st − u)‖22.

2. Update st using shrinkage:

st ← arg mins

λ‖s‖1 + µ2‖s− (xtmeas − JT a

t − xt−1reg + u)‖22.

3. Update scaled dual variable:

u← u+ (xtmeas − JT at − xt−1reg − st).

1 R Glowinski and A Marrocco, Inf. Rech. Oper., R-2, 1975.2 D Gabay and B Mercier, Comput. Math. Appl., 2(1), 1976.

CSP Seminar – Fall 2013 28

Page 89: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Alternating minimization

Use alternating directions method of multipliers (ADMM)1,2.Each iteration consists of three steps:

1. Update xtmeas, at together (least-squares problem):

{xtmeas, at} ← arg min

x,a

12σ2 ‖x−F−1dt‖22 + 1

2‖a‖2

(Pt|t−1α )−1

+ µ2‖x− JT a− (xt−1reg + st − u)‖22.

2. Update st using shrinkage:st ← arg min

sλ‖s‖1 + µ

2‖s− (xtmeas − JT at − xt−1reg + u)‖22.

3. Update scaled dual variable:

u← u+ (xtmeas − JT at − xt−1reg − st).

1 R Glowinski and A Marrocco, Inf. Rech. Oper., R-2, 1975.2 D Gabay and B Mercier, Comput. Math. Appl., 2(1), 1976.

CSP Seminar – Fall 2013 28

Page 90: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Alternating minimization

Use alternating directions method of multipliers (ADMM)1,2.Each iteration consists of three steps:

1. Update xtmeas, at together (least-squares problem):

{xtmeas, at} ← arg min

x,a

12σ2 ‖x−F−1dt‖22 + 1

2‖a‖2

(Pt|t−1α )−1

+ µ2‖x− JT a− (xt−1reg + st − u)‖22.

2. Update st using shrinkage:st ← arg min

sλ‖s‖1 + µ

2‖s− (xtmeas − JT at − xt−1reg + u)‖22.

3. Update scaled dual variable:u← u+ (xtmeas − JT a

t − xt−1reg − st).

1 R Glowinski and A Marrocco, Inf. Rech. Oper., R-2, 1975.2 D Gabay and B Mercier, Comput. Math. Appl., 2(1), 1976.

CSP Seminar – Fall 2013 28

Page 91: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Outline

Magnetic Resonance Imaging

Functional MRI

Head Motion in fMRI

Proposed Method for Prospective Correction

Real Time Implementation

Simulation Results

Conclusions and Future Work

Summary

CSP Seminar – Fall 2013 29

Page 92: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Experimental design

• T ∗2 -weighted Brainweb1 phantom (1× 1× 3 mm resolution)• Simulated activations, head motion on high-resolution

phantom for 200 frames (TR = 1 s)• Sampled k-space for 16 + 4 slices at 4× 4× 3 mm

resolution (64× 64 samples/slice) with 40 dB SNR

16 + 4 high-resolution slices1 RKS Kwan et al., IEEE Trans. Med. Imag., 18(11), 1999.

CSP Seminar – Fall 2013 30

Page 93: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Experimental design

• T ∗2 -weighted Brainweb1 phantom (1× 1× 3 mm resolution)• Simulated activations, head motion on high-resolution

phantom for 200 frames (TR = 1 s)• Sampled k-space for 16 + 4 slices at 4× 4× 3 mm

resolution (64× 64 samples/slice) with 40 dB SNR

High-resolution slices + activations (red)1 RKS Kwan et al., IEEE Trans. Med. Imag., 18(11), 1999.

CSP Seminar – Fall 2013 30

Page 94: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Experimental design

• T ∗2 -weighted Brainweb1 phantom (1× 1× 3 mm resolution)• Simulated activations, head motion on high-resolution

phantom for 200 frames (TR = 1 s)• Sampled k-space for 16 + 4 slices at 4× 4× 3 mm

resolution (64× 64 samples/slice) with 40 dB SNR

High-resolution slices + motion1 RKS Kwan et al., IEEE Trans. Med. Imag., 18(11), 1999.

CSP Seminar – Fall 2013 30

Page 95: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Experimental design

• T ∗2 -weighted Brainweb1 phantom (1× 1× 3 mm resolution)• Simulated activations, head motion on high-resolution

phantom for 200 frames (TR = 1 s)• Sampled k-space for 16 + 4 slices at 4× 4× 3 mm

resolution (64× 64 samples/slice) with 40 dB SNR

4× 4× 3 mm slices + motion1 RKS Kwan et al., IEEE Trans. Med. Imag., 18(11), 1999.

CSP Seminar – Fall 2013 30

Page 96: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Simulated motion

• Rigid-body motion is described using six parameters:1. ∆x: right-to-left translation (mm)2. ∆y: anterior-to-posterior translation (mm)3. ∆z: superior-to-inferior translation (mm)4. α: axial (xy-)plane rotation (degrees)5. β: coronal (xz-)plane rotation (degrees)6. γ: sagittal (yz-)plane rotation (degrees)

0 20 40 60 80 100 120 140 160 180 200−3

−2

−1

0

1

2

3

Time (s)

Motion P

ara

mete

r

x

∆y

∆z

α

β

γ

Simulated rigid-body motion

CSP Seminar – Fall 2013 31

Page 97: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Prospective motion correction

0 50 100 150 200−1.2

−1

−0.8

−0.6

−0.4

−0.2

0

0.2

0.4

Time (s)

Mo

tio

n P

ara

me

ter

∆x

∆y

∆z

α

β

γ

Residual motion after prospective correction

• Residual motion is substantially reduced:Uncorrected: tx = 1.6± 0.53 mm, rot = 1.4± 0.68 deg.

Residual: tx = 0.25± 0.10 mm, rot = 0.45± 0.11 deg.• Retrospective registration can mitigate this residual motion.

CSP Seminar – Fall 2013 32

Page 98: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Prospective motion correction

0 50 100 150 200−1.2

−1

−0.8

−0.6

−0.4

−0.2

0

0.2

0.4

Time (s)

Mo

tio

n P

ara

me

ter

∆x

∆y

∆z

α

β

γ

Residual motion after prospective correction

• Residual motion is substantially reduced:Uncorrected: tx = 1.6± 0.53 mm, rot = 1.4± 0.68 deg.

Residual: tx = 0.25± 0.10 mm, rot = 0.45± 0.11 deg.• Retrospective registration can mitigate this residual motion.

CSP Seminar – Fall 2013 32

Page 99: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Time-series correlation maps – no correction

0

0.2

0.4

0.6

0.8

1

0

0.2

0.4

0.6

0.8

1

Correlation Map Differences (10×)

CSP Seminar – Fall 2013 33

Page 100: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Time-series correlation maps – retrospective

0

0.2

0.4

0.6

0.8

1

0

0.2

0.4

0.6

0.8

1

Correlation Map Differences (10×)

CSP Seminar – Fall 2013 34

Page 101: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Time-series correlation maps – prospective

0

0.2

0.4

0.6

0.8

1

0

0.2

0.4

0.6

0.8

1

Correlation Map Differences (10×)

CSP Seminar – Fall 2013 35

Page 102: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Time-series correlation maps – both corrections

0

0.2

0.4

0.6

0.8

1

0

0.2

0.4

0.6

0.8

1

Correlation Map Differences (10×)

CSP Seminar – Fall 2013 36

Page 103: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Performance analysis of activation maps

0 0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 0.20.8

0.85

0.9

0.95

1

False alarm rate (1 − specificity)

Se

nsitiv

ity r

ate

Prospective + Retrospective (SPM8)

Prospective only

Retrospective (SPM8) only

No correction

Receiver operating characteristic (ROC) curves for correlation analysis

• Prospective correction improves sensitivity and specificity• Spatial interpolation may be responsible for reduced

sensitivity with just retrospective correction

CSP Seminar – Fall 2013 37

Page 104: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Performance analysis of activation maps

0 0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 0.20.8

0.85

0.9

0.95

1

False alarm rate (1 − specificity)

Se

nsitiv

ity r

ate

Prospective + Retrospective (SPM8)

Prospective only

Retrospective (SPM8) only

No correction

Receiver operating characteristic (ROC) curves for correlation analysis

• Prospective correction improves sensitivity and specificity• Spatial interpolation may be responsible for reduced

sensitivity with just retrospective correction

CSP Seminar – Fall 2013 37

Page 105: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Simulation with unknown parameters

• Estimate σ2 using sample variance of noise-only data.• Calibrate for 2-D EPI Nyquist ghost correction1:

• use 2-D reference scans (forwards & backwards)• transform linear terms for prospective correction

• Estimate the innovation covariance Q:

• initialize to a large value• update the sample covariance using estimated a’s• since Q is time-varying, update using just last ten frames

1 N Chen and AM Wyrwicz, Mag. Res. Med., 51(6), 2004.

CSP Seminar – Fall 2013 38

Page 106: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Simulation with unknown parameters

• Estimate σ2 using sample variance of noise-only data.• Calibrate for 2-D EPI Nyquist ghost correction1:

• use 2-D reference scans (forwards & backwards)• transform linear terms for prospective correction

• Estimate the innovation covariance Q:

• initialize to a large value• update the sample covariance using estimated a’s• since Q is time-varying, update using just last ten frames

1 N Chen and AM Wyrwicz, Mag. Res. Med., 51(6), 2004.

CSP Seminar – Fall 2013 38

Page 107: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Simulation with unknown parameters

• Estimate σ2 using sample variance of noise-only data.• Calibrate for 2-D EPI Nyquist ghost correction1:

• use 2-D reference scans (forwards & backwards)• transform linear terms for prospective correction

• Estimate the innovation covariance Q:• initialize to a large value• update the sample covariance using estimated a’s• since Q is time-varying, update using just last ten frames

1 N Chen and AM Wyrwicz, Mag. Res. Med., 51(6), 2004.

CSP Seminar – Fall 2013 38

Page 108: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Simulation with unknown parameters

0 50 100 150 200

−1

−0.5

0

0.5

Time (s)

Mo

tio

n P

ara

me

ter

x

∆y

∆z

α

β

γ

Residual motion after prospective correction

• Residual motion is nearly the same as before:Uncorrected: tx = 1.6± 0.53 mm, rot = 1.4± 0.68 deg.

Residual: tx = 0.28± 0.11 mm, rot = 0.47± 0.26 deg.• Prospective correction remains effective at improving

sensitivity, specificity.

CSP Seminar – Fall 2013 39

Page 109: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Simulation with unknown parameters

0 0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 0.20.8

0.85

0.9

0.95

1

False alarm rate (1 − specificity)

Se

nsitiv

ity r

ate

Prospective + Retrospective (SPM8)

Prospective only

Retrospective (SPM8) only

No correction

Receiver operating characteristic (ROC) curves for correlation analysis

• Residual motion is nearly the same as before:Uncorrected: tx = 1.6± 0.53 mm, rot = 1.4± 0.68 deg.

Residual: tx = 0.28± 0.11 mm, rot = 0.47± 0.26 deg.• Prospective correction remains effective at improving

sensitivity, specificity.

CSP Seminar – Fall 2013 39

Page 110: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Correcting for impulsive motion

• Impulsive motion is significant over a short duration.• I generated 1 s impulses of ±1.5 mm/degrees per second

occurring every 100 s, on average.• The residual motion effects are mainly short-lived.• The improvement in sensitivity of prospective correction

remains significant.

0 50 100 150 200−5

−4

−3

−2

−1

0

1

2

3

Time (s)

Mo

tio

n P

ara

me

ter

∆x

∆y

∆z

α

β

γ

True motion including simulated impulses

CSP Seminar – Fall 2013 40

Page 111: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Correcting for impulsive motion

• Impulsive motion is significant over a short duration.• I generated 1 s impulses of ±1.5 mm/degrees per second

occurring every 100 s, on average.• The residual motion effects are mainly short-lived.• The improvement in sensitivity of prospective correction

remains significant.

0 20 40 60 80 100 120 140 160 180 200

−2

−1

0

1

2

Time (s)

Mo

tio

n P

ara

me

ter

x

∆y

∆z

α

β

γ

Residual motion after prospective correction

CSP Seminar – Fall 2013 40

Page 112: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Correcting for impulsive motion

• Impulsive motion is significant over a short duration.• I generated 1 s impulses of ±1.5 mm/degrees per second

occurring every 100 s, on average.• The residual motion effects are mainly short-lived.• The improvement in sensitivity of prospective correction

remains significant.

0 0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 0.20.8

0.85

0.9

0.95

1

False alarm rate (1 − specificity)

Se

nsitiv

ity r

ate

Prospective + Retrospective (SPM8)

Prospective only

Retrospective (SPM8) only

No correction

Receiver operating characteristic (ROC) curves for correlation analysis

CSP Seminar – Fall 2013 40

Page 113: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Outline

Magnetic Resonance Imaging

Functional MRI

Head Motion in fMRI

Proposed Method for Prospective Correction

Real Time Implementation

Simulation Results

Conclusions and Future Work

Summary

CSP Seminar – Fall 2013 41

Page 114: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Conclusions

• The residual motion is much smaller than absolute motion.• Correlation maps show fewer errors and

mis-classifications.• The proposed method is more statistically robust than

standard retrospective registration.• The algorithm remains effective when noise/innovation

statistics are unknown or impulsive motion is added.• Limitations include:

• motion assumed constant over a TR• ignored other time-varying effects such as scanner (B0)

drift, susceptibility variations, and physiological signals

CSP Seminar – Fall 2013 42

Page 115: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Conclusions

• The residual motion is much smaller than absolute motion.• Correlation maps show fewer errors and

mis-classifications.• The proposed method is more statistically robust than

standard retrospective registration.• The algorithm remains effective when noise/innovation

statistics are unknown or impulsive motion is added.• Limitations include:

• motion assumed constant over a TR• ignored other time-varying effects such as scanner (B0)

drift, susceptibility variations, and physiological signals

CSP Seminar – Fall 2013 42

Page 116: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Conclusions

• The residual motion is much smaller than absolute motion.• Correlation maps show fewer errors and

mis-classifications.• The proposed method is more statistically robust than

standard retrospective registration.• The algorithm remains effective when noise/innovation

statistics are unknown or impulsive motion is added.• Limitations include:

• motion assumed constant over a TR• ignored other time-varying effects such as scanner (B0)

drift, susceptibility variations, and physiological signals

CSP Seminar – Fall 2013 42

Page 117: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Conclusions

• The residual motion is much smaller than absolute motion.• Correlation maps show fewer errors and

mis-classifications.• The proposed method is more statistically robust than

standard retrospective registration.• The algorithm remains effective when noise/innovation

statistics are unknown or impulsive motion is added.• Limitations include:

• motion assumed constant over a TR• ignored other time-varying effects such as scanner (B0)

drift, susceptibility variations, and physiological signals

CSP Seminar – Fall 2013 42

Page 118: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Conclusions

• The residual motion is much smaller than absolute motion.• Correlation maps show fewer errors and

mis-classifications.• The proposed method is more statistically robust than

standard retrospective registration.• The algorithm remains effective when noise/innovation

statistics are unknown or impulsive motion is added.• Limitations include:

• motion assumed constant over a TR• ignored other time-varying effects such as scanner (B0)

drift, susceptibility variations, and physiological signals

CSP Seminar – Fall 2013 42

Page 119: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Slice-by-slice motion correction

• Motion will be different for each slice in a slice-by-sliceacquisition.

• Prospective correction reduces residual per-slice motion:

Uncorrected: tx = 1.1± 0.27 mm, rot = 1.5± 0.64 deg.Residual: tx = 0.30± 0.11 mm, rot = 0.47± 0.20 deg.

0 50 100 150 200−2.5

−2

−1.5

−1

−0.5

0

0.5

1

1.5

2

Time (s)

Mo

tio

n P

ara

me

ter

∆x

∆y

∆z

α

β

γ

True slice-by-slice motion

CSP Seminar – Fall 2013 43

Page 120: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Slice-by-slice motion correction

• Motion will be different for each slice in a slice-by-sliceacquisition.

• Prospective correction reduces residual per-slice motion:

Uncorrected: tx = 1.1± 0.27 mm, rot = 1.5± 0.64 deg.Residual: tx = 0.30± 0.11 mm, rot = 0.47± 0.20 deg.

0 20 40 60 80 100 120 140 160 180 200−1

−0.8

−0.6

−0.4

−0.2

0

0.2

0.4

0.6

0.8

1

Time (s)

Motion P

ara

mete

r

x

∆y

∆z

α

β

γ

Residual motion after prospective correction (known Q)

CSP Seminar – Fall 2013 43

Page 121: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Slice-by-slice motion correction

20 40 60 80 100 120 140 160 180 2000

0.005

0.01

0.015

0.02

0.025

0.03

Time (s)

Sa

mp

le V

aria

nce

s

2(a

∆x)

s2(a

∆y)

s2(a

∆z)

s2(a

α)

s2(a

β)

s2(a

γ)

Estimates of innovation sample variances (diagonal of Q)

• Estimates of Q are less stable with slice-by-slice motion.• Innovation variances for out-of-plane rotations β, γ ↓ 0.

• In turn, (Pt|t−1α )−1 becomes arbitrarily large, yielding

motion estimates mostly ignoring the data.

CSP Seminar – Fall 2013 44

Page 122: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Slice-by-slice motion correction

20 40 60 80 100 120 140 160 180 2000

0.005

0.01

0.015

0.02

0.025

0.03

Time (s)

Sa

mp

le V

aria

nce

s

2(a

∆x)

s2(a

∆y)

s2(a

∆z)

s2(a

α)

s2(a

β)

s2(a

γ)

Estimates of innovation sample variances (diagonal of Q)

• Estimates of Q are less stable with slice-by-slice motion.• Innovation variances for out-of-plane rotations β, γ ↓ 0.

• In turn, (Pt|t−1α )−1 becomes arbitrarily large, yielding

motion estimates mostly ignoring the data.

CSP Seminar – Fall 2013 44

Page 123: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Slice-by-slice motion correction

0 50 100 150 200−2.5

−2

−1.5

−1

−0.5

0

0.5

1

1.5

2

Time (s)

Mo

tio

n P

ara

me

ter

∆x

∆y

∆z

α

β

γ

Residual motion after prospective correction (estimated Q)

• Estimates of Q are less stable with slice-by-slice motion.• Innovation variances for out-of-plane rotations β, γ ↓ 0.

• In turn, (Pt|t−1α )−1 becomes arbitrarily large, yielding

motion estimates mostly ignoring the data.

CSP Seminar – Fall 2013 44

Page 124: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Slice-by-slice motion correction

• Enforcing a minimum threshold on the innovation samplevariances would mitigate the effect of poor estimates of Qon future motion estimates.

• Alternatively, we can extend our Kalman filter model toaccount for slice-by-slice motion: α1

...αNS

t

=

α1...

αNS

t−1

+

a1...aNS

t

, where

a1...aNS

t

∼ Normal

0,

NS · · · 1...

. . ....

1 · · · NS

⊗Q .

CSP Seminar – Fall 2013 45

Page 125: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Slice-by-slice motion correction

• Enforcing a minimum threshold on the innovation samplevariances would mitigate the effect of poor estimates of Qon future motion estimates.

• Alternatively, we can extend our Kalman filter model toaccount for slice-by-slice motion: α1

...αNS

t

=

α1...

αNS

t−1

+

a1...aNS

t

, where

a1...aNS

t

∼ Normal

0,

NS · · · 1...

. . ....

1 · · · NS

⊗Q .

CSP Seminar – Fall 2013 45

Page 126: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Accounting for other time-varying signals

• Other time-varying components of the BOLD signalinclude:

• scanner drift, which has a global effect on T ∗2 ,• breathing-induced global modulation of the main field, T ∗2 ,• and cardiac pulsatility, which varies blood flow, especially

near the cerebral arteries and ventricles.

• The global effects are spatially smooth.• Introducing a wavelet transform can isolate drift and

respiratory changes to the approximation coefficients.• We propose performing registration using just the detail

coefficients.

CSP Seminar – Fall 2013 46

Page 127: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Accounting for other time-varying signals

• Other time-varying components of the BOLD signalinclude:

• scanner drift, which has a global effect on T ∗2 ,• breathing-induced global modulation of the main field, T ∗2 ,• and cardiac pulsatility, which varies blood flow, especially

near the cerebral arteries and ventricles.

• The global effects are spatially smooth.• Introducing a wavelet transform can isolate drift and

respiratory changes to the approximation coefficients.• We propose performing registration using just the detail

coefficients.

CSP Seminar – Fall 2013 46

Page 128: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Accounting for other time-varying signals

• Other time-varying components of the BOLD signalinclude:

• scanner drift, which has a global effect on T ∗2 ,• breathing-induced global modulation of the main field, T ∗2 ,• and cardiac pulsatility, which varies blood flow, especially

near the cerebral arteries and ventricles.

• The global effects are spatially smooth.• Introducing a wavelet transform can isolate drift and

respiratory changes to the approximation coefficients.• We propose performing registration using just the detail

coefficients.

CSP Seminar – Fall 2013 46

Page 129: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Accounting for other time-varying signals

• Other time-varying components of the BOLD signalinclude:

• scanner drift, which has a global effect on T ∗2 ,• breathing-induced global modulation of the main field, T ∗2 ,• and cardiac pulsatility, which varies blood flow, especially

near the cerebral arteries and ventricles.

• The global effects are spatially smooth.• Introducing a wavelet transform can isolate drift and

respiratory changes to the approximation coefficients.• We propose performing registration using just the detail

coefficients.

CSP Seminar – Fall 2013 46

Page 130: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Accounting for other time-varying signals

• Other time-varying components of the BOLD signalinclude:

• scanner drift, which has a global effect on T ∗2 ,• breathing-induced global modulation of the main field, T ∗2 ,• and cardiac pulsatility, which varies blood flow, especially

near the cerebral arteries and ventricles.

• The global effects are spatially smooth.• Introducing a wavelet transform can isolate drift and

respiratory changes to the approximation coefficients.• We propose performing registration using just the detail

coefficients.

CSP Seminar – Fall 2013 46

Page 131: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Accounting for other time-varying signals

• Other time-varying components of the BOLD signalinclude:

• scanner drift, which has a global effect on T ∗2 ,• breathing-induced global modulation of the main field, T ∗2 ,• and cardiac pulsatility, which varies blood flow, especially

near the cerebral arteries and ventricles.

• The global effects are spatially smooth.• Introducing a wavelet transform can isolate drift and

respiratory changes to the approximation coefficients.• We propose performing registration using just the detail

coefficients.

CSP Seminar – Fall 2013 46

Page 132: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Outline

Magnetic Resonance Imaging

Functional MRI

Head Motion in fMRI

Proposed Method for Prospective Correction

Real Time Implementation

Simulation Results

Conclusions and Future Work

Summary

CSP Seminar – Fall 2013 47

Page 133: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Summary

• Functional MRI tracks brain function during tasks by usingthe signal variation generated by metabolizing hemoglobin.

• Prospective correction can improve statistical sensitivity offMRI time series acquired in the presence of head motion.

• The proposed method outperforms retrospectiveregistration in simulated data, even with impulsive motionand unknown model parameters.

• Future work will make the proposed method robust tointer-slice motion and global image time variations.

• I am also preparing to evaluate my proposed method inreal fMRI studies.

CSP Seminar – Fall 2013 48

Page 134: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Summary

• Functional MRI tracks brain function during tasks by usingthe signal variation generated by metabolizing hemoglobin.

• Prospective correction can improve statistical sensitivity offMRI time series acquired in the presence of head motion.

• The proposed method outperforms retrospectiveregistration in simulated data, even with impulsive motionand unknown model parameters.

• Future work will make the proposed method robust tointer-slice motion and global image time variations.

• I am also preparing to evaluate my proposed method inreal fMRI studies.

CSP Seminar – Fall 2013 48

Page 135: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Summary

• Functional MRI tracks brain function during tasks by usingthe signal variation generated by metabolizing hemoglobin.

• Prospective correction can improve statistical sensitivity offMRI time series acquired in the presence of head motion.

• The proposed method outperforms retrospectiveregistration in simulated data, even with impulsive motionand unknown model parameters.

• Future work will make the proposed method robust tointer-slice motion and global image time variations.

• I am also preparing to evaluate my proposed method inreal fMRI studies.

CSP Seminar – Fall 2013 48

Page 136: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Summary

• Functional MRI tracks brain function during tasks by usingthe signal variation generated by metabolizing hemoglobin.

• Prospective correction can improve statistical sensitivity offMRI time series acquired in the presence of head motion.

• The proposed method outperforms retrospectiveregistration in simulated data, even with impulsive motionand unknown model parameters.

• Future work will make the proposed method robust tointer-slice motion and global image time variations.

• I am also preparing to evaluate my proposed method inreal fMRI studies.

CSP Seminar – Fall 2013 48

Page 137: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Summary

• Functional MRI tracks brain function during tasks by usingthe signal variation generated by metabolizing hemoglobin.

• Prospective correction can improve statistical sensitivity offMRI time series acquired in the presence of head motion.

• The proposed method outperforms retrospectiveregistration in simulated data, even with impulsive motionand unknown model parameters.

• Future work will make the proposed method robust tointer-slice motion and global image time variations.

• I am also preparing to evaluate my proposed method inreal fMRI studies.

CSP Seminar – Fall 2013 48

Page 138: Sparse Modeling for Prospective Head Motion Correction · Sparse Modeling for Prospective Head Motion Correction Daniel S. Weller University of Michigan September 26, 2013 CSP Seminar

Questions?

Thank you for your attention.

Acknowledgments:• Jeff Fessler and Doug Noll

• NIH F32 EB015914 and P01 CA087634

CSP Seminar – Fall 2013 49