Post on 11-Jan-2016
Auditory cortical monitoring prevents speech errors
before they happen
Caroline A NiziolekUCSF Depts of Radiology and Otolaryngology ndash Head and Neck
SurgeryBiomagnetic Imaging LaboratorySpeech Neuroscience Laboratory
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
deafness
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
perceptualdeficits
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
MEG fMRI ECoG
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
deafness
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
perceptualdeficits
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
MEG fMRI ECoG
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
deafness
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
perceptualdeficits
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
MEG fMRI ECoG
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
deafness
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
perceptualdeficits
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
MEG fMRI ECoG
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
The Speech Chain
Denes amp Pinson 1993
The Speech Chain
Denes amp Pinson 1993
deafness
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
perceptualdeficits
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
MEG fMRI ECoG
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
The Speech Chain
Denes amp Pinson 1993
deafness
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
perceptualdeficits
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
MEG fMRI ECoG
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
perceptualdeficits
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
MEG fMRI ECoG
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
perceptualdeficits
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
MEG fMRI ECoG
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
The Speech Chain
Denes amp Pinson 1993
deafnessdecrease in intelligibility
frontal motor lesion
perceptualdeficits
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
MEG fMRI ECoG
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
MEG fMRI ECoG
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Understanding speech production via perception
Understanding speech production via perception
Understanding speech production via perception
MEG fMRI ECoG
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Understanding speech production via perception
Understanding speech production via perception
MEG fMRI ECoG
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Understanding speech production via perception
MEG fMRI ECoG
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Understanding speech production via perception
Houde Niziolek et al 2014 ISSPMEG fMRI ECoG
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Understanding speech production via perception
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
bull How does auditory feedback affect speech output
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Auditory feedback causes compensatory changes in our
speech output
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Auditory feedback causes compensatory changes in our
speech output
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
e
f0 (pitch)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eformant
s(vowel)
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Focal acoustic changesevoke focal compensation
frequency
am
plit
ud
eamplitude (loudness
)
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Chang Niziolek et al 2013 PNAS
f0 shift during vocalization
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
f0 shift of emphatic stress
f0 c
ontr
ast
dist
ance
Patel et al 2011 JSLHR
ampl c
ontr
ast
dist
ance
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
x y
frequencyam
plitu
de
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
x y
frequencyam
plitu
de
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
x y
frequencyam
plitu
de
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
x y
frequencyam
plitu
de
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
x y
frequencyam
plitu
de
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids
x y
frequencyam
plitu
de
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Real-time formant alteration
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Greater compensation to vowels shifted across a boundary
Niziolek amp Guenther 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Enhanced auditory error to shifts across a boundary
Niziolek amp Guenther 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci
f0 formants
Patel et al 2011 JSLHR
f0 c
on
tra
ct d
ista
nce
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Neural responses to feedback
Chang Niziolek et al 2013 PNAS
NO
RM
AL
ALT
ER
ED
ltfeedback match
suppression
feedback mismatch
no suppression
ge
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected
What causes this selective suppression Can it be used for error detection
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Models of speech motor control
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
CONTROLLER premotor
motor cortex
Models of speech motor control
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
CONTROLLER premotor
motor cortex
OUTPUTvocal tract articulators
COMPARISONauditory cortex
auditory signal
internal prediction
corrective error signal
Models of speech motor control
motorcommand
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Artificially-altered feedback
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
release from suppression
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Artificially-altered feedback
Chang Niziolek et al 2013 PNAS
change in speech output
release from suppression
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Are these error-correction processes at work
in natural speech
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Multi-vowel task
eatspeak Ed add
listen eat Ed add
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Auditory M100
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci
Source localization Champagne
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Vowel spacecenter vs periphery
Niziolek et al 2013 J Neurosci
ldquoeatrdquo
ldquoEdrdquo
ldquoaddrdquo
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Are peripheral productions processed as errors
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
center periphery
F1
F2
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
center periphery
F1
F2
predict variability
off center = expected
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
center periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Individual subjectdecrease in suppression
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
p = 0002
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Decrease in suppression isconsistent in left AC
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
center
center
periphery
periphery
F1
F2
predict variability
off center = expected
donrsquot predict variability off center = error
WINNER
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
acoustic distance
decrease in suppression prop
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Suppressionfalls off at the
vowel periphery
Niziolek et al 2013 J Neurosci
Fall-offincreases with
acoustic distance
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Acoustic error is coded by auditory suppression
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
The efferent prediction may reflect an acoustic
target or goal
(not merely a ldquocopyrdquoof motor commands)
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
bull How does auditory feedback affect speech output
bull How do we detect deviations from what we intend to say
bull What is the corrective behavior when a deviation is detected
Understanding speech production via perception
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Does error-like processing have behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Behavioral consequences
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Behavioral consequences
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Behavioral consequences
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Behavioral consequences
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Niziolek et al 2013 J NeurosciBehavioral consequences
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
If centering is partly driven by auditory feedback it should
bull correlate with cortical responses to feedback
bull decrease when you canrsquot hear yourself (ie in masking noise)
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Centering correlates with suppressionNiziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Masking noise reduces centering
Niziolek et al submitted
quiet
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Masking noise reduces centering
quiet masking noise
Niziolek et al submitted
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Masking noise reduces centering
quiet masking noise
Implications for hearing loss
Niziolek et al submitted
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
We detect deviations from an expected
targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
We correct our deviations before they
become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)
Centering ongoing error correction process (partly mediated by feedback)
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Ongoing amp future directions
Assess error detection and correction capacities in patients with speech disorders
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Speech error detection and correction in aphasia
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Speech error detection and correction in aphasia
detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Speech error detection and correction in aphasia
center periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Speech error detection and correction in aphasia
center
center
periphery
periphery
F1
F2detection impaired
detection preserved
sensory feedbacktraining
motor skilltraining
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Ongoing amp future directions
How task-specific is the perceived error
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Niziolek et al in prep
Redefining center and periphery
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Sort by formant
Niziolek et al in prep
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
F0
Sort by formant
Sort by pitch
Redefining center and periphery
F1
F2
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Multi-pitch task
Niziolek et al in prep
eatspeak eat eat
listen eat eat eat
z x cz x c
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Owen et al 2012 NeuroImageNiziolek et al in prep
Source localization right hemi
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
F0
Sort by pitch
Pitch task auditory suppression
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
F0
Sort by pitch
Pitch task auditory suppression
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 0048
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
F0
Sort by formant
Sort by pitch
Pitch task auditory suppression
F1
F2
Niziolek et al in prep
p = 027
(ns)
p = 0048
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Task-specific suppression
F0
formant
pitch
F1F2
vowel task
pitchtask
(ns)
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Pitch centering
Niziolek et al in prep
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Pitch centering
Niziolek et al in prep
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Niziolek et al in prep
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
bull Altered auditory feedback causes compensatory changes to speech output
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
Understanding speech production via perception
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
bull Altered auditory feedback causes compensatory changes to speech output
bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say
bull This suppression may underlie a corrective behavior that serves to bring speech back on track
Understanding speech production via perception
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Thank you
NIH F32DC011249NIH R01DC010145NSF BCS0926196
Frank GuentherJohn Houde
Sri NagarajanEddie Chang
Danielle MizuiriSusanne Honma
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Decrease in suppressionin both speak and listen
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
No systematic changesin suppression in right AC
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
Anti-centering
masking noise Niziolek et al in prep
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci
ldquoSIS falloffrdquo across acoustic space
Niziolek et al 2013 J Neurosci