Slide 1

Slide 2

Speech perception Relating features of hearing to the perception of speech

Slide 3

The bottom line The auditory system encodes the properties of sound that are essential to recognizing speech, but its a lot more complicated than that.

Slide 4

Production

Slide 5

Acoustics

Slide 6

Vowels

Slide 7

Consonants Laughter can soothe and heal

Slide 8

Place and manner of articulation

Slide 9

Speech cues

Slide 10

Important acoustic features

Slide 11

Envelope v. Spectral Information

Slide 12

Fine structure: Voicing

Slide 13

Fine structure: Intonation contour Marianna made the marmalade.

Slide 14

Fine structure: Tone split white swing defeat mother high level hemp rising horse falling- rising scold falling

Slide 15

Redundancy leads to robust perception Frequency (Hz) Amplitude (dB) 2100 400 Hz bandwidth.5 1 1.5 2.0 Amplitude (dB).5 1 1.5 2.0 1 Hz 4 Hz 64 Hz Interrupted Filtered

Slide 16

Variability in acoustics: Co-articulation

Slide 17

Variability in acoustics: Speaker Winnfield, LAVancouver, BCBrooklyn, NY

Slide 18

Variability in acoustics: Top-down influences another thing coming OR another think coming?

Slide 19

Multisensory integration

Slide 20

Conclusions Speech is produced by spectral and temporal modifications (by articulators) of a vibrating source (vocal folds). The amplitude spectrum and the envelope of sound carry much of the information in speech. The fine structure contributes to pitch-related aspects of speech. Sound associated with a phoneme is influenced by preceding and following phonemes, by the speaker, and by many other factors. Speech is highly resistant to corruption and interference. Acoustic and semantic context important in speech recognition. Speech is a multisensory phenomenon.