Download - A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Transcript
Page 1: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours

Adviser: Dr. Yeou - Jiunn ChenPresenter: MING -DA LEE

Hsiao-chuan wang (2010 )A Study of Assisting Hearing-Impaired Students inIdentifying Mandarin Tones by Using Modified Pitch Contours and Low-Pass Filtering. Bulletin of Special Education, 35(3), 77-101Journal of the Speech, Languagen, and Hearing Research.

Page 2: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

OutlineOutline

IntroductionIntroduction PurposePurpose Materials and MethodsMaterials and Methods ResultResult ConclusionConclusion ReferencesReferences

Page 3: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

IntroductionIntroduction

mandarin ?mandarin ?

ToneTone ?

fundamental frequency(F0)?fundamental frequency(F0)?

Syllable?Syllable?

Page 4: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

PurposePurpose

(1) (1) Investigation voice monotonous decrease of Investigation voice monotonous decrease of the degree of speech intelligibility.the degree of speech intelligibility.

(2) (2) Relatively monotonous voice of the three Relatively monotonous voice of the three two-syllable words after the identification of two-syllable words after the identification of impact.impact.

Page 5: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Materials and Methods Materials and Methods

一、一、 ParticipantsParticipants 32 32 Normal adultsNormal adults 4 Speaker4 Speaker Age19~40 years oldAge19~40 years old 。。 First languageFirst language is mandarinmandarin

Page 6: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Materials and Methods Materials and Methods

Page 7: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Materials and MethodsMaterials and Methods

Marantz PMD201 recorderMarantz PMD201 recorder SHURE BG 2.1 microphoneSHURE BG 2.1 microphone

Page 8: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Materials and MethodsMaterials and Methods

Speech re-synthesisSpeech re-synthesis 32 bit Creative sound blaster Sampling frequency 22.05Hz Cspeech

Removed F0’s rise and fallRemoved F0’s rise and fall

Page 9: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Materials and MethodsMaterials and Methods

Play speech sounds

subject

Heard&Write down Press the button

Page 10: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

ResultResult

Page 11: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

ResultResult

Page 12: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

ResultResult

Page 13: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

ConclusionConclusion TThe F0-flattened stimuli

significantly longer reaction time (RT) greater error rates lower intelligibility scores

Page 14: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

PurposePurpose

Using Modified Pitch Contours in hearing-Impaired Students ?

Page 15: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Materials and MethodsMaterials and Methods

26 children Mean age 13.6 years old Mean hearing loss right ear is 88dB

'left ear is 89dB

Page 16: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Materials and Methods Materials and Methods

MaterialsMaterials 「ㄧ」、「ㄨ」、 「 「ㄧ」、「ㄨ」、 「 Y Y 」 、「ㄞ」、「ㄟ」、」 、「ㄞ」、「ㄟ」、

「ㄠ」、「ㄡ」 。「ㄠ」、「ㄡ」 。

Page 17: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Materials and Methods Materials and Methods

Voice Hearing detection systemVoice Hearing detection system Voice modify systemVoice modify system

Page 18: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Materials and Methods Materials and Methods

Page 19: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Setting the voice fundamental Setting the voice fundamental frequency curve-frequency curve-Tseng ( 1990 )Tseng ( 1990 )

Expand the voice fundamental Expand the voice fundamental frequency curve-frequency curve-Liu (2007 )Liu (2007 )

Materials and Methods Materials and Methods

Page 20: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Materials and MethodsMaterials and Methods

Page 21: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:
Page 22: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Materials and Methods Materials and Methods

「「 low-pass filtering 」」 Keep the following 500hzKeep the following 500hz

Page 23: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

Materials and MethodsMaterials and Methods

Play speech sounds

subject

Used mouse to point out the print

Page 24: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

ResultResult

Page 25: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

ResultResult

Page 26: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

ResultResult

Page 27: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

ConclusionConclusion

Expand the voice fundamental Expand the voice fundamental frequency curve and Expand the frequency curve and Expand the 

baseband filter curve better than the baseband filter curve better than the other fourother four

Page 28: A Study of Assisting Hearing-Impaired Students in Identifying Mandarin Tones by Using Modified Pitch Contours Adviser: Dr. Yeou - Jiunn Chen Presenter:

ReferencesReferences Hsiao-chuan wang (2010 )A Study of Assisting Hearing-Impaired Students inIdentifying Mandarin Tones by

Using Modified Pitch Contours and Low-Pass Filtering. Bulletin of Special Education, 35(3), 77-101Journal of the Speech, Languagen, and Hearing Research.

Jing-Yi Jeng(2004) The influence of Monotone on Mandarin Lexical Identification and Speech Intelligibility, 38, 175∼196, 南師學報 .