專題研究 語音訊號處理專題
description
Transcript of 專題研究 語音訊號處理專題
![Page 1: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/1.jpg)
專題研究語音訊號處理專題
助教:余典翰指導教授:李琳山
2013/07/30
![Page 2: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/2.jpg)
2
Outline
• Acoustics (聲學 )
• Phonetics (語音學 )
• Useful Tools
![Page 3: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/3.jpg)
3
AcousticsPart 1
![Page 4: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/4.jpg)
4
Acoustics (1/4)
• Oscillogram(波形圖 )
• Spectrogram (頻譜圖 )
![Page 5: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/5.jpg)
5
Acoustics (2/4)
• Frequency– hertz (Hz)
• Amplitude– decibel (dB)
• Phase– degree (∘)
period amplitude
𝑓𝑟𝑒𝑞𝑢𝑒𝑛𝑐𝑦=1
𝑝𝑒𝑟𝑖𝑜𝑑
phase
![Page 6: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/6.jpg)
6
Acoustics (3/4)
• F0 (fundamental frequency 基頻 )– property of vocal fold (聲帶 )vibration– pitch (音高 )
fundamental period
![Page 7: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/7.jpg)
7
Acoustics (4/4)
• F1, F2, F3… (formant frequencies 共振頻率 )– properties of vocal tract (聲道 )– phone (音素 )
F3F2
F1
![Page 8: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/8.jpg)
8
PhoneticsPart 2
![Page 9: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/9.jpg)
9
Phonetics (1/4)
• Transcription–語音符號
• Articulatory phonetics (speech production)–語音發聲
• Acoustics phonetics–語音聲學
• Auditory phonetics (speech perception)–語音聽覺
![Page 10: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/10.jpg)
10
Phonetics (2/4)
• Vowels– Monophthong (單母音 )– Diphthong (雙母音 )
![Page 11: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/11.jpg)
11
Phonetics (3/4)
• Consonants– Voiced (濁音 )– Unvoiced (清音 )
╳– Plosive/Stop (爆破音 /塞音 )– Fricative (擦音 )– Affricate (塞擦音 )– Nasal (鼻音 )
![Page 12: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/12.jpg)
12
Phonetics (4/4)
• IPA consonants for English
![Page 13: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/13.jpg)
13
Useful ToolsPart 3
![Page 14: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/14.jpg)
14
Useful Tools
• Praat– http://www.fon.hum.uva.nl/praat/
• Wavesurfer– http://www.speech.kth.se/wavesurfer/index.html
![Page 15: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/15.jpg)
15
Praat (1/6)
![Page 16: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/16.jpg)
16
Praat (2/6)
• Read from file (.wav)
![Page 17: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/17.jpg)
17
Praat (3/6)
• Record mono sound (need microphone)
![Page 18: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/18.jpg)
18
Praat (4/6)
• Record• Stop• Save to list
![Page 19: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/19.jpg)
19
Praat (5/6)
• View & Edit
![Page 20: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/20.jpg)
20
Praat (6/6)
![Page 21: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/21.jpg)
21
Wavesurfer (1/4)
• File/Open
![Page 22: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/22.jpg)
22
Wavesurfer (2/4)
• Choose “Speech analysis”– Do NOT check “default” (next time will crash)
![Page 23: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/23.jpg)
23
Wavesurfer (3/4)
![Page 24: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/24.jpg)
24
Wavesurfer (4/4)
• Right click and create other panes you need– Ex: power plot
![Page 25: 專題研究 語音訊號處理專題](https://reader035.fdocuments.net/reader035/viewer/2022082203/56814f31550346895dbcc066/html5/thumbnails/25.jpg)
25
Summer Assignment
• Use praat or wavesurfer to analyze a .wav file
• Can you identify any phone by spectrogram?• What kind of vowels or consonants are there?• Can you recognize pitch and formants?
• Try out more functions of these tools!