IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf ·...
Transcript of IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf ·...
![Page 1: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/1.jpg)
IERG 3050 Week5Selecting Input Probability Distributions
(Part II)
Bolei ZhouDepartment of Information Engineering
The Chinese University of Hong Kong
![Page 2: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/2.jpg)
Announcement
• Hand in Homework 1 by end of today!• Homework 2 will be out by the end of tomorrow. No need to hand in,
but important for your final exam and a good preparation for Quiz 1 on Oct. 16. • Quiz 1 on Oct.16: • 5-min discussion: on version 1• 15-min problem solving on your own: on version 2
![Page 3: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/3.jpg)
OutlineApproach for specifying a probability distribution from collected dataStep 1: Selecting family of distributions.Step 2: Estimating model parameters.Step 3: Determining how representative the fitted distribution is.
Reading: Chapter 6 of the textbook
3
![Page 4: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/4.jpg)
Maximum-Likelihood Estimation (MLE)
4
![Page 5: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/5.jpg)
Maximum-Likelihood Estimation (MLE)
5
![Page 6: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/6.jpg)
Maximum-Likelihood Estimation (MLE)
6
![Page 7: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/7.jpg)
Maximum-Likelihood Estimation (MLE)
7
![Page 8: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/8.jpg)
Maximum-Likelihood Estimation (MLE)
8
![Page 9: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/9.jpg)
Step 3: Determining how representative the fitted distribution is
![Page 10: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/10.jpg)
![Page 11: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/11.jpg)
Heuristic methods
![Page 12: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/12.jpg)
![Page 13: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/13.jpg)
![Page 14: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/14.jpg)
Probability Plots
![Page 15: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/15.jpg)
![Page 16: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/16.jpg)
Comparison of Q-Q and P-P Plots
![Page 17: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/17.jpg)
![Page 18: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/18.jpg)
Quantile-to-quantile plot
![Page 19: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/19.jpg)
Quantile-to-quantile Plot (Q-Q Plot)
![Page 20: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/20.jpg)
Quantile-to-quantile Plot (Q-Q Plot)
![Page 21: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/21.jpg)
Quantile-to-quantile Plot (Q-Q Plot)
![Page 22: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/22.jpg)
Quantile-to-quantile Plot (Q-Q Plot)
![Page 23: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/23.jpg)
![Page 24: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/24.jpg)
![Page 25: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/25.jpg)
![Page 26: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/26.jpg)
Probability-to-probability plot
![Page 27: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/27.jpg)
![Page 28: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/28.jpg)
![Page 29: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/29.jpg)
![Page 30: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/30.jpg)
![Page 31: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/31.jpg)
Comparison of Q-Q and P-P Plots
![Page 32: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/32.jpg)
Chi-Square goodness-of-fit test
![Page 33: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/33.jpg)
![Page 34: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/34.jpg)
![Page 35: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/35.jpg)
![Page 36: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/36.jpg)
![Page 37: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/37.jpg)
k
![Page 38: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/38.jpg)
![Page 39: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/39.jpg)
![Page 40: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/40.jpg)
![Page 41: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/41.jpg)
Error Type and Hypothesis Testing
![Page 42: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/42.jpg)
Error Type and Hypothesis Testing
• Null hypothesis: phenomenon being studies produces no effect or make no difference• Alternative hypothesis is opposed to the null hypothesis• Type I error: the rejection of a true null hypothesis• A test that shows a patient to have a disease when in fact the patient does
not• Type II error: the failure to reject a false null hypothesis• When comparing two means, concluding the means were different when in
reality they were not different is a type I error; concluding the means were not different when in reality they were different is a type II error.
![Page 43: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/43.jpg)
Thanks!
• Next week: Random Number Generation• Required reading: Chapters 7 and 8
• Special thanks to Prof. Pascal Vontobel, Prof. Minghua Chen, Prof. Rosanna Chan, Prof. Jianwei Huang, Prof. Angela Zhang for improving slides over the years.
![Page 44: IERG 3050 Week5 Selecting Input Probability Distributions ...ierg3050/Lectures/week5-lecture.pdf · IERG 3050 Week5 Selecting Input Probability Distributions (Part II) Bolei Zhou](https://reader033.fdocuments.net/reader033/viewer/2022050418/5f8df09f758434363314fd90/html5/thumbnails/44.jpg)
Preview on the course proposals
• https://piazza.com/class/jzkcr8285wg6pl?cid=7