STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems...
-
Upload
juan-fisher -
Category
Documents
-
view
215 -
download
1
Transcript of STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems...
![Page 1: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/1.jpg)
STATISTICS Linear Statistical Models
Professor Ke-Sheng ChengDepartment of Bioenvironmental Systems Engineering
National Taiwan University
![Page 2: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/2.jpg)
The Method of Least Squares • Consider the data shown in the following
table and figure. We are interested in fitting a straight line to the points in order to obtain a simple mathematical relationship for runoff and rainfall.
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
2
![Page 3: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/3.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
3
![Page 4: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/4.jpg)
• Intuitively, we want that, for each observed value of rainfall, the corresponding value of runoff will be as close as possible to the observed value. It is equivalent to say that we want the vertical deviations to be as small as possible.
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
4
![Page 5: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/5.jpg)
• One method of constructing such a straight line to fit the observed data is called the method of least squares. It requires the sum of the squares of the vertical deviations of all the points from the fitted line to be a minimum.
• Let the rainfall and runoff data in the above figure be respectively represented by x and y. The fitted line is expressed by
xy 10ˆ
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
5
![Page 6: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/6.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
6
![Page 7: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/7.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
7
![Page 8: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/8.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
8
![Page 9: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/9.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
9
![Page 10: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/10.jpg)
Remarks
n
ini
n
inini
xx
yyxx
1
2
11
)(
))((
n
ini
n
iini
xx
yxx
1
2
1
)(
)(
n
ini
n
inii
xx
yyx
1
2
1
)(
)(
,0)ˆ(1
n
iii yy
n
iiii yyx
1
0)ˆ(
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
10
![Page 11: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/11.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
11
![Page 12: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/12.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
12
Given a value of x, what dose the predicted value of y really represent?
![Page 13: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/13.jpg)
• Given a value of x, what dose the predicted value of y really represent?– It is unlikely that the predicted value will be the
same as the observed value at all times. – It may even be possible that the predicted value is
the same as the observed value only in very few cases.
– In some cases, the predicted values are far different from observed values.
• We are sure that the linear model may overpredict or underpredict the observed values.
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
13
![Page 14: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/14.jpg)
Linear statistical model
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
14
.),0(~,)|( , Given 210 Niidxxyx iiiiii
Random component
We are not able to predict y without errors due to existence of the random component. If a phenomenon is stochastic in nature, it cannot be predicted without errors.
![Page 15: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/15.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
15
iii
ixY
xxYVar
x
xNxY
ii
2
10|
210
)|(
),(~)|(
model) d(Postulate
.),0(~,)|( , Given 210 Niidxxyx iiiiii
iiiii
ii
exeyy
xy
10
10
ˆˆˆ
ˆˆˆ
![Page 16: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/16.jpg)
Coefficient of determination• How well does the least squares line explain
the variation in the data? • The coefficient of determination represents
the proportion of data variation that can be explained by the linear regression model.
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
16
![Page 17: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/17.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
17
![Page 18: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/18.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
18
![Page 19: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/19.jpg)
Estimating the variance of Y|x
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
19
iii
ixY
xxYVar
xxNxYii
2
10|2
10
)|(
,),(~)|(
Note: The variance of Y|x is NOT the same as the variance of Y.
RSS (Residual sum of squares) = SSE (sum of squared errors)
n
iii
n
iii xyyyRSS
1
210
1
2 )]ˆˆ([)ˆ(
![Page 20: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/20.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
20
![Page 21: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/21.jpg)
Unbiasedness of the least squares estimators
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
21
![Page 22: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/22.jpg)
Confidence intervals of the regression coefficients• Pivotal quantities
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
22
10 and
22
000 ~
1
ˆ
n
xx
n
t
s
x
ns
Q
211
1 ~ˆ
n
xx
tss
Q
222
2
3 ~)2(
n
snQ
![Page 23: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/23.jpg)
Hypothesis tests for regression coefficients
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
23
![Page 24: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/24.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
24
![Page 25: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/25.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
25
![Page 26: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/26.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
26
![Page 27: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/27.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
27
![Page 28: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/28.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
28
![Page 29: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/29.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
29
![Page 30: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/30.jpg)
Simple linear regression using R• Useful material– Chapter 11 of Introduction to Probability and
Statistics Using R (G. J. Kerns) is highly recommended.
– http://www.montefiore.ulg.ac.be/~kvansteen/GBIO0009-1/ac20092010/Class8/Using%20R%20for%20linear%20regression.pdf
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
30
![Page 31: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/31.jpg)
• Defining linear regression models
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
31
![Page 32: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/32.jpg)
• Conducting regressionlm(y~model)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
32
s
![Page 33: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/33.jpg)
• Other useful commands
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
33
![Page 34: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/34.jpg)
– For prediction (x values not observed)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
34
![Page 35: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/35.jpg)
Graphing the Confidence and Prediction Bands
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
35
You may want to change it. For example, data.frame(x=seq(20,30,by=0.5))
![Page 36: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/36.jpg)
Confidence and prediction intervals
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
36
Line of prediction. It represents the estimated conditional expectation of y given x.
![Page 37: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/37.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
37
![Page 38: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/38.jpg)
• Multiple regression – The following slides are provided for your reference
only. Due to the time constraint, they will not be covered in this class.
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
38
![Page 39: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/39.jpg)
• Now let’s consider fitting a linear function of several variables. Suppose that we have the following data set:
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
39
![Page 40: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/40.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
40
![Page 41: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/41.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
41
![Page 42: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/42.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
42
![Page 43: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/43.jpg)
knnn
k
k
xxx
xxx
xxx
X
21
22212
12111
1
1
1
k
1
0
ny
y
y
Y2
1
YXB
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
43
YXXBX TT YXXXB TT 1)(
![Page 44: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/44.jpg)
The Linear Regression Model
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
44
![Page 45: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/45.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
45
![Page 46: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/46.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
46
![Page 47: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/47.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
47
![Page 48: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/48.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
48
![Page 49: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/49.jpg)
Covariance and Correlation Coefficient
• Suppose we have observed the following data. We wish to measure both the direction and the strength of the relationship between Y and X.
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
49
![Page 50: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/50.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
50
![Page 51: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/51.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
51
![Page 52: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/52.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
52
![Page 53: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/53.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
53
![Page 54: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/54.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
54
![Page 55: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/55.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
55
![Page 56: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/56.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
56
![Page 57: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/57.jpg)
The Analysis of Variance (ANOVA)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
57
![Page 58: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/58.jpg)
• Given X, Y’s are independent normal random variables, i.e.,
• The residual sum of squares (or sum of squared errors, SSE) is expressed by
nI2,~ XBNY
BXYBXYSSET ˆˆ
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
58
![Page 59: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/59.jpg)
BXYYY
BXYXBBXYY
BXYBXYSSE
TT
TTT
T
ˆ
ˆˆˆ
ˆˆ
0ˆ BXYX T
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
59
![Page 60: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/60.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
60
![Page 61: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/61.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
61
![Page 62: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/62.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
62
![Page 63: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/63.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
63
![Page 64: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/64.jpg)
• The total sum of squares corrected for the mean is referred to as the total variation. This total variation is split up in two parts:– the regression part (SSRm) “explained by the model”,
and
– the residual part (SSE).
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
64
![Page 65: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/65.jpg)
• The ratio is known as the coefficient of determination.
• If the coefficient of determination is large then the model provides a good fit to the data. It also represents the part of the total variation which is explained by the model.
mm SSTSSRR /2
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
65
![Page 66: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/66.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
66
![Page 67: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/67.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
67
![Page 68: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/68.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
68
![Page 69: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/69.jpg)
Properties of the Estimators
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
69
![Page 70: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/70.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
70
![Page 71: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/71.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
71
![Page 72: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/72.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
72
![Page 73: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/73.jpg)
Confidence Intervals
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
73
![Page 74: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/74.jpg)
• The 100(1 – )% confidence interval of 2 is
2
2,
2
221,
2 )(,
)(
pnpn
spnspn
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
74
![Page 75: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/75.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
75
![Page 76: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/76.jpg)
• However, the true value of is unknown, the above equation can not be used to establish the confidence interval of .
• We then use s to substitute and it is known that has a t-distribution with
(n–p) degree of freedom.
i
i
ii
vs
ˆ
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
76
![Page 77: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/77.jpg)
• The 100(1 – )% confidence interval of
is
1ˆˆ
1ˆ
2,2,
2,2,
ipniiipni
pn
i
iipn
vstvstP
tvs
tP
i
ipniipni vstvst 2,2,ˆ,ˆ
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
77
![Page 78: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/78.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
78
![Page 79: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/79.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
79
![Page 80: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/80.jpg)
Example 1 • A scientist carries out an experiment on the
relationship between the yield Y of a crop and the amount of irrigation water X. It is believed that the relationship between expected yield and amount of irrigation water (ignore the units) can be described adequately as
xxxYE 210)|(
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
80
![Page 81: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/81.jpg)
• The data shown in the following table were collected in the field.
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
81
![Page 82: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/82.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
82
![Page 83: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/83.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
83
![Page 84: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/84.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
84
![Page 85: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/85.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
85
![Page 86: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/86.jpg)
Example 2 • Data in the following table are rainfall (x)
and runoff (y) measured during the rainy season in a study area.
• A regression model is postulated for the above data iXY X
ii 10|
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
86
![Page 87: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/87.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
87
![Page 88: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/88.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
88
![Page 89: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/89.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
89
![Page 90: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/90.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
90
![Page 91: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/91.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
91
![Page 92: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/92.jpg)
Test of Hypotheses
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
92
![Page 93: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/93.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
93
![Page 94: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/94.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
94
![Page 95: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/95.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
95
![Page 96: STATISTICS Linear Statistical Models Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.](https://reader033.fdocuments.net/reader033/viewer/2022051613/55147f36550346ea6e8b48aa/html5/thumbnails/96.jpg)
112/04/10 Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering, NTU
96