What makes one estimator better than another Estimator is jargon term for method of estimating.
-
date post
19-Dec-2015 -
Category
Documents
-
view
222 -
download
0
Transcript of What makes one estimator better than another Estimator is jargon term for method of estimating.
![Page 1: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/1.jpg)
What makes one estimator better than another
Estimator is jargon term for method of estimating
![Page 2: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/2.jpg)
Estimate
• The estimator produces an estimate.• The estimate is the number.• The estimator is the method.
![Page 3: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/3.jpg)
What makes one estimator better than another
A better estimator is more likely to be close to the true line.
![Page 4: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/4.jpg)
How close is our regression line to the true line?
• To answer, we must make assumptions.• Assumption 1 is right in the question
above. It’s that there is a true line that we’re trying to find.
• Assumptions are needed to assess an estimator.
![Page 5: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/5.jpg)
• To see where we’re going with the assumptions…
![Page 6: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/6.jpg)
True line demo review
• Yi = α + βXi + ei
• (spreadsheet)
![Page 7: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/7.jpg)
Least squares demo review
![Page 8: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/8.jpg)
Errors’ expected value is 0.
– Assumption 2• Why we draw our regression line
through the middle of the points’ pattern• Implies that the least squares estimator
is unbiased• Estimator = Method
![Page 9: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/9.jpg)
Bias
• Unbiased means aimed at target.– Bias demo
• The expected value of the least squares slope is the true slope.
• Same for intercept.
![Page 10: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/10.jpg)
All errors have the same variance
– Assumption 3• Why you give each point equal
consideration
![Page 11: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/11.jpg)
Errors not correlated with each other
– Assumption 4• Correlated means a linear relationship
that lets you predict one error once you know another error.
• Serial correlation would be if one error helps you anticipate the direction of the next error.
![Page 12: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/12.jpg)
Errors not correlated with each other
• Why you predict on the regression line rather than above or below it.
![Page 13: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/13.jpg)
Normal distribution for errors
– Assumption 5• Normal distribution results from the
accumulation of small disturbances. Random walk with small steps.
• Normal distribution demos show how tight the normal distribution is.
![Page 14: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/14.jpg)
Normal distribution for errors
• Least squares is best.– Unbiased– Least variance -- most efficient -- of any
estimator that is unbiased • Efficiency demos
• Can do hypothesis testing.
![Page 15: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/15.jpg)
1A spreadsheet adds …
• Standard error of coefficient for the slope
• T-statistic– Coefficient ÷ its Standard error
• R-squared• Standard error of the regression
![Page 16: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/16.jpg)
Standard error of coefficient
• Shows how near the estimated coefficient might be to the true coefficient.
![Page 17: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/17.jpg)
t
• A unitless number with a known distribution, if the assumptions about the errors are true.
• Used here to test the hypothesis that the true slope parameter is 0.
![Page 18: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/18.jpg)
R2
• Between 0 and 1. Demo• Least squares maximizes this.• Correlation coefficient r is square root.
1Sum of squares of residuals
Sum of squares of Y Y
![Page 19: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/19.jpg)
Standard error of the regression
• “s”• Should be called standard residual
– But it isn’t
![Page 20: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/20.jpg)
s
• Root-mean-square average size of the residuals
• s2 is an estimate of 2
s2 sum of squares of residuals
Number of observations 2
![Page 21: What makes one estimator better than another Estimator is jargon term for method of estimating.](https://reader036.fdocuments.net/reader036/viewer/2022062313/56649d2e5503460f94a0522b/html5/thumbnails/21.jpg)
S2 and 2
S2
Sum of squares of residuals
Divided by
N-2
2
Expected value of sum of squares of the errors
Divided by
N