The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial...

27
ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s notes

Transcript of The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial...

Page 1: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

ECON 4550Econometrics Memorial University of Newfoundland

Adapted from Vera Tabakova’s notes

Page 2: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

2.1 An Economic Model 2.2 An Econometric Model 2.3 Estimating the Regression Parameters 2.4 Assessing the Least Squares Estimators 2.5 The Gauss-Markov Theorem 2.6 The Probability Distributions of the Least

Squares Estimators 2.7 Estimating the Variance of the Error Term

FIRST

Page 3: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

First:2.1 An Economic Model2.2 An Econometric Model

FIRST

Page 4: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Figure 2.1a Probability distribution of food expenditure y given income x = $1000

Slide 2-Slide 2-44

Page 5: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Figure 2.1b Probability distributions of food expenditures y given incomes x = $1000 and x = $2000

Slide 2- 2-55

Page 6: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

The simple regression function

E y x xy x( | ) | 1 2

Page 7: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Figure 2.2 The economic model: a linear relationship between average per person food expenditure and income

Slide 2-7

Page 8: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slope of regression line

“Δ” denotes “change in”

2

E y x

x

dE y x

dx

( | ) ( | )

Page 9: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Figure 2.3 The probability density function for y at two levels of income

Slide 2-9Principles of Econometrics, 3rd Edition

Page 10: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-10Principles of Econometrics, 3rd Edition

1 2|E y x x

Page 11: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-11Principles of Econometrics, 3rd Edition

2var |y x

Page 12: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-12Principles of Econometrics, 3rd Edition

cov , 0i jy y

Page 13: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-13Principles of Econometrics, 3rd Edition

Page 14: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-14Principles of Econometrics, 3rd Edition

y~N 1 2X, 2

Page 15: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-15Principles of Econometrics, 3rd Edition

1 2( | )E y x x

2var( | )y x

cov , 0i jy y

21 2~ ,y N x

Page 16: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

2.2.1 Introducing the Error Term The random error term is defined as

Rearranging gives

y is dependent variable; x is independent variable

Slide 2-16Principles of Econometrics, 3rd Edition

1 2( | )e y E y x y x

y x e 1 2

Page 17: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

The expected value of the error term, given x, is

The mean value of the error term, given x, is zero.

Slide 2-17Principles of Econometrics, 3rd Edition

1 2| | 0E e x E y x x

Page 18: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Figure 2.4 Probability density functions for e and y

Slide 2-18Principles of Econometrics, 3rd Edition

Page 19: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-19Principles of Econometrics, 3rd Edition

1 2y x e

Page 20: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-20Principles of Econometrics, 3rd Edition

( ) 0E e

1 2( )E y x

Page 21: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-21Principles of Econometrics, 3rd Edition

2var( ) var( )e y

Page 22: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-22Principles of Econometrics, 3rd Edition

cov( , ) cov( , ) 0i j i je e y y

Page 23: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-23Principles of Econometrics, 3rd Edition

Page 24: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-24Principles of Econometrics, 3rd Edition

e~N0, 2

Page 25: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-25Principles of Econometrics, 3rd Edition

y x e 1 2

( ) 0E e 1 2( )E y x 2var( ) var( )e y

cov( , ) cov( , )e e y yi j i j 0

e N~ ( , )0 2

Page 26: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Figure 2.5 The relationship among y, e and the true regression line

Slide 2-26Principles of Econometrics, 3rd Edition

Page 27: The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.

Slide 2-27Principles of Econometrics, 3rd Edition