1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

23
1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang

Transcript of 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

Page 1: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

1

Statistical Tests of Returns to Scale Using DEA

Rajiv D. Banker

Hsihui Chang

Shih-Chi Chang

Page 2: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

2

Introduction

• Simar and Wilson (2002) conduct simulations to evaluate non-parametric tests of returns to scale in DEA– Bootstrap-based tests– Binomial tests– DEA-based tests

• They claim that when the production technology exhibits CRS

- Their own binomial tests perform quite poorly in almost every instance

- DEA-based tests perform poorly- Bootstrap-based tests consistently perform best compared to the

other tests

Page 3: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

3

Objectives of Our Study

• Use experimentally designed simulations to evaluate the relative performance of Bootstrap-based and DEA-based test statistics for returns to scale based on the occurrence of both Type I and Type II errors

• Type I error occurs when one rejects the null hypothesis when it is true while Type II error occurs when one fails to reject the null hypothesis when the alternative hypothesis is true

Page 4: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

4

Preview of Simulation Results• DEA-based tests perform much better than Bootstrap-based

tests in terms of the occurrence of Type I errors and is comparable for Type II errors

• Simulations reveal that Simar and Wilson (2002) (1) Misreport the performance of DEA-based tests, (2) Inflate the performance of their Bootstrap-based tests

• The performance of Bootstrap-based tests is very sensitive to different decision rules employed by Simar and Wilson to evaluate the null hypothesis, contrary to their claim that they are equivalent

• DEA-based tests have an advantage of using only a small fraction of CPU time required by Bootstrap-based tests

Page 5: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

5

BCC Model of DEA

BjMax

r y.. 0rj rj

j yts

ixij

ij x 0j

j

j 1

0, λ j

dropped is 1 when : Model CCR jC

Page 6: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

6

Additive Test Statistics

N

j

N

j

Bj

cjF

1 11 )1(/)1(

N

j

N

j

Bj

CjF

1

2

1

22 )1(/)1(

],..1|)()(max[( NjFFK Bj

vcj

c

Simar-Wilson use this statistic for comparison

Page 7: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

7

Multiplicative Test Statistics

N

j

N

j

Bj

CjF

1 13 ln/ln

N

j

N

j

Bj

CjF

1

2

1

24 )ln(/)ln(

This statistic is suggested whenthe efficiency is multiplicative

as in y = θ • f (x)

Page 8: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

8

Bootstrap-based Test Statistics

N

j

Bj

cj DDNT

1

11

ˆ/ˆ

N

j

N

j

Bj

cj DDT

1 12

ˆ/ˆ

Cj

CjD /1ˆ B

jBjD /1ˆ

Observe that these statistics are very similar to the multiplicative DEA-based test statistics

except for the bootstrap

Page 9: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

9

Experimental Design

• Design elements:– production technology– sample size– range of input values– efficiency distribution

• Composed production function which includes a mix of a shifted Cobb-Douglas production function that exhibits variable returns to scale, and a linear production function that characterizes constant returns to scale

Page 10: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

10

Production Technology

)()()1( 21 xfxfz

]1,0[5.0

1 )5()( xxf

kxxf )(2

= 0, 0.25, 0.50, 0.75, and 1

Page 11: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

11

Page 12: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

12

Sample Size n=40 and n=60

Input RangeThree different ranges for input values which are

generated uniformly over the intervals of• 5 and 15 (both incr. and decr. RTS)• 5 and 10 (only incr. RTS)• 10 and 15 (only decr. RTS)

Page 13: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

13

Efficiency Distribution

||1.0 ve

v is generated for each observation j{1,…N} from a standard normal distribution N(0,1)

Page 14: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

14

Simulated Observations

||1.0 vjj ezy

We use the Frontier Efficiency Analysis with R (FEAR) package (Wilson, 2008) to compute output oriented DEA inefficiency scores for both CCR and BCC models.

Page 15: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

15

Bootstrap-based Test Procedures

(1) Generate a random sample of size N from DEA inefficiency index

(2) Compute adjusted output value

(3) Re-estimate CCR and BCC models using adjusted output and the original input to obtain the bootstrap DEA inefficiency estimates

(4) Compute test statistics T1 and T2

Page 16: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

16

Bootstrap-based Test Procedures

(5) Repeat steps (1)-(4) B =2000 times to provide a set of estimates Tib, i=1,2 and b=1,2,,B

(6) Construct the empirical distributions of Bootstrap estimates Tib, i=1,2

(7) Use the empirical distributions of Tib to compute bias of bootstrap estimates and construct the bias-corrected distributions of Tib

(8) Select the nominal size (i.e.,α=0.01, 0.02, 0.05, 0.1, 0.15, 0.2, 0.25, 0.3)

Page 17: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

17

The (5.6) Test Procedure

- Use bootstrap estimates of Tib and the original estimates of Ti to determine the critical value Cα for each selected nominal size by following the procedures outlined in Eq. (5.1)-(5.6) in Simar and Wilson (2002, pp. 121-122)

- Use the decision rule in Eq. (5.6) to evaluate the null hypothesis of constant returns to scale, i.e., reject H0 if the observed Ti is less than (1-Cα)

c

Page 18: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

18

The (5.11) Test Procedure

- Estimate the probability value p that bootstrapped Tib is less than the observed Ti based on procedures outlined in Eq. (5.7)-(5.11) in Simar and Wilson (2002, p122)

- Use the decision rule to compare the probability value with the selected nominal size to evaluate the null hypothesis of constant returns to scale, i.e., reject H0 if p < α

c

Page 19: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

19

Number of Trials and Bootstraps

• 1,000 experiments (trials), each with 2,000 bootstraps for Bootstrap-based test procedures

Page 20: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

20

CPU Time

• For every 1,000 experiments, each Bootstrap-based test procedure using FEAR program took on average 8,048 seconds of CPU time

• For every 1,000 experiments each DEA-based test procedure used on average only 3 seconds of CPU time

• CPU time is for a Lenovo desktop PC equipped with Intel Core CPU E8400 @ 3.00GHZ and 2.00G RAM

Page 21: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

21

Simulation Results

• The performance of DEA-based statistics is e comparable to that of the Bootstrap-based statistics in terms of the occurrence of type II errors

• DEA-based statistics outperform Bootstrap-based statistics in terms of the occurrence of type I errors when the null is true

• The performance of Bootstrap-based statistics is much worse when the decision rule (5.6) is employed to evaluate the null hypothesis than when (5.11) is used.

Page 22: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

22

Conclusion

• Performance of DEA-based statistics proposed by Banker (1996) is comparable to that of Bootstrap-based statistics suggested by Simar and Wilson (2002) for occurrence of Type II errors and is, in fact, superior for Type I errors

• DEA-based statistics have an advantage of using much less CPU time than the Bootstrap test procedures

Page 23: 1 Statistical Tests of Returns to Scale Using DEA Rajiv D. Banker Hsihui Chang Shih-Chi Chang.

23

Implications

• There is no need to use the Bootstrap-based test procedures since they yield comparable results to DEA-based procedures

• There is a need to focus on more research using direct DEA-based statistical tests