1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart...

31
/ 1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia November 27, 2017 Greg Lestikow Evidence from a randomized control trial.

Transcript of 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart...

Page 1: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 1

Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia

November 27, 2017 Greg Lestikow

Evidence from a randomized control trial.

Page 2: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 2

• The issues we’re facing and the big questions we’re trying to answer

• The study we designed to answer those questions

• Our results, and what they tell us about targeted subsidies

• How iDE intends on scaling up the use of smart subsidies in our Sanitation Marketing program in Cambodia.

What we’ll be discussing today

Presentation overview

Page 3: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 3

• We work through the private sector to build markets

• We design products to context

• We train businesses to produce and distribute products

• We recruit and train independent sales agents who are paid by suppliers

The Basics of SanMark

Sanitation Marketing

Page 4: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 4

The issues we’re facing

Page 5: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 5

We use a technology adoption curve to conceptualize the market.

Our theory of change

Page 6: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 6

As we achieve scale, we move the needle on coverage and move farther along the technology adoption curve.

Our theory of change

-

50,000

100,000

150,000

200,000

250,000

Dec

Ap

r

Au

g

Dec

Ap

r

Au

g

Dec

Ap

r

Au

g

Dec

Ap

r

Au

g

Dec

Ap

r

Au

g

Dec

Ap

r

Au

g

Dec

Ap

r

Au

g

2010 2011 2012 2013 2014 2015 2016

Cu

mu

lati

ve L

atri

ne

s So

ld

Cumulative Latrines Sold, Cambodia

Page 7: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 7

A market-based approach does not inherently establish incentives to reach the poor.

0% 5% 10% 15% 20% 25% 30% 35%

Population

Latrine Sales

Population

Latrine Sales

Population

Latrine Sales

Otd

ar

Me

an

ch

ey

Ka

mp

on

gT

ho

mS

va

y R

ien

g

Poor HHs' share in latrine sales and in province population

How many poor HHs are buying latrines?

How many poor HHs are in the population?

The issues we’re facing

Page 8: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 8

Prior market research suggests that relatively few poor households can afford latrines at market price…

The issues we’re facing

Downward-sloping

demand curves

Only 20% of HHs

willing/able to pay

market price

Page 9: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 9

…and that financing can only take us so far, especially given operational complexities surrounding finance.

The issues we’re facing

Still only half of HHs

willing/able to pay

market price

Page 10: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 10 / 10

1. Do targeted, partial latrine subsidies increase latrine sales to poor households?

2. Do targeted, partial latrine subsidies affect latrine sales to non-poor households?

3. Are targeted subsidies a cost-effective means of increasing latrine sales to poor households?

Given these issues, we want to know:

Page 11: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 11

Study design and mechanics

Page 12: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 12

• The national government works with local government to categorize households as ID Poor 1, ID Poor 2, and Non-poor

• ID Poor households have identification cards that iDE was able to verify with local officials and the national database.

• Sales agents took photos of ID cards and uploaded directly to our management information system on Salesforce using TaroWorks.

Cambodia’s “ID Poor” system allows us to accurately target subsidies.

Study mechanics: targeting the subsidy

Subsidy Amounts

• ID Poor 1 HHs $25 USD discount on a $56 USD market price = 44%

• ID Poor 2 HHs $12.50 USD discount on a $56 USD market price = 22%

Page 13: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 13 / 13

166 Villages

Treatment (83 villages)

Control (83 villages)

No subsidy offered to any HH

ID Poor 1 HHs offered $25 subsidy

ID Poor 2 HHs offered

$12.50 subsidy.

Non-poor HHs not offered subsidy

RCT study design

All HHs can pay with cash or apply for MFI loan

Page 14: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 14

Results and insights

Page 15: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 15 / 15

1. Do targeted, partial latrine subsidies increase latrine sales to poor households?

2. Do targeted, partial latrine subsidies affect latrine sales to non-poor households?

3. Are targeted subsidies or sanitation financing options—or a combination of the two—the most cost-effective means of increasing latrine sales to poor households?

We want to know:

Page 16: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 16

Results: Absolute sales figures

356

255

39

223

39

101

36

121

Poor Non-poor Poor Non-poor

Treatment(subsidies)

Control(no subsidies)

Total toilet sales by payment type and experimental group

Cash Financing

Far greater sales to

poor households

when subsidies are

offered.

Page 17: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 17

Results: Absolute sales figures

356

255

39

223

39

101

36

121

Poor Non-poor Poor Non-poor

Treatment(subsidies)

Control(no subsidies)

Total toilet sales by payment type and experimental group

Cash Financing

Little impact of subsidies

on sales to non-poor

Households.

Page 18: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 18

Interpretations

Results: Village-level treatment effects analysis

Outcome: Uptake rate among ‘valid’ households1

Coverage change treatment effects model2

Non-poor IDP 1 IDP 2 All HHs

Treatment

(subsidy offer to IDP HHs)

-0.00159 0.169*** 0.147*** 0.143**

(0.0403) (0.0586) (0.0499) (0.0621)

Constant 0.283*** 0.0838 0.0841 0.216

(0.0957) (0.274) (0.115) (0.242)

Observations 143 140 142 150

R-squared 0.232 0.206 0.290 0.181

Robust standard errors in parentheses. [ *** p<0.01, ** p<0.05, * p<0.1 ] 1Valid households are those households that do not have improved sanitation, as measured by latrine census

2This table shows only truncated model results, and does not include control variables

Offering partial subsidy to IDP households has no statistically significant effect on the likelihood of non-poor households purchasing.

Uptake increases by 16.9 and 14.7 percentage points among IDP 1 and IDP 2 households, respectively, when they are offered targeted subsidies.

Overall uptake increases by 14.3 percentage points in villages where subsidies are offered, when compared with control villages.

Page 19: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 19 / 19

1. Do targeted, partial latrine subsidies increase latrine sales to poor households?

2. Do targeted, partial latrine subsidies affect latrine sales to non-poor households?

3. Are targeted subsidies a cost-effective means of increasing latrine sales to poor households?

We want to know:

Page 20: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 20

Results: Cost-effectiveness analysis

Cost-Effectiveness Ratio =

Total Fixed Costs + (Marginal Costs * Number of Latrines Sold)

Number of Latrines Sold

Marginal Costs

Control: sales agent

commissions and loan

processing costs

Treatment: subsidy

amount, sales agent

commissions, and loan

processing costs

Page 21: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 21

Results: Cost-effectiveness analysis

Takeaways

Higher sales in the pilot Treatment group “spread” fixed costs across a greater number of latrines, resulting in a higher cost-effectiveness ratio

$39

$66

$153

$254

$0 $50 $100 $150 $200 $250 $300 $350 $400

Treatment

Control

Treatment

Control

Pro

gra

m-W

ide

(Scale

)P

ilot

Costs per latrine (fixed) Costs per latrine (marginal)

If we project calculations out to a scaled version of the program, smart subsidies still look like a cost-effective way to drive increases in sanitation coverage

Page 22: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 22

Future Plans and Takeaways

Page 23: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 23

• The study took place in a province with high coverage rates – how would results differ in different circumstances?

• High turnover of Sales Agents, requiring considerable training and oversight.

• The study design may have impacted sales agent motivation to sell in control villages.

• The ID Poor system is by no means a worldwide standard – how do we target in the absence of such systems?

Challenges & Limitations

Conclusions

Page 24: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 24

• No longer pursuing formal sanitation finance.

• Instalment plans offered to customers by suppliers.

• Smart subsidy will be fully integrated into the existing sanitation marketing program under SMSU 3.0.

• Government of Cambodia adopted the recommended subsidy guidelines coverage must be 60% before subsidy can be offered.

• Continue to share findings in hopes of influencing others in the sector – in Cambodia, but also in other contexts.

Scale Up Plans

Conclusions

Page 25: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 25

• This study provides promising evidence that targeted subsidies can increase sanitation coverage among poor households and overall.

• It also shows that well-targeted subsidies need not have market distortion effects.

• Targeted subsidies may provide a cost-effective complement to financing.

Takeaways

Conclusions

Page 27: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 27

Program Cost-Effectiveness

$240

$66 $50

$327

$30 $35

0

40,000

80,000

120,000

160,000

200,000

240,000

$0

$100

$200

$300

$400

$500

Dec Mar Jun Sep Dec Mar Jun Sep Dec Mar Jun Sep Dec Mar Jun Sep Dec Mar Jun Sep Dec Mar Jun Sep Dec Mar Jun

2010 2011 2012 2013 2014 2015 2016

Cu

mu

lati

ve L

atri

ne

Sal

es

Pro

gram

Co

st p

er

Latr

ine

Cambodia SanMark - Cumulative Latrine Sales vs Cost per Unit Sold

Cambodia Sales Cumulative Cambodia $ Cost/Unit 6-month Average

Large-scale program in

vestments lead to rapid

sales growth…

…driving down program

unit costs.

Outstanding questions:

1. At what point is it most cost-effective to introduce targeted subsidies? 2. What is the impact of targeted subsidies on future cost-effectiveness?

Page 28: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 28 Appendices: Model results

Page 29: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 29 Appendices: Model results

Page 30: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 30 Appendices: Model results

Page 31: 1 Optimizing smart subsidies to drive toward 100% market ... Subsidies.pdf1 Optimizing smart subsidies to drive toward 100% market-led rural sanitation coverage in Cambodia Greg Lestikow

/ 31 Appendices: Model results