Presentation Socio-economic impact...

35
www.fot-net.eu | FOT-Net is a support action co-funded by the European Commission to network FOT activities at European, national and international level. SOCIO-ECONOMIC IMPACT ASSESSMENT From analysed FOT data to costs and benefits Eline Jonkers, TNO Tom Alkim, Rijkswaterstaat

Transcript of Presentation Socio-economic impact...

Page 1: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |FOT-Net is a support action co-funded by the European Commission to network FOT activities at European, national and international level.

SOCIO-ECONOMIC IMPACT ASSESSMENTFrom analysed FOT data to costs and benefits

Eline Jonkers, TNOTom Alkim, Rijkswaterstaat

Page 2: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

WHERE ARE WE IN THE FESTA-V?

May 10 2012

Socio-economic impact assessment

2

Page 3: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

CONTENT

• Introduction: the client’s perspective• Impact assessment• Scaling up• Cost benefit analysis• Discussion and questions

May 10 2012

Socio-economic impact assessment

3

Page 4: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

THE CLIENT’S PERSPECTIVE

May 10 2012

Socio-economic impact assessment

4

Page 5: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

WHY DOING A FOT?PUTTING THE FOT INTO PERSPECTIVE

May 10 2012

Socio-economic impact assessment

5

TimeNow

FOTs

Methodology, Testing, Validation,

Evaluation, Organizational Issues,

Business Case development

Proof of Concept

Innovation,

Stakeholder

groups

Large-scale implementation

Business Modelling & Planning,

Deployment

Page 6: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

WHY DOING A FOT?

May 10 2012

Socio-economic impact assessment

6

• Important step in decision making process towards deployment

• Link theory / experiments and practice• See whether predicted benefits actually arise

in practice• Raising awareness

• Benefits first!

Page 7: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

IT’S LIKE BUYING A CAR…

May 10 2012

Socio-economic impact assessment

7

• The brochure promises you a lot (literature research and simulation studies)

• Make a test drive, does the car live up to the described potential? (FOT)

• Weigh the benefits against the costs• Buy it (deployment)

Page 8: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

CLIENT’S BACKGROUND

• Who is usually the client? � EU commission / public parties

• Why does the client pay for a FOT? � Deployment is expensive, seeing is believing (before you buy a car, make a test drive)

• What is the goal for the client? � Validate potential benefits, raise awareness

• What does the client expect (outcomes)? � Quantitative results, if you invest this, your benefits are that

May 10 2012

Socio-economic impact assessment

8

Page 9: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

MATCH CLIENT & CONTRACTOR

May 10 2012

Socio-economic impact assessment

9

Page 10: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

STEPS TO TAKE

• From analysed data and tested hypotheses to calculation of costs and benefits:– Impact Assessment– Scaling up– Cost Benefit Analysis (CBA)

May 10 2012

Socio-economic impact assessment

10

Page 11: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

IMPACT ASSESSMENT

May 10 2012

Socio-economic impact assessment

11

Page 12: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

GOAL IMPACT ASSESSMENT

• Draw conclusions about what the effect of the tested system is on– Safety– Traffic efficiency– Environment– User acceptance– Personal Mobility– Policy– Business models– Etc.

May 10 2012

Socio-economic impact assessment

12

Page 13: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

DETERMINING EFFECTS

• Starting point– FOT data available– Hypotheses tested– Research questions answered

• CBA needs quantitative data, specified as follows…

May 10 2012

Socio-economic impact assessment

13

Page 14: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

IMPACTS NEEDED FOR CBA

• Traffic efficiency– Changes in travel times

• Safety– Changes in no. of accidents (with fatalities,

injuries, property damage only)

• Environment– Changes in emissions of NOx, PM10, CO2 (and

other pollutants), noise, change in fuel consumption

May 10 2012

Socio-economic impact assessment

14

Page 15: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

NOT A STRAIGHTFORWARD STEP…

• Usually the FOT does not directly provide the right data– Indicators could not be measured directly (accidents,

emissions)– Data was not logged or lost� A translation needs to be made

• For the calculation of the impacts data can be complemented with simulation, models, data enrichment, …

May 10 2012

Socio-economic impact assessment

15

Page 16: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

HELP IN DETERMINING EFFECTS

May 10 2012

Socio-economic impact assessment

16

Increase in• Complexity• Accuracy

Rule of thumb

Simulation

Formula

Statistics Choice depends on

• Needs

• Budget

• Availability

• …

Page 17: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

EXAMPLE: TRAFFIC EFFICIENCY

• Available data– Speeds, time headways, lane change behaviour, etc.

• Needed– Change in travel times / delays / capacity

• Translation distribution of desired speed into impact on travel times at network level– With traffic micro simulation tool

May 10 2012

Socio-economic impact assessment

17

Page 18: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

EXAMPLE: SAFETY

• Available data: surrogate safety measures– Speed, speed variation, time headways, time to collision

• Needed: change in no. of fatalities and injuries

• Outcome FOT – Change in average speed: -2% (100 km/h � 98 km/h)

• Nilsson formula

– F1 = no. of fatal accidents without system, F2 with system– v1 = average speed without system, v2 with system

• Result– Decrease of fatal accidents: -8%

May 10 2012

Socio-economic impact assessment

18

4

1

212

⋅=

v

vFF

Page 19: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

EXAMPLE: ENVIRONMENT

• Available data: speed profiles (speed vs. time)• Needed: change in CO2 emissions

• Translation– With emission model

May 10 2012

Socio-economic impact assessment

19

Page 20: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

SCALING UP

May 10 2012

Socio-economic impact assessment

20

Page 21: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

WHAT IS SCALING UP?

• Translation of small scale effects into large scale effects on society level – Geographical scale

• From Pisa to Europe

– Time scale• From one week to one year

– Time period (future)• From 2012 to 2020

May 10 2012

Socio-economic impact assessment

21

Micro Macro

Page 22: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

WHAT IS DIFFICULT ABOUT SCALING UP?

No cookbook / cut-and-dried formulas:• Interaction between users and non-users• Nonlinear in penetration rate (early adopters,

cooperative systems)• Different geography• Different time scale• Different time period (future)• Modelling of driver behaviour• Frequency of conditions needs to be matched (traffic

situations, weather, road types, …)• Cultural differences• Etc.

May 10 2012

Socio-economic impact assessment

22

Page 23: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

SCALING UP A REGION – HOW?

• Direct method: using statistical characteristics– E.g., scale up delay times per road type in the

micro network by number of road km of that type in the larger region

+ Works well for local effects+ Requires little effort+ Easy to do- Inaccurate if network structure has influence- Data collection

May 10 2012

Socio-economic impact assessment

23

Page 24: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

COST BENEFIT ANALYSIS

May 10 2012

Socio-economic impact assessment

24

Page 25: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

CBA IN THE FOT

• Initial phase– Define scope of CBA– Specify components, address CBA

issues and discuss CBA design

• On watch phase– Particularly useful for exploring cost

side

• Results phase– Monetisation of impacts (benefits)– Result: benefit cost ratio – Plausibility checks and sensitivity

tests

May 10 2012

Socio-economic impact assessment

25

Tim

e

Page 26: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

COMPONENTS

• Benefits– Efficiency (travel times)– Safety (change in no. of accidents)– Environment (change in emissions)– …

• Costs– In-vehicle equipment– Infrastructure equipment– Operation– Maintenance– …

May 10 2012

Socio-economic impact assessment

26

Page 27: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

ISSUES TO CONSIDER

• Geographical scope (regional, national, EU)• Assessment of stand-alone functions or bundles

of applications• Lifecycle versus snapshot CBA

– Effects over entire assessment period– Assessment for one or several preselected target years

• Selection of the reference year

May 10 2012

Socio-economic impact assessment

27

Page 28: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

CALCULATING COSTS

• Cost components– In-vehicle equipment– Infrastructure equipment– Operation– Maintenance

• Obtain information from– Publicly available information– Project partners– Other companies– Business and service models

• Make initial estimation of costs and refine this with partners

May 10 2012

Socio-economic impact assessment

28

Page 29: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

TRANSLATING IMPACTS INTO €

• Cost unit rates for each impact– Safety impact (€ per fatality, injury)– Mobility impact (€ per h, € per l)– Environmental impact (€ per t CO2, NOx-eq.)

• Issues and choices– European average versus country specific values• Appraisal offers some room for shaping the results

May 10 2012

Socio-economic impact assessment

29

Page 30: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

RESULTS

May 10 2012

Socio-economic impact assessment

30

Valued effects (in Mill. Euro per year)

Safety Impact 2,897.2

Indirect Traffic Impact 66.0

Direct Traffic Impact 48.0

Benefits

Total 3,011.2

System Costs 1,619.8 Costs Total 1,619.8

Benefit-Cost Ratio 1.9

Example: Speed Alert – Scenario 2020 low

Page 31: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

RESULTS: DISCUSSION• Only a results table does not say much• Work is not over when the results are ready• Series of checks necessary

– Acceptability to policy and stakeholders– More disaggregated information needed

• Particular aspects– Composition of impacts– Sensitivity tests– Broader stakeholder analysis

Page 32: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

BACK TO THE CLIENT…

May 10 2012

Socio-economic impact assessment

32

Page 33: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

CHALLENGES

• Scaling up• Value of societal benefits (political perspective)• Human factors

– (Unexpected) side effects– 2nd order effects– Interaction effects

May 10 2012

Socio-economic impact assessment

33

Page 34: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

FOLLOW UP CLIENT

• To the Minister! (for the 2nd time)

• Benefits could be safety related, but focus has shifted towards environment or throughput…

• Political issues

• 26,27 June, Brussels• http://www.eurofot-ip.eu/en/final_event/

May 10 2012

Socio-economic impact assessment

34

Page 35: Presentation Socio-economic impact assessmentfot-net.eu/wp-content/uploads/sites/7/2012/05/Socio-economic-impa… · Socio-economic impact assessment 15. | HELP IN DETERMINING EFFECTS

www.fot-net.eu |www.fot-net.eu |

DISCUSSION AND QUESTIONS

May 10 2012

Socio-economic impact assessment

35