Retrospective assessment –Open DataProZorro, an open source and open data e-procurement system •...

Retrospectiveassessment– OpenData

Externalreportdraft

PleaseNote:ThisisamodificationofDalberg’sreport,whichwascreatedandintendedforOmidyarNetwork’sGovernance&CitizenEngagementinitiative’sinternaluse.Severalsectionsandslideshavebeenremovedforbrevityandconfidentiality.Therefore,somecontentaboutparticularorganizationsandstrategiesisnotincludedinthisdeck.

2

Tableofcontents:Supportinganalysis

Section Slidenumber

Opendata

Evolutionandimpact 3

Lessonslearned 18

Implicationsforthefuture 23

Annexes

OpenData– Evolution 27

Fieldsustainability 43

Sourcesandreferences 46

3

Opendata– summaryoffindings

Evolutionandimpact

Lessonslearned

Implicationsforthefuture

4

Thefieldofopendatagrewworldwidewithinadecade

Notes:1.IntheUKitwasTheyWorkForYou.com andintheUSitwasGovTrack.us.2.SunlightFoundation,“TenPrinciplesforOpeningupGovernmentInformation,”2017.3.Brazil,Indonesia,Mexico,Norway,thePhilippines,SouthAfrica,theUnitedKingdom,andtheUnitedStates.4.OpenGovernmentPartnership,“TheOGPExplorer,”2018.Sources:BeckyHogge,“OpenDataStudy,”2010;SunlightFoundation,“TenPrinciplesforOpeningupGovernmentInformation,”2017;OpenGovernment Partnership,“TheOGPExplorer,”2018;Stakeholderinterviews,2018

Pre-2008 2018

BeginningofopendataeffortsintheUSandUKwithgrassrootsandgovtactionatalllevels

Broaderuptakeandadoptionofopendataeffortsviasupportofhigh-levelgovernmentofficials

Growthoftheopendatafieldintonewgeographiesandsectors

Uncertainty duetoincreasedawarenessofdataprivacyanduseissuesandpoliticalclimate

2004 – US&UK: initialopendata(OD)advocacyandgovernmentdatareleaseandreuse1

2007– Advocates developeightopengovernmentdataprinciples2

2008– ObamawinstheUSelectionwithanopengovtagenda

2009/10– US&UKlaunchopendatarepositories

2011– OpenGovernmentPartnership(OGP)islaunchedbyObama&sevenotherheadsofstate3

2011– OpenDataforDevelopment(OD4D)islaunched

2011-16– OGP:59governmentsmake>450opendatacommitments4

2012– TheWorldBanklaunchesitsODinitiative

2012– OpenDataInstitute(ODI)iscreated

2013– Snowdenleaks

2013/15– G8leaderssigntheG8OpenDataCharter(ODC)

2016/17– Leadership fromearlychampions(e.g.,US,UK)decreases,newopendataleadersemerge(e.g.,France)

2017/18– FacebookCambridgeAnalyticascandalputsprivacyconcernsfrontandcenter

Inception(Pre-2008)

Systematization(2009-2010)

Reevaluation(2016-2018)

Expansion(2011-2015)

Opendata Evolution

5

Effortstodatehavedrivenconcreteresultsacrossmanyissueareas

Notes:1.R4D,“OPENGOVERNMENTCASESTUDY:CostingtheProZorro e-ProcurementProgram,”2017.2.OpenDataCharter“OpenUpGuide:UsingOpenDatatoCombatCorruption,”2018.3.TheGovLab"Uruguay'sATuServicio,"2016.4.Deloitte,“AssessingthevalueofTfL’s opendataanddigitalpartnerships,”2017.5.Hogge B.&TheGovLab,“UnitedKingdom’sTransportForLondon:GetSet,Go!,”2016.6.TheGovLab“NepalEarthquakeRecovery,"2016.Sources:Stakeholderinterviews,2018

• In2014theUkrainiangovernmentcreatedProZorro,anopensourceandopendatae-procurementsystem

• ProZorro isestimatedtohavecostthegovernmentUSD~4.7million1

• ProZorro estimatedsavingsover$350milliononplannedgovernmentspendingand increasedthenumberofcompaniesbiddingforcontractsby50%2

• ATuServicio—aUruguayanwebsitethatprovideseasytousegovernmenthealthdata–helpscitizensmakedata-baseddecisionsabouttheirhealthserviceproviders

• Withinonemonth,thewebsitereceived35,000visits—~1%ofUruguay’spopulation—comparedto<500downloadsin2014beforethelaunch3

• TransportforLondon(TfL)—thelocalgovtbodyresponsiblefortransport—decidedtorelease63keydatasets4 inlargepartasanexperimentwithoutastrongbusinesscasesupportingthisdecision5

• Thishasunlocked£130millionfortheLondoneconomy4 viagrowthofbusinessesusingTfLdata,bettertransportservices,andcommutetimesaved

• Over600applicationsuseTfLdata—reachingfourmillionpeople5

• FollowingearthquakesinNepalin2015,crowdsourcinganduseofopendatahelpedtoidentifyurgentcitizenneeds,targetreliefefforts,andensureaidmoneyreachedtargets

• Asoneexample,QuakeMap.orgreceived2,035reports– whichwerethenverifiedbyvolunteerstoidentify551reportsthatrequiredaction6

IMPROVING GOVERNMENT EMPOWERING CITIZENS

CREATING OPPORTUNITIES SOLVING PUBLIC PROBLEMS

Opendata Evolution

6

EarlymomentumfromNorthAmericaandEuropespreadtoallregions

Notes:1.GODANisGlobalOpenDataforAgricultureandNutrition.IDRCisCanada’sInternationalDevelopmentResearchCentre.2.Definitionofdatagovernance:theoverallmanagementoftheavailability,usability,integrity,andsecurityofdata.3.Infomediaries:actorswhohavetakenpublished dataandtransformeddata—intervieweesnotedthisiscommoninmanyAfricancountriesasfewimpactcasescomefromciviliansusingdata.Stakeholderinterviews,2018.Sources:OD4D,“TheStateofOpenData- WIP,”2018;WWWF,“OpenDataBarometer,4th Edition,"2016;OpenDataWatch,“OpenDataInventory,”2017;OpenKnowledgeInternational,“GlobalOpenDataIndex,”2015;Stakeholderinterviews,2018andDalberganalysis

• ODbegan~2004withgrassrooteffortsreusingpublicgovernmentdata(e.g.,GovTrack.Us)• CanadaandUSwerefirstmovers(e.g.,USgovernment’slaunchofODplatformin2009)andsupportedODglobally(e.g.,CanadaIDRCeffortswithOD4D,USAIDsupporttoGODAN)• Today,NorthAmericaistheleadingODregion(e.g.,rankedfirstinODBarometer2016,ODInventoryIndex2017,andGlobalODIndex2015)

NORTHAMERICA

• Opendataeffortsacceleratedin2013throughLatinAmerica&CaribbeanODConference—ConDatos—inUruguay• Strongopendataimpactcasesexist(e.g.,Mejoratu EscuelainMexico,AtuservicioinUruguay)• Strongcommitmentsandpoliciesexist(e.g.,LAChasthemostsigneestotheODCharter;ODkitpublishedbyArgentina’sgovtasgovtdatapublishingguidelines)

LAC

• EuropebegancreatingitsODfield~2004,withtheUKasfirstmover—andlauncheditsgovtplatformin2010• Today,strongadvancementsinODarepresentacrossEurope,fromlegislativeODcommitmentsinFrancetoimpactfulusecasesinUkraine• Europeisalsospearheadingdatagovernanceconversations2 (e.g.,recentapprovaloftheGeneralDataProtectionRegulation,GDPR)

EUROPE

• ODhadamajormilestonein~2011whenKenyalaunchedAfrica’sfirstopendataportal• Some“firstmover”countrieshavebacktrackedduetolimitedpoliticalcommitment(e.g.,BurkinaFaso,Kenya)• Newregionleaders arecreatingimpactcases(e.g.,SouthAfrica,Nigeria)—inlargepartviainfomediarywork3

AFRICA

• EarlysupportersofODandgovtopennesscamefromAsia(e.g.,PhilippineswasoneoftheeightfoundersofOGPin2011)• Today,ODuseandavailabilityvarybycountryincomeintheregion;EastAsiahasastrongdatareleaseanduse,whileSoutheast,West,andSouthAsiaallhavemorenascentODefforts

ASIA

Opendata Evolution

7

Opendataeffortsgainedthemosttractioninhigh-incomecountries,althoughtherearepromisingusecasesacrossincomelevels

Notes:1.ODWatch,“OpenDataInventory,”2017.2.WorldWideWebFoundation,“OpenDataBarometer,4thEdition,"2016.3.WB, “WorldBankSupportforOpenData,”2018.Sources:OpenDataWatch,“OpenDataInventory,”2017;WorldWideWebFoundation,“OpenDataBarometer,4thEdition,"2016;OpenDataCharter“OpenUpGuide:UsingOpenDatatoCombatCorruption,”2018;OpenDataCharter“OpenUpGuide:UsingOpenDatatoCombatCorruption,”2018;OGP,“ThePhilippinesprogressreport2015–2017,”2018;WB,“WorldBankSupportforOpenData,”2018;Stakeholderinterviews,2018

0

50

100

0 50 100

Lower-middle-incomeUpper-middle-income Low-incomeHigh-incomeRankingsofopendataprogressbycountry1,2

Index(0-100),2016- 2017

OpenDataBarometer (2016)Howgovernmentsarepublishingandusingopendataforaccountability,innovation,andsocialimpact

Ope

nDataInventoryInde

x(201

7)Ope

nnesso

fofficialstatistics

InthePhilippines,theDepartmentofTransportationandtheWorldBankcreatedandusedatransportdatabasetorationalizetrafficroutesinManila—whichcouldreducegreenhousegasemissionsby23%eachyeariffullyimplemented.3

Highestperformers

Since2014,BurkinaFaso’sopendataeffortshavepositivelyinfluencedthecountry’sdemocracy. Forexample,inthe2015presidentialelection,resultswerereleasedasopendatainnearrealtime,contributingtoapeacefulgov.transition.3

Opendata Evolution

8

Progressreleasingandusingdatahasvariedbysectoranddomain

Notes:1.Sectorsorganizedfromhighesttolowestglobalscoreandregionsorganizedfromhighesttolowestscoring– fromleft toright– intheOpenDataBarometer.AverageOpenDataBarometerscoreforsectordatasetsis32.5.WWWF,“OpenDataBarometer,4th Edition,"2016.Sources:WWWF,“OpenDataBarometer,4th Edition,"2016andDalberganalysis

Census

Budget

Environment

Trade

Elections

Contracts

Education

Map

Company

Health

Transport

Land

Crime

Legislation

Spending

NorthAmerica

88

53

53

75

83

80

58

95

78

80

85

48

43

93

85

EU&CentralAsia

30

30

27

38

51

48

56

49

57

48

53

63

67

EastAsia&Pacific

23

28

25

28

41

40

45

43

43

41

50

53

53

62

LatinAmerica&Caribbean

28

22

35

20

40

29

49

38

49

50

56

50

MiddleEast&NorthAfrica51

35

33

24

25

30

SouthAsia

23

26

28

26

24

26

26

Sub-SaharanAfrica

25

24

24

28

35

Topthird Middlethird BottomthirdOPENGOVERNMENTDATAPROGRESS,BYSECTOR(OpenDataBarometer,0-100)1

19

14 9

15

11

13

15

19

14

16

13

15

12

5

5

15

14

11

10

15

5

5

14

5

5

8

11

13

5

10

14

15

18

Opendata Evolution

9

Advocacy,politicalclimate,andtechnologicalchangeallshapedthefield’strajectory

Sources:BeckyHogge,“OpenDataStudy,”2010;CostaRicanGovernment,“Decreto Ejecutivo N° 40199-MP,”2015;TheGovLab,“TheOD500GlobalNetworkwebsite,”2018;Stakeholderinterviews,2018;andDalberganalysis

Driver

Championenthusiasm

Data&techgrowth

• Pressurefromgrassrootsandcivilservantsfueledinitialeffortsaroundgovernmenttransparencyandaccountability—andhavesustained“movement-like”energyovertime

• Pressureshaveshapedtheopendatadialoguebypushingforgovernmenttransparency,raisingconcernsandrisks(e.g.,privacy),andworkingtowardimproveddataquality

• Developmentanddiffusionofinformationcommunicationtechnologiesenableddatareleaseanduse

• Recently,adeeperunderstandingoftherisksvs.rewardsoftechanddatahavepromptedreevaluationoftheinitialpromiseofopendata,amplifiedcertainvoicesintheconversation(e.g.,civilians,privacyexperts),andhelpedcreatenewanonymizeddataformatsandstandards

• Governmentsupport—orlackthereof—hasinfluencedpublicandprivatesectoreffortsaroundopendata

• Governmentshavehelpedattractinternationalattentionandsupportforopendata (e.g.,OGP,OpenDataCharter),andenabledorhampereddatareleases—amongstothercontributions

Selectexamples

In2006,bottom-uppressurestartedbuildingintheUKasagroupofvolunteerslaunchedtheyworkforyou—awebsitethathelpsunderstandwhathappensinparliamentbyreusinggovernmentdata

Technologyhasenabledcreationofmoredetailed,comprehensivedatasets;forexample,Zillow—arealestateapp—maderealestateinfodigitallyaccessibleforfree- itwaspreviouslyonlyaccessibleviaphysicalregistries

In2015theCostaRicangovernmentissuedadecreethat governmentdatashouldbepublishedunderopendatatechnicalstandards—helpinginstitutionalizeopendataeffortsPolitical

climate

Opendata Evolution

10

Welookedatfourdimensionsofopendataasleadingindicatorsofthefield’sabilitytoachieveitsdesiredimpact

Source:TheGovLab “ODImpactWebpage,”2018;Stakeholderinterviews,2018,andDalberganalysis

ECOSYSTEM

POLICY,NORMS,&STANDARDS

DATASUPPLY DATAUSE

IMPACTCreatingopportunity,improvinggovernment,empoweringcitizens,solvingpublicproblems

Opendatafield

Opendata Evolution

11

Therehasbeendemonstrableprogressinbuildinganecosystem;developingpolicies,norms,&standards;andreleasing&usingdata(1/2)

Notes:1.Forexample,theUKhaddifficultcopyrightandlicensingrulesmakingitdifficulttoworkwithpublicdata.2.OECD, “CompendiumofgoodpracticesontheuseofopendataforAnti-corruption,”2017.3.ODI,“OpenStandardsforData:Guidebook,”2018.Sources:Stakeholderinterviews,2018;JoshuaTauberer,“OpenGovernmentData:TheBook,”2014;U.S.Government,“data.govwebpage,”2018;Techradar,“Hacktothefuture:InsidetheYoungRewiredStateProject,”2012;OECD,“CompendiumofgoodpracticesontheuseofopendataforAnti-corruption,”2017;WorldWideWebFoundation,“OpenDataBarometer,4thEdition,"2016;ODI,“OpenStandardsforData:Guidebook,”2018;Stakeholderinterviews,2018;Dalberganalysis

Opendata Evolution

Ecosystem

Policy,norms,&standards

• Fewincipientactorsexist,liketheSunlightFoundation- foundedin2006• Fewopendata-focusedevents(e.g.,conferences)• Siloedopendataecosystemsexistinafewsectorsortopics,(e.g.weather)

•Well-establishedactorsexist,includingopendatachampions(e.g.,ODIandOpenDataCharter) andactivesupporters(e.g.,OGP)• Opendataeventshappenrecurrentlyandhavegrowninsize(e.g.,10xgrowthforInternationalOpenDataConference,IODC;soldoutOpenDataInstituteSummit)• Globalandregionalcommunitiesexist(e.g.,IniciativaLatinoamericanaporlosDatosAbiertos,ILDA)

• Legislation:Noexplicitopendatalawsexistandsomecountrieshavelawsthatrestrictopendatapossibilities1

• Policy:No explicitopendatapoliciesexist• Norms:Firstnormsarecreated,liketheeightprinciplesofopengovernmentdata2

• Technicalstandards:Sector-specifictechnicalstandardsexistorarebeingcreated(e.g.,theUS EnvironmentalProtectionAgencyisusing openstandardsforenvironmentaldata)

• Legislation:Afewcountrieshaveopendatalawsorlawsthatincludeopendatastandards(e.g.,Germany’sopendatalawenablingfreeaccesstogovtdata)• Policy:CountrieshaveinstitutedODpolicies (e.g.,theUShasanODpolicyestablishedbyanexecutiveorder)• Norms:Havedevelopedacrosssectors(e.g., OpenDataCharter,16G20countrieshaveODstrategies,3ODpolicyofInternationalAidTransparencyInitiative)• Technicalstandards:Thousandsofopenstandardsexist(e.g.,OpenContractingDataStandard),4includingqualitystandardsandinfrastructuretomonitorprogress(e.g.,OpenDataBarometer)

Opendata~2007 Opendata~2018

Thefollowingslidescontainadditionaldetailondevelopmentsineachcategory

12

Therehasbeendemonstrableprogressinbuildinganecosystem;developingpolicies,norms,&standards;andreleasing&usingdata(2/2)

Notes:1.JoshuaTauberer,“OpenGovernmentData:TheBook,”2014.2.Techradar,“Hacktothefuture:InsidetheYoungRewiredStateProjecta,”2012.3.WorldWideWebFoundation,“OpenDataBarometer,4thEdition,"2016.4.U.S.Government,“data.govwebpage,”2018.Sources:Stakeholderinterviews,2018;JoshuaTauberer,“OpenGovernmentData:TheBook,”2014;U.S.Government,“data.govwebpage,”2018;Techradar,“Hacktothefuture:InsidetheYoungRewiredStateProject,”2012;OECD,“CompendiumofgoodpracticesontheuseofopendataforAnti-corruption,”2017;WorldWideWebFoundation,“OpenDataBarometer,4thEdition,"2016;ODI,“OpenStandardsforData:Guidebook,”2018;Stakeholderinterviews,2018;Dalberganalysis

Opendata Evolution

Datarelease

Datause

• Afewgovernmentshaveeffortstoopendata(e.g.,thecityofWashingtonDClaunchedthefirstmajorgovernmentdatacataloguein20061)

• Opendatasupplyisverylimited (e.g.,in2009data.gov—theUSfederalgovernmentdataportal—had47datasets4)

• Havingopendataportalsiscommonformostcountries(e.g.,79outofthe115governmentsintheOpenDataBarometerhaveatleastoneportal3)

• Opendatarepositoriesholdvastamountsofdata(e.g.,data.govhas~200,000datasets4)

• 90%ofgovernmentdatasetsremainclosed,accordingtotheOpenDataBarometer

• Firsteventstouseopendatawereheld:

- First“RewiredStateHacktheGovernmentday”isheldintheUKwith80developers2

- TheSunlightFoundationholdsitsfirstTransparencyCamp

• Arangeofusecaseshavebeendemonstrated acrosssectorsandgeographies

• Opendatacommunityhasshiftedtofocusmoreondataqualityanduse(e.g.,more“purpose-driven”ODCharterstrategy—meaningdataisreleasedbasedonacleargoal)

• Thereismoreactiveengagementofendusersofdata(e.g.,civilsociety,infomediaries)

Opendata~2007 Opendata~2018

Thefollowingslidescontainadditionaldetailondevelopmentsineachcategory

13Note:1.Thesedescriptionsillustratekeyroles/linkagesandarenotexhaustive.Forfurtherdetailspleaserefertoannexes.Sources:data.gov,“homepage,”2018;PewResearchCenter,“Americans’ViewsonOpenGovernmentData,”2015;Stakeholderinterviews,2018;andDalberganalysis

Ecosystem:Funders,civilsociety,anddedicatedpartnershipsenabledgovernmentandprivatesectordatarelease

Opendata Evolution

Adoptedpoliciesandreleaseddatasets

GOVERNMENTS

UsedandstudiedODtoadvancemanyfields

RESEARCHINST./NGOS

CreatedinnovativeusecasesforOD

OTHERSINFOMEDIARIES MEDIA

CITIZENSACTIVISTS

Publishedandusedopendata

STARTUPS

Createdbusinessmodelsandreleaseddata

PRIVATESECTOR

Builttheecosystem,useddataformanypurposes

Providedfundingandtechnicalexpertise

Supportedsomeopendataefforts

FOUNDATIONS

FundedODeffortsinmanycountries

DEV.AGENCIES

Opendata

Funding,support,advocacy

Drovenorms,standards,collaboration

MULTI-STAKEHOLDER

Funding,support

Funding,support

Support,advocacy

14

Sources:Stakeholderinterviews,2018andDalberganalysis

Ecosystem:Theopendatacommunityisnowlinkingtootheradvocacyefforts—andmoreconcreteusecasesareneededtocementlinkages

Opendata Evolution

OpendataOpendataexpertshavestartedtoengagewithotherrelatedissues(e.g.,ODIstrategy).

However,collaborationisnotyet“mainstream”

AIhasbecomeincreasinglyrelevantgivendatauseand

theneedtoeffectivelyscrutinizeandgovern

automateddecisions– thelinktoODisstillnascent

Linkbetweenopendataandprivacyisincreasinglyclear.Resourcesforprivacyexpertstocollaboratewithopendata

communityarelimited

Privacy

“Whenyoucompareprivacywithotherfields,wearesotinyandwearefightingonsomanyfronts,wecan’tprioritizeopendata.”– Privacyexpert

“Itisimportanttotapintonewenergy,butitisstillunclearhoworwheretodothis…forexamplearealsynergyforprivacyandODcouldbethenewhorizonofAI.”– Opendataexpert

AIethics&governance

“It'snotaboutprivacy,bigdata,orAI.It'salloftheseputtogether” – Formergovleader

"Whatunitestheprogressivepartsoftheopendata,privacy,andAIcommunities?I’darguethateachhasaclearrecognitionofthepowerofdata,andaconcernwithminimizingharm”– Opendataexpert

15

• OGP,theOpenDataCharter,andotherglobaladvocacyeffortssecuredimportantcommitmentsfromglobal,national,andsubnationalgovernments.

• Translationintolegislationatthenationalandlocallevelsisstillunderway.Forexample,FranceandGermanyrecentlycreatedopendatalaws.AustraliaandConnecticutrecentlyannouncedplanstodoso.

KEYFINDINGS

Policy,norms&standards:Opendatapoliciesandstandardshavegainedtractionattheglobal,national,andsubnationallevels

Notes:1.OpenDataCharter,“Webpage,AboutUs,”2018.2.OGP,“OGPExplorer,”2018.3.WorldWideWebFoundation,“OpenDataBarometerGlobalReport,4th Edition,"2016.Sources:OpenDataCharter,“Webpage,AboutUs,”2018;OGP,“OGPExplorer,”2018;WorldWideWebFoundation,“OpenDataBarometerGlobalReport,4th Edition,"2016;FrenchNationalAssembly,“BillonaDigitalRepublic,”2016;OGP,“GermanyFinallyhasanOpenDataLaw,”2017;Lexology,”AustralianGovernmentcommittedtoopendatawithresponsetoPrivacyCommission,”2018;Digitalcommunities,“What’sNewinCivicTech:NewLegislationinConnecticutBolstersState’sOpenDataEfforts,”2018;Stakeholder interviews,2018,andDalberganalysis

NumberofOGPcommitmentstaggedwithopendata2Commitments,2011-2016

28

6547

96

63

165

201620122011 2013 2014 2015

+43%

“Cross-pollinationbetweengovernmentsplaysanimportantroleindisseminatingopendata,forexampleBurkinaFaso’sgovernmentbegantogrowinterestinmovingthetopicnationallyafteratriptoGhana.”– Governmentofficial

“Legalsupportisimportanttocreatesustainability,aswithoutlawsitbecomesverydifficulttosupportopendatainitiativesthatwilloutlastgovernmentchanges.”– Governmentofficial

“Opendatagotbroadbuy-inasitwasamoretechnical,andlesscontroversialissue thanopengovernment.”– Funderandresearcher

Opendata Evolution

PROGRESSTODATE

19 nationaland35 local/subnationalgovernmentsarepartoftheOpenDataCharter1

59 countriesmade464 OGPopendatacommitments2

7countriesintheOpenDataBarometer haveanexplicitpolicycommitmenttomakegovernmentdataopenbydefault3

16

QUALITYOpenDataBarometerdatasetsthatmeetopendata qualitystandards3%ofdatasets,2013-2016

AVAILABILITYCoverageandopennessofofficialstatisticspublishedbynationalstatisticaloffices(NSOs)1Index(0-100),2015-2017

Datarelease:Publicandprivatedatareleasedcontinuestogrow.Qualityisnowthefocustoincreaseusability

Notes:1.OpenDataWatch,“OpenDataInventory2017Index,”2017.2.OpenCorporates,“AboutTimeline,”2018.3.WorldWideWebFoundation,“OpenDataBarometer,4th Edition,"2016.4.OpenKnowledgeNetwork,“TheGlobalOpenDataIndex,”2018.Sources:OpenDataWatch,“OpenDataInventory2017Index,”2017;OpenCorporates,“AboutTimeline,”2018;WorldWideWebFoundation,“OpenDataBarometer,4th Edition,"2016;OpenKnowledgeNetwork,“TheGlobalOpenDataIndex,”2015;Stakeholderinterviews,2018;andDalberganalysis

“Openingdatawithoutfollowingguidelines–suchasupdatingitperiodicallyorpublishingitinmachinereadableformats– reallydecreasesitsutility.”– Opendataexpert

30.2 39.3 39.5

2015 2016 2017

13811595

2015 2016 2017

7% 10% 10% 7%

20152013 2014 2016

9%12%16%

2013 20152014

ODIndexdatasetsthatmeetqualitystandards4%ofdatasets,2013-2015

CompanieslistedonOpenCorporates2Millionsofcompanies,2015-2017

“Therhetoricaroundopendatahasstartedtoshift,fromopenforopennesssake,tomorepurpose-driveninitiatives ofwhywewanttoopenthedata.”– NGO

Opendata Evolution

• Releaseofpublicandprivatedataisincreasing.Expertsalsonoteagrowingfocuson“purpose-driven”release—meaningdataisreleasedbasedonaspecificgoal.

• Dataqualityremainsachallenge.Indicesshowincreasesinnumberofdatasetsbutdecreasesinquality.

• Theseindicesmeasurequantityandqualityofopendatareleased.However,ifreleaseis“purpose-driven,”thereisnoexpectationthatallgovernmentdatasetsshouldbeopen.

KEYFINDINGS

17

Overall,theopendatafieldhasmaturedanddevelopedsomeaspectsoflonger-termsustainability

Notes:1.OpenGovernmentPartnership,“TheOGPExplorer,”2018.2.TheODC,“TheOpenDataCharterWebpage,”2018.3.TheState ofOpenData,“Donors– StakeholderChapterWIP,”2018– AstheStateofOpenDataisstillaWIP,thisinformationmaychangewhenfinalizedandreviewed.4.Deloitte,“AssessingthevalueofTfL’s opendataanddigitalpartnerships,”2017.Sources:RobertWoodJohnsonFoundation,“ExitingResponsibly:BestDonorPracticesinEndingFieldSupport,”2011;TheODC,“TheOpenDataCharterWebpage,”2018;OpenGovernmentPartnership,“TheOGPExplorer,”2018;TheStateofOpenData,“Donors– StakeholderChapterWIP,”2018;Deloitte,“AssessingthevalueofTfL’s opendataanddigitalpartnerships,”2017;Stakeholderinterviews,2018;andDalberganalysis

• Incipientchangesinnormsandstandardsacrosssectorsandcountries,e.g.reportinginextractives,releaseofgov.data,ODIandODC’s5-stardeploymentscheme.Fewerchangesinprivatesector

• Opendataeffortsexistineveryregionandinalmosteverycountry• ODrelatestomanyissuesareasandhasseenuptakeacross20+sectors(e.g.,extractives,education)anddomains(e.g.,weather)

• 50+ fundershavesupportedopendataefforts3

• SpecializedODorgshaveledefforts(e.g.,ODI’sdataspectrum)andadjacentorgshavebuiltODintotheirwork(e.g.,EITI)

• Opendataandsector-specificchampionsexist• ManypeopleuseODwithoutknowing(e.g.,42%ofLondonersuseTfL-drivenapps4)

Norms

Narrative

Institutions

Constituency

• ~60countrieshavemadecommitmentsviaOGP;1 afewhaveODlegislation(e.g.,Germany)• 35sub-nationalgovernments haveadoptedOpenDataCharter2

Policies

PROGRESS BY ~2018

• Fewnormsinplacearoundneedtoopendata

• Localizednarrativeinafewcountries(e.g.,US,UK)

• Someearlyinstitutions(e.g.,Sunlight,earlyOpenKnowledge)

• Someemergingchampions(e.g.,Sebastopoladvocates)

• Opendataleadershaveestablishedabackbone(e.g.,dataportals,technicaldefinitions,indices,talent)

Technicalleadershipand

capacity

• Earlytechenthusiastsbecominginvolved(e.g.,TimO’Reilly)

• Nodedicatedpoliciesinplace

OPEN DATA ~2007

Opendata Evolution

18

Severaltensionsaretop-of-mindforopendatachampions

Sources:Stakeholderinterviews,2018;RouteFifty,“TheDifficultBalanceofTransparencyandPrivacyforLocalGovernments,”2018;Twitter,“Twitterwebpage,”2018;PrivacyInternational,“Video:WhatIsPrivacy?,”2018.

Opendata

“Purpose-drivenreleaselinksdirectlytouseofdata,thisiswhywealwaysprioritizepurpose-drivenreleases”– GCEgrantee

“Ithinkinthefuture‘OD’ willdisappearandintegrateintoothersectorsasatoolemployedforspecificpurposes”– ODexpert

Purpose-driven:datashouldbereleasedbasedoncleargoalstouseit(e.g.,Ebolaoutbreakdatatocontroltheepidemic)

Evolution

PURPOSE-DRIVENVS.FREE-MARKET

Free-market:asmuchdataaspossibleshouldbereleasedbasedonprincipleofopenness(e.g.,governmentdatais“openbydefault”)andbeliefthatmarketwillfindthemostimportantuses

“Fromapolicyperspective,openingupdatashouldnotbecontingentonhowmanypeopleareusingit.Somedatasetsaresocriticalthatifonlyonepersonusesit,thatisfine”– GCEgrantee

“The‘openbydefault’principleofopendata,reallycreatesaredline betweentheopennessfieldandtheprivacyfield”– Privacyexpert

“Therearealotofrisks…Personaldatalikeincometaxandhealthcarerecordsshouldbeclosed”– Funder

Privacy:theabilityofanactor(e.g.,individual,company,government)togovernwhatdataonthemcanbestoredandsharedwithathirdparty

Openness:dataisresponsiblysharedwitheveryone,freely

“Datashouldbe‘asopenaspossible’over‘openbydefault.’Andgettinggovtstorecognizethisaspartoftheirdutiesiskey”- GCEgrantee

“’Openbydefault’doesnotmeanopeningalldatasets.It’smoreabouttransparency andbeingopenaboutwhatyou’renotopening”– ODexpert

PRIVACYVS.OPENNESS

19


Evolutionandimpact

Lessonslearned


20

A.GlobalpolicyagreementshavehighROIpotential

Sources:Dalberganalysis

Public

Private

Potentialentrypoints

Nationalgovernments Sub-national

High-levelpathways(notcomprehensive)

Companies

GCEdirectpaths

Relevantpublicandprivatesectoractors

releaseandusedata

Sub-national


GCEindirectpaths

Opendata Learnings


Potentialcascade

GlobalpolicyplayscanhavelargeROI(e.g.,~60countrieswithODOGPcommitments,~20countriessignedontoOpenDataCharter)– butsignificantfollow-upis

neededtodeliverresults

Directeffortstoreleaseandusedatacanleadtomore

concrete/immediateimpact,butcanbemoredifficulttoscale

UN/Multilateral

Nationalgovernments

Sub-nationalgovernments

Industrygroups

Companies

Global/regionalcoalitions(e.g.,

OGP)

G8(G7)/G20

21

B.Realizationofresultsfromglobalpolicyagreementsrequiressustainedfocus,incentives,andclarityonwhowilldriveimplementation

Notes:1.Forexample,aTransparencyInternationalstudyfoundfiveG20countries– Brazil,France,Germany,IndonesiaandSouthAfrica– havenotmadeenoughprogressinreleasingallanti-corruptiondatasetsrequiredandensuringtheyareeasytofindandtouse.2.OpenDataCharter,“Bridgingthegap,”2018.3.“Testing, learningandadapting:AyearinthelifeoftheOpenDataCharterteam,”2018.Sources:InternalGCEdocuments;Stakeholderinterviews,2018;andDalberganalysis

Lessonlearned

• Globaladvocacylaidimportantfoundations,foropendatapolicyandregulationatthenationalandlocallevels,butisnotenoughtodriveendimpacto 70%ofOGPopendatacommitmentscannotbeconfirmedduetolackofreviewand/ordatao Countrieshavenot fullydeliveredonG8,G20commitments1

• Implementationanddeliveryofopendatacommitmentsrequires“bootsontheground”(i.e.,deeplocalengagement,culturechange,anddedicatedbudgetsandstafftosucceed)

• Todrivelong-termsuccess,itisimportanttoidentifytheconstituencies(e.g.,withingovernmentsandcompanies)whodrivesustainedreleaseofdata– anduserswhowillengage/benefitfromthedata2

• Itiscriticaltohavefulltheoryofchangeforhowpolicyeffortstranslateintodurableendimpact– includingstrategiestobuildownershipacrossrelevantconstituencies,embedchangesinlegislation,etc.3

“Buildingsustainablepoliciesthatcreatelastingchangecanstartwithhighlevelpoliticalwillbutneedtobefollowedbysmarterwaystoadvocateforchange,includingbuildingownershipacrossconstituencies,layingthefoundationsfortransformativelegislation,anddeliveringresults thatresonatewiththeneedsanddemandsofpeople.”– OpenDataCharter

Opendata Learnings

“Nothingwillhappentosomeonewhodoesn’tcomplyanODcommitment–enforcementdoesn’thappen”– Privacyexpert

22

Notes:1.Medium,“Testing,learningandadapting:AyearinthelifeoftheOpenDataCharterteam,”2018.GovLabcasestudiesalsopointtopartnerships,publicinfrastructure,policiesandperformancemetrics,andproblemdefinitionaskeyenablingconditions.Corechallengesarereadiness,responsiveness,risks,andresourceallocation.2.Forexample,theOpenDataCharterframespurpose-drivenreleaseasonewaytoprioritizeeffortswithinagovernment’sbroadercommitmentto“OpenbyDefault.”Sources:Medium,“Testing,learningandadapting:AyearinthelifeoftheOpenDataCharterteam,”2018;theGovLab,“ODimpactwebpage,”2018;theOpenDataCharter,“ODCwebpage,”2018;InternalGCEdocuments;Stakeholderinterviews,2018;andDalberganalysis

Lessonlearned

• Opendataprojectshavemost effectivelydeliveredimpactwhentheyarefocusedonsolvingproblemspeoplecareabout1

• “Purpose-driven”releasecanhelpprioritizereleaseofdatathatismostdemanded fromcitizens,CSOs,andotheractorswhouseit– whichiscriticalgivenlimitedcapacityandresources2

• Opendatareleasedwithoutaclearpurposerisksharmingperceptionsaboutthevalueofthefield:“thisiswhereopendatawentwrong”

• Thedebateaboutpurpose-drivenrelease(i.e.,openingdataforacleargoal)vs.free-market-drivenrelease(i.e.,releasingasmuchaspossible)continues(seeannexslide126)

• Someexpertsfearagrowingfocusondatauseriskslosingfocusonunderlyingrights-basedprinciples – aswellasshareddatainfrastructure

“Problem-focused,butpublic-mindedisthegoal”– ODexpert

“Astheopennessspacematuresandstartsthinkingaboutusecasesandusers,thereisatension.Peoplesay‘thereisnopointinpublishingdataifnooneisgoingtouseit,’whichisreallythreatening.Somedatasetsaresocriticalthatifonlyonepersonusesit,thatisfine.” – GCEgrantee

Opendata Learnings

C.Cleargoals,collaborativeusers,andwindowsofopportunitydriveimpactofopendatareleaseanduse

“Openingdataforthesakeofopeningresultsinabunchofzombieplatformsthatarecreatedandneverusedormaintained.”– GCEgrantee

23Notes:1.“Theopendatacommunitydidnotstopdrivingformoreandmoredata…theydidnotstoptopauseandtothinkwhatisgoingtohappenwithallofthisopendata?Ihavenotseenthismomentofcontemplationandreflection…notalotofpeoplearestoppingandseeingwhatisgoingon.”– Privacyexpert.Sources:InternalGCEdocuments;Stakeholderinterviews,2018;Stakeholderinterviews,2018;andDalberganalysis

Lessonlearned

• Manyearlyopendataadvocatesdidnotgivesufficientattentiontotherisksandcostsofopeningdata– orproposemitigationstrategiestoaddressthem1

• Casesofopeningdatawithouthavingtheappropriateprecautionshaveevidencedopendata’srisk.Forexample,EightmapsintheUSApermittedpeopletogatherpersonalinformationondonorssupportingbansonsamesexmarriageinCalifornia,leadingtoharassmentandthreatstocivilians

Opendata Learnings

“Oneofthelessonsisthecostsandrisksarebothcomplicated.Whoeverhasmoreexpertiseandbetterempiricalguidanceaboutwhattheactualrisksareinanygivendisclosureoropendatascheme– whatit’sgoingtocostandwhatthepotentialnegativesideeffectsare– thisiswhatisworthitsweightingold.Mostpeoplewhocallthemselvesexpertsarenotreallygrapplingwiththesequestions.”– GCEgrantee

“TheimportantadvanceslieinthenuanceaboutwhendoesCongressneedsecrecy,whendoesopendatacreateariskofabuse,andhowmuchisthisdatabasegoingtocost.Thesearethehardquestionsatthecoreofopendataadvocacythatarelargelyignored.”– GCEgrantee

D.“Opendata”asaconcepthasdemonstratedlimitationsaddressingrelatedrisksandmaximizingopportunitiesofdatause

24


Evolutionandimpact

Lessonslearned


25

Lookingforward,theopendatafieldrequiresadditionaleffortstocementnorms,changepolicies,andstrengthentechnicalcapacity

Sources:RobertWoodJohnsonFoundation,“ExitingResponsibly:BestDonorPracticesinEndingFieldSupport,”2011;TheODC,“TheOpenDataCharterWebpage,”2018;OpenGovernmentPartnership,“TheOGPExplorer,”2018;TheStateofOpenData,“Donors– StakeholderChapterWIP,”2018;Deloitte,“AssessingthevalueofTfL’s opendataanddigitalpartnerships,”2017;Stakeholderinterviews,2018;andDalberganalysis

• Energizeandempowercitizensandotherusers(e.g.,infomediaries)todemandpublicdata,astheywouldforanypublicgood

• Address datarisksandconsiderhowtoprotectindividualprivacyandpromoteethicaldatause• Increaseawarenessofopendata’stangibleimpacts

• Increasesustainabilityofmanyorganizationswhostruggletosecurefunding

• Supportdatausecollaborationsthatmaximizeimpact• Trainusersandpotentialuserstomakeuseofavailabledatafordifferentactivities(e.g.,decision-making,entrepreneurship,civicparticipation)

• Ensuretechnical capacity existstoensurelong-termsuccess(e.g.,ingovernment)

Norms

Narrative

Institutions

Constituency


capacity

• Embedopendatainmorelawsatnationalandsub-nationallevels• Driveimplementation ofopendatacommitments

Policies

KEY PRIORITIES TO STRENGTHEN THE FIELD

• Normstoopendataexist,butsocialactionislow(e.g.,limitedactionafterTrumpclosedvariousdatasets)

• WidespreadnarrativewithODknowledgeanduseinmanycountries,sectors,andgroups

• Well-establishedspecializedinstitutions(e.g.,ODI)• StrongODenablers (e.g.,IATI)

• Clearchampions(e.g.,France)• Widespreadsupportfromvariousregions(e.g.,LAC,Africa)

• Lowtechnicalcapacityanddigitalliteracytodrivedatause

• FewcountrieshaveODlawsorlawsthatincludeOD• SomecountrieshaveODpolicies

OPEN DATA TODAY

Opendata Implications

26

Manyexternalfactorswillinfluencethefutureofopendata

Sources:Stakeholderinterviews,2018;Dalberganalysis


Lackofpoliticalwillingovernment

Politiciansbecomeunwillingtocreateorimplementopendata

initiatives

Hostilecompanypractices

Digitalgiantsbecome“toobigtofail”andholdvastpoweroverdata

Societiesaversetoopenness

Peoplebecomeaversetoopenness,asitisunderstoodasa

surveillancetoolorotherprivacyrisk

Politicalwillingovernment

PoliticiansbecomechampionsbycreatingandimplementingOD

policiesandlaws

Responsiblecompanypractices

Companiesadoptpractices/areregulatedtoprotectdataprivacyand

ethics

Societieswithanappetiteforopenness

Peopleunderstandtherisksandrewardsof

opennessandpressureformore

Opendataprogresses

Opendatabacktracks

27

Basedonthesetrends,opendataeffortscouldmoveinseveraldirections


2025

Sources:Stakeholderinterviews,2018;andDalberganalysis

ODissustainedasafieldinandofitselfandhasdedicatedorgsandchampions

pushingforit

Energyshiftstoothertrends(e.g.,privacy)andopendataisdeprioritized

Anewframetiesmanydata-relatedtopicstogether,

includingopendata

Sector-specificdataeffortsdominate,withopendataasacomponentofabroadereffort

28

Annexes:• Opendata

• FieldSustainability

• Sourcesandreferences

29

Acombinationofchampionsandpoliticalforcesfueledcriticaldevelopmentsacrosstheopendatasystem

Notes:1.Thesedescriptionsillustratekeyrolesthesesegmentsofactorshaveplayedsofar,hencearenotexhaustive.2.data.gov,“homepage,”2018.Sources:data.gov,“homepage,”2018,andstakeholderinterviews,2018.

Key

players

Mainachievem

ents

1Segm

ent

• Builtorgsinthefield

• Fundedkeymilestones(e.g.,creationofODcharter)

• Strategicallyadvocatedformoreopendata(e.g.,fundersaroundG8andG20summits)

• SupportedkeyODgroupsfocusedondevelopingregions(e.g.,OD4DfundedbyIDRC,WB,andUKaid)• Fundedkeystudies(e.g.,supported“TheStateofOpenData”report)

• Openedimportantdatasets(e.g.,USgovhas~200,000datasets2)

• Setpolicies&standardsaroundtheproductionofopendata

• CommittedresourcestoOD(people,budget)

• Supportedpoliciesandstandards(e.g.,Sunlight’sleadershipingeneratingODstandardsin2007)• Stewardedprogressthroughconstantresearchandmonitoring

• Generatedopendataforuse

• Fundedopendatainitiatives(e.g.,supportofGoogletoWWWF)• Usedopendataforproducts(e.g.,Google’suseoftransportOD)

• CreatedpressuredemandingODfromgovernments

• Usedopendatatocreatestartups• Usedopendataforanti-corruption

• ProvidedfundstoimportantODusers(e.g.,Godan’ssupporttofarmers)

• CommittedgovernmentstoOD(e.g.,OGPpledges)

• CreatedODqualitystandards

INFOMEDIARIES

MEDIACITIZENSACTIVISTS

STARTUPS

ECOSYSTEMPOLICY&STANDARDS

DATASUPPLY

Opendata Evolution

Foundations

DATAUSE

Dev.Agencies Multi-stakeholder Govs. Research

inst./NGOs Privatesector Other

30

Ecosystem:Fundershavesupportedtheuptakeofopendata—primarilythroughsector-focusedefforts

Notes:1.OpenGovernmentPartnership,“TheOGPExplorer,”2018.2.TheODC,“TheOpenDataCharterWebpage,”2018.3.TheState ofOpenData,“Donors– StakeholderChapterWIP,”2018– AstheStateofOpenDataisstillawork-in-progress,thisinformationmaychangewhenfinalizedandreviewed.Sources:TheODC,“TheOpenDataCharterWebpage,”2018;OpenGovernmentPartnership,“TheOGPExplorer,”2018;TheStateofOpenData,“Donors– StakeholderChapterWIP,”2018;Stakeholderinterviews,2018;andDalberganalysis.

1212

1110

77

655555

333

222

111

Transport

Governmentfinance

Education

JournalismandMediaDataLiteracy

Humanitarianrelief

NationalStatistics

CivilSociety

Health

CrimeandJustice

Anticorruption

EnvironmentMeasurement

Extractives

AgricultureUrbanDevelopment

GenderEquality

LandOwnershipCorporateOwnership

Researchers

PrivateSector

Numberofopendatadonorssupportingasector1Numberofdonors,2018 • Opendatahasthesupportofatleast55funders,

concentratedinjournalismandmedia,dataliteracy,nationalstatistics—andlesssointransport,privatesector,andeducation 1

• Thefivedonorsthatsupportthemostsectorsinopendataare:IDRC(10),GCE(9),Hewlett(9),OpenSocietyFoundation(8),andUK’sDepartmentforInternationalDevelopment(8)1

• Someactorsnotedlackofcollaborationbetweendonors—e.g.,fundingsimilaractivitieswithoutcoordinatingwitheachother;notlookingfor“jointcollaboration”opportunities

KEYFINDINGS

Opendata Evolution

“Alotoffocushasgonetowardscreatingsystems,butnotonthemoresystemicsupportthatorganizationsandgovernmentsneedtogetopendataembedded.”– ODexpertandGCEgrantee

“Wewereabletoadvanceinlargepartduetointernationalfundingforourefforts.”– National-levelcivilsociety

31

InMarch,2018afoundationProgramOfficerstartedaTwitterdiscussionbystatinghewishedchampionshad“pushedservicedesignratherthanopendataadecadeago.” Thisledto200+responsesthatcapturecurrentperspectivesandsentimentsacrossmanyopendatachampionsandadvocates.

Ecosystem:Someopendatachampionsareuncertainaboutthefuture

Notes:1.Twitter,“Twitterwebpage,”2018.Sources:Twitter,“Twitterwebpage,”2018;WorldWideWebFoundation,“OpenDataBarometer,4th Edition,"2016;Stakeholderinterviews,2018andDalberganalysis

• SomechampionsbelieveODhasnotdeliveredonitsinitialpromise—partlyduetoimpossiblyhighinitialexpectations

• Someintervieweesnotedthat opendataeffortscenteraroundthe“usualplayers”(i.e.,donors,funders,andadvocates)andhavenotfullytappedintorelatedinitiatives/projects(e.g.,dataworkinsectors)

• Theecosystemisstilltryingtostrikethecorrect balancebetweenmainstreamingthefield(e.g.,becomingembeddedinmanysectors) andfocusingoncoreopendatainfrastructure

• Someactorswanttomove—andaremoving(e.g.,ODI)—opendatatoabroaderdataframework. Butmanyadvocatesremainunsureabouthowbesttodothis

KEYFINDINGS

“…Idefinitelydonotthinkweshouldlookforuseofdatasetsbutotherwayaround,problemfirst.Theeraof‘govtdataandtheinvisiblehand’isnolonger”- Funder

SPOTLIGHT:TWITTERDISCUSSIONONOPENDATA1

Opendata Evolution

“OpenDataontheopioidcrises,climatechange,housingprices,rentalcosts(…)hasbeeninstrumentalinhelpingofficialsandthepublictackleissuesthatI’mnotsurestartasUXproblems.”– ITandgov.expert

“…Servicedesigniscritical,butsoisfreedomofinfo.thetwoevencomplement(…),ifdoneright.Idon'tseethisasan"either/or"issue:thepublicbothneeds&deservesbetterUX,UI&accesstoinfo.”- NGO

“ODisavictimofitsownsuccess asitbuiltagreathype,anditdidnotprovethedirectreturnofinvestmentsitpromised”– ODexpert

“Rightnowthereisalotofuncertaintyaroundwherethingsaregoingandwhatneedstohappeninthefuture,foropendata”– GCEgrantee

32

1114

20232426

33353739394142

4954

LegislationContracts

Spending

Ø32

BudgetEducation

MapCrime

TransportEnviron.

LandCompany

ElectionsHealth

TradeCensus

Datarelease:Qualityofopendatavariesacrosssectors,partlyduetosensitivitiesaroundcertaintopics

Notes:1.WorldWideWebFoundation,“OpenDataBarometer,4th Edition,"2016.Sources:WorldWideWebFoundation,“OpenDataBarometer,4th Edition,"2016andStakeholderinterviews,2018

Opendata Evolution

SUPPLYPERTOPICOpenDataBarometerrating,bytopic1Averagescore(0-100),2016

• Qualityofopendatasetsislowonaverage,particularlyforspending,land,andcompanydata

• Datasetsthatcanbemostimpactfultodrivetransparencyandaccountability(e.g.,spending,land)canbethehardesttoopenandimproveastheyhavehighpoliticalsensitivity

• Someintervieweesnotedthatthemovementofpeoplefromtheopendatafield(e.g.,ODI)toothersectorsisa catalystofopendataquality,asthesepeopletransferbestpracticesandknow-how

KEYFINDINGS

“Togetgovernmentstoopenpotentiallycontroversialorsensitivedata,youmustfirstapproachthemwithafriendliertoneofopeningweatherortransportdata,andworkfromthere.”- Donor

“Oneofourfirstprojectswasmakingninegovernmentprocurementdatasetstalktoeachother.Whenweweredone,weendedupknowingmoreaboutthegovernment’sprocurementsthanthegovernmentitself.”– Thinktank

33

OPENDATAUSE

Datause:Opendatauseandimpactshowgrowth,butchallengesremainaroundtechnicalcapacityandunderstandingvalue

Notes:1.WorldWideWebFoundation,“OpenDataBarometer,4th Edition,"2016.Sources:WorldWideWebFoundation,“OpenDataBarometer,4th Edition,"2016andStakeholderinterviews,2018

Measurestheextentofuseofopendatainpolitical,social,andeconomicfields;ODhasdemonstratedasmallbutsteadyrisedrivenbyNorthAmerica,EastAsia,andEurope

23,7

18,6

20162013 2014 2015

22,620,8

“Todayveryfewpeoplecananalyzeoruseopendata,asitneedsahighleveloftechnicalknowledgethatmanylack.”– OpenDataAdvocate

“Wehavehelpedentrepreneursimprovetheirbusinessbyteachingthemhowtouseopendata.Forexamplewehadthecaseofaclothessalesmanwhoimprovedhissaleswithwhatwetaughthim.”– Governmentofficial

“Someofoureffortswithopendatahavebeenhugelyimpactfulinthecountry.Forexampleweuncoveredahugelossofpublicfundsfromteachersthatweregettingpaidsalarieswhodidn’texist,andsupportedthegovernmentinrectifyingthis.”– Researcher

Opendata Evolution

OpenDataBarometerimpactindex1Index(0-100),2013-2016

34

Organizationsusingopendata,bysector1%oforganizationsineachsector,2016

Datause:Usecasesexistacrossabroadarrayofsectors

Notes:1.CenterforOpenDataEnterprise,“TheOpenDataImpactMap,”2016.2.Othersectors– indescendingorder:Healthcare, Transportationandlogistics,Mediaandcommunications,Education,Housing,ConsumerAgriculture,Other,andCultureandtourism.Sources:CenterforOpenDataEnterprise,“TheOpenDataImpactMap,”2016andStakeholderinterviews,2018

Opendata Evolution

SPOTLIGHT:USEACROSSSECTORS

“ThebiggestopendatasuccessstoriesprecedetheODmovement,suchasGPSorweatherdata.”– Technologyexpert

“Theprivatesectorisgreatatidentifyingusefulopendataandreapingbenefitsfromitinthenearterm.Thisuseofopendataisveryimpactfulandmuchlesspoliticizedthantraditionalopendatausecases.”– Opendataexpert

7%

15%

17%

26%

Financeandins.Energy&climate

Research

Governance

ITandgeospatial

1,783

6%

Thissubset—whichisnotrepresentative—showsorganizationsareusingopendataacrossarangeofsectors.ThesubsetisbiasedtowardsorganizationsinNorthAmericaandEurope.

35

Fiscalgovernance:Progresswithinfiscalgovernancesub-domains

Opendata Evolution

Notes:1.TheExtractiveIndustriesTransparencyInitiative,“EITIWebpage,”2018.2.OpenOil,OpenOilwebpage,"2018.3.TheOpenContractingPartnership,“OCPwebpage,”2018.4.TheInternationalBudgetPartnership,"IBPwebpage,"2018.5.TheGlobalInitiativeforFiscalTransparency,"GIFTwebpage,"2018.6.TheInternationalBudgetPartnership,"TheOpen BudgetSurvey2017,"2017.Sources:TheExtractiveIndustriesTransparencyInitiative,“EITIWebpage,”2018,OpenOil,OpenOilwebpage,"2018,TheOpen ContractingPartnership,“OCPwebpage,”2018,TheInternationalBudgetPartnership,"IBPwebpage,"2018,TheGlobalInitiativeforFiscalTransparency,"GIFTwebpage,"2018,TheInternationalBudgetPartnership,"TheOpenBudgetSurvey2017,"2017andStakeholderinterviews,2018.

SPOTLIGHT:EXTRACTIVES SPOTLIGHT:CONTRACTING SPOTLIGHT:BUDGETS

• Culturearoundreleasing datastarted~2002– withTonyBlair’sannouncementoftheExtractiveIndustriesTransparencyInitiative(EITI).Extractivesdatastartedbeingreleased,butqualitywaslowastherewerenoclearstandardsandreleaseswerenotdigital.1EITIputinplaceopendatapolicyin2013-2015

• Strongconstituencyexists– EITIhas51implementingcountries,$2.4trilliondisclosed,and95%ofdatasetscomplywithODestablishedstandards;1 OpenOilcreatedin2011tobringopendatatoolstotheoilindustry2

• Demonstratedimpact– Nigeriarecovered$2.4billionofunpaidrevenueandidentified$9billionitexpectstorecover1

• BornafterOD– theopencontractingfieldwasborn~2012withtheOpenContractingPartnership(OCP),whereopendatastandardsplayedacentralrolefromthebeginning3

• StrongODorganizations– e.g.,OCP’sopenstandardshavegainedcommitmentfromover30governmentstodate3

• Demonstratedimpactwithstrongusecases– ~10%savingsforgovernments;3inParaguay,themediausedopencontractingdatatoforcetheexitoftheEducationMinisterduetoanirregularcateringcontract

• Focusonpurpose-drivenaction–e.g.,withinOCP,opendataisseenasameanstoanend,notanendinitself

• EffortsforopenbudgetsprecedesOD– effortsforopenbudgetscanbetracedbacktothe80’s– e.g.,in1985Disha,acivilsocietyorganizationinIndia,gatheredbudgetdataanduseditforadvocacywork4

• Existingopenbudgetstandards-e.g.,TheGlobalInitiativeforFiscalGovernancehasdeveloped10principlesforopenbudgets5

• Limitedavailabilityofdata-~75%ofcountriesdonotpublishsufficientbudgetinformation4

• Recentbacktrack- After10yearsofprogress,therewasaglobaldeclineoftwopointsintheOpenBudgetSurveyfrom2015-17,partlyduetogovernmentcrackdownonCSOs6

36

Opendatainsectors (1/4)

Notes:1.GODAN,“GODANwebpage,”2018.2.RiSSC,“RevolutionDelayed?AstudyontheimpactofOpenDataonCorruption,”2015.3.WWWF,“TheOpenDataBarometer4thedition,”2016.Sources:OD4D.“TheStateofOpenData– WIP,”2018;WWWF,“TheOpenDataBarometer4thedition,”2016;RiSSC,“RevolutionDelayed?AstudyontheimpactofOpenDataonCorruption,”2015;WWWF,“CONNECTINGTHEDOTS:BuildingtheCaseforOpenDatatoFightCorruption,”2017;ODCharter,“ODCharterwebpage;”GODAN,“GODANwebpage,”2018;Stakeholderinterviews,2018;andDalberganalysis

Opendata Evolution

Sectors Keyactors Keyactivities/progress Keyimpact Lingeringgaps

Agriculture

• GODAN• WB• AfDB• AidData• CGIAR

• StrongODorganizations- e.g.,GODANhas~700partners1• Vastuseandimpactofweatherdatafordecision-making(e.g.,sowingday,harvesting)

• Provenimpact– e.g.,GODANpublishedtwovolumesofODimpact

• Confusionindataownership• Lackofincentivestoprovidedata• Limitedusebysmallholderfarmers

Anti-corruption

• ODCharter• CSOs• Media• OGP• OCP• WWWF• TACOD• RiSSC

• Growingsupport- ODcharterhasdefinedprioritydatatofightcorruption• UsesofODtocall-outorlookforcorruption– e.g.,RegardsCitoyens,aFrenchCSO,createdaplatformreusingODshowinggiftsfrompharma.toDrs.

• Limiteddirectimpactevidence-e.g.,2015RiSSC studyfoundthatODdidn’thaveacausaleffectonanti-corruption2• CasestudiesofODuseforanti-corruption- InGermanyofcitizensstewardingpharma’sgiftstoDrs.

• Disconnecteddevelopmentofanti-corruptionandopendatalosingopportunitiestoaddvalue• Dataiscommonlyunavailable,hasqualityissues,andpeopledon'thavetheskillstouseit• Difficultytomovefromcorruptiontopersecution

Corporate

• OpenCorporates• GovLab• GlobalWitness• Open-ownership• TransparencyInternational• EITI

• Centralregistriesofbeneficialownershipexistinafewcountries(e.g.,UK,Ukraine,Denmark)• Testingofabetadatastandardtodescribebeneficialownership(BODS)

• ExistenceofanindextomonitortheuseofOD– theCompanyDataIndex• Knownuseinuncoveringscandalsthroughtheidentificationofshellcompanies(e.g.,PanamaPapers)

• Littleuseofstandardsforcorporateregistries• Limitedinteroperabilitybetweendatasetsduetoweakstandards• LowavailabilityofdataasOD(e.g.,ODBarometerfoundthat5%ofregistriesareOD3)

Crime&justice

• IDRC• OGP• ODI• MySociety• GovLab• UpTurn

• Opendataisgainingattentionasatoolforcrime&justice–particularlywithinternationalorganizationsthatpushODpolicies(e.g.,OGP)

• ProvenimportanceofODforcrime&justice(e.g.,theGovLab’s CriminalJusticeInnovationProject)

• PoliticalandculturalbarriersreduceOD’simplementation• Limitedinteroperabilitybetweenavailabledatasets• Limitedpublicationofjudicialdatainopenformats

Education

• OpenStateFoundation• Academia

• Opendataisusedasaninput,output,andsubjectofeducation• DatareportingforSDGsoneducationhaveimprovedtheirqualityrecently

• StrongimpactcasessuchasMejoratuEscuelainMexicoormonitoringschoolbudgetcutsintheUK

• LowresearchontheusesandneedsofODineducation• Researchersrarelymaketheirdataopen,makingverifyingresultsdifficult

37


Sources:OD4D.“TheStateofOpenData– WIP,”2018;IATI,“IATIwebpage,”2018;PublishWhatyouFund,“AidTransparencyIndex,”2016;OpenDataWatch,“OpenDataInventoryIndex,”2017;WWWF,“TheOpenDataBarometer4thedition,”2016;GIFT,“GIFTwebpage,”2018;International BudgetPartnership,“TheOpenBudgetSurvey,”2017;GIFT,“OpenBudgetData:MappingtheLandscape,”2015;Stakeholderinterviews,2018;andDalberganalysis

Opendata Evolution


Internationalaid

• IATI• PublishwhatyouFund• GlobalHumanitarianAssistance• Dev.DataHub• AidData• AllVoicesCount

• Activetrackingandmonitoringofprogress- e.g.,AidTransparencyIndexpublishedsince2011• ExistinginternationalconsensusonODrequirementsandneeds-e.g.IATIinitiative,HDXlabsinDakarandNairobi

• Monitoringofaiddonorperformanceinreportingactivitiesestablishedclearbenchmarksandoversight• Improvedcoordinationamongdonorsingeographiesandtopicsbeingsupported

• LimitedknowledgeofIATIstandardsamongpeoplewhoareinterestedinaidinformation,asfoundbya2015USAIDstudy• Limiteduseindecision-making,asnotalldonorsarebasingtheirdecisionsondataorarenotprioritizingit

Nationalstatistics

• OpenDataWatch• OKI• ODCharter• IDRC• UNF• WB

• Strongstridesinopeningdatasets- e.g.,ODINscoresforover180countriesshowprogressthroughitsthreeeditions• Countriespublishingdataareworkingtoestablishstandards(e.g.,France)

• CountrieshaveimprovedreportingonachievingSDGcommitments,accordingtotheOpenDataInventory• CensusdataisthehighestqualityopendataaccordingtotheOpenDataBarometer

• Progressinimprovingcoverageofmissingdataisslow• LackofmanydatasetsessentialtomeasuringSDGprogress• Littlegenderdisaggregationdata• Lowpoliticalsupportforqualitydata

Urbandevelopment

• OpenCities• OKI• SunlightF.• CitiesClimateLeadershipGroup• OD4D• OpenDataSoft

• Stronginfrastructuretosourcedata– e.g.crowdsourcing,crowd-mapping• Existingmulti-stakeholdercoordinationwhichenhancesdata’sinteroperabilityandmaximizessharedinfrastructure

• Strongtechnicaldevelopmentsinthefield- e.g.,SDGtrackingthroughgeospatialdata,improvedestimationofurbanpoverty

• Multiplestakeholders– includinggovernment– lackknowledgeofexistingtoolsand/ordonotusethemfordecision-making

Governmentfinance

• FollowtheMoneyNetwork• InternationalBudgetPartnership• GIFT

• Effortsthatprecedetheopendatamovement– somethatdatebacktothe80s• StrongCSOsupport,duetoitsimportanceforadvocacywork• 2017OpenBudgetSurveyshowsprogressstallingfrom2016-17,afteryearsofcontinuedprogress

• Multiplerecordedusecases-e.g.,over250casesrecordedintheOpenDataImpactMap• Evidenceofimpactatagloballevel- e.g.,2015GIFTresearchcoded120impactcases

• Mostbudgetdataavailableistoohighlyaggregated• Spendingdataisnotreadilyavailableandisthelasttypeofdatagovs.arewillingtoopen• ImplementationoftheG20OpenDataPrinciplesislowandinadequate

38


Notes:1.EITI,“2018EITIProgressReport,”2018.2.PublishWhatYouPay,“Uk governmentreviewofthereportsonpaymentstogovernmentsregulations,”2017.3.CenterforOpenDataEnterprise,“TheOpen DataImpactMap,”2016.4.Deloitte,“AssessingthevalueofTfL’s opendataanddigitalpartnerships,”2017.Sources:CenterforOpenDataEnterprise,“TheOpenDataImpactMap,”2016;PublishWhatYouPay,“Uk governmentreviewofthereportsonpaymentstogovernmentsregulations,”2017;OD4D.“TheStateofOpenData– WIP,”2018;IATI,“,EITI,“2018EITIProgressReport,”2018;EITI,“EITIWebpage,”2018;TheGovLab,“OpenDataImpactWebpage,”2018,Deloitte,“AssessingthevalueofTfL’s opendataanddigitalpartnerships,”2017;Stakeholderinterviews,2018;andDalberganalysis

Opendata Evolution


Extractives

• EITI• PublishwhatyouPay• OpenOil• OCP• ResponsibleMiningIndex

• 51EITIcountrieshavedisclosed95%oftheirdatainODformat1• 51EITIcountrieshaveagreedtoprovideproject-leveldisclosuresfromthefinancialyearof2018,inODformat1

• ~65companiesdisclosedataintheUKthroughanextractivesdisclosureAPI2• Countrieshaveimprovedtheirmanagementofextractives- e.g.,NigeriarecoveredUSD2.4billionunpaidandidentifiedUSD9billionexpectedtorecover1

• Blackboxmethodologies–particularlyfromprivateactors–remainsacommonpracticeinextractives- e.g.,howdealdecision-makingisdone• Manyvaluabledatasetsremainprivate

Health

• MoHs• BMGF• IDRC• MCC• Pepfar• GovLab

• VariousMoHs haveledeffortstoopendataatnationalandsubnationallevels- e.g.,ODworkinMexicobytheSlimFoundationandtheMoH• Increaseduseofautomationindatacollectionhasimprovedthequalityandveracityofdata

• Tangibleimprovementofhealthsectorgovernance– e.g.,sub-SaharanAfricahasreceivedsignificantinvestmentstoimprovehealthdata

• Accountabilityremainslimited• Thereistensionbetweenopenandpersonaldataissues• Insomecountriesopeninghealthdataisdifficultwithoute-governmentinfrastructure

Environment

• Resourcewatch• Specializedplayersinsub-topics– e.g.,climatechange,airquality,biodiversity,water,forest

• Strongpoliticalbackingbyalmostallcountries– e.g.,TheParisAgreementrequirescountriestoreleaseODdetailingprogressagainstgoals• MorecomprehensiveenvironmentODplatformsareemerging- e.g.,wdc.org.ua

• Sensorsarebeingimplementedatarapidpace,allowingmultiplestreamsofdatatobemadeavailableforresearch• TheOpenDataImpactMaphastrackedover100casesoforganizationsusingenergyandclimatedata3

• Lackofacomprehensiveinventoryisresultingincollectionofdatathatcouldalreadybeavailable• Lackofcommonstandardsreducesuseandinteroperability• Difficultyincreatingstrongbusinesscaseshampersfunding

Transport

• Transportationcamp• Oasisproject• GovLab• Eurocities

• TransportdatasuccessstoriesprecedeODconversations• Transportdataiscommonlyusedonaday-to-daybasisbymanytonavigatecities

• Strongimpactcases– e.g.,TheTransportforLondon’s(TfL)ODhasgenerated~USD150millionfortheLondoneconomy4• Stronguseofdata– e.g.,withTfL’s data~600appswerecreated,usedby42%ofLondon4

• LittletransportdataispublishedincompliancewithOD’stechnicaldefinition• Limiteddatainteroperabilityduetolackofuseofcommonidentifiers

39


Notes:1.OpenKnowledgeFoundation,“GlobalOpenDataIndex,”2015.Sources:OD4D,“TheStateofOpenData– WIP,”2018;ODI,“Openbanking:settingastandardandenablinginnovation,”2018;BeckyHogge,“OpenDataSixStoriesAboutImpactintheUK,”2015;TheCadasta Foundation,“Cadasta Website,”2018;OpenKnowledgeFoundation,“GlobalOpenDataIndex,”2015;Stakeholderinterviews,2018;andDalberganalysis

Opendata Evolution


Land

• Cadasta F.• LandMatrix• AccessLand• GlobalLandAlliance• PRIndex• Radiant

• Continuedworkfromspecializedstakeholders,withthesupportofODspecialists– e.g.,TheCadastaFoundationandOpenKnowledgehaveworkedtogethertoexploreopenlanddata• Focusedworkongeospatialmappingdata,byincreasingaccuracyandhelpingcommunitieswithnoformallandrecognition

• ThelandrecordsauthorityofUK(HMLandRegistry)freedtwoofitslandownershipdatasets,howeverthetermsofre-usewerechangedinApril2017andthedatasetisnolongertechnicallyopen

• Limitedsupply- ranksastheleastlikelydatatobeavailable(e.g.,leastopenamong15typesofdataintheopendataindex)1• Highaversionfromgovernmenttoopenthisdataduetopoliticalaversionandprivacyconcerns• Highaversionfromlandownersduetoprivacyconcerns,asestablishedby2016studybytheCadasta Foundation

Banking

• ODI• Barclays• COADEC• EY• HSBC• RoyalBankofScotland

• Developmentofstandards– e.g.,ODIdevelopedopenbankingstandards• Nascentfield– todate,theUKhasadoptedopenbankingandothercountrieshaveshownpromisingsteps(e.g.,Australia)

• TheUKhasbecomealeaderinOpenBanking• Impactdataislimitedgiventhateffortsarerelativelynascent

• Openbankingfacessubstantialdataconcerns– particularlyaroundclientprivacyandsecurity• SomebanksandFinTechcompanieshaveexpressedaversiontousingopenbankingstandards

40

Opendatainregions (1/3)

Notes:1.TheGovLab,“ODImpact,”2018.Sources:TheGovLab,“ODImpact,”2018;OGP,“IndependentReportingMechanism,”2018;OpenDataLabs,“OpenDataAsia2020,”2015;TheGovLab,”OD Impactwebpage,”2018;WWWF,“TheOpenDataBarometer4thEdition,”2016;OD4D.“TheStateofOpenData– WIP,”2018;Stakeholderinterviews,2018;and Dalberganalysis

Opendata Evolution


Asia

• WFOpenDataLabs• DataKind• OKI• IDRC• OD4D• WWWF

• VariousODcivilsocietyinitiatives,includingactiveinitiativestoimproveopendata– e.g.,OpenDataAsia2020whichsetstheregion’sODagenda• TangibleimprovementsinOD–e.g.,cleargrowththroughoutAsiainODBscores

• Nascenteffortsshowevidenceofimpactatoutcomeslevel,butnotyetchanginglives• Concreteimpactcasesexist–e.g.,useofODforNepal’searthquakerecovery,useofmappingdatatoidentifydengueoutbreakinSingapore,andIndia’senergymappingtoolESMI

• Fundinglimitationshavedrivenvariousinitiativestodry-upafterfundingends• Useislackinginlower-incomecountries,especiallycountriesinwesternandsouthernAsia• Limiteduseoutsideoftheprivatesector

SSAfrica

• WWWF• CodeforAfrica• OGP• ODI• FollowtheMoney

• PolicysupporttoODoradjacenttopics– e.g.,15countrieshaveconstitutionalmandateoranAccesstoInformationAct• Uptakeofglobalefforts– e.g.,commitmentsofvariousAfricancountriesunderOGP(e.g.,Kenya,CoteD’Ivoire)• Nascentpolicycommitments–e.g.,BurkinaFasostarteddraftingitsopendatapolicy

• Tangibleusecaseshavebeenchampionedmainlybyinfomediaries– e.g.,FollowtheMoneyKenyauncovereddeviationoffundstosupportfamilieswithleadpoisoning

• Limitedengagementfromciviliansandprivatesector,reducingpotentialODuses• LittlesustainabilityofOD– e.g.,Kenyaoriginallyledtheway,howevertheybacktrackedandnowcountrieslikeCoteD’Ivoirearebecomingregionalleaders• Lackofstronglegalframeworksincludingopendatapolicies,politicalwill,andfunding

WesternEurope

• OpenKnowledgenetwork• MySociety• OKI• ODI• WWWF• OpenCorporates

• Strongnon-govdataeffortsarebecomingmorecommon– e.g.,OpenScience,OpenGlam,TfL• GloballeadersinODhaveemergedfromEU,likeUK,France,andDenmark• Governmentshavededicatedfull-timeresourcestoODefforts– e.g.,Belgium’sdataharmonizationagencies

• Multiplestrongimpactcaseshavebeenrecorded– e.g.,Denmark’sreleaseofaddressdata,creatingdirectfinancialbenefitsfor2005-09of~USD70million,atacostofonly~USD3million;1 Sweden’slaunchofopenaid.sedisclosedaidfundingforhighertransparency1

• AlignmentofpoliciesacrossgovernmentagenciesremainschallengingandveryfewcountrieshaveengravedODintheirlegislation• Theprivatesectorcontinuestolagbehindgovernmentefforts,withexceptionslikeOpenCorporates

41


Notes:1.TheGovLab,“ODImpact,”2018.2.OECD,“BenchmarkingDigitalGovernmentStrategiesinMENACountries,”2017.Sources:TheSunlightFoundation,“ThesegovernmentopendatasetshavebeentakendownsinceTrumptookoffice,”2017;OECD, “TheMENA-OECDGovernanceProgramme,”2017;OECD,“BenchmarkingDigitalGovernmentStrategiesinMENACountries,”2017;OECD,“TheMENA-OECDGovernanceProgramme,”2015;TheGovLab,“ODImpact,”2018;OD4D,“TheStateofOpenData– WIP,”2018;WWWF,“TheOpenDataBarometer4thedition,”2016;Stakeholderinterviews,2018;and Dalberganalysis

Opendata Evolution


NorthAmerica&Oceania

• GovLab• OCP• SunlightFoundation• CfA• NewAmerica• ODI• Stronggovernmentleaders

• UseofODbygovs toengageinevidence-basedpolicymaking• Emphasisondataquality,toincreaseOD’susabilitybyciviliansandmachines(e.g.,AI)• MixofpoliticalheadwindsandtailwindsforOD– e.g.,USsupportslowdownatfederallevelduetochangeingovernment;Canada’sconsistentsupporttoODprovidesfull-timefocusedresources;NewZealand’sgovernmenthasmadeODcommitmentsandinvestmentsforimplementation

• NewZealand– OD,opensourcetools,andcrowdsourcingwereusedtodeveloptoolstorespondtonaturaldisasters,enablingcitizenstocheckthestatusoftheirhomesandsavedthegovernmentUSD~6millionincostswithinitsfirstyearofuse1• Canada– T3010providedamappingofthenonprofitsectorinODformatwhichhelpedimproveadvocacyworkbycreatingacommonunderstandingaboutareaswithduplicationofefforts1

• Limiteddatauseremainsasabarrierinmostcountries,asmanyciviliansrarelyengagewiththedataduetofactorslikelackofincentivesorlackofknowledge• Politicalheadwindshavedemonstratedfragilitiesinwhathasalreadybeenbuilt;forexampleafewmonthsaftertakingoffice,Trumptookdowndatasetsthathadbeenopen,likefederally-fundedteachingpositions

MENA

• ODI• OKI• IDRC• WB

• Thereisagrowingdatacommunity,withcapacitybuildingorganizationsanddata-driveninnovation• Progressinlegalreformsthatsupportopendata– e.g.,JordanandTunisiahaveaccesstoinformationlaws,whileEgypt,Lebanon,andMoroccohavedraftsforsimilarlaws2• Recently,almostallMENAgovsarebackslidingonOD,withlowerscorescomparedtothepreviousOpenDataBarometer

• TheLebaneseAssociationforDemocraticElectionsusedODtopromoteelectoraltransparencybyvisualizingvotertrendsinpastelectionstohelpcreatediscussionsandparticipationintheelectionprocess• InMorocco,Geospheresharmonizesurbandatafromdifferentsubnationalgovernmentsandothersourcestoprovideaneasy-to-usegeospatialplatformofMoroccangeospatialdata

• Lackofcivilsocietyengagementwithopendata• Littlepressureforgovernmentstomakedatapublicorprovideitinqualityformat• Lackofdatainfrastructuretocollectanddisseminateit

42


Sources:1.WWWF,“TheOpenDataBarometer4thEdition,”2016.Sources:TheGovLab,“ODImpactwebpage,”2018;WWWF,“TheOpenDataBarometer4thEdition,”2016;OpenDataCharter,“OpenUpGuide:UsingOpenDatatoCombatCorruption,”2018;TheOpenDataCharter,“ODCharterwebpage,”2018;OD4D.“TheStateofOpenData– WIP,”2018;Stakeholderinterviews,2018;andDalberganalysis

Opendata Evolution


EasternEurope

• DFID• USAID• WB• Governments

• IncreasedmomentumandpoliticalinterestaroundjoiningODglobalinitiatives– e.g.,variouscountriesfromWesternBalkansandtheCaucasusareconsideringopencontracting• ImprovedoverallawarenessaroundODandhowtocombineitwithothersourcesofdataforproblem-solving

• Ukraine’sProZorroexperiencehasservedasaglobalexampleofahighROIODinvestment• RolloutofthePersonalDemocracyForuminUkrainehashelpedconsolidatethecommunityacrosstheregion• InKosovo,abottom-upmovementforODhasgeneratedpressureforpolicy-makers

• Lackofsupportforcollaborativeinnovations– withmultiplesiloedeffortsatregional,national,andsectorallevels• Datainfrastructureandqualityarelow–e.g.,intheregion,only4%ofdatasetsanalyzedintheOpenDataBarometerwerefullyopen1

LAC

• OECD• Abrelatam• Red-Gealc• OpenContracting• OGP• ILDA• ECLAC• ODCharter• IMCO• CaribbeanOpenInstitute(COI)

• LAChasthehighestnumberofadoptersoftheODCharter• Promisingworkaroundfiscalgovernanceisoccurring– e.g.,morefiscalgovernancedataisavailableinLACthananywhereoutsideofWesternEuropeandNorthAmerica• Variouscooperationmechanismsandforumshavecontinuedinterest– e.g.,AbreLatam,Condatos• Strongpoliticalwill– e.g.,CostaRicaisworkingonadecreetoinstitutionalizeitsODPolicythroughparticipatorydialogue

• Strongimpactcasesareseeninalmostallcountriesoftheregion– e.g.,ATuServicioinUruguay,MejoraTuEscuelainMexico,BudgetTransparencyPortalinBrazil,andAclimate inColombia• StrongusebymediaandcommunicationsofOD– e.g.,LaNacion – anArgentineannewspaper– hasmadegovernmentdatamoreaccessiblethroughaplatformthatreusesitsocivilianscanaccessdatasetslikeconsumerindices,industrialdata,weatherdata,andCO2emissions

• LimitedeffectivenessofparticipatorymechanismsreducethepotentialimpactofOD,forexamplecorruptionscandalsmaybeuncoveredandputinthepubliceye,butfewconsequencesarehadduetoineffectiveinstitutions• Civilsocietygroupscommonlylackfinancialsupportfromgovernments,andmustworkwithverylimitedresourcestodriveforimpact• Governmentsandcivilsocietygroupscommonlywanttodomorewithopendata,butlackthetechnicalcapacity• Politicalinstabilityjeopardizesprogress– inCostaRica,afterachangeingovernment,thenewadministrationtookdownawell-functioningopendataplatform– asitwasassociatedwithpeoplefromthepreviousadministration– tostartfromscratch

43




44

Consideringfieldsustainability

Notes:1.Relevantfeaturefortechrelatedfields.FrameworkadaptedfromRobertWoodJohnsonFoundation,“ExitingResponsibly:BestDonorPracticesinEndingFieldSupport,”2011– withinputfromLarryHirschhorn,“IdeasinPhilanthropicFieldBuilding,”2004,TheInternationalConsortiumforOrganizationalResilience,“ICORWebpage,”2018.CenterforStrategic&InternationalStudies,“Resilience:ACriticalFrameworkforDevelopment,”2014.

• Standardsandprinciples: Havestandards,principles,and/orexpectationschanged?Towhatextenthavechangesspreadacrossdomainsandsectors(e.g.,government,privatesector)?

• Frame:Istheframingoftheissueunderstoodandreachingmultipleaudiences?• Cleargoals: Isthereacleargoalforthefield?

• Keyinstitutions:Dokeyinstitutionshavetheabilitytosuccessfullyweathershocks?• Diversefunding: Aretherediverse/multi-sectorsourcesoffundingandinvestments?

• Policychange: Aretherepolicychangesthathavebeenmadeasaresultoftheworkofthefield?Dofieldactorsmonitorandreportontheimplementationofrelevantpolicies?

• Techleadership:Aretechleadersdrivingprogressforward?• Knowledgeandcapacity: Doesthefieldhavethecapacityitneedstodriveresearchandevolution?

NarrativeAbilitytocreate,articulate,andagree

uponaframeandgoals

NormsCreation,adoption,andchangeofrelevantnormsandexpectations

PoliciesAbilitytoembedpracticesinpoliciesor

laws

InstitutionsExistenceofmultipleanddiverseorgsfocusedondifferentaspectsofthefield

ConstituencyInterestandcommitmentacross

relevantsupporters

Technicalleadershipandcapacity1

Recognizedleaderswiththetechnicalknowledgetodrivethefieldforward

ASPECTSOFSUSTAINABILITY CONSIDERATIONS

• Awarenessandsupport: Aregoalsofthefieldrecognizedandembraced?• Demand:Isthereapoliticalconstituencyormarkettosustaindemand?

45

Measurestoassesssustainability

FrameworkadaptedfromRobertWoodJohnsonFoundation,“ExitingResponsibly:BestDonorPracticesinEndingFieldSupport,”2011– withinputfromLarryHirschhorn,“IdeasinPhilanthropicFieldBuilding,”2004,TheInternationalConsortiumforOrganizationalResilience,“ICORWebpage,”2018.Center forStrategic&InternationalStudies,“Resilience:ACriticalFrameworkforDevelopment,”2014

Signsofnascentfield

• Unchangednorms• Scatteredpractices

• Newfield• Broadproblemarea

• Onemajorfunder• Neworganizations

• Lowpublicawareness• Disconnectedactors

• Dispersedtechnicalleadership• Littleknowledgebase• Limitedresourcestodrivechange

• Normsenactedandimplemented• Institutionalizedpractices

• Existingfield• Specificproblemarea

• Manyfunders• Establishedorganizations

• Highpublicappealorexistenceofconstituency• Highlyinterconnectedactors

• Robusttechnicalleadership• Significantknowledgeproduction• Sufficientresourcestodrivechange

Norms

Narrative

Institutions

Constituency


capacity

• Unchangedpoliciesandlaws• Unrecognizedbypoliciesandlaws

• Policiesandlawsenactedandimplemented• EngravedinpoliciesandlawsPolicies

Signsofasustainablefield

46




47

• Interviews:Dalbergconducted~40semi-structuredinterviewswithGCEgrantees,otheropendataexperts,privacyandAIethicsexperts,andotherrelevantactors.Theinterviewsfocusedonallfourofthelearningquestions.

• Quantitativeanalysis: Dalberganalyzedquantitativedatatounderstandtheevolutionofopendataandprogresstodate—disaggregatedbyregion,country,sector,andactorwherepossible

• Expertpanels: Dalbergconvenedanexpertpanelwithexpertsfromopendataandadjacenttopics(e.g.,privacy)todiscusskeyquestionsandthemesemergingfromanalysis.DalbergalsoattendedaStateofOpenDataeditorialmeeting.

• Literaturereview: Dalbergconsultedover100internalandexternalsources—includingacademicstudies,newsarticles,andwebpages—tosynthesizeawiderangeofperspectivesandinsights

Opendata:Methodologyandobjectives

• Thisstudyfocusedonfourlearningquestions:— Howandwhydidtheopendatafieldevolve

globallyoverthepastdecade?Whereisthefieldtoday?

— WhatrolehasGCEplayedinthefield?HowhasGCEcontributedtoecosystem,policy,andsocialimpact?

— WhatdidGCElearnaboutitsapproachtoinvestmentandinfluence?

— Whatarekeyopportunitiesforthefieldgoingforward?HowshouldGCEapproacheachfieldinthefuture?

• Thisstudydidnotaimto:— EvaluateallGCEopendatagrants— Provideacomprehensivemappingofallthe

sectors,countries,andactorsworkingonopendata

— Assessthedevelopmentofotherdatagovernancetopics(e.g.,privacy,AIethics)

— Compileandanalyzealldevelopments(e.g.,opendatalaws,policies,norms,andtechnicalstandards)

Methodology Objectives

48

Opendata– Externalreferences(1/3)

• BeckyHogge,“OpenDataStudy,”2010• Bloomberg,“FacebookGoesonaHiringSpreeforWashingtonLobbyists,”2018• CenterforOpenDataEnterprise,“TheOpenDataImpactMap,”2016• data.gov,“Homepage,”2018• CostaRicanGovernment,“Decreto Ejecutivo N°40199-MP,”2015• Deloitte,“AssessingthevalueofTfL’s opendataanddigitalpartnerships,”2017• Digitalcommunities,“What’sNewinCivicTech:NewLegislationinConnecticutBolstersState’sOpenDataEfforts,”2018• EITI,“EITIWebpage,”2018• EITI,"2018EITIProgressReport,”2018• FAO,“OpenData,”2015• FrenchNationalAssembly,“BillonaDigitalRepublic,”2016• GIFT,“GIFTwebpage,”2018• GIFT,“OpenBudgetData:MappingtheLandscape,”2015• Gobierno Mexicano,“Alianza paralasContratacionesAbiertas,” 2017• GODAN,“GODANwebpage,” 2018• Google,“GoogleTrends,”2018

• Medium,“Testing,learningandadapting:AyearinthelifeoftheOpenDataCharterteam,”2018• Hogge B.&TheGovLab,“TransportForLondonGetSet,Go!,” 2016• IATI,“IATIAwebpage,” 2018• InternationalBudgetPartnership,“TheOpenBudgetSurvey,” 2017• JoshuaTauberer,“OpenGovernmentData:TheBook,” 2014• Lexology,”AustralianGovernmentcommittedtoopendatawithresponsetoPrivacyCommission,” 2018• OD4D,“TheStateofOpenData- WIP,”2018• ODI,"ODIwebsite,"2018• OECD,“OpenGovernmentDataReviewofMexico,”2016• OGP,“OGPExplorer,”2018• OGP,“SouthAfrica2017-2019Commitments,”2018• OpenDataCharter,“Webpage,AboutUs,”2018• OpenDataWatch,“OpenDataInventory,”2017• OpenDataCharter,“OpenDataCharterwebpage,”2018• ODI,“Openbanking:settingastandardandenablinginnovation”,2018• ODI,“OpenStandardsforData:Guidebook,”2018

49


• ODI,“UsingopendataforeconomicimpactinNigeria,”2017• OECD,“BenchmarkingDigitalGovernmentStrategiesinMENACountries,”2017• OECD,“CompendiumofgoodpracticesontheuseofopendataforAnti-corruption,”2017• OECD,“TheMENA-OECDGovernanceProgramme,”2017• OGP,“GermanyFinallyhasanOpenDataLaw,”2017• OGP,“OGPNigeriaSelfAssessmentReport,”2017• OGP,“ThePhilippinesprogressreport2015–2017,”2018• OKI, "OKIwebsite,"2018• OpenContractingPartnership,“OpenContractingPartnershipwebpage,”2018• OpenDataCharter,“OpenUpGuide:UsingOpenDatatoCombatCorruption,”2018• OpenDataLabs,“OpenDataAsia2020webpage,”2018• OpenDataWatch,“OpenDataInventoryIndex,”2017• OpenKnowledgeFoundation,“GlobalOpenDataIndex,”2015• OpenCorporate,“AboutTimeline,”2018• PewResearchCenter,“Americans’ViewsonOpen

GovernmentData,”2015• PrivacyInternational,“Video:WhatIsPrivacy?,”2015• PublishWhatYouPay,“Uk governmentreviewofthereportsonpaymentstogovernmentsregulations,”2017• RiSSC,“RevolutionDelayed?AstudyontheimpactofOpenDataonCorruption,”2015• RouteFifty,“TheDifficultBalanceofTransparencyandPrivacyforLocalGovernments,”2018• SunlightFoundation,“TenPrinciplesforOpeningupGovernmentInformation,”2017• Techradar,“Hacktothefuture:insidetheYoungRewiredStateproject,”2012• TheCadasta Foundation,“Cadasta Website,” 2018• TheGovLab "Uruguay'sATuServicio,"2016• TheGovLab,“NepalEarthquakeRecovery,"2016• TheGovLab,“ODimpactwebpage,”2018• TheGovLab,“TheOD500GlobalNetworkwebsite,”2018• TheStateofOpenData,“Donors– StakeholderChapterWIP,”2018• TheSunlightFoundation,“TheSunlightFoundationwebpage,”2018

50


• Technical.ly,“ThesegovernmentopendatasetshavebeentakendownsinceTrumptookoffice,” 2017• TheSunlightFoundation,"SunlightFoundation990PublicDisclosures,"2018• TheWorldBank,“TheWorldBankDataRepository,”2018• TheWorldBank,“WorldBankSupporttoOpenData,”2018• Twitter,“Twitterwebpage,”2018• WorldWideWebFoundation,“OpenDataBarometerGlobalReport,1stEdition,"2013• WorldWideWebFoundation,“OpenDataBarometerGlobalReport,2ndEdition,"2014• WorldWideWebFoundation,“OpenDataBarometerGlobalReport,3rdEdition,"2015• WorldWideWebFoundation,“OpenDataBarometerGlobalReport,4thEdition,"2016• WWWF,“CONNECTINGTHEDOTS:BuildingtheCaseforOpenDatatoFightCorruption,”2017• YesBank&MeitY,“OpenGovernment,OpenData–Re-imaginingIndia,”2018• R4D,“OPENGOVERNMENTCASESTUDY:CostingtheProZorro e-ProcurementProgram,”2017• RobertWoodJohnsonFoundation,“Exiting

Responsibly:BestDonorPracticesinEndingFieldSupport,”2011

Retrospective assessment –Open DataProZorro, an open source and open data e-procurement system •...

Documents

Transcript of Retrospective assessment –Open DataProZorro, an open source and open data e-procurement system •...