New Call for Expressions of Interest - UBDCubdc.ac.uk/media/1329/ubdc-call-for-expressions-of... ·...

10
Urban Big Data Centre Call for Expressions of Interest Data available through the UBDC February 2016

Transcript of New Call for Expressions of Interest - UBDCubdc.ac.uk/media/1329/ubdc-call-for-expressions-of... ·...

Page 1: New Call for Expressions of Interest - UBDCubdc.ac.uk/media/1329/ubdc-call-for-expressions-of... · 2019. 9. 10. · area estimates of a wide variety of economic, social, built environment

Urban Big Data Centre

Call for Expressions of Interest

Data available through the UBDC February 2016

Page 2: New Call for Expressions of Interest - UBDCubdc.ac.uk/media/1329/ubdc-call-for-expressions-of... · 2019. 9. 10. · area estimates of a wide variety of economic, social, built environment

integratedMultimediaCityData(iMCD)Project:GlasgowHouseholdSurveyData3BackgroundoniMCDsurveydata 3HowtoaccesstheUBDC’siMCDSurveydata 4

SpatialUrbanDataSystem(SUDS)UrbanIndicators 4StravaMetroData:CyclingdatacoveringGlasgow 6BackgroundonStravaMetrodata 6StravaMetro-Streets 6StravaMetro-OriginDestination(OD) 6StravaMetro-Nodes 6

LiDARData:HighresolutionimagedataoftheEarth’ssurface 7BackgroundonLiDARdataanditsuses 7PrevioususeofUBDC’sLiDARdata 7

NestoriaData–GlasgowandPaisleyHousingMarket 8AccessingAdministrativeDatathroughtheUBDC 10LocalAuthoritydata 10Opendata 10

Page 3: New Call for Expressions of Interest - UBDCubdc.ac.uk/media/1329/ubdc-call-for-expressions-of... · 2019. 9. 10. · area estimates of a wide variety of economic, social, built environment

integratedMultimediaCityData(iMCD)Project:GlasgowHouseholdSurveyDataTheUBDC’siMCDProjecthasgatheredauniqueandexcitingcollectionofdatalookingaturbanlifeinGlasgow.WearenowabletoofferaccesstotheinitialdatafromtheiMCDHouseholdSurvey,inanonymisedform.TheSurveyhasauniquecombinationofquestionscoveringdetailedinformationabouteachhouseholdandtheirattitudesandbehaviourstotransport,education,computerandmobilephoneusage,andsustainability.Thesedatawouldbeofinteresttoplanners,researchersorindividualswantingtogainabetterunderstandingofthesetopicsandtheirinteractions.

BackgroundoniMCDHouseholdSurvey

TheiMCDHouseholdSurveyinterviewedarepresentativesampleofadultsintheGlasgowandClydeValleyPlanningareabetweenAprilandNovember2015.Thisareaincludesthefollowinglocalauthorities:Glasgow;NorthLanarkshire;SouthLanarkshire;Inverclyde;Renfrewshire;EastRenfrewshire;EastDunbartonshireandWestDunbartonshire.Aswellasbasicdemographicdata,thesurveyhasasignificantnumberofquestionsoneducation,transport,srustainability,andICTusage.Italsocontainsquestionsoncivicandculturalactivities,andneighbourhoodbelongingandsatisfaction.Thesurveywouldbeofuseforanyonewantingtogetdetailedinformationintheseareas.DetailsofthequestionscanbefoundintheiMCDSurveyTechnicalReport. Somevariableshavebeenremovedorhavehadresponsesgroupedtoensureanonymityofrespondents,andthereisnogeographicorlocationalinformation.However,inthenearfuture,afurtherversionofthedatasetwillbemadeavailablewithadditionalgeographicinformation,andmoredetailedinformationaboutindividualsandhouseholds. TheiMCDprojecthasanumberofotherdatasetsthatwillbeavailableinthefuturebutalsolinkedtothesurveydata.MoreinformationonthiscanbefoundontheiMCDprojectpage.

Page 4: New Call for Expressions of Interest - UBDCubdc.ac.uk/media/1329/ubdc-call-for-expressions-of... · 2019. 9. 10. · area estimates of a wide variety of economic, social, built environment

HowtoaccesstheUBDC’siMCDSurveydata

Thedata(availableinSPSSandCSVformats)isavailablethroughasimpleprocessofregistrationandagreementtolicensingterms.IfyouwouldliketousethedatapleasesubmitanExpressionofInterestandwecanarrangeaccesstothesedata.

SpatialUrbanDataSystem(SUDS)UrbanIndicatorsTheUBDCisintheprocessofdevelopingadatabaseofsmall-areaurbanindicators.CalledSpatialUrbanDataSystem(SUDS),theprogrammeaspirestocreatesmall-areaestimatesofawidevarietyofeconomic,social,builtenvironmentandphysicalindicatorsinUKurbanareas.TheSUDSprogrammewillallowresearcherstomap,analyseandotherwiseexaminespatialvariationsineconomicperformance,socialequityandwellbeing,andtoconductresearchandformulatepolicysolutionssurroundingsustainableandeffectivecommunities.Thisworkisongoing,sothecollectionwillcontinuetogrowoverthelifetimeofUBDC.

WehaveusedtheframeworkoftheISOStandard37120:2014“Sustainabledevelopmentofcommunities--Indicatorsforcityservicesandqualityoflife”,andtheworkbeingspearheadedbytheResearchDataAlliance’sUrbanDataInterestGroupandothers.TheISO37120standardisedindicatorsoutlineskeymeasurementstoevaluateservicedeliveryandqualityoflife,andaredesignedtohelpcitiesassessperformanceandmeasureprogressovertimetoimprovethequalityoflife.WehavestartedcreatingtheUBDCUrbanIndicatorsonOutputArealevelfor14built-upareasintheUnitedKingdom,basedontheISO37120.Table1belowlistsexamplesoftheSUDSindicatorswithdescriptionsandlinkstothevisualisationsofparticularindicators.

Page 5: New Call for Expressions of Interest - UBDCubdc.ac.uk/media/1329/ubdc-call-for-expressions-of... · 2019. 9. 10. · area estimates of a wide variety of economic, social, built environment

Table1:ExamplesofsmallareaurbanindicatorsfromSUDSprogramme

Indicator Link to the example

Spatial resolution

Percentage of persons in full-employment (%)

http://gis.ubdc.ac.uk:8080/geoexplorer/viewer/#maps/7

Output Areas for 13 built-up areas: Bristol, Birmingham, Cardiff, Leeds, Liverpool, London, Manchester, Nottingham, Sheffield, Southampton-Portsmouth, Glasgow, Edinburgh, Belfast

Unemployed: Aged 16-24 years (%)

http://gis.ubdc.ac.uk:8080/geoexplorer/viewer/#maps/8

Output Areas for 14 built-up areas: Bristol, Birmingham, Cardiff, Leeds, Liverpool, London, Manchester, Nottingham, Sheffield, Southampton-Portsmouth, Glasgow, Edinburgh, Belfast

Unemployment rate - all economically active and inactive (%)

http://gis.ubdc.ac.uk:8080/geoexplorer/viewer/#maps/9

Output Areas for 14 built-up areas: Bristol, Birmingham, Cardiff, Leeds, Liverpool, London, Manchester, Nottingham, Sheffield, Southampton-Portsmouth, Glasgow, Edinburgh, Belfast

Unemployment rate-all economically active only (%)

http://gis.ubdc.ac.uk:8080/geoexplorer/viewer/#maps/10

Output Areas for 14 built-up areas: Bristol, Birmingham, Cardiff, Leeds, Liverpool, London, Manchester, Nottingham, Sheffield, Southampton-Portsmouth, Glasgow, Edinburgh, Belfast

Public Greenspace

http://gis.ubdc.ac.uk:8080/geoexplorer/viewer/#maps/11

Output Areas for 14 built-up areas: Bristol, Birmingham, Cardiff, Leeds, Liverpool, London, Manchester, Nottingham, Sheffield, Southampton-Portsmouth, Glasgow, Edinburgh, Belfast

Job Accessibility Indicators (experimental)

http://ubdc.ac.uk/media/1325/birmingham-accessibility-map.pdf

Output Areas for 14 built-up areas: Bristol, Birmingham, Cardiff, Leeds, Liverpool, London, Manchester, Nottingham, Sheffield, Southampton-Portsmouth, Glasgow, Edinburgh, Belfast

Ifdatausersareinterested,wecangivethemaccesstothedatasotheycaneitherdownloadtables(CSV)orGISshapefileswiththedataassociatedwithit.Wearealsodevelopingaprocessforaccesstoaweb-basedGISsolutionsothatuserscanmapandvisualisethedatausingourwebservices.

Page 6: New Call for Expressions of Interest - UBDCubdc.ac.uk/media/1329/ubdc-call-for-expressions-of... · 2019. 9. 10. · area estimates of a wide variety of economic, social, built environment

StravaMetroData:CyclingdatacoveringGlasgowUBDChasStravaMetrocyclingdatacoveringtheGlasgowareafor2013-2014availableatnocostforresearchers.Wewillalsobecollectingthefollowing2years’worthofdatatothebeginningof2017.AfulldescriptionofthedataisavailableintheStravaMetroComprehensiveUserGuide.

Stravaisaserviceforcycliststologtheiractivity,withdatasubmittedeitherusingasmartphoneapp,orbyuploadingGPSdatathroughtheStravawebsite.Thecompanyisthepre-eminentserviceforcyclistsinparticular.

Thelevelofdetailprovidedallowsthedatatobeusedinavarietyofwaysbyawidevarietyofresearchers.Thedatahasthepotential,inconjunctionwithotherdatasets,toprovidenewandexcitingopportunitiesforresearchintoactivetravel,sustainabletravelandpublichealth.

BackgroundonStravaMetrodata

GoodqualitydataoncyclinguseintheUKisnotavailableelsewhere.Atbestdataoncyclingusageinmostcitiesisestimatedfromsurveydataorfromlimitedcordoncounts.StravahasthousandsofusersintheGlasgowClydeValleyplanningarea,withasizableproportionofcommutingjourneysrepresentedintheirdata.AsStravadataishighlycorrelatedwithoverallcyclingusage,thedataallowsuserstoestimatecyclingusageacrosstheGlasgowClydeValleyPlanningarea.Stravaprovidethedatainthreeformatsandwearemakingalloftheseavailable:

StravaMetro-Streets

Thisisthecoredataservice.Itisdefinedasaminute-by-minutereflectionofallcyclingactivityovertheGlasgowClydeValleyregionforafouryearperiodatthestreetlevel.

StravaMetro-OriginDestination(OD)

ThisbuildsoffoftheStreetsdataservicebyreportingthestartingandendingpolygonsofactivities.thesedataarereportedbytheminuteandcoversbeyondthestreetnetworktogetpolygonsofusersstartingoutsideoftheGlasgowClydeValleyarea.

StravaMetro-Nodes

Intersectionsareakeypieceofanystreetnetwork.TheNodedataserviceisdesignedtofocusontheseintersectionsandreportprimarilyuseandwaitduration.

Page 7: New Call for Expressions of Interest - UBDCubdc.ac.uk/media/1329/ubdc-call-for-expressions-of... · 2019. 9. 10. · area estimates of a wide variety of economic, social, built environment

InthefuturetheUBDCintendstopurchasesimilarStravadatacoveringallofScotlandfortheuseofresearchers.

LiDARData:HighresolutionimagedataoftheEarth’ssurfaceUBDChasacquiredLiDARdatacoveringGlasgowin2003forresearcherstouse.Thecoverageareaisshowninthemap:2003LiDARDatainGlasgow.

Wehavetwoexamplesofuseofthisdata(seebelow),andmorecoming:ouriMCDprojectiscombiningitwithsatelliteimagesofGlasgowtocompareGlasgow’surbanterrainovertime-3Dmodelsrelatedtothisworkareinthepipeline.

BackgroundonLiDARdataanditsuses

LiDAR—LightDetectionandRanging—isaremotesensingmethodusedtoexaminethesurfaceoftheEarth.LiDARdataisextremelyaccurate3Ddatageneratedfromsensorsonthegroundoronairplanes.

TherearevariousapplicationsthatmayuseLiDARdatatoimprovemanagementofdifferentprocessesorareassuchas:

• ADigitalElevationModel(DEM)isusedtoplanparksandtourismarea.Thishighlyaccuratelandsurfacemodelhelpstofindthebestareatoconstructaplayground,planttreesorplanwalkingpaths;

• AsurfacemodelcreatedfromLiDARcouldbeusedasagraphicalvaluetomaps.DEMisaddedunderneathalllayers,showinga3Dviewoftheland.

• LiDARdatacanbeaddedtoaerialphotographytoshowa3Dview,whichmakeseasiertoplanroads,buildings,bridgesandrivers.

Theseaccuratemodelshaveusesforlocalgovernmentplannerswhoneeddetailedstructuralplansofthecity.LiDARisalsoregularlyusedbyarchaeologists,computerscientists,andcivilengineeringcompanies.

PrevioususeofUBDC’sLiDARdata

HereareacoupleofexamplesofUBDCprojects,bothinvolvingGlasgowSchoolofArt(GSA),thathavealreadyusedthisdata:

Page 8: New Call for Expressions of Interest - UBDCubdc.ac.uk/media/1329/ubdc-call-for-expressions-of... · 2019. 9. 10. · area estimates of a wide variety of economic, social, built environment

• GSAmapofGlasgow-TheGSAusedinitialGPSdatafromtheiMCDproject,inadditiontoLiDARdata,toillustratemovementpatternsofmenandwomeninGlasgowCityCentreoverthecourseoftheweek.Usingthisdata,GSADigitalDesignteamcreatedthedatavisualisationvideo:Datascape–MovementPatternsinScotland’sLargestCity

• GSA/UniversityofGlasgowWesternInfirmarySiteProject-aftersuccessfullyusingtheLiDARdatatohelpwiththeabovevisualisation,theGlasgowSchoolofArtvisualisationteamusedthesamedatatoassistthemwithcreatinganinternalplanningresourceforGlasgowUniversityinitsdevelopmentoftheWesternInfirmarysite.Theyarecurrentlyusingittocreatevisualmodelsofthecurrentlandscape,andtheplannednewcampusdevelopmentattheWesternInfirmarysite.

NestoriaData–GlasgowandPaisleyHousingMarketTheUBDChasobtainedagreementfromNestoriaonprovidingadatabaseoftheirhousingadvertisementsfornon-commercialresearchpurposes.AnexamplerecordisavailableinTable2below.

ThisdataconsistsoflistingrecordsfromtheNestoriawebsitethathavebeenobtainedviaAPIfromMarch2015.Thedatabaseconsistsoftwodatasets:forsaleandtorent.ThedatawecanoffercoverstheareaofGlasgowandPaisley(GandPApostcodeareas),andconsistsofvariablessuchas:location(latitude,longitude),price(rent),numberofbedrooms,numberofbathrooms,keywords,listingagency,linksforimagesfromthewebsite,andlinktotheoriginallisting.Thedatasethasadvertsofover38,000individualpropertiesforsale,andasimilarnumberofadvertsofpropertiestorent.

Table2:ExampleNestoriarecord

Variable ExamplefromthedatabaseCrawlTime summary Hurryphasetwonowlaunchedthreebedbymctaggartmickel.

accomthe...img_url http://3.l.uk.nestoria.nestimg.com/lis/9/3/0/a43750110d17c12

3a79e629ad91177efc32ea.2.jpgthumb_url http://2.l.uk.nestoria.nestimg.com/lis/9/3/0/a43750110d17c12

3a79e629ad91177efc32ea.1.jpgprice_currency GBP

Page 9: New Call for Expressions of Interest - UBDCubdc.ac.uk/media/1329/ubdc-call-for-expressions-of... · 2019. 9. 10. · area estimates of a wide variety of economic, social, built environment

price_high 260000img_height 120auction_date title MoorRoad,Glasgow,Lanarkshire,G76thumb_width 60lister_url http://rd.nestoria.co.uk/rd?itype=2&l=XVeZoh9rq9shskd914&s

=&url=2-ePz73aTBU4LVGFByDI484Ner8aIMqOqnmnO6u50s2qDdmu-ced_G5rGpMAbDMkMIxZIZsli8WefUu6sPU8-oGzVkuh5PhhDYelfWSVFvNe7w2ViqEdrSf0AlbLz8TnY-ugC99lhEwA-iKi4B4mXSWi1g_RLNrJaSvbecndEDb2faiDM3UCvCZ3tuJw8kcgaZArPeSjbTSf6R9iXXsdggnS6-ycrZNBIOK4jLIaUH7cjH1uaTPzVe4a_64eksFBNXMLvns0acXyhul-KP_BuQQ0uWAqV5yEF0_WCx4pgl4WOILXK5YH4EaCg6FueZXMmM1j5Lg8BWn2-OISULfl3XvZ0%3D&v=2

bathroom_number

longitude -4.284870148img_width 160commission 0price_formatted 260,000GBPcar_spaces 0construction_year 0updated_in_days 160.5keywords Garden,NewBuild,Kitchenbedroom_number 3listing_type buythumb_height 60lister_name SlaterHogg&Howisondatasource_name NetHousePricesupdated_in_days_formatted

overamonthago

guid g1-TOtADN0gVOD9ETxszMwATN=Qprice_low 260000location_accuracy 9price_type fixedproperty_type houseprice 260000latitude 55.73611832row_number 1

Page 10: New Call for Expressions of Interest - UBDCubdc.ac.uk/media/1329/ubdc-call-for-expressions-of... · 2019. 9. 10. · area estimates of a wide variety of economic, social, built environment

AccessingAdministrativeDatathroughtheUBDCTheUBDCoffersasecureControlledDataServicetoenableresearchusingpotentiallysensitiveorconfidentialdata.Wedonotholdthistypeofdatainourcollection;rather,webrokeraccesswithdataowningorganisationssothatindividualresearcherscanworkonspecificdataforaspecificproject,whilealsoensuringthatdataownerscanmeettheirlegalobligationstoprotectindividualprivacy.Oncethenecessarylegalagreementsandapprovalsareinplace,wearrangetransferofthedataandlinkagebetweendatasetswhererequired.Youcanthenaccessananonymisedversionofthedatathroughthesecurecomputingfacilities.

LocalAuthoritydata

Asanexampleofthetypeofbrokeragewecanhelpwith,wehavemadeanagreementwithRenfrewshireCounciltosharehousing-specificdataforaresearchprojectaroundtheprivaterentedsector.SomeofthisdataisconfidentialandrequiresuseofourControlledDataService,andhasbeenmadeavailableforthisoneprojectonly.Thiswillgenerallybethecaseforthistypeofhighlysensitiveadministrativedata.

Ifyou'realocalauthoritywhowishestobematchedwithprojectsthatmaybeofusetoyouinthisway,pleasegetintouch.Likewise,ifyou'rearesearcherwithanideaandwantourhelpinbrokeringadatasharingagreementandaccesstoourControlledDataService,pleasesendanExpressionofInterest.

Opendata

Wehavecollectedsomeurban-relateddatathatisopenlyavailableforusebyanyone.Toviewthisdata,pleasevisitourOpenDataCatalogue.

Tousethisopenlylicenseddataonitsownyoudon’tneedtosubmitanexpressionofinterest,unlessyouwanttouseourcomputingservicesitlinkitwithnon-opendataorcreatevisualisationsofit.

Ifyoudodownloadanyofthisdataforyourownuse,weinviteyoutoletusknowaboutitandwhatyouaredoingwithit.Thiswillhelpusunderstandhowthedataisusedandhowtoimproveourdataservicesinfuture,plus,wecanhelpyoupubliciseyourworkandincreaseyourownimpactandreach.Pleaseletusknowifyouusethisdatabyemailingubdc@glasgow.ac.uk.