Download - Playful Explorations of Public and Personal Data - OSCON Data 2011

Transcript
Page 1: Playful Explorations of Public and Personal Data - OSCON Data 2011

Pub

lic &

Personal

DataPlayful

Explorations

Andrew Turner@ajturner

Page 2: Playful Explorations of Public and Personal Data - OSCON Data 2011

Data

Page 3: Playful Explorations of Public and Personal Data - OSCON Data 2011
Page 4: Playful Explorations of Public and Personal Data - OSCON Data 2011
Page 5: Playful Explorations of Public and Personal Data - OSCON Data 2011

Open Government Data

Page 6: Playful Explorations of Public and Personal Data - OSCON Data 2011

flickr: jrparis

Page 7: Playful Explorations of Public and Personal Data - OSCON Data 2011

of the world80%live within cell coverage

flickr: jrparis

Page 8: Playful Explorations of Public and Personal Data - OSCON Data 2011

of the world80%live within cell coverage

and of the50%world own a mobile phone

flickr: jrparis

Page 10: Playful Explorations of Public and Personal Data - OSCON Data 2011
Page 11: Playful Explorations of Public and Personal Data - OSCON Data 2011

unread POI’s 1000+

Page 12: Playful Explorations of Public and Personal Data - OSCON Data 2011

Black Friday, 2010

Page 13: Playful Explorations of Public and Personal Data - OSCON Data 2011

Social Media Trajectorieshttp://geocommons.com/maps/89371#

Page 14: Playful Explorations of Public and Personal Data - OSCON Data 2011

Personal Data

Page 15: Playful Explorations of Public and Personal Data - OSCON Data 2011

How to deal with this data? flickr: ejpphoto

Page 16: Playful Explorations of Public and Personal Data - OSCON Data 2011

Approachable, relevant, accessible

Page 17: Playful Explorations of Public and Personal Data - OSCON Data 2011

Sharing Visualizations http://flowingdata.com

Page 18: Playful Explorations of Public and Personal Data - OSCON Data 2011

Tools are often too difficult.

Page 19: Playful Explorations of Public and Personal Data - OSCON Data 2011

Basic Principles

Page 20: Playful Explorations of Public and Personal Data - OSCON Data 2011

Open Access

Basic Principles

Page 21: Playful Explorations of Public and Personal Data - OSCON Data 2011

Open Access

Visualize

Basic Principles

Page 22: Playful Explorations of Public and Personal Data - OSCON Data 2011

Open Access

Visualize

Analyze

Basic Principles

Page 23: Playful Explorations of Public and Personal Data - OSCON Data 2011

Power of Place

Page 24: Playful Explorations of Public and Personal Data - OSCON Data 2011

The role of mapsMaps Reflect & Define Reality

Waldseemüller Uniersalis Cosmographia

Page 25: Playful Explorations of Public and Personal Data - OSCON Data 2011

The role of mapsMaps Reflect & Define Reality“America”

Waldseemüller Uniersalis Cosmographia

Page 26: Playful Explorations of Public and Personal Data - OSCON Data 2011

Story Mapping

Page 27: Playful Explorations of Public and Personal Data - OSCON Data 2011

Navigation Marshall Islands stick chart19th century

Page 28: Playful Explorations of Public and Personal Data - OSCON Data 2011

Travel Guides

Page 29: Playful Explorations of Public and Personal Data - OSCON Data 2011

Spatial Operations

Buffer, Intersect, AggregationCorrelation, Prediction, Custom

Tools: geos, JTS, PostGIS

Page 30: Playful Explorations of Public and Personal Data - OSCON Data 2011

Spa$al  Aggrega$on:  Group  data  by  arbitrary  geographic  boundaries

(Proprietary  and  confiden0al)

Page 31: Playful Explorations of Public and Personal Data - OSCON Data 2011

Spa$al  Aggrega$on:  Group  data  by  arbitrary  geographic  boundaries

(Proprietary  and  confiden0al)

Page 32: Playful Explorations of Public and Personal Data - OSCON Data 2011

Spa$al  Aggrega$on:  Group  data  by  arbitrary  geographic  boundaries

(Proprietary  and  confiden0al)

Page 33: Playful Explorations of Public and Personal Data - OSCON Data 2011

Spa$al  Correla$on:  Rela0onship  between  mul0ple  datasets  by  geography

(Proprietary  and  confiden0al)

Page 34: Playful Explorations of Public and Personal Data - OSCON Data 2011

Spa$al  Correla$on:  Rela0onship  between  mul0ple  datasets  by  geography

(Proprietary  and  confiden0al)

Page 35: Playful Explorations of Public and Personal Data - OSCON Data 2011

Spa$al  Correla$on:  Rela0onship  between  mul0ple  datasets  by  geography

(Proprietary  and  confiden0al)

Page 36: Playful Explorations of Public and Personal Data - OSCON Data 2011

Spa$al  Buffer  and  Distance  Filter:  Radius  buffer  from  a  point,  line  or  polygon

(Proprietary  and  confiden0al)

Page 37: Playful Explorations of Public and Personal Data - OSCON Data 2011

Spa$al  Buffer  and  Distance  Filter:  Radius  buffer  from  a  point,  line  or  polygon

(Proprietary  and  confiden0al)

Page 38: Playful Explorations of Public and Personal Data - OSCON Data 2011

Spa$al  Buffer  and  Distance  Filter:  Radius  buffer  from  a  point,  line  or  polygon

(Proprietary  and  confiden0al)

Page 39: Playful Explorations of Public and Personal Data - OSCON Data 2011

Intersec$on:  Overlap  between  two  polygonal  areas,  lines  or  points

(Proprietary  and  confiden0al)

Page 40: Playful Explorations of Public and Personal Data - OSCON Data 2011

Intersec$on:  Overlap  between  two  polygonal  areas,  lines  or  points

(Proprietary  and  confiden0al)

Page 41: Playful Explorations of Public and Personal Data - OSCON Data 2011

Intersec$on:  Overlap  between  two  polygonal  areas,  lines  or  points

(Proprietary  and  confiden0al)

Page 42: Playful Explorations of Public and Personal Data - OSCON Data 2011

Intersec$on:  Overlap  between  two  polygonal  areas,  lines  or  points

(Proprietary  and  confiden0al)

Page 43: Playful Explorations of Public and Personal Data - OSCON Data 2011

Intersec$on:  Overlap  between  two  polygonal  areas,  lines  or  points

Use  Cases:• Locate  that  a  social  media  men0ons  happened  within  a  geo-­‐fence

• Track  mobile  traffic  entering  a  zip  code

(Proprietary  and  confiden0al)

Page 44: Playful Explorations of Public and Personal Data - OSCON Data 2011

User-­‐Defined  Analysis:  Custom  equa0ons  via  intui0ve  wizard  interface

(Proprietary  and  confiden0al)

Page 45: Playful Explorations of Public and Personal Data - OSCON Data 2011

User-­‐Defined  Analysis:  Custom  equa0ons  via  intui0ve  wizard  interface

(Proprietary  and  confiden0al)

Page 46: Playful Explorations of Public and Personal Data - OSCON Data 2011

User-­‐Defined  Analysis:  Custom  equa0ons  via  intui0ve  wizard  interface

(Proprietary  and  confiden0al)

Page 47: Playful Explorations of Public and Personal Data - OSCON Data 2011

Traffic Accidents http://geocommons.com/maps/77512

Page 48: Playful Explorations of Public and Personal Data - OSCON Data 2011

Virtual Vehicle www.virtualvehicle.co

Page 49: Playful Explorations of Public and Personal Data - OSCON Data 2011

Crash ‘Likelihood’ Density www.virtualvehicle.co

Page 50: Playful Explorations of Public and Personal Data - OSCON Data 2011

Making it revelantflickr: qwertyuiop

Page 51: Playful Explorations of Public and Personal Data - OSCON Data 2011

neogeography |nē'ō-jē-ŏg'rə-fē|

geographical techniques and tools used for personal activities or for utilization by a non-expert group of users;

Page 52: Playful Explorations of Public and Personal Data - OSCON Data 2011

Psychogeography

Page 53: Playful Explorations of Public and Personal Data - OSCON Data 2011

Playful Explorations

Page 54: Playful Explorations of Public and Personal Data - OSCON Data 2011

http://geocommons.com

Page 55: Playful Explorations of Public and Personal Data - OSCON Data 2011

http://geocommons.com

67k+ unique datasetsbillions of features.

590,000+ geographic attributes

Page 56: Playful Explorations of Public and Personal Data - OSCON Data 2011

Acetate Layers

http://developer.geoiq.com

Page 57: Playful Explorations of Public and Personal Data - OSCON Data 2011
Page 58: Playful Explorations of Public and Personal Data - OSCON Data 2011

= 174,049,705,000

Page 59: Playful Explorations of Public and Personal Data - OSCON Data 2011

= 174,049,705,000

well... close enough

Page 60: Playful Explorations of Public and Personal Data - OSCON Data 2011
Page 61: Playful Explorations of Public and Personal Data - OSCON Data 2011
Page 62: Playful Explorations of Public and Personal Data - OSCON Data 2011

Open Access

Page 63: Playful Explorations of Public and Personal Data - OSCON Data 2011

Open Access

Visualize

Page 64: Playful Explorations of Public and Personal Data - OSCON Data 2011

Open Access

Visualize

Analyze

Page 65: Playful Explorations of Public and Personal Data - OSCON Data 2011

Citizens

Page 66: Playful Explorations of Public and Personal Data - OSCON Data 2011

Foursquare Crime

Page 67: Playful Explorations of Public and Personal Data - OSCON Data 2011

Citizens

Government

Page 68: Playful Explorations of Public and Personal Data - OSCON Data 2011

Social Government

Page 69: Playful Explorations of Public and Personal Data - OSCON Data 2011
Page 70: Playful Explorations of Public and Personal Data - OSCON Data 2011

Citizens

Government

Media

Page 71: Playful Explorations of Public and Personal Data - OSCON Data 2011

Journalists

Page 72: Playful Explorations of Public and Personal Data - OSCON Data 2011

Journalists

Page 75: Playful Explorations of Public and Personal Data - OSCON Data 2011

Citizens

Science

Media

Government

Page 76: Playful Explorations of Public and Personal Data - OSCON Data 2011

Research

Page 77: Playful Explorations of Public and Personal Data - OSCON Data 2011

Citizens

Science

MediaDevelopers

Government

Page 78: Playful Explorations of Public and Personal Data - OSCON Data 2011

Using Appcelerator’s open-source cross-mobile platform technology, mobile applications can quickly integrate with GeoIQ to access and create new data from the field.

GeoIQ & Appcelerator

Page 79: Playful Explorations of Public and Personal Data - OSCON Data 2011

GeoPace

HBase

GEOS

GeoPacing

Page 80: Playful Explorations of Public and Personal Data - OSCON Data 2011

GeoPace

Action

Results

Search

Loc(lat,lon)

HBase

GEOSstart

GeoPacing

Page 81: Playful Explorations of Public and Personal Data - OSCON Data 2011

GeoPace

Action

Results

Search

Loc(lat,lon)

HBase

GEOSstart

GeoPacing

Page 82: Playful Explorations of Public and Personal Data - OSCON Data 2011

GeoPace

Action

Results

Search

Loc(lat,lon)

HBase

GEOSstart

Cascading

GeoPacing

Page 83: Playful Explorations of Public and Personal Data - OSCON Data 2011

GeoPace

Action

Results

Search

Loc(lat,lon)

HBaseDB

DB

DB

GEOSstart

Cascading

GeoPacing

Page 84: Playful Explorations of Public and Personal Data - OSCON Data 2011

GeoPace

Action

Results

Search

Loc(lat,lon)

HBaseDB

DB

DB

GEOSstart

Cascading

MapMapMapMapMapMapMap

GeoPacing

Page 85: Playful Explorations of Public and Personal Data - OSCON Data 2011

Appcelerator

http://appcelerator.geoiq.com

Page 86: Playful Explorations of Public and Personal Data - OSCON Data 2011

Mobile Analysis on Mobile Devices

Page 87: Playful Explorations of Public and Personal Data - OSCON Data 2011

Citizens

Organizations

Science

MediaDevelopers

Enterprise

Page 88: Playful Explorations of Public and Personal Data - OSCON Data 2011

Social Media Dashboards MongoDBPolymaps

Page 89: Playful Explorations of Public and Personal Data - OSCON Data 2011

Organizations

Science

MediaDevelopers

Enterprise

Citizens

Page 90: Playful Explorations of Public and Personal Data - OSCON Data 2011

Hotness http://geocommons.com/maps/89561

Page 91: Playful Explorations of Public and Personal Data - OSCON Data 2011

Health http://geocommons.com/maps/77282

Page 92: Playful Explorations of Public and Personal Data - OSCON Data 2011

Traffic & Caffeine http://geocommons.com/maps/82402

Page 93: Playful Explorations of Public and Personal Data - OSCON Data 2011
Page 94: Playful Explorations of Public and Personal Data - OSCON Data 2011

More Technical Information

Open Geospatial Libraries for RubyChris HelmWednesday @ 5PM

Page 95: Playful Explorations of Public and Personal Data - OSCON Data 2011

Andrew Turner - @[email protected]://highearthorbit.com

Thank You