Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist...

36
Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community http://semanticommunity.info/ http://datacommunitydc.org/blog/2013/08/cloud-soa-semantics-and-data-science-conference/ https://silverspotfire.tibco.com/us/library#/users/bniemann/Public http://semanticommunity.info/Data_Science/Doing_Data_Science December 7, 2013 1

Transcript of Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist...

Page 1: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

1

Hubway Data Visualization Challenge: Spotfire

Dr. Brand NiemannDirector and Senior Data Scientist

Semantic Communityhttp://semanticommunity.info/

http://datacommunitydc.org/blog/2013/08/cloud-soa-semantics-and-data-science-conference/ https://silverspotfire.tibco.com/us/library#/users/bniemann/Publichttp://semanticommunity.info/Data_Science/Doing_Data_Science

December 7, 2013

Page 2: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

2

Explanation• Discovered the Hubway Data Visualization Challenge while preparing

my lectures for teaching a Practical Data Science for Data Scientists class using the new book Doing Data Science.– Every time a Hubway user checks a bike out from a station, the system records

basic information about the trip. See if you can answer questions from the data.

• Decided to take the challenge even though it was over by building a dynamic Knowledge Base instead of the Hubway Seeking Metro-Boston static figure.– See 67 entries and how to [email protected]

• Built a Knowledge Base in a spreadsheet (33 data sets) and Spotfire (27 tabs).• I used the CSV files and Shapefile (10MB ZIP), the aggregated rebalancing data sample,

and the related data (Census, neighborhoods, bike facilities, elevation, etc.) packaged up as Hack Day Treat (100MB ZIP).

Page 3: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

3

Hubway Data Visualization Challenge

http://hubwaydatachallenge.org/

Page 5: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

5

Knowledge Base: Spreadsheet

http://semanticommunity.info/@api/deki/files/27392/DoingDataScience.xlsx

Page 6: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

6

Knowledge Base: Spotfire

Page 7: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

7

Exploratory Data Analysis:Metadata

Page 8: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

8

Exploratory Data Analysis:Trips

Page 9: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

9

Exploratory Data Analysis:Trips Filter by Registered

Page 10: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

10

Exploratory Data Analysis:Trips Filter by Casual

Page 11: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

11

Exploratory Data Analysis:Trips Filter by Female

Page 12: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

12

Exploratory Data Analysis:Trips Filter by Male

Page 13: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

13

Exploratory Data Analysis:Stations 1

Page 14: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

14

Exploratory Data Analysis:Stations 2

Page 15: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

15

Exploratory Data Analysis:Station Capacity

Page 16: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

16

Exploratory Data Analysis:Rebalancing

Page 17: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

17

Exploratory Data Analysis:Census 2010 Blocks

Page 18: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

18

Exploratory Data Analysis:Somerville Neighborhoods

Page 19: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

19

Exploratory Data Analysis:Open Space Polygons

Page 20: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

20

Exploratory Data Analysis:MBTA Stations

Page 21: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

21

Exploratory Data Analysis:MBTA Lines

Page 22: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

22

Exploratory Data Analysis:Library Points

Page 23: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

23

Exploratory Data Analysis:InfoGroup Employers

Page 24: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

24

Exploratory Data Analysis:Hydro 25k Polygons

Page 25: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

25

Exploratory Data Analysis:Farmers Markets

Page 26: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

26

Exploratory Data Analysis:EOT Roads

Page 27: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

27

Exploratory Data Analysis:Colleges

Page 28: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

28

Exploratory Data Analysis:Cambridge Neighborhoods

Page 29: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

29

Exploratory Data Analysis:Boston Neighborhoods

Page 30: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

30

Exploratory Data Analysis:2009-2010 Crashes

Page 31: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

31

Exploratory Data Analysis:VMT 250m Grid

Page 32: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

32

Exploratory Data Analysis:Hubway Municipalities

Page 33: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

33

Exploratory Data Analysis:Travel Time to Work

Page 34: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

34

Exploratory Data Analysis:Race Ethnicity

Page 35: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

35

Exploratory Data Analysis:Population by Gender and Age

Page 36: Hubway Data Visualization Challenge: Spotfire Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

36

Exploratory Data Analysis:Median Household Income