Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global...
Transcript of Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global...
![Page 1: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/1.jpg)
Michael Grossberg
Data Visualization Basics
Tools, Principles and Pitfalls
![Page 2: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/2.jpg)
Visualization as Tool Whats the problem?
![Page 3: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/3.jpg)
Information
Understanding
![Page 4: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/4.jpg)
Data Visualization Global Temp Year Annual_Mean 5-
year_Mean!-------------------------------
---! 1880 -0.20 *! 1881 -0.12 *!
1882 -0.15 -0.19! 1883 -0.18 -0.19! 1884 -0.26 -0.22! 1885 -0.24 -0.25! 1886 -0.23 -0.25! 1887 -0.31 -0.21! 1888 -0.19 -0.23! 1889 -0.09 -0.23! 1890 -0.32 -0.23! 1891 -0.26 -0.26! 1892 -0.30 -0.31! 1893 -0.35 -0.29! 1894 -0.32 -0.27! 1895 -0.24 -0.25! 1896 -0.17 -0.24! 1897 -0.17 -0.21! 1898 -0.30 -0.19! 1899 -0.19 -0.20! 1900 -0.14 -0.23! 1901 -0.20 -0.24! 1902 -0.30 -0.28! 1903 -0.36 -0.31! 1904 -0.43 -0.32!
1905 -0.29 -0.35! 1906 -0.25 -0.36! 1907 -0.41 -0.37! 1908 -0.42 -0.40! 1909 -0.46 -0.44! 1910 -0.45 -0.43! 1911 -0.44 -0.43! 1912 -0.40 -0.38! 1913 -0.38 -0.32! 1914 -0.22 -0.30! 1915 -0.16 -0.31! 1916 -0.35 -0.29! 1917 -0.43 -0.31! 1918 -0.31 -0.33! 1919 -0.28 -0.30! 1920 -0.26 -0.27! 1921 -0.20 -0.26! 1922 -0.28 -0.25! 1923 -0.25 -0.23! 1924 -0.23 -0.21! 1925 -0.21 -0.19! 1926 -0.08 -0.17! 1927 -0.17 -0.18! 1928 -0.16 -0.16! 1929 -0.30 -0.16! 1930 -0.11 -0.15! 1931 -0.06 -0.16! 1932 -0.10 -0.12! 1933 -0.24 -0.13!
1934 -0.09 -0.14! 1935 -0.14 -0.11! 1936 -0.10 -0.05! 1937 0.04 -0.03! 1938 0.06 0.02! 1939 0.01 0.05! 1940 0.07 0.06! 1941 0.08 0.06! 1942 0.05 0.08! 1943 0.06 0.07! 1944 0.14 0.04! 1945 0.01 0.02! 1946 -0.08 -0.02! 1947 -0.04 -0.07! 1948 -0.10 -0.10! 1949 -0.11 -0.10! 1950 -0.19 -0.09! 1951 -0.06 -0.05! 1952 0.02 -0.05! 1953 0.09 -0.04! 1954 -0.11 -0.06! 1955 -0.12 -0.06! 1956 -0.18 -0.07! 1957 0.04 -0.04! 1958 0.05 -0.02! 1959 0.03 0.02! 1960 -0.04 0.02! 1961 0.05 0.03! 1962 0.04 -0.01!
1963 0.07 -0.03! 1964 -0.20 -0.05! 1965 -0.10 -0.06! 1966 -0.04 -0.08! 1967 -0.01 -0.03! 1968 -0.05 -0.00! 1969 0.06 -0.01! 1970 0.04 0.00! 1971 -0.07 0.04! 1972 0.02 0.02! 1973 0.16 0.01! 1974 -0.07 -0.01! 1975 -0.01 0.02! 1976 -0.12 -0.00! 1977 0.15 0.04! 1978 0.05 0.08! 1979 0.12 0.16! 1980 0.23 0.15! 1981 0.28 0.20! 1982 0.09 0.20! 1983 0.27 0.17! 1984 0.12 0.14! 1985 0.08 0.18! 1986 0.14 0.19! 1987 0.28 0.22! 1988 0.35 0.28! 1989 0.24 0.33! 1990 0.39 0.31! 1991 0.38 0.28!
1992 0.19 0.29! 1993 0.21 0.30! 1994 0.28 0.29! 1995 0.43 0.34! 1996 0.32 0.42! 1997 0.45 0.44! 1998 0.61 0.44! 1999 0.40 0.48! 2000 0.40 0.51! 2001 0.52 0.51! 2002 0.61 0.53! 2003 0.60 0.58! 2004 0.51 0.59! 2005 0.65 0.59! 2006 0.59 0.57! 2007 0.62 0.59! 2008 0.49 0.59! 2009 0.59 0.58! 2010 0.66 0.57! 2011 0.55 0.59! 2012 0.57 *! 2013 0.60 *! 2014 * *!
!-------------------------------
-----
![Page 5: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/5.jpg)
Global Means Temp as Graph
Hansen et al. (2006), NASA GISS
![Page 6: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/6.jpg)
Goals of Visualization❖ Record!
!
!
❖ Analyze!
!
!
❖ Communicate
![Page 7: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/7.jpg)
Analyze/Monitor
![Page 8: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/8.jpg)
Analyze
John Snow, 1854
Exploratory!Data Analysis!
(EDA)
![Page 9: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/9.jpg)
Analyze
John Snow, 1854
Cluster Region
Exploratory!Data Analysis!
(EDA)
![Page 10: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/10.jpg)
Analyze
John Snow, 1854
Cluster Region
Cluster Center
Exploratory!Data Analysis!
(EDA)
![Page 11: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/11.jpg)
Analyze
John Snow, 1854
Cluster Region
Cluster Center
PumpExploratory!
Data Analysis!(EDA)
![Page 12: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/12.jpg)
Analyze/Communicate
John Snow, 1854
Confirmatory!Data Analysis!
(CDA)
![Page 13: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/13.jpg)
Communicate/Convince
Al Gore, An Inconvenient Truth 2006
![Page 14: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/14.jpg)
Communicate
http://www.gapminder.org/
![Page 15: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/15.jpg)
What do you want to accomplish?
![Page 16: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/16.jpg)
Don’t Build to Convince
Al Gore, An Inconvenient Truth 2006
![Page 17: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/17.jpg)
If the goal is Monitoring
![Page 18: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/18.jpg)
Most of your visualizations
http://nyti.ms/17AErgX
Convince
http://nyti.ms/1dRTdxQ
Explore
![Page 19: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/19.jpg)
What visual queries do you support?
![Page 20: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/20.jpg)
Are These Data Sets The Same?!
![Page 21: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/21.jpg)
![Page 22: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/22.jpg)
![Page 23: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/23.jpg)
Iterate
❖ Build many simple graphs first!
❖ Use Ipython/Excel/OpenOffice/Tabeau
Fully Explore Your Data First
![Page 24: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/24.jpg)
Start Design with paper and pencil/pen
![Page 25: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/25.jpg)
Build Static BEFORE Interactive
Build these (Matplotlib) Before these (D3)
![Page 26: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/26.jpg)
Keep It Simple Stupid
KISS principle:
http://visual.ly/mad-mad-world-we-livehttp://viz.wtf/
![Page 27: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/27.jpg)
Practice Good Visual Design
![Page 28: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/28.jpg)
Choosing The Right Tool for the Job
![Page 29: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/29.jpg)
Choosing The Right Tool for the Job
http://extremepresentation.typepad.com/blog/2006/09/choosing_a_good.html
![Page 30: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/30.jpg)
Look at Good/Bad Visualizations❖ Good Examples:!
❖ http://flowingdata.com/!
❖ http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/!
❖ Bad Examples:!
❖ http://wtfviz.net/!
❖ http://junkcharts.typepad.com/junk_charts
![Page 31: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/31.jpg)
Practice
![Page 32: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/32.jpg)
Data Sources* Fivethirtyeight Data * Quandl * Datamob * Reddit Datasets Lists
* Datahub * Factual * Census.gov * Data.gov * Dataverse Network * Infochimps * Linked Data * Data Market * Reddit Open Data
* Climate Data Sources
* Climate Station Records
* CDC Data * World Bank Catalog * StateMaster * Socrata * The UN * Weatherbase * ESPN * Datamarket * Google Public Data * Million Song Database
* Hillary Mason's aggregation of Dataset links
* NASDAQ Data Store * KDNuggets links * Amazon Public Datasets
* Data NYC * Freebase * DBpedia * Enigma * Reuters Corpora * World bank Data * International Monitory Fund Data
![Page 33: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/33.jpg)
Libre Office
❖ Load a spreadsheet with data!
❖ Make a time series line plot
![Page 34: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/34.jpg)
Python/Pandas/Matplotlib/Ipython
❖ Load a time series of data!
❖ Make a line plot
![Page 35: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/35.jpg)
Data Transformations
![Page 36: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/36.jpg)
Can the data be visualized as-is?❖ 1885 Hight data from Francis Galton on 928 (adult)
children
![Page 37: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/37.jpg)
Yum Data61.7, 61.7, 61.7, 61.7, 61.7, 62.2, 62.2, 62.2, 62.2, 62.2, 62.2, 62.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 63.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 64.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 65.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 66.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 67.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 68.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 69.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 70.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 71.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 72.2, 73.2, 73.2, 73.2, 73.2, 73.2, 73.2, 73.2, 73.2, 73.2, 73.2, 73.2, 73.2, 73.2, 73.2, 73.2, 73.2, 73.2, 73.7, 73.7, 73.7, 73.7, 73.7, 73.7, 73.7, 73.7, 73.7, 73.7, 73.7, 73.7, 73.7, 73.7
Now what??
![Page 38: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/38.jpg)
Vertical lines (1D data)
Height
Not too !illuminating
![Page 39: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/39.jpg)
Sort and Plot
Height
Subject Rank (shortest to tallest)
![Page 40: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/40.jpg)
Distribution (histogram)
0
45
90
135
180
61.7-62.9 62.9-64.1 64.1-65.3 65.3-66.5 66.5-67.7 67.7-68.9 68.9-70.1 70.1-71.3 71.3-72.5 72.5-73.7
![Page 41: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/41.jpg)
Probability
0
0.045
0.09
0.135
0.18
61.7-62.9 62.9-64.1 64.1-65.3 65.3-66.5 66.5-67.7 67.7-68.9 68.9-70.1 70.1-71.3 71.3-72.5 72.5-73.7
![Page 42: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/42.jpg)
Probability using Using KDE
![Page 43: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/43.jpg)
Galton Data also has “midparent” height.
❖ Mid-parent height = mean(father hight, 1.08* mother height)
How do we show relationship?
![Page 44: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/44.jpg)
Scatter Plot
Uggh! Data heavily quantized. Blah.
![Page 45: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/45.jpg)
KDE also possible
❖ We can do a Kernel Density estimator to find surface
![Page 46: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/46.jpg)
Contour Plot (2D)
![Page 47: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/47.jpg)
Box and Whiskers
First Quartile
Median (Second Quartile)
Third Quartile
Min
Max
lowest datum still within 1.5 IQR
outlier
![Page 48: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/48.jpg)
Matplotlib Boxplot
![Page 49: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/49.jpg)
Candle Stick Chart
Finance
![Page 50: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/50.jpg)
Moving Averages Smoothing
![Page 51: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/51.jpg)
Visualization Zoo (Heer,Bostock, et al)
![Page 52: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/52.jpg)
Time Series: Index Charts
![Page 53: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/53.jpg)
Time Series: Stacked Graph
![Page 54: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/54.jpg)
Small Multiples
![Page 55: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/55.jpg)
Scatter Plot
![Page 56: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/56.jpg)
Parallel Coordinates
![Page 57: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/57.jpg)
Radar Chart
Typically Positive data
![Page 58: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/58.jpg)
Map(s)
More in Later Lecture
Flow
Graduated!Symbol!
Map
Cloropleth
Cartogram
![Page 59: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/59.jpg)
Hierarchies
![Page 60: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/60.jpg)
Network
![Page 61: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/61.jpg)
Recommended Tool for Static Plotshttp://matplotlib.org/
![Page 62: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/62.jpg)
Rapid Prototyping: Use Ipython
http://nbviewer.ipython.org/github/jrjohansson/scientific-python-lectures/blob/master/Lecture-4-Matplotlib.ipynb
http://ipython.org/
![Page 63: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/63.jpg)
http://www.erh.noaa.gov/okx/climate/almanacs/nycaug.htm
![Page 64: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/64.jpg)
Libre Office Method
❖ “Manually chop out data”!
❖ Put in spreadsheet!
❖ Use “chart” function!
❖ Fix up
![Page 65: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/65.jpg)
Manually Chop Out Data
❖ Here I use Vim block select to pull out data
![Page 66: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/66.jpg)
Libre Office (or spreadsheet prog)
❖ Paste data in!
❖ Delete blank lines
![Page 67: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/67.jpg)
Chart Wizard
![Page 68: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/68.jpg)
Label and adjust
![Page 69: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/69.jpg)
Pro/Cons❖ Pros:!
❖ WYSIWYG!
❖ Can directly manipulate data!
❖ Easily try options!
❖ Cons:!
❖ Difficult to automate!
❖ Limited flexibility!
❖ Limited processing options
![Page 70: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/70.jpg)
Python
❖ Can interactively work with !
❖ ipython shell!
❖ ipython notebook!
❖ Can save notebook or turn into script
![Page 71: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/71.jpg)
Python Distribution (one choice)
https://store.continuum.io/cshop/academicanacondahttps://store.continuum.io/cshop/anaconda/
![Page 72: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/72.jpg)
Other choices
❖ Mac OS: homebrew (http://brew.sh/) install python, then numpy, matplotlib, scipy using home-brew … everything else with pip!
❖ Linux Ubuntu apt-get (yum for redhat) for numpy, matplotlib, scipy!
❖ Windows: use anaconda (previous slide) or Ubuntu inside Virtual Box VM then see above
![Page 73: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/73.jpg)
Start Notebook
❖ $ ipython notebook!
❖ (assumes installation and set up ok)
![Page 74: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/74.jpg)
Open New Notebook
![Page 75: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/75.jpg)
Initial Load Needed libraries
![Page 76: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/76.jpg)
Request Library for Loading from Web
Hard WayEasier API
![Page 77: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/77.jpg)
Load Data from Web
![Page 78: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/78.jpg)
Text Munging (scraping)❖ Some string
methods:!
❖ 'endswith',!
❖ 'expandtabs',!
❖ 'find',!
❖ 'index',!
❖ 'isalnum',!
❖ 'isalpha',!
❖ 'isdigit',!
❖ 'islower',!
❖ 'isspace',!
❖ 'istitle',!
❖ 'isupper',!
❖ 'lstrip',!
❖ 'partition',!
❖ 'replace',!
❖ 'rfind',!
❖ 'rindex',!
❖ 'rjust',!
❖ 'rpartition',!
❖ 'rsplit',!
❖ 'rstrip',!
❖ 'split',!
❖ 'splitlines',!
❖ 'startswith',!
❖ 'strip'
![Page 79: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/79.jpg)
Regular Expressions (Regexp)
![Page 80: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/80.jpg)
but …
Some people, when confronted with a problem, think "I know, I'll use regular expressions." Now they have two problems.!
❖ Jamie Zawinski (?)
![Page 81: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/81.jpg)
Regexp (very useful)
![Page 82: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/82.jpg)
Look for data lines with regexp
![Page 83: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/83.jpg)
Split then filter
![Page 84: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/84.jpg)
Extract Numbers and Convert
![Page 85: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/85.jpg)
Quick Plot
![Page 86: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/86.jpg)
Explicitly Set Properties
![Page 87: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/87.jpg)
Imperative vs Object Approach
vs
![Page 89: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/89.jpg)
Later use D3
![Page 90: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/90.jpg)
Raw lets you do some D3 pro typing
![Page 91: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/91.jpg)
Some Recommended Software Tools❖ mercurial (bit bucket)/git github [version control]!
❖ scientific python tools!
❖ python, numpy, scipy, matplotilib, pandas, ipython, basemap!
❖ linux (apt-get)/pip, mac (homebrew), mac/windows anaconda from continuum!
❖ D3!
❖ Editor, web browser (vim/sublime text2)
![Page 92: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/92.jpg)
Supplemental Tools❖ Libre Office/Google Docs Spreadsheet!
❖ Inkscape (for vector/svg editing)!
❖ Gimp (for pixel editing)!
❖ tableau (http://www.tableausoftware.com) free version!
❖ Other python vis libraries: networkX, mayavi2 (3D), bokeh, seaborn, chaco, vincent, ggplot (python)!
❖ Other Javascript libraries: three.js (3D), philogl (3d), processing.js, digraphs.js, polymaps.js, dimple.js!
❖ R has ggplot2!
❖ Gephi
![Page 93: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/93.jpg)
Some Guiding Principles
![Page 94: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/94.jpg)
What to we mean by good design?
Design is a funny word. Some people think design means how it looks. But of course, if you dig deeper, it's really how it works.!!
Steve Jobs
![Page 95: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/95.jpg)
Attributes of good design
Judo Master: Kano Jigoro!!
Maximum Efficiency !with Minimum Effort
![Page 96: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/96.jpg)
Edward Tufte
American Statistician!!Pioneer!!Can be controversial!!Hard to overstate importance
![Page 97: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/97.jpg)
Principle Tufte: Graphical Integrity
![Page 98: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/98.jpg)
Lie Factor
![Page 99: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/99.jpg)
![Page 100: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/100.jpg)
![Page 101: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/101.jpg)
![Page 102: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/102.jpg)
![Page 103: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/103.jpg)
![Page 104: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/104.jpg)
And then there are pie charts
![Page 105: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/105.jpg)
![Page 106: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/106.jpg)
![Page 107: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/107.jpg)
![Page 108: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/108.jpg)
![Page 109: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/109.jpg)
3D adds to Extra Distortion
![Page 110: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/110.jpg)
![Page 111: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/111.jpg)
More Baloney than Lies
![Page 113: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/113.jpg)
Actually Content Free
![Page 114: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/114.jpg)
Missing Data is also a Problem
Some hydrology data we were working with.
![Page 115: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/115.jpg)
Learning from Social Networks
http://ebiquity.umbc.edu/blogger/2007/04/19/twitter-social-network-analysis/
![Page 116: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/116.jpg)
Problems with Social Network Data
![Page 117: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/117.jpg)
Numbers don’t Lie?
![Page 118: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/118.jpg)
Maximize: Data to Ink Ratio
![Page 119: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/119.jpg)
![Page 120: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/120.jpg)
![Page 121: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/121.jpg)
Chart JUNK
![Page 122: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/122.jpg)
If you paid for decoration?
A designer knows he has achieved perfection not when there is nothing left to add, but when there is nothing left to take away.!
Antoine de Saint-Exupery
![Page 123: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/123.jpg)
![Page 124: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/124.jpg)
Tim Brey
![Page 125: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/125.jpg)
![Page 126: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/126.jpg)
![Page 127: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/127.jpg)
![Page 128: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/128.jpg)
![Page 129: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/129.jpg)
![Page 130: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/130.jpg)
![Page 131: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/131.jpg)
![Page 132: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/132.jpg)
Principle: Increase Data Density
![Page 133: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/133.jpg)
Ho et al., “Thermal Conductivity of the!Elements: A Comprehensive Review” J.!Phys. Chem. 1974
![Page 134: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/134.jpg)
100 Million Calls to 311 by Steven Johnson 2011
![Page 135: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/135.jpg)
Tufte Principles
❖ Don’t Lie!
❖ Maximize Data to Ink Ratio!
❖ Avoid Chart Junk!
❖ Increase Data Intensity
![Page 136: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/136.jpg)
Hannah’s Rules
❖ http://hackerspace.lifehacker.com/5-rules-for-making-graphs-1605706367
![Page 137: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/137.jpg)
1. Label Everything
Important: Meaningful Titles! Label Axis! List data source
![Page 138: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/138.jpg)
2. Work with the Numbers
Should be zoomed!on range of data
![Page 139: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/139.jpg)
3. Choose Colors Carefully
![Page 140: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/140.jpg)
4. Know your Audience
14 year olds
Professors
![Page 141: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/141.jpg)
5. Use the Correct Graph
![Page 142: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/142.jpg)
The Big Picture
![Page 143: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/143.jpg)
![Page 144: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/144.jpg)
Categorical!Qualitative
![Page 145: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/145.jpg)
Nominal, Ordinal and Quantitative❖ N: Nominal (labels)!
❖ Eg. Animals, pigs, goats, cattle!
❖ O: Ordered!
❖ Eg. XS, S, M, L, XL, XXL!
❖ Q: Interval (zero irrelevant) !
❖ Eg. Dates, Location (lon, lat)!
❖ Q: Ratio (linear scale)!
❖ Eg. Mass, charge, speed
![Page 146: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/146.jpg)
Data Types (Operations)
❖ Nominal: =, ≠!
❖ Ordinal: =, ≠ and <, >!
❖ Interval: =, ≠, <, >, and - (distance between points), + (diff)!
❖ Ratio: =, ≠, <, >,+,-, and x,÷
![Page 147: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/147.jpg)
![Page 148: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/148.jpg)
![Page 149: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/149.jpg)
![Page 150: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/150.jpg)
![Page 151: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/151.jpg)
![Page 152: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/152.jpg)
Example: U.S. Census Data
❖ People: # of people in group!
❖ Year: 1850 – 2000 (every decade)!
❖ Age: 0 – 90+!
❖ Sex: Male, Female!
❖ Marital Status: Single, Married, Divorced, …
![Page 153: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/153.jpg)
Census Data
❖ People!
❖ Year!
❖ Age!
❖ Sex!
❖ Marital Status!
❖ 2348 data points
![Page 154: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/154.jpg)
Census: N, O, Q?
❖ People Count……!
❖ Year………………!
❖ Age………………!
❖ Sex……………….!
❖ Marital Status…..
![Page 155: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/155.jpg)
Census: N, O, Q?
❖ People Count……!
❖ Year………………!
❖ Age………………!
❖ Sex……………….!
❖ Marital Status…..
Q-Ratio!
Q-Interval (O)!
Q-Ratio (O)!
N!
N
![Page 156: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/156.jpg)
Visual Variables
![Page 157: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/157.jpg)
Jacques Bertin
❖ French cartographer [1918-2010]!
❖ Semiology of Graphics [1967]!
❖ Theoretical principles for visual encodings
![Page 158: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/158.jpg)
Bertin’sVisual Variables
Position
Size
(Grey)Value
Texture
Color
Orientation
Shape
Channels
Points Lines AreasMarks
![Page 159: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/159.jpg)
Position
❖ Strongest visual variable!
❖ Suitable for all data types!
❖ Problems:!
❖ Sometimes not available!
❖ Cluttering
![Page 160: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/160.jpg)
Position in 3D?
[Spo%ire]
![Page 161: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/161.jpg)
Size & Length❖ Good visual variable!
❖ Easy to see whether one is bigger!
❖ Grouping works!
❖ Judging differences!
❖ Good for aligned bars (position)!
❖ OK for changes in length!
❖ Bad for changes in area
![Page 162: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/162.jpg)
Shape
❖ Great to recognize many classes.!
❖ No grouping, ordering.
![Page 163: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/163.jpg)
Value
❖ Good for quantitative data when length & size are used.!
❖ Not very many shades recognizable!
❖ Supports grouping!
❖ Is pre-attentive (stands out) if sufficiently different
![Page 164: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/164.jpg)
Color (Hue)
❖ Good for qualitative data!
❖ Limited number of classes!!
❖ Not good for quantitative data!!
❖ Is pre-attentive if sufficiently different.!
❖ Lots of pitfalls! Be careful!
Hue
![Page 165: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/165.jpg)
Saturation (color)
❖ Good for Qualitative Data!
❖ Good for Ordered Data!
❖ Ok for Quantitative Data
Saturation
![Page 166: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/166.jpg)
http://blog.visual.ly/45-ways-to-communicate-two-quantities/
![Page 167: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/167.jpg)
Bertin, 1967
![Page 168: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/168.jpg)
Heer & Bostock, 2010
![Page 169: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/169.jpg)
Quantitative
Ordinal
Nominal
Most !Efficient
Least !Efficient
}}}
![Page 170: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/170.jpg)
Most Effective
![Page 171: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/171.jpg)
Less Effective
![Page 172: Michael Grossberg Data Visualization - Robert Haralick · 2015-04-12 · Data Visualization Global Temp Year Annual_Mean 5-year_Mean!-----! 1880 -0.20 *! 1881 -0.12 *! 1882 -0.15](https://reader035.fdocuments.net/reader035/viewer/2022081607/5ec670e29ef15334146bbe22/html5/thumbnails/172.jpg)
Least Effective