gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Big Data
Lecture 19:
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Updates
Tuesday: Friends Release
Class: Playtesting / spamming friends
Thursday: Postmortem
Must use actual data from actual players
Big Data2
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Today
Survey results
More real-world examples
Data collection recommendations
Big Data3
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Survey Results!
Big Data4
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Most Disliked Topic
Overview
5%
Paper Prototyping
60%
Logging
20%
Game Mechanics
5%
AI
5%
PCG
5%
Big Data5
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Most Liked Topic
Data Visualization
31%
Level Design
17%AI
17%
Game Mechanics
7%
Procedural Content
Generation
7%
Playtesting
7%
Logging
7%
Learnability and UI
7%
Big Data6
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Group Activities
Activities could be
improved
31%
This is great!
35%
I wish he would
continue lecturing
17%
Other
17%
Big Data7
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
I see what you did there…
I hope to see this kind of analysis next Thursday
Big Data9
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Deliverables
Big Data10
First
Prototype
Second
Prototype
Friends
Release
Newgrounds
Release
Kongregate
Release
Oct. 7 Oct. 23 Nov. 4 Nov. 18 Dec. 2
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
A Venn Diagram
Big Data11
Games with
Published
Analytics
Great Flash
Games
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Bioware
Big Data12
Georg Zoeller
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Big Data13
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Interesting uses of analytics
Tool for spatial event visualization
Visualizing crashes
Incentivizing developers
Visualizing complaints
Visualizing the effect of fog of war
Uncovering human nature
3D Visualizations
Big Data14
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Big Data15
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
As of March 2010…
1,100,000 games
1,141 unique machines
250 GB of data
38,000,000 datapoints
50,000 bugs
4597 unique users
582 machines
Big Data16
Source: Georg Zoeller, “Game Development Telemetry” GDC 2010
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Big Data17
Source: Georg Zoeller, “Game Development Telemetry” GDC 2010
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Spatial Event Visualization
Big Data18
Source: Georg Zoeller, “Game Development Telemetry” GDC 2010
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Logging Crashes
Big Data19
Source: Georg Zoeller, “Game Development Telemetry” GDC 2010
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Logging Crashes
Big Data20
Source: Georg Zoeller, “Game Development Telemetry” GDC 2010
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Heatmap of Crashes
Big Data21
Source: Georg Zoeller, “Game Development Telemetry” GDC 2010
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Big Data22
Source: Georg Zoeller, “Game Development Telemetry” GDC 2010
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Big Data23
Source: Georg Zoeller, “Game Development Telemetry” GDC 2010
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Developer Achievements
Big Data24
Source: Georg Zoeller, “Game Development Telemetry” GDC 2010
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Developer Achievements
Big Data25
Source: Georg Zoeller, “Game Development Telemetry” GDC 2010
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Developer Achievements: Results
Big Data26
Doubled developer play time for 1 month
More bugs caught
Developers got addicted
Buggy achievements caused anger
Source: Georg Zoeller, “Game Development Telemetry” GDC 2010
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Big Data27
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Optimizing Engines
Big Data28
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Optimizing Art
Source: Georg Zoeller, “MMO Rapid Content Iteration” GDC Online 2011
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
How do I…
Big Data30
Source: Georg Zoeller, “MMO Rapid Content Iteration” GDC Online 2011
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
“bug”
Big Data31
Source: Georg Zoeller, “MMO Rapid Content Iteration” GDC Online 2011
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
The road less traveled
Big Data32
68% of players go right
Source: Georg Zoeller, “MMO Rapid Content Iteration” GDC Online 2011
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Big Data33
Fog of War
Source: Georg Zoeller, “MMO Rapid Content Iteration” GDC Online 2011
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
3D Visualizations
Big Data34
Source: Georg Zoeller, “MMO Rapid Content Iteration” GDC Online 2011
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
More 3D Visualizations
Big Data35
Source: Georg Zoeller, “MMO Rapid Content Iteration” GDC Online 2011
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Experimentation is everywhere
Big Data36
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Big Data37
But so are ethical challenges
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Institutional Review Board
Big Data38
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Milgram Experiment
Big Data39
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Stanford Prison Experiment
Big Data40
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
IRB Approval
Big Data41
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Don’t publish data
Big Data42
An Epic Study of Epic Players In
Epic’s Epic Epic
An honors thesis submitted in partial fulfillment of the
requirements for the degree of
Bachelor of Science
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
IRB Approval
Big Data43
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
No identifiable data
Big Data44
Please enter your name:
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Avoid causing harm
Big Data45
Wow, you are
terrible at this gameGreat job!
A B
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
IRB Approval
Big Data46
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Big Data47
You are visitor number
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Big Data48
Congratulations! You are
player number
to lose on this level
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Big Data49
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Big Data50
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
What this means for you
Protect the welfare of your players
Do not
record identifiable information
give data to anyone outside the class
discuss your data or analysis in
public presentations
theses
journal articles
conference papers
Big Data51
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Summary
Release / postmortem next week
Creative visualizations are awesome and effective
Be ethical in your data collection
Big Data52
gamedesigninitiativeat cornell university
thegamedesigninitiative
at cornell university
the
Group Activity
What hypotheses do you want to test?
How are you going to record data to test them?
How will the data answer your hypotheses?
How will you demonstrate this to the class?
Big Data53
Top Related