Analyzing gaming-simulations using video based techniques
-
Upload
technological-ecosystems-for-enhancing-multiculturality -
Category
Education
-
view
40 -
download
0
description
Transcript of Analyzing gaming-simulations using video based techniques
![Page 1: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/1.jpg)
+
Dinesh Babu Jayagopi, Assistant Professor, IIIT Bangalore Co authors: Bharath and Harsha, Fields of View, India TEEM 2014, Gamification Ecosystems, 2 Oct 2014
Analyzing gaming simulations using video based techniques
![Page 2: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/2.jpg)
+Energy game: a sample session
2
Goal of the group: Energy policy for the country Observe 3 small groups
(representing departments – coal, atomic, renewable) Conflict/ Cooperation among groups Conflict/ Cooperation across groups
Goal serious Game designer: • Use game elements to maximize learning • Create awareness • Abstract reality
![Page 3: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/3.jpg)
+Role of game observation
3
![Page 4: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/4.jpg)
+Quantitative data
4
![Page 5: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/5.jpg)
+Qualitative data: game observation
5
n Group 1 (Dept of Atomic Energy) had heavy discussions
n Individual 2 in Group 3 was negotiating with Group 2 and was quite influential
n Individual 3 in Group 2 was dominating and disturbing
Behavior Analysis of Group dynamics
Group 1
Group 2 Group 3
![Page 6: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/6.jpg)
+
Behavior (Multimodal / audio-visual) analysis of group interactions
![Page 7: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/7.jpg)
+Human Communication: Several channels of info.
7
![Page 8: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/8.jpg)
+Behavior Coding: extracting cues
8
Source: Adam Kendon Conducting Interaction
![Page 9: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/9.jpg)
+Technological trends: Human-centered Sensing
9
Microcone – Array microphone
Kinect – Image + Depth Camera
Sociometer – Wearable badge
Google glasses
![Page 10: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/10.jpg)
+Technological trends: Human-centered Signal Processing
10
![Page 11: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/11.jpg)
+Technological trends: Human-centered Signal Processing
© CHIL
11
![Page 12: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/12.jpg)
+
Label
Observations
Hidden Variable
Observations
Technological trends: Machine Learning/Probabilistic Formulations
12
![Page 13: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/13.jpg)
+Behavior Tracking and Perception [Human Human Interaction]
Cue Summarization
Behavior Perception
Multimodal Signal Processing
Speaking, Looking Gesturing style
Who speaks, Looks at Whom, who nods
Feedback/Analysis
Machine Learning
13
Sensing
P(Perception/Behavior)
Behavior Tracking
VIDEO
![Page 14: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/14.jpg)
+Example: Gaze tracking
VFOA: Visual Focus of Attention
Observation: Texture (HOG) & color features
State space:
Location, scale,
eccentricity - continuous
Pose – discrete
14
![Page 15: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/15.jpg)
+ 15 Example: Analysis HHI
speaking activity
inferred focus
person ID
head pose
tracking
side-view cameras
VIDEO
![Page 16: Analyzing gaming-simulations using video based techniques](https://reader035.fdocuments.net/reader035/viewer/2022081404/559637631a28abd3148b4753/html5/thumbnails/16.jpg)
+Conclusion
n Serious game [Face-to-face] design
n Need for automatic observation (summarization and querying)
n Automatic behavior analysis
n Speech – who speaks when to whom, interruption, negotiation, word usage, dialog acts (question, answer)
n Video – who looks at whom, who gestures what
n Challenges: Canceling speech interference from other groups, occlusion.
16