VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to...
Transcript of VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to...
![Page 1: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/1.jpg)
VIGART Application to Assist ASD ChildrenHCI Focus
http://www.ed.gov/blog/2011/04/raising-autism-awareness/
![Page 2: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/2.jpg)
Based on the Paper:Design of a Gaze-Sensitive Virtual Social
Interactive System for Children With Autism
By: Uttama Lahiri, Zachary Warren, and Nilanjan Sarkar
From: IEEE Transactions on Neural Systems and Rehabilitation Engineering Vol. 19 No. 4, August 2011
![Page 3: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/3.jpg)
Overview Introduction to ASD Motivation Previous Work VIRGART Usability Study Conclusions Future Work
![Page 4: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/4.jpg)
Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition:
− A neurological developmental disability that varies in symptoms and severity, presenting around the age of 3. The main impairment is communication and social abilities
Pierce K et al. Brain 2004;127:2703-2716
![Page 5: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/5.jpg)
High Functioning
Low Functioning
Normal
Aspergers
![Page 6: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/6.jpg)
ASD in People
![Page 7: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/7.jpg)
![Page 8: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/8.jpg)
Life for ASD Affected Individuals Inability to interpret emotions Inability to communicate emotions Inability to process emotions Inability to control behavior ADHD ADD Uncontrollable Tantrums Overwhelmed by surrounding
http://www.howtodothings.com/health-and-fitness/a3856-how-to-teach-autistic-children.html
![Page 9: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/9.jpg)
![Page 10: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/10.jpg)
Motivation Intervention to better quality of life Provide education to improve core skills There are no answers, explanations or cures
http://www.to-treat-autism.com/tag/autism-symptoms/
![Page 11: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/11.jpg)
Previous Work VR systems designed for ASD individuals are
open loop Low levels of customization in the VR system Pyshcological- Many Theories, No Answers Neurological- Many Theories, No Answers Distance Learning/Virtual Enviroments for
main stream inderviduals
![Page 12: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/12.jpg)
HCI Human Computer Interactions Interactions: Emotional, Physical,
Psychological Interfaces:Tangible, Visualization, Audio,
Commands
http://mehrcenter.com/blog/tips-for-judging-a-touchscreen-display/
![Page 13: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/13.jpg)
Interaction Design: Beyond Human-Computer Interaction, 3ed. Preece, Sharp,
Rogers;www.id-book.com, 2011
![Page 14: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/14.jpg)
Objective Develop a system for VR that can be
individualized through feedback from gaze patterns
Explore the usability and acceptability of VIGART for use by ASD adolescents
![Page 15: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/15.jpg)
VIGART Virtual Interactive system with Gaze-sensitive
Adaptive Response Technology 3 components
− VR System presenting the educational information
− Real time gaze monitoring− Integration of the real time data to the VR
system for individualization
![Page 16: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/16.jpg)
VR System Avatars are modeled in similarity to the
individuals Avatars provide the interface of
communicating the information, story or situation for the individual to interact with and learn from
Design of a Gaze Sensitive Virtual Social Interactive System for Children with Autism, DOI: 10.1109/TNSRE.2011.2153874
![Page 17: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/17.jpg)
Gaze Detection
Eye gaze behavior is characteristic of attention
http://www.newscientist.com/blog/invention/labels/military.html
http://gazeinteraction.blogspot.com/2010/08/how-to-build-low-cost-eye-tracking.html
![Page 18: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/18.jpg)
Data Acquisition
Design of a Gaze Sensitive Virtual Social Interactive System for Children with Autism, DOI: 10.1109/TNSRE.2011.2153874
![Page 19: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/19.jpg)
Quantification for Feedback and Evaluation
Mean Pupil Diameter (PDmean) Sum of Fixation Counts (SFC) Average Fixation Duration (FDAVG) Regions of Interest(ROI)
http://www.33rdsquare.com/2012/01/click-on-windows-8-apps-by-looking-at.html
![Page 20: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/20.jpg)
Extraction of Quantifiable Features
Design of a Gaze Sensitive Virtual Social Interactive System for Children with Autism, DOI: 10.1109/TNSRE.2011.2153874
![Page 21: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/21.jpg)
ROI
Design of a Gaze Sensitive Virtual Social Interactive System for Children with Autism, DOI: 10.1109/TNSRE.2011.2153874
![Page 22: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/22.jpg)
Feedback System Attention level needs to control the speed of
the communication Can be a rule based system or dynamic
![Page 23: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/23.jpg)
VIGART Feedback System Questions
from the user complement the data from the gaze monitoring
Design of a Gaze Sensitive Virtual Social Interactive System for Children with Autism, DOI: 10.1109/TNSRE.2011.2153874
![Page 24: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/24.jpg)
Real Time Gaze-Based Feedback Algorithm (RGFA)
Algorithm controls sampling of the gaze coordinates, 33ms
The ROI is determined through coordinate analysis
VIGARTUser
Interface
![Page 25: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/25.jpg)
Usability Testing 6 adolescents with ASD(5 male, 1 female) Ages 13-17 Half participants in mild to moderate ASD
range, half in the severe rang Language skills were required to be above 80
from the PPVT 5 social interactions were tested, each with a
story approxinmatly 3 minutes long
![Page 26: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/26.jpg)
Study Results Exit interviews with the subjects provided the
following feedback:− Liked interacting with VIGART− Wanted to use it more
From the feedback of the caregivers, VIGART had influence on the behavior with an increase engagement
![Page 27: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/27.jpg)
Design of a Gaze Sensitive Virtual Social Interactive System for Children with Autism, DOI: 10.1109/TNSRE.2011.2153874
![Page 28: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/28.jpg)
Design of a Gaze Sensitive Virtual Social Interactive System for Children with Autism, DOI: 10.1109/TNSRE.2011.2153874
![Page 29: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/29.jpg)
Results from Usability Testing Has Potential for Acceptance by the Target
Audience Indexes of quantification allow VIGART to be
an intelligent system
![Page 30: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/30.jpg)
Moving VIGART Forward Switch to desktop mounted eye tracker Larger investigation to take the proof of
technology concept forward to determine actual improvement statistics
![Page 31: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/31.jpg)
HCI Conclusions HCI for ASD Interventions have positive
results when feedback is gained from gaze tracking
HCI utilization of Avatars allow simulation of social interactions
![Page 32: VIGART Application to Assist ASD Children HCI Focuszhuofeng/EE5970Spring2012_files...Introduction to ASD ASD is the acronym for Autism Spectrum Disorder Definition: − A neurological](https://reader034.fdocuments.net/reader034/viewer/2022050519/5fa2af7d4fce6c7dea40dcae/html5/thumbnails/32.jpg)
Future Work Large Scale Testing for statistics on
improvement Advancing VR based on Feedback Expansion of Feedback Interactions Expansion of interactions for individuals with
ASD
http://dallaslifeblog.dallasnews.com/archives/2011/03/kaspar-the-friendly-robot-help.html