Post on 27-Mar-2015
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Virginia Tech Plans with SenseCam: Early Ideas
Microsoft Memex Workshop, July 2006
Beyond Human Memory:SenseCam Use in Veterinary
College and as Assistive Technology
Manuel A. Pérez-Quiñones,Edward A. Fox
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Virginia-Maryland Regional College of Veterinary Medicine
• Context of student life at the Vet School• Goals:
– improve the recall of clinical procedures studied in lab sessions
– promote learning through sharing of information among students
• which should result from integration of– audio/photos from multiple SenseCams,– video from the professor, and– live notes taken by several students
• Sharing:– Students will have the option of providing access to
particular pieces of information by particular users.– Information will be uploaded automatically to a web server
where it will be available to other students for download into their MyLifeBits data store.
Friday, December 2, 2005
Human InformationProcessingPersonal MemexStudents with Disabilities
• Help students with disabilities in their day-to-day activities on campus
• Use location tracking and some form of simple tagging of the audio or video data to help students with prospective remembering
• Allow students with motor disabilities to share data with their care-giver and/or with the staff of the Assistive Technologies office
• Track locations indoors with 802.11 device
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Term Veterinary School Students with Disabilities
Spring 2006
Early-semester - 2 students use SenseCam for week at a timeMid-semester - administer memory test; design and prototype data sharing functionalityLate-semester - focus group, interview students
Early-semester – identify students that will participate; consider privacy and legal issuesMid-semester – allow student to use SenseCam for a period of time. Design and prototype indoor route visualization.Late-semester – analyze effectiveness of SenseCam for students with disabilities
Summer 2006
Implementation of new functionality into MyLifeBits schema.Write papers with early results, participate in workshops
Fall 2006
Repeat memory study using new functionality.Consider collaboration and sharing of data more explicitly.
Recruit new participantsDeploy system with participants and care-giversEvaluate effectiveness.
Publish results, participate in workshops
Original Timeline
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Human Information Processing
with the
Personal Memex
Ingrid Burbey, Gyuhyun Kwon, Uma Murthy, Nicholas Polys, Prince Vicent
Human Information Processing Project Presentation
Friday, December 2, 2005
Human InformationProcessingPersonal MemexOverview
Literature Search:
HIP Principles
Initial Prototype
Expert Interviews
Cognitive Walkthroughwith experts
Scenarios
Task Analysis
Revised PrototypeDesign Guidelines
1. Project Overview
AnnotatedBibliography
Friday, December 2, 2005
Human InformationProcessingPersonal MemexOverview
Literature reviewExpert Interview
Studies of current related systemsBrainstorming
Design
Analysis
Prototype&Evaluation
Scenario generationFunction decomposition
Task decompositionSpecifying interaction
Low fidelity prototypeCognitive walkthrough
Iterative analysis and design based on Usability claims and HIP principle
1. Project Overview
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Memex Prototyping
Test ScenarioDescription
Performing Cognitive Walkthrough
Record usability
problems found
Fix the usability
problems
System Requirements
HIP/Usability Principle
Cognitive Walkthrough
1. Cognitive Workthrough Process
Friday, December 2, 2005
Human InformationProcessingPersonal MemexHuman Information Processing: Memory
• The Multi-Store Model (Atkinson & Shiffrin, 1968)
• Encoding, Storage, Retrieval
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Human Information Processing: Long-term Memory
• Types of LTM (evidence from Amnesiacs)– Semantic: Knowledge & Facts– Episodic: Events & Experiences – Procedural: Skill
• Aspects of LTM– Explicit aka ‘declarative’– Implicit aka ‘non-declarative’
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Human Information Processing: Long-term Memory
• Structure of LTM: Schemas– Developed by experience and pre-
programming; accommodation & assimilation
– Prototypical elements are always given priority
– Can be applied non-consciously– Shared across individuals within a culture– Stable over time
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Human Information Processing: Long-term Memory
Recall can be confounded by:• Proactive interference
– prior learning interferes with subsequent learning
• Retroactive interference – post hoc learning confounds the prior
learning
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Human Information Processing: Long-term Memory
Models of LTM retrieval• Associative Memory
– Levels of Processing – Cue-dependent forgetting
•Encoding Specificity Principle : Context !!!
– Priming & Cues : visual, verbal, …
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Human Information Processing: Working Memory
• Working Memory, Baddeley, 2003
Friday, December 2, 2005
Human InformationProcessingPersonal MemexSymptoms of Macular Degeneration
• Difficult to see colors• Difficulty recognizing faces• Prefer dim backgrounds
Friday, December 2, 2005
Human InformationProcessingPersonal MemexMild Cognitive Impairment
• Due to Hippocampus shrinking • No universally, accepted definition• Symptoms
– Loss of short-term memory– Forgetfulness– Deteriorates over time– Difficulty in associative memory
• Remembering names of people or things
Friday, December 2, 2005
Human InformationProcessingPersonal MemexDesign Guidelines
Design Guidelines• Formulated in the tradition of
Nielsen, Tognazzini • Discovered or confirmed through:
– Literature search– Expert interviews– Cognitive walkthrough
Friday, December 2, 2005
Human InformationProcessingPersonal MemexDesign Guidelines
General Results
• Maintain consistent, meaningful graphics• Support opportunistic navigation
– user control and freedom – ‘Bookmarking’ paths, previous searches
• Leverage user recognition rather than recall – provide context for users while searching and browsing memories
• Provide visibility for mode & system status • Provide Internationalized Tool Tips for icons and buttons• Provide Help w/o loosing state• Provide Tutorials explicitly demonstrating functionality
Friday, December 2, 2005
Human InformationProcessingPersonal MemexDesign Guidelines
Population-specific Results: Mild Cognitive Impairment
• Simplify task steps• Provide views that can represent time and objects
graphically • Provide time, space, and object reminders
(for schedules, directions, medication)
Friday, December 2, 2005
Human InformationProcessingPersonal MemexDesign Guidelines
Population-specific Results: Visual Impairment
• Provide enlargeable fonts & interface items (e.g., buttons)• Provide contrast between font and background• Provide options for audio output: voice, speed,
pitch
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Prototype
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Friday, December 2, 2005
Human InformationProcessingPersonal Memex
Friday, December 2, 2005
Human InformationProcessingPersonal MemexGeneral Comments
• Integration with other applications/devices
• Date/time on main screen• Mouse-over magnification• Help menu item• Prototypical terms• Scroll forward to future events
Friday, December 2, 2005
Human InformationProcessingPersonal MemexTablet Idea
• Monday Tablet session• Discussion that people aided by
assistive technologies are delayed a long time before the right affordances arise
• Idea that SenseCam could be used along with a Tablet
• in synergistic capture, analysis, design, deployment methodology
Friday, December 2, 2005
Human InformationProcessingPersonal MemexSummary and Conclusions
• Two planned efforts• Student project report• Tablet idea• Looking forward to new version!• Hoping Microsoft’s many projects
(search, image processing, Tablet, etc.) can be integrated with MyLifeBits
• Hope Microsoft staff can help run a JCDL workshop on personal DLs in 2007
• Open for collaboration– fox@vt.edu