Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful...
-
Upload
david-kozatch -
Category
Technology
-
view
1.971 -
download
1
description
Transcript of Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful...
![Page 1: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/1.jpg)
Fast, Cheap and In Control:
Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences
David Kozatch and Susanna Kirk
DIG
![Page 2: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/2.jpg)
1. Short on $ budget and time2. Single session with UI not enough3. You want to assess more than just ‘usability”
Q: How?
![Page 3: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/3.jpg)
![Page 4: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/4.jpg)
Is there a “budget” UI test that will gauge meaningful experiences?
![Page 5: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/5.jpg)
Case Study
![Page 6: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/6.jpg)
Who would like to be happier?
![Page 7: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/7.jpg)
No problem
![Page 8: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/8.jpg)
“There’s an app
for that”
![Page 9: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/9.jpg)
Signal Patterns “Live Happy” for the iPhone – a mobile happiness building application
![Page 10: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/10.jpg)
Why is this woman smiling?
Sonja Lyubormirsky
![Page 11: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/11.jpg)
• What makes people happy?• Benefits of happiness?• How can we make people happier?
![Page 12: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/12.jpg)
And, she wrote a book about it
![Page 13: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/13.jpg)
•Savor
•Restore and Cultivate Relationships
•Goal setting
•Be grateful
•Cultivate optimism
![Page 14: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/14.jpg)
Timeline: record your progress
![Page 15: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/15.jpg)
• Personality survey • Happiness and Mood survey• Activity “Fit” Survey
![Page 16: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/16.jpg)
Q: Sounds great -- but how do you put …
?
![Page 17: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/17.jpg)
A: Partner with a company that knows about technology …
![Page 18: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/18.jpg)
![Page 19: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/19.jpg)
![Page 20: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/20.jpg)
The Project
![Page 21: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/21.jpg)
• Assess “proof of concept”
• Assess “usability” • Assess preference of
guided vs. unguided navigation
• Assess price sensitivity/value
• Would a donation help?
Client Objectives:
![Page 22: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/22.jpg)
And, by the way …• Highly specialized
audience
• Requires at least a week of use in order to realize its benefits
• Short time window prior to launch
• Difficult to distribute the app to users
• Limited budget for research
![Page 23: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/23.jpg)
“Can we get a copy of the app and take it for a spin?”
![Page 24: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/24.jpg)
Not quite ready for prime-time
Please stand by….
Photo: Diane Diederich
![Page 25: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/25.jpg)
1. Does the application provide personal significance for users?
2. Is the interface helpful? Respectful? Interested? Forgiving?
3. Does the app take full advantage of the personalized features and interface provided by the iPhone?
Reframe Objectives to include 3 additional questions re: meaning:
![Page 26: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/26.jpg)
Recommendation:
Qualitative assessment
![Page 27: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/27.jpg)
• Sync to iPhone/iPod Touch• Use Live Happy prototype for 7-10 days• Provide detailed feedback via Google Docs
every day during the test period
Focus Group:• Participate in follow-up discussion online via
WebEx and telephone• Include in-depth discussion and instant
polling
Methodology:
Diary:
![Page 28: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/28.jpg)
Why not remote UI study?
• Limited research budget: requires greater time commitment
• Remote testing limited to a few tasks
• Too much focus on “errors” • Need detailed feedback
about experiences
![Page 29: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/29.jpg)
Keep sample small (N=10-12)Use client resources: user or
prospect email lists, etc.Use online social networks (e.g.,
Facebook) and related user pages (e.g., ipod lounge)
Ask qualifying questions relating to specific behaviors/attitudes (e.g., price sensitivity)
Only include those with some interest in overall concept
Recruiting tips
![Page 30: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/30.jpg)
Base $ amount on difficulty of participation – not just audience type
Cash is king: coupons or merch seldom work
Don’t be afraid to overpay to insure participation – you’ve only got one shot
Spread out payments: e.g., 50% after complete diary
entries 50% after complete focus
group
$ Incentive tips
![Page 31: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/31.jpg)
The Diary Study
![Page 32: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/32.jpg)
• UI issues in a “real world” environment
• Users choose their own pace
• “Unfiltered” responses• Adjust questions during
test• Easy, continuous client
involvement
Lose benefits of “direct observation” but gain …
![Page 33: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/33.jpg)
![Page 34: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/34.jpg)
• Flexible and Free • Can reveal a small portion of the diary questions at a time via skip patterns
• Responses automatically populate Google spreadsheet for easy review and sharing
• All responses are dated• Users can upload links to pictures
• Users trust Google
Why we like
![Page 35: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/35.jpg)
Keep questions simple and shortUse mix of closed and open endsGive user the ability to decide
which questions they’d like to answer
Provide final screen text that invites user to go back and answer more q’s
For picture uploads, have respondents use http://imageshack.us Free No registration required Don’t have to share own flickr
photos
Google Docs diary tips
![Page 36: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/36.jpg)
![Page 37: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/37.jpg)
Stay in touch!Use friendly language Praise and cajoleFoster competition, if possibleRemind them that they are getting
paid
More diary tips
![Page 38: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/38.jpg)
![Page 39: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/39.jpg)
Focus Group
![Page 40: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/40.jpg)
Why bother doing a focus group?
• Allows users to share experiences
• Allows client to hear direct feedback and probe deeper
• Adds more depth re: user experiences beyond initial diary entries
• More opportunities to assess emotional language
• Can test additional interface ideas/fixes
• Provides confirmation of hypothesis learned from diaries
![Page 41: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/41.jpg)
… can better assess meaning and user engagement
And …
![Page 42: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/42.jpg)
• Was the (interface) helpful?• Define value of the (interface) in terms of how
it made you feel• Did you get a sense that the (interface) was
listening/responding to your needs as you completed each task?
• How does this (application) fit with how you perform related activities in your life?
Q:
![Page 43: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/43.jpg)
• Relatively low cost• Has video capability• Can switch from PPT to live Web easily if needed
• Private chat feature allows clients to participate silently
• Has polling feature with instant display of results
• Can record session and stream to client or save as .wmv file
Why we like
![Page 44: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/44.jpg)
Length: 1 ½ - 2 hoursKeep text on PPT slides simple
and unclutteredMake use of screen
shots/imagesUse opportunity to follow up on
individual diary postsUse polling sparinglyOpen poll prior to group
discussion to nail down individual responses
Focus Group moderating tips
![Page 45: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/45.jpg)
Users liked the Live Happy prototype …
•Well designed and inviting
•Can choose your own path or follow a sequence
•Takes advantage of personalized iPhone features
•Fast learning curve
Conclusions
![Page 46: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/46.jpg)
But initial prototype didn’t support higher price point desired by the client.
Why?
![Page 47: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/47.jpg)
• Respond to my activities with affirmations/positive comments
• Clearer indications that suggestions are targeted and unique
• Suggestions across various media
• Integrate LiveHappy with an online account for data entry and backup
• Add more content from Sonja's book that is inquiry based
• Track my change for me
Research showed that users wanted a more meaningful experience …
![Page 48: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/48.jpg)
Isn’t that what we all want?
![Page 49: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/49.jpg)
How do we get there?
![Page 50: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/50.jpg)
“Budget” solution
![Page 51: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/51.jpg)
•Speed (“Fast”)
•Value (“Cheap”)
![Page 52: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/52.jpg)
Performance
![Page 53: Fast, Cheap and In Control: Using an Online Diary/Focus Group Methodology to Gauge Meaningful Experiences](https://reader035.fdocuments.net/reader035/viewer/2022062616/549a5d23b479599c128b4625/html5/thumbnails/53.jpg)
Contact Information
• David Kozatch, Principal
Ph 646.416.6784
• Susanna Kirk, Senior Analyst
Ph 617.475.5105
Web: www.digsmarter.com
Blog: blog.digsmarter.com