HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… ·...
Transcript of HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… ·...
![Page 1: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/1.jpg)
HUMAN-COMPUTER INTERACTIONMETHODOLOGICAL FIT
Professor Bilge MutluComputer Sciences, Psychology, & Industrial and Systems Engineering
University of Wisconsin–Madison
CS/Psych-770 Human-Computer Interaction
![Page 2: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/2.jpg)
CHOOSING THE RIGHT METHOD
![Page 3: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/3.jpg)
“The key to good research lies not in choosing the right method, but rather in asking the right question and picking the most powerful method for answering that particular question.”
—Bouchard, 1976
Bouchard, T. J., Jr. (1976). Field research methods: Interviewing, questionnaires, participant observation, systematic observation, unobtrusive measures. In M. D. Dunnette (Ed.), Handbook
of industrial and organizational psychology: 363– 413. Chicago: Rand McNally.
![Page 4: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/4.jpg)
THE ANATOMY OF A RESEARCH PROJECT
![Page 5: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/5.jpg)
METHODOLOGICAL FIT
Internal consistency among elements of a research project:
Research question
Prior work
Research design
Contribution to literature
![Page 6: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/6.jpg)
I. RESEARCH QUESTION
Goals of a research question:
Focus a study
Narrow the topic area to a meaningful, manageable size
Address issues of theoretical and practical significance
Point toward a viable research project—that is, the question can be answered
![Page 7: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/7.jpg)
II. PRIOR WORK
Prior work represents
The state of the literature
Existing theoretical and empirical research papers that pertain to the topic of the current study
An aid in identifying unanswered questions, unexplored areas, relevant constructs, and areas of low agreement
![Page 8: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/8.jpg)
III. RESEARCH DESIGN
Defines:
Type of data to be collected
Data collection tools and procedures
Type of analysis planned
Finding/selection of sites for collecting data
![Page 9: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/9.jpg)
IV. CONTRIBUTION TO LITERATURE
Components:
The theory developed as an outcome of the study
New ideas that contest conventional wisdom, challenge prior assumptions, integrate prior streams of research to produce a new model, or refine understanding of a phenomenon
Any practical insights drawn from the findings that may be suggested by the researcher
![Page 10: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/10.jpg)
HOW TO DETERMINE LOW FIT
![Page 11: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/11.jpg)
HOW TO DETERMINE FIT?
State of current theory
A given, fixed context in which new research is developed
The only element over which the researcher has no control
From mature to nascent
![Page 12: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/12.jpg)
NASCENT THEORY
Proposes tentative answers to novel questions
Suggesting new connection among phenomena
![Page 13: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/13.jpg)
INTERMEDIATE THEORY
Presents provisional explanations of phenomena
Introduces a new construct
Proposes relationships between new and existing constructs
May be made up of testable hypotheses and tentative construct
![Page 14: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/14.jpg)
MATURE THEORY
Presents well-developed constructs and models
Has been studied over time with increasing precision by a variety of scholars
Consists of points of broad agreement
![Page 15: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/15.jpg)
RESEARCH QUESTIONS
Nascent:
Open-ended inquiry about a phenomenon of interest
Intermediate:
Proposed relationships between new and established constructs
Mature:
Focused questions and/or hypotheses relating existing constructs
![Page 16: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/16.jpg)
TYPE OF DATA COLLECTED
Nascent:
Qualitative, initially open-ended data that need to be interpreted for meaning
Intermediate:
Hybrid (both qualitative and quantitative)
Mature:
Quantitative data; focused measures where extent or amount is meaningful
![Page 17: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/17.jpg)
DATA COLLECTION METHODS
Nascent:
Interviews; observations; obtaining documents or other material from field sites relevant to the phenomena of interest
Intermediate:
Interviews; observations; surveys; obtaining material from field sites relevant to the phenomena of interest
Mature:
Surveys; interviews or observations designed to be systematically coded and quantified; obtaining data from field sites that measure the extent or amount of salient constructs
![Page 18: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/18.jpg)
CONSTRUCTS AND MEASURES
Nascent:
Typically new constructs, few formal measures
Intermediate:
Typically one or more new constructs and/or new measures
Mature:
Typically relying heavily on existing constructs and measures
![Page 19: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/19.jpg)
GOALS OF DATA ANALYSIS
Nascent:
Pattern identification
Intermediate:
Preliminary or exploratory testing of new propositions and/or new constructs
Mature:
Formal hypothesis testing
![Page 20: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/20.jpg)
DATA ANALYSIS METHODS
Nascent:
Thematic content analysis coding for evidence of constructs
Intermediate:
Content analysis, exploratory statistics, and preliminary tests
Mature:
Statistical inference, standard statistical analyses
![Page 21: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/21.jpg)
THEORETICAL CONTRIBUTION
Nascent:
A suggestive theory, often an invitation for further work on the issue or set of issues opened up by the study
Intermediate:
A provisional theory, often one that integrates previously separate bodies of work
Mature:
A supported theory that may add specificity, new mechanisms, or new boundaries to existing theories
![Page 22: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/22.jpg)
Theory
*
*
Dat
aExceptions with good fit
Good fitHybrid
Quantitative
Qualitative
Nascent Intermediate Mature
![Page 23: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/23.jpg)
PROBLEMS WITH LOW FIT
![Page 24: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/24.jpg)
Prior Work Data Problems Outcome
NascentLittle or no prior work on the constructs and processes under investigation
Qualitative only Fishing expeditionsResults vulnerable to finding significant associations among novel constructs and measures by chance
Research falls too far outside guidelines for statistical inference to convince others of its merits
Hybrid Quantitative measures with uncertain relationship to phenomenaEmergent constructs may suggest new measures for subsequent research, but statistical tests using same data that suggested the constructs are problematic
![Page 25: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/25.jpg)
Prior Work Data Problems Outcome
IntermediateOne or more streams of relevant research, offering some but not all constructs and measures needed
Quantitative only Uneven status of empirical measuresNew constructs and measures lack reliability and external validity and suffer in comparison to existing measures
Results are less convincing, reducing potential contribution to the literature and influence on others’ understanding of the topic
Qualitative only Lost opportunityInsufficient provisional support for a new theory lessens paper’s contribution
![Page 26: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/26.jpg)
Prior Work Data Problems Outcome
MatureExtensive literature, complete with constructs and previously tested measures
Qualitative only Reinventing the wheelStudy findings risk being obvious or well-known
Research fails to build effectively on prior work to advance knowledge about the topic
Hybrid Uneven status of evidencePaper is lengthened but not strengthened by using qualitative data as evidence
![Page 27: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/27.jpg)
QUESTIONS?
![Page 28: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/28.jpg)
DISCUSSION QUESTIONS
![Page 29: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/29.jpg)
HOW DOES A PERSON’S ENGAGEMENT WITH SOCIAL MEDIA SERVICES AFFECT HIS/HER INFORMATION SHARING
BEHAVIORS?
Jansen, B. J., Sobel, K., and Cook, G. 2010. Gen X and Ys attitudes on using social media platforms for opinion sharing. In Proceedings of the 28th of the international Conference Extended Abstracts on Human Factors in
Computing Systems (Atlanta, Georgia, USA, April 10 - 15, 2010). CHI EA '10. ACM, New York, NY, 3853-3858. DOI= http://doi.acm.org/10.1145/1753846.1754068
![Page 30: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/30.jpg)
1. HOW IS VISUAL ATTENTION GENERALLY DISTRIBUTED ON THE SCREEN DURING
READING?
2. WHAT IS THE NATURE OF VARIATION ACROSS USERS?
3. IS THERE A RELATIONSHIP BETWEEN MOUSE MOVEMENTS AND THE DISTRIBUTION
OF VISUAL ATTENTION ON THE SCREEN?
Buscher, G., Biedert, R., Heinesch, D., and Dengel, A. 2010. Eye tracking analysis of preferred reading regions on the screen. In Proceedings of the 28th of the international Conference Extended Abstracts on Human
Factors in Computing Systems (Atlanta, Georgia, USA, April 10 - 15, 2010). CHI EA '10. ACM, New York, NY, 3307-3312. DOI= http://doi.acm.org/10.1145/1753846.1753976
![Page 31: HUMAN-COMPUTER INTERACTIONhci.cs.wisc.edu/courses/hci/lectures/fall2011/HCI-Week04-Lecture05.… · HUMAN-COMPUTER INTERACTION METHODOLOGICAL FIT Professor Bilge Mutlu Computer Sciences,](https://reader030.fdocuments.net/reader030/viewer/2022041106/5f0897387e708231d422c38b/html5/thumbnails/31.jpg)
THANKS!Professor Bilge Mutlu
Computer Sciences, Psychology, & Industrial and Systems EngineeringUniversity of Wisconsin–Madison
CS/Psych-770 Human-Computer Interaction