Post on 26-Dec-2015
1
IS8004
Seminar 1:Introduction and the Road Ahead
2
Topics
1. Introduction to Research Methods in IS and Associated Issues. 2. Types of Qualitative Data (Sources) and Analytical Techniques3. Dissection of a Typical Qualitative Research Paper4. Proposal Development5. Focus on Methods 1: Issues in the Field6. Focus on Methods 2: Case Study7. Focus on Methods 3: Ethnography8. Focus on Methods 4: Canonical Action Research9. Theory and Qualitative Research (Guest speaker?)10. Mixing Methods, Data Sources and Epistemologies11. Planning & Writing Qualitative Research12. Reviewing and Presenting Qualitative Research 13. Presenting Research Proposals
3
AssessmentIn-class Participation – 40%– This is not an attendance mark. You need to
participate actively.
In-class Critical Analysis – 30%– Each of you will need to present a critical analysis of
one Qualitative Research paper towards the end of the semester
Proposal Development – 30%– Each of you will need to develop and present a
research proposal that involves qualitative data
4
Expectations
Learning attitude– I do expect that you will read set readings before class, so
that you come prepared– I do expect that you will participate actively in classes. There
are very few “correct” answers. There are many possibilities. You will learn more if you participate.
Attendance– It is advisable. If you can’t come, please email me in advance
to let me know – and give a good justification.
5
Research and MethodsIn order to tackle a research problem it is conventional to apply a method.A method is simply a way of doing something.There are many methods, and each has a prescribed set of rules about how it should be applied.There is no one ‘best’ method. Each method is appropriate for different situations. Sometimes, methods can be applied in combination.Just as important as the method is the researcher – who applies the method.
6
The Research Process
In undertaking research, we attempt to:– Plan our designs in a realistic way– Measure things in a precise way– Generalize our findings in a useful way
However, realism, precision and generalization are to some extent opposed to each other and so doing all three is considered to be impossibleThis is known as the three-horned dilemma
7
For Instance
Experiments (in the lab)– Have very weak realism and generalizability– But very strong control and precision in measurement
Field studies– Are high on realism, often not high on generalizability– And very low on control / precision
Surveys– Are less realistic, more generalizable, moderately
precise, have poor control
8
Research and MethodsMethods can be classified according to the:– Type of data
• Quantitative or Qualitative– Type of data analysis
• Coding, Hermeneutic, Grounded, Metaphorical,…– Epistemology
• Positivist, Interpretivist, Critical– Role of researcher
• Observer, Intervener
9
Types of Data
Quantitative (numerical) Data – Objective data, e.g. $, £, %, n
• Used to describe specific objective measures, e.g. of individual or organisational performance
– Subjective data, e.g. SA = 1, 31/100• Used to describe subjective perceptions of situations
– Transformative data, e.g. Σ, σ, x+y• Used in statistics so as to calculate results – for later
further analysis.
10
Types of DataQualitative– Interviews
• Un/Semi-structured; Telephone, IM, Face-to-Face– Notes and observations
• Text, Audio or Video; Researcher– Diaries
• Data Subject; Confessional– Documents
• Usually organisation; Text, Audio or Video; Paper, Web– User-generated data
• Data Subject; Text, Audio or Video– Emails/SMS/IM/Wiki - logs
• Researcher and Data Subject(s)
11
Data Coding
Organising data so that it can be analysedLooking for patterns in data– Thematic– Metaphorical
So as to identify theoretical constructs, as well as practical examples to illustrate existing theory.
12
MetaphorThe concept of understanding one thing in terms of another. – This system is a dinosaur!– The system is full of rubbish– The system died, hung, flopped, etc.– Shoot the competition! Killer apps– Fly High with Business Knowledge– We should embrace IT– This function is a cornerstone of the programme– Our employees are immersed in an IT training course
13
Themes
Organising (e.g. interview) data according to patterns or themes that can be identifiedHigh-level (Meta) themes, labels, concepts
14
Grounded Theory… is a research method that seeks to develop theory that is grounded in data systematically gathered and analyzed. … is "an inductive theory discovery methodology that allows the researcher to develop a theoretical account of the general features of a topic while simultaneously grounding the account in empirical observations or data." (Martin & Turner, 1986)
15
Epistemology – Positivism
Positivism is premised on the scientific method as the best way to understand processes– It relies on observable, empirical and measurable
evidence– Data is collected through observation and
experimentation; – Hypotheses are formulated and tested with that data– The method is as objective as possible, to reduce bias– Description, control and prediction are key tenets– Context is often disregarded – except in the limitations
section
16
Epistemology - InterpretivismAll actions occur in a social context– This context includes language, culture, shared
meanings– Interpretive studies generally attempt to understand phenomena
through the meanings that people assign to them and interpretive methods of research in IS are "aimed at producing an understanding of the context of the information system, and the process whereby the information system influences and is influenced by the context" (Walsham 1993, p. 4-5).
– Interpretive research does not predefine dependent and independent variables, but focuses on the full complexity of human sensemaking as the situation emerges (Kaplan and Maxwell, 1994).
17
Epistemology - CriticalCritical researchers assume that social reality is historically constituted.Although people can consciously act to change their social and economic circumstances, critical researchers recognize that their ability to do so is constrained by various forms of social, cultural and political domination. The main task of critical research is seen as being one of social critique, whereby the restrictive conditions of the status quo are brought to light. Critical research focuses on the oppositions, conflicts and contradictions in contemporary society, and seeks to be emancipatory.
18
Role of the ResearcherObserver– Someone who watches and measures
• Case studies, Ethnography– Someone who designs and measures
• Experiment, Survey
Intervenor– Someone who changes and measures
• Action Research
19
Case StudyA case study is an empirical inquiry that:– investigates a contemporary phenomenon
within its real-life context, especially when– the boundaries between phenomenon and
context are not clearly evident (Yin, 2003)
The case study is the most common form of qualitative research method in IS – as well as other disciplines
20
EthnographyAn ethnographer is required to spend a significant amount of time in the field.Ethnographers immerse themselves in the lives of the people they study and seek to place the phenomena studied in their social and cultural context.Ethnographies are used to study the development of systems and work practices/processes.Cyber-ethnographies do the same thing in online environments
21
Action ResearchCanonical AR involves the combination of theory and practice “through change and reflection in an immediate problematic situation within a mutually acceptable ethical framework” (Avison et al. 1999), with the dual intention of improving practice and contributing to theory and knowledge both within and beyond the immediate confines of the project (cf. Eden and Huxham, 1996).
22
MixingEach of the above sources of data, types of analysis, methods, etc. can be mixed with othersOften, mixing enables one to gain a richer understanding of a phenomenonBut be careful not to violate each method’s principles and criteriaMake sure you represent each consistently– Venkatesh (MISQ)
23
Rigour and RelevanceGood research needs to aim to satisfy both.Relevance– For whom is the research relevant and why?– Overly controlled or artificial research may not
have high levels of relevance– The ‘audience’ of the research is a key
stakeholder for relevance, notably including any organisations or managers who can actively use the research outcomes
24
RigourSometimes this is assumed to mean ‘positivist’ or ‘scientific’ research.Actually, rigour simply means ‘exactness’ and ‘strict precision’Benbasat/Zmud define rigour as “the correct use of methods and analyses appropriate to the tasks at hand”
25
Theory“There is nothing so practical as a good theory”! (Lewin, 1945)“There is nothing so dangerous as a bad theory”! (Ghoshal, 2005)So, clearly we have to handle theory very carefully.We have a dangerous fetish for theory!– Hambrick, 2007; Avison and Malaurent, 2014.
26
The Purpose of Theory?
To provide prescriptions to be followed in practiceTo represent how concepts interact (e.g. IT, people, organisations)To explain how different concepts are related and then to create testable hypothesesTo make sense of the world.Universal statements designed as nets in which to catch the world and master it. (Popper)
27
Types of Theory
Analysis and Description – What it is. No causality. No prediction.
Explanation – What, how, when, why, where. No prediction or testable
propositions.Prediction– What is and what will be. Testable propositions, but not
causal explanationsDesign and Action– How to do. Explicit prescriptions (methods, techniques)
for actionGregor, MISQ, 2006
28
Examples of Theories Used in IS Research
Absoprtive capacityActor networkAdaptive structurationAgencyBehavioural decisionChaosCognitive dissonanceCognitive fitEtc.
29
InComplete ListAbsorptive capacity theoryActor network theoryAdaptive structuration theoryAdministrative behavior, theory ofAgency theoryArgumentation theoryBehavioral decision theoryBoundary object theoryChaos theoryCognitive dissonance theoryCognitive fit theoryCognitive load theoryCompetitive strategy (Porter)Complexity theoryContingency theoryCritical realism theoryCritical social theoryCritical success factors, theory ofDeferred action, theory ofDelone and McLean IS success modelDiffusion of innovations theoryDynamic capabilities
Embodied social presence theoryEquity theoryEvolutionary theoryExpectation confirmation theoryFeminism theoryFit-Viability theoryFlow theoryGame theoryGarbage can theoryGeneral systems theoryGeneral deterrence theoryHermeneuticsIllusion of controlImpression management, theory ofInformation processing theoryInstitutional theoryInternational information systems theoryKnowledge-based theory of the firmLanguage action perspectiveLemon Market TheoryManagement fashion theoryMedia richness theory
Media synchronicity theory
Modal aspects, theory of
Multi-attribute utility theory
Organizational culture theory
Organizational information processing theory
Organizational knowledge creation
Organizational learning theory
Portfolio theory
Process virtualization theory
Prospect theory
Punctuated equilibrium theory
Real options theory
Resource-based view of the firm
Resource dependency theory
Self-efficacy theory
SERVQUAL
Social capital theory
Social cognitive theory
Social exchange theory
Social learning theory
Social network theory
Social shaping of technology
Socio-technical theory
Soft systems theory
Stakeholder theory
Structuration theory
Task closure theory
Task-technology fit
Technological frames of reference
Technology acceptance model
Technology dominance, theory of
Technology-organization-environment framework
Theory of planned behavior
Theory of reasoned action
Transaction cost economics
Transactive memory theory
Unified theory of acceptance and use of technology
Usage control model
Work systems theory
Yield shift theory of satisfaction
30
Discussion Questions
In which situations do you think a qualitative method might be most practical or useful?– Be as specific as possible. Justify why you think so.
Why is a good theory practical and why is a bad theory dangerous?Is it a problem that we have a fetish for theory?Can theory-light research ever be good research?
31
References 1
Avison, D.E., Lau, F., Myers, M. and Nielsen, P.A. (1999) "Action Research", Communications of the ACM, 42, 1, 94-97.
Avison, D.E. and Malaurent, J. (2014) Is Theory King? Questioning the Theory Fetish in Information Systems, Journal of IT, 29, 4, 327-336.
Eden, C. and Huxham, C. (1996) Action Research for Management Research, British Journal of Management, 7, 1, 75-86.
Ghoshal, S. (2005) Bad Management Theories are Destroying Good Management Practices, Academy of Management Learning and Education, 4, 1, 75-91.
Gregor, S. (2006) The Nature of Theory in Information Systems, MIS Quarterly 30(3): 611-642.Hambrick, D. (2007). The Field of Management’s Devotion to Theory: Too much of a good thing?
Academy of Management Journal 50(6): 1346–1352.Kaplan, B. and Maxwell, J.A. "Qualitative Research Methods for Evaluating Computer Information
Systems," inEvaluating Health Care Information Systems: Methods and Applications, J.G. Anderson, C.E. Aydin and S.J. Jay (eds.), Sage, Thousand Oaks, CA, 1994, pp. 45-68.
32
References 2
Klein & Myers (1999) A Set of Principles for Conducting and Evaluating Interpretive Field Studies in IS, MISQ, 23, 1, 67-94.
Lewin, K. (1945) The Research Centre for Group Dynamics at Massachusetts Institute of Technology, Sociometry, 8, 126-135.
Martin, P.Y. and B.A. Turner. "Grounded Theory and Organizational Research," The Journal of Applied Behavioral Science, (22:2), 1986, pp. 141-157.
Venkatesh, V., Brown, S. and Bala, H. (2013) Bridging the Qualitative-Quantitative Divide: Guidelines for Conducting Mixed Methods Research in Information Systems, MISQ, 37, 1, 21-54.
Walsham, G. (1993) Interpreting Information Systems in Organisations, Wiley: Chichester.
Yin, R.K. (2003) Case Study Research, Design and Methods, Sage Publications