Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does...
Transcript of Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does...
![Page 1: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/1.jpg)
everyoneHypothesis testing for
Nick FineBAD 2020
![Page 2: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/2.jpg)
@doctorfine@Nick Fine
![Page 3: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/3.jpg)
1996 BSc (Hons) Psychology | heavy MUDding | Worms Armageddon | C&C
2004 MSc Human Computer Interaction with Ergonomics2009 PhD Human Computer Interaction, Personalisation | Eve Online
2010 User Experience Executive, LV=
2011 Senior User Experience Consultant, Redweb
2013 Head of User Experience, SAS/MSLGROUP
2014 Lead User Experience Architect (contract), Virgin Media
2016 Lead User Experience Architect (contract), Camelot & VML London
2017 Lead User Researcher (contract), Home Office
2018 Lead User Researcher (contract), Eurostar & Greater London Authority
ACADEMIC STUPIDITY
COMMERCIAL UX
EXPERIENCE
2019- Lead User Researcher (contract), Shell, Emergn @ GSK
EARLY COMPUTING
INTERNET PIONEERING
1997 Senior Technical Consultant, Demon Internet
DOTCOM BOOM
1998 Head of Technical Pre-Sales, Internet Network Services
1999-03 Chief Technical Officer, EO plc
1999-03 Technical Advisor, New Media Spark plc
1985 First modem. Hacked UK car manuf., bank and florist on BBC Model B | Elite
1991 Active member on SFnet, coffee table network in San Francisco
1979 First computer, Tandy TRS-80. First console, Atari 2600
PSYCHOLOGY!
1990 Introduced first computing, Mac 2SE & Filemaker Pro at Marvel Comics UK
![Page 4: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/4.jpg)
1996 BSc (Hons) Psychology | heavy MUDding | Worms Armageddon | C&C
2004 MSc Human Computer Interaction with Ergonomics2009 PhD Human Computer Interaction, Personalisation | Eve Online
2010 User Experience Executive, LV=
2011 Senior User Experience Consultant, Redweb
2013 Head of User Experience, SAS/MSLGROUP
2014 Lead User Experience Architect (contract), Virgin Media
2016 Lead User Experience Architect (contract), Camelot & VML London
2017 Lead User Researcher (contract), Home Office
2018 Lead User Researcher (contract), Eurostar & Greater London Authority
ACADEMIC STUPIDITY
COMMERCIAL UX
EXPERIENCE
2019- Lead User Researcher (contract), Shell
EARLY COMPUTING
INTERNET PIONEERING
1997 Senior Technical Consultant, Demon Internet
DOTCOM BOOM
1998 Head of Technical Pre-Sales, Internet Network Services
1999-03 Chief Technical Officer, EO plc
1999-03 Technical Advisor, New Media Spark plc
1985 First modem. Hacked UK car manuf., bank and florist on BBC Model B | Elite
1991 Active member on SFnet, coffee table network in San Francisco
1979 First computer, Tandy TRS-80. First console, Atari 2600
PSYCHOLOGY!
1990 Introduced first computing, Mac 2SE & Foxbase at Marvel Comics UK
![Page 5: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/5.jpg)
• What is hypothesis testing? • Who is it for? • Working with Product • How do I do it? How do we do it? • Storing hypotheses • Sharing and socialising
What we’ll be covering
![Page 6: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/6.jpg)
What's in it for you ?tried and testing way of learning about stuff you learn better stuff
raise your profile at work by leading the thinking
demonstrable value = job security, £££, builds confidence
build better product better experience, better folio
![Page 7: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/7.jpg)
![Page 8: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/8.jpg)
![Page 9: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/9.jpg)
AUTHORS
INSIGHTS
TECHNIQUES
TOOLS
METHODS EFFECTS
![Page 10: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/10.jpg)
![Page 11: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/11.jpg)
??
??
??
??
?? ??
![Page 12: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/12.jpg)
THINGS YOU LEARN FOR YOUR SELF
THINGS YOU PRACTICE AT WORK
![Page 13: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/13.jpg)
THINGS YOU LEARN FOR YOUR SELF
THINGS YOU PRACTICE AT WORK
??? ???
![Page 14: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/14.jpg)
THINGS YOU LEARN FOR YOUR SELF
THINGS YOU PRACTICE AT WORK
![Page 15: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/15.jpg)
THINGS YOU LEARN FOR YOUR SELF
THINGS YOU PRACTICE AT WORK
HYPOTHESIS TESTING
![Page 16: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/16.jpg)
HYPOTHESIS
![Page 17: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/17.jpg)
IDEA
![Page 18: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/18.jpg)
HYPOTHESIS =
IDEA
![Page 19: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/19.jpg)
IDEATHIS IS ALL ABOUT
TESTING
![Page 20: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/20.jpg)
IDEASEVERYONE HAS
you! your boss your bosses boss
product development deliverydesign contentmarketing
the client
your partner some dude David Icke
![Page 21: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/21.jpg)
IDEAS USERS
![Page 22: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/22.jpg)
IDEAS USERS
![Page 23: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/23.jpg)
IDEAS USERS
USE
R E
XPER
IEN
CE
![Page 24: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/24.jpg)
IDEAS USERS
UX
MAR
KET
ING
R&D
![Page 25: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/25.jpg)
IDEAS USERS
PRO
DU
CT
MAR
KET
ING
R&D
UX
AGEN
CY
AGEN
CY
AGEN
CY
AGEN
CY
AGEN
CY
AGEN
CY
![Page 26: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/26.jpg)
IDEAS USERS
PRO
DU
CT
MAR
KET
ING
R&D
UX
AGEN
CY
AGEN
CY
AGEN
CY
AGEN
CY
AGEN
CY
AGEN
CY
![Page 27: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/27.jpg)
MAR
KET
ING
R&D
AGEN
CY
AGEN
CY
AGEN
CY
AGEN
CY
AGEN
CY
AGEN
CYIDEAS USERS
PRO
DU
CT
UX HYPOTHESIS
TESTING
![Page 28: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/28.jpg)
MAR
KET
ING
R&D
AGEN
CY
AGEN
CY
AGEN
CY
AGEN
CY
AGEN
CY
AGEN
CYIDEAS USERS
PRO
DU
CT
UX
TRYING OUT A COOL IDEA I LEARNED AT BAD2020 TO SEE IF IT WORKS FOR OUR USERS
![Page 29: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/29.jpg)
ORGANISE YOUR IDEAS
![Page 30: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/30.jpg)
MANAGE YOUR IDEAS
![Page 31: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/31.jpg)
STRUCTURE YOUR
HYPOTHESES
![Page 32: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/32.jpg)
What do I mean by
STRUCTURE ?
![Page 33: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/33.jpg)
1. Structured HYPOTHESES2. Structured INQUIRY
What do I mean by
STRUCTURE ?
![Page 34: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/34.jpg)
1. Structured HYPOTHESES2. Structured INQUIRY
What do I mean by
STRUCTURE ?
![Page 35: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/35.jpg)
HYPOTHESIS STRUCTURE
If I do [ ] then [ ]
If I make the CTA green then more people buy more
If I add a chatbot to the product page then people will be able to get help quicker and buy more
CHANGEACTION
![Page 36: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/36.jpg)
If I choose stock images with individuals not looking directly at the camera, then people will feel more comfortable on our website. I will know this to be true when time on page and/or pages consumed increases from repeat visitors by at least 20%
If I do [ACTION] then [CHANGE]I will know this to be true when [MEASURABLE OUTCOME]
![Page 37: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/37.jpg)
1. Structured HYPOTHESES2. Structured INQUIRY
What do I mean by
STRUCTURE ?
![Page 38: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/38.jpg)
STRUCTURED INQUIRY
Structuring your learning activity
i.e. how do you learn about stuff?
![Page 39: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/39.jpg)
UNSTRUCTURED STRUCTURED
HYPOTHESIS #1
HYPOTHESIS #2
FAIL
FAIL
HYPOTHESIS #1
HYPOTHESIS #2
FAIL
FAIL
HYPOTHESIS #3
PASS
HYPOTHESIS #3
FAIL
![Page 40: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/40.jpg)
UNSTRUCTURED STRUCTURED
HYPOTHESIS #1
HYPOTHESIS #2
HYPOTHESIS #3
FAIL
FAILFAIL
HYPOTHESIS #1
HYPOTHESIS #2
FAIL
FAIL
HYPOTHESIS #3
PASS
Guessing
![Page 41: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/41.jpg)
UNSTRUCTURED STRUCTURED
HYPOTHESIS #1
HYPOTHESIS #2
HYPOTHESIS #3
FAIL
FAILFAIL
HYPOTHESIS #1
HYPOTHESIS #2
FAIL
FAIL
HYPOTHESIS #3
PASS
LearningGuessing
![Page 42: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/42.jpg)
THE STRUCTURE THAT COMES FROM HYPOTHESIS TESTING CHANGES YOU, YOUR TEAM AND YOUR BUSINESS INTO A
LEARNING MACHINE
![Page 43: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/43.jpg)
• Break your ideas down into manageable hypotheses
• investigate one thing at one time • don’t be overambitious • repeat hypotheses with different samples
LEARNING MACHINETop Tips:
![Page 44: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/44.jpg)
VARYING YOUR HYPOTHESESaka trying something a little different to see if it
works any better
![Page 45: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/45.jpg)
CALL TOACTION
COLOUR SHAPE POSITION
H S L ROUNDED SQUARE TOP BOTTOM BOTH
![Page 46: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/46.jpg)
• Be agile about it • learn small • fail fast • iterate quickly
LEARNING MACHINETop Tips:
![Page 47: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/47.jpg)
How do I fit this into my ways of working?How does this work on agile teams?
![Page 48: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/48.jpg)
PRODUCT TEAM SPRINT 1
WEEK 1 WEEK 2DISCOVERY TESTING
![Page 49: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/49.jpg)
PRODUCT TEAM SPRINT 1
WEEK 1 WEEK 2DISCOVERY TESTING
IDEAS!
HYPOTHESIS GENERATION
DOES IT WORK?
HYPOTHESIS TESTING
PR
OTO
TY
PIN
G
![Page 50: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/50.jpg)
PRODUCT TEAM SPRINT 1
WEEK 1 WEEK 2DISCOVERY TESTING
PRODUCT TEAM SPRINT 2
WEEK 1 WEEK 2DISCOVERY TESTING
IDEAS!
HYPOTHESIS GENERATION
DOES IT WORK?
HYPOTHESIS TESTING
IDEAS!
HYPOTHESIS GENERATION
PR
OTO
TY
PIN
G
PR
OTO
TY
PIN
G
![Page 51: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/51.jpg)
DEV TEAM SPRINT 1
DEV TEAM SPRINT 2
DEV TEAM SPRINT 3
PRODUCT TEAM SPRINT 1
PRODUCT TEAM SPRINT 2
PRODUCT TEAM SPRINT 3
PRODUCT TEAM SPRINT 4
![Page 52: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/52.jpg)
DEV TEAM SPRINT 2
DEV TEAM SPRINT 3
PRODUCT TEAM SPRINT 2
PRODUCT TEAM SPRINT 3
PRODUCT TEAM SPRINT 4
DEV TEAM SPRINT 1
PRODUCT TEAM SPRINT 1
VALIDATED IDEAS
![Page 53: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/53.jpg)
DEV TEAM SPRINT 1
DEV TEAM SPRINT 2
DEV TEAM SPRINT 3
PRODUCT TEAM SPRINT 1
PRODUCT TEAM SPRINT 2
PRODUCT TEAM SPRINT 3
PRODUCT TEAM SPRINT 4
![Page 54: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/54.jpg)
DEV TEAM SPRINT 1
DEV TEAM SPRINT 2
DEV TEAM SPRINT 3
PRODUCT TEAM SPRINT 1
PRODUCT TEAM SPRINT 2
PRODUCT TEAM SPRINT 3
PRODUCT TEAM SPRINT 4
![Page 55: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/55.jpg)
MANAGING YOUR RESEARCH ACTIVITY
IDEASHYPOTHESES PERSONA
DECKINSIGHT
![Page 56: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/56.jpg)
SPORTS OBSESSED
DAD
47%of users
in May 20
IDEAS• Personalised landing• Learn primary sport• Effect of team badges?
![Page 57: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/57.jpg)
SPORTS OBSESSED
DAD
47%of users
in May 20
HYPOTHESES
• If we show the user's favourite club badge on the CTA, we will see more sales, more pages consumed
![Page 58: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/58.jpg)
SPORTS OBSESSED
DAD
47%of users
in May 20
HYPOTHESES
• If we show the user's favourite club badge on the CTA, we will see more sales, more pages consumed
FAILED Sprint 14
![Page 59: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/59.jpg)
SPORTS OBSESSED
DAD
47%of users
in May 20
HYPOTHESES• If we show the user's favourite club badge on the order summary page, we will see more sales and less bounce SPRINT 18-19
![Page 60: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/60.jpg)
SPORTS OBSESSED
DAD
47%of users
in May 20
INSIGHTS
• Showing the latest scores in the banner increased scroll depth by 25% for new users (Sprint 4)
![Page 61: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/61.jpg)
Retired Repeat
BRIEF OVERVIEW IDEAS
USER NEEDS
PAIN POINTS
TECHNOLOGY USE
MOTIVATORS
HYPOTHESES
August 2019 Mary Person
INSIGHTS
Sports Obsessed Dad
![Page 62: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/62.jpg)
PUTTING IT ALL TOGETHER
IDEA HYPOTHESIS STRUCTURE
![Page 63: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/63.jpg)
IDEA
HYPOTHESIS
STRUCTURE
1
2
3
e.g. Be inspired at BAD conference
Write a few hypotheses to explore the idea
Think about how you might structure your investigation, one hypothesis at a time
![Page 64: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/64.jpg)
VARY YOUR HYPOTHESIS
STORE IT ALL IN YOUR PERSONAS
SHARE SHARE SHARE!
4
5
6
Try variants to see if they perform any better
Store ideas, hypotheses, insights
Share successes and failures with your team and wider organisation so that they can benefit from your learning
![Page 65: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/65.jpg)
IDEA
HYPOTHESIS
STRUCTURE
VARIATION
STORAGE
SHARING
![Page 66: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/66.jpg)
UX PSYCHOLOGY
![Page 67: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/67.jpg)
UX PSYCHOLOGYThe future of UX involves developing deep behavioural understanding of our users' needs from multiple sources, including direct observation and machine learning. UX Psychology seeks to develop psychology knowledge and practices within UX to support this behaviourally centric future.
![Page 68: Hypothesis testing for y e · 2020. 6. 5. · discovery testing ideas! hypothesis generation does it work? hypothesis testing ideas! hypothesis generation typing typing. dev team](https://reader036.fdocuments.net/reader036/viewer/2022071023/5fd8868d937894182132f9ba/html5/thumbnails/68.jpg)
UX PSYCHOLOGYUKAUSTRALIAGERMANY
Nick FineDavid Di SipioMark Drexler