People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and...

26
People have been telling stories for thousands of years What makes some more engaging?

Transcript of People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and...

Page 1: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

Peoplehavebeentellingstoriesforthousandsofyears

Whatmakessomemoreengaging?

Page 2: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

NarrativeArcsandCulturalSuccess

Page 3: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction
Page 4: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

Whydosomeculturalitemssucceedwhileothersfail?

Twopossibilities

Page 5: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

#1:Successisrandom

Evendomainexpertshavedifficultypredictingsuccess(Bielby &Bielby,1994;Hirsch,1972)

Drivenbypatternsofsocialinfluence(Hahn&Bentley,2003;Salganik,Dodds,&Watts,2006)

Page 6: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

#2:Individuallevelpsychologicalprocessesshapecollectiveoutcomes

Cultureshapespsychologicalprocesses(Markus&Kitiyama,1991).Reverseisalsotrue:

Psychologicalprocessesshapenormsandpractices

Page 7: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

CulturalSelection

• Similartobiologicalnotions(Dawkins1976)

• Successdependsonfitbetweenitemcharacteristicsandsharedhumanpsychology– Emotions,memory,etc.(Heath,Bell,&Sternberg2001;Kashima

2008;Schaller&Crandall2004)

Page 8: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

Problem:Howtoquantify“fit”withpeople?Featuresofitems?

Solution:NaturalLanguageProcessing

Page 9: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

KeyQuestions

• Whatbestcapturesnarrativetrajectory?– Emotionalvalence?Arousal?Somethingelse?

• Howtobreakupculturalitemintochunks– Scenes?Similarlengths?

• Whatfeaturestocapture?– Micro-level/period-to-period-emotionalvolatility– Macro-level- #ofupsanddownsandsize

Page 10: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

OriginalStarWars

Page 11: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

Emotionsshapehowweevaluateexperiences

Positive>negativePeakandend(Frederickson2000;Redelmeier &Kahneman,1996)

Page 12: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

Lessattentiontoemotionaldynamics(Kuppens &Verduyn 2017)

Particularlyvolatility

-2

-1

0

1

2

1 2 3 4

LowVolatility HighVolatility

Page 13: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

VolatilityShouldIncreaseEvaluation

• Volatilitycreatesuncertaintyandsurprisewhichshouldincreaseemotionalimpact(Mellers,etal.,1997)

• Forpositiveexperiences(e.g.,booksandmovies),thisshouldboostevaluations

• Volatilityshouldprovidestimulationandreducehedonicadaptation(NelsonandMeyvis 2008),bothofwhichshouldleadpositiveexperiencestobeevaluatedmorefavorably

Page 14: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

NoteaboutVolatility

• Focusonvolatilitybetweensizablechunksofamovie,likescenes,orportionsofthem.

• Moregranular(e.g.,second-to-second)volatilitylesslikelytoleaveanenduringimpressionandmorelikelytobemeasuredwitherror

• Further,ifamovierepeatedlyoscillatedbackandforthbetweenhighlynegativeandpositiveinamatterofseconds,itwouldexhausttheviewer.

Page 15: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

Methods

1) Collectscriptsforthousandsofmovies– 4125moviesfromOpenSubtitles

• Scorepositivity/negativityofchunksoftext– Hedonometer(Dodds andDanforth2010)– 100segmentsof500words

1) Plotemotionaltrajectory2) Measureemotionalvolatility

– Std ofdifferencebetweensegments3) Testrelationshipwithsuccess(IMDBratings)

Page 16: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

Results• Moreemotionallyvolatilemoviesreceivehigherratings(b=

9.40,s.e. =0.788, p <0.001)• 10%increaseinvolatilitylinkedto+1%inratings

Page 17: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

Robustness• Movielength• Genre• YearofRelease• Amountofemotion– somemoviescontainmoreemotion• PeakandEnd• AverageSentiment– somemoviesaremorepos orneg• Complexity– morecharactersorcomplexaction• Extremity- howmuchatrajectorydivergesfromthemean• Resultsremainthesamecontrollingforallthesefactors

• Alternatesegmentstructures– Numberofsegments(e.g.,50)– Differentlength(e.g.,1000words)– Fixingoverlapbetweensegments(e.g.,1000words,900overlap)– Nooverlapbetweensegments

Page 18: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

Canweisolateimpactofemotionalvolatility?

BestapproachwouldmanipulateONLYvolatility,keepeverythingelsethesame

Solution:movieswithsequels

Page 19: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

IsolatingEmotionalVolatility

• Moviesinaseries(N=175)shouldperformbetterwhenthey’remoreemotionallyvolatile

• Result:Evenwithinthesameseries,moreemotionallyvolatilemoviesaremoresuccessful(b=8.86,s.e. =4.32,p=0.04)

• Originalseffect?– No.lookingwithinsequels(2nd vs.3rd movie),moreemotionally

volatilemoviesaremoresuccessful(b=19.37,s.e. =6.19, p =0.04)

Page 20: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

VariationbyGenre

• Ifrelationshipisdrivenbysurprise/stimulation,shouldbestrongeringenreswherethoseaspectscontributemoretoevaluation

• E.g.,ThrillersandMysteries

Page 21: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

“Macro”featuresmatteraswell

• Take100wordchunks• Smooththecurvetodropsmallhitches• Controlforlength

• (1)More“runs”(i.e.,upsanddowns),(2)Largeraverageruns,and(3)theirinteractionallpositivelylinkedtoratings

• Howcloseare“peaks”?

• Howdotheychangeovertime?– Dotheygetprogressivelylarger?– Morefrequent?

Page 22: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

Summary

1. Narrativearcsmayhelpexplainculturalsuccess.

2. Individual-levelpsychologicalprocessescanshapecollectiveoutcomes(i.e.,culture)

3. NLPcanhelplinkmicro(psychological)andmacro(cultural)processes.

Page 23: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

Thankyou.

Page 24: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction
Page 25: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

Data

• DownloadedallmoviescriptsfromOpenSubtitles• MatchedwithIMDb.comprofilestoacquiregenreanduserrating

• Removemovieswithnomatchorveryfewwords• N=4125movies(Meanwords=7387,SD=2558)

Page 26: People have been telling stories for thousands of years · 2020-01-06 · •E.g., Thrillers and Mysteries “Macro” features matter as well ... runs, and (3) their interaction

CalculateEmotionalVolatility• Usehedonometer (Dodds andDanforth2010),toscore

sentimentofeachwordinthescript

• Followingpriorwork(Reaganetal2016),focusonwordswithclearemotionalcontent(i.e.,≥6or≤4)

• Dividemoviesinto100segmentsof500words– Resultsarerobusttodifferentsegmentnumbersandsizes

• Calculateemotionalscoreforeachsegment

• Volatility=standarddeviationofdifferencebetweensegments– Simplestd ofemotionalscoresdoesn’tindicateifchangeoccurs