Metis Project 5: The (Data) Science of Binge Watching on Netflix

24
JAMIE FRADKIN MARCH 31, 2016 THE (DATA) SCIENCE OF BINGE WATCHING ON

Transcript of Metis Project 5: The (Data) Science of Binge Watching on Netflix

Page 1: Metis Project 5: The (Data) Science of Binge Watching on Netflix

JAMIE FRADKINMARCH 31, 2016

THE (DATA) SCIENCE OF BINGE WATCHING ON

Page 2: Metis Project 5: The (Data) Science of Binge Watching on Netflix
Page 3: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Source: Statista.com

Page 4: Metis Project 5: The (Data) Science of Binge Watching on Netflix

binge watch·ingnoun

the practice of watching multiple episodes of a television program in rapid succession, typically by means of digital streaming.

Page 5: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Netflix Report Reveals Pivotal Episodes that “Hooked”* Viewers on Popular Series

Source: Netflix

Page 6: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Netflix Report Reveals Pivotal Episodes that “Hooked”* Viewers on Popular Series

*“Hooked” indicates that >70% of viewers proceeded to complete the full first season following this episode

Source: Netflix

Page 7: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Netflix Report Reveals Pivotal Episodes that “Hooked”* Viewers on Popular Series

*“Hooked” indicates that 70% of viewers proceeded to complete the full first season following this episode

Source: Netflix

"Arrow" - Episode 8"Bates Motel" - Episode 2

"Better Call Saul" - Episode 4"Bloodline" - Episode 4

"BoJack Horseman" - Episode 5"Breaking Bad" - Episode 2

"Dexter" - Episode 3"Gossip Girl" - Episode 3

"Grace & Frankie" - Episode 4"House of Cards" - Episode 3

"How I Met Your Mother" - Episode 8"Mad Men" - Episode 6

"Marco Polo" - Episode 3

"Marvel’s Daredevil" - Episode 5"Once Upon A Time" - Episode 6

"Orange is the New Black" - Episode 3"Pretty Little Liars" - Episode 4

"Scandal" - Episode 2"Sense8" - Episode 3

"Sons of Anarchy" - Episode 2"Suits" - Episode 2

"The Blacklist" - Episode 6"The Killing" - Episode 2

"The Walking Dead" - Episode 2"Unbreakable Kimmy Schmidt" - Episode 4

Page 8: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Project GoalUse Natural Language Processing tools and feature engineering to identify elements of TV show scripts that “hook” viewers and induce binge-watching.

Page 9: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Methods

Page 10: Metis Project 5: The (Data) Science of Binge Watching on Netflix

MethodsUse web

scraping to collect TV show

scripts

Page 11: Metis Project 5: The (Data) Science of Binge Watching on Netflix

MethodsUse web

scraping to collect TV show

scripts

Train word2vec

model to create word

embeddings for script text

Page 12: Metis Project 5: The (Data) Science of Binge Watching on Netflix

MethodsUse web

scraping to collect TV show

scripts

Train word2vec

model to create word

embeddings for script text goodbye pilot happy birthday look at that that is veggie

bacon believe it or not zero cholesterol you wont even taste the difference what time do you think youll be home same time i dont want him dicking you around tonight you get paid till you work till no later hey happy birthday well thank you youre late again there was no hot water again i have an easy fix for that you wake up early and then you get to be the first person in the shower i have an idea how about buy a new hot water heater hows that idea for the millionth and billionth time did you take your echinacea yeah i think its getting better not me i want real bacon not this fake crap too bad eat it this smells like bandaids eat it so hows it feel to be old how does it feel to be a smart ass good eat your veggie bacon you all set yeah im fine all right see you at home okay see you chemistry it is the study of what anyone ben chemicals chemicals no chemistry is well technically chemistry is the study of matter but i prefer to see it as the study of change now just just think about this electrons they change their energy levels molecules molecules change their bonds elements they combine and change into compounds well thats thats all of life right i mean its just its the constant its the cycle its solution dissolution just over and over and over it is growth then decay then transformation it is fascinating really chad is there something wrong with your table okay ionic bonds

Isolate sections and calculate vector

ave. cosine distance from remainder of the

script

Page 13: Metis Project 5: The (Data) Science of Binge Watching on Netflix

MethodsUse web

scraping to collect TV show

scripts

Train word2vec

model to create word

embeddings for script text goodbye pilot happy birthday look at that that is veggie

bacon believe it or not zero cholesterol you wont even taste the difference what time do you think youll be home same time i dont want him dicking you around tonight you get paid till you work till no later hey happy birthday well thank you youre late again there was no hot water again i have an easy fix for that you wake up early and then you get to be the first person in the shower i have an idea how about buy a new hot water heater hows that idea for the millionth and billionth time did you take your echinacea yeah i think its getting better not me i want real bacon not this fake crap too bad eat it this smells like bandaids eat it so hows it feel to be old how does it feel to be a smart ass good eat your veggie bacon you all set yeah im fine all right see you at home okay see you chemistry it is the study of what anyone ben chemicals chemicals no chemistry is well technically chemistry is the study of matter but i prefer to see it as the study of change now just just think about this electrons they change their energy levels molecules molecules change their bonds elements they combine and change into compounds well thats thats all of life right i mean its just its the constant its the cycle its solution dissolution just over and over and over it is growth then decay then transformation it is fascinating really chad is there something wrong with your table okay ionic bonds

Isolate sections and calculate vector

ave. cosine distance from remainder of the

script

Search text for sentiment for hypothesized

“hook” moments

Page 14: Metis Project 5: The (Data) Science of Binge Watching on Netflix

MethodsUse web

scraping to collect TV show

scripts

Train word2vec

model to create word

embeddings for script text goodbye pilot happy birthday look at that that is veggie

bacon believe it or not zero cholesterol you wont even taste the difference what time do you think youll be home same time i dont want him dicking you around tonight you get paid till you work till no later hey happy birthday well thank you youre late again there was no hot water again i have an easy fix for that you wake up early and then you get to be the first person in the shower i have an idea how about buy a new hot water heater hows that idea for the millionth and billionth time did you take your echinacea yeah i think its getting better not me i want real bacon not this fake crap too bad eat it this smells like bandaids eat it so hows it feel to be old how does it feel to be a smart ass good eat your veggie bacon you all set yeah im fine all right see you at home okay see you chemistry it is the study of what anyone ben chemicals chemicals no chemistry is well technically chemistry is the study of matter but i prefer to see it as the study of change now just just think about this electrons they change their energy levels molecules molecules change their bonds elements they combine and change into compounds well thats thats all of life right i mean its just its the constant its the cycle its solution dissolution just over and over and over it is growth then decay then transformation it is fascinating really chad is there something wrong with your table okay ionic bonds

Isolate sections and calculate vector

ave. cosine distance from remainder of the

script

Search text for sentiment for hypothesized

“hook” moments

Create features for various script elements based

on genre

! ? …

Page 15: Metis Project 5: The (Data) Science of Binge Watching on Netflix

MethodsUse web

scraping to collect TV show

scripts

Train word2vec

model to create word

embeddings for script text goodbye pilot happy birthday look at that that is veggie

bacon believe it or not zero cholesterol you wont even taste the difference what time do you think youll be home same time i dont want him dicking you around tonight you get paid till you work till no later hey happy birthday well thank you youre late again there was no hot water again i have an easy fix for that you wake up early and then you get to be the first person in the shower i have an idea how about buy a new hot water heater hows that idea for the millionth and billionth time did you take your echinacea yeah i think its getting better not me i want real bacon not this fake crap too bad eat it this smells like bandaids eat it so hows it feel to be old how does it feel to be a smart ass good eat your veggie bacon you all set yeah im fine all right see you at home okay see you chemistry it is the study of what anyone ben chemicals chemicals no chemistry is well technically chemistry is the study of matter but i prefer to see it as the study of change now just just think about this electrons they change their energy levels molecules molecules change their bonds elements they combine and change into compounds well thats thats all of life right i mean its just its the constant its the cycle its solution dissolution just over and over and over it is growth then decay then transformation it is fascinating really chad is there something wrong with your table okay ionic bonds

Isolate sections and calculate vector

ave. cosine distance from remainder of the

script

Use tf-idf weighting and NMF to focus on

key topics

Search text for sentiment for hypothesized

“hook” moments

Create features for various script elements based

on genre

! ? …

Page 16: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Topics

Supporting Character Development

Joining Forces

Demonstration of Leadership

Page 17: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Topic: Supporting Character DevelopmentEx) Mad Men Hook Episode (Season 1, Episode 6)

FRED

Your girl. Full of surprises. Oh Pretty Peggy Sue.

DON Peggy? If you say so. I avoid eye contact to avoid being blinded by the earnestness.

FRED

Actually, she really stood out—brainstorming wise…While the rest of the hens were busy tearing out each other’s feathers, that one saw the benefit, not the feature. She said she didn’t want to be one of a hundred colors in a box. That’s interesting, right?

”Hook” SceneRemainder of Episode

t-SNE Plot: 2D representation of word clusters

Page 18: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Topic: Joining ForcesEx) Breaking Bad Hook Episode (Season 1, Episode 2)

JESSEYou're not You're not serious? You're

serious? Who's gonna do that? And don't look at me!

WALT

I guess we'll both do it together. JESSE

No, Mr. White, okay, I'm not good with dead bodies. We're in this 50/50,

okay?

WALTI guess the only other fair way to go about this would be that one of us

deals with the body situation, while the other one of us deals with the

Krazy-8 situation. In a scenario like this, I don't suppose it is bad form

to just flip a coin.

”Hook” SceneRemainder of Episode

t-SNE Plot: 2D representation of word clusters

Page 19: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Topic: Demonstration of LeadershipEx) House of Cards Hook Episode (Season 1, Episode 3)

FRANKYou know what no one wants to

talk about.Hate.

I know all about hate.It starts in your gut, deep down here, where it stirs and churns.

And then it rises.Hate rises fast and volcanic.It erupts hot on the breath.Your eyes go wide with fire.You clench your teeth so hard you think they'll shatter.

I hate you, God.I hate you! Oh, don't tell me you haven't said those words

before.I know you have.

We all have, if you've ever felt so crushing a loss.

”Hook” SceneRemainder of Episode

t-SNE Plot: 2D representation of word clusters

Page 20: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Conclusion

Page 21: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Conclusion• Analysis led to 3 central themes in shows that “hook”

viewers:• Supporting character development• Characters joining forces• Demonstration of leadership

Page 22: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Conclusion• Analysis led to 3 central themes in shows that “hook”

viewers:• Supporting character development• Characters joining forces• Demonstration of leadership

• word2vec proved to be a useful tool to establish text sections’ divergence from document

Page 23: Metis Project 5: The (Data) Science of Binge Watching on Netflix

Conclusion• Analysis led to 3 central themes in shows that “hook”

viewers:• Supporting character development• Characters joining forces• Demonstration of leadership

• word2vec proved to be a useful tool to establish text sections’ divergence from document• Incorporating sentiment analysis, tf-idf, and other script

features help target pivotal scenes

Page 24: Metis Project 5: The (Data) Science of Binge Watching on Netflix

[email protected]

linkedin.com/in/jamiefradkin

github.com/jmfradkin

jamiefradkin.wordpress.com

Thank you!

Jamie Fradkin