Choosing Content for Netflix: How Data Leads the Way

Post on 05-Jan-2017

215 Views

Category:

Science

0 Downloads

Preview:

Click to see full reader

Transcript

Choosing Content for Netflix:

How Data Leads The WayPaul Ellwood

VP, Data Engineering & Analytics

Today’s TalkEvolution of NetflixData@NetflixChoosing Content for Netflix

Evolution of NetflixA Brief History Lesson

DVD Service1999 DVD Service2007 Streaming Service2012 Netflix Originals 2016 Netflix Global

Streaming Service1999 DVD Service2007 Streaming Service2012 Netflix Originals 2016 Netflix Global

1999 DVD Service2007 Streaming Service2012 Netflix Originals 2016 Netflix Global

Netflix Originals1999 DVD Service2007 Streaming Service2012 Netflix Originals 2016 Netflix Global

2012 2013 2014 2015 2016

+ 3 more + 2 more + 20 more + 30 or so more

Netflix Originals1999 DVD Service2007 Streaming Service2012 Netflix Originals2016 Netflix Global

Netflix Studios1999 DVD Service2007 Streaming Service2012 Netflix Originals 2016 Netflix Global

Local Originals1999 DVD Service2007 Streaming Service2012 Netflix Originals 2016 Netflix Global

#netflixeverywhere1999 DVD Service2007 Streaming Service2012 Netflix Originals 2016 Netflix Global

Netflix in Hollywood1999 DVD Service2007 Streaming Service2012 Netflix Originals 2016 Netflix Global

Data@Netflix

Big Data

>40PB700

B

Experimentation, Not Opinion

2013

2015

User Experience

http://techblog.netflix.com/2016/05/selecting-best-artwork-for-videos.html

Cover Art Optimization

https://media.netflix.com/en/company-blog/how-netflix-works-with-isps-around-the-globe-to-deliver-a-great-viewing-experience

Content Delivery

http://techblog.netflix.com/2015/12/optimizing-content-quality-control-at-netflix-predictive-modeling.html

Quality Control

But What About Choosing Content?

Can a computer write a script that would win a competition? [benjamin.wtf]

Can Data Science Create Content?

Not So Well (Yet)...

Is Netflix Doing This?

No. It’s the opposite.

We give creative freedom to the creatives.

But Can Data Help in Choosing Content?

Yes.All decisions are made by experienced

creatives, but analytic products can help.

Value Attribution On a Subscription Service

Valuing Content on Linear TV

How Should Netflix Value Content?

Many possibilities…● Hours viewed?● Completed watching?● New subscribers?● Award nominations? Wins?● Buzz?Or All Of The Above?

Content Efficiency = value / cost

Applying Netflix’s Notion of Value

Value PredictionFor Licensed Content

Predict Value For Licensed Content

Available Titles

DemandFeature

s

DemandPredictiv

eModel

Adjust If efficient, license

Predicting Value For Licensed Content

E.g.● Past performance on Netflix (if previously

licensed)● Past performance of similar titles on Netflix● Broadcast ratings● Box Office● Talent involved● Critic & User Reviews● Awards

Available Titles

DemandFeature

s

DemandPredictiv

eModel

Adjust If efficient, license

Predicting Value For Licensed Content

Available Titles

DemandFeature

s

DemandPredictiv

eModel

Adjust If efficient, license

Predicting Value For Licensed Content

E.g.● Buyer judgements● Deal term adjustments

Available Titles

DemandFeature

s

DemandPredictiv

eModel

Adjust If efficient, license

Predicting Value For Licensed Content

Available Titles

DemandFeature

s

DemandPredictiv

eModel

Adjust If efficient, license

Value PredictionFor Original Content

Predicting Value for Original Content

Originals is a more difficult problem

● Less data - no box office or reviews

● Moving target - ideas and scripts can evolve

● Fungible - execution varies with talent and budget

‘House of Cards’ script = X

Those members also watch:

Finding Comparable Titles (that we know more about)

Catalog Optimization

Programming Linear TVDemographic Based

Programming Netflix

Something for Everyone

Global Complexity

What’s Next?

Upcoming Challenges

•Choose the best mix of content globally•Identify valuable content earlier•Better analytic tools for buyers & creatives•Understand marketplace dynamics

Paul Ellwoodpellwood@netflix.com

@pellwood@netflixdata

top related