Harnessing Machine Learning, AI & Metadata to Power-up Content Discovery Scott Maddux VP, Business Development [email protected] 415-722-9600 May 2017
Harnessing Machine Learning, AI & Metadata to Power-up Content Discovery
Scott MadduxVP, Business [email protected] a y 2 0 1 7
2 © 2016 Company confidential.© 2017 TiVo
The Revolution will be Televised… and Powered by AI & ML
*AI: ”The capability of a machine to imitate intelligent human behavior.”
Very Large
DatasetsAI*
Cheap & Plentiful
CPU Cycles
Sophisticated Machine Learning
Algorithms
3 © 2016 Company confidential.© 2017 TiVo
Content Providers
Broadcast & Cable
Telco
SVOD, TVOD & PVOD
OTT
TVE
Web Portals
IPTV(streamers)
CE(smart TVs)
Social Media
YouTube
Game Consoles
Other (Auto,
Aviation)
Content Owners’ Ecosystem Has Changed Dramatically
ContentOwners
Broadcast& Cable
Televisions
(This model held for 60+ years)
Fragmented Distribution Channels, Advertising & Viewers
>> Today
4 © 2016 Company confidential.© 2017 TiVo
TiVo Delivers The Complete Discovery UX
1. Set-Top Boxes2. Next-Gen Guides3. Voice Interface4. Search Solutions5. Recommendations6. Ad Targeting7. Metadata
• Film, TV & Digital• Rich Images• Schedule Data• Sports• Music• Games
5 © 2016 Company confidential.© 2017 TiVo
Search & Recommendations Ads & AnalyticsUX, STBs & Guides
Metadata is Foundational to the TiVo Portfolio
Factual • Descriptive • Graph • Image • Trending • Social
Video Sports Music Games Books
6 © 2016 Company confidential.© 2017 TiVo
MetadataFactual Metadata
• Cast, Writer, Producer, Director etc.• Air data / Season:Episode• Summary / Bio
Image Metadata• Poster Art• Cast (Headshot)• Character• Scene• In-Era• Red Carpet• Production
Attributes• Format• Type• Language• Duration• Popularity Score• Cast/Character Pair• Trend Scores & Ratings• Studio/Network• Awards
Entertainment Graph• Cross-category links (people & works)
Distribution Channels• Distribution Windows & Schedules• OTT Availability
Deep Descriptors & Keywords• Theme• Tone• Mood• Story
7 © 2016 Company confidential.© 2017 TiVo
ML Applications Enrich Metadata
AI
Natural Language Processing (NLP) Signal ProcessingMachine Learning
Ingest
Extraction & Enrichment
Graphed Relationships
NLU(Understanding)
NLG(Generation)
Audio
Video(aka Computer Vision)
Image
• Object Identification• Facial Recognition• Program Identification• Ad Detection• Brand (logo) Identification
• Voice Recognition• Excitement Metering• Ad Detection
• Face detection• Text detection• Image extraction from Video• Auto cropping
• Semantic Analysis• Deep Descriptor
Extraction
• Celebrity Bios• Descriptions• Play by Play• Game Recaps
• Continuous ingest from 1000’s of structured and unstructured data sources
• Data Parsing• Normalization• Matching• Deduplication• TiVO Unique ID
• Cross Category Links• Entity Relationships• Weighting• AKAs
8 © 2016 Company confidential.© 2017 TiVo
sanctuary{17} westernamerican{20} rebels{17}barter{16}blooddonor{70} postapocalyptic{85}
cultleader{20}exodus{20} warboy{32}godofwar{16} peopleeater{58} sandstorm{68}
citadel{54}tyrannical{16}
nuclearholocaust{20} transfuses{35}ontherun{15}
bloodbag{43} wasteland{47}
spiritualsequel{20} highoctane{19}developmenthell{20} ozploitation{20}
9 © 2016 Company confidential.© 2017 TiVo
Trending Data + Knowledge Graph
JordanPeele’ssatiricalhorrorfilm“GetOut”gainedverystrongsocialmediamomentumandbecameoneofthehighest-grossingoriginaldebutsever.
Horror
Comedy
Satire
Genre
Daniel Kaluuya
Suspense Thriller
Cast
Allison Williams
Storks
Jordan Peele
Keegan-Michael
Key
MadTV
Key & Peele
Keanu
Get Out
10 © 2016 Company confidential.© 2017 TiVo
Next-Gen Scene Level Metadata
Actor/Character
Object
Mood/Tone
Location
Event
Brand
Music
Grandeur Romance Lust Threat Drunk Team Conflict Loss Terror Nostalgia Power Retro
ElizabethDebicki ChrisPrattZoeSaldana MichaelRooker HowardtheDuck KurtRussel Sylvestor Stallone
Throne Batteries Headphones Mohawk Arrow Martini Robe LeatherJacket Blob Spaceship
Utopia Forest DesolatePlanet Galaxy IceWorld Prison Earth Missouri Bar Spaceship
Theft Escape Chase Attack Mutiny Reunited TruthRevealed Explosion
SonyWalkman Funko Vinyl DairyQueen FordTruck MicrosoftZune
ELO Sweet FleetwoodMac SamCooke CheapTrick CatStevens Parliament DavidHasselhoff
11 © 2016 Company confidential.© 2017 TiVo
Next-Gen Scene Level Metadata
Actor/Character
Object
Mood/Tone
Location
Event
Brand
Music
Grandeur Romance Lust Threat Drunk Team Conflict Loss Terror Nostalgia Power Retro
ElizabethDebicki ChrisPrattZoeSaldana MichaelRooker HowardtheDuck KurtRussel Sylvestor Stallone
Throne Batteries Headphones Mohawk Arrow Martini Robe LeatherJacket Blob Spaceship
Utopia Forest DesolatePlanet Galaxy IceWorld Prison Earth Missouri Bar Spaceship
Theft Escape Chase Attack Mutiny Reunited TruthRevealed Explosion
SonyWalkman Funko Vinyl DairyQueen FordTruck MicrosoftZune
ELO Sweet FleetwoodMac SamCooke CheapTrick CatStevens Parliament DavidHasselhoff
SceneLevel(timebased)Metadata
12 © 2016 Company confidential.© 2017 TiVo
ML & AI Tech Behind the Scenes
Grandeur Romance Lust Threat Drunk Team Conflict Loss Terror Nostalgia Power Retro
ElizabethDebicki ChrisPrattZoeSaldana MichaelRooker HowardtheDuck KurtRussel Sylvestor Stallone
Throne Batteries Headphones Mohawk Arrow Martini Robe LeatherJacket Blob Spaceship
Utopia Forest DesolatePlanet Galaxy IceWorld Prison Earth Missouri Bar Spaceship
Theft Escape Chase Attack Mutiny Reunited TruthRevealed Explosion
SonyWalkman Funko Vinyl DairyQueen FordTruck MicrosoftZune
ELO Sweet FleetwoodMac SamCooke CheapTrick CatStevens Parliament DavidHasselhoff
FACIALRECOGNITION(videosignalprocessing/computervision)
OBJECTIDENTIFICATION(videosignalprocessing/computervision)
VOICERECOGNITION(audiosignalprocessing+naturallanguageunderstating– NLU)DEEPDESCRIPTOREXTRACTION(naturallanguageprocessing– NLP)GRAPHRELATIONSHIPS(namedentityrecognition– NER)WEIGHTEDSCORES(latentsemanticanalysis– LSA)EVENTSUMMARIES(naturallanguagegeneration– NLG)
OBJECTIDENTIFICATION(videosignalprocessing/computervision)
SONG/ARTISTIDENTIFICATION(audiosignalprocessing)
Actor/Character
Object
Mood/Tone
Location
Event
Brand
Music
13 © 2016 Company confidential.© 2017 TiVo
Content Providers
Broadcast & Cable
Telco
SVOD, TVOD & PVOD
OTT
TVE
Mobile Web & Apps
IPTV
CE
Social Media
YouTube
Game Consoles
Other (Auto,
Aviation)
ML + Metadata Drive Discovery & Monetization
• Production
• Distribution
• Ad Ops & Sales
• Targeting
• Search
• Recommendations
TiVo metadata solutions help package & deliver your content to the right audience.
Thank You
Scott MadduxVP, Business [email protected]