Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting

1

Watermarking and Fingerprinting for Global Broadcast Monitoring

Presentation for: Bits by the Bay, SMPTE 2014 Technology Conference

Presenter: Wim J.C.M. Bus

Title: SVP Product Management

2

1. CONTENT IDENTIFICATION

2. GLOBAL BROADCAST MONITORING PLATFORM

3. QUESTIONS

PRESENTATION OVERVIEW

3

1. CONTENT IDENTIFICATION

WATERMARKING & FINGERPRINTING

4

Watermarking & Fingerprinting

Video Watermarking(VWM)

Audio Fingerprinting(AFP)

Audio Watermarking(AWM)

Video Fingerprinting(VFP)

Embedding a unique identifier in audio and/or video, imperceptible to the human ear and eye, but can be detected by special software tools.

Watermarks make each content copy unique when embedding unique data, allowing to track unique content copies or the source of (illegal) content copies.

Identifying content by extracting unique features from audio and/or video, which are compared with features previously stored in a database

Fingerprints give content assets and copies thereof a unique identity, allowing efficient high volume and real-time identification of content assets and copies thereof.

Fingerprinting (matching)Watermarking (embedding)

detectionUnique watermark

Media content

Insertion of unique ID tag to individual pieces of content

Distribution

UsageRe-distribution

WM

Metadata

Metadatadatabase

Assetregistration

DistributionMedia content Distributedmedia content

Identification of fingerprintsNbr. 6538964212556….Comparison and matching

of fingerprints against fingerprints stored into the database

5

Watermarking Parameters

Optimized for

application

Perceptual QualityImperceptibility of the

embedded information

RobustnessRobustness against further

modifications of the content

Capacity (Payload)How much retrievable

Information can be transmitted

Original image

115 154 180 …

158 183 174 …

177 168 144 …

After embedding

114 150 180 …

156 186 172 …

177 170 144 …

6

Fingerprint Parameters

• Robustness (False Negative)“Can a clip still be identified after (severe) degradation?”

• Reliability (False positive)“How often is a clip falsely identified?”

• Fingerprint SizeStorage needed for a fingerprint

Bandwidth needed to send fingerprints to a fingerprint server

• GranularityHow many seconds of content is needed to identify a clip

• 50-80 times per second a 32 bit sub-fingerprint is extracted

• Bits are determined by looking at characteristic features of a video and

audio (e.g. luminance changes for video and spectrum changes for audio)

• A group of sub-fingerprints form a fingerprint.

Tim

e

32 bits

7

Fingerprinting Matching

4.6

s

• 256 sub fingerprints ( a fingerprint block)

are compared by counting bit-errors

• If less than 35% of the bits are in error

fingerprint blocks are said to be derived

from the same clip.

Reference Fingerprint

Extracted from the

reference content

Fingerprint extracted

from unknown content

Difference

8

Watermarking vs Fingerprinting

Watermarking (Granularity 1 sec)

(+) Different identifiers in copies of the same content(+) Stand alone(-) Modification of the content (active)(-) Watermark not present in legacy content

Fingerprinting (Granularity 3-5 sec)

(+) Content is not modified (passive)(+) Works for legacy content (-) Connection to database required(-) Cannot distinguish distribution path/source

9

2. GLOBAL BROADCAST MONITORING PLATFORM

MEDIA INTELLIGENCE

10

Teletrax - Key Characteristics

Technology:

– Video Watermark & Video Fingerprinting based broadcast monitoring service

– Optimized for Short-Form and Long-Form content tracking

Network:

– A consistent Global monitoring network

– Over 2,200 TV channels in more than 60 countries incl. all 210 US DMA’s

Platform:

– Flexible server farm running in a High-Grade professional colocation in New Jersey.

– World wide TV content monitoring information delivered to the desktop within 15 minutes

11

• Government/NGO’s (Watermarking/Fingerprinting)

– (Non) Government organisations that create content and have a need to both monitor domestically and/or internationally.

– Global Monitoring of third content in case of incidents/ crisis.

– What , Where and how long is content being used (Exposure).

– In which context is the content being used (video, EPG).

• News agencies (Watermarking)

– News agencies distribute stories to and need track the actual usage and billing of its clients.

• Entertainment (Fingerprinting)

– Large studios that distribute high value content and want to track for contract compliancy.

– Track illegal usage of non licensed content.

• Advertisement (Watermarking/Fingerprinting)

– Campaign verification (Watermarking /Fingerprinting)

– Competitive intelligence, which competitive brands are/where running campaigns on TV (Fingerprinting)

Teletrax – Application areas

12

Broadcast Monitoring – Watermarking workflow

Identification of

unique watermark

Watermarking

Insert ID tag to

individual pieces

of content

DistributionMedia content

metadata

Monitoring network

Data-Centre

Content owner

Content identified

and reported

via online portal

TV

Channel

13

Broadcast Monitoring – Fingerprinting workflow

Distribution

Monitoring network

Data-Centre

Content owner

Content identified

and reported

via online portal

TV

Channel

Fingerprint

extraction

Reference

fingerprint

registration

Matching

Analysis

Media content

Channel-FP

storage

Reference-FP

Database

14

ConfidentialConfidential

Broadcast Monitoring – Platform Architecture

IdentificationHits Engine

Data collection

Rep

ort

Sch

edu

ler

Analytics Engine Analytics

Data MarriageCustom

MetadataGRPData

Program Data

Detectors

VWMAudio CCVFP

Embedders / Ingest

VWMmetadata

VFPAudio

Custom ReportingStandardMarketIndividual Customer

Network

Management

FP-Reference Database

Channel-FPStorage

Video clips

15

Raw data for per TV channel

16

Comparison

17

Retro-Track – Boston Marathon

18

3. QUESTIONS

19

www.civolution.comTwitter: @Civolution

Solutions for content identification and value creation