Top Banner
Electronic & Electrical Engineering. Communications Research Group. Digital watermarking techniques for JPEG2000 scalable image coding Deepayan Bhowmik The University of Sheffield, Sheffield, UK
64

Digital watermarking techniques for JPEG2000 scalable ...

Mar 23, 2022

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Digital watermarking techniques for JPEG2000 scalable ...

Electronic & Electrical Engineering.

Communications Research Group.

Digital watermarking techniques for JPEG2000 scalable image coding

Deepayan Bhowmik The University of Sheffield, Sheffield, UK

Page 2: Digital watermarking techniques for JPEG2000 scalable ...

Contents

Introduction

Digital watermarking: properties and applications

Discrete wavelet transform and its applications

Scalable image coding and its application in multimedia signal processing

Research techniques for image watermarking for JPEG2000 content adaptation

Recent developments and open questions in this field

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 3: Digital watermarking techniques for JPEG2000 scalable ...

Contents

Introduction

Digital watermarking: properties and applications

Discrete wavelet transform and its applications

Scalable image coding and its application in multimedia signal processing

Research techniques for image watermarking for JPEG2000 content adaptation

Recent developments and open questions in this field

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 4: Digital watermarking techniques for JPEG2000 scalable ...

Introduction

• A digital watermark is the copyright or author identification information which is embedded directly in the digital media in such a way that it is imperceptible, robust and secure.

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Audio watermarking

Image watermarking

Video watermarking

Page 5: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

+ =

Digital watermarking: properties and applications

Page 6: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 7: Digital watermarking techniques for JPEG2000 scalable ...

Example

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 8: Digital watermarking techniques for JPEG2000 scalable ...

Example

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 9: Digital watermarking techniques for JPEG2000 scalable ...

Example

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 10: Digital watermarking techniques for JPEG2000 scalable ...

• Imperceptibility

Measurement metrics: RMSE, PSNR, SSIM etc.

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Digital watermarking : properties

Page 11: Digital watermarking techniques for JPEG2000 scalable ...

• Imperceptibility

Measurement metrics: RMSE, PSNR, SSIM etc.

• Robustness

Measurement metric: Hamming distance, Correlation etc.

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Digital watermarking : properties

Page 12: Digital watermarking techniques for JPEG2000 scalable ...

• Imperceptibility

Measurement metrics: RMSE, PSNR, SSIM etc.

• Robustness

Measurement metric: Hamming distance, Correlation etc.

• Fragility

• Tamper-resistance

• Data payload

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Digital watermarking : properties

Page 13: Digital watermarking techniques for JPEG2000 scalable ...

Applications

• Copyright protection.

• Owner identification.

• Content authentication.

• Broadcast monitoring.

• Transaction tracking.

• Media digital rights management (DRM) in content supply chain.

• Tamper proofing.

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 14: Digital watermarking techniques for JPEG2000 scalable ...

Contents

Introduction

Digital watermarking: properties and applications

Discrete wavelet transform and its applications

Scalable image coding and its application in multimedia signal processing

Research techniques for image watermarking for JPEG2000 content adaptation

Recent developments and open questions in this field

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 15: Digital watermarking techniques for JPEG2000 scalable ...

Discrete Wavelet Transform (DWT) and applications

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 16: Digital watermarking techniques for JPEG2000 scalable ...

DWT

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

2

2

H

L

2

2

HH

HL

2

2

LH

LL

2D wavelet decomposition

G0

G1

G0

G0

G1

G1

I

Page 17: Digital watermarking techniques for JPEG2000 scalable ...

DWT

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

HH1

HL1

LH1

HH2 LH2

HL2 LL2

2 level decomposition

Page 18: Digital watermarking techniques for JPEG2000 scalable ...

DWT Applications

• Compression

• JPEG-2000 image compression

• MC-EZBC video compression

• De-noising

• Edge-detection

• Image retrieval

• Gait analysis

• Digital communication and many others

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 19: Digital watermarking techniques for JPEG2000 scalable ...

Contents

Introduction

Digital watermarking: properties and applications

Discrete wavelet transform and its applications

Scalable image coding and its application in multimedia signal processing

Research techniques for image watermarking for JPEG2000 content adaptation

Recent developments and open questions in this field

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 20: Digital watermarking techniques for JPEG2000 scalable ...

Scalable image coding

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 21: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 22: Digital watermarking techniques for JPEG2000 scalable ...

JPEG2000 image coding using DWT

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 23: Digital watermarking techniques for JPEG2000 scalable ...

JPEG2000

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 24: Digital watermarking techniques for JPEG2000 scalable ...

JPEG2000 image coding

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 25: Digital watermarking techniques for JPEG2000 scalable ...

JPEG2000 image coding

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

0

1

0

1

Bit plane 0

Bit plane N

Bit plane N-1

Bit plane N-2

Most

significant

Least

significant LH2

HL2

HH2

LH1

HL1

HH1

HH2

HH1

LH2

LH1

HL2 HL1

LL2

LL2

Page 26: Digital watermarking techniques for JPEG2000 scalable ...

JPEG2000 image coding

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

LL1 HL1

LH1 HH1

HH2

HL2

LH2

LL2

Quarter Resolution

Half Resolution

Full Resolution

Page 27: Digital watermarking techniques for JPEG2000 scalable ...

Resolution scalability

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 28: Digital watermarking techniques for JPEG2000 scalable ...

Resolution scalability

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 29: Digital watermarking techniques for JPEG2000 scalable ...

Resolution scalability

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 30: Digital watermarking techniques for JPEG2000 scalable ...

Quality scalability

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 31: Digital watermarking techniques for JPEG2000 scalable ...

Quality scalability

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 32: Digital watermarking techniques for JPEG2000 scalable ...

Quality scalability

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 33: Digital watermarking techniques for JPEG2000 scalable ...

Example

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 34: Digital watermarking techniques for JPEG2000 scalable ...

Contents

Introduction

Digital watermarking: properties and applications

Discrete wavelet transform and its applications

Scalable image coding and its application in multimedia signal processing

Research techniques for image watermarking for JPEG2000 content adaptation

Recent developments and open questions in this field

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 35: Digital watermarking techniques for JPEG2000 scalable ...

Robust watermarking techniques for scalable coding

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 36: Digital watermarking techniques for JPEG2000 scalable ...

Watermarking techniques

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

()Embedding

Original Image

Watermarked Image

)(I

)'(IWatermark )(W

()Extraction Test Image Extracted

watermark )'(I

)'(W

Original Image

(for non-blind type) )(I Original watermark )(W

Watermark

detection

decision

Authenti- cation

Page 37: Digital watermarking techniques for JPEG2000 scalable ...

Watermarking techniques

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Embedding Domain

Pixel Domain

Transform Domain

Fourier DCT Wavelet

Non-Blind Blind

Page 38: Digital watermarking techniques for JPEG2000 scalable ...

Watermarking techniques

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Host

Image Watermarked

Image

Authentication

Decision

DWT Coefficient

selection

and watermark

embedding

IDWT Attack including

content

adaptation

DWT

Test

image

Watermark

Extraction

(Blind / Non-blind)

Extracted

Watermark Comparison of

original and

extracted watermark

Watermark

Page 39: Digital watermarking techniques for JPEG2000 scalable ...

Watermarking techniques

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Embedding

where C’m,n = modified coefficient, Cm,n = wavelet coefficient to be modified, wm,n = watermark information, α = watermark strength parameter, wext = extracted watermark.

Extract

,,,,,' nmnm wCCC nmnm ,'

C

CCextw

Page 40: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ IET/IPR 2012 © The University of Sheffield, UK

Wavelet based image compression (Bit-plane discarding):

,

Q

CCq

Nk 2).1( Nk 2.Nk 2).1(

2

122).1()1(

NN

k kC2

122.

NN

k kC

C

,2

1.ˆ

QCQC q

where Cq = quantised coefficient, C = original coefficient, Q = quantisation parameter,

Cˆ = decoded coefficient Q = 2N

k € ±1, ±2, ±3… Ck = Center point value

Page 41: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Embed 1: C & C’ in different cluster:

Algorithm 1:

Nk 2).1( Nk 2.Nk 2).1(

)1( kCkC

11

2.

w

k N

C

'C

.2.1

2.

1

NN

kCw

k

w1 = value to embed ‘1’.

Page 42: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Robustness Analysis :

)1( kCkC

T

Ck

1

Nk 2).1( Nk 2.Nk 2).1(

C

'C

Embed 1: C & C’ in same cluster:

.1

2.T

CCk kN

T = Threshold for watermark detection.

Page 43: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Robustness Analysis :

)1( kCkC

11

2.

w

k N

T

Ck

1

Nk 2).1( Nk 2.Nk 2).1(

C

'C

Embed 1: combined:

.11

2.

1 T

CC

w

k kN

Page 44: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Robustness Analysis :

)1( kCkC

01

2.

w

k N

Nk 2).1( Nk 2.Nk 2).1(

C

'C

Embed 0: C & C’ in different cluster:

.2.1

2.

0

NN

kCw

k

w0 = value to embed ‘0’.

Page 45: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Robustness Analysis :

)1( kC kC

01

2.

w

k N

T

C k

1

)1(

Nk 2).1( Nk 2.Nk 2).1(

C

'C

Embed 0: C & C’ in different cluster:

.1

2.

1 0

)1(

w

kC

T

C Nk

Page 46: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Robustness Analysis :

Nk 2).1( Nk 2.Nk 2).1(

)1( kCkC

11

2.

w

k N

T

Ck

101

2.

w

k N

T

C k

1

)1(

C

Embed 1 or 0 for correct watermark extraction:

.1

2.

1

2.

01 w

kC

w

k NN

Page 47: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Simulation results :

Map of original coefficient values (C) to retain the watermark information.

Page 48: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Effect of bit-plane based coefficient selection procedure against JPEG2000 quality scaling considering 64:1 compression ratio. Quantisation steps: Q = 20 to Q = 29.

0 1 2 3 4 5 6 7 8 90.1

0.15

0.2

0.25

0.3

0.35

Effect of coefficient selection on JPEG2000 compression for different N. CR = 64:1

N

Ha

mm

ing

Dis

tan

ce

Image 1

Image 2

Image 3

Image 4

Image 5

Image 6

Simulation results :

Page 49: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ IET/IPR 2012 © The University of Sheffield, UK

Wavelet based image compression (Bit-plane discarding):

,

Q

CCq

Nk 2).1( Nk 2.Nk 2).1(

2

122).1()1(

NN

k kC2

122.

NN

k kC

C

,2

1.ˆ

QCQC q

where Cq = quantised coefficient, C = original coefficient, Q = quantisation parameter,

Cˆ = decoded coefficient Q = 2N

k € ±1, ±2, ±3… Ck = Center point value

Page 50: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ IET/IPR 2012 © The University of Sheffield, UK

0 2 3 )(n )1( n

C

0

0 01 1

2)%1( n 2%n

1

2/)(2 n 2/)1(2 n2/)12( n

)1( n

C

0 1

4/)(4 n 4/)12(2 n4/)14( n

C

0 1C

8/)14(2 n 8/)12(4 n8/)38( n

Algorithm 2:

M2

Page 51: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ IET/IPR 2012 © The University of Sheffield, UK

0 1

12% n

0 1

0 1

0 1

0 1

Tree for C: 1011011)2%()( nCb

Tree depth d

Embedding algorithm

....,3,2,1,0,2%

2

iC

bi

i

142C 3225

01000)( Cb 6d

Page 52: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ IET/IPR 2012 © The University of Sheffield, UK

Tree based watermarking rule

Symbols Binary Tree Watermark association

Embedded Zero (EZ) 000xxxx 0

Embedded Zero (EZ) 001xxxx 0

Cumulative Zero (CZ) 010xxxx 0

Weak One (WO) 011xxxx 1

Weak Zero (WZ) 100xxxx 0

Cumulative One (CO) 101xxxx 1

Embedded One (EO) 110xxxx 1

Embedded One (EO) 111xxxx 1

Page 53: Digital watermarking techniques for JPEG2000 scalable ...

Experimental Results

Existing Algorithm Proposed Algorithm

PSNR Data capacity (L)

PSNR Data capacity (L)

Boat (704x576)

86.40 53.74 2112 84.13 47.43 6336

Barbara (704x576)

80.64 55.12 2112 81.71 49.13 6336

Blackboard (704x576)

69.12 56.45 2112 69.12 50.51 6336

Light House (768x512)

84.48 55.36 2048 82.43 48.78 6144

Page 54: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ IET/IPR 2012 © The University of Sheffield, UK

Experimental Results

0 5 10 15 20 25 30 35 40 45 50

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

JPEG2000 compression Ratio

Ha

mm

ing

Dis

tan

ce

Robustness against JPEG2000: Blackboard

d=5 (=31)

d=5 (=329)

d=6 (=112)

d=6 (=1278)

d=7 (=466)

d=7 (=4980)

0 1 2 3 4 5 6 7

0

0.1

0.2

0.3

0.4

0.5

p

Ha

mm

ing

Dis

tan

ce

Robustness against bit plane discarding: Blackboard

d=5 (=31)

d=5 (=329)

d=6 (=112)

d=6 (=1278)

d=7 (=466)

d=7 (=4980)

Page 55: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ IET/IPR 2012 © The University of Sheffield, UK

Experimental Results

0 5 10 15 20 25 30 35 40 45 50

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0.4

JPEG2000 compression Ratio

Ha

mm

ing

Dis

tan

ce

Robustness against JPEG2000: Light House

d=5 (=31)

d=5 (=335)

d=6 (=125)

d=6 (=1358)

d=7 (=482)

d=7 (=5129)

0 1 2 3 4 5 6 7

0

0.1

0.2

0.3

0.4

0.5

p

Ha

mm

ing

Dis

tan

ce

Robustness against bit plane discarding: Light House

d=5 (=31)

d=5 (=335)

d=6 (=125)

d=6 (=1358)

d=7 (=482)

d=7 (=5129)

Page 56: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ IET/IPR 2012 © The University of Sheffield, UK

Experimental Results

0 10 20 30 40 50 600

0.05

0.1

0.15

0.2

0.25

JPEG2000 compression Ratio

Ha

mm

ing

Dis

tan

ce

Robustness against JPEG2000: Light House

Proposed algorithm

Existing algorithm

0 10 20 30 40 50 600.05

0.1

0.15

0.2

0.25

0.3

JPEG2000 compression Ratio

Ha

mm

ing

Dis

tan

ce

Robustness against JPEG2000: Blackboard

Proposed algorithm

Existing algorithm

Page 57: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ IET/IPR 2012 © The University of Sheffield, UK

Experimental Results

0 10 20 30 40 50 600

0.05

0.1

0.15

0.2

0.25

JPEG2000 compression Ratio

Ha

mm

ing

Dis

tan

ce

Robustness against JPEG2000: Light House

Proposed algorithm

Existing algorithm

0 10 20 30 40 50 600.05

0.1

0.15

0.2

0.25

0.3

JPEG2000 compression Ratio

Ha

mm

ing

Dis

tan

ce

Robustness against JPEG2000: Blackboard

Proposed algorithm

Existing algorithm

Page 58: Digital watermarking techniques for JPEG2000 scalable ...

Contents

Introduction

Digital watermarking: properties and applications

Discrete wavelet transform and its applications

Scalable image coding and its application in multimedia signal processing

Research techniques for image watermarking for JPEG2000 content adaptation

Recent developments and open questions in this field

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 59: Digital watermarking techniques for JPEG2000 scalable ...

Demo

• Watermarking demo.

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 60: Digital watermarking techniques for JPEG2000 scalable ...

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Open questions in this field and comments

• Watermarking a growing research area for digital copyright protection and other applications.

• Scalable coded contents are being used for various applications including mobiles.

• Watermarking for scalable coded contents are challenging and needs more research.

• Video watermarking is a promising research area to explore.

Page 61: Digital watermarking techniques for JPEG2000 scalable ...

Pointers

• WEBCAM Framework developed by The University of Sheffield.

• http://svc.group.shef.ac.uk/webcam.html

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 62: Digital watermarking techniques for JPEG2000 scalable ...

Pointers

05/12/2012 @ ICISS 2012 © The University of Sheffield, UK

Page 63: Digital watermarking techniques for JPEG2000 scalable ...

Questions and Answers:

Electronic & Electrical Engineering.

Communications Research Group.

Page 64: Digital watermarking techniques for JPEG2000 scalable ...

Thank You All

[email protected]

www.bhowmik.net/publication.html

Electronic & Electrical Engineering.

Communications Research Group.