Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06 Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen.

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 1

Content-aware and context-aware resource

adaptation

Juan Hamers (06/06/2006)

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 2

Content providers offer multiple versions : which to choose

Media stream

low

medium

high

small

medium

large

56k

100k

300k

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 3

2 Major issues for client when selecting media

• Decoder powerful enough– No skipping distortion

• Sufficient battery life

BatteryEmpty

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 4

Impact of content itself on decoding time / Energy consumption

Platform capacity

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 5

Exploiting this variance to adapt resources for energy efficiency

40 80 120

P(W)

t (ms)

5

DVS (P ~ fV², V ~ f)

frequency

power

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 6

Oracle needed for accurate timing information

Missed deadline

Less Energy conserved

40 80 120

P(W)

t (ms)

5

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 7

Content-provider has to add scenario information

Platform & decoder independent

Adequate Resources

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 8

Looking into content structure

……

Decoder

MB type

Scaling

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 9

A Macroblock profile summarizes the structure of a GOP/frame

Histogram

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 10

Macroblock profile relates to decode time

MB-profile

Decode time

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 11

Provider determines scenarios based upon macroblock profiles

Content Provider

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 12

Client trains Scenario Adaptation Table with representative samples

freq V En (J) dtime (ms)

300 1.2 6 100

533 1.35 15 200

400 1.225 10 140

666 1.6 20 300

Client Side

Content Provider

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 13

What about new content ???

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 14

Determining resource needs during handshake

Energy / Time

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 15

Client uses scenario IDs and its SAT to scale frequency & voltage

freq V

300 1.2

533 1.35

400 1.225

666 1.6

Decoder……

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 16

Experimental setup

• 12 Video sequences (300 frames)

• Macroblock profiles per GOP/frame

• Train with 11, test other

• Cluster centroid for training target platform (+ Additional offset)

• 12/32 scenarios performed best

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 17

Predicting decode complexity

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 18

Decoder Adaption : 3 Cases considered

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 19

We realized an average energy reduction of 46%

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 20

Results energy prediction

Content-aware and context-aware resource adaptation Juan Hamers – 2006-06-06Faculteit Ingenieurswetenschappen – Vakgroep Elektronica en Informatiesystemen

pag. 21

Conclusion• Macroblock profiles correlate well with

decoding time/Energy usage.• Recognizing scenarios derived from

macroblock profiles allows for – efficient resource adaption– Predicting required resources– In a platform independent way

• Average energy reduction of 46%• Used for resource prediction < 2 % error