Top Banner
>> HIGHERVIEW Team: A. Sasse J. D. McCarthy D. Miras J. Riegelsberger Presentation to UCL Network Group: 3rd March 2004
38

> HIGHERVIEW

Jan 06, 2016

Download

Documents

Weston Zhu

> HIGHERVIEW. Team: A. Sasse J. D. McCarthy D. Miras J. Riegelsberger. Presentation to UCL Network Group: 3rd March 2004. > Sharp or smooth? Comparing the effects of quantization vs. frame rate for streamed video. J.D. McCarthy M. A. Sasse D. Miras. > motivation. - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: > HIGHERVIEW

>> HIGHERVIEW

Team:

A. Sasse

J. D. McCarthy

D. Miras

J. Riegelsberger

Presentation to UCL Network Group: 3rd March 2004

Page 2: > HIGHERVIEW

>> Sharp or smooth?Comparing the effects of quantization vs. frame rate for streamed video.

J.D. McCarthy

M. A. Sasse

D. Miras

Page 3: > HIGHERVIEW

3

>> motivation

> Existing QOS policies conflict with experimental evidence.

> No previous studies manipulating frame quality in conjunction with frame rate.

Page 4: > HIGHERVIEW

4

>> motivation

> IBM QOS policy (2003)“recommends reducing DCT coefficients rather than frame rate for Sports coverage, as “the priority for smooth video is higher than the priority for frame quality”

> Apteker et al. (1995) > Sport coverage relatively insensitive to reductions in frame rate.

Page 5: > HIGHERVIEW

5

>> methodology

> Continuously change video quality while users are watching.

> Continuously record user’s perception.

> Discover the relationship between signal quality and perceived quality.

Page 6: > HIGHERVIEW

6

>> which measure?

> Mean Opinion Score (MOS)– 8-10 second clips – single camera angle

– rate quality on a 5 point Likert scale.

> Limitations– Doesn’t measure continuous quality variations.– Poor measure for streamed video quality.– Doesn’t measure acceptability.

Page 7: > HIGHERVIEW

7

>> which measure?

> SSCQE – The single stimulus continuous quality evaluation (SSCQE)– using a slider to indicate quality continuously.

> Limitations– Too demanding for users performing real tasks.– Doesn’t measure service acceptability.

Page 8: > HIGHERVIEW

8

>> acceptability?

> Is a MOS of 3.5 acceptable to users?

> What about an SSCQE rating of 70?

> Service dependent?

Page 9: > HIGHERVIEW

9

>> our approach

> Focus on a specific service.> Ask users to say when the service is

acceptable / unacceptable.

> Advantages– Can be used with continuous streams

– Easy for users to understand

– Less disruptive

– Relevant to service providers

Page 10: > HIGHERVIEW

10

>> methodology

> Continuously change video quality while users are watching.

> Continuously record user’s perception.

> Discover the relationship between signal quality and perceived quality.

Page 11: > HIGHERVIEW

11

>> “method of limits”

unacceptable

acceptable

low quality

high quality

Page 12: > HIGHERVIEW

12

>> “method of limits”

unacceptable

acceptable

low quality

high quality

Page 13: > HIGHERVIEW

13

>> “method of limits”

unacceptable

acceptable

low quality

high quality

Page 14: > HIGHERVIEW

14

>> service functions

unacceptable

acceptable

low quality

high quality

Pr (acceptable)

Page 15: > HIGHERVIEW

15

>> service functions

unacceptable

acceptable

low quality

high quality

Pr (acceptable) ITU BT.500-11

Logistic Function

Page 16: > HIGHERVIEW

16

>> service functions

unacceptable

acceptable

frame rate

?

Page 17: > HIGHERVIEW

17

>> service functions

unacceptable

acceptable

frame quality

?

Page 18: > HIGHERVIEW

18

>> two studies

> Study 1– CIF video viewed on a desktop. – Acceptability ratings.– Eye movements.

> Study 2– QCIF video viewed on an iPAQ.– Acceptability ratings.– Qualitative interviews.

Page 19: > HIGHERVIEW

19

>> video material

> Football match– Arsenal vs Man. United (2002)

• 3 source clips.

– [A] Match intro and opening 3 minutes of play– [B] Highlights of Manchester United chances– [C] Highlights of Arsenal chances, final whistle and

Arsenal celebration.

Page 20: > HIGHERVIEW

20

>> participants

> Study 1– 41 football fans.

– 59% watched at least once a week

– 88% supported a football team.

– 51% supported Arsenal or Man U.

Page 21: > HIGHERVIEW

21

>> participants

> Study 2– 37 football fans.

– 65% watched at least once a week

– 84% supported a football team.

– 34 % supported Arsenal or Man U.

Page 22: > HIGHERVIEW

22

>> design

Page 23: > HIGHERVIEW

23

>> study 1 - results

fps

Page 24: > HIGHERVIEW

24

>> study 1 - results

quant

Page 25: > HIGHERVIEW

25

>> study 1 - results

fps +

quant

Page 26: > HIGHERVIEW

26

>> study 1 - results

gaze

Page 27: > HIGHERVIEW

27

>> study 1 - summary

> Acceptability insensitive to frame rate.

> Acceptability sensitive to quantization.

> Critical values:– Quantisation = 8– Frame rate = 6

Page 28: > HIGHERVIEW

28

>> study 2 - results

fps

Page 29: > HIGHERVIEW

29

>> study 2 - results

quant

Page 30: > HIGHERVIEW

30

>> study 2 - results

fps +

quant

Page 31: > HIGHERVIEW

31

>> bandwidth?

Page 32: > HIGHERVIEW

32

>> bandwidth?

Critical

Values

(Clip B)

Page 33: > HIGHERVIEW

33

>> qualitative comments

– 84%, recognising players was impossible.

– 65% had problems following the ball.

– 35% said close up shots fine - but long distant shots poor.

– 21% said jerky movement was a problem.

Page 34: > HIGHERVIEW

34

>> qualitative comments

“I’d rather have jerky video and

better quality pictures”

Page 35: > HIGHERVIEW

35

>> study 2 - summary

> Acceptability insensitive to frame rate.

> Acceptability sensitive to quantization.

> Critical values:– Quantisation = 4– Frame rate = 6

Page 36: > HIGHERVIEW

36

>> conclusions

> Limitations– Network effects not factored in.

> Substantive– High motion does not need high frame

rate! – Important task relevant information is lost

with poor frame quality.

Page 37: > HIGHERVIEW

37

>> conclusions

> Methodological– Binary acceptability rating

• continuous• easy to understand• doesn’t disrupt task

– “Method of limits” produces robust replicable service functions.

Page 38: > HIGHERVIEW

>> Sharp or smooth?Comparing the effects of quantization vs. frame rate for streamed video.

J.D. McCarthy

M. A. Sasse

D. Miras