CCTV systems Encoding Standards and ONVIF

1

[NAME], [POSITION]

[EVENT OR DATE]

Selecting your CCTV encoding standardOptimise and protect your investment

2

Selecting your CCTV encoding standard

ST-PRM/EU Gerard Otterspeer/Ruud Toonders | 01/05/2009 | © Robert Bosch GmbH 2009. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.

Security Systems

Agenda H.264 it’s a standard... right? ONVIF: 1st step to global standardisation iSCSI: Record anywhere in your network Live demonstration

3



Security Systems

1st: A guide to standardisation bodies ITU-T

International Telecommunications Union (ITU) Telecommunication Standardization Sector (ITU-T)

Video Coding Experts Group (VCEG)

ISO/IEC International Organization for Standardization (ISO) International Electrotechnical Commission (IEC)

Moving Picture Experts Group (MPEG)

Both teams work together in the Joint Video Team (JVT)

4



Security Systems

1988 1992 1996 2000 2004 2008Year

MPEG

JVT

ITU-T

H.262/MPEG-2

MPEG-1

H.261 v1 H.261 v2 H.263 H.263 + H.263 ++

H.264/MPEG-4 AVC

MPEG-4 part1

H.264/MPEG-4 AVC

A guide to standardisation bodies - History

MPEG-4 p2

5



Security Systems

2nd The goal… ITU-T Recommendation H.264 or

ISO/IEC MPEG-4 part 10 Advanced Video Coding (AVC)

Goals for development: create a standard capable of providing good video quality at

substantially lower bit rates than previous standards

Intended for a wide variety of applications: low and high resolution video Broadcast DVD storage IP network ITU-T multimedia telephony systems

6



Security Systems

3rd: The directions… The standard includes several sets of capabilities, which are referred

to as profiles, targeting specific classes of applications.

Two are relevant to CCTV video encoding:

Baseline ProfilePrimarily for applications with limited computing resources, this profile is used widely in videoconferencing, mobile applications and CCTV video encoding.

Main ProfileOriginally intended as the mainstream consumer profile for broadcast and storage applications. Now implemented by Bosch for recording of CCTV Video.

7



Security Systems

InterlacingInterlacing

The road travelled…SCENE

Analogframe

Odd field

Even field

InterlacedFrame

8



Security Systems

The road travelled…

Analogframe

Analogframe

Analogframe

Analogframe

Analogframe

Analogframe

Analogframe

Analogframe

Analogframe

I “JPEG”

PPredicted

PPredicted

PPredicted

PPredicted

t

I“JPEG”

9



Security Systems

Baseline +Additional elements

for better frame quality

Baseline

H.264

Base profile for H.264

Main

High Quality encoding for recording

SCENE

H.264 profiles

10



Security Systems

Baseline profileBaseline profile

I & P Slices Quarter-Pel MC Different Block Sizes In-Loop Deblocking Filter Multiple Reference frames Intra Prediction CAVLC Flexible Macroblock Order Arbitrary Slice Order


Baseline Profile

H.264

SCENE

Different Block Sizes

In-Loop Deblocking Filter

Multiple reference pictures

CAVLC

Building BlockBuilding Block BenefitBenefit

More image detail image looks better to human eyes better compression of difficult scenes

Lower bitrate

11



Security Systems

Different Block Sizes Large blocks where details are low, Small blocks where details

are high With H.264 we can even go as small as 4x4 pixels

More image detail where needed without unnecessary overhead

BE

NE

FIT

BE

NE

FIT

12



Security Systems




Baseline Profile

H.264

SCENE




CAVLC



Lower bitrate

13



Security Systems

In-Loop Deblocking Filter Smoothes the edges between macro blocks Makes the image easier for our eyes without loosing details

Better and easier experience of the resulting image for the human user

BE

NE

FIT

BE

NE

FIT

Reconstructed Frame; QP=32; No Filter Reconstructed Frame; QP=32; With Filter

14



Security Systems




Baseline Profile

H.264

SCENE




CAVLC



Lower bitrate

15



Security Systems

Multiple reference pictures Multi-picture motion compensation using previously-encoded

pictures as references.

Very significant bit rate reduction for scenes with: back-and-forth scene cuts or uncovered background areas

BE

NE

FIT

BE

NE

FIT

16



Security Systems




Baseline Profile

H.264

SCENE




CAVLC



Lower bitrate

17



Security Systems

CAVLC Context-Adaptive Variable-Length Coding

Lower bitrate, up to 15%

BE

NE

FIT

BE

NE

FIT

H.264Encoder

Entropy bit streamEncoder

H.264Decoder

Entropy bit streamDecoder

LAN

18



Security Systems

H.264 profiles - Baseline Bare recommendation, does not support interlaced video (field

coding) This dictates that the maximum resolution is 2CIF

For those systems requiring medium resolution Bosch provides optimum investment protection, by supporting H.264 Baseline profile @ 25IPS on existing IP cameras and encoders with the release of firmware 4.0.

More image detail where needed without unnecessary overhead

BE

NE

FIT

BE

NE

FIT


BE

NE

FIT

BE

NE

FIT


BE

NE

FIT

BE

NE

FIT

19



Security Systems

Baseline+ profileBaseline+ profile

I & P Slices Quarter-Pel MC Different Block Sizes In-Loop Deblocking Filter Multiple Reference frames Intra Prediction CAVLC Field Coding


Baseline+ profile

H.264

SCENE






CAVLC

Field Coding


More image detail image looks better to

better compression

Lower bitrate

Interlacing support

20



Security Systems

Baseline+: Baseline + field coding Remember the analogue picture we started with?

Support of interlaced resolutions up to 4CIF whilst maintaining all H.264 Baseline benefits.

BE

NE

FIT

BE

NE

FIT

Odd field (2CIF)

Even field (2CIF)

InterlacedFrame (4CIF)

21



Security Systems

H.264 profiles – Baseline+ Baseline+ is implemented in

Divar XF Hybrid Recorder Autodome Easy IP

We implemented it also in our new VIPX 1600 encoder modules. Existing platforms run H.264 encoder in firmware on DSP New platform uses dedicated hardware accelerator chips for

H.264 encoding New Bosch encoders also support H.264 main profile!

22



Security Systems

Main profileMain profile



Main profileSCENE

H.264 B-Slices MBAFF Weighted Prediction CABAC

23



Security Systems

B Slices Bi-directional predictive coding

inter-picture prediction, longer-term referencesbitrate reduction 15-30% over baseline profile

BE

NE

FIT

BE

NE

FIT

Analogframe

Analogframe

I “JPEG”

PPredicted

Analogframe

Analogframe

Analogframe

Analogframe

Analogframe

Analogframe

Analogframe

PPredicted

PPredicted

PPredicted

I“JPEG”

B BI PB IB B B P

24



Security Systems

Main profileMain profile



Main profileSCENE

H.264 B-Slices MBAFF Weighted Prediction CABAC

25



Security Systems

CABAC Context-Adaptive Binary Arithmetic Coding

More efficient lossless entropy encodingBitrate reduction 10-30% over CAVLC

BE

NE

FIT

BE

NE

FIT

H.264Encoder

Entropy bit streamEncoder

H.264Decoder

Entropy bit streamDecoder

LAN

“Winzip on steroids”

26


Confidential | STVC/PRM | 4/30/2009 | © Robert Bosch GmbH 2009. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.

Security Systems

The benefits of H.264More image detail where needed without unnecessary

overhead B

EN

EFIT

BEN

EFIT

Ba

se

lin

e P

rofi

leB

as

eli

ne

Pro

file


BEN

EFIT

BEN

EFIT


BEN

EFIT

BEN

EFIT

Support of interlaced resolutions up to 4CIF whilst maintaining all H.264 Baseline benefits.

BEN

EFIT

BEN

EFIT

inter-picture prediction, longer-term referencesbitrate reduction 15-30% over baseline profileB

EN

EFIT

BEN

EFIT

More efficient lossless entropy encodingBitrate reduction 10-30% over CAVLC so 20% overallB

EN

EFIT

BEN

EFIT

Up

to

30%

mo

re e

ffic

ien

t*U

p t

o 3

0% m

ore

eff

icie

nt*

* In relation to MPEG4, depending on scene and quality settings

Up

to

50%

mo

re e

ffic

ien

t*U

p t

o 5

0% m

ore

eff

icie

nt*

Ba

se

lin

e+

Pro

file

Ba

se

lin

e+

Pro

file

Ma

in P

rofi

leM

ain

Pro

file

27



Security Systems

Identical quality = lowest bitrate MPEG4@2600kbps BP+@1800kbps MP@1600kbps

Fixed bitrate = best quality MPEG4@500kbps BP+@500kbps MP@500kbps

Adds delayUse only

for recording

28



Security Systems

XFM4 H.264 encoding module

1st member of our new hardware platform Full H.264 4CIF@25IPS resolution encoding in hardware

Each module provides in parallel at 4CIF@25ips: 4x H.264@baseline for low-latency live stream (up to 30% less

bandwidth*) 4x H.264@main profile for recording stream (up to 50% less

bandwidth*) JPEG Audio

No direct CPU power limitations Dedicated IVA 4.0 hardware engine Dedicated iSCSI recording engine

* In relation to MPEG4, depending on scene and quality settings

29

but…



Security Systems

H.264 it’s a standard... right? YES… The decoding part is standard, although not all created

equal…. Profile building blocks can be picked at leisure Which can be some; Or many……

But all maybe called ‘H.264’

H.264 encoded video

30



Security Systems

H.264 it’s a standard... right? YES… but… however..Transmit Decoding

H.264Decoder

H.264Encoder

Receive

31



Security Systems


32



Security Systems

About ONVIF

• ONVIF = Open Network Video Interface Forum

• Global and open industry forum for the development of a global interface standard for network video products

• Non-profit organization supported by membership fees

• Open to all companies and organizations

• Founded in 2008 by Axis, Bosch and Sony

• ONVIF = Open Network Video Interface Forum

• Global and open industry forum for the development of a global interface standard for network video products

• Non-profit organization supported by membership fees

• Open to all companies and organizations

• Founded in 2008 by Axis, Bosch and Sony

33



Security Systems

Mission Standardize communication between network video devices Ensure interoperability between network video products Open to all companies and organizations

To facilitate the development and use of a global open standard for the interface of network video products

MIS

SIO

NM

ISS

ION

34



Security Systems 3434

Currently 57 members (April 2009)

Full members

Contributing members

User members

37 companies

35


ST/MKT3 | 7/14/2008 | © Robert Bosch GmbH 2008. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.

Security Systems

Before ONVIF: connecting encoders and decoders

E.g. live streaming or metadata

Decoder included in PC software

Decoder included in PC software

BoschAxisSonyCompany X

Network Layer

Communication: LAN

36

The new standard defines a common protocol (“language”) for network video devices on how to exchange information like live video or meta data

Network Layer

Communication:



Security Systems

After ONVIF: connecting encoders and decoders

E.g. live streaming or metadata

LANONVIF

37



Security Systems

Before ONVIF: video management

Closed Video Management System Platform

Bosch SDK Axis SDK Sony SDK Company X SDK

LAN

38



Security Systems

After ONVIF: video management

Open Video Management System Platform

Standard compliant SDK e.g. Bosch SDK

LAN

39



Security Systems

ONVIF - Version 1.0 Interfaces of version 1.0 of ONVIF core specification covers

the following Network Layer Communications: Local and remote device discovery Device management Imaging/ media configuration Real time streaming of audio and video Event handling Video analytics PTZ (Pan, Tilt and Zoom) control security

Includes streaming set-up and control from JPEG, MPEG-4 & H.264 network video devices but does not cover compression standards.

FW 4.0 is ONVIF 1.0 readyDevice discovery, configuration and media service (MJPEG + H.264) are supported.

PTZ, event and imaging services are not supported yet. Fully compliant with the official ONVIF Test Tool 1.01.

FW

4.0

FW

4.0

40



Security Systems

The benefits of the ONVIF standard

Increased flexibility and greater freedom of choiceSecurity of investment in future-proof systems

Reduced total cost of ownershipEnd UsersEnd Users

Interoperability between different vendor’s productsSimplified installation

Greater freedom to specify a system

Integratorsand

consultants

Integratorsand

consultants

InteroperabilityExtended market opportunities

Reduced in-house development costs

Manufacturers

Softwarevendors

Manufacturers

Softwarevendors

41



Security Systems


42



Security Systems

1970 1990 1996 2000 2004 2008Year

Storage

Recording VCR’s

Tapes

DVR’s

Hard disks

A guide to recording and storage - History

SCSI

NVR’s

iSCSI

DirectiSCSI

Intelligent cameras, a stack of hard drives

43 ST-PRM/EU Gerard Otterspeer/Ruud Toonders | 01/05/2009 | © Robert Bosch GmbH 2009. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.

Security Systems

Closer Look on ‘Direct-to-iSCSI’


Camera is streaming directly to iSCSI storage devices Intelligence at the edge Fixed assignment of IP video

source to iSCSI storage device

Eliminate the need for NVRsProvides latest Bosch techniques like Forensic Search

BE

NE

FIT

BE

NE

FIT

44

, and a pinch of software



Security Systems

1970 1990 1996 2000 2004 2008Year

Storage

Recording VCR’s

Tapes

DVR’s

Hard disks

VRM

A guide to recording and storage - History

SCSI

NVR’s

iSCSI

DirectiSCSI

Intelligent cameras, a stack of hard drives

45

One VRM for all cameras, acts like ‘traffic cop’ Still direct-to-iSCSI recording Automatic redundancy if disc space is available Easy network scalability


Security Systems

Closer Look on the Video Recording Manager


Eliminate the need for NVRsProvides latest Bosch techniques like Forensic Search

Provides load balancing and failover for iSCSI storageBE

NE

FIT

BE

NE

FIT

46



Security Systems


47



Security Systems

Final Thoughts

Direct-to-iSCSI recording eliminates the single point of failureAnd significantly reduces TCOiS

CS

IiS

CS

I

FW 4.0 is ‘ONVIF ready’ and partly supports version 1.0 on JPEG Look for full compliance in cameras, encoders and DVR’s soon O

NV

IFO

NV

IF

Not all H.264 is created equal, look behind the labelMain profile recording significantly reduces TCOH

.26

4H

.26

4

48

[NAME], [POSITION]

Thank you for your attention

CCTV systems Encoding Standards and ONVIF

Documents