Top Banner
Slide 1 Fraunhofer Digital Cinema Cross Media Format Workflow for Production, Postproduction and Archiving Heiko Sparenberg, Siegfried Foessel Fraunhofer Institute for Integrated Circuits Am Wolfsmantel 33, 91058 Erlangen, Germany www.iis.fraunhofer.de www.dcinema.fraunhofer.de www.wmp-bayern.de
51

Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Mar 18, 2019

Download

Documents

dokhanh
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide1

Fraunhofer Digital Cinema

Cross M

edia Form

at WorkflowforProduction,

Postproductionand Archiving

HeikoSparenberg,

Siegfried Foessel

Fraunhofer Institute for Integrated C

ircu

its

Am W

olfsm

antel3

3, 91058 Erlangen, Germ

any

www.iis.fraunhofer.de

www.dcinema.fraunhofer.de

www.w

mp-baye

rn.de

Page 2: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide2

Contents

1.Motivation

2.Production System Overview

3.Ingest Process

4.Using the Production System

5.Benefits

6.Fraunhofer IIS Developments

Page 3: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide3

Project: Tools forMedia Production

Page 4: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide4

Cinema Chain: Film and Digital

Digital

Postproduction

Digitizing

Exposure

to film

Secondaryuse

DVD

Production

Postproduction

Playback

Film-Camera

Conventional

Postproduction

Conventional

Projection

Archives

Digital

Camera

Digitale

Projection

Page 5: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide5

Goals

•Deliver data for different form

ats on demand

•No need for proxies

•No exposure back on film -data should stay digital

•Quick search in metadata

•Limitations for different user groups

•Open interfaces

Page 6: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide6

StorageSystem

Content Storage

User Rights

Metadata

ContentAcquisition

Creation

Postproduction

Ingest&

Administration

Metadata &

Transcoding

DCinema

HDTV

Mobil TV

Page 7: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide9

JPEG2000: LayeredSchemeCompression

Sca

lab

le B

itstr

ea

m

En

co

din

g

Page 8: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide10

Benefitsof JPEG2000 Standard

ContentStorage

4K

Co

nte

nt

2K

Co

nte

nt

Page 9: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide12

StorageSystem

Content Storage

User Rights

Metadata

System overview

ContentAcquisition

Creation

Postproduction

Ingest&

Administration

Metadata &

Transcoding

Page 10: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide13

StorageSystem

Content Storage

User Rights

Metadata

System overview: StorageSystem

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 11: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide14

StorageSystem

•Separate storage for

-Content (video and audio)

-Metadata

-Management data (user rights, content relation)

StorageSystem

Content Storage

User Rights

Metadata

Page 12: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide15

StorageSystem

Content Storage

User Rights

Metadata

System overview

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 13: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide16

ContentAcquisition

Creation

StorageSystem

Content Storage

User Rights

Metadata

System overview: ContentCreation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 14: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide17

ContentCreation/Acquisition

•Different form

ats from filmset

-Scanned film

-Digital data

•Not in scope of this project

-We expect digital data

ContentAcquisition

Creation

Page 15: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide18

StorageSystem

Content Storage

User Rights

Metadata

System overview

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 16: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide19

StorageSystem

Content Storage

User Rights

Metadata

System overview: Ingest& Adminstration

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 17: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide20

Ingest& Administration •Convert material from set to lossless JPEG2000

•Extract metadata from material header

•Store metadata in database

•Administrate

-User rights

-Access to content

-Quality and resolution right to content

•Add and remove

-User, groups, projects…

•Automatic metadata enrichment

Ingest&

Administration

Page 18: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide21

Face Detection

•Detect faces inside video content

•Detect mood

-Angry, happy, sad, surprised

•Detect gender

•Use this inform

ation to find certain content in

production system later

Ingest&

Administration

Page 19: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide22

Face Detection

Ingest&

Administration

Page 20: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide23

StorageSystem

Content Storage

User Rights

Metadata

System overview

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 21: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide24

StorageSystem

Content Storage

User Rights

Metadata

System overview: Postproduction

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 22: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide25

Postproduction

•Create sequences from source material

•Non destructive colorgrading for different purposes

-Cinema

-Broadcast

-Mobile TV

-Archive

•Add masks and filters

•Enrich descriptive metadata

•Combine audio and video

Postproduction

Page 23: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide26

StorageSystem

Content Storage

User Rights

Metadata

System overview

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 24: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide27

StorageSystem

Content Storage

User Rights

Metadata

System overview: Metadata & Transcoding

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 25: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide28

Metadata & Transcoding

•Gateway to other applications

•Deliver metadata in certain form

ats

-e.g. Broadcast Metadata Form

at (BMF)

•Transcodecontent to different destination form

ats

-H.264 for broadcast or

-DCI compliant J2K for DCinemadistribution

•Automatic audio downmixfrom 5.1 to stereo

•Wrappvideo, audio and metadata into destination

packet form

at like DCP or MXF

Metadata &

Transcoding

Page 26: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide29

StorageSystem

Content Storage

User Rights

Metadata

System overview

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 27: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide30

Ingestand Postproduction

StorageSystem

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 28: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide31

Ingestand Postproduction

RAW

D20

DPX

JPEG2000

StorageSystem

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 29: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide32

Ingestand Postproduction

RAW

D20

DPX

JPEG2000

Connect

StorageSystem

Content Storage

User Rights

Metadata

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 30: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide33

Ingestand Postproduction

StorageSystem

Content Storage

User Rights

Metadata

JPEG2000

RAW

D20

DPX

JPEG2000

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 31: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide34

Ingestand Postproduction

StorageSystem

Content Storage

User Rights

Metadata

e.g. Titel, Faces

RAW

D20

DPX

JPEG2000

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 32: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide35

Ingestand Postproduction

StorageSystem

Content Storage

User Rights

Metadata

perm

it/denyaccessto content

RAW

D20

DPX

JPEG2000

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 33: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide36

StorageSystem

Ingestand Postproduction

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 34: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide37

Connect

Ingestand Postproduction

StorageSystem

Content Storage

User Rights

Metadata

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 35: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide38

SearchContent

StorageSystem

Content Storage

User Rights

Metadata

Ingestand Postproduction

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 36: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide39

Non destructiveworkon content

StorageSystem

Content Storage

User Rights

Metadata

Ingestand Postproduction

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 37: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide40

Addmetadata

StorageSystem

Content Storage

User Rights

Metadata

Ingestand Postproduction

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Metadata &

Transcoding

Page 38: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide41

Metadata &

Transcoding

Client

Distributor

Archives

Editor

ContentAcquisition

Creation

UsingtheProductionSystem

StorageSystem

Ingest&

Administration

Postproduction

Page 39: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide42

UsingtheProductionSystem

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Client

Distributor

Archives

Editor

Connect

Connect

StorageSystem

Content Storage

User Rights

Metadata

Metadata &

Transcoding

Page 40: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide43

Metadata &

Transcoding

StorageSystem

Content Storage

User Rights

Metadata

UsingtheProductionSystem

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Client

Distributor

Archives

Editor

SearchContent

Metadata

Page 41: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide44

StorageSystem

Content Storage

User Rights

Metadata

UsingtheProductionSystem

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Client

Distributor

Archives

Editor

Pre

vie

w

Metadata &

Transcoding

Page 42: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide45

Metadata &

Transcoding

StorageSystem

Content Storage

User Rights

Metadata

UsingtheProductionSystem

ContentAcquisition

Creation

Ingest&

Administration

Postproduction

Client

Distributor

Archives

Editor

RequestContent

GeneratedContent

Page 43: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide46

Conclusion/ Benefits

•No proxies for certain output form

ats

•Full non destructive workflow

•Generate content on demand

•Usage of JPEG2000 results in

-Less storage needs

-Less storage costs

-Less bandwidth needs

•Data will stay digital

Page 44: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide47

Test Productionin Progress

•First test production with Distributed Production

System in progress

•Work on film set finished yet

•Currently testing software modules for ingest and

transcoding

•2nd test production will be started in summer 2008

Page 45: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide49

Combination of analog and digital technology:

Combination of analog and digital technology:

Combination of analog and digital technology:

Combination of analog and digital technology:

-Rotating mirror shutter

-Optical view finder

-Use of one CMOS image sensor with 35mm-film

form

at allows

use of 35mm lenses and enables film look

-Resolution of 2880 by 2160 Pixel equivalent to RGB

2k camera

-Digital processing inside the camera

-Variable Output form

ats, variable Speed

-Digital Outputs (single/dual HDSDI)

-HD-and Data-M

ode

-Electronic developed for ARRI CinetechnikGmbH by

Fraunhofer IIS

D20 -Digital FilmstyleCamera

ARRI D20

ARRI D20

Page 46: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide50

D20 -Mobile field recorder from IIS

�HDD-based (optional Flash-based)

Storage,

portable 8kg

�Storage capacity >1,0 TeraByte

�Storage and Playback of Sequences up to DC2048x1080

and HTDV 1920x1080, RGB 12 Bit

�Uncompressed (or lossless/near lossless J2K-compression)

�IT interfaces: 2 GBitFC, FW

Megacine

Megacine

Page 47: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide51

DCP Authoring

JPEG2000-Codestream-Viewer

ScaleabilityControls

DCP Essence

Navigation Controls

Timeline

MXF

CPL

PKL

Page 48: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide52

DCP Validation

DCP-Content

PKL

CPL

MXF

J2K-Codestream

CodestreamValidation

Preview

ViewerControls

Page 49: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide53

JPEG2000 –Form

at support

Plugindevelopment for postproduction software

-Software based

-Available for

-IridasSpeedgrade

-IridasFramecycler

-Digital Fusion 4

-Digital Fusion 5

Page 50: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide54

Visitusat NAB ´08

•Center Hall Booth C10919A/B

Center Hall Booth C10919A/B

Center Hall Booth C10919A/B

Center Hall Booth C10919A/B

•www.wmp-bayern.de

Page 51: Fraunhofer Digital Cinema Cross Media Format ... · Fraunhofer Digital Cinema Cross Media Format WorkflowforProduction, Postproductionand Archiving ... MXF CPL PKL. Slide52 DCP Validation

Slide63

Thankyou

foryourattention