HDTV/DTV: Technical Overview and Roadmap Dr. Nikhil Balram Vice President of Advanced Technology Faroudja Laboratories, Sunnyvale, CA IEEE Communications.

HDTV/DTV: Technical Overview and Roadmap HDTV/DTV: Technical Overview and Roadmap Dr. Nikhil BalramDr. Nikhil Balram

Vice President of Advanced TechnologyVice President of Advanced TechnologyFaroudja Laboratories, Sunnyvale, CAFaroudja Laboratories, Sunnyvale, CA

IEEE Communications Society Seminar, 10th November 1999IEEE Communications Society Seminar, 10th November 1999

OverviewOverview HDTV/DTV OverviewHDTV/DTV Overview

• History & current statusHistory & current status• Technical overviewTechnical overview• Major playersMajor players• Barriers to rapid penetration/deploymentBarriers to rapid penetration/deployment

SourceSource

ChannelChannel

Receiver/DisplayReceiver/Display

ForecastsForecasts

SummarySummary

AcknowledgementsAcknowledgements

ReferencesReferences

Disclaimer:Disclaimer: All opinions/material presented in this seminar are solely the responsibility of the author All opinions/material presented in this seminar are solely the responsibility of the author and do not necessarily represent the views of current or past employers. Any trademarks or brand and do not necessarily represent the views of current or past employers. Any trademarks or brand names mentioned here are the properties of their respective holders and are hereby acknowledged. names mentioned here are the properties of their respective holders and are hereby acknowledged.

HDTV/DTV OverviewHDTV/DTV Overview HistoryHistory

Technical overviewTechnical overview

Major playersMajor players

Barriers to rapid penetration/deploymentBarriers to rapid penetration/deployment

HistoryHistoryHDTV/DTV OverviewHDTV/DTV Overview

19871987• Broadcasters petition FCC to institute rules for terrestrial HDTV broadcastBroadcasters petition FCC to institute rules for terrestrial HDTV broadcast• FCC creates Advisory Committee on Advanced Television Services (ACATS) FCC creates Advisory Committee on Advanced Television Services (ACATS)

to gather information and recommend a standardto gather information and recommend a standard

19881988• US Broadcasters create Advanced Television Test Center (ATTC) to conduct US Broadcasters create Advanced Television Test Center (ATTC) to conduct

tests of the proposed systemstests of the proposed systems

1989/901989/90• Cable industry through Cable Television Labs (CableLabs) prepares to test Cable industry through Cable Television Labs (CableLabs) prepares to test

proposed Advanced Television (ATV) systems over cable networksproposed Advanced Television (ATV) systems over cable networks• 9 systems offered to ATTC for testing: all analog except Zenith hybrid9 systems offered to ATTC for testing: all analog except Zenith hybrid

– Faroudja Labs, MIT, North American Phillips (NAP), Production Services Inc., Faroudja Labs, MIT, North American Phillips (NAP), Production Services Inc., Zenith Electronics, 2 from David Sarnoff Research Center (DSRC), 2 from Japan Zenith Electronics, 2 from David Sarnoff Research Center (DSRC), 2 from Japan Broadcasting Corporation (NHK)Broadcasting Corporation (NHK)

History (cont.)History (cont.)HDTV/DTV OverviewHDTV/DTV Overview

1990/91 1990/91 • FCC favors simulcast (full HDTV with eventual shutdown of NTSC) versus FCC favors simulcast (full HDTV with eventual shutdown of NTSC) versus

augmentationaugmentation• Shift to digital started by General Instruments (GI) DigiCipherShift to digital started by General Instruments (GI) DigiCipher• 6 systems (4 digital) from different coalitions tested by ATTC 6 systems (4 digital) from different coalitions tested by ATTC

1992 1992 • Advanced Television Systems Committee (ATSC) agrees to coordinate task of Advanced Television Systems Committee (ATSC) agrees to coordinate task of

documenting standard chosen by FCCdocumenting standard chosen by FCC

19931993• Analog options eliminatedAnalog options eliminated• Proponents of the 4 digital systems form Grand Alliance (GA)Proponents of the 4 digital systems form Grand Alliance (GA)

– AT&T, DSRC, GI, MIT, NAP, Thomson Consumer Electronics, Zenith ElectronicsAT&T, DSRC, GI, MIT, NAP, Thomson Consumer Electronics, Zenith Electronics

19941994• ACATS approves GA systemACATS approves GA system

1995/961995/96• ATSC documents and approves standard based on GA systemATSC documents and approves standard based on GA system

History (cont.)History (cont.)HDTV/DTV OverviewHDTV/DTV Overview

19961996• FCC proposes to adopt GA system as documented by ATSCFCC proposes to adopt GA system as documented by ATSC• Computer Industry Coalition on Advanced Television Services (CICATS) files Computer Industry Coalition on Advanced Television Services (CICATS) files

strong objection and proposes progressive SDTV with future path to HDTV strong objection and proposes progressive SDTV with future path to HDTV through an augmentation signalthrough an augmentation signal

Dec 24 1996Dec 24 1996• FCC adopts ATSC DTV standard except for table 3 with 18 formats (6 HD, 12 FCC adopts ATSC DTV standard except for table 3 with 18 formats (6 HD, 12

SD)SD)

19971997• HDTV rollout schedule agreed toHDTV rollout schedule agreed to

– Some stations in top 10 markets to offer some programming by November 1, 1998Some stations in top 10 markets to offer some programming by November 1, 1998– Top 10 markets (covering 30% of US households) to be on air by May 1, 1999Top 10 markets (covering 30% of US households) to be on air by May 1, 1999– Top 30 markets (covering 50% of US households) to be on air by November 1, 1999Top 30 markets (covering 50% of US households) to be on air by November 1, 1999– All commercial stations on air by May 1, 2002, (public stations get 1 more year)All commercial stations on air by May 1, 2002, (public stations get 1 more year)– NTSC broadcasting to cease on May 1, 2006, (later changed to whenever 85% of NTSC broadcasting to cease on May 1, 2006, (later changed to whenever 85% of

market is using HDTV sets) market is using HDTV sets)

Nov 1998Nov 1998• HDTV broadcasts beginHDTV broadcasts begin

Current Status Current Status HDTV/DTV OverviewHDTV/DTV Overview

November 1999November 1999• OverallOverall

– 474 TV stations have filed construction permit applications474 TV stations have filed construction permit applications– 220 have been granted DTV construction permits220 have been granted DTV construction permits– 66 are on air with full facilities66 are on air with full facilities– 25 are on air with special or experimental DTV authority25 are on air with special or experimental DTV authority

• Top 10 market network affiliates - 40 stationsTop 10 market network affiliates - 40 stations– 32 are on air with full facilities32 are on air with full facilities– 8 have requested second extensions8 have requested second extensions

• Markets 11-30 network affiliates - 79 stationsMarkets 11-30 network affiliates - 79 stations– 20 are on air with full facilities20 are on air with full facilities

See www.fcc.gov/mmb/vsd/files for more informationSee www.fcc.gov/mmb/vsd/files for more information

Technical OverviewTechnical OverviewHDTV/DTV OverviewHDTV/DTV Overview

Video: Video: • MPEG2 Main Profile @ High Level (MP@HL)MPEG2 Main Profile @ High Level (MP@HL)• 18 formats: 6 HD, 12 SD18 formats: 6 HD, 12 SD

Audio: Audio: • Dolby AC-3Dolby AC-3

Transport: Transport: • Subset of MPEG2Subset of MPEG2• Fixed length 188-byte packetsFixed length 188-byte packets

RF/Transmission:RF/Transmission:• Terrestrial: Terrestrial:

– 8-VSB (Vestigial Side Band) with Trellis coding8-VSB (Vestigial Side Band) with Trellis coding– effective payload of ~19.3 Mb/s (18.9 Mb/s used for video)effective payload of ~19.3 Mb/s (18.9 Mb/s used for video)

• Cable: Cable: – 16-VSB16-VSB– effective payload of ~38.6 Mb/seffective payload of ~38.6 Mb/s

HDTV/DTV System LayersHDTV/DTV System Layers

PictureLayer

CompressionLayer

TransportLayer

TransmissionLayer

MPEG-2 packets

MPEG-2 videoand Dolby AC-3

compressionsyntax

Multiple Picture Formatsand Frame Rates

Multiple Picture Formatsand Frame Rates

8-VSB

Video packet Video packetAudio packet Aux data

DataHeaders

MotionVectors

Chroma and LumaDCT Coefficients

Variable Length Codes

layered system with header/descriptors

Flexible delivery of dataand future extensability

Flexible delivery of dataand future extensability

19.3 Mb/s

Packet Headers

996 Mb/s1920 x 1080

@60I

Source:Sarnoff CorporationSource:Sarnoff Corporation

HDTV/DTV OverviewHDTV/DTV Overview

6 MHz

HDTV/DTV MPEG2 TransportHDTV/DTV MPEG2 Transport

audio 1

...packets with header/descriptors enable flexiblility and features...

video video TEXT video audio 2 PGM GD video video

Many services can be dynamically multiplexed and delivered to the viewer

video video

184 Byte Payload (incl. optional Adaptation Header)

188 Byte Packet

4 BytePacket Header

Video Adaptation Header(variable length)


Packet syncType of data the packet carriesPacket loss/misordering protectionEncryption controlPriority (optional)

Time synchronizationMedia synchronizationRandom access flagBit stream splice point flag


MPEG2 Video Basics: MPEG2 Video Basics: Sequence

(Display Order)

GOP(Display Order,

N=12, M=3)

Picture

Slice

MacroBlock

YCr

Cb

4 50 1

2 3Y Blocks Cr Block Cb Block

B B B B B B B BI P P P

Note:

Y = Luma

Cr = Red-Y

Cb = Blue-Y



MPEG2 Video BasicsMPEG2 Video BasicsHDTV/DTV OverviewHDTV/DTV Overview

MPEG2 Profiles/Levels MPEG2 Profiles/Levels • MPEG specification is generic - intended to cover wide range of applicationsMPEG specification is generic - intended to cover wide range of applications• ““Profiles” and “Levels” used to put bounds around parameters for applicationsProfiles” and “Levels” used to put bounds around parameters for applications

– ““Profile” is subset of bitstream syntaxProfile” is subset of bitstream syntax– ““Level” constrains parameters within allowed syntaxLevel” constrains parameters within allowed syntax

• Main Profile @ Main Level (MP@ML) - DVDMain Profile @ Main Level (MP@ML) - DVD– 4:2:0 I,P,B, bit rates up to 15 Mb/s4:2:0 I,P,B, bit rates up to 15 Mb/s

• Main Profile @ High Level (MP@HL) - HDTVMain Profile @ High Level (MP@HL) - HDTV– 4:2:0 I,P,B, bit rates up to 80 Mb/s 4:2:0 I,P,B, bit rates up to 80 Mb/s

Block Diagram of MPEG2 EncoderBlock Diagram of MPEG2 Encoder

Motion Compensation

DCT

“Previous” & “Future” Frames

Present frame +

+Q VLC

MotionEstimation

IDCT

Q-1

-

DCT Coefficients

Motion Vectors

MPEG2 Video Basics: Discrete Cosine Transform (DCT)MPEG2 Video Basics: Discrete Cosine Transform (DCT)

Image Transform domain

8x8 coefficients

Spatialdomain

8x8 pixels

8 x 8DCT

8 x 8DCT-1

Spatialdomain

8x8 pixels

ReconstructedImage

DCT is an orthogonal transformationDCT is an orthogonal transformation 2-D DCT is separable in x and y dimensions2-D DCT is separable in x and y dimensions Has good energy compaction propertiesHas good energy compaction properties Close to Karhunen-Loeve Transform (KLT), which is Close to Karhunen-Loeve Transform (KLT), which is

optimal but depends on image statistics.optimal but depends on image statistics. Efficient hardware realizationEfficient hardware realization Theoretically Theoretically losslesslossless, but slightly lossy in practice due , but slightly lossy in practice due

to round off errorsto round off errors



MPEG2 Video Basics: Discrete Cosine Transform (DCT)MPEG2 Video Basics: Discrete Cosine Transform (DCT)

pixels frequency coefficients

8x8DCT

low high

255 255 255 255 255 255 255 255 255 187 204 255 255 255 255 255 255 122 20 102 230 255 255 255 255 153 0 0 35 136 213 255 255 196 0 0 0 0 17 94 255 247 43 0 0 0 0 0 255 255 82 0 0 0 0 0 255 255 128 0 0 0 0 0

300137

51-12

-82

-1-6

59-942540

314-32

89-35-42

-81714-2-6

394

-20-16-13

512

6

717

-14-4-4-708

-1316

1-400

-4 0

-1275

-52

-1 0 0

-727

-5-1010

“DC” horizontal

vertical

Note: Transform values in this example are for illustration only.

low

high

8x8 pixel blocks transformed to 8x8 frequency coefficient blocks8x8 pixel blocks transformed to 8x8 frequency coefficient blocks Applied to intra-field blocks and motion-compensated (prediction Applied to intra-field blocks and motion-compensated (prediction

error) blocks error) blocks



MPEG2 Video Basics: Motion-compensated PredictionMPEG2 Video Basics: Motion-compensated Prediction

Current P or B PicturePrevious I or P Picture

XF

MVF

Instead of sending quantized DCT coefficients of X, send:

1. quantized DCT coefficients of X-F (prediction error). If prediction is good, error will be near zero and will need few bits.

2. MVF, the motion vector. This will be differentially coded with respect to its neighboring vector, and will code efficiently.

This will typically result in 50% - 80% savings in bits.

CurrentMacroblock


ATSC FormatsATSC FormatsHDTV/DTV OverviewHDTV/DTV Overview

Vertical Horizontal Aspect Ratio Picture Rate1080 1920 16:9 60I, 30P, 24P720 1280 16:9 60P, 30P, 24P480 704 16:9 & 4:3 60P, 60I, 30P, 24P480 640 4:3 60P, 60I, 30P, 24P

HDTV

SDTV““HD0”HD0”

18 formats: 6 HD, 12 SD 18 formats: 6 HD, 12 SD • 720 vertical lines and above considered High Definition720 vertical lines and above considered High Definition• Choice of supported formats left voluntary due to disagreement between Choice of supported formats left voluntary due to disagreement between

broadcasters and computer industrybroadcasters and computer industry– Computer industry led by Microsoft wants exclusion of interlace and initially use of Computer industry led by Microsoft wants exclusion of interlace and initially use of

only those formats which leave bandwidth for data services - “HD0” subsetonly those formats which leave bandwidth for data services - “HD0” subset

• Different picture rates depending on motion content of applicationDifferent picture rates depending on motion content of application– 24 frames/sec for film24 frames/sec for film– 30 frames/sec for news and live coverage30 frames/sec for news and live coverage– 60 fields/sec, 60 frames/sec for sports and other fast action content60 fields/sec, 60 frames/sec for sports and other fast action content

1920 x 1080 @ 60 frames/sec not included because it requires 1920 x 1080 @ 60 frames/sec not included because it requires ~100:1 compression to fit in 19.3 Mb/s terrestrial channel, ~100:1 compression to fit in 19.3 Mb/s terrestrial channel, which cannot be done at high quality with MPEG2 which cannot be done at high quality with MPEG2

Aspect RatiosAspect Ratios

800800

600600 450450

16:9 aspect ratio16:9 aspect ratio

800800

600600

4:3 aspect ratio4:3 aspect ratio


Two options: 16:9 and 4:3Two options: 16:9 and 4:3

4:3 standard aspect ratio for US TV and computer monitors4:3 standard aspect ratio for US TV and computer monitors

HD formats are 16:9HD formats are 16:9• better match with cinema aspect ratiobetter match with cinema aspect ratio• better match for aspect ratio of human visual systembetter match for aspect ratio of human visual system• better for some text/graphics tasks better for some text/graphics tasks

– allows side-by-side viewing of 2 pagesallows side-by-side viewing of 2 pages

Aspect RatiosAspect RatiosHDTV/DTV OverviewHDTV/DTV Overview

Full Zoom Full Zoom Squeeze

16 x 9 Display Modes 4 x 3 Display Modes

SqueezeVariableExpand

VariableShrink

(j)(d)(b)(a)

4

3

(e) (f) (g) (i) (h)

16

9

(c)

VideoTransmission

Format

Aspect ratio conversion will be requiredAspect ratio conversion will be required• 4:3 material on 16:9 monitor4:3 material on 16:9 monitor• 16:9 material on 4:3 monitor16:9 material on 4:3 monitor

Several options (shown below)Several options (shown below)

Viewing Distance Versus ResolutionViewing Distance Versus Resolution

Minimum Vertical Lines

0

200

400

600

800

1000

1200

0 10 20 30 40 50 60

4:3 Display Diagonal (inch)

2 3

36.724.5 44.1 61.216:9 Display Diagonal (Inch)

Viewing Distance (meters)

Source: McLaughlin Consulting GroupSource: McLaughlin Consulting Group


VERTICAL

LINES

PER

PICTURE

HT.

MINIMUM VERTICAL LINES

Display Size Display Size SDTV vs. HDTVSDTV vs. HDTV

• SDTV is adequate for small size TVs (<30 inches) at normal (>2 SDTV is adequate for small size TVs (<30 inches) at normal (>2 meters) viewing distancesmeters) viewing distances

• Current PC monitor definition offers excellent HDTV imaging at close Current PC monitor definition offers excellent HDTV imaging at close viewing distances (<1 meter)viewing distances (<1 meter)

– However, it may not feel the same as a large screen display even though it However, it may not feel the same as a large screen display even though it subtends the same angle ?subtends the same angle ?

• Major opportunity for HDTV is for big screens (>>30 inches) viewed Major opportunity for HDTV is for big screens (>>30 inches) viewed at > 2 metersat > 2 meters

PC vs. TVPC vs. TV• Both SDTV and HDTV can be displayed on 19”/21” PC monitorsBoth SDTV and HDTV can be displayed on 19”/21” PC monitors• Big screens TVs for family entertainmentBig screens TVs for family entertainment

The widescreen requirementThe widescreen requirement• Major new requirement of DTV is widescreen formatMajor new requirement of DTV is widescreen format• Requires widescreen home PC monitors and SDTVsRequires widescreen home PC monitors and SDTVs


Interlace vs ProgressiveInterlace vs ProgressiveHDTV/DTV OverviewHDTV/DTV Overview

Direct-view and projection CRT TVs typically use interlaced scanning, alternating between all odd lines and all even lines

CRT monitors and Flat Panel Displays put lines up in consecutive order

Odd Even

Reasons for interlacing in NTSC/PALReasons for interlacing in NTSC/PAL• Conserves bandwidth & storageConserves bandwidth & storage• Maintains frame rate & vertical resolutionMaintains frame rate & vertical resolution• Minimizes line structureMinimizes line structure

Odd & Even

Interlaced Vertical-Temporal Spectrum: 525 Lines @ 60IInterlaced Vertical-Temporal Spectrum: 525 Lines @ 60IHDTV/DTV OverviewHDTV/DTV Overview

30

262.5

60 TemporalFreq. (Hz)

Spatial Freq. (cycles/picture height)

525

0

I

II

III

V

A

B

C

D

E

F

Spectrum of (NTSC) interlaced video: I is original content, II, III, IV, V Spectrum of (NTSC) interlaced video: I is original content, II, III, IV, V are replicas caused by V-T samplingare replicas caused by V-T sampling

Interlacing artifacts: line twitter/flicker, line crawl, featheringInterlacing artifacts: line twitter/flicker, line crawl, feathering

IV

Progressive Vertical-Temporal Spectrum: 525 Lines at 60PProgressive Vertical-Temporal Spectrum: 525 Lines at 60PHDTV/DTV OverviewHDTV/DTV Overview

30

262.5

60 Temporal Freq. (Hz)

Spatial Freq. (cycles/picture height)

525

0

I

II

III

Spectrum of (NTSC-like) progressive video: I is original content, II, III, Spectrum of (NTSC-like) progressive video: I is original content, II, III, IV are replicas caused by V-T samplingIV are replicas caused by V-T sampling

Absence of replica V avoids artifacts created by interlacingAbsence of replica V avoids artifacts created by interlacing

Uses 2X as much bandwidth as 525 @ 60IUses 2X as much bandwidth as 525 @ 60I

IV

Addressability vs ResolutionAddressability vs ResolutionHDTV/DTV OverviewHDTV/DTV Overview

Addressability refers to number of pixels/lines that can be addressedAddressability refers to number of pixels/lines that can be addressed

Resolution is number of pixels (lines) that can be resolvedResolution is number of pixels (lines) that can be resolved• Measured as line pairs or TV-linesMeasured as line pairs or TV-lines

Resolution is usually less than addressability due toResolution is usually less than addressability due to• Bandwidth of channel and electronics Bandwidth of channel and electronics

– cables, video amplifiers, etccables, video amplifiers, etc

• Characteristics of reconstruction filter (display system)Characteristics of reconstruction filter (display system)– CRTs (horizontally): Gaussian spotCRTs (horizontally): Gaussian spot

– described by Modulation Transfer Function (MTF)described by Modulation Transfer Function (MTF)

– FPDs (and CRTs in vertical direction): spatially varyingFPDs (and CRTs in vertical direction): spatially varying– this is why NTSC is considered to have ~330 lines of resolution even though there are this is why NTSC is considered to have ~330 lines of resolution even though there are

480 active lines. # active lines is derated by Kell factor of 0.7480 active lines. # active lines is derated by Kell factor of 0.7– described by Multi-valued Modulation Transfer Function (MMTF)described by Multi-valued Modulation Transfer Function (MMTF)

Major implications for design of optimal video display systemMajor implications for design of optimal video display system

Interactivity & Data ServicesInteractivity & Data ServicesHDTV/DTV OverviewHDTV/DTV Overview

DTV bandwidth can be used for digital dataDTV bandwidth can be used for digital data• Allows new data enhanced viewing modesAllows new data enhanced viewing modes

– instant access to information such as player statistics, profiles of actors, etc.instant access to information such as player statistics, profiles of actors, etc.

• Simulated and actual interactivitySimulated and actual interactivity– real interactivity possible if platform has backchannelreal interactivity possible if platform has backchannel

Sophisticated electronic programming guide needed to manage much Sophisticated electronic programming guide needed to manage much greater choice created by multicast of SDTV streams greater choice created by multicast of SDTV streams • HDTV channel can be used to send multiple audio/video streamHDTV channel can be used to send multiple audio/video stream

– exact number depends on format and content. exact number depends on format and content.

Infrastructure for data services and interactivity laggingInfrastructure for data services and interactivity lagging

Major PlayersMajor PlayersHDTV/DTV OverviewHDTV/DTV Overview

Content providersContent providers• StudiosStudios• BroadcastersBroadcasters

Highway providersHighway providers• CableCable• Direct Broadcast SatelliteDirect Broadcast Satellite• BroadcastersBroadcasters

Receiver/Platform providers Receiver/Platform providers • Consumer electronics Consumer electronics • ComputerComputer

Technology providersTechnology providers• EquipmentEquipment• Semiconductor Semiconductor

Supervisors/regulatorsSupervisors/regulators• FCCFCC• CongressCongress

ConsumersConsumers

Distribution of US TV ViewersDistribution of US TV ViewersHDTV/DTV OverviewHDTV/DTV Overview

1998 2002

Total households ~ 100M ~ 105-110M

Total TV households ~ 99M ~ 104-107M

Total Cable subscribers ~ 65M ~ 65-70M

Total DBS subscribers ~ 8M ~ 13-20M

Total Terrestrial only ~ 25M ~ 20-22M

Cable dominates and will continue to do soCable dominates and will continue to do so• ~ 2/3 of US viewers ~ 2/3 of US viewers

Barriers to Rapid DeploymentBarriers to Rapid DeploymentHDTV/DTV OverviewHDTV/DTV Overview

SourceSource• Infrastructure costs Infrastructure costs

– New towers, transmitters, antennaeNew towers, transmitters, antennae

• Equipment costsEquipment costs– Large amount of NTSC equipmentLarge amount of NTSC equipment

• Operating costsOperating costs– Higher electricity billsHigher electricity bills– Greater programming costs - chicken & egg problem with viewers vs advertising Greater programming costs - chicken & egg problem with viewers vs advertising

revenuesrevenues

• Existing archivesExisting archives– Huge existing archives of material will still need to be usedHuge existing archives of material will still need to be used

Barriers to Rapid DeploymentBarriers to Rapid DeploymentHDTV/DTV OverviewHDTV/DTV Overview

ChannelChannel• Approx 2/3 of US TV households get programming via cableApprox 2/3 of US TV households get programming via cable• Cable BW is NOT freeCable BW is NOT free

– Huge investments made by cable companies to increase bandwidthHuge investments made by cable companies to increase bandwidth– More choice (of SD or 480i channels) and data services may offer better ROI than More choice (of SD or 480i channels) and data services may offer better ROI than

HD programmingHD programming– No “must carry” rules yetNo “must carry” rules yet

Receiver/DisplayReceiver/Display• Large high resolution displays are very expensiveLarge high resolution displays are very expensive• New electronics is expensive and still evolvingNew electronics is expensive and still evolving• Chicken & egg problemChicken & egg problem

– volumes vs costvolumes vs cost

Crossing the Barriers: Crossing the Barriers: SourceSource Upconversion of 480i to ATSCUpconversion of 480i to ATSC

• Huge NTSC archive and installed base of NTSC equipment can continue to be Huge NTSC archive and installed base of NTSC equipment can continue to be used by addition of Digital Format Translator (DFT) which upconverts 480i used by addition of Digital Format Translator (DFT) which upconverts 480i (NTSC, S-Video, D1, D2) to any ATSC HDTV format in real-time(NTSC, S-Video, D1, D2) to any ATSC HDTV format in real-time

• Allows gradual introduction of HD equipment as volumes increase and costs Allows gradual introduction of HD equipment as volumes increase and costs dropdrop

Digital Format Translator

ATSC formats480i

UpconversionUpconversion

AffiliateReceiver &

Decompressor

HD MPEG2Compressor

Broadcast Affiliate

Cable System

TV Affiliate or Cable Operator

Transmission

DigitalFormat

TranslatorTape Archive

or Disk Source

Video SourceFiber

Satellite Downlink

Cable

FromNetwork

Television Tower

NetworkSwitchingAnalog orCCIR601

HD MPEG2CompressorTape Archive

or Disk Source

Fiber

Network Broadcast:Cable:Satellite

TransmissionDigitalFormat

Translator

Satellite Uplink

To Affiliates

Video Source

480i (NTSC, S-Video, D1, D2) to any ATSC HDTV format in real-time480i (NTSC, S-Video, D1, D2) to any ATSC HDTV format in real-time

Crossing the Barriers:Crossing the Barriers: Source Source

Crossing the Barriers: Crossing the Barriers: ChannelChannel Cable adding significant capacity by upgrading to hybrid fiber/coaxCable adding significant capacity by upgrading to hybrid fiber/coax

• fiber from headend to nodefiber from headend to node• coax from node to homescoax from node to homes

Premium channels/content might use full HDPremium channels/content might use full HD

Channel bandwidth can be conserved by combination of good down/up Channel bandwidth can be conserved by combination of good down/up conversionconversion• Cable (and DBS/DSS) control both sides of channel that delivers content to Cable (and DBS/DSS) control both sides of channel that delivers content to

the homethe home

Downconvert480i or 480p

Upconvert

ATSC formats

HDTV/DTVATSC formats

Headend or node

Set-Top box inside home

channel

Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display Receiver and display currently separated in most offeringsReceiver and display currently separated in most offerings

• Enhanced DTVEnhanced DTV– addressability < 720 lines verticallyaddressability < 720 lines vertically– cost < $5000cost < $5000– direct-view and rear projectiondirect-view and rear projection– usually include line doubler (de-interlacer)usually include line doubler (de-interlacer)– Hitachi, Samsung, Panasonic, and many othersHitachi, Samsung, Panasonic, and many others

• HDTV-capableHDTV-capable– full HD addressabilityfull HD addressability– cost typically > $5000cost typically > $5000– no HD receiverno HD receiver– HD input from external receiver, often via proprietary interface HD input from external receiver, often via proprietary interface – mainly rear-projection, but some direct-viewmainly rear-projection, but some direct-view– Mitsubishi HD1080 Diamond Series with 4:3 and 16:9 options, Panasonic, Mitsubishi HD1080 Diamond Series with 4:3 and 16:9 options, Panasonic,

Faroudja, Hitachi, Samsung, and many othersFaroudja, Hitachi, Samsung, and many others

• HDTV-readyHDTV-ready– full HD addressabilityfull HD addressability– includes HD receiver and possibly others (e.g., DirecTV)includes HD receiver and possibly others (e.g., DirecTV)– mainly rear-projection but some direct viewmainly rear-projection but some direct view– Thomson, Sony, Toshiba, Hitachi, Samsung, and othersThomson, Sony, Toshiba, Hitachi, Samsung, and others

Receiver/Display OptionsReceiver/Display OptionsCrossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display

Display optionsDisplay options• Direct-view CRT TVDirect-view CRT TV• Rear-projection CRT TVRear-projection CRT TV• Rear-projection LCDs & DMDsRear-projection LCDs & DMDs

– Liquid-Crystal-On-Silicon (LCOS) devices could offer cheap high-def solutionLiquid-Crystal-On-Silicon (LCOS) devices could offer cheap high-def solution

• Front-projection LCDs & DMDsFront-projection LCDs & DMDs• LCOS HeadsetsLCOS Headsets• PlasmaPlasma• Direct-view LCDDirect-view LCD• 17”-21” CRT computer monitors17”-21” CRT computer monitors

– rapid decline in price + rapid increase in volumesrapid decline in price + rapid increase in volumes

Receiver optionsReceiver options• Set-Top Box (STB)Set-Top Box (STB)

– simplest option is simple decoding device similar to DSS/Cable STBsimplest option is simple decoding device similar to DSS/Cable STB– most popular option under development is low-cost multi-functional computer that can most popular option under development is low-cost multi-functional computer that can

be used for gaming, DVD, digital VCR, interactivity, Internet surfing, etcbe used for gaming, DVD, digital VCR, interactivity, Internet surfing, etc

• PC-DTVPC-DTV– PC with low cost DTV receiverPC with low cost DTV receiver

Set-Top BoxSet-Top BoxCrossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display

Basically a PC-like deviceBasically a PC-like device• Low cost: < 500$Low cost: < 500$• Multi-functionalMulti-functional

– HDTV/DTV tuner, demux, decode, conversionsHDTV/DTV tuner, demux, decode, conversions– NTSC tuner, decode, upconversionNTSC tuner, decode, upconversion– 3D Games3D Games– DVD playerDVD player– Interactivity & data servicesInteractivity & data services– Internet surfingInternet surfing– Digital VCRDigital VCR

• Open architectureOpen architecture– Not necessarily using Windows or x86Not necessarily using Windows or x86

• Leveraging PC components and approachLeveraging PC components and approach– PCI busPCI bus– Graphics and video components leveraged from PCGraphics and video components leveraged from PC– Software APIs to allow ISVs to offer enhanced servicesSoftware APIs to allow ISVs to offer enhanced services

DBS/DSS and Cable STBs pursuing similar directionDBS/DSS and Cable STBs pursuing similar direction

Set-Top Box: System ViewSet-Top Box: System View

USB Peripherals(Scanners, Keyboards,Joysticks, Printers )

HD HD DigitalDigitalDiskDisk

RecorderRecorder

HD HD DigitalDigitalDiskDisk

RecorderRecorder

AmplifierAmplifier

MTS 100MTS 100StreamStreamPlayerPlayer

MTS 100MTS 100StreamStreamPlayerPlayer

Software Development ToolsApplication Control Program

Telco Remote Control(or IRDA Peripherals)

Composite OutSvideo Out

R (R-Y)G (Y)

B (B_Y)S

AudioDTVNIM

TVTunerS/PDIF InS/PDIF In

S/PDIF OutS/PDIF Out

SDI InSDI In

SDI OutSDI Out

RS232RS232

JTAG TapJTAG Tap

EvaluationEvaluation

Modem USB/P1394 Smartcard IR/IRDA

Reference

TL850TL850

CPUCPU

Source:TeraLogic, Inc.Source:TeraLogic, Inc.

Crossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display

Set-Top Box: Structure and I/FsSet-Top Box: Structure and I/Fs

Source: TeraLogic Inc. Cougar DTV Reference Platform HWSource: TeraLogic Inc. Cougar DTV Reference Platform HW


Set-Top Box: SW ArchitectureSet-Top Box: SW Architecture

Source: TeraLogic Inc. Cougar DTV Reference Platform SWSource: TeraLogic Inc. Cougar DTV Reference Platform SW


DTV-STB Receiver ArchitectureDTV-STB Receiver Architecture

DTV DecoderDTV Tuner Demodulator

NTSC/PAL

Decoder

TransportStream

CCIR601

SDRAM

HD Video Out

Audio Out

Aux. Video OutCCIR601 Digital

EPROM

1394 Link

1394 PHY

Super I/O

STB I/O

PCI Bridge

CPU

FLASH SDRAM

PCI Bus

RS-232Parallel

USBIDE

IR

NTSC/PAL Encoder

Descrambler/CA sub system

IICSC

PWMGPIO

NTSC


PC-DTV PlatformPC-DTV PlatformCrossing the Barriers: Crossing the Barriers: Receiver/DisplayReceiver/Display

Near-term solutionNear-term solution• add-in card with HDTV/NTSC tuner and demux/decoderadd-in card with HDTV/NTSC tuner and demux/decoder

– offers HDTV/DTV viewing on conventional CRT computer monitor or HD monitoroffers HDTV/DTV viewing on conventional CRT computer monitor or HD monitor– enhanced services and interactivity possible through other PC HW/SWenhanced services and interactivity possible through other PC HW/SW– low cost: likely < 300$ in 2H99low cost: likely < 300$ in 2H99

• add-in card with HDTV/NTSC tuneradd-in card with HDTV/NTSC tuner– HW NTSC decodeHW NTSC decode– SW HD demux and decode (with IDCT+Motion Compensation assistance from SW HD demux and decode (with IDCT+Motion Compensation assistance from

graphics accelerator - MP@HL likely by 1H00).graphics accelerator - MP@HL likely by 1H00).– very low cost possible: could be < $100 in 1H00 very low cost possible: could be < $100 in 1H00

Long-term solutionLong-term solution• PC-based Integrated Digital Media PlatformPC-based Integrated Digital Media Platform

– Modular secure architecture based on compact enclosed receiver modules (Device Modular secure architecture based on compact enclosed receiver modules (Device Bay) with SW acting as bridge between receiver and renderer.Bay) with SW acting as bridge between receiver and renderer.

– Big push by Microsoft in this directionBig push by Microsoft in this direction

PC-DTV Add-in Card PC-DTV Add-in Card

AnalogSwitch

ATSC/NTSCTuner

VSB Demod.

PCI or AGP Graphics Card

NTSC Decoder

Xport

CCIR656

RGB

RGB

VIP Port,

PCI Bus

PC Monitor

HDTV

HD DigitalVideo

8/16/24

32

64

Memory -4/8/16 MB

HD

Antenna

CATV

JanusDTVPC

Decoder

Loop-back Cable

CCIR656

Video

Source: TeraLogic Inc. Source: TeraLogic Inc.


Add-in card option based on dual-input tuner and HW DTV decoderAdd-in card option based on dual-input tuner and HW DTV decoder

Could be < $300 in 2H99Could be < $300 in 2H99

DTV Decoder ICDTV Decoder IC

PCI Controller

Memory Controller

TransportDemultiplexer

TransportDemultiplexer

•ATSC•DVB•DSS

Digital Video Decoder•MP@HL MPEG2 •Decodes all 18

ATSC formats •1HD or 4 SD streams•Decodes DVD video•ATSC, ARIB, DVB

compliant

Video Scaler• 19 tap H/V filters

•Line Doubler•High Quality

up/downconversion

Display Processor•Multiple formats - 1080i, 720P,480P, 480i .

•PC Formats - VGA, SVGA, XVGA

•Letterbox mode

Memory

4/8/16 MB

PCI Bus

VIP PortHD TransportStream

Audio IN

Digital HD Video

Digital Video

CCIR656

SD Video

Audio OutCCIR656

RGB/YPbPr

(9)

(32)

(6)

(8)

(8)

(64)

(3)

(6)

Janus

AudioProcessor/

Mixer

2D Graphics•32 bit engine

•Anti-alias filter•Alpha blending

Source: TeraLogic Inc. Source: TeraLogic Inc.


Highly integrated DTV decoder ICHighly integrated DTV decoder IC• Comprehensive set of features: transport demux, MPEG2 MP@HL decode, video Comprehensive set of features: transport demux, MPEG2 MP@HL decode, video

processing, 2D graphics for GUI support, display processor, PCI I/Fprocessing, 2D graphics for GUI support, display processor, PCI I/F

Suitable for STB or PC-DTVSuitable for STB or PC-DTV

Philips Coney PCI ATSC/NTSC Reference DesignPhilips Coney PCI ATSC/NTSC Reference Design

Low cost add-in card optionLow cost add-in card option• NTSC/ATSC reception with single tunerNTSC/ATSC reception with single tuner• ATSC transport stream, scaled 656, and BTSC stereo audio sent out via PCIATSC transport stream, scaled 656, and BTSC stereo audio sent out via PCI• Could be < $100 in high volumeCould be < $100 in high volume


PC-DTV: HW/SW PartitioningPC-DTV: HW/SW Partitioning

Analog/digAnalog/digtuner drivertuner driver

VSB demodVSB demoddriverdriver

TS demuxTS demux

AC3 decodeAC3 decode DShowDShowsoundsound

DShow videoDShow videorendererrenderer

Gfx driverGfx driver

Gfx hardwareGfx hardware

NTSC/CCNTSC/CCapp/UIapp/UI

TunerTuner

Analog TVAnalog TVdemoddemod

Digital TVDigital TVdemoddemod

MP@HLMP@HLh/w assisth/w assist

PCIPCIBridgeBridge

SoftwareSoftware

HardwareHardware

DTV DTV app/UIapp/UI

MP@HLMP@HLvideo decodevideo decode

PCI BridgePCI BridgeWDMWDM


HW/SW partitioning for low cost Coney card optionHW/SW partitioning for low cost Coney card option

Enhanced Enhanced programmingprogramming

Video Video Audio Audio DataData

Graphics Graphics chip/cardchip/card

On-chip MPEG On-chip MPEG accelerationacceleration

8VSB PCI 8VSB PCI Receiver Receiver ModuleModule

AGPAGPPCIPCI13941394

WDM driverWDM driver

PC motherboard and softwarePC motherboard and software

1394 Device 1394 Device Bay or external Bay or external C.A. Receiver C.A. Receiver ModuleModule

NTSCNTSC

Analog Analog (MPEG (MPEG Encoding) Encoding) Receiver Receiver ModuleModule

TS splitTS split CS createCS create CS store/retrieveCS store/retrieve CS splitCS split

PCIPCI

MPEG MPEG decode decode support support

WDM driverWDM driver WDM driverWDM driver DriverDriver

CableCableCableCable


PC-DTV: System ViewPC-DTV: System View

PC-DTV: Long-term System ArchitecturePC-DTV: Long-term System Architecture

StorageStorage(Network)(Network)

TerrestrialTerrestrial

CableCable

SatelliteSatellite

ADSLADSL

TelcoTelco

????????

DirectShowDirectShow(value adding filters)(value adding filters)

Video Video display display

subsystemsubsystem

Audio Audio subsystemsubsystem

Data Data subsystemsubsystem

MPEG EncMPEG Enc

DVDDVD


Receiver functions separate from rendering functionsReceiver functions separate from rendering functions• All streams go through Microsoft DirectShow SW layerAll streams go through Microsoft DirectShow SW layer

PC-DTV: Long-term ViewPC-DTV: Long-term View

Integrated Digital Media Platform Integrated Digital Media Platform (“PC-Inside”)(“PC-Inside”)

Subsumes Subsumes functionality functionality of some or of some or all of theseall of these

Satellite TVSatellite TVreceiverreceiver

A/V receiverA/V receiver

VCRVCR

DVD playerDVD player

Game consoleGame console

Cable boxCable box

Atsc boxAtsc box

Telco boxTelco box

PC

insi

de

Web browserWeb browser


ForecastsForecasts Depends on whether PC-based DTV (or PC-like STB-based DTV) can Depends on whether PC-based DTV (or PC-like STB-based DTV) can

provide quick ramp up in volumeprovide quick ramp up in volume• PC-DTV add-in cards for $99-$299 coupled with 17”-21” CRT monitors could PC-DTV add-in cards for $99-$299 coupled with 17”-21” CRT monitors could

provide significant early deployment to create the positive spiral needed for fast provide significant early deployment to create the positive spiral needed for fast growthgrowth

• PC & CE industry will tryPC & CE industry will try– ultimately depends on consumer preferencesultimately depends on consumer preferences

Traditional approach based on HDTV sets and vanilla HD receivers will be Traditional approach based on HDTV sets and vanilla HD receivers will be much slowermuch slower

Low cost Low cost interactive interactive

receiversreceivers

Large installed base of Large installed base of eyeballseyeballs

Effective Effective advertisingadvertising

Better free Better free programsprograms

Large volume Large volume receiver marketreceiver market

Positive spiralPositive spiral

SummarySummary Transition to HDTV/DTV began with November 98 broadcastsTransition to HDTV/DTV began with November 98 broadcasts

• Current status is 66 stations on air with full facilities, 25 with partialCurrent status is 66 stations on air with full facilities, 25 with partial

Many barriers to rapid deployment, but most can be overcomeMany barriers to rapid deployment, but most can be overcome• Upconversion Upconversion • STB and PC DTV low cost receiver platformsSTB and PC DTV low cost receiver platforms

– New functionality such as digital recording, interactive television, data services, at low New functionality such as digital recording, interactive television, data services, at low cost could attract high volumes cost could attract high volumes

– PC/semiconductor industry price pressure could offer price-points as low as $99 (for PC/semiconductor industry price pressure could offer price-points as low as $99 (for lowest functionality option). lowest functionality option).

• Emerging display technologies such as LCOS, low cost large PC CRT monitors, Emerging display technologies such as LCOS, low cost large PC CRT monitors, and enhanced CRT SDTVs could provide high quality viewing options at and enhanced CRT SDTVs could provide high quality viewing options at reasonable cost. reasonable cost.

Could be a significant opportunity for “enhanced TV”Could be a significant opportunity for “enhanced TV”

Ultimately will depend on consumer preferencesUltimately will depend on consumer preferences

AcknowledgementsAcknowledgements Speaker gratefully acknowledges material and/or information provided by Speaker gratefully acknowledges material and/or information provided by

• Chuck McLaughlin, McLaughlin Consulting GroupChuck McLaughlin, McLaughlin Consulting Group• Mark O’Brien, TeraLogic, Inc.Mark O’Brien, TeraLogic, Inc.• Terry Smith, Sarnoff CorporationTerry Smith, Sarnoff Corporation• Dave Marsh, Microsoft CorporationDave Marsh, Microsoft Corporation• Mark Farley, S3 IncorporatedMark Farley, S3 Incorporated• Glen Sakata, Broadcast Group, Faroudja LaboratoriesGlen Sakata, Broadcast Group, Faroudja Laboratories

ReferencesReferences HDTV/DTVHDTV/DTV

• ““HDTV Status and Prospects”, B. Lechner, SID 1997 Seminar M-10.HDTV Status and Prospects”, B. Lechner, SID 1997 Seminar M-10.– detailed history of development of HDTV detailed history of development of HDTV

• ““The Impact of DTV on Television and Computer Displays”, R. Cooke, The Impact of DTV on Television and Computer Displays”, R. Cooke, C. McLaughlin, McLaughlin Consulting Group, December 1998 C. McLaughlin, McLaughlin Consulting Group, December 1998

– provides in depth analysis of US market and a detailed product and technology provides in depth analysis of US market and a detailed product and technology forecastforecast

– www.mcgweb.com/reports/dtv.htm.www.mcgweb.com/reports/dtv.htm.

• ““Opportunities for Displays in the DTV Era”, R. Cooke, C. McLaughlin, Opportunities for Displays in the DTV Era”, R. Cooke, C. McLaughlin, McLaughlin Consulting Group, April 1999 McLaughlin Consulting Group, April 1999

– abridged version, summarizes market trends and forecasts DTV rolloutabridged version, summarizes market trends and forecasts DTV rollout– www.mcgweb.com/reports/dtvopps.htm.www.mcgweb.com/reports/dtvopps.htm.

• www.atsc.org www.atsc.org – web site for Advanced Television Systems Committeeweb site for Advanced Television Systems Committee

• www.teralogic-inc.comwww.teralogic-inc.com– white papers on set-top box and PC implementations of DTVwhite papers on set-top box and PC implementations of DTV

• www.microsoft.com/winhecwww.microsoft.com/winhec– presentations and white papers on PC-centric DTVpresentations and white papers on PC-centric DTV

• www.fcc.gov/mmb/vsdwww.fcc.gov/mmb/vsd– web site for FCC - up-to-date information on TV stations DTV transitionweb site for FCC - up-to-date information on TV stations DTV transition

ReferencesReferences MPEG2MPEG2

• ““An Introduction to MPEG-2” B. Haskell, A. Puri, A. Netravali, Chapman & An Introduction to MPEG-2” B. Haskell, A. Puri, A. Netravali, Chapman & Hall, 1997Hall, 1997

PC multimedia architecturePC multimedia architecture• ““Multimedia Accelerators”, N. Balram, SID 1998 Seminar M-7.Multimedia Accelerators”, N. Balram, SID 1998 Seminar M-7.• Datasheets and data books from various multimedia accelerator companiesDatasheets and data books from various multimedia accelerator companies

Image/Video/TelevisionImage/Video/Television• ““Video Demystified: A Handbook for the Digital Engineer”, K. Jack, HighText Video Demystified: A Handbook for the Digital Engineer”, K. Jack, HighText

Publications, 1993. Publications, 1993. • ““Digital Television”, C. P. Sandbank (editor), John Wiley & Sons, 1990.Digital Television”, C. P. Sandbank (editor), John Wiley & Sons, 1990.• ““High Quality Video De-interlacing”, N. Balram, B. Herz, Windows Hardware High Quality Video De-interlacing”, N. Balram, B. Herz, Windows Hardware

Engineering Conference (WinHEC98), 1998.Engineering Conference (WinHEC98), 1998.• ““Video Processing for Pixellized Displays”, Y. Faroudja, N. Balram, Video Processing for Pixellized Displays”, Y. Faroudja, N. Balram,

Proceedings of SID International Symposium, May, 1999.Proceedings of SID International Symposium, May, 1999.• ““Principles of Digital Image Synthesis”, Vols 1 & 2, A. Glassner, Morgan Principles of Digital Image Synthesis”, Vols 1 & 2, A. Glassner, Morgan

Kaufmann Publishers, 1995.Kaufmann Publishers, 1995.

HDTV/DTV: Technical Overview and Roadmap Dr. Nikhil Balram Vice President of Advanced Technology Faroudja Laboratories, Sunnyvale, CA IEEE Communications.

Documents

digital systems

hdtvdtv overview u1996

ga system slide

attc6 systems

atsc dtv standard

information slide

zenith hybrid9 systems

terrestrial hdtv broadcast