Overview of Known Deployment Plans and Status for H.264/MPEG-4 pt. 10/AVC Gary J. Sullivan Document JVT-J009 of 10 th JVT Meeting Waikoloa, Hawaii, December,

Overview of Known Overview of Known Deployment Plans and Status Deployment Plans and Status for H.264/MPEG-4 pt. 10/AVCfor H.264/MPEG-4 pt. 10/AVC

Gary J. Sullivan

Document JVT-J009 of 10th JVT MeetingWaikoloa, Hawaii, December, 2003

(Contents are from public information only)

JVT-J009

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 2

Companies Publicly Known to be Doing Companies Publicly Known to be Doing Preliminary Implementation WorkPreliminary Implementation Work

Amphion British Telecom Broadcom (chip) Conexant (chipset for STB) Deutsche Telekom Envivio Equator FastVDO France Telecom Harmonic (filtering and motion estimation) HHI (PC & DSP encode & decode; demos) iVast LSI Logic (chip, plus Videolocus acquisition demoing

real-time FPGA+P4 encode, P4 dec) Mainconcept Mcubeworks Mobile Video Imaging Modulus Video (main profile levels 3 & 4 b’cast

encoders & professional-use decoders) Moonlight Cordless Motorola Nokia PixelTools PixSil Technology Polycom (videoconferencing & MCUs) Radvision (videoconferencing)

Sand Video (demoed 2 Xilinx FPGA decoder, encode/decode & decode-only chips to fab in ’03)

Sony (encode & decode, software & hardware, including PlayStation Portable 2004 & videoconferencing systems)

ST Micro (decoder chip in ‘03) Tandberg (shipping with all videoconferencing

endpoints since July ’03, GW and MCU since Oct.) Thomson TI (DSP partner with UBV for one of two UBV real-

time implementations) Toshiba UB Video (demoed real-time encode and decode,

software and DSP implementations) Vanguard Software Solutions (s/w, enc/dec) VideoTele.com (a division of Tut Systems) VCON

CAUTION: All such information should be considered preliminary and should not be considered to be product announcements – only preliminary implementation work. It will be awhile before robust interoperable conforming implementations exist.

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 3

Product Plans AnnouncedProduct Plans Announced

Amphion Semiconductor http://www.eetimes.com/story/OEG20020920S0049 Envivio http://www.envivio.com/products/h264.html Equator http://www.embeddedstar.com/press/content/2002/10/embedded5816.html FastVDO http://www.fastvdo.com/newslist.html France Telecom http://www.econf-communication.com HHI http://www.eetimes.com/sys/news/OEG20020916S0072 iVast http://www.ivast.com/company/press/2003/SandVid_NAB_033103.pdf LSI Logic http://www.lsilogic.com/products/islands/h264.html Mainconcept http://www.mainconcept.com/h264.shtml Mcubeworks http://www.mcubeworks.com/products Mobile Video Imaging http://www.digitalwebcast.com/2003/03_mar/news/dlmvi32703.htm Modulus Video http://www.modulusvideo.com/products.html Moonlight Cordless http://www.prweb.com/releases/2003/3/prweb59692.php PixelTools http://www.pixeltools.com/experth264.html PixSil Tech http://www.pixsiltech.com/products.htm Polycom http://www.polycom.com/investor_relations/0,1406,pw-2573,FF.html Radvision http://www.radvision.com Sand Video http://www.sandvideo.com/pressroom.html Sony http://www.eetimes.com/issue/mn/OEG20030801S0024 & http://news.sel.sony.com/pressrelease/3691 ST Microelectronics http://www.eetuk.com/tech/news/OEG20021113S0026 Tandberg http://tandberg.net/tb.asp?s=pagesimple&aid={8395730F-6D6F-4101-812F-B10A37412E16} UB Video http://www.eetimes.com/semi/news/OEG20021202S0048 Vanguard Software Solutions (software encode & decode) http://www.vsofts.com/codec/h264.html VCON http://www.vcon.com/press_room/english/2003/03031102.shtml

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 4

Support TechnologySupport Technology(Filtering, Motion Estimation, Stat Mux, etc.)(Filtering, Motion Estimation, Stat Mux, etc.)

Harmonic http://www.harmonicinc.com/ah_press_release_text.cfm?ID=453 http://www.harmonicinc.com/stageone/files/harmonic/collateral/H264_WP_0902_s.pdf

Moonlight http://www.moonlight.co.il/technology_h264.htm

Videoconferencing SystemsVideoconferencing Systems

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 6

Polycom Product HighlightsPolycom Product Highlights

http://www.polycom.com The world’s biggest videoconferencing company (whether counting

units or revenue) VSX™ 7000 “entry-level” set-top videoconferencing system

announced October 10, 2003 iPower™ 9000, 9400 and 9800 group videoconferencing systems

shipping some form of H.264/AVC since Q103 MGC™ multipoint conferencing unit “bridge” support Encoder operates up to 30 fps SIF / 25 fps CIF Planned availability as an option on the ViewStation® EX,

ViewStation FX and VS4000™ models in early 2004. Profile in all of these products: Baseline profile Shipping products not yet interoperating with Tandberg

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 7

Tandberg Product HighlightsTandberg Product Highlights

http://www.tandberg.no World’s second biggest videoconferencing company Entire product line (videoconferencing endpoints, MCUs, and

gateways) supports H.264/AVC Videoconferencing endpoints have supported it since July 2003

• Models 6000, 7000, 8000 group-use systems• Models 880 & 2500 medium-size systems• Models 550 & 1000 for small rooms & offices

Up to 30 fps CIF (level 1.3 with some H.241 enhancements) MCU and gateway support since Oct 2003 Shipping products not yet interoperating with Polycom, although

reportedly interoperating with some other pre-release products

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 8

Sony Videoconferencing Product HighlightSony Videoconferencing Product Highlight

http://www.sony.com/videoconference PCS-1 Series videoconferencing product announcement

June 2003 at Infocomm, with plan for future support of H.264/AVC announced

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 9

France Telecom Product HighlightFrance Telecom Product Highlight

http://www.francetelecom.com France Telecom is developing new videotelephony /

videoconferencing over IP services:• Platform aspects integrating third-party components (MCU,

Gatekeeper, etc…)• Full software SIP/H.323 (3G-324M soon) end point: eConf

– Baseline profile, Levels up to 2 (CIF 30 fps) for mid 2004– Supported platforms:

– Microsoft OSes (98, Me, 2000, XP, CE)– Other software and hardware platforms supported

soon: Symbian OS, Linux, Mac OSX. For Enterprise and Mass Market services

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 10

Radvision Product HighlightsRadvision Product Highlights

http://www.radvision.com viaIP MCU 3.2 videoconferencing “bridge” product

announced October 13, 2003 Plans for support across the videoconferencing product

line

Consumer ElectronicsConsumer Electronics

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 12

Sony CE Product HighlightsSony CE Product Highlights

http://www.sony.com Playstation Portable (PSP) announcement at Electronic

Entertainment Exposition in Las Vegas July 2003 PSP to have an LCD about 4.5 inches wide, with

480x272 resolution Incorporates single-chip 90-nm process custom silicon Decode only World-wide availability planned for Q404

Custom Silicon & FPGA Custom Silicon & FPGA PrototypesPrototypes

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 14

LSI Logic Product HighlightsLSI Logic Product Highlights

http://www.lsilogic.com Technology platform product announced with Sept 2003

availability for small-scale deployments• VLE4000 Encoder• VLD4000 Decoder• VSA2000 Stream Analyzer

Demonstrated at IBC 2003, Amsterdam, Sept. 2003 SDTV resolution & frame rate

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 15

Sand Video Product HighlightsSand Video Product Highlights

http://www.sandvideo.com New company based in Andover Massachusetts Advantage264™ chip family

• SV-C011 codec chip• SV-D011 decoder chip

Commercial sample availability Q104 September 2003 demonstrations at IBC Amsterdam:

• MPEG-2-to-H.264/AVC transcoding• SVP-IP01 Real-time 720p&1080i HD H.264/AVC Main Profile

decoding hardware licensable core design currently on FPGA• Focus especially on PVR functionality deployment

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 16

ST Microelectronics Product HighlightsST Microelectronics Product Highlights

http://www.st.com In-Stat/MDR: “For the fourth year in a row ST

Microelectronics was the largest supplier of MPEG ICs, based on revenue, with 31%.” (“while ESS Technology leads in units.”)

To ship H.264 in future Nomadik implementations (press release October 2003)

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 17

Pixsil Technology Product HighlightsPixsil Technology Product Highlights

http://www.pixsiltech.com Small company based in Newport Beach and San Diego System-on-chip hardware core designs Current focus on hand-held applications Future plans for additional applications

PC & DSP Software SolutionsPC & DSP Software Solutions

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 19

Envivio Product HighlightsEnvivio Product HighlightsStated product offerings as of 10/31/03Stated product offerings as of 10/31/03

http://www.envivio.com PC-based 4Coder™ encoder (CIF resolution real-time,

higher resolution offline) PC-based EnvivioTV™ player Hardware encoder (up to SDTV BT.601 resolution real-

time) Hardware MPEG-2 to H.264/AVC transcode Hardware decoder

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 20

Heinrich-Hertz-Institut fuer Heinrich-Hertz-Institut fuer Nachrichtentechnik Berlin GmbH (HHI) Nachrichtentechnik Berlin GmbH (HHI)

Product HighlightsProduct Highlights

http://www.hhi.de P4-based software decode SDTV (BT.601) resolution Real-time by end of 2003 Plan for ARM-based ASIC implementation – architecture

to be finished by end of 2003• One version for mobile applications• Another for set-top boxes

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 21

UB Video Product HighlightsUB Video Product Highlights

http://www.ubvideo.com UBLive-264-BP: "C" Source Code for Baseline Encode/Decode, for

R&D and/or non-C64x-Based applications. UBLive-264-MP: "C" Source Code for Main Encode/Decode, for

R&D and/or non-C64x-Based applications. UBLive-264-BP-C64: C64x- and DM642-optimized implementations

of Baseline H.264 Encode/Decode, designed mainly for low-delay, real-time applications such as video conferencing, 64 kbps - 1.5 Mbps, up to 30 fps, progressive and interlace, up to VGA resolution.

UBLive-264-MP-C64-Decode: C64x- and DM642-optimized implementations of Main profile Decode, designed for some Set-Top and streaming aplications, 1 Mbps - 5 Mbps, up to 30 fps, progressive and interlace, up to SDTV. Expected to support 10 Mbps in the future, likely with some hardware-assist.

Also, pre-processing, post-processing, and error concealment capability

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 22

FastVDO Product HighlightsFastVDO Product Highlights

http://www.fasvdo.com ANSI C++ Implementation for DSP & PC On 2.8 GHz PC, claims

• Encoder: 26 fps CIF Main profile, 40 fps CIF Baseline• Decoder: 180 fps CIF Main, 200 fps CIF Baseline

Target markets for Baseline: cell phone, PDA, videoconferencing

Target markets for Main: broadcast, set-top, DVD

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 23

Moonlight Product HighlightsMoonlight Product Highlights

http://www.moonlight.co.il 45-person company with R&D in Tel Aviv, IL and Tomsk, Russia SDK provider for encoder & decoder software fo

• PC• Equator• Nexperia/Trimedia

Demonstration for cellular market in July, 2003 at ESEC (Embedded Systems Expo & Conference) in Tokyo: QCIF at 25 fps

Demonstration for military surveillance market at Israel’s Military Technologies Show, July 2003

Demonstration at CeBit, March 2003:• “industry first DirectShow encoder”: “VHS quality streams under

300 kb/s, full-frame rate”• real-time SDTV (BT.601) decode

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 24

Mcubeworks Product HighlightsMcubeworks Product Highlights

http://www.mcubeworks.com Providing H.264 solutions for mobile video applications Commercial VOD support with PDA by SKT in Korea (2Q, 2002) Commercial VOD support with cellular phone will be provided by

SKT (4Q, 2003) XEPEG Live : H.264 Real time encoding server for cellular VOD

service by SK Telecom(Korea) XEPEG Broadcaster : H.264 Real time encoding server for DMB

(Digital Multimedia Broadcasting) service(Korea and Japan) XEPEG Embedded : H.264 decoder for wireless VOD

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 25

Vanguard Software SolutionsVanguard Software SolutionsProduct HighlightsProduct Highlights

http://www.vsofts.com Primary target is Intel platform Real-time SD (level 3) encoding capability Plan to port it to different DSP platforms: Texas

Instrument (C64 series), TriMedia (pnx1500 series) and Equator (BSP-15 series) and offer real-time Audio/Video encoding at D1 resolution (ITU-T CCIR-601 or VGA).

Broadcast EncodingBroadcast Encoding

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 27

Modulus Video Product HighlightsModulus Video Product Highlights

www.modulusvideo.com AVE-SD: SD real-time encoding: Prototype now, pilot

production expected 1Q04, full production 2Q04 AVE-HD: HD encoding: Off-line now, real-time under

development AVD decoder: Main profile level 3 (SD) Stream analyzer

Current Licensing SituationCurrent Licensing Situation

(Two distinct licensing authorities forming, final relationship between them is unknown, no obligation on IPR holders to join pools,

comprehensiveness indemnification unlikely, “non-essential” IPR not pooled)

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 29

Via Licensing PoolVia Licensing PoolPreliminary terms announced Oct 15, 2003Preliminary terms announced Oct 15, 2003

http://www.vialicensing.com Ten companies (Apple, Dolby, FastVDO, Fraunhofer-Gesellschaft eV / HHI, IBM, LSI

Logic, Microsoft, Motorola, Polycom, and RealNetworks) announced preliminary licensing terms Oct 15, 2003

$US 15K initial fee (hardship terms for small orgs; waived for small deployments as defined below)

No fees for small deployments (<50k devices & <0.5M$ revenue/yr) No royalties due for activities prior to 2005 “Encoder/Decoder” fees

• 25¢ per device for encoding and/or “permanent” decoding implementations (one price, even if multiple encoders and/or decoders implemented in the device); 0.25¢ for temporary dec

• Enterprise device fee cap: $2.5M for most products; additional $4M for PC SW also installed by OEMs

“Replication” fees• 2.5¢ per 90+ minute title for permanent sale of content• 0.25¢ per (any length) title for temporary/pay-per-view content• Replication fees are not capped

H.264 / MPEG-4 AVC December ‘03 Gary Sullivan – JVT chair 30

MPEG-LA Licensing PoolMPEG-LA Licensing PoolPreliminary terms announced Nov. 17, 2003Preliminary terms announced Nov. 17, 2003

http://www.mpegla.com 17 Companies (Columbia University, ETRI, France Télécom, Fujitsu, LG Electronics,

Matsushita, Mitsubishi, Microsoft, Motorola, Nokia, Philips, Robert Bosch GmbH, Samsung, Sharp, Sony, Toshiba, and Victor Company of Japan (JVC)) announced preliminary terms November 17, 2003.

MPEG-LA is a private company not to be confused with MPEG or MPEG-IF (there is no formal relationship between these three organizations)

No royalties due for activities prior to 2005 “Encoder/Decoder” fees:

• No fees for small deployments (<100k devices)• 20¢ per device for encoding and/or decoding (10¢ above 5M devices/year)• Enterprise device fee caps approx approx $4M for most products; additional

approx $11M for PC SW also installed by OEMs “Participation” fees:

• 2¢ per 12 minute+ title or 2%, whichever lower, for permanent or PPV sale• Subscription service use $0k to $100k depending on number of subscribers• Over-air free broadcast $10k/yr per channel to 100k or more customers• Internet free broadcast no fee (to at least 2010)• Enterprise participation fee caps of approx $4M/yr

Terms stated to be effective through 2010