Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.
Post on 25-Dec-2015
216 Views
Preview:
Transcript
Paul Greenfield, CEO
High Definition
Video Transcoding
for Consumer Markets
CONFIDENTIAL
2©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
Product Roadmap
Linedancer 1130nm NXP
Production
ASProCoreV6
• High Performance Extreme Processor
• PC-based Professional Image Processing
Linedancer HD130nm NXP/UMC
Sampling
ASProCoreV7
• High Performance Extreme Processor
• Embedded Professional Image Processing
"Q"Mobile
• Low cost/power ASSP
• High quality 720p encode/decode
• Camera/phone market
• General Purpose architecture forhigh performanceimageprocessing
Accelera2xxx/3xxx
• PCI-X / PCIe Plug-In-Card
• Realtime / Offline HD Video Compression
• Studio Quality H.264 / VC-1* / MPEG-2
Production
Accelera5xxx
• PCIe Plug-In-Card
• Realtime HD Video Compression
• Studio Quality H.264 / VC-1* / MPEG-2
Sampling
IP license• Customer ASICs
ProfessionalMarkets
* porting subject to customer demand
ASProCoreV8
• New Architecture optimisedfor advanced videoencoding/decoding
“Q” Transcoder65nm Toshiba
3©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
"Q" Transcoder
Realtime HD encoding (1920x1080p30/i60) 4x SD encoding (720x480i30 / 576i25) H.264/AVC: Baseline/Main/High Profiles VC-1/WM9: Simple/Main/Advanced Profiles MPEG-2: Main/High Profiles All resolutions up to 1920x1080i60
Optional Video Decode Engine for transcoding Audio encoding/transcoding for all
major standards (AAC, HE-AAC, AC-3, WMA) Customer-programmable stream processor for
application-specific mux/output formats & DRM
System StreamProcessor (RISC)
MUX, DRM, Output, System Control
Customer programmable, standard RTOS
10/100/1G MAC
USB 2.0
Memory Card
PCI Express
Audio DSP
System DRAM
Flash
Video Preprocessor Scaling, Color Space Conversion,
De-interlacing, Noise reduction,Watermarking, Logo insertion
HD Compression Engine
Motion Estimation
Intra Mode Prediction
MacroblockEngine:
TransformQuantize
RDO
EntropyCoding
&Stream
Generation
Rate Control
VideoDRAM
Unc
ompr
esse
d A
/V in
Com
pres
sed
A/V
out
put
VideoDecodeEngine
Secure OTP
AES / 3DES
GPIO / TSDVI / HDMI
8/10 bit ITU-656RGB/YUV
1 x HD / 4 x SD
I2S Audio x 4
HDCP Keystore
4©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
Scalable to meet any price / performance point
System Control CPU(ARM, MIPS, DSP, etc)
Macroblock Processing
Unit
MacroblockProcessing
Unit
MacroblockProcessing
Unit
SADAccelerator
SADAccelerator
EntropyCoding
Accelerator
MacroblockProcessing
Unit
SIMD Instruction bus
ControlUnit
AMBA AHB Interface
Scalable number of Macroblock SIMD PUs (Decides performance)
Scalable number of SAD Motion Estimation
accelerators(Decides Quality)
ApplicationVideosize
Profile & Level
CTRL ECA SADMB PUs
Engine size (65nm/500MHz)
Power(65 nm)
HD H.264 compression1920 x 1080i60
High Profile, Level 4.1 1 1 2 16 ~4.1 mm2 ~300 mW
Wireless HDMI1920 x 1080
p60 4:4:4
High 4:4:4 Intra Profile 1 1 0 11 ~1.5 mm2 ~200 mW
Mobile HD cellphone 1280 x 720p30
Baseline profile 1 1 1 5 ~2.2 mm2 ~150 mW
SD H.264 compression 720 x 480i60
Main Profile Level 3 1 1 1 5 ~2.2 mm2 ~150 mW
5©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
Market for HD Video Encoding Devices (IN-STAT 2007)
(In Thousands of Units) 2005 2006 2007 2008 2009 2010 201107-11 CAGR
ASTB/Home Gateway/PVRs 3,651 7,746 8,616 11,041 13,354 16,410 18,380 21%
Blu-Ray / HD-DVD recorders 20 30 200 530 1,120 2,305 3,810 109%
IPTV adapters 382 470 740 1,200 1,800 2,675 4,132 54%
In-Home Video Networking 4,170 7,345 12,982 21,101 32,607 52,415 85,671 60%
Wireless HDMI 0 0 0 1,971 2,556 3,258 7,122 N/A
Remote streaming appliances 225 500 760 1,000 1,200 2,000 41%
BIu-Ray / HD-DVD burners 116 585 2,808 3,503 4,708 11,883 112%
SD/HD Camcorders 13,600 14,400 14,900 15,100 15,300 15,200 15,407 1%
IPTV infrastructure 6,107 10,385 12,157 16,477 18,479 20,914 25,884 21%
Mobile TV infrastructure 265 366 494 645 835 1,079 1,414 30%
Broadcast & Digital Cinema 24,007 27,196 32,345 28,138 30,461 36,278 38,988 5%
Phone Cameras 387,500 531,000 644,000 765,000 830,000 868,000 981,468 11%
Web cameras 14,700 15,400 16,000 16,600 17,200 17,800 18,456 4%
PC TV Tuners 1,135 2,311 3,677 6,714 12,015 15,725 17,885 58%
TOTAL UNITS 455,537 616,989 747,195 888,084 980,289 1,057,968 1,232,499 32%
Also validated by independent strategy consultant - Dr Handel Jones (Excludes PC Market)
6©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
Competitive Advantages
Higher performance & quality - based on Studio Quality Algorithms 2 channels of 1080i encode / 1080p60 encode / 10-bit / 4:2:2 support
“Anything in, anything out” transcoding Flexible software-programmable engines Multi-codec decode + encode
Advanced Security Features Emerging as a strong customer care-about “Q” has comprehensive encryption/transcryption features
e.g. encrypting data when passed to external memory
Secure on-chip memory for keys & boot images
Flexible front-end video preprocessor Advanced noise reduction, scaling & deinterlacing
Highly Scaleable - no software rewrites required - easy to create variants “HD Encoder” – Camcorders, Blu-Ray recorders / “SD Encoder” – Slingbox-type applications
“Mobile” – High end (720p) cameraphone / “Lite” – Low end (VGA) cameraphone
“Wireless HDMI” – Low latency for UWB, etc
Additional Material
Use Cases
IP Overview
Software Development Environment
12©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
Wireless HDMI solution (H.264 option)
HDMI 1.2
Q-basedencoder
Wireless USBTX
Wireless USBRX
TV/STBDecoder
HDMI 1.2
USB 2.0 OTG
USB 2.0 OTG
Rate control
Link quality feedback
802.11nor UWB
Low latency I-frame only encode H.264 (can use standard/modified TV decoder)
50-200 Mbps compression Dynamic rate control adapts to wireless link quality
Quantization, 4:4:4/4:2:2/4:2:0, 8/10/12 bpp, block sizes, etc Can also drop down to long-GOP at 5-10 Mbps
Using standard TV/STB Decoder Multi-room coverage with the same solution
1920x1080i6024/30/36 bppRGB / YCrCb1.5 – 3.0 Gbps
480 Mbps PHY50-200 MbpsAES encryptedstream
HDMI 1.2
Q-basedDecoder
13©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
Integrated TV “Pause Button”
Store video from broadcast, HDMI or analogue sources Encode and/or transcode and/or downscale video
Integrated solid state NAND flash storage Longer lifetime & higher reliability than Hard Disk 8GB Flash gives ~4 hrs (HD), ~20 hrs (SD)
Support external SD/MMC or USB key for placeshifting & sideloading Transcode to portable devices, e.g. iPod, Zune, Mobile phone Add Digital Rights Management to protect content
AspexQ-basedEncoder/
Transcoder
Video RAM32Mx16
DDR2-667
Serial Boot / ID
Flash
NAND FlashStorage
USB 2.0USB socket
for RemovableFlash Drive
Cable/Satellite/Terrestrial
Tuner inputs
HDMI inputs
TV Decoder
SoCTransport Stream
Plasma/LCDPanel
HDMI or Digital YUVSD/MMC
SD or MMCsocket for
memory card
14©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
Networked digital TV
Add home networking chipset Wireless, Ethernet, Powerline, MOCA, HomePNA, etc
Use DLNA to publish content to networked devices Industry standard for media servers
Secure reformatting for placeshifting, sideloading & internet streaming Streaming to second TV, PC, portable device, or internet (“Slingbox”) Reduce bitrate and/or resolution to meet bandwidth or device constraints Transcode to other codecs (e.g. Windows Media) for client devices Add Digital Rights Management (e.g. Microsoft DRM) to control content
AspexQ-basedEncoder/
Transcoder
Video RAM32Mx16
DDR2-667
Serial Boot / ID
Flash
HomeNetworking
Chipset
Cable/Satellite/Terrestrial
Tuner inputs
HDMI inputs
TV Decoder
SoCTransport Stream
Plasma/LCDPanel
HDMI or Digital YUV
Home NetworkWiFi, Powerline,
Ethernet, MoCa, etc
Home NetworkWiFi, Powerline,
Ethernet, MoCa, etc
PCSecond
TVPortableDevice
Broadband Modem Internet
InternetLaptop
or MobileDevice
15©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
Blu-Ray recorder / DVR
Record from SD or HD analogue sources Full 1920x1080 resolution in H.264, VC-1 or MPEG-2 Choice of bitrates and resolutions for control of recording time
Transcode broadcast streams Ensure compatibility with Blu-Ray/HD-DVD codec constraints Reduce bitrate to extend recording time
Transcoding from AVCHD/HDV Camcorder inputs “Long play” recording
AspexQ-basedEncoder/
Transcoder
Video RAM32Mx16
DDR2-667
Serial Boot / ID
Flash
Transport Stream
Blu-Ray/HD-DVDrecordable drive
Hard DiskDrive
HDMI
Component in Digital Y Cr CbVideo ADC
Tuner / DemodCable/Sat/Terr in
Audio ADC I2S
Transport Stream
Stereo audio in
HDMI
Blu-RayDecoder
SoC
16©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
AspexQ-basedEncoder/
Transcoder
PCI Express plug-in card
Video RAM32Mx16
DDR2-667
HDMI
Component in
PCI Express x1
Serial Boot / ID
Flash
Digital Y Cr CbVideo ADC
Tuner / Demod
Cablecard/DVB-CIsocket (optional)
PSU &Power
sequencer
ATSC/Cable/Sat in
1 Lane PCI Express (desktop) or ExpressCard (laptop) form factors H.264 SD or HD encode from component or HDMI inputs
Any resolution & bitrate from 1..20 Mbps, Baseline (Quicktime) or Main / High Profile
Transcode from off-air MPEG-2 HD to H.264 (HD or SD) Free-to-air or using Cablecard/DVB-CI Conditional Access smartcard Can transcode multiple SD streams
“Slingbox” functionality – variable resolution & bandwidth VC-1 / H.264 Transcode/sling content from PC (or PC-connected peripheral)
Webcam videoconferencing Accelerated HD-DVD / Blu-Ray burning
Audio ADC I2S
Transport Stream
Stereo audio in
PCIe slot (desktop)or
ExpressCard slot (laptop)
PCI 32/33
17©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
USB / Wireless TV capture
Video RAM32Mx16
DDR2-667
HDMI
Component in
USB 2.0 OTG (Host or Device)
Serial Flash
(Program)
Digital Y Cr CbVideo ADC
Tuner / Demod
PCI 32/33Cablecard/DVB-CIsocket (optional)
AspexQ-basedEncoder/
Transcoder
PSU &Power
sequencer
ATSC/Cable/Sat in
Standalone USB Dongle or Wireless Media Ingest engine USB 2.0 interface configurable as host or device
H.264 SD or HD encode from component or HDMI inputs Any resolution & bitrate from 1..20 Mbps, Baseline (Quicktime) or Main / High Profile
Transcode from off-air MPEG-2 HD to H.264 (HD or SD) Free-to-air or using Cablecard/DVB-CI Conditional Access smartcard Can transcode multiple SD streams
“Slingbox” functionality – variable resolution & bandwidth VC-1 / H.264
Audio ADC I2S
Transport Stream
Stereo audio in
PCUSB port
(Wired Option)
802.11n WiFiUSB chipset
(Wireless Option)
18©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
Webcam / Videoconferencing app
Video RAM32Mx16
DDR2-667
USB 2.0 OTG (Host or Device)
Serial Flash
(Program)
Digital Y Cr Cb
CMOS orCCD
CameraModule Aspex
Q-basedEncoder/
Transcoder
PSU &Power
sequencer
Digital Y Cr Cb (or RGB) input from image sensor 8/10/16/20 bit input, up to 165 MHz pixel clock
H.264 (Quicktime) or VC-1 (Windows Media) encoding at up to 1080i60 Other video formats (Flash, MJPEG, MPEG-4) could be added as software upgrades
USB Video Class support Bulk or Isochronous Stream-based (MPEG-2 TS) Frame-based (MJPEG etc)
Audio ADC I2S
PCUSB port
(Wired Option)Microphone
19©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
Aspex Compression Engine
Software programmable architecture Exploits Aspex’s expertise in multi-standard video encoding Based on 8th generation Aspex ASProCore Supports concurrent multiple steams and standards
Configurable for any price or quality point Optimized for low system power
AspexCompression
Engine
UncompressedVideo
ElementaryStream
SystemBus
20©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
SADAccel
ECAccel
MBPU
Ctrlunit
Processing Units
Control Unit: VLIW program controller and scalar processor, e.g. DSP, ARM.
Macro Block PU: SIMD parallel co-processor for data processing. Designed to minimise power and memory bandwidth.Performs all macro block processing including motion search.
(Optional) Sum of Absolute Difference Accelerator: Hardware accelerator with flexible fully programmable search strategy.
(Optional) Entropy Coding Accelerator: Hardware accelerator. Supports multiple standards including CABAC, CAVLC, etc.
21©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
Aspex Compression Engine
Scalable to meet any price / performance point
System Control CPU(ARM, MIPS, DSP, etc)
MacroblockProcessingU
nit
MacroblockProcessing
Unit
MacroblockProcessing
Unit
SADAccelerator
SADAccelerator
EntropyCoding
Accelerator
MacroblockProcessing
Unit
SIMD Instruction bus
On-chip video memory
Off-chip video memory
DMADMADMADMA
ControlUnit
AMBA AHB Interface
Arbiter
Scalable number of SIMD Macroblock PUs (Decides performance)
Scalable number of SAD
Motion Estimation accelerators
(Decides Quality)
Scalable amountof on-chip memory
(Performance & Power)Scalable amount
of off-chip memory(Quality & Power)
Scalable number ofinstances for
multi-stream support
22©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL
Software Development
Software tools Comprehensive suite of GNU based cross development tools
Compiler, assembler, linker, loader, libraries Supported under Linux and Windows
Derived from previous ASProCore programming tools and libraries Proven on seven ASProCore versions over 10 years
Programming Majority of customers
Use the Aspex encoder libraries and program in C/C++ via the library API Some customers wishing to differentiate themselves
Directly programming the PUs in an extended version of C/C++ New statement to declare data parallel variables and perform data parallel
operations
Programming model Conventional SISD processor with co-processors Simple to understand, program and debug
All control on the SISD processor
top related