1 SET2005 Trend of Digital Broadcasting in Japan and Research and Development in NHK STRL Masayuki TAKADA NHK Science and Technical Research Laboratories Sep. 21, 2005
1
SET2005
Trend of Digital Broadcasting in Japan and Research and Development in NHK STRL
Masayuki TAKADA
NHK Science and Technical Research Laboratories
Sep. 21, 2005
SET2005
2
Contents
1. Introduction of NHK STRL2. Digital broadcasting in Japan
- ISDB family : Satellite, Terrestrial, Cable Broadcasting
3. New services for digital broadcasting- Digital terrestrial broadcasting for handheld receivers- Broadcasting based on Home Servers
4. NHK STRL Vision "NEXT"5. Typical research and development in NHK STRL
- View, Know, Use
6. Other technologies from the Open House 2005- Productions, Transmissions, Presentations, Devices
7. Summary
3
SET2005
1. Introduction of NHK STRL
Leading organization for future broadcasting world
SET2005
4
NHK STRL
NHK (Japan Broadcasting Cooperation)Established in 1925
Non-profit public broadcasting organization
2 AM radio, 1 FM radio, 2 terrestrial TV, 3 satellite TV
NHK STRL (Science & Technical Research Labs.)Established in 1930
(5 years later science radio broadcasting started)
Research department of NHK
Major research themesAdvanced television systems, Wireless systems, Advanced broadcasting devices, Program production and future broadcasting related systems and devices.
SET2005
5
3rd generation research complex
Opened in April 200214 stories high(office tower)6 stories high (experiment building)
STRL areaB2 – 5th floors
STRL employees (’05,March)282 personnel(260 research engineers)
Researches based on “Middle and long term research vision(MLRV) of STRL” are conducted
SET2005
6
Organization of STRL (9 research labs.)Wireless systems
Terrestrial/satellite digital broadcasting, wireless LANNetworked broadcasting systems
Networked program production broadcasting systems and servicesAdvanced television systems
Ultra high definition video (super hi-vision), 3D visual systems Acoustics and audio signal processing
High definition audio systems, acoustic signal analysis and codingVisual information technologies
Video compression and image expressionIntelligent information processing
Metadata production and applications, image recognition, media processingHuman science
Services for visual or hearing impaired, software agents, speech processingAdvanced broadcasting devices
Ultrahigh-sensitivity imaging devices, ultrahigh-density recordingMaterials science
Materials for displays and recording devices
7
SET2005
2. Digital broadcasting in Japan
SET2005
8
Broadcasting systems in the digital era
ISDB (Integrated Services Digital Broadcasting)
SET2005
9
ISDB family
MPEG-2 TS
Satellite
Cable
Terrestrial
Package, communication, andother media (DVB and ATSC)
Multiplexing
Video
Audio
Data
Coding
Coding
Coding
MPEG-2Error correction
RS(204,188)
Error correctionRS(204,188)
Error correctionRS(204,188)+Conv. code
ModulationTC-8PSK
Modulation64QAM
ModulationSegmented OFDM
SET2005
10
Transmission parameters for ISDB family
System ISDB-S ISDB-C ISDB-T
Video coding MPEG-2 Video (ISO/IEC 13818-2)
Audio coding MPEG-2 AAC (ISO/IEC 13818-7)
Multiplex MPEG-2 Systems (ISO/IEC 13818-1)
Conditional access Multi 2
Outer (204,188) Reed-Solomon codeError correction Inner 2/3Trellis Code /
Conv.code(1/2-7/8) - Conv.code(1/2-7/8)
Modulation TC-8PSK,QPSK, BPSK 64QAM
Segmented OFDM(DQPSK,QPSK,16QAM,64QAM)
Information bit rate 52.17 Mbit/s (Max) 28.6 Mbit/s 3.7 – 23.2 Mbit/s
Data broadcasting BML (XHTML), ECMAScript
Channel bandwidth 34.5 MHz (12GHz) 6 MHz (Cable) 6 MHz (VHF/UHF)
SET2005
11
Digital broadcasting services in Japan
High picture quality / sound quality HDTV and 5.1 surround stereo system
Multi-programs broadcasting
High performanceElectronic Program Guide (EPG)Data broadcasting (program related data services, interactive data services)
Digital terrestrial TV broadcastingAlong with digital satellite broadcasting services,
Services for mobile reception terminals (1 segment broadcasts)Regional broadcastsNHK Data Online
New service using the Internet connection of digital broadcasting receivers
SET2005
12
Schedule of digitalization of broadcasting media in Japan
Conventional Analog TV
Digital Terrestrial TV
BS Digital TV
BS Analog TV
BS Analog HDTV
Terr
estr
ial T
VSa
telli
te T
V
2000 2003 2006 2011
Launched on Dec.1, 2003
Started on Dec.1, 2000
Closing by 2007
Digital Terrestrial Audio
Tokyo, Nagoya, Osaka Metro Area
Other major capital cities(by Year 2006)
Switch-over in July 24, 2011
Reaching all of Japan
Experimental Broadcasts started in Oct. 2003 in Tokyo, Osaka Metro Area
CATV (re-transmission)
Closing by 2011
BS Digital Digital Terrestrial
Fully digital
(expected)
(expected)
13
SET2005
3. New services for digital broadcasting
SET2005
14
New services are coming !
Conventional Analog TV
Digital Terrestrial TV
BS Digital TV
BS Analog TV
BS Analog HDTV
Terr
estr
ial T
VSa
telli
te T
V
2000 2003 2006 2011
Launched on Dec.1, 2003
Started on Dec.1, 2000
Closing by 2007
Digital Terrestrial Audio
Tokyo, Nagoya, Osaka Metro Area
Other major capital cities(by Year 2006)
Switch over in July 24, 2011
Reaching all of Japan
Experimental Broadcasts started in Oct. 2003 in Tokyo, Osaka Metro Area
CATV (re-transmission)
Closing by 2011
BS Digital Digital Terrestrial
Fully digital
(expected)
(expected)
Service for handheld terminals
Broadcasting based on home server
15
SET2005
Digital terrestrial broadcastingfor handheld receivers
SET2005
16
Segmented OFDM and services in ISDB-T
ExampleCase 1
Case 2
6-MHz TV channel (13 segments)
1segment service
Data Broadcasting
Data Broadcasting Data Broadcasting Data Broadcasting
SDTV
HDTV
SDTV SDTV
Video:14 Mbps
Video:
4.3 MbpsVideo:
4.3 MbpsVideo:
4.3 Mbps
Transmission Data Rate: 310 kbpsModulation: QPSK (1/2)- Low Bit Rate Video: AVC/H.264- Data Broadcasting
SET2005
17
Handheld terminals for ISDB-T (prototypes)
Service will start
in next spring
SET2005
18
Handheld terminals
Get information related to a program with low-bit-rate video from data broadcasting or Internet
Information from broadcasting and communication channel
Low-bit-rate video from broadcasting channel
Video:AVC/H.264 (about 128 kbps)Audio: AAC-SBR (about 48 kbps)Data BroadcastingClosed captionWake up function in case of emergency
SET2005
19
Linkage from broadcasting to communication
To receive and view
broadcasting program
with mobile terminal
To receive data broadcasting on the air
(due to low bit rate, content is limited.)
-TV program is on the air-Data is received via
the Internet (without limit of bandwidth)
Broadcasting program view Handheld data onlineData broadcasting view
BML
NHK
Service model of 1-segment service for handheld communication terminals
Various types of services can be realized using functionalities combining 1-segment service reception and mobile communication
Full screen display of internet
content (TV program does
not appear on the screen)
Link to web sitesNHK
BMLー町のお知らせーくらし便利帳ー町営バス時刻表ー図書館だよりー観光案内ー防災情報
お問い合わせ植田町広報課
ようこそ植田町へ
SET2005
20
Network-Linked Service for handheld reception(1)
Get the information related to a program with low-bit-rate video from data broadcasting
Choose summary from the display
Data broadcasting provides summary of the program.
Low-bit-rate video from broadcasting channel
SET2005
21
Network-Linked Service for handheld reception(2)
Rich information will be available through Internet
Choose “On-Line”from the display Connect to Internet Select “Cast” Display the profile
of the cast
SET2005
22
Waking up a handheld receiver with an emergency warning
Emergency warning broadcast
Low power consumption
Stand-by mode
Low power consumption
Stand-by mode
Tsunamiwarning issued
Active mode to receive emergency
warning broadcast
Active mode to receive emergency
warning broadcast
Receive only Emergency Warning Signal (EWS)
Receive only Emergency Warning Signal (EWS)
Wake up handheld receiverWake up handheld receiver
Power Consumption: under 3nW (desired)The system does not employ FFT, but instead stays on stand-by for the EMS frequency component.
Explanation
TMCC Signal
SET2005
23
Improved AVC/H .264 video encoder
Conventional image using AVC/H.264 scheme
Image processed with picture quality enhancement technology
Explanation
SET2005
24
Transmission test for handheld reception
Tokyo Tower
10km
・7 directions (spokewise)・1,3,5,10,15,20,25,30 km
Receiving Antenna
1.5 m
Receiving scenery
Receiving antenna height : 1.5mReceiving antenna : Cross dipole antenna
Measurement sites
SET2005
25
Distribution of measured field strength
30
40
50
60
70
80
90
1 10 100
Distance from the transmitter (km)
Rec
eivi
ng f
ield
str
engt
h (d
BuV/
m)
Eo : ideal (free space)
Average : 29dB0
10
20
30
40
501 10 100
Distance from the transmitter (km)At
tenu
atio
n fr
om E
o(d
B)
Average attenuation from Eo (free space electric field strength) = 29dB
26
SET2005
Broadcasting based on Home Servers
SET2005
27
Broadcasting based on home servers
Home Server: large-capacity storage unit for TV programs Enables anytime viewing by using metadata
Program+ Metadata
Service will start
around 2007
High-function EPG
Favorite program
Related informationHighlight viewing
Home serverInternet
Stored programs and information collected over several months
SET2005
28
Service example for broadcasting based on home servers and Internet
Internet
Municipality,School
Home server
Broadcastingstation server
Broadcasting
Digest viewing/Interactive viewing
Digest teaching materialContinuing education
Digest viewing of “desired” scenes
NHK text based on home serversused in school classroom
Spoken command“I want to select program
that I missed”
Network-linkedbroadcastingservices
Broadband linkageCellular phone linkage
Diverse services that meet individual needs
Explanation
29
SET2005
4. NHK STRL Vision "NEXT"
SET2005
30
NHK STRL Vision “NEXT”
View
Know Use
To utilize information media for a broad range of daily activities
and in times of emergency
To enable sender and viewers to share
information and emotions
To view a faraway scene as if it were nearby in real time
To
To To
“Human-oriented” system
SET2005
31
R&D Framework
Broadcasting technology that learns from human possibilities
Advanced content production and agile news-reporting systems
Ubiquitous and universal services
System technology
Audio-video technology conveying a heightened
sensation of reality
Content production technology that incorporates the knowledge
of production experts
Network technology; Security technology
Highly functional wireless
transmission technology
Flexible system construction technology
Human science Fundamental device technology
Image/speech recognition,language processing
Analysis and application for knowledge and
sensibility
Psychology; Physiology
Ultrahigh-resolution video devices,
Ultra large-capacity recording devices
Devices with new functions Nanophotonics
materials
<Approaches>
Ultimate broadcasting system conveying a strong sensation of reality
View Know UseTo To To
Explanation
<
32
SET2005
5. Typical research and developmentin NHK STRL
SET2005
33
Typical research and development
ViewSuper Hi-VisionIntegral 3-D televisionElectro-holography
KnowMetadata production systemAdvanced program production system using wired and wireless IP networksAdvanced imaging devicesUltrahigh-speed high-sensitivity cameraUltrahigh-sensitivity HDTV new-super-HARP handheld camera
UseFlexible displaysTV agent system
34
SET2005
Research on Ultimate System with Heightened Sensation of RealityView
To
SET2005
35
EffectsStrong sensation of reality (as if you are there)More exciting live TV programs
Our objectivesExamine physical and psychological effectsEnhance the reality sensation for future TV systems
Future TV System with Greater Sensation of Reality
Super Hi-Vision(Ultra-high-definition, Wide-screen System with 4000 Scanning Lines)
4320 Lines(1080 x4)
7680 pixels(1920x4) Explanation
SET2005
36
Integral 3-D televisionNatural and realistic autostereoscopic images can be viewed from any viewpoint.
Requires no special viewing glassesDifferent aspects of the object can be seen depending on the viewing position3-D effects viewable at any viewing angle
Viewing a little higher
Viewing a little lowerVertical parallaxSuper-high-definition camera
(2000 scanning line equivalent)
Lens array for imaging with160(H) x 118(V) small lenses
Imaging system
STRL’s prototype can shoot and display 3-D images in real-time.
Explanation
SET2005
37
Electro-holography
Technology to record and reproduce optical information with the use of optical interference ---> reproduce ideal autostereoscopic imagesApplied to a three-dimensional television systemMany issues to be overcome ---> low quality and narrow viewing zone
Explanation
38
SET2005
Research on Advanced Content Production and Mobile News-reporting SystemsKnow
To
SET2005
39
Metadata production systemProgram script and shooting plan can be used for metadata production for drama and documentary program.Metadata can be efficiently produced for sports programs by combining image recognition, speech recognition, natural language processing, etc.
Services for mobile receivers
Data broadcasting
Archives
Live program production
Video data Audio data
Textual data
Cheers
Metadata production system
Image recognition
Speech recognition
Natural language
processing
Service based on home servers
Metadata;10 minutes 30 secondsA shot on goalby Nakata
Internet
Nakata shoots!Wow!
Explanation
SET2005
40
Advanced program production system using wired and wireless IP networks
Program production system using broadcasting equipment and contents not only within a broadcasting station but also other stations or archive facilities via broadband networks.
Explanation
SET2005
41
Advanced imaging devices
Compact ultrahigh-sensitivity camera capable of vivid nighttime shots
Imaging device using organic films for a palm-size camera system
Explanation
SET2005
42
Ultrahigh-speed high-sensitivity camera
Captures clear images of phenomena too quick for the naked eye under ordinary lighting conditionsShoots at 1 million frames per second (high sensitivity)
Picture exampleBaseball Golf Soap Bubble Balloon
SET2005
43
Ultrahigh-sensitivity HDTV new-super-HARP handheld camera
For emergency night time reportingClear HDTV picture under moonlit conditions200x the sensitivity of a CCD camera, 50,000x for still pictures
HDTV new-super HARP handheld camera
Picture captured by HARP camera
Picture captured by conventional CCD camera (Gain: +42 dB)
Explanation
44
SET2005
Research on Ubiquitous and Universal ServicesUse
To
SET2005
45
Flexible displays
Flexible liquid crystal display
Flexible Organic Electroluminescence Display
Organic TFT-driven Liquid Crystal Display (5x5
elements)
Flexible organic electroluminescence (EL) display
Flexible Liquid Crystal Display(A4 size)
Explanation
SET2005
46
TV agent system
Let’s anyone easily operate digital broadcasting receiversNew Q&A function with a spoken dialogue TV operation capability.
ExplanationTV Agent responding to a viewer’s question
47
SET2005
6. Other technologies from the Open House 2005
SET2005
48
Other technologies
Program productions1080/60p HDTV systemBone conduction intercom headsets for broadcaster
Transmission technologiesMillimeter-wave mobile cameraLuneberg lens antenna system for HDTV transmission
PresentationsField emission displayTactile presentation system for visually impaired persons
FundamentalsDigital holographic memorySpintronics
49
SET2005
Program productionsTo
SET2005
50
1080/60p HDTV system
For improving the quality of HDTV imageProgressive-scanning HDTV camera system
Explanation
SET2005
51
Bone conduction intercom headsetsfor broadcaster
To overcome difficulty for hearing sounds under some situation, a bone conductive intercom was developed.Bone conduction uses a mechanism whereby the human body's bones transmit sound by their vibration.
52
SET2005
Transmission technologiesTo
SET2005
53
Millimeter-wave mobile camera
Wireless HDTV camera system using MIMO-OFDM transmission
Wireless camera system free up camerawork
Explanation
SET2005
54
Luneberg lens antenna system for HDTV transmission
Luneberg lens antenna instead of parabolic antenna for satellite communications
Small, lightweight antennaPrompt stellite transmission
55
SET2005
PresentationsTo
SET2005
56
Tactile presentation systemfor visually impaired persons
High-resolution tactile display for graphical information
Tactile navigator enables a user to navigate a GUI’s screen or table through touch
Explanation
SET2005
57
Field emission display
For Super Hi-Vision programs to be viewed in the homes of the futureThin field emission displays with high luminous efficiencyCompact flat display with high picture quality and low power consumption
Explanation
58
SET2005
FundamentalsTo
SET2005
59
Digital holographic memory
Holographic recording using optical interference as an advanced recording technology
Explanation
SET2005
60
Spintronics
Key technology for a future recording device. The spin-injection magnetization reversal technology is capable of performing pinpoint recording onto a small magnetic dot, without magnetic field spread. This technology enables high-density recording at lower current, which means less power consumption.
61
SET2005
7. Summary
SET2005
62
Summary
R&D based on NHK STRL vision “NEXT”“NEXT”: NHK EX Technology (Express, Excel and Expand)Broadcasting technology that learns from human possibilities
for ultimate broadcasting systemsfor advanced program production and news-reporting systemsfor ubiquitous and universal services
Broadcasting will play an important role in the creation of culture and in the lives of people.Collaboration with organizations in the world
63
SET2005
Thank you for your attention!