Nextreaming 이동통신을 위한 표준 기반의 멀티미디어 서비스 구현 기술 2002-9-27 임 일 택 넥스트리밍 주식회사 Nextreaming Corporation.

Nextreaming

이동통신을 위한 표준 기반의 멀티미디어 서비스 구현 기술

2002-9-27

임 일 택

넥스트리밍 주식회사

Nextreaming Corporation

2 Nextreaming

Wireless, Mobile Multimedia?

옵션 대체영상

00:11

Jordan

0:15

옵션 리스트정지 : Rew/FF

옵션 리스트재생

Matrix

: Rew/FF0:02

생일 축하해 ~

생일 축하하구 ~ 사랑해 ~

정지 취소

Streaming

3 Nextreaming

스트리밍 규격 표준화 필요성

무선 단말 능력의 제한• 다양한 서비스에서 동일 코덱을 재사용할 필요

- 스트리밍 , 메시징 , 브로드캐스트 , 화상통신• 단말 개발 비용의 절감

서비스의 고품질화• 경쟁에 의한 품질 개선 촉진• 각 기능 요소별로 전문화된 기업 등장 가능• 관련 부가 응용 기술 및 장비 개발 촉진 • 컨텐츠 생성 , 가공 및 응용이 쉬워짐

국내 관련 분야 산업 활성화• 최고의 시장 환경에서 국제 규격과 호환성 가지는 제품의

경쟁력 확보를 통한 해외진출 가속화 , 국가 경쟁력 제고

4 Nextreaming

Multimedia Streaming Service Flow

Creation Distribution Playback

WirelessNetworkWirelessNetwork

Streaming Server

Contents Creation

File Server

WiredNetworkWired

Network

Streaming Player

Web Server

5 Nextreaming

Architecture of Simple Streaming Client

Video Output

Audio Output

Video Decoder

Audio Decoder

Pack

eti

zer

(Pack

et-

Sw

itch

ed)

Wir

ele

ss C

om

munic

ati

on N

etw

ork

System ControlUser Interface

System ControlInterface

Scope of Video Streaming Service

6 Nextreaming

Technical Elements for Streaming

Session Set-up and Control Media Codecs

• Speech, Audio, Video• Still Images, Vector Graphics, Synthetic Audio, etc.

Transport Protocol• For Realtime Media• For Static Media

Scene Description• Spatial and Temporal Layout of Media Objects

File Formats• Exchange• Storage and Retrieval

7 Nextreaming

Standards for Streaming Services

Standardization Bodies• UMTS (W-CDMA) • cdma2000

Industry Forum• WMF • ISMA

8 Nextreaming

3GPP (3rd Partnership Project)

Evolved from GSM Packet Switched Multimedia Services

• TSG-SA WG4 (CODEC)- Packet Switched Streaming (TS 26.233,

26.234)- Multimedia Codecs for MMS (TS 26.140)- Circuit Switched / Packet Switched Conversational

Services (TS 26.110, TS 26.235, etc.)

Streaming • From 3GPP Spec Release 4• Rel-4 (2001/3) Rel-5 (2002/3) Rel-6 (2003/12?)

9 Nextreaming

3GPP Streaming Terminal

Rel-4• Video, Audio,

Speech, Image, Text • SMIL to integration

various media types

Rel-5• Vector graphics,

synthetic audio added

• Capability exchange specified for personalized services

Graphics Display

Sound Output

Terminal Capabilities

User Interface

3G

PP

L2

Image Decoder

Pa

cke

t b

ase

d n

etw

ork

inte

rfa

ce

Vector Graphics Decoder

Text

Audio Decoder

Speech Decoder

Scene Description

Session Control

Session Establishment

Capability Exchange

Sp

atia

l la

you

t

Video Decoder

Synthetic audio Decoder

Timed text Decoder

Syn

chro

nis

atio

n

10 Nextreaming

3GPP Specification details

Default video codec : H.263 baseline Optional video codec : MPEG-4 SP @ L0, H.263 profile

3 level 10 Default speech codec : AMR Optional audio codec : AAC Low Complexity (LC) Transport : RTP Control : RTSP, SDP Default still image : JPEG Optional still image : GIF Formatted text : xhtml Scene description : SMIL 2.0 basic profile File format : 3GPP (based on MP4 file format)

11 Nextreaming

3GPP2

Evolved from CDMA Working Groups Relevant to Multimedia

Services• TSG-C WG1 SWG2 (Video Services)

Two Service Categories• Multimedia Streaming Services (C.S0027)

- Started from Video Streaming Services - Current draft is highly related to 3GPP works

• Video Conferencing Services - Circuit Switched (C.P9016)- Packet Switched (C.P9008)

12 Nextreaming

3GPP2 Specification details

Default video codec : MPEG-4 SP @ L0 Optional video codec : MPEG-4 SSP @ L0,

H.263 Profile 3&4 @ L 10 Optional speech codec : EVRC, QCELP,

SMV Transport : RTP Control : RTSP, SDP

13 Nextreaming

Wireless Multimedia Forum (WMF)

Overview• Working Period: Mar. 2000 ~ Mar. 2002• Members: more than 60 vendors (device manufacturers, serv

ice providers, solution providers, contents providers, …) Activity

• Technical Specification • Interop Test – Completed in Oct. 2001 (6 months)

Impacts• Influence many other organization’s activity • Became a basement of 3GPP’s initial works• IMTC took over its interop experiences (procedures, manage

ment, and so on)

14 Nextreaming

WMF Spec Details

MPEG-4 SP @ L0 (QCIF, 64 kb/s) Either AMR or EVRC RTP RTSP, SDP

15 Nextreaming

Internet Streaming Media Alliance (ISMA)

Founded in Dec. 2000• Apple, Cisco, Sun, IBM, Phillips, Kasenna

Goals• To accelerate the market adoption of open standards for stre

aming rich media over Internet Protocol (IP). Specification

• Version 1.0 released (available at www.isma.tv) Current works

• Corrigenda to Technical Spec• Digital Right Management• Advanced Contents

16 Nextreaming

ISMA Specification Details

Profile 0• MPEG-4 SP @ L1 (QCIF, 64 kb/s)• High Quality Audio Profile @ L2 (CELP, AAC LC)• RTP, RTSP, SDP

Profile 1• MPEG-4 Advanced Simple Profile(ASP) @ L3b (CIF,

1.5 Mb/s)• High Quality Audio Profile @ L2 (CELP, AAC LC)• RTP, RTSP, SDP

17 Nextreaming

Standards-Related Organizations

Interoperability Tests

Streaming SpecificationStreaming Specification

Certificate

18 Nextreaming

IMTC (International Multimedia Telecommunication Consortium)

Interop Tests • H.323, H.324, SIP, IP Security, etc.• 3GPP Packet-Switched Streaming PSS-AG

PSS-AG• 12 vendors are participating

- Ericsson, Motorola, Nokia, Philips, Siemens, Serome, etc.

• 1st round completed in Mar. 2002 (9 vendors)• 2nd round is ongoing to be completed 4Q 2002

19 Nextreaming

국내 관련 표준화

TTA ( 한국정보통신기술협회 ) 무선인터넷표준화 포럼

• 서비스 분과 산하 - PSM 소분과에서 스트리밍 서비스 규격 담당- MMS 소분과에서 멀티미디어 메시징 서비스 규격 담당

• 이동통신 3 사 , 이동단말업체 , 인코더 및 서버 업체 등을 중심으로 참여

• 스트리밍 서비스 규격 작성• 규격 기반 연동 테스트 ( 현재 계획 중 )• 홈페이지 : www.kwisforum.org

20 Nextreaming

KWISF 스트리밍 서비스 규격

시스템 모델

소요 기술• 저작단 : 미디어코덱 , 파일포맷• 서버 : 전송프로토콜 , 제어프로토콜 , 파일포맷• 무선단말 : 미디어코덱 , 전송프로토콜 , 제어프로토콜 , (

파일포맷 )

서버컨텐츠

무선단말

파일 저장

저작단

21 Nextreaming

KWISF 규격 (1/2)

미디어 코덱• 비디오

- H.263 Profile 0 Level 10(Baseline) ( 필수 )- MPEG-4 SP@L0 ( 권고 )

• 음성 ( 아래 두 가지에서 선택 )- AMR- 3GPP2 음성코덱 (EVRC, SMV, etc.)

• 오디오 - AAC Low Complexity ( 권고 )

22 Nextreaming

KWISF 규격 (2/2)

전송프로토콜• RTP (Realtime Transport Protocol)• 각 코덱별 페이로드는 IETF 의 해당 RFC 를 따름

제어프로토콜• IETF RTSP (RFC 2326)• IETF SDP (RFC 2327)

파일포맷• MP4 파일 포맷을 기반으로 하며 , 3GPP 와 호환성을

가지도록 하였음• 국내 실정에 맞도록 추후 확장이 가능하도록 함 .

23 Nextreaming

Next Generation Streaming Services

Rich Media • SMIL (Synchronized Multimedia Integration Language)

• BIFS (Binary Format for Scenes)

Interaction with User Personalized Services

• Tailored services based on user profile• Automatic contents selection according to

terminal capability• Service differentiation per subscriber’s

gender, age, interests

24 Nextreaming

<smil>

<head>

<layout>

<root-layout width=“176” height=“144” />

<region id=“title” top=“124” left=“17” width=“159” height=“20” />

<region id=“map” top=“3” left=“131” width=“42” height=“42” />

<region id=“movie” top=“0” left=“0” width=“176” height=“144” />

</layout>

</head>

<body>

<par>

<video region=“movie” src=“rtsp://foo.com/movice.mp4” begin=“0s” />

<img region=“map” src=“http://bar.com/map.jpg” begin=“5s” />

<text region=“title” src=“http://bar.com/welcome.txt” begin=“3s” />

</par>

</body>

</smil>

<smil>

<head>

<layout>

<root-layout width=“176” height=“144” />

<region id=“title” top=“124” left=“17” width=“159” height=“20” />

<region id=“map” top=“3” left=“131” width=“42” height=“42” />

<region id=“movie” top=“0” left=“0” width=“176” height=“144” />

</layout>

</head>

<body>

<par>

<video region=“movie” src=“rtsp://foo.com/movice.mp4” begin=“0s” />

<img region=“map” src=“http://bar.com/map.jpg” begin=“5s” />

<text region=“title” src=“http://bar.com/welcome.txt” begin=“3s” />

</par>

</body>

</smil>

Rich Media Example: SMILDefine spatial layout

of the scene

Define temporal layout

and their URLs

“map”area

“title” area

“movie”area

movie

map

title

t

...............

The syntax ofSMIL looks like

HTML

25 Nextreaming

Rich Media Example: BIFS

Caption On/Off Button

(Image with Event Callback)

Synchronized Caption(Realtime text may be pushed dynamically during a s

ession)

Highlight Image

(Shows larger images when

clicked)

26 Nextreaming

Multimedia Codecs for Mobile Terminals

Software codec (i.e., inside modem)• Qualcomm MSM 5000 series : ARM7 core, 20 MHz

128x96 size H.263 decoding : 2 frames/sec• Qalcomm MSM 6000 series : built-in MPEG-4 block

(QCIF size video and AAC LC audio) Hardware codec (i.e., outside modem)

• Emblaze ER4520: ARM9 core + peripherals • Hitachi SH Mobile: SH3 core + DSP + peripherals• Toshiba T3: hardwired logic based, codec• TI OMAP: C5x DSP + peripherals

27 Nextreaming

OS or Middleware for Mobile Terminals

REX, z-REX pSOS Qualcomm Brew Java WIPI Symbian WinCE

28 Nextreaming

부록 : 관련 단체 홈페이지

3GPP, www.3gpp.org 3GPP2, www.3gpp2.org ISMA, www.isma.tv IMTC, www.imtc.org (http://www.imtc.org/act_pss.htm) M4IF, www.m4if.org MPEG, mpeg.telecomitalialab.com IETF, www.ietf.org W3C, www.w3.org (SMIL, http://www.w3.org/AudioVideo/) TTA, www.tta.or.kr KWISF, www.kwisforum.org

Nextreaming

Thank you !Thank you !

Jae-Yong LeeJae-Yong Lee

([email protected])([email protected])

Q&AQ&A