12 장 MPEG 장장장 장장장 Ⅱ - MPEG-4, 7 장 장 장장 12.1 MPEG-4 장 장장 12.2 MPEG-4 장 장장장장 장장장 장장장 12.3 MPEG-4 장 장장 장장 장장장 12.4 MPEG-4 장장 장장 , 장장장장 장 장장 12.5 MPEG-4 Part10/H.264 12.6 MPEG-7 12.7 MPEG-21 2009-2 장장 장장장장장장장장 1
Jan 22, 2016
12 MPEG - MPEG-4, 7 12.1 MPEG-4 12.2 MPEG-4 12.3 MPEG-4 12.4 MPEG-4 , 12.5 MPEG-4 Part10/H.26412.6 MPEG-712.7 MPEG-212009-2*
MPEG-4: . , .
MPEG-4 (object-based coding) :
, , , , .
12.1 MPEG-4 .
MPEG-4 5kbps 10Mbps .2009-2*
12.1: MPEG-4 2009-2*
MPEG-4( 12.2(b)) :
(a) .
(b) (QoS: Quality of Service) .
(c) .2009-2*
12.2: MPEG : (a) MPEG-1 2 ( MPEG-2 ); (b) MPEG-4 2009-2*
MPEG-4 ()MPEG-4 , MPEG-1 MPEG-2 . 12.3: MPEG-4 2009-2*
1. (VS) 2 3, MPEG-4 .2. (VO) ( ) .3. (VOL) ( ) . (VO) (VOLs) , (VOL) .4. (GOV) .( )5. (VOP) .2009-2*
MPEG-1 MPEG-2 VOP . , -(frame-based) .(, - (blocks-based coding) )
12.4(c) - .
12.4(d) VOP , . VOP 2009-2*
12.4: 2009-2*
MPEG-4 VOP :
VOP I-VOP .
VOP P-VOPs , B-VOPs .
VOP : , VOP .
: VOP ( ) .2009-2*
MPEG-4 VOP :
(a)
(b)
(c)
() VOP VOP .
, VOP (MBs) . 1616 88 .
: 2009-2*
MPEG-4 VOP .( 12.5 )
VOP (Interior Macroblocks) .
VOP (Boundary Macroblocks) .
VOP (, DCT) VOP .
: VOP .2009-2*
12.5: VOP 2009-2*
I. VOP , .
, VOP (Exterior Macroblocks) . 12.6: MPEG-4 VOP 2009-2*
. 12.1 :2009-2*
12.7: VOP : (a) VOP , (b) , (c) .2009-2*
, 5
II. C(x+k, y+l) VOP , R(x+i+k, y+j+l) VOP . (SAD) :
N . C(p, q) VOP Map(p, q) = 1, Map(p, q) = 0 . SAD (i, j) MV(u, v) :
p u v .
MPEG-4 :
DCT DCT(SA-DCT)
I-VOP VOP JPEG DCT VLC .
P-VOP B-VOP, . DCT VLC . I. DCT 2009-2*
:
VOP 1616, VOP 88.
6 88 .
:
VOP VOP , VOP DCT .
, VOP .2009-2*
, 5
II. DCT(SA-DCT) DCT(SA-DCT) . , SA-DCT MPEG-4 2 . 1 DCT-N IDCT-N :1 DCT-N:
1 IDCT-N:
SA-DCT 2 DCT 1 DCT-N 2 .
12.8 DCT(SA-DCT) . 2009-2*
12.8: DCT(SA-DCT) 2009-2*
MPEG-4 (binary) (gray scale) .
VOP ( ) .
1() 0() VOP .
0( ) 255() .2009-2*
BABs( : Binary Alpha Blocks): , 1616 .
BABs VOP . .
:
(a) READ(MMR: Modified Modified READ)
(b) - (CAE: Context-based Arithmetic Encoding)2009-2*
MMR (READ: Relative Element Address Designate) .
READ :
a0: ;a1: a0 ;a2: a2 ;b1: a0 ;b2: b1 .2009-2*
READ :
, a0, b1, b2 a1 a2 .
:
1. - , a1 b1 a0 a1 . a1 - b1 - .
2. - , - 1 - . .
3. a0 b1 < b2 < a1 , (codeword) b2 a0 .2009-2*
READ .
, a1 - b1 < 3 , .
, k - k- .
G3 READ (Modified READ) . MMR( READ) k- . 2009-2*
12.9: BAB( ) CAE . (a) -CAE, (b) -CAE.2009-2*
(, 0 1) .
k , 2k .
. CAE BAB 1616 BAB .
-CAE -CAE : . 2009-2*
(gray-scale) (transparency) .
MPEG-4 (gray-scale shape coding) .
, DCT .
VOP . 2009-2*
MPEG-4 .
MPEG-4 :
DPCM . .
.
- .
.2009-2*
(sprite) .
, (sprite panorama) : .
.
, .
12.10 .2009-2*
12.10: . (a) , (b) ( ) (c) * Simon Fraser University Pipe Band 2009-2*
(Global) - ((pan), (tilt), (rotation), (zoom))
GMC(Global Motion Compensation) .
GMC :
(warping) (blending)
LMC( : Local Motion Compensation) GMC 2009-2*
, 5
S I' :
:
2 (2D mesh): 2 ( ):
(node) . (triangular mesh).MPEG-4 2 : (unform mesh) Delaunay 2 . . 2 (MOP: mesh object plane) .2 2009-2*
12.11: 2 (MOP) 2009-2*
I. 2 MPEG-4 3 . 12.12: 4 2009-2*
: D Delaunay 3 , tn = (Pi, Pj, Pk)D tn Pl .
Delaunay :
1. : .
2. : (, ) .
3. Delaunay 3 : Delaunay 3 .2009-2*
, 5
Delaunay 3 . Delaunay . (Pi, Pj, Pk) (Pj, Pk, Pl) , (Pi, Pj, Pk) Pl (Pj, Pk, Pl) Pi , Delaunay . Pl (Pi, Pj, Pk) ( Pi (Pj, Pk, Pl) ), Pi Pl x Delaunay .
, 5
(x0, y0) , . , n 1 ,
dxn, dyn . 12.13: Delaunay : (a) (P0 ~ P7) (P8 ~ P13). (b) Delaunay 3 .
, 5
II. 2 - , 3 - . 2 1 1 .
MOP (Pi, Pj, Pk) , Pi Pj MVi MVj , Predk Pk :
ek :
12.14: 2 MOP 2009-2*
12.15: 2 2009-2*
, MPEG-4 (face objects) (body objects) 3 .
, - , , .
(shaded) -(texture-mapped) MPEG-4 (wireframes) .2009-2*
MPEG-4 VRML . (FAPs: Face Animation Parameters) ( ) ., (FDPs: Face Definition Parameters) . 12.16 FDPs . (FAPs) . 2009-2*
12.16: (FDPs). ((teeth) (tongue) .)2009-2*
MPEG-4 2 (body objects) .
VRML (H-Anim) , .
, .
296 (BAPs: Body Animation Parmeters) . MPEG-4 , .2009-2*
BAPs : , , , , , , , , , 25 , 186 .
.
, (BDPs: Body Definition Parameters) , , .
BAPs FAPs : , .2009-2*
MPEG-4 (Profiles) (Levels) :
(a)
(b)
MPEG-4 , , .
(object type) .2009-2*
12.1: MPEG-4 2009-2*
Simple, Core, Main, Scalable Still Texture . 12.2: MPEG-4 2009-2*
12.3: Simple, Core, Main MPEG-4 2009-2*
H.26L , H.264 ISO/IEC MPEG ITU-T VCEG Joint Video Team (JVT) .
H.264 MPEG-2 3050% , H.263+ MPEG-4 Simple 30% .
: ISO MPEG-4 Part10 ITU-T H.264.
H.264 TV (HDTV: High Definition TV) .2009-2*
VLC :
: -VLC(UVLC) VLC(CAVLC)
(P-):
44 (1616, 168, 816, 88, 84, 48, 44) . . 4 1 .
- (I-):
H.264 H.263+ .2009-2*
- 44 DCT - .
H.264 .
H.264 , IP .
(ASO) (FMO) 2009-2*
.
(ASO, FMO, ) :
B (CABAC)
( X) . , , - .2009-2*
MPEG-7 ( ) .
, ( ) ( ) .
MPEG-7 2001 9 (Multimedia Content Description Interface) . 2009-2*
MPEG-7 . , , 3 , , , , ( ) .
MPEG-7 (textual format) (binary format) .
12.17 MPEG-7 .2009-2*
12.17: MPEG-7 2009-2*
MPEG-7 (D), (DS), (DDL) . :
, D DS .(D) ( ) (DS) D DS (DDL) DS D
MPEG-7 D, DS DDL . MPEG-7 . 2009-2*
, , . :
(Color)
(a) RGB, (b) YCbCr, (c) HSV(, , ), (d) HMMD (HueMaxMinDiff), (e) RGB 33 3 , (f)
(a) , (b) , (c)
/ (GoF/GoP) 2009-2*
(Texture)
(Shape)
3 2009-2*
(Motion)
( 12.18 )
(Localization)
(Others)
2009-2*
12.18: : , , , , , 2009-2*
(Basic Elements)
(Content Management)
(Content Description)
2009-2*
, DS . : DS, DS, DS, DS, DS. DS . (Navigation and Access) (Content Organization) (User Interaction) 2009-2*
12.19: MPEG-7 2009-2*
12.20: 2009-2*
MPEG-7 (DDL: Description Definition Language) WWW (W3C) XML . XML :
, , MimeType, CountryCode, RegionCode, CurrencyCode, and CharacterSetCode D DS (IPMP: Intellectual Property Management and Protection) 2009-2*
, MPEG-21: 2000 6 2003 .
MPEG-21 .
MPEG-21 7 :
.
, .2009-2*
(, , , ) .
(IPMP) .
(QoS) .
MPEG-21 , .
( ) . 2009-2*