Professional Documents
Culture Documents
LI GII THIU...................................................................................................................................................6
CC THUT NG TING ANH..........................................................................................................................8
LI M U........................................................................................................................................................10
CHNG I.
C S V NN TN HIU VIDEO.............................................................................11
I.1
S CN THIT CA NN TN HIU..............................................................................................11
I.2
QU TRNH S HA TN HIU......................................................................................................12
I.2.1
I.2.2
I.2.3
LY MU.............................................................................................................................12
LNG T HA.................................................................................................................12
M HA...............................................................................................................................13
TC BIT V THNG LNG KNH TRUYN TN HIU S.............................................14
I.3.1
I.3.2
I.4
TC BT.........................................................................................................................14
THNG LNG KNH TRUYN.....................................................................................14
QU TRNH BIN I TN HIU MU.........................................................................................14
I.5
I.6
I.3
I.6.1
NN TN HIU VIDEO.......................................................................................................17
I.6.2
LNG TIN TRUNG BNH (ENTROPY)..........................................................................18
CHNG II.
CC K THUT NN VIDEO...................................................................................21
II.1
PHN LOI CC K THUT NN.................................................................................................21
II.2
II.2.1
IU XUNG M VI SAI DPCM.........................................................................................22
II.2.2
M HA BIN I.............................................................................................................22
II.2.2.1
Bin i cosin ri rc DCT.................................................................................................22
II.2.2.2
Bin i Hadamard..............................................................................................................23
II.3
QU TRNH LNG T..................................................................................................................24
II.3.1
LNG T HA V HNG...........................................................................................24
II.3.2
LNG T HA VECTOR................................................................................................25
II.4
QU TRNH M HA.......................................................................................................................25
II.4.1
M HA DI THAY I.............................................................................................25
II.4.1.1
M ha Huffman.................................................................................................................26
II.4.1.2
M ho mc dc chiu di RLC..........................................................................................26
II.4.2
M HA S HC................................................................................................................27
II.5
TIU CHUN NH GI CHT LNG NH NN...................................................................30
CHNG III.
CC CHUN NN THUC H MPEG TRC MPEG-4 H.264/AVC.............31
III.1
GII THIU V LCH S PHT TRIN CA K THUT MPEG...............................................31
III.2
III.2.1
TIU CHUN MPEG-1.......................................................................................................31
III.2.1.1
Cc c im ca tiu chun MPEG-1................................................................................32
III.2.1.2
Cu trc dng bit ca MPEG-1...........................................................................................33
III.2.2
TIU CHUN MPEG-2.......................................................................................................34
III.2.2.1
Cc c im ca tiu chun MPEG-2................................................................................34
III.2.2.2
S khc nhau chnh gia MPEG-1 v MPEG-2..................................................................35
III.2.3
TIU CHUN MPEG-4.......................................................................................................36
III.2.4
SO SNH C IM NI BT CA CC CHUN NN..............................................37
CHNG IV.
CHUN NN MPEG-4 H.264/AVC..........................................................................38
IV.1
TNG QUAN V CHUN NN MPEG-4 H.264/AVC....................................................................38
IV.1.1
IV.1.2
IV.1.2.1
IV.1.2.2
IV.2
IV.3
IV.3.1
GII THCH NGUYN L HOT NG C BN.........................................................44
IV.3.1.1
S m ha.......................................................................................................................44
IV.3.1.2
S gii m.......................................................................................................................45
IV.3.2
KHI NN THI GIAN......................................................................................................46
IV.3.2.1
D on mt chiu (m ha nh Prediction).......................................................................46
IV.3.2.2
D on hai chiu( m ha nh Bidiriectional Prediction).................................................47
IV.3.2.3
D on lin nh (Inter-Frame)...........................................................................................51
IV.3.2.4
M ha nh SP (switching P) v SI (switching I)...............................................................53
IV.3.3
KHI NN KHNG GIAN..................................................................................................54
IV.3.3.1
Chia nh thnh cc MacroBlock.........................................................................................55
IV.3.3.2
D on trong nh (Intra-frame).........................................................................................56
IV.3.3.3
D on trng s:................................................................................................................62
IV.3.3.4
K thut tin on b chuyn ng v c lng chuyn ng.........................................63
IV.3.3.5
Php bin i nguyn ICT (Integer Discrete Cosin Transform).........................................71
IV.3.3.6
Qu trnh lng t...............................................................................................................75
IV.3.3.7
Qu trnh gii lng t:.......................................................................................................77
IV.3.3.8
Qut Zig-Zag.......................................................................................................................78
IV.3.3.9
M ha xen k.....................................................................................................................80
IV.3.3.10
Sp xp th t Slice.............................................................................................................80
IV.3.4
M HA ENTROPY............................................................................................................81
IV.3.4.1
M ha Entropy Exp-Golomb.............................................................................................82
IV.3.4.2
M ha di bin i thch nghi ni dung CAVLC..........................................................84
IV.3.4.3
M ha s hc nh phn thch nghi ni dung CABAC........................................................87
IV.3.5
B LC TCH KHI TRONG VNG...............................................................................89
IV.3.5.1
Nguyn tc ca lc tch khi..............................................................................................90
IV.3.5.2
Qu trnh lc khi................................................................................................................91
IV.3.6
CU TRC V C PHP CHUN H.264/AVC................................................................94
IV.3.6.1
Lp tru tng mng NAL.................................................................................................95
IV.3.6.2
Lp m ha video VCL (Video Coding Layer)...................................................................96
IV.3.6.3
K thut FMO v Data Partitioned Slices...........................................................................96
IV.3.6.4
K thut Arbitrary Slice Ordering.......................................................................................96
IV.3.6.5
Cu trc dng bit H.264/AVC.............................................................................................97
CHNG V.
MT S NG DNG CHUN H.264/AVC...............................................................99
V.1
TRUYN HNH INTERNET IPTV....................................................................................................99
V.2
V.3
CHNG VI.
VI.1
VI.2
VI.3
KT QU M PHNG....................................................................................................................104
PH LC.............................................................................................................................................................106
TI LIU THAM KHO...................................................................................................................................113
CHNG I.
I.1
C S V NN TN HIU VIDEO
S CN THIT CA NN TN HIU
Gim dung lng thng tin m khng lm mt tnh trung thc ca hnh nh.
I.2
QU TRNH S HA TN HIU
Trong :
+ fs l tn s ly mu.
+ fmax l tn s cc i ca ph tn hiu tng t.
ho bin i tn hiu lin tc theo thi gian thnh tn hiu c bin ri rc, nhm lm
gim nh hng ca tp m trong h thng, hn ch cc mc cho phpt ca tn hiu ly
Xung lay mau
t
Ma hoa tn
hieu
1000
0001
0000
4
Hnh I.1: S o qua trnh tao tn hieu so.
I.3
I.3.1 TC BT
Tc bit l s lng bit c truyn i hay lu tr trong mt n v thi gian.
C fs * n
(bit/s)
Trong :
+ f s l tn s ly mu (Hz).
+ n l s bit nh phn trong mt k hiu.
+ C l tc bit (bps).
I.3.2 THNG LNG KNH TRUYN
L tc s liu cc i c th truyn c trn knh truyn c rng bng tn B.
C B. log 2 (1 S ) (bps)
N
Trong
+ C l tc bit (bps)
+ S N l t s tn hiu trn nhiu trng.
+ B l bng thng knh truyn (Hz).
Tc bit cng ln th tn hiu tng t khi phc li cng trung thc tuy nhin n s
l cho dung lng lu tr v bng thng knh truyn cng ln. Trong thc t truyn
3
4
V rng bng tn l B C =
I.4
3
x 176,4.10 3 132,3 Khz
4
R, G, B
0.5
(B Y )
1 kb
Cr
0 .5
(R Y )
1 kr
Vi
kb k r k g 1 ,
(1)
R 1 0 1.402 Y
G 1 0.34 0.714 Cb
B 1 1.7 2 0 Cr
I.5
=> Vy tng s bits s dng l (720 576 8) + (360 288 8) 2 = 4 976 640 bits
I.6
Nn thi gian
Nn khng gian
B m ha ENTROPY
Lu tr nh
Hnh I.4. S khi nn tn hiu Video c bn
Cc khi chnh l:
- Khi nn d tha thi gian.
D on chuyn ng
B chuyn ng
- Khi nn d tha theo khng gian.
Bin i DCT, DWT
Lng t ha
Xp xp li trt t v m ha Entropy
I.6.1 NN TN HIU VIDEO
Tn hiu video c di ph nm trong khong 0 -> 6Mhz, do thnh phn tn s cao ch
xut hin cc ng vin ca hnh nh nn nng lng ph rt t tp trung min tn
s cao m ch yu tp trung min tn s thp. iu c ngha l s lng bit
min tn s thp s nhiu hn min tn s cao.
Trong cc h thng nn, t s nn chnh l tham s quan trng nh gi kh nng nn
ca h thng, ta gi n1, n2 l s lng bit ca tn hiu trc v sau khi nn nn ta c
cng thc nh sau:
T s nn s l C
n1
n2
n
n n
R 1 2 x 100% 1 2 x 100%
n1
n1
1
] log 2 p ( ai )
p (ai )
10
Theo cng thc trn ta thy lng tin cha ng trong mt hnh nh s t l nghch vi
kh nng xut hin ca nh , ngha l s kin t xy ra s cha ng nhiu thng tin
hn v bng tng s lng thng tin ca tng phn t nh.
Gi lng tin trung bnh ca hnh nh l H(X) v c tnh bng cng thc sau:
N
H ( X ) p (ai ) * log 2 [
1
N
1
] p (ai ) * log 2 p (ai )
p (ai )
1
Xc sut phn b cng nhiu th lng tin trung bnh entropy cng nh. Entropy t
gi tr cc i i vi phn b u, do nu mt k hiu c xc sut ln s c s
Entropy nh.
V d: Gi s c mt nh en trng vi phn gii lng t 8 bit. K hiu i l mc
xm ca pixel v b k hiu A l tp hp tt c cc mc xm t 0->255, mc xm 0
tng ng vi mu en, mc xm 255 tng ng vi mu trng. Do , Entropy ca
255
nh l H (X ) p (i ) log 2 p (i )
0
21
21
95
169
243
243
243
21
21
21
95
169
243
243
243
21
21
21
95
169
243
243
243
21
21
21
95
169
243
243
243
S lng pixel
Xc sut.
21
12
3/8
95
1/8
169
1/8
243
12
3/8
3
8
= log 2
3 1
1 1
1 3
3
log 2 log 2 log 2
8 8
8 8
8 8
8
6
3 2
1
log 2 log 2
8
8 8
8
11
S lng cp
Xc sut
(21, 21)
1/4
(21, 95)
1/8
(95, 169)
1/8
(169, 243)
1/8
(243, 243)
1/4
(243, 21)
1/8
H(x)
1
4
= log 2
1 1
1 1
1 1
1 1
1 1
1
log 2 log 2 log 2 log 2 log 2
4 8
8 8
8 8
8 4
4 8
8
2
1 4
1
log 2 log 2
4
4 8
8
2.5bits / cap
pixels
74
74
74
21
74
74
74
21
74
74
74
21
74
74
74
Gi tr mc xm
S lng
Xc sut.
21
1/8
16
1/2
74
12
3/8
H(x)
1
8
= log 2
1 1
1 3
3
log 2 log 2
8 2
2 8
8
Nh vy, s lng tin trung bnh ti thiu cn thit truyn mt phn t nh s khc
nhau, ngha l d tha trong nh v gia cc bc nh s ph thuc vo cch m ha
Entropy. Do cn phi xem xt k chn ra loi m ha hiu qu nht.
12
II.2
QU TRNH BIN I
Bien
oi
T
Giai
nen
Bien oi
ngc
T-1
Lng t
hoa
Q
Ma
hoa
C
Giai lng
t hoa R
Giai
ma D
13
Bo tien
oan
V d
Ma hoa
entropy
S khc nhau
Dng bit c nn nh sau:
115
-1
-1
-2
-1
-1
-2
II.2.2 M HA BIN I
Nhm bin i cc h s trong min thi gian (video s), khng gian 2D (bc nh
tnh) thnh cc h s trong min tn s. Cc h s ny t tng quan hn c ph nng
lng tp trung hn, thun tin cho vic loi b thng tin d tha.
II.2.2.1 Bin i cosin ri rc DCT
V nh gc c kch thc rt ln cho nn trc khi a vo bin i DCT, nh c
phn chia thnh cc MB biu din cc mc xm ca im nh. Vic phn khi ny s
lm gim c mt phn thi gian tnh ton cc h s chung, mt khc bin i cosin
i vi cc khi nh s lm tng chnh xc khi tnh ton vi du phy tnh, gim
thiu sai s do lm trn sinh ra. Php bin i DCT c bn hot ng da trn c s
ma trn vung ca mu sai s d on, kt qu cho ta mt ma trn Y l nhng h s
DCT c minh ha nh sau:
14
Y = AXAT
Trong A l ma trn h s bin i, cc thnh phn ca A nh sau:
Ci
Ai , j C i cos
( 2 j 1)i
2N
Vi
1
N
Nu i = 0
Nu i > 0
C 2
i N
N 1 N 1
Tng ng vi Yx , y C x C y X i, j Cos
i 0 J 0
( 2 j 1) y
( 2i 1) x
Cos
2N
2N
1
2 cos 0
1
cos 0
2
1
cos 0
2
1
cos 0
2
1
2 cos 8
1 3
cos
2 8
1 5
cos
2 8
1 2
cos
2
1 6
cos
2 8
1 10
cos
2 8
1 7
cos
2 8
1 14
cos
2 8
1 cos 3
2 8
1 9
cos
2 8
1 15
cos
2 8
1 21
cos
2 8
X i , j C x C y Yx , y Cos
x 0 y 0
( 2 j 1) y
( 2i 1) x
Cos
2N
2N
15
H n1 H nT
Vi H1=
II.3
1 1 1
1 1
2
QU TRNH LNG T
QP = 1
QP = 2
QP = 3
QP = 5
-4
-4
-4
-3
-5
-3
-3
-2
-3
-5
16
-2
-2
-2
-3
-1
-1
II.4
QU TRNH M HA
17
II.4.1 M HA DI THAY I
K thut m ha di thay i VLC da trn xc sut cc gi tr bin ging nhau
trong mt nh la chn cc t m m ho. B m ha c di thay i nh x
cc k hiu ng vo thnh mt chui t m c di thay i ng ra nhng cha s
lng bt nguyn. Cc k hiu c xc sut cao s c gn t m c di ngn, cn
cc k hiu c xc sut thp s c gn t m c di ln hn, do n s lm ti
thiu chiu di trung bnh ca t m. Ti pha gii nn c cc ch nh m ging nhau
c dng khi phc li cc gi tr d liu gc. Cc loi m ha VLC c bn nh:
m ha Huffman, m ho RLC, m ha Exp-Golomb
II.4.1.1 M ha Huffman
M ha Huffman l m ha tha mn ti u tnh prefix v phng php m ha
thng da vo m hnh thng k. Da vo d liu gc, ngi ta tnh xc sut xut
hin ca cc k t. Vic tnh ton xc sut c thc hin bng cch duyt tun t tp
gc t u n cui v cc k t no c xc sut cng cao th t m cng ngn nn
gim chiu di trung bnh ca t m mt cch r rt, m ha Huffman thng c
biu din di dng cy m nh sau:
1
1
0
u1
u3
u4
u2
1
0
1
u7
u5
u6
18
19
Xc sut
-2
-1
0
1
2
0.1
0.2
0.4
0.2
0.1
3.32
2.32
1.32
2.32
3.32
Khong chia nh
0 0.1
0.1 0.3
0.3 0.7
0.7 0.9
0.9 1.0
Ci phm vi bt u
Tm khong con tng
ng cho k hiu u tin
Ci li khong mi cho
khong con.
Tm khong con tng
ng cho k hiu tip
theo
Ci li khong bt u
mi nm trong khong
trc
Tm khong tp theo
Ci li khong bt u
mi nm trong khong
trc
Tm khong tp theo
Ci li khong bt u
mi nm trong khong
trc
Phm vi
(L H)
0 1.0
K hiu Khong
(L H) chia nh
(0)
0.3 0.7
(-1)
0.1
Ch thch
0.3 0.7
0.3
0.34 = 10%
0.42 = 30%
0.34 0.42
(0)
0.3 0.7
0.364 = 30%
0.396 = 70%
0.3640.396
(2)
0.9-1.0
0.3928 = 90%
0.396 = 100%
0.3928 0.396
20
Phm vi
01
Ci phm vi bt u
Tm khong con tng ng cho k
hiu u tin
K hiu gii m
0.3 0.7
0.34 0.42
-1
0.3640.396
0.3928 0.396
0.3 0.7
II.5
Khong chia nh
21
Sai s bnh phng trung bnh MSE (mean square error) nh ngha cho
: MSE
1
N2
N 1
N 1
(C
i 0
j 0
Ri j ) 2
i j
(2 b 1) 2
(dB)
MSE
: MAE
1
N2
N 1
N 1
i 0
j 0
ij
Ri j
N 1
C
j 0
ij
Ri j
H.264
(1998/99)
(H.262)
(2003)
III.1 GII
THIU V LCH S PHT TRIN CA K THUT MPEG
(1994/95)
MPEG-4 v2
(1999/00)
MPEG-1
MPEG-4 v3
(11/1992)
(2001)
1993
1995
1997
1999
2000
2001
2003
2005
22
Hnh III.1. Qu trnh pht trin ca k thut nn MPEG qua cc giai on
23
Ty thuc kiu nh m tn hiu sai s c pht hin bng cch tm ra sai s gia d
on b chuyn ng v d liu hin ti trong mi MB. Tn hiu sai s d on c
chuyn n khi DCT 8x8 v b lng t to h s lng t. Mt b iu khin tc
bit c nhim v iu chnh d liu ng ra thng qua iu chnh bc lng t. Cc
h s ny c qut theo ma trn Zig-Zag v m ho bng m Entropy ri mi a ra
knh truyn.
III.2.1.1 Cc c im ca tiu chun MPEG-1
Cu trc ly mu 4:2:0
Ch c kh nng qut lin tip.
Biu din mu bng t m 8 bits, chnh xc ca qu trnh lng t v bin
i DCT l 9 bits.
S dng phng php DPCM lng t ha cho h s DC. B chuyn ng
cho cc MB 16x16 trong cng mt khung hnh hoc gia cc khung vi nhau.
chnh xc d on chuyn ng l 1 pixel.
Chun MPEG-1 c 4 kiu nh l Intra, Predicted, Bidirectional v nh D
(DC coded picture). N gn ging nh I nhng ch c thnh phn mt chiu
u ra DCT c th hin. N cho php d nhanh nhng cho cht lng nh
thp.
III.2.1.2 Cu trc dng bit ca MPEG-1
Chun MPEG-1 nh ngha mt kiu phn cp cu trc trong d liu Video v y
cng l cu trc d liu chung cho c chun MPEG v sau. Cu trc d liu nh sau:
+ Khi (Block) gm 8x8 pixels tn hiu chi v mu c nh ngha dng cho nn
DCT.
+ T hp khi (Macroblock) gm cc khi Y, Cb v Cr tng ng vi ni dung thng
tin ca mt khi 16x16 pixel ca thnh phn chi hoc khi 8x8 ca 2 thnh phn mu
trong hnh nh gc. Mt MB bao gm 6 khi trong c 4 khi Y, 1 khi Cb v 1 Cr
nh hnh v, cc khi s c nh s th t bt u bng 1.
24
+ Mng (Slice) gm nhiu MB. Kch thc slice ln nht l 1 nh, nh nht l 1 MB
Th t cc MB bn trong slice c xc nh t tri qua phi, trn xung di. Phn
header ca slice cha thng tin v v tr ca mng trong ton b nh v h s ca b
lng t. Slice rt quan trng trong vic nh li, nu dng d liu c cha li, b gii
m c th b qua v tip tc slice k tip. Nhiu slice trn dng d liu cho php che
giu li tt hn v c dng ci thin cht lng hnh nh.
+ nh (Picture): gm nhiu slice cho php b gii m xc nh loi m ha khung.
Thng tin header ch th t truyn khung b gii m sp xp li cc nh ng
th t, ngoi ra thng tin header cn cha cc thng tin v ng b, phn gii,
phm v ca vector chuyn ng
+ Nhm nh (GOP): gm nhiu nh bt u t nh I. Ch bo im bt u cho vic
bin tp v vic tm kim. Phn header cha m iu khin v m thi gian 25 bit cho
thng tin nh thi.Cu trc ca mt GOP c m t bng 2 tham s:
- N: l cc nh trong GOP
- M: l khong cch gia cc nh P-pictures.
V d: Ta c 1 GOP nh sau :
B1 B2 I3 B4 B5 B7 B8 P9 B10 B11 P12.
Tc N = 12 v M = 3.
+ Chui nh (Sequence): bt u l mt Sequence Header, 1 hay nhiu GOP v 1 m
kt thc chui End-of-Sequence. Thng tin header cha kch thc mi chiu ca bc
nh, kch thc im nh, tc bit ca dng video s, tn s nh, b m ti thiu
cn c. Chui nh v thng tin header cn c gi chung l dng c bn ES.
25
Main
4:2:0, 352 x 288
SNR
4:2:0, 352 x 288
4Mbps
4Mbps, I, P ,B
15 Mbps, I, P
15 Mbps, I, P, B
15 Mbps, I, P, B
20Mbps, I, P, B
Low
Main
26
Spatially
High
High
1440
60 Mbps, I, P, B
60 Mbps, I, P, B
1440 x 1152
80 Mbps, I, P, B
4:2:0, 4:2:2
High
4:2:0, 4:2:2
1192 x 1152
80 Mbps, I, P, B
100 Mbps I P, B
MPEG-2
27
MPEG-1
MPEG-2
MPEG-4
H.264
MB size
16 x 16
16 x 16
16 x 16
Block size
8x8
8x8
16 x 16, 8 x 8
Transform
DCT
DCT
DCT, DWT
Entropy coding
VLC
VLC
VLC
ME, MC
Pixel accuracy
Reference
frames
Picture type
Transmission
rate
Yes
pixel
Yes
pixel
Yes
pixel
16 x 16
16x16, 16x8, 8x16
8x8,8x4,4x8,4x4
4x4 Int transform
VLC, CAVLC,
CABAC
41 MVs/MB
pixel
1 frame
1 frame
1 frame
5 frame
I, P, B
I, P, B
I, P, B
I, P, B
1.5 Mbps
2-15Mbps
64kbps-2Mbps
64kbps-150Mbps
28
Hnh IV.7. So snh s ti u gia cc chun nn
High
High 10
High 4:2:2
High 4:4:4
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
29
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
MAIN
HIGH
EXTENDED
(Streaming)
(Broadcast)
I Slices
I Slices
I Slices
I Slices
P Slices
P Slices
P Slices
P Slices
CAVLC
CAVLC
CAVLC
CAVLC
4x4 Transform
4x4 Transform
4x4 Transform
4x4 Transform
Weighted Prediction
Weighted
Prediction
B Slices
Weighted
Prediction
B Slices
CABAC
CABAC
B Slices
Quantization
Matrix
8x8 Transform
30
ASO
ASO
FMO
FMO
Redundant Slices
Redundant Slices
Data Partitioning
SP Slices, SI Slices
Level Max
number MB/s
1485
99
64 kbit/s
80 kbit/s
192 kbit/s
256 kbit/s
128x96@30.9 (8)
176x144@15.0 (4)
1b
1485
99
128 kbit/s
160 kbit/s
384 kbit/s
512 kbit/s
128x96@30.9 (8)
176x144@15.0 (4)
1.1
3000
396
192 kbit/s
240 kbit/s
576 kbit/s
768 kbit/s
176x144@30.3 (9)
320x240@10.0 (3)
352x288@7.5 (2)
1.2
6000
396
384 kbit/s
480 kbit/s
1152 kbit/s
1536 kbit/s
320x240@20.0 (7)
352x288@15.2 (6)
1.3
11880
396
768 kbit/s
960 kbit/s
2304 kbit/s
3072 kbit/s
320x240@36.0 (7)
352x288@30.0 (6)
11880
396
2 Mbit/s
2.5 Mbit/s
6 Mbit/s
8 Mbit/s
320x240@36.0 (7)
352x288@30.0 (6)
2.1
19800
792
4 Mbit/s
5 Mbit/s
12 Mbit/s
16 Mbit/s
352x480@30.0 (7)
352x576@25.0 (6)
16 Mbit/s
352x480@30.7(10)
352x576@25.6 (7)
720x480@15.0 (6)
720x576@12.5 (5)
2.2
20250
1620
4 Mbit/s
5 Mbit/s
12 Mbit/s
1620
10 Mbit/s
12.5 Mbit/s
30 Mbit/s
40 Mbit/s
352x480@61.4 (12)
352x576@51.1 (10)
720x480@30.0 (6)
720x576@25.0 (5)
3.1
108000 3600
14 Mbit/s
17.5 Mbit/s
42 Mbit/s
56 Mbit/s
720x480@80.0 (13)
720x576@66.7 (11)
1280x720@30.0 (5)
3.2
216000 5120
20 Mbit/s
25 Mbit/s
60 Mbit/s
80 Mbit/s
1280x720@60.0 (5)
1280x1024@42.2 (4)
245760 8192
20 Mbit/s
25 Mbit/s
60 Mbit/s
80 Mbit/s
1280x720@68.3 (9)
1920x1088@30.1 (4)
2048x1024@30.0 (4)
4.1
245760 8192
50 Mbit/s
62.5 Mbit/s
150 Mbit/s
200 Mbit/s
40500
31
1280x720@68.3 (9)
1920x1088@30.1 (4)
2048x1024@30.0 (4)
4.2
522240 8704
50 Mbit/s
62.5 Mbit/s
150 Mbit/s
200 Mbit/s
1920x1088@64.0 (4)
2048x1088@60.0 (4)
589824 22080
135 Mbit/s
168.75 Mbit/s
405 Mbit/s
540 Mbit/s
1920x1088@72.3 (13)
2048x1024@72.0 (13)
2048x1088@67.8 (12)
2560x1920@30.7 (5)
3680x1536/26.7 (5)
5.1
983040 36864
240 Mbit/s
300 Mbit/s
720 Mbit/s
960 Mbit/s
1920x1088@120.5 (16)
4096x2048@30.0 (5)
4096x2304@26.7 (5)
32
ta cn phi c nhiu frame tham kho nng cao hiu sut v cht lng.
H.264/AVC cho php s dng ti a 32 frame tham kho trong khi MPEG-2 ch
s dng 2 frame tham kho mang tnh cht chu k. B chuyn ng vi nhiu
hnh tham kho s l chm qu trnh m ha v gii m nhng s tng cht
lng nh vi cng t s nn.
Tch ring hnh tham kho v hnh hin th: cc tiu chun trc c s ph
thuc gia hnh tham kho v hnh hin th, cn trong H.264/AVC b m ha c
th chn hnh nh tham kho gn nht vi hnh nh c m ha cho mc
ch tham kho d on nn c th hin th vi tnh linh hot cao, do khong
thi gian tr s c loi b.
Gim d tha v khng gian tt hn: s dng php bin i nguyn thay v s
dng php bin i DCT nh MPEG-2, lm gim nh hng do sai s lm trn.
Lng t ha thch nghi: trong qu trnh m ha vi tc bit bin thin, khi s
dng lng t ha thch nghi, mi frame c th c nn vi nhng b lng
t khc nhau ph thuc vo bn cht hnh nh ca chng thng qua vic iu
khin tc bit. V d nhng phn chuyn ng hay nhng phn hnh nh sm
mu kh nhn bit s c x l vi h s lng t ln hn ( nn cao hn,
dung lng nh hn), nhng phn hay c h thng mt ngi ch nhiu
hn s c x l vi h s lng t thp hn ( nn nh hn, dung lng ln
hn). H.264/AVC cho php s dng ti 52 mc lng t trong khi MPEG-2 ch
c 31 mc.
S dng b lc tch khi: Tri ngc vi b tin x l hay b hu x l, b lc
tch khi c p dng trong sut qu trnh m ha trn mi frame n l,
nhng trc n s c s dng tham kho cho nhng frame n sau. Ci
tin mi ny s gip trnh c hin tng kt khi lm nh hng n cht
lng hnh nh, c bit l vi tc bit thp. Nhng tc m ha, gii m s
b gim st.
Kiu d on trng s. H.264/AVC c th h tr qu trnh m dn hay ti dn
khung hnh trong nhng on film c hiu ng m dn (nhng frame n sau
rt ging so vi nhng frame ngay trc n, ch c sc l khc mt cht),.
33
34
Bin i
DCT nguyn
Lng t
v hng
Sp xp
trt t
M ha
Entropy
D on
chuyn ng
nh
trc
B chuyn
ng
Chn kiu d
on Intra
nh cu
trc li
17 kiu d on Intra
D on
Intra
Lc tch
khi
Bin i
ngc
Gii
lng t
35
B chuyn
ng
D on
Intra
nh cu
Lc tch
Bin i
Gii
Sp xp
Gii m
gii m Entropy nhn cngc
cc dng bitlng
nn t
mttmt s gii
m
trc liu tin b khi
t NAL, trt
Entropy
36
Anh d oan
P
anh gia
chuyen
ong
D oan
chuyen ong
Bo nh
anh
37
IV.3.2.2.a S nguyn l nn nh B.
Anh d
oan P
anh
gia
chuyen
ong
Anh
trc o
D oan
chuyen
ong
Anh sau
o
38
Phan vung
16 x16
16 x 8 hoac 8 x 16
8x8
on List
List 0
List 1
0
1
2
3
4
5
126
125
123
128
129
130
128
129
130
126
125
123
39
Hnh IV.5. Cc mu d on trong nh B
40
Cc h s phn cp c tnh ton t thi gian khc nhau gia 2 VOP tham chiu v
B-VOP hin ti. Chng c xc nh nh sau:
TRb = thi gian hin th (VOP hin ti) - thi gian hin th (tham chiu trc)
TRd = thi gian hin th (tham chiu ngc) - thi gian hin th (tham chiu
trc)
Cng lc , vector chuyn ng Delta (MVD) c cng thm vo. Tip theo qu
trnh ny, cc vector chuyn ng B-VOP c xc nh nh sau:
MVF = TRb/TRd.MV + MVD
MVB = (TRb TRd).MV + MVD
Vy i vi v d trn th ta c :
MVF = 1/3 MV + MVD
MVB = -2/3MV + MVD.
i vi b chuyn ng trong cc B-VOP ch c th s dng mode 1MV, c ngha l:
ch mt vector chuyn ng duy nht c th c truyn i cho mt MB cho mi mt
hng d on. Nhng trong mode trc tip nu MB tun t trong VOP tham chiu
ngc c m ho vi ch 4MV, vi MB hin ti trong mode trc tip th 4 vector
chuyn ng c s dng cho 4 khi 8x8 tng ng ca MB hin ti trong B-VOP.
Nu MB hin ti c m ho trong ch SKIP th n cng l b chuyn ng s
dng mode trc tip vi vector chuyn ng Delta zero nhng b qua m ho sai s
d on .
IV.3.2.3 D on lin nh (Inter-Frame)
Nn lin nh chnh l vic loi b nhng thng tin ging nhau gia cc nh lin tip,
ch m ha phn thng tin khc nhau gia chng, y cng l ni dung chnh ca khi
nn theo thi gian. Da vo nguyn tc , cc b m ho s qut ln lt tng MB v
pht hin xem c s thay i t frame ny sang frame khc hay khng. Mt khc, cc
b m ho cn tin on s xut hin ca cc MB khi bit v tr v hng chuyn ng
ca n. Do , ch nhng s thay i gia cc khi mi c truyn n pha thu. B
gii m lu tr sn nhng thng tin khng thay i vo b nh m v khi khi
phc li nh gc th ch vic in mt cch u n vo cc v tr cn trng. V d hai
frame lin tip trong chui nh c minh ha nh hnh IV.7. Trong frame 2 c
d on t frame 1, c s ging nhau v nh nn, quyn sch, cy n,... phn sai khc
41
Frame 1
Frame 2
khi phc li nh tham kho c th thc hin d dng v cht lng nh nn cng
trung thc hn.
43
45
46
hoc
a = 128
2. Kiu d on dc (Vertical)
Cc mu bn di sao chp li cc mu bn trn theo chiu dc.
LT | T0 T1 T2 T3
--------------------L0 | T0 T1 T2 T3
L1 | T0 T1 T2 T3
L2 | T0 T1 T2 T3
L3 | T0 T1 T2 T3
3. Kiu d on ngang (Horizontal )
Cc mu bn phi sao chp li cc mu bn phi theo chiu ngang.
LT | T0 T1 T2 T3
--------------------L0 | L0 L0 L0 L0
L1 | L1 L1 L1 L1
L2 | L2 L2 L2 L2
L3 | L3 L3 L3 L3
4. Kiu d on cho xung/tri (Diagonal Down/Left )
Cc mu c ni suy theo gc 450 gia gi tr bn tri trn v bn phi di theo
ng cho.
LT | T0 T1 T2 T3 T4 T5 T6 T7
------------------------------------L0 | a b c d
L1 | b c d e
L2 | c d e f
L3 | d e f g
Trong :
a = (T0 + 2*T1 + T2 + 2) / 4
b = (T1 + 2*T2 + T3 + 2) / 4
c = (T2 + 2*T3 + T4 + 2) / 4
d = (T3 + 2*T4 + T5 + 2) / 4
e = (T4 + 2*T5 + T6 + 2) / 4
f = (T5 + 2*T6 + T7 + 2) / 4
g = (T6 + 3*T7
+ 2) / 4
5. Kiu d on cho xung/phi (Diagonal Down/Right)
Cc mu c ngoi suy theo gc 450 t trn xung, t tri qua phi.
LT | T0 T1 T2 T3
--------------------L0 | d e f g
L1 | c d e f
47
L2 | b c d e
L3 | a b c d
Trong :
a = (L3 + 2*L2 + L1 + 2) / 4
b = (L2 + 2*L1 + L0 + 2) / 4
c = (L1 + 2*L0 + LT + 2) / 4
d = (L0 + 2*LT + T0 + 2) / 4
e = (LT + 2*T0 + T1 + 2) / 4
f = (T0 + 2*T1 + T2 + 2) / 4
g = (T1 + 2*T2 + T3 + 2) / 4
6. Kiu d on dc/phi (Vertical/Right)
Cc mu c ngoi suy theo gc xp x 26.60 t phi sang tri theo chiu dc
LT | T0 T1 T2 T3
--------------------L0 | a b c d
L1 | e f g h
L2 | i a b c
L3 | j e f g
Trong :
a = (LT + T0 + 1) / 2
b = (T0 + T1 + 1) / 2
c = (T1 + T2 + 1) / 2
d = (T2 + T3 + 1) / 2
e = (L0 + 2*LT + T0 + 2) / 4
f = (LT + 2*T0 + T1 + 2) / 4
g = (T0 + 2*T1 + T2 + 2) / 4
h = (T1 + 2*T2 + T3 + 2) / 4
i = (LT + 2*L0 + L1 + 2) / 4
j = (L0 + 2*L1 + L2 + 2) / 4
7. Kiu d on dc/ tri (Vertical/Left)
Cc mu c ngoi suy theo gc xp x 26.60 t tri sang phi theo chiu dc
LT | T0 T1 T2 T3 T4 T5 T6 T7
------------------------------------L0 | a b c d
L1 | f g h i
L2 | b c d e
L3 | g h i j
Trong :
a = (T0 + T1 + 1) / 2
b = (T1 + T2 + 1) / 2
c = (T2 + T3 + 1) / 2
d = (T3 + T4 + 1) / 2
e = (T4 + T5 + 1) / 2
f = (T0 + 2*T1 + T2 + 2) / 4
48
g = (T1 + 2*T2 + T3 + 2) / 4
h = (T2 + 2*T3 + T4 + 2) / 4
i = (T3 + 2*T4 + T5 + 2) / 4
j = (T4 + 2*T5 + T6 + 2) / 4
8. Kiu d on ngang/xung (Horizontal/Down)
Cc mu c ngoi suy theo gc xp x 26.60 t trn xung theo chiu ngang
LT | T0 T1 T2 T3
--------------------L0 | a b c d
L1 | e f a b
L2 | g h e f
L3 | i j g h
Trong :
a = (LT + L0 + 1) / 2
b = (L0 + 2*LT + T0 + 2) / 4
c = (LT + 2*T0 + T1 + 2) / 4
d = (T0 + 2*T1 + T2 + 2) / 4
e = (L0 + L1 + 1) / 2
f = (LT + 2*L0 + L1 + 2) / 4
g = (L1 + L2 + 1) / 2
h = (L0 + 2*L1 + L2 + 2) / 4
g = (L2 + L3 + 1) / 2
j = (L1 + 2*L2 + L3 + 2) / 4
9. Kiu d on ngang/ln (Horizontal/Up)
Cc mu c ni suy theo gc xp x 26.60 t di ln theo chiu ngang
LT | T0 T1 T2 T3
--------------------L0 | a b c d
L1 | c d e f
L2 | e f g g
L3 | g g g g
Trong :
a = (L0 + L1 + 1) / 2
b = (L0 + 2*L1 + L2 + 2) / 4
c = (L1 + L2 + 1) / 2
d = (L1 + 2*L2 + L3 + 2) / 4
e = (L2 + L3 + 1) / 2
f = (L2 + 2*L3 + L3 + 2) / 4
g = L3
IV.3.3.2.b INTRA LUMA 16 x 16
49
50
......
L15 | L15 L15 L15 L15 L15 .. L15
4.Kiu d on mt phng Plane
Cho 16 b d on nh trn (T0..T15), 16 b d on bn tri (L0..L15) v 1 b d
on gc nh tri (LT) sp xp nh sau:
LT | T0
T1
T2
..
------------------------------------- ..
L0 | c[ 0, 0] c[ 1, 0] c[ 2, 0] ..
L1 | c[ 0, 1] c[ 1, 1] c[ 2, 1] ..
......
L15 | c[ 0,15] c[ 1,15] c[ 2,15] ..
T15
-------c[15, 0]
c[15, 1]
c[15,15]
51
52
Frame 1
Frame 2
C b chuyn ng
Khng b chuyn
ng
Hnh IV.16. S khc nhau gia sai s c b chuyn ng v
khng b chuyn
53 ng cho khi 16x16
54
Hnh IV.18. Minh hoa phep pixel theo hng nm ngang cho thanh
phan
Cc
mu luma.
v tr pixel nm cnh 2 mu nguyn c ni suy t nhng mu nguyn
bng cch s dng b lc FIR 8-nhnh (Finite Impulse Response) vi cc trng s
(8/256, -40/256, 40/256, 40/256, -40/256, 8/256) tng ng vi (1/32,-5/32, 5/8,
5/8,-5/32, 1/32). V d, v tr mu pixel b c tnh ton t 6 mu nguyn nm
ngang E, F, G, H, I v J nh sau:
b round (
E - 5F 20G 20H - 5I J
)
32
55
Hnh IV.19. Ni suy mu cho thnh phn luma ti v tr .
Gb
)
2
56
a round
Vi dx l 2 v dy l 3, nn
a round
57
Hnh IV.22. B chuyn ng cho mt VOP c hnh dng bt k
58
60
DCT
1 1 1 1
1.3 0.54 0.54 1.3
1 1 1 1
2 1 1 2
Gia tr
thc
ICT
Gia tr
nguyen
1 1 1 1 1 1 1 1
0.54 1.3 1.3 0.54 1 2 2 1
61
a a a b a c
b c b X a c ba
T
Y AX
a a a c a b
c b c ab ca
Thc hin co dn ma trn Y vi ma trn E nh sau:
62
a
b
a
b
1 1 1 1 d
2 2
T 1 d 1 X 1 d 1 ab ab
Y XC )( EC 2 2
1 1 1 d 1 a b a b
d 1 d 1 1 d 2 2
ab ab
22
Trong
b
0.414
c
63
2
5
, d = 0.5
1 1 1 2 1 a b/2 aa ab/2
2 2
T 2 1 2 X 1 1 2 b/2 ba /4 b/2ba /4
YC ff )( EX f 2 2
1 1 1 1 2 a b/2 aa ab/2
1 2 1 1 2 1 2 2
b/2 ba /4 b/2ba /4
22
64
% A LA MA TRAN HE SO CO DAN
CHENHLECH = Y2-Y1
Y1 AXAT
5.5 5.193. 2.0 0.253
Y 2 (CXCT ) E f
5.5 2.6879 2.0 4.9015
0
6.7542
Y1 Y 2
0
4.0189
10.376 0 15.8628
2.3411 4.9938 4.1759
2.5051 0 5.1545
65
1 1 /2 a b a b1 111
1 /2 1 Y ab 2 ab 2 1 /2 1/2 1
T
Y Ci Y Ei)(' C 2 2
1 /2 1 a b a b1 1 11
2 2
1 1 /2 ab ab 1/21 1/2
22
66
1 11 1 11
1 1 WD 1 11
Y /2
1 1 1 11
1 1 1 11
Cc h s DC c lng t theo cng thc sau:
Z D ( i , j ) ( YD ( i , j ) MF( 0 , 0 ) 2 f ) ( qbits 1)
Vi
2qbits / 3 Intra
2qbits / 6 Inter
67
1 11 1 1
1 1 ZD 1 11
WQD
1 1 1 1
1 1 1 11
Qu trnh co dn ti b gii m nh sau:
W'
W'
[W
D(i, j)
D (i , j )
D (i , j )
V( 0, 0 ) 2 floor ( QP / 6 ) 2
D (i , j )
(QP 12)
(QP 12)
68
1 WD1
WQD
1 1
Ng ra ca lng t ha khi 2x2 c thc hin nh sau:
Z D ( i , j ) ( YD ( i , j ) .MF( 0 , 0 ) 2 f ) ( qbits 1)
Trong qu trnh gii m, php bin i ngc c thc hin trc khi co dn.
1 ZD1
WQD
1 1
69
Trong
Yij
Qstep
tng ng vi
Z ij round (Wij .
PF
)
Qstep
Vi gi tr ca PF nh sau:
70
0
1
2
0.625 0.6875 0.8125
18
3
4
0.875 1
24
10
5
6
1.125 1.25
30
20
7
1.375
36
40
8
1.625
9
1.75
42
80
10 11 12
2 2.25 2.5
48 51
160
224
n gin ha php tnh trong phn mm tham kho b sung h s nhn MF v php
dch phi s nh phn, nhm trnh thc hin php tnh chia nn cng thc tng ng
s l Z ij round (Wij .
MF
)
2 qbits
a 2 * 2 qbits / Qstep
Qstep
0
1
2
3
4
5
0.625
0.6875
0.8125
0.875
1
1.125
V tr
(0,0),(2,0),(2,2),
(0,2)
13107
11916
10082
9362
8192
7282
V tr
(1,1),(1,3),(3,1),
(3,3)
5243
4660
4194
3647
3355
2893
V tr khc
8066
7490
6554
5825
5243
4559
71
floor(QP/6)
cng thc tng ng s l W ' ij Z ij .Vij .2
V d :
QP= 3, nn Qstep = 0.875
(i,j) = (1, 2) nn PF = ab = 0.3162 v 2floor (QP/ 6) = 1
V= (Qstep.PF.64) = 0.875 x 0.3162 x 64 = 18.
Wi'
= Zi j x 18 x1.
QP
0
1
2
3
4
5
V tr (1,1),(1,3),(3,1),
(3,3)
16
18
20
23
25
29
V tr khc.
13
14
16
18
20
23
Ng vo X :
i=0
i=1
i=2
i=3
j=0
5
9
1
19
j=1
11
8
10
6
j=2
8
4
11
15
j=3
10
12
4
7
i=0
i=1
i=2
i=3
j=0
140
-19
22
-27
j=1
-1
-39
17
-32
j=2
-6
7
8
-59
j=3
7
-92
31
-21
2 qbits
3
j=0
544
-40
96
-80
j=1
0
-100
40
-50
72
j=2
-32
0
32
-200
j=3
0
-250
80
-50
74
Hnh IV.28. Minh ha qu trnh m ha xen k
IV.3.3.10 Sp xp th t Slice.
K thut nn H.264/AVC cho php b m ha c th chn tn s v v tr ca nh I,
iu ny rt c ch cho nhng ng dng yu cu im truy cp ngu nhin, nh I
c s dng vi chu k 2 ln/giy. B m ha cng cho php chn s lng nh B
gia 2 cp nh tham kho bt k (I hoc P) da vo dung lng b nh trong b m
ha v c tnh ca nh c m ha. V d nh, mt bc nh ln c 2 nh B chia
thnh 2 nh tham kho lin tip, kiu sp xp ca nh I, nh P v nh B theo trt t
nh sau:
75
IV.3.4 M HA ENTROPY
M ha Entropy l mt k thut m ha khng tn hao c cc k hiu ng vo l
nhng h s lng t, vector chuyn ng, thng tin headerN gm nhiu loi m
ha nh m ha d on, m ha Huffman, m ha c chiu di bin i VLC v m
ha s hc nh phn BAC. Trong H.264/AVC s dng kiu m ha thch nghi theo ni
dung CA nh CAVLC v CABAC ngha l ch c mt nh x cho mt bng t m n
c thc hin theo thng k d liu, cn cc tiu chun trc th s dng mt bng
VCL cho mi phn t khc nhau. Cc thnh phn c php lp bn trn s c m
ha VLC hoc FLC, cn thnh phn c php lp bn di s c m ha VLC
hoc CABAC ty thuc vo kiu m ha Entropy. Khi c ch ch m ha Entropy
c ci v 0 th cc khi d liu d tha s c m ha CAVLC hoc m ha
VLC no nh m ha Ex-Golomb. Cc thng s cn m ha nh bng sau:
Thng s
M t
Ch nh mu khi trong MB c m ha
Truyn gi tr sai khc v QP ca nh trc
Ch s nh tham kho cho d on Inter
Truyn phn sai khc t vector chuyn ng d on
H s d liu d tha t cc khi 4x4, 2x2
Phm vi gi tr codeNum
01x0
1-2
001x1x0
3-6
0001x2x1x0
7-14
00001x3x2x1x0
15-30
000001x4x3x2x1x0
31-62
...
...
76
me
M t
nh x trc tip khng du, code_num = k.
L phin bn ca bng m Exp-Golomb, trong t m ngn b ct b.
nh x c du, s dng vector chuyn ng sai khc, delta QP v
nhng vector khc, gi tr k s c nh x vo gi tr code_num nh
bng IV. Vi cc gi tr code_num nh sau.
Code_num = 2 | k |
(k 0)
Code_num = 2 | k |1
(k> 0)
K t nh x, thng s K s c nh x vo code_num. Bng IV lit
k mt phn cc mu khi cho d on Inter, ch ra nhng khi 8x8
trong MB cha cc h s khc 0
Code_num
0
1
-1
2
-2
3
0
1
2
3
4
5
Code_num
0
1
2
3
4
5
77
6
7
78
4, 5, 6, 7
12
24
48
79
Gi tr
coeff token
TrailingOne sign
(4)
TrailingOne sign
(3)
TrailingOne sign
(2)
Level (1)
Level (0)
Total zeros
TotalCoeffs = 5,
TrailingOnes= 3 (use
Table 1)
0000100
run before(4)
run before(3)
run before(2)
run before(1)
run before(0)
1 (prefix)
+1 (use suffixLength = 0)
001 (prefix) 0 (suffix)
+3 (use suffixLength = 1)
111
ZerosLeft = 3; run before
10
=1
ZerosLeft = 2; run before
1
=0
ZerosLeft = 2; run before
1
=0
ZerosLeft = 2; run before
01
=1
ZerosLeft = 1; run before H s cui cng, khng cn m
=1
ha.
Thnh phn
Gi tr
80
Mng ng ra
0000100
0
1
1
coeff token
TrailingOne sign
TrailingOne sign
TrailingOne sign
Level
0010
111
10
1
1
01
Level
total zeros
run before
run before
run before
run before
TotalCoeffs = 5, TrailingOnes = 3
+
+1 (suffixLength = 0; tng chiu
di tin t sau khi gii m
+3 (suffixLength = 1)
3
1
0
0
1
Empty
1
-1, 1
-1, -1, 1
1, 1,1, 1
3, 1, 1,1, 0, 1
3, 1, 1,1, 1
3, 1, 1,1, 0, 1
3, 1, 1,1, 0, 1
3, 1, 1,1, 0, 1
3, 0, 1, 1,1, 0, 1
81
Nh phn
0
1
0
10s
110s
1110s
11110s
111110s
6
7
8
1111110s
11111110s
111111110s
Kiu ni dung
Kiu 0
Kiu 1
Kiu 2
0 ek 3
3 ek 3 3
33 ek
82
Kiu 5
Kiu 6
chui nh.
mc mp khi: cng lc ty thuc vo kiu d on Intra hay Inter, sai
s chuyn ng.
mc mu. Phn quyt nh l s khc nhau gia mu gc v mu c lng
t ha t cc h s bin i.
p1 p0 (QP)
bS! 0
p 0 q 0 (QP)
f (QP _ offset )
_ offset [ 6, 5, 4, 3, 2, 1, 0, 1, 2, 3, 4, 5, 6]
_ offset [6, 5, 4, 3, 2, 1, 0, 1, 2, 3, 4, 5, 6]
Khi cn c lc
84
Bc nh c chia thnh cc MB
Lc theo chiu dc
ngang
cho cc cnh ngang
Lc theo chiu
cho cc cnh dc
bS = 4 (Lc
mnh nht)
bS = 3
bS = 2
bS = 0 (khng
nh tham kho khc nhau hoc khc nhau v s lng nh tham kho.
lc)
P0 Q 0 (QP )
2.
P1 P1 (QP )
3.
Q 1 Q 0 (QP )
hay
Q2 Q0 (QP )
Trng hp bS {1, 2, 3}
Mt b lc p ng xung hu hn FIR-4 tap c dng lc cc gi tr p1, p0, q1, q0
to thnh cc gi tr p0 v q0. Nu l thnh phn luma v c |p2-p0|< th s s
dng mt FIR-4 tap khc lc cc gi tr p2, p1, p0 v q0 to ra p1. Cn nu |q2q0| < th s s dng mt FIR-4 tap khc lc cc gi tr q2, q1, q0 v p0 to ra
q1.
Trng hp bS = 4
Nu l thnh phn luma v c |p2 - p0| < , |p0 - q0| < round( / 4 ) th
S dng mt FIR-5 tap khc lc cc gi tr p2, p1, p0, q0 v q1 to ra p0
S dng mt FIR-4 tap khc lc cc gi tr p2, p1, p0 v q0 to ra p1
S dng mt FIR-5 tap khc lc cc gi tr p3, p2, p1, p0, v q0 to ra p2
S dng mt FIR-3 tap khc lc cc gi tr p1, p0, v q1 to ra p0
Nu l thnh phn luma v c |q2 - q0| < , |p0 - q0| < round( / 4 ) th
S dng mt FIR-5 tap khc lc cc gi tr q2, q1, q0, p0 v p1 to ra q0
S dng mt FIR-4 tap khc lc cc gi tr q2, q1, q0 v p0 to ra q1
86
Data Partitioning
87
.NAL
header
NAL
NAL
RBSP
header
header
Hnh IV.36. Cu trc dng bit.
RBSP
RBSP
SEI
Picture
parameter set
I slice
Picture
delimiter
P slice
P slice
M t
Thng s v kch thc, nh dng video, v tr nh x
MB, s lng nh tham kho, thng s lng t
Mng bo tin. Yu t ny khng cn thit cho vic gii
m ng th t chui video
ng bin gia cc nh, nu khng c th b gii m s
da vo s th t frame trong mi tin t slice phn
on
Cha tin t v d liu m ha
Ba dng phn vng nhm tng cng kh nng chng
li.
Ch nh bc nh k tip trong th t gii m l nh
IDR. (Khng cn thit)
Khng cn nh tip theo no c.
Cha d liu gi nhm tng s lng byte trong chui.
(Khng cn thit)
88
89
Video
MB : thng tin v
MB.
Params
Bitstream
Params
QTs
Misc
GOP
GOP
Time
GOP
Pict
Pict
Code (CBP)
Params
- Code Block Pattern
: ch r loi khi c m ho.
PSC
Type
Buffer
Params
SSC
Vert
Pos
Qscale
Addr
Iner
Type
Motion
vector
Encode
Params
Slice
MB
MB
Qscale
CBP
b0
Slice
b5
90
Hnh IV.38. Cu trc dng bit MPEG-4 H.264/AVC
CHNG V.
91
Cng ngh truyn hnh s ta khc phc c nhiu khuyt im ca truyn hnh
tng t nhng hn c l m ra cho ta mt tim nng pht trin v cng rng ln. C
th thy s h tr mang tnh bn cht cho cc hot ng tng tc l s khc nhau ch
yu, th hin tnh nng u vit ca cng ngh H.264/AVC so vi MPEG-2, l chun
hin ang c p dng rng ri trong cc h thng truyn hnh. Trn thc t cc hng
cung cp dch v truyn thng theo dng a phng tin u h tr chun
H.264/AVC trong cu trc h tng v sn phm ang trin khai ca mnh, nhm khc
phc nhc im ca cc m hnh truyn dn pht sng pht thanh v truyn hnh
ang s dng hin nay. Cc ng dng ca H.264 thc t ang trin khai nh:
V.1
IPTV l mng truyn hnh kt hp cht ch vi mng vin thng. Ni rng hn IPTV
l dch v gi tr gia tng s dng mng bng rng IP phc v cho nhiu ngi dng.
Cc user c th thng qua my vi tnh PC hoc my thu hnh ph thng cng vi STB
s dng dch v IPTV. c im ni bt ca IPTV l da trn nn cng ngh IP v
c kh nng tng tc. IPTV s dng chun nn H.264/AVC lm gim i mt na
bng thng cn thit phn phi video s cht lng DVB y mn hnh n khch
hng, v gim yu cu bng thng truyn dn truyn hnh s cht lng chun SDTV
xung 700 kb/s - c hai nm trong gii hn ca vng DSL 1.5 Mb/s. H.264 m ra cc
c hi mi v cng gim gi thnh p dng v gi thnh iu hnh khi so snh vi
MPEG-2. H.264 nn video hiu qu hn, gim gi thnh truyn dn qua cc kt ni v
tinh v mt t.
nc ta mt s Website cng cung cp th nghim cc chung trnh truyn hnh
trc tuyn nh VietNamNet, Cng ty VTC, i truyn hnh HTV ghi nhn s lng
truy cp rt ln, cho thy sc hp dn ca dch v ny i vi cng chng. Vi mng
bng hp truyn thng, ch mt s dch v n gin ca IPTV l c th thc hin c.
Cn c th trin khai thnh cng dch v IPTV th mng bng rng ng vai tr tin
quyt, bi v ch vi mng bng rng mi c th bo m cung cp y bng thng
theo yu cu cho cc dch v IPTV (nh truyn hnh, Video, Games, v.v...).
V.2
92
dng MPEG-2, v d nh c th pht 21-26 chng trnh SDTV hoc 5-6 chng trnh
HDTV trn mt transponder 36Mhz. Cng ngh ny thc s l b cng c hu hiu
cho cc dch v tng tc qua v tinh. Truyn hnh tng tc l mt phng thc
qung co truyn hnh mi kt hp im mnh gia tip th trc tip v truyn hnh,
qua ngi xem c th chn mua, xem thng tin chi tit... ch n gin qua mt thao
tc click, hoc trong khi xem chng trnh truyn hnh, ngi xem c th tham gia vao
cc tr chi qua cc hnh thc gi tin nhn SMS Truyn hnh HDTV tr thnh
mt mt sn phm thit yu trong cc gia nh. C khong hn 10 triu h gia nh
trn ton cu hin s dng HDTV, con s ny d kin s tng ln 52 triu vo nm
2009. y thc s l mt tin ch hp dn vi khn gi truyn hnh. S nh hng tch
cc n th trng phim nh, cng nh cc dch v qung b v gi c thp
V.3
93
94
D on chuyn
ng
END
Tm vector chuyn ng
trong filelastmov
Cu trc li cc block
4x4 tham kho
Bin i ICT cc
block 4x4 d tha
M filelastmov
Lng t cc h s
DCT
Lu li thnh file
lastmov
M ha Entropy
Bin i frame t
YUV sang RGB
Lu thnh file
lastmov
Ti to li MB t
cc block 4x4
Gii lng t
95
Gii m filelastmov
Hm main
Hm playmov
VI.3 KT QU M PHNG
Vi cng gi tr QP = 31, Frame th 1 ca bc nh foreman.yuv c nn bng k
thut H.264/AVC c dung lng v t s PSNR = dB nh sau
96
PH LC
function main()
clear all;
clc;
97
98
%%%%%
HAM MA HOA TUNG FRAME ANH
%%%%%%
function [avc,df] = mhframe(f,ftype,pf)
[M,N,i] = size(f);
% M = 176, N= 144,i = 3 TRONG f
mbsize = [M, N] / 16;
% PHAN CHIA THANH CAC MACROBLOCK
avc = struct('type',[],'mvx',[],'mvy',[],'scale',[],'coef',[]);
avc(mbsize(1),mbsize(2)).type = [];
pfy = pf(:,:,1);
df = zeros(size(f));
for m = 1:mbsize(1)
% VONG LAP THEO CHIEU CAO
for n = 1:mbsize(2)
% VONG LAP THEO CHIEU RONG
x = 16*(m-1)+1 : 16*(m-1)+16;% LAP TU 1-CAO
y = 16*(n-1)+1 : 16*(n-1)+16;% LAP TU 1-RONG
[avc(m,n),df(x,y,:)] = mhmblock(f(x,y,:),ftype,pf,pfy,x,y);
end
end
%%%%%%%%%%
HAM MA HOA MAROBLOCK %%%%%%%%
function [avc,dmb] = mhmblock(mb,ftype,pf,pfy,x,y)
persistent q1 q2;
if isempty(q1)
%Neu mang q1 la rong.
q1 = qintra;
q2 = qinter;
end
load nq;
%THONG SO BUOC LUONG TU
scale = nq;
avc.type = 'I';
% CAU TRUC AVC
avc.mvx = 0;
avc.mvy = 0;
% TIM VECTOR CHUYEN DONG CHO ANH P
if ftype == 'P'
avc.type = 'P';
[avc,emb] = getmotionvec(avc,mb,pf,pfy,x,y);
mb = emb;
% LAY PHAN SAI SO GIUA CAC FRAME P DE MA HOA
q = q2;
% NEU LA ANH P THI DU DOAN INTER
else
q = q1;
% NEU LA ANH I
end
% TIM VECTOR CHUYEN DONG CHO ANH B
if ftype == 'B'
avc.type = 'B';
[avc,emb] = getmotionvec(avc,mb,pf,pfy,x,y);
mb = emb;
% LAY PHAN SAI SO GIUA CAC FRAME B DE MHOA
q = q2;
else
q = q1;
end
% CHON KHOI VA TIEN HANH BIEN DOI DCT VA LUONG TU
b = getblocks(mb);
for i = 18:-1:1
avc.scale(i) = scale;
% DAT VECTOR LUONG TU CHO KHOI i
coef = dct2(b(:,:,i));
% BIEN DOI DCT HAI CHIEU CHO KHOI THU i
avc.coef(:,:,i) = round( 8 * coef ./ (scale * q));
end
% CAU TRUC LAI KHOI DE THAM KHAO
99
dmb = gmmblock(avc,pf,x,y);
%%%%%
PHAN CHIA MACROBLOCK THANH 18 KHOI 4x4 %%%%%
function b = getblocks(mb)
b = zeros([4, 4, 18]);
% TAO 18 MA TRAN 4x4 ZEROS
b(:,:,1) = mb( 1:4, 1:4, 1);
b(:,:,2) = mb( 1:4, 5:8, 1);
b(:,:,3) = mb( 1:4, 9:12, 1);
b(:,:,4) = mb( 1:4, 13:16, 1);
b(:,:,5) = mb( 5:8, 1:4, 1);
b(:,:,6) = mb( 5:8, 5:8, 1);
b(:,:,7) = mb( 5:8, 9:12, 1);
b(:,:,8) = mb( 5:8, 13:16, 1);
b(:,:,9) = mb( 9:12, 1:4, 1);
b(:,:,10) = mb( 9:12, 5:8, 1);
b(:,:,11) = mb( 9:12, 9:12, 1);
b(:,:,12) = mb( 9:12, 13:16, 1);
b(:,:,13) = mb( 13:16, 1:4, 1);
b(:,:,14) = mb( 13:16, 5:8, 1);
b(:,:,15) = mb( 13:16, 9:12, 1);
b(:,:,16) = mb( 13:16, 13:16, 1);
% HAI KHOI CHROM (GIA TRI TRUNG BINH CUA 4 KHOI BEN CANH)
b(:,:,17) = 0.25 * ( mb(1:4:15,1:4:15, 2) + mb(1:4:15,2:4:16, 2) ...
+ mb(2:4:16,1:4:15, 2) + mb(2:4:16,2:4:16, 2));
b(:,:,18) = 0.25 * ( mb(1:4:15,1:4:15, 3) + mb(1:4:15,2:4:16, 3) ...
+ mb(2:4:16,1:4:15, 3) + mb(2:4:16,2:4:16, 3) );
%%%% HAM TINH TOAN VECTOR CHUYEN DONG
%%%%%%%
function [avc,emb] = getmotionvec(avc,mb,pf,pfy,x,y)
mby = mb(:,:,1); % CHI TIM TRONG THANH PHAN Y
[M,N] = size(pfy);
% TIM KIEU MOI KHIA CANH
% maxstep = 10; % Largest allowable motion vector in x and y
% mvxv = -maxstep:maxstep;
% mvyv = -maxstep:maxstep;
% minsad = inf;
% for i = 1:length(mvxv)
% tx = x + mvxv(i);
% if (tx(1) < 1) | (M < tx(end))
%
continue
% end
% for j = 1:length(mvyv)
%
ty = y + mvyv(j);
%
if (ty(1) < 1) | (N < ty(end))
%
continue
%
end
%
sad = sum(sum(abs(mby-pfy(tx,ty))));
%
if sad < minsad
%
minsad = sad;
%
mvx = mvxv(i);
%
mvy = mvyv(j);
%
end
% end
% end
% TIM KIEU Logarithmic
100
step = 8;
% KICH THUOC BUOC TIM KIEM Initial step size for logarithmic search
dx = [0 1 1 0 -1 -1 -1 0 1]; % VECTOR CHI HUONG TIM KIEM
dy = [0 0 1 1 1 0 -1 -1 -1]; % [origin, right, right-up, up, left-up,
% left, left-down, down, right-down]
mvx = 0;
mvy = 0;
while step >= 1
minsad = inf;
for i = 1:length(dx)
tx = x + mvx + dx(i)*step;
if (tx(1) < 1) | (M < tx(end)) % NEU GIA TRI tx(1) <1 HOAC
continue
% M < GIA TRI tx CUOI CUNG
end
ty = y + mvy + dy(i)*step;
if (ty(1) < 1) | (N < ty(end))
continue
end
sad = sum(sum(abs(mby-pfy(tx,ty))));
if sad < minsad
ii = i
minsad = sad;
end
end
mvx = mvx + dx(ii)*step;
mvy = mvy + dy(ii)*step;
step = step / 2;
end
avc.mvx = mvx; % LUU VECTOR CHUYEN DONG
avc.mvy = mvy;
emb = mb - pf(x+mvx,y+mvy,:); % MACROBLOCK SAI SO
%%%%%%%%%%%%%%%%%%
HAM GIAI MA
%%%%%%%%%%%%%%%%%%
%%
function mov = giaima(avc)
movsize = size(avc{1});
mov = repmat(uint8(0),[16*movsize(1:2), 3, length(avc)]);
pf = [];
for i = 1:length(avc)
% GIAI MA TOAN BO KHOI TRONG AVC
f = gmframe(avc{i},pf); % GIAI MA FRAME
pf = f;
% LUU FRAME TRUOC DO
f = yuv2rgb(f);
% BIEN DOI FRAME SANG RGB
f = min( max(f,0), 255); % GIOI HAN MOVIE TRONG KHOANG 8 BITS
mov(:,:,:,i) = uint8(f); % LUU FRAME
progressbar(i/(length(avc)));
end
%%%%%%%%%%% HAM GIAI MA FRAME
%%%%%%%%%%%%%
function fr = gmframe(avc,pf)
mbsize = size(avc);
% KICH THUOC MB CHINH LA KICH THUOC FILE
M = 16 * mbsize(1);
N = 16 * mbsize(2);
fr = zeros(M,N,3);
for m = 1:mbsize(1)
% LAP TOAN BO MB
for n = 1:mbsize(2)
x = 16*(m-1)+1 : 16*(m-1)+16;% TAO LAI FRAME
y = 16*(n-1)+1 : 16*(n-1)+16;
fr(x,y,:) = gmmblock(avc(m,n),pf,x,y);% GOI HAM GIAI MA MB CHO KHOI
101
102
% CAU TRUC B
mb = mb + putblocks(b);
%%%%%%%%% HAM BIEN DOI TU RGB SANG YUV
%%%%%%%%%%%
function yuv = rgb2yuv(rgb)
% BIEN DOI TRUOC KHI MA HOA
m = [ 0.299 0.587 0.144; %Y = 0.299R + 0.587R + 0.144B
-0.168736 -0.331264 0.5;
% MA TRAN BIEN DOI
0.5 -0.418688 -0.081312];
% LAY DU LIEU MOVIE
[nr,nc,c] = size(rgb);
rgb = reshape(rgb,nr*nc,3);
% TAI TAO CHO MA TRAN NHAN
% MA HOA MAU BIEN DOI
yuv = m * rgb';
yuv = yuv + repmat([0; 0.5; 0.5],1,nr*nc);
yuv = reshape(yuv',nr,nc,3);
% TAI TAO LAI ANH GOC
%%%%%%%%%%%%%%% HAM BIEN DOI TU YUV SANG RGB %%%%%%%%%%
function rgb = yuv2rgb(yuv)
% BIEN DOI SAU KHI GIAI MA
m = [ 0.299 0.587 0.144;
-0.168736 -0.331264 0.5;
0.5 -0.418688 -0.081312];
m = m^-1;
% LAY NGHICH DAO MA TRAN m
[nr,nc,c] = size(yuv);
% LAY DU LIEU MOVIE
yuv = reshape(yuv,nr*nc,3);
% TAI TAO LAI CHO MA TRAN YUV
rgb = yuv - repmat([0, 0.5, 0.5],nr*nc,1);% MA HOA BIEN DOI MAU
rgb = m * rgb';
% rgb' hoan vi cua rgb
rgb = reshape(rgb',nr,nc,3);
% TAI TAO LAI ANH GOC
%%%%%%%%%%%% BANG LUONG TU CHO ANH INTER 4x4 P VA B %%%%%
function q = qinter
q = [17,17,16,16;
17,16,15,15;
16,15,15,15;
16,15,15,15];
%%%%%%%%%%% BANG LUONG TU CHO ANH INTRA 4x4 %%%%%%%
function q = qintra
q = [ 9,13,18,21;
13,18,21,24;
18,21,24,27;
21,24,27,30];
Hm plotvector.m
function plotvector
load lastmov;
[M,N] = size(avc{1});
for f = 1:length(avc)
if avc{f}(1,1).type == 'I'% neu la anh I thi bo qua
continue
end
for i = 1:M
for j = 1:N
mvx(i,j) = avc{f}(i,j).mvy;
mvy(i,j) = avc{f}(i,j).mvx;
end
end
103
figure
quiver(flipud(mvx),flipud(mvy))
set(gca,'XLim',[-1, N+2],'YLim',[-1, M+2])% CAI DAT TOA DO CUA HINH
title(sprintf('Vector chuyen dong cho anh thu %i',f))
end
Hm playmov.m
function playmov(n)
load lastmov
for i = 1:size(mov,4)
m(i).cdata = uint8([mov(:,:,:,i) mov2(:,:,:,i)]);% mov anh goc, mov2 anh giai nen
m(i).colormap = [];
end
figure('Position',[30,100,750,400,]);
axs=axes('Position',[0.05 0.15 0.8 0.55]);
xlabel( 'Anh GOC ------------------------------------------------------>>>>>> Anh NEN');
movie(m,n,5); % Play mang m n lan, nhung lan sau play voi toc do 5fps
104
[7] Iain E. G. Richardson, H.264 And MPEG-4 Video Compression, The Robert
Gordon University, Aberdeen, UK
[8] John Arnold, Michael Frater, Mark Pickering, Digital Television Technology and
Standards, The University of New South Wales, ADFA Canberra, ACT, Australia
[9] JVT Draft ITU-T recommendation and final draft international standard of joint
video specification (ITU-T rec. H.264 ISO/IEC 14496-10 AVC),
[10] THOMAS SIKORA, MPEG-1 and MPEG-2 Digital Video Coding Standards,
McGraw Hill Publishing Company.
[11] T. Wiegand, G.J. Sullivan, G. Bjontegaard, A. Luthra, Overview of the
H.264/AVC Video Coding Standard,
[12] Siwei Ma, Xiaopeng Fan, Wen Gao, Low Complexity Integer Transform and
High Definition Coding
[13]
Cc
trang
web
http://google.com,
http://mathexchange.com
http://en.wikipedia.org
http://www.mathworks.com/,
http://media.xiph.org/video/derf/
http://www.stanford.edu/class/ee398b/samples.html
105