Bao Cao Luan Van Final

I HC QUC GIA THNH PH H CH MINH
TRNG I HC KHOA HC T NHIN
TRN SN HI
NGHIN CU PHNG PHP KT HP CC C TRNG MU SC HNH DNG V V TR TRUY VN NH
LUN VN THC S NGNH TIN HC
NGI HNG DN KHOA HC: T.S. L HONG THI
Thnh ph H Ch Minh - 2007
LI CM N
Xin chn thnh bit n TS. L HONG THI tn tnh hng dn, gip ti trong sut qu trnh lm lun vn. Xin chn thnh cm n thy c trong khoa Cng Ngh Thng Tin tn tnh ging dy v ch bo ti cng cc anh ch ng nghip trong c quan cng tc v bn b to iu kin thun li, ng gp nhng kin qu bu cho ti trong sut qu trnh hc tp v hon thnh lun vn ny. Mc d rt c gng, song lun vn ny khng th trnh khi nhng thiu st, knh mong c s ch dn ca cc qu thy c v cc bn.
Tp. H Ch Minh, ngy 31 thng 12 nm 2007 Hc vin Cao hc Tin hc kha 14
TRN SN HI
LI M U
Tr tu nhn to (Artificial Intelligence AI) pht trin hn na th k qua. C rt nhiu cng trnh trong v ngoi nc nghin cu cc phng php s dng tr tu nhn to gii cc bi ton hc ba trn my tnh kh thnh cng. Trong phm vi lun vn ny ch xin trnh by nghin cu v phng php s dng m hnh lin mng Nron gii bi ton truy vn nh. B cc ca lun vn gm 5 chng: Chng 1: Tng quan v truy vn nh v cc hng tip cn. Chng ny trnh by v tnh hnh nghin cu trong v ngoi nc v lnh vc truy vn nh cng nh cc thun li, kh khn v thch thc ca vic gii bi ton truy vn nh. Chng 2: xut m hnh lin mng meta-Nron. Chng ny trnh by v vic ci tin m hnh kt hp mng Nron v thut gii di truyn (NN_GA) ca tc gi L Hong Thi thnh m hnh lin mng meta-Nron gii bi ton trong trng hp dng b tham s tng qut (m, n, L). Trong , m l s vector c trng ca mu X, n l s chiu ca mi vector c trng v L l s phn hoch cho cc mu X. Chng 3: Mt p dng ca h thng lin mng meta-Nron. Chng ny trnh by qu trnh xy dng mt h thng lin mng c th vi b tham s (m=4, n=5, L=3) gii bi ton truy vn nh vng du lch. Chng 4: Chng trnh ng dng. Chng 5: Kt lun.
MC LC
DANH MC BNG .........................................................................................4 DANH MC HNH V V BIU ............................................................5 Chng 1: TNG QUAN V TRUY VN NH V CC HNG TIP CN.................................................................................................9 1.1. Gii thiu chung ..................................................................................... 9 1.2. Cc phng php truy vn nh chnh................................................ 14 1.2.1 Truy vn theo li ch thch (annotation, key words) ..................14 1.2.2 Truy vn nh da trn ni dung (CBIR)......................................14 1.2.3 Truy vn nh theo i tng (OBIR) ...........................................17 1.2.4 Truy vn nh kt hp vi my hc ...............................................17 1.3. Truy vn nh da trn ni dung......................................................... 18 1.3.1 K thut truy vn nh da trn ni dung mc 1.........................19 1.3.2 Truy vn nh theo ng ngha.........................................................20 1.3.3 Cc vn thng gp phi ..........................................................20 1.3.4 Cc cch tip cn hin ti v gii php c chn......................21 1.4. Mt s h thng truy vn nh c th .................................................. 22 1.4.1 Truy vn nh da trn histogram mu ........................................22
1.4.2 Truy vn nh s dng ch mc mu sc, hnh dng v v tr .....24 1.4.3 Truy vn nh da trn mng Nron.............................................27 Chng 2: XUT H THNG LIN MNG META-NRON ........34 2.1 Mng Nron ........................................................................................... 34 2.2 H thng lin mng meta-Nron.......................................................... 36 2.2.1 Gii thiu cc phng php kt hp.............................................36 2.2.2 Kin trc ca h thng lin mng meta-Nron............................43 2.2.3 Qu trnh hun luyn ca h thng lin mng.............................48 2.2.4 Qu trnh nh gi mt mu X qua h thng lin mng ............52 2.3 H thng lin mng meta-Nron cho bi ton truy vn nh............. 53 Chng 3: MT P DNG CA H THNG LIN MNG META-NRON ...........................................................................58 3.1 Rt trch cc c trng ca nh........................................................... 58 3.2 Kin trc h thng lin mng meta-Nron ......................................... 61 3.3 Xy dng h thng lin mng meta-Nron......................................... 62 Chng 4: CHNG TRNH NG DNG ................................................70 4.1 Qu trnh x l nh trc khi a vo h thng lin mng ............. 70 4.2 Rt trch cc c trng v lu vo c s d liu................................ 73 4.3 Tm cu hnh mng ti u..................................................................... 74
4.4 Thc hin truy vn tm vng du lch ................................................... 77 Chng 5: KT LUN...................................................................................79 TI LIU THAM KHO ..............................................................................82 PH LC A: Mng Nron Lan Truyn Ngc...........................................86 PH LC B: C S D Liu nh.................................................................89 PH LC C: C S D Liu c Trng .....................................................93
DANH MC BNG BIU

Bng 1.1: Thng k la chn c trng ca mt s h thng truy vn nh........ 15 Bng 1.2: Bng thng s 25 mu c bn ............................................................ 25 Bng 1.3: Bng kt qu thc nghim h thng ca B.G. Prasad, K.K Biswas v S.K. Gupta .......................................................................................... 26 Bng 1.4: Kt qu h thng NNFIR.................................................................... 33 Bng 3.1: Biu din nh thnh cc c trng ..................................................... 60 Bng 3.2: Thc nghim phn hoch H Long theo mng con............................ 63 Bng 3.3: Thc nghim phn hoch H Ni theo mng con .............................. 64 Bng 3.4: Thc nghim phn hoch Nha Trang theo mng con......................... 64 Bng 3.5: Thc nghim phn hoch qua ton h thng lin mng..................... 66 Bng 4.1: Kt qu thc nghim mt s phng php......................................... 78 Bng C.1: M t c s d liu c trng ............................................................ 94
DANH MC HNH V V BIU

Hnh 1.1: H thng truy vn nh ca Yahoo..................................................... 10 Hnh 1.2: M hnh rt trch c trng thi gian thc........................................ 11 Hnh 1.3: M hnh tch ring c s d liu c trng ...................................... 12 Hnh 1.4: H thng truy vn nh vi c s tri thc .......................................... 13 Hnh 1.5: H thng truy vn nh kt hp mu sc v kt cu .......................... 22 Hnh 1.6: Hai dng lc mc xm............................................................... 23 Hnh 1.7: Qu trnh phn tch mc xm ........................................................... 24 Hnh 1.8: Phn vng v tr ................................................................................. 26 Hnh 1.9: H thng truy vn nh NNFIR.......................................................... 27 Hnh 1.10: nh gc ........................................................................................... 29 Hnh 1.11: nh qua php bin i wavelet song trc giao mc 1.................... 29 Hnh 1.12: nh qua php bin i wavelet song trc giao mc 2.................... 30 Hnh 1.13: nh qua php bin i wavelet song trc giao mc 3.................... 30 Hnh 1.14: Mi quan h gia khong cch, RBNF v UF................................ 32 Hnh 1.15: Kt qu ln truy vn ln u ........................................................... 32 Hnh 1.16: Kt qu truy vn sau khi nhn phn hi.......................................... 33 Hnh 2.1: Mng Nron truyn thng.................................................................34
Hnh 2.2: Mu X c trng bi m vector..........................................................37 Hnh 2.3: Tng th h thng lin mng ...........................................................37 Hnh 2.4: Qu trnh x l ca cc mng con.....................................................38 Hnh 2.5: Phng php kt hp trung bnh kt qu cc mng con ...................39 Hnh 2.6: Kt hp mng Nron v thut gii di truyn (NN_GA) ...................40 Hnh 2.7: Tng quan m hnh kt hp bng h thng lin mng .....................42 Hnh 2.8: Gp kt qu cc mng con chun b a vo mng ton cc ...........44 Hnh 2.9: a cc vector Ri vo mng kt hp ...............................................46 Hnh 2.10: Phn lp mu m vector ...................................................................46 Hnh 2.11: M hnh lin mng (m, n, L)...........................................................47 Hnh 2.12: Hun luyn mng con RN1 ca h thng lin mng meta-Nron (m, n, L) ............................................................................................49 Hnh 2.13: Hun luyn mng thnh phn TP1 ca h thng lin mng meta-Nron (m, n, L) .......................................................................51 Hnh 2.14: S rt trch c trng .................................................................54 Hnh 2.15: Kin trc h thng lin mng meta-Nron p dng trn nh .........56 Hnh 3.1: S rt trch c trng ...................................................................58 Hnh 3.2: nh u vo ......................................................................................60 Hnh 3.3: H thng lin mng (m=4, n=5, L=3)...............................................62
Hnh 3.4: Biu thc nghim mng phn lp H Long.................................67 Hnh 3.5: Biu thc nghim mng phn lp H Ni ...................................67 Hnh 3.6: Biu thc nghim mng phn lp Nha Trang..............................67 Hnh 3.7: Tng quan qu trnh x l ca h thng lin mng c th (m=4, n=5, L=3) ...............................................................................69 Hnh 4.1: nh gc dng truy vn......................................................................70 Hnh 4.2: Phn nn v phn ni ........................................................................71 Hnh 4.3: Vng 1...............................................................................................71 Hnh 4.4: Vng 2...............................................................................................72 Hnh 4.5: Vng 3...............................................................................................72 Hnh 4.6: Vng 4...............................................................................................73 Hnh 4.7: Cp nht c trng vo c s d liu................................................74 Hnh 4.8: Hun luyn vi s nt n ti u ........................................................76 Hnh 4.9: Kt qu truy tm vng du lch ...........................................................77 Hnh 4.10: Chc nng thng k xc nh vng du lch.....................................78 Hnh 4.11: Biu so snh mt s phng php .............................................79 Hnh A.1: Mng Nron .....................................................................................86 Hnh A.2: Hot ng ca mt Nron................................................................86 Hnh A.3: Mt s hm truyn ...........................................................................87
Hnh B.1: nh hun luyn 1 .............................................................................89 Hnh B.2: nh hun luyn 2 .............................................................................89 Hnh B.3: nh hun luyn 3 .............................................................................90 Hnh B.4: nh hun luyn 4 .............................................................................90 Hnh B.5: nh kim tra 1..................................................................................91 Hnh B.6: nh kim tra 2..................................................................................91 Hnh B.7: nh kim tra 3..................................................................................92 Hnh B.8: nh kim tra 4..................................................................................92 Hnh C.1: C s d liu c trng ....................................................................93
Chng 1: TNG QUAN V TRUY VN NH V CC HNG TIP CN

1.1 Gii thiu chung
X l nh l lnh vc nghin cu ang pht trin khng ngng bi tnh trc quan sinh ng cng nh kh nng p dng vo thc t ln. Hin x l nh ang ginh c nhiu s quan tm ca cc nh nghin cu trong v ngoi nc. Trong x l nh, truy vn nh c th ni l lnh vc i hi s nghin cu tng hp: nghin cu x l nh rt trch cc c trng, p dng cc tnh ton ton hc cao cp xc nh mc tng ng gia hai nh v s t chc sp xp ch mc cho c s d liu nh. Chnh v th truy vn nh l lnh vc nghin cu em li nhiu th v. Hn na, cng vi s pht trin ca phn mm v phn cng, khi lng nh pht trin khng ngng v ngy cng ln. Mt s lng ln cc nh ang c s dng trong th vin nh s v trn web. V vy nhu cu tm kim nh l mt nhu cu tt yu. Hin ti, truy vn nh ng dng trong kh nhiu lnh vc nh: qun l nhn hiu logo, truy tm ti phm, ng dng trong y khoa, qun s Bi ton tm kim nh trong C S D Liu (CSDL) nh c a ra t cui nm 1970 v c nhiu cch gii quyt khc nhau. Cho n ngy nay c rt nhiu h thng truy vn nh (c thng mi ln thc nghim) v ang c pht trin. C hai dng CSDL nh l: CSDL nh tnh v CSDL nh ng (nh video). Trong nghin cu ny, ch xin xem xt n phm vi nh tnh. Mc tiu ca h thng truy vn nh l tm ra nh ng vi nhu cu ca ngi dng:
10
Hnh 1.1: H thng truy vn nh ca Yahoo
Cc h thng truy vn nh hin nay rt a dng nhng nhn chung th chng c phn bit bi: cc c trng m h thng rt trch t nh lm c s truy vn v phng php phn on nh c s dng trong h thng truy vn, cch thc t chc ch mc cho CSDL nh, o s tng ng gia hai nh. o s tng ng l hm s d:HxH R+ tha cc tnh cht sau vi mi nh I, J, K trong khng gian cc nh H [15]: Tnh t tng ng (self similarity): d(I, I) = d(J, J) Tnh i xng (synmetry): d(I, J) = d(J, I) Tnh bc cu (triangular inequality): d(I, K) + d(K, J) >= d(I, J)
11
Tnh ti tiu (minimality): d(I, J) >= d(I, I) Cc h thng truy vn nh thng tun theo mt trong cc m hnh sau:
CSDL nh
Xut ra
Tp nh kt qu
Rt trch c trng v o s tng ng nh truy vn
Yu cu truy vn
Hnh 1.2: M hnh rt trch c trng thi gian thc
M hnh ny n gin, d ci t nhng a vo ng dng thc t s chm v nhc im: khi c mt yu cu truy vn nh h thng khng nhng phi rt trch cc c trng ca nh truy vn m cn phi rt trch cc c trng ca nh trong tp nh ca CSDL nh, sau tnh ton mc tng ng gia chng. M hnh ny thch hp ci t th nghim v ghi nhn kt qu trong qu trnh thc nghim la chn cc c trng cn rt trch cng nh o s tng ng hiu qu nht.
12
CSDL Trch CSDL Cc c c nh trng trng ca nh Tnh o s tng ng Trch c trng ca nh truy chn c nh truy vn trng vn
Hnh 1.3: M hnh tch ring c s d liu c trng
Tp nh Xut ra kt qu
M hnh ny xy dng nn CSDL cc c trng tng ng vi CSDL nh nn khi pht sinh mt yu cu truy vn, h thng ch rt trch cc c trng ca nh truy vn v so snh vi cc c trng trong CSDL c trng nn kh nng thc thi nhanh hn nhng c s phc tp hn trong ci t so vi m hnh trn. M hnh ny thch hp xy dng ng dng sau khi th nghim v la chn o s tng
13
ng ti u, cc c trng cn thit phi rt trch v phng php truy vn ti u cho bi ton cn gii quyt. M hnh ny cn mt c ch m bo gia CSDL cc c trng v CSDL nh phi khp vi nhau sau mt thi gian s dng, trnh trng hp ngi dng v tnh hay c thay i CSDL c trng khng cn tng ng vi CSDL nh. Tm li, xy dng h thng truy vn nh, cn gii quyt 3 vn chnh sau: Rt trch cc c trng trn nh (Feature Exaction) Xc nh o s tng ng gia hai nh (Similarity Measure) Lp ch mc cho CSDL nh (Image Indexing) T xy dng nn cc thnh phn cho h thng truy vn nh:
nh truy vn H thng truy vn nh Rt trch c trng C s tri thc
CSDL nh
Lp ch mc
Biu din ca nh truy vn
o s tng ng
CSDL cc c trng
nh kt qu
Hnh 1.4: H thng truy vn nh vi c s tri thc
14
1.2 Cc phng php truy vn nh chnh

1.2.1 Truy vn theo li ch thch (annotation, key words) Cc t kha hay cc li ch thch c a vo m t thng tin trong nh v cc t kha hay li ch thch cng c dng lm ch mc. Vic truy vn nh n gin ch l s so khp cc t kha . Cch lm ny ch thch hp khi cc nh trong CSDL nh c ni dung khng qu phc tp. Tuy nhin, hn ch ca cch lm ny l khi CSDL nh ln th vic b sung t kha hay li ch thch s tn nhiu chi ph tnh ton v kh kh khn. Hn na, c vn s khng th miu t bng li ch thch m phi th hin bng th gic ca nh. Ngoi ra, cc h thng truy vn nh da trn t kha hay li ch thch s c s khng ng nht do nhng ngi s dng khc nhau s cho ra cc t kha khc nhau. Bn cnh vic truy tm ti liu vn bn, cc b my tm kim ca www.search.yahoo.com hay www.google.com u h tr truy vn nh da theo cc t kha. y chnh l cc h thng truy vn nh da trn t kha hay li ch thch. 1.2.2 Truy vn nh da trn ni dung (CBIR) H thng truy vn nh da trn ni dung (Content-Based Image Retrieval vit tt l CBIR) l h thng truy vn nh da trn vic t ng rt trch mt s thng tin c trng trong nh nh: mu sc, kt cu, v tr, hnh dng. Phng php ny c nhiu ngi nghin cu vi rt nhiu cch tip cn khc nhau; do rt nhiu h thng truy vn nh da trn ni dung ra i nh: QBIC, VisualSeek, WebSeek v BlobWorld... Mi h thng s truy vn da trn mt s c trng nht nh no v c nhiu ty chn khc nhau ngi dng c th truy vn nh theo mu sc, kt cu, hnh dng hay thm ch l theo t kha. Theo thng k ti www.aa-
15
lab.cs.uu.nl/cbirsurvey v mc la chn c trng truy vn ca mt s h thng truy vn nh da trn ni dung c th nh sau:

Bng 1.1: Thng k la chn c trng ca mt s h thng truy vn nh
H thng Query Based Image Content (QBIC) l h thng truy vn da trn s phc tho do IBM pht trin. Ngi s dng xy dng mt phc tho, v ra v la chn mu cng kt cu da theo nh truy vn. Cc c trng mu s dng l gi
16
tr mu trung bnh trong khng gian RGB. Cc c trng v hnh dng s dng l dng trn, lch tm v hng ca trc chnh. H thng ch mc xy dng da vo cu trc cy R* Tree. o tng ng v mu trung bnh l d2avg(x,y)=(xavgyavg)t(xavg-yavg); cn v hnh dng th s dng o Euclide c trng s. H thng VisualSeek l h thng truy vn da vo cc c trng trc quan ca nh, s dng khng gian 166 mu HSV. S tng ng gia hai nh c xc nh theo s tng ng ca cc vng trong nh. tin hnh truy vn, trc tin ngi dng phi phc ha mt s vng trn nh. Sau chn mu cho mi vng, ng thi xc nh v tr, ln ca vng. H thng s s dng hm so khp sau tm cc hnh ging vi nh truy vn d(cq,ct)=(cq-ct)tA(cq-ct), trong cq,ct l hai tp mu ca hai nh v A=(a[i,j]) l ma trn tng ng ca cc mu. H thng WebSeek l h thng truy vn nh trn web theo danh mc nh cho trc v s dng php bin i wavelet: su tp nh sau phn lp nh, to ch mc v cui cng l tm kim v hin th. Ngi dng phi chn ch trong danh mc, h thng s s dng hm so khp sau:
d (hq , ht ) = (hq ht ) t A(hq ht ) q + t 2k with h [ k ] r hq [k ] rt [k ]
q
(1.1)
tm kim trong ch tng ng nh ging nht. H thng BlobWorld l h thng truy tm theo nh mu da trn vic rt trch cc d liu im nguyn thy cng cc c tnh ging nhau v mu sc, kt cu v hnh dng. Mu sc s c biu din di dng histogram 218 mu, kt cu c trng bi s tng phn v tnh khng thng ng; cn cc c trng hnh dng tnh theo vng vi trng tm v hng. nh truy vn theo s phc tho ca cc vng ring bit. Hm o s tng ng l d(h1, h2)=(h1-h2)TA(h1-h2), vi A=(aij) l ma trn i xng th hin s tng ng gia mu i v j.
17
1.2.3 Truy vn nh theo i tng (OBIR) H thng truy vn nh da vo i tng Object Based Image Retrieval (OBIR) ang c nghin cu. R rng truy vn theo i tng s rt gn vi nhu cu thng thy ca ngi s dng v ging theo nhn thc ca con ngi. V d tm tt c cc v tr xe (c biu tng Parking) Tuy vy chi ph cho vic d tm ra i tng l khng nh v kh nng trch ra chnh xc i tng trong nh cng khng d bi l nh ngha th no l i tng trong nh cho ng vi ngha ca i tng trong thc t. V th ch ring vic nhn din ra i tng hay nhn dng mt ngi cng l mt ti nghin cu. i vi phng php ny th yu t quyt nh l lm sao rt trch ra chnh xc cng mt i tng trong cc nh khc nhau (cc hon cnh xut hin khc nhau ca cng mt i tng). 1.2.4 Truy vn nh kt hp vi my hc ci thin hiu qu truy vn, ngi ta xy dng h thng truy vn nh kt hp vi my hc c kh nng nhn phn hi t ngi dng. Nng cao hiu qu truy vn qua qu trnh hun luyn. V d nh truy vn CSDL nh p dng m hnh Mediator Markov Model (MMM) ca tc gi Nguyn Hu Lc. Kt qu ca h thng ny cho thy: trong 1048 nh th nghim vi 40 truy vn mu sau khi c 200 phn hi: s nh tm c gn bng 795, s nh tm c ng gn 510 v s nh ng trong CSDL 670. (Ngha l t l Precision=0.64 v t l Recall l 0.76) [4]. Trong cc h thng truy vn nh p dng mng Nron, da trn phn hi ca ngi dng h thng thay i cc trng s quan h gia cc c trng trong nh (nh mu sc, hnh dng). V d nh h thng Nron Netwrok based Flexible Image Retrieval (NNFIR) ca HYOUNG K. LEE and SUK I. YOO s dng hm
18
Radial Basis Function (RBF) xc lp mi quan h phi tuyn gia cc c trng c kt qu truy vn vi t l Precision l 81.70% v t l recall l 54.22% [13]. Ngoi ra, cc nh nghin cu th nghim nhng Fuzzy Logic vo vic truy vn nh nhng cha thnh cng v cha c hm o s tng ng thch hp cho s m bi nguyn nhn cc hm tnh ton n gin trn s m th tt. Trong khi cc tnh ton cao cp phc tp trn s m vn cn hn ch. V d nh phng php nhng Fuzzy Logic vo Truy vn nh da trn ni dung (Embedding Fuzzy Logic in Content Based Image Retrieval) ca Constantin Vertan, Nozha Boujemaa truy vn nh da trn Fuzzy Histogram th nghim vi nhiu o khc nhau (Zadeh, Algebaric, Lukasiewicz, Hamacher , L1) kt qu truy vn t l Precision u nh hn 70.00% [21]. Sau ny,Yixin Chen v James Z. Wang (2002) xy dng mt h thng truy vn nh theo vng da vo Fuzzy logic s dng o Unified feature matching (UFM) cho kt qu kh kh quan. Bn cnh , s dng my hc Support Vector Machine (SVM) da trn cc phn hi ca ngi dng xc nh nh kt qu tr ra no l ging vi nh truy vn v nh kt qu tr ra no l khc vi nh truy vn. Sau , h thng s a ra tp kt qu chnh xc hn. V d nh h thng Support Vector machine Learning for Image Retrieval ca Lei Zhang, Fuzong, Bo Zhang cho t l recall l 0.743. Phng php ny i hi c ch ngn chn s phn hi sai ca ngi dng, ng thi cn c mt qu trnh hun luyn cho my hc th h thng mi hot ng tt c.
1.3 Truy vn nh da trn ni dung

Truy vn nh da trn ni dung l s truy vn nh trong CSDL nh bng cch t ng rt trch cc c trng c bn hay ng ngha trong nh truy vn v so snh vi cc c trng ca cc nh trong CSDL. rt ra cc c trng trong nh ngi ta phi s dng cc php bin i nh Wavelet, Fourier, DCT, hay cc b lc Gabor, b lc trung bnh,
19
1.3.1 K thut truy vn nh da trn ni dung mc 1 Truy vn nh da trn ni dung mc 1 l s truy vn da trn cc c trng c bn nh mu sc, hnh dng, kt cu, v tr ca cc thnh phn trong nh. V d: tm cc hnh c cha ngi sao vng nm cnh hay tm cc hnh c s im nh mu chim , cn li l mu xanh Truy vn nh mc ny c p dng rng ri trong thc t: tm bn v thit k, ng dng qun l ng k logo (ngi dng a vo mt nh mun ng k lm logo cho t chc ca mnh, h thng s kim tra xem nh logo c ngi ng k hay cha nu c ng k h thng s tr ra nh logo ging vi nh mun ng k trong c s d liu cc nh logo c ng k ca h thng) Mu sc l mt yu t rt quan trng trong nh, c rt nhiu phng php truy vn nh da trn s tng t v mu sc. Thng cc phng php truy vn nh da theo mu sc dng histogram mu. V d h thng truy vn nh da trn histogram ca Lm Th Ngc Chu, Trng i Hc Khoa Hc T Nhin, Khoa Cng Ngh Thng Tin, 2003 [1]. Cc h thng ny thng t b st, ngha l nh cn tm lun xut hin trong tp nh kt qu tr ra nhng t l bt nhm rt cao hn 50%. V kt cu, vic truy vn nh da trn kt cu c v l khng hiu qu nhng c th dng n phn bit cc vng hay i tng c mu sc tng ng nh bu tri v bin c th rt tt Hnh dng l khi nim c nh ngha tt hn kt cu v cc i tng t nhin c th phn bit nhau bi hnh dng. Cc c trng v hnh dng c s dng thng phi c lp v kch thc v hng. V d c trng v t s gia chu vi v din tch, ng bin, hnh dng trn
20
1.3.2 Truy vn nh theo ng ngha Truy vn nh da theo ng ngha c hai cp : ng ngha cp thp da trn vic rt trch mt s c tnh logic nh tm tt c cc hnh c thp Eiffel; cn ng ngha cp cao th da trn cc thuc tnh tru tng nh tm cc hnh c ngi chu ang khiu v. Phn ln cc k thut truy vn nh trong CBIR hin nay u da trn cc c trng c bn mc 1. c mt s cng trnh truy vn nh da theo ng ngha cp thp nh phng php ca Ranta v Grimson dng cc mi lin h v mu sc rt ra t s phn gii cp thp ca nh xy dng nn cc mu do ngi dng nh ngha. Cn cc cng trnh nghin cu truy vn nh da trn cc c trng ng ngha cp cao rt t. Hin ti ch c mt s cng trnh ang nghin cu nhn bit nh hong hn v bnh minh hay l nh th hin thi tit lnh hay m p 1.3.3 Cc vn thng gp phi H thng truy vn nh da vo ng ngha thng gp phi vn v rt trch v nhn dng c trng ng ngha trong nh v tng ng tng th gia cc c trng ng ngha vi nhau. V d nh 1 c bng n trn mu , nh 2 c bng n trn mu cam, nh ba c bng n elp mu . Vi trng hp ny vic rt trch chnh xc cc ng ngha bng n hnh g v mu g trong mi nh l khng d. Hn na, nh 1 s ging nh 2 hay nh 1 ging nh 3 cng l mt vn h thng cn x l. V nh 1 khc v mu v ging nhau v hnh dng n vi nh 2 nhng nh 1 li khc v hnh dng n v ging v mu vi nh 3. Phng php truy vn nh da trn cc c trng c bn chng minh c phn no hiu qu ca n qua cc h thng CBIR mc 1 ang c trin khai QBIC, VisualSeek, BlobWorld, vi hiu qu truy vn tng i. Nhng mi mt
21
cch la chn c trng c bn no dng truy vn thng cng ch ti u trong mt s loi nh ny m khng tt trong loi nh khc. C th nh, nu dng histogram s c v s nh khc nhau nhng li c cng histogram, ngc li nu dng hnh dng th s hn ch khi thc hin truy vn trong mt loi tp nh c s khc bit t v hnh dng (nh tp nh v cc loi c). Ngoi ra, cc h thng nh ch mc cho d liu vn bn thng thng khng th p dng cho vic xy dng ch mc cho CSDL nh. p dng h thng ch mc cho d liu nhiu chiu R*-tree, TV-tree v SS+-tree vo nh ch mc cho CSDL nh cng c nhng hn ch nht nh v chi ph tnh ton. V vy trin khai mt h thng truy vn nh hon thin trong thc t cn xy dng h thng ch mc nhiu thch hp. 1.3.4 Cc cch tip cn hin ti v gii php c chn Cng vi s pht trin mnh m php bin i wavelet, cch tip cn truy vn nh da trn php bin i ny cng pht trin theo. Mt s cng trnh nghin cu theo hng ny ra i v vn ang tip tc pht trin cho ra nhng kt qu truy vn chnh xc hn. Song, s dng php bin i wavelet, cng nh Fourier hay DCT trc y i hi chi ph tnh ton cao. Cho nn gii quyt vn ny, ngi ta thng chn php bin i wavelet haar gim bt chi ph tnh ton trong cc h thng truy vn nh. V d h thng p dng bin i wavelet vo truy vn nh trong lun vn ca tc gi Nguyn Vn Diu thi gian tm kim 10 nh trong 1000 nh dng o l1(Z) trn V4 mt 3 pht vi kt qu 85% [2]. Mt hng tip cn khc kh mi m v ang c quan tm l kt hp cc c trng c bn truy vn v d nh phng php kt hp mu sc v kt cu ca tc gi Anh-Minh Hong. Phng php ny ang trong giai on hon thin:
22
Hnh 1.5: H thng truy vn nh kt hp mu sc v kt cu
Nghin cu trn cho thy vic kt hp hai hay nhiu c trng truy vn l phng php hon ton kh thi. Trong phm vi nghin cu ca lun vn ny s kt hp cc c trng v mu sc, hnh dng v v tr truy vn nh. Tuy vic kt hp cc c trng s ci thin ng k kt qu truy vn nhng s gp kh khn trong vic tm v chn o s tng ng gia 2 nh theo nhiu c trng v xy dng h thng ch mc cho CSDL nh truy vn da trn nhiu c trng.
1.4 Mt s h thng truy vn nh c th

1.4.1 Truy vn nh da trn histogram mu [1] Histogram ca mt nh l mt hm cung cp tn sut xut hin ca mi mc xm. Ta c th biu din histogram trong h trc Oxy vi trc honh Ox biu din
23
s mc xm t 0 n L (s mc xm), trc tung Oy biu din s im nh cho mt mc xm tng ng.
Hnh 1.6: Hai dng lc mc xm
Ngha l, histogram ca nh s c mc xm [0,L] l mt hm ri rc h(rk)=nk vi rk : mc xm th k v nk l s pixel c mc k. Histogram thng s c chun ho thnh p(rk)=nk/n vi n l tng s pixel trong nh. V lc ny ta c : p(rk ) = 1 (1.2)
k =0
L
o gia 2 histogram gi l o phn giao cp histogram (histogram intersection measure) ca nh q v nh t l:
v q ,t = 1
m =0
min( p
L q m =0
(m), p t (m))
L
min( p (m), p (m))

t m =0
(1.3)
H thng truy vn nh ca tc gi Lm Th Ngc Chu s xm ho nh mu RGB v nh xm 256 mc t 0..255. Theo cng thc mc xm: Y = 0.114*R+0.587*G +0.299*B. (1.4)
24
Biu mc xm s phn thnh cc loi EN, TRNG. Vi
EN =
Xi X
i =0 i =0 255 i
127
; TRNG =
i =128 255 i =0
255
(1.5)
i
Trong , Xi l s pixel c mc xm i. Ri EN s phn thnh 1, 2, nh sau:
HISTOGRAM
EN
TRNG
T1
T2
11
12
21
22
T11
T12
T21
T22
Hnh 1.7: Qu trnh phn tch mc xm
Vic to ch mc s c thc hin tng dn theo ct en v gim dn theo ct trng theo 3 mc ca cy nh phn pha trn. 1.4.2 Truy vn nh s dng ch mc mu sc, hnh dng v v tr [14] B.G. Prasad, K.K. Biswas, v S.K. Gupta xy dng h thng truy vn nh da theo ch mc mu sc hnh dng v v tr da theo cc vng trn nh. H thng
25
a ra ch mc kt hp nhng khng tm ra o s tng ng da theo mu sc hnh dng v v tr m ch da theo s trng khp v ch mc. H thng s s dng khng gian mu gim 25 mu m mt ngi d phn bit theo bng tra cu mu sau:
Bng 1.2: Bng thng s 25 mu c bn Th t 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 Black Sea green Light green Olive green Aqua Bright green Blue Green Turquoise Brown Blue gray Lime Lavender Plum Teal Dark red Magenta Yellow green Flouro green Red Rose Yellow Pink Orange White 0 0 0 36 36 36 73 73 73 109 109 109 146 146 146 182 182 182 182 219 219 219 255 255 255 0 182 255 73 146 255 36 146 219 36 109 219 0 109 182 0 73 182 255 73 146 255 36 146 255 0 0 170 0 170 0 170 0 170 0 170 0 170 0 170 0 170 0 170 0 170 0 170 0 255 Mu R G B
26
V hnh dng tin hnh php quay chun ha trc v bin i t l chun ha kch thc v hng. Sau tnh ton cc thng s hnh dng: trc chnh, trc ph, hnh ch nht c s, lch tm, trng tm, bao ph dng, v bao ph ct. V v tr s chia nh lm 9 phn vng v tr nh s nh sau:
Hnh 1.8: Phn vng v tr
Kt qu thc nghim ca h thng ny nh sau:

Bng 1.3: Bng kt qu thc nghim h thng ca B.G. Prasad, K.K Biswas v S.K. Gupta
Da trn mu sc
T l precision T l recall
Da trn hnh dng

Trung bnh lch chun
0.743401 0.26772
0.528 0.218
0.58338 0.205423
0.393825 0.187294
Da trn mu sc- hnh dng

Da trn mu sc hnh dng v tr

Trung bnh lch chun
0.932563 0.176627
0.355601 0.257311
0.788688 0.279232
0.593624 0.33318
27
1.4.3 Truy vn nh da trn mng Nron [13] HYOUNG K. LEE, SUK I. YOO xy dng h thng Neural Netwrok based Flexible Image Retrieval (NNFIR) s dng mng Nron i xng tm (Radial Basis Function Network (RBFN)) kt hp gi tr cc c trng truy vn nh.
nh truy vn
Rt trch c trng
Tm kim trong c s d liu
o s tng ng kt hp cc khong cch bng mng Nron i xng tm
Hc thch nghi bng mng i xng tm
Phn hi ca ngi dng Truy vn nh
Tp nh kt qu
Hnh 1.9: H thng truy vn nh NNFIR
Rt trch cc c trng, mi nh q u dng khng gian mu RGB, s c c trng bi mt vector c trng Fq:
q F q = { f 1q , f 2q ,..., f 29 }
28
f 1q , f 2q , f 3q l cc histogram mu Red, Green, Blue xc nh nh sau:
fi [ k] =
q x=0 y=0
M1 N 1
1 0
vi q[i][ x,y]=k ngc lai
(1.6)
Vi 0 k L v i=1,2,3 trong L s mc mu ca nh, MxN l kch thc ca nh. Mu mi pixel c ta (x, y) l s t hp ca 3 thnh phn mu Red, Green, Blue; q[1][x, y] l gi tr thnh phn mu Red ca pixel c ta (x, y) ca nh q, q[2][x, y] l gi tr thnh phn mu Green ca pixel c ta (x, y) ca nh q, q[3][x, y] l gi tr thnh phn mu Blue ca pixel c ta (x, y) ca nh q.
f 4q , f 5q , f 6q
v f 7q , f 8q , f 9q ln lt l trung bnh v phng sai ca cc
thnh phn mu red, green, blue xc nh nh sau:
fi q = q [i 3][ x , y ] MN
x =0 y =0
M 1 N 1
khi
i = 4,5,6
f = q [ j 6 ][ x , y ] f
q j x =0 y =0
M 1 N 1
q j 3
(1.7)
MN khi j = 7,8,9
Sau p dng php bin i wavelet song trc giao ln nh q n mc 3 ta c cc h s sau: xp x wavelet mc 1, wavelet mc 1 ngang, dc, ng cho, wavelet mc 2 ngang, dc, ng cho, wavelet mc 3 ngang, dc, ng cho. Ta
q q q q c f10 ... f19 v f 20 ... f 29 l trung bnh v phng sai ca cc h s wavelet thu c
trn.
29
Hnh 1.10: nh gc
Hnh 1.11: nh qua php bin i wavelet song trc giao mc 1
30
31
so snh histogram ta dng o phn giao ca hai histogram nh sau:
vi
= 1
M 1 m=0
min fi q [ m ] , fi t [ m] min fi q , fi t
)
(1.8)
L 1 L 1 vi fi q = m=0 fi q , fi t = m=0 fi t
Vi i=1,2,3. so snh cc c trng khc ta s dng php tr n gin:
vi = fiq fit , i = 4,5,...,29
(1.9)
Vai tr ca mng Nron RBF: dng kt hp cc gi tr khong cch vi. Input ca mng Nron RBF l tp cc khong cch vk gia 2 nh I1, I2. Nu tt c cc c trng ca 2 nh ny ging nhau ta mong mun Output l 1 v nu hon ton khc nhau ta mong mun Output l 0. Khi nhn c tp nh kt qu ca nh truy vn th ngi dng c th phn hi trn tng nh m mnh thy l ging nhau (alike), tng t (similar) hay khc nhau (different). Hm RBF l
f (x ) =
c g(
i =1 i
x xi
(1.10)
vi g l mt hm Gauss c dng:
g( x x i
) = exp
x xi 2 2
(1.11)
Gi tr phn hi ca ngi dng v kt qu truy vn xc nh nh sau:

0.9 UF (q ) = 0.5 0 neu giong nhau neu tng t neu khac nhau (1.12)
32
Mng Nron RBF c th minh ha nh sau:

Mng Nron i xng tm 0.5941 0.1742 0.5610 0.1402 Cc 0.4464 0.0519 gi tr .. khong.. cch ..
0.9 0.4 S tng ng
0.9 0.5 Phn hi ca ngi dng

Hnh 1.14: Mi quan h gia khong cch, RBNF v UF
Qu trnh hun luyn s iu chnh cc tham s ci da theo phn hi ca ngi dng. T cho kt qu truy vn ngy cng chnh xc hn. H thng cho kt qu kh quan sau 5 ln phn hi ca ngi dng.
Hnh 1.15: Kt qu ln truy vn ln u
33
Hnh 1.16: Kt qu truy vn sau khi nhn phn hi
Kt qu t c ca h thng NNFIR so vi cc cch kt hp tuyn tnh nh sau:

Bng 1.4: Kt qu h thng NNFIR
Phng php kt hp tuyn tnh

T l bao ph cho ca s kch thc W=8
NNFIR 81.70% 54.22% 16.92 msec
71.32% 40.11% 7.33 msec
T l chnh xc khi bao ph l 100% Thi gian kt hp
bao ph (Recall) = S nh ng tr ra/Tng s nh ng trong CSDL. chnh xc (Precision) = S nh ng tr ra/Tng s nh tr ra.
34
Chng 2: XUT H THNG LIN MNG META-NRON

Chng ny trnh by mt h thng lin mng meta-Nron dng kt hp nhiu mng Nron vi nhau p dng cho bi ton truy vn nh tng qut. H thng xut ny da trn s ci tin phng php kt hp nhiu mng Nron li vi nhau bng thut gii di truyn hay Logic m ca cc tc gi trc y. 2.1 Mng Nron Mng Nron xut pht t vic m phng hot ng ca b no ngi bng my tnh. Mng Nron l mt m hnh tnh ton cha cc n v x l c kh nng truyn thng vi nhau thng qua cc lin kt c trng s v c kh nng hc t kinh nghim hay t tp mu. V vy mng Nron c xem nh l mt hm s vi tham s c th iu chnh cho thch hp qua qu trnh hun luyn. Cu trc ca mt mng Nron bao gm mt s lp: 1 lp input, 1 hay nhiu lp n v 1 lp output. Mi lp bao gm mt s cc n v hay nt. u ra ca mi n v c lin kt thng qua trng s n n v khc lp k tip. Mng Nron l mt cu trc bao hm cc quan h cc trng s ca Nron, hay cc n v (units) vi cc php bin i v hng khng tuyn tnh v tuyn tnh.
Hnh 2.1: Mng Nron truyn thng
35
Hnh 2.1 trn l mt v d minh ha v mng Nron gm 3 lp: 1lp input, 1 lp n v 1 lp output. Lp input c 3 nt nhp, x = {x1, x2, x3} v u vo ngoi d liu ( lch) ni vo 2 Nron trong lp n. Hai gi tr ra t lp n cng vi lch
c a vo 1 Nron lp xut tnh ra gi tr xut v hng y .
Lp cha cc Nron gi l lp n v gi tr xut ca n khng cn xut ra trc tip d liu. Cc mi tn tng trng cho cc tham s gi tr thc hay trng s ca mng. Gi tr xut ca mng c L nt xut l:
y =g(v ), i i
i=1,, K. (2.1)
Trong g(vi) l hm truyn theo vi

vi = b0i + b ji h j
j =1 J
(2.2)
c J nt n vi kt xut hj, bji l cc trng trn cung lin kt t nt n j n nt xut th i, cn b0i l trng ngng ca nt xut th i. Cc cng thc trn gii thch theo thut ng mng nh sau. Mi nt trong J nt n chuyn gi tr kt xut hj ca n n tng nt xut. Mi nt trong L nt xut
tnh tng trng ha theo J kt xut ca nt n v cng vi ngng b0i. Kt xut y i l
gi tr hm truyn ca tng ny. Mc tiu ca vic hun luyn mng l tm gi tr trng s thch hp vi d liu nhp x bt k vo mng s cho ra gi tr output xp x output mong i. Cc thut ton hun luyn s lp nhiu bc vi trng s khi to v c cp nht tt hn trong mi bc lp.
36
Trc khi mng c chp nhn, cn c bc kim nghim (validate). Ngha l mng s c chy th vi mt s d liu bit. n gin v tt nht l th nghim mng vi tp d liu m khng c trong d liu c hun luyn v d liu ny vi d liu hun luyn c to ra trong cng cc iu kin tng t nhau. Vic hun luyn mng nu tht bi trong bc kim nghim, trong trng hp ny, ta phi chn m hnh tt hn. Tuy nhin, i khi ta ch cn lp li bc hun luyn vi gi tr tham s khi to khc. Mi bi ton mng Nron thng thc hin qua 4 bc sau: Chun b tp d liu nhp. Khi to mng. Hun luyn mng. Kim nh m hnh. 2.2 H thng lin mng meta-Nron 2.2.1 Gii thiu cc phng php kt hp Xt mu X gm m vector c trng (X c xem xt da trn m tiu ch khc nhau) X=(v1,v2,...,vm). Mi vector vk ca mu X c n chiu vk=(vk1,vk2,,vkn) vi k t 1 n m.
37
v1=(v11,v12,,v1n) X v2=(v21,v22,,v2n)
vm=(vm1,vm2,,vmn)
Hnh 2.2: Mu X c trng bi m vector
Xt phn hoch = {i | 1 i L}. Hai mu X1, X2 s thuc cng phn hoch nu kt qu nh gi hai mu ny da trn m vector c trng (hay m tiu ch) ny gn nhau theo cng thc o s tng ng 2.5. Xy dng mt h thng lin mng meta-Nron nh gi mu X gm m vector c trng nh sau:
v1=(v11,v12,,v1n) X v2=(v21,v22,,v2n) ... vm=(vm1,vm2,,vmn)
Mng con RN1
Mng con RN2
Mng metaNron
Mng con RNm
Hnh 2.3: Tng th h thng lin mng
Mi mng Nron con th k s dng nh gi thnh phn vk (hay tiu ch th k) ca mu X. Vi tng mng con phi to ra tp hun luyn v tp mu kim
38
tra tin hnh hun luyn nhm xc nh b trng s ti u cho mng con. Sau , mi mu X qua m mng con s c c m kt lun nh gi v mu X. Nh vy mi vector c trng vk qua mng con th k s cho ta mt vector xc sut Pk cho ta bit xc sut X thuc v phn hoch th i no vi i t 1 n L. Cn c theo mt tiu ch th k ta cng c th cho ra mt quyt nh X thuc v phn hoch no. Gi s Pk(i | X) = 0.9 th ngha l da theo tiu ch th k (vector c trng vk) th mng con cho rng 90% l mu X thuc v phn hoch th i.
B Trch Chn c Trng
B Trch Chn c Trng
B Trch Chn c Trng
Hnh 2.4: Qu trnh x l ca cc mng con
Nht thit phi hp nht cc nh gi ca cc mng con cho ra kt lun cui cng ca ton h thng [5]. Gi s ta nh ng cc kt lun ca cc mng con
39
(hay xem cc tiu ch nh gi X l nh nhau) th kt lun cui cng ca ton h thng s l:

P (i | X ) = 1 Pk (i | X ) m k =1
m
(2.3)
B Trch Chn c Trng
1/m
P1
1/m 1/m
B Trch Chn c Trng
1/m 1/m 1/m 1/m P2
B Trch Chn c Trng
1/m 1/m
PL
Hnh 2.5: Phng php kt hp trung bnh kt qu cc mng con
Phng php kt hp trung bnh l phng php kt hp n gin, tn t chi ph tnh ton v nhanh chng cho ra kt qu tng hp ca ton h thng. Tuy nhin trong thc t mc quan trng ca cc tiu ch l khc nhau nn cn xc nh h s tin cy rij tng ng. C th dng cc k thut khc nh thut
40
gii di truyn xc nh b h s tin cy ti u. Kt lun cui cng ca h thng s thnh [5]:
P ( i | X ) = r ji Pk ( i | X )
k =1
( 2 .4 )
B Trch Chn c Trng
B Trch Chn c Trng
Kt hp bng GA
B Trch Chn c Trng
Hnh 2.6: Kt hp mng Nron v thut gii di truyn (NN_GA)
y l dng kt hp tuyn tnh cc kt qu ca cc mng con. s kt hp ny thm uyn chuyn linh hot ty vo bi ton, cc kt qu ca cc mng con s c cho qua mng meta-Nron ton cc thch hp cho ra kt lun cui cng.
41
C th p dng mng Nron truyn thng vi hm tuyn tnh hay mng Nron phi tuyn vo mng meta-Nron ton cc c mt s kt hp output cc mng con thch hp ty tng trng hp c th. B trng s ca mng meta-Nron s c xc nh qua qu trnh hc. V vy cn c tp mu hun luyn cho mng meta-Nron ton cc. Nu nh input ca tp mu hun luyn ca cc mng con l vector c trng tng ng vk th input tp mu hun luyn ca mng meta-Nron ton cc l output ca cc mng con. Nh vy, h thng lin mng meta-Nron ny s kt hp cc mng Nron con mt cch linh hot ty thuc vo vic la chn cu hnh ca mng meta-Nron c s kt hp ph hp vi tng lp bi ton c th. Ngoi ra, h thng lin mng meta-Nron khng i hi cc nh pht trin, ng dng h thng meta-Nron phi nm r nhiu loi k thut kh khc nhau nh Nron v thut gii di truyn (GA) hay SVM m ch cn hiu r k thut v mng Nron thun ty.
42
B Trch Chn c Trng
B Trch Chn c Trng
Mng metaNron dng kt hp cc mng con
B Trch Chn c Trng
Hnh 2.7: Tng quan m hnh kt hp bng h thng lin mng
T tng chnh ca h thng lin mng meta-Nron l thay v dng thut gii di truyn kt hp cc output ca cc mng con th h thng s dng ngay chnh cng c mng Nron kt hp cc output ca cc mng con. Cc output ca cc mng con s c kt hp bng mng meta-Nron ton cc. Mng meta-Nron ton cc gm nhiu mng Nron thnh phn. Chi tit v mng meta-Nron ton cc cng nh cch kt hp cc output ca cc mng con vo mng meta-Nron ton cc s trnh by trong phn sau 2.2.2.
43
thy r hn l do ca vic phi kt hp cc kt qu ca cc mng con, trong h thng th nghim truy tm vng du lch vi 822 nh hun luyn v 82 nh dng kim tra, lun vn th xc nh vng du lch bng cc phng php: cn c theo tng mng con, theo phng php trung bnh v phng php dng h thng lin mng kt qu cc mng con (xem chi tit ti bng 4.1) thy rng nu khng kt hp cc kt qu ca cc mng con th kt qu s khng cao. V mi mng con ch cn c trn mt tiu ch ra quyt nh. Trong khi thc t th mi tiu ch s c mt h s tin cy khc nhau. V d, nh gi kh nng t duy logic th kt qu cc mn t nhin s c h s tin cy cao hn cc mn x hi. Cc cng trnh ca cc tc gi trc y thng kt hp kt qu bng thut gii di truyn hay Logic m hay SVMTrong lun vn ny s dng mng meta-Nron ton cc kt hp kt qu nh gi ca cc mng con cho ra kt qu nh gi cui cng. 2.2.2 Kin trc ca h thng lin mng meta-Nron Gi s cn nh gi mu X (c c trng bi m vector, mi vector n chiu) thuc v phn hoch no trong 1, 2,.., L phn hoch. Nh vy, ta cn m mng Nron con nh gi xem X thuc phn hoch no theo tiu ch (hay vector c trng) tng ng. Mi mng con s c n nt input (s chiu ca vector c trng) v c L nt output (s phn hoch). Mng c th c nhiu lp n thay v ch 1 lp n. C nhiu nghin cu cng phu nhm tm hiu xem vic thm cc lp n c lm tng nng lc hc hoc tc hc ca mng nh vic thm s nt n khng. Tuy nhin, cha c lp lun l thuyt no ng h vic thm cc lp n c tnh thuyt phc. Ngc li, mng c mt lp n c th nh x c bt k nh x no. Nhiu lp n gy ra bt li v lm cho cc cng thc ton hc ca mng phc tp hn v cc chng trnh my tnh ci t theo cc cng thc ny cng kh hn. V th, lun vn ny xut s dng mng Nron ch c 1 lp n cho cc mng Nron trong h thng lin mng meta-Nron.
44
Mng Nron con th k k hiu l RNk . Output th j (j t 1 n L) ca mng con th k (k t 1 n m) k hiu l rokj , cho ta xc sut nh gi mu X thuc v phn hoch th j theo nh gi ca mng con th k.
Vector v1
Vector gp R1
Vector v2
Vector gp R2
Vector vm
Vector gp RL
Hnh 2.8: Gp kt qu cc mng con chun b a vo mng ton cc
Gp cc output th nht ca tt c cc mng con lm thnh phn ca vector R1(ro11, ro21,, rom1), vector R1 ny s cha tt c cc nh gi xc sut mu X thuc v phn hoch th nht i=1 ca tt c m mng con. Tng t, gp cc output th k ca tt c cc mng con lm thnh phn ca vector Rk(ro1k, ro2k,, romk), vector Rk ny s cha tt c cc nh gi xc sut mu X thuc v phn hoch th nht i=k ca tt c m mng con. Gp cc output th L ca tt c cc mng con lm thnh phn ca vector RL(ro1L, ro2L,, romL), vector RL ny s cha tt c cc nh gi xc sut mu X thuc v phn hoch th nht i=L ca tt c m mng con.
45
Vector ra R1 s l input ca mt Nron thnh phn k hiu TP1 cho ra nh gi xc sut mu X thuc v phn hoch th nht. Nh vy mng Nron thnh phn TP1 s c m nt input (s chiu ca vector ra R1) v mt nt output O1 cho ra nh gi xc sut mu X thuc v phn hoch th nht i=1 cn c theo nh gi ca tt c cc mng con. Vector ra Rk s l input ca mt Nron thnh phn k hiu TPk cho ra nh gi xc sut mu X thuc v phn hoch th k. Nh vy mng Nron thnh phn TPk s c m nt input (s chiu ca vector ra Rk) v mt nt output Ok cho ra nh gi xc sut mu X thuc v phn hoch th nht i=k cn c theo nh gi ca tt c cc mng con.. Vector ra RL s l input ca mt Nron thnh phn k hiu TPL cho ra nh gi xc sut mu X thuc v phn hoch th L. Nh vy mng Nron thnh phn TPL s c m nt input (s chiu ca vector ra RL) v mt nt output OL cho ra nh gi xc sut mu X thuc v phn hoch th nht i=L cn c theo nh gi ca tt c cc mng con.. C tt c L vector ra RL nn s cn L mng Nron thnh phn TPL . Mi mng Nron thnh phn c m nt input v mt nt output duy nht.
46
v1 R1
Mng Nron TP1
O1
Mng Nron kt hp metaNron
v2
R2
Mng Nron TP2
O2
vm
RL
Mng Nron TPL
OL
Hnh 2.9: a cc vector Ri vo mng kt hp
Tm li, phn hoch mu X (c trng bi m vector, mi vector n chiu) vo mt trong L phn hoch 1,2,..,L theo dng s sau [5],[6]:
i thuc {1,2,..,L}
Vector V1 n chiu
Vector V2 n chiu Vector Vm n chiu
i thuc {1,2,..,L} ... i thuc {1,2,..,L}
Kt Hp
i thuc {1,2,..,L}
Hnh 2.10: Phn lp mu m vector
H thng lin mng cn xy dng s c m mng Nron con RNk vi k t 1 n m v mt mng meta-Nron ton cc gm L mng Nron thnh phn TPi vi i
47
t 1 n L. Trong cc mng Nron con cng nh mng Nron thnh phn ca mng ton cc u c 3 lp: 1 lp input, 1 lp output v 1 lp n. V cha c cng thc xc nh s nt n ti u cho mng Nron nn s nt n ti u cn xc nh qua qu trnh thc nghim. C th cc mng Nron con RNk s c n nt input (s chiu ca vector c trng) v c L nt output (s phn hoch). Cc mng Nron thnh phn TPi ca mng ton cc c m nt input (s mng con) v c mt nt output chnh l nt output th i ca ton h thng lin mng meta-Nron.
V1
Mng con RN1
Vector R1
Mng TP1
V2
Mng con RN2
Vector R2
Mng TP2
Mng Kt Hp
Vector RL Vm
Mng con RNm
Mng TPL
Hnh 2.11: M hnh lin mng (m, n, L)
48
Trong , m l s vector c trng ca mt mu, n l s chiu ca cc vector c trng v L l s phn hoch. Cc mng con RNk vi k t 1 n m s c n nt input v L nt output. Cc mng thnh phn TPi vi i t 1 n L c m nt input v 1 nt output duy nht. S kt hp ca h thng lin mng l s kt hp output ca cc mng con. C th b trng s ca cc mng thnh phn TPi s kt hp tt c cc output th I ca cc mng con cho ra kt xut th i ca ton h thng lin mng. 2.2.3 Qu trnh hun luyn ca h thng lin mng Qu trnh hun luyn cho h thng lin mng theo 2 giai on v thuc dng hc c gim st: Hun luyn ln lt cho tt c cc mng con. Hun luyn cho mng meta-Nron ton cc. Xt nhng mu X c trng bi m vector vk, mi vector n chiu, thuc mt trong L phn hoch i vi i t 1 n L. Gi s tp mu X c tng cng TX mu bit trc phn hoch ca chng. Nu X thuc v phn hoch th i=1 th vector output k vng (mong mun) ca X qua h thng lin mng l (1, 0, 0,, 0) ngha l thnh phn th nht ca vector output l 1, cc thnh phn cn li ca vector output l 0. Qu trnh hc l qu trnh iu chnh b trng s output gn vi kt qu k vng. 2.2.3.1 Hun luyn cho cc mng con C TX mu X bit output, mi mu X rt ra c m vector c trng vk vi k t 1 n m. Vy ta c TX vector v1 bit output s l tp d liu hun luyn cho mng Nron con RN1. Ngha l ln lt cc vector v1 ny s qua mng con RN1 tnh ra
49
cc output v iu chnh b trng s ca mng Nron con RN1 sao cho output ca n gn v output bit theo thut ton hc ca mng Nron. Lp i lp li qu trnh iu chnh b trng s cho n khi h s li chp nhn c hay vt qu s bc gii hn. Sau khi hun luyn xong cho mng con RN1 ta ghi nhn li b trng s ca mng con ny. Chi tit v thut ton hc ca mng Nron c th xem trong phn ph lc A.
Vng lp hun luyn cho mng con 1
V1
Mng con RN1
Vector R1
Mng TP1
V2
Mng con RN2
Vector R2
Mng TP2
Mng Kt Hp
Vector RL Vm
Mng con RNm
Mng TPL
Hnh 2.12: Hun luyn mng con RN1 ca h thng lin mng meta-Nron (m, n, L)
Tin hnh tng t cho cc mng con cn li RN2, RN3,,RNm. n khi ta thu c cc b trng s ca cc mng con v output ca cc mng con. Kt thc giai on th nht: hun luyn cho cc mng con.
50
Chng hn, c 822 mu mi mu c trng bi 4 vector 5 chiu. Trong c 201 mu (X1,.., X201) thuc phn hoch 1 (v d mu thuc v H Long), 367 mu (X202,.., X569) thuc v phn hoch 2 (v d mu thuc v H Ni) v 254 mu (X570,.., X822) thuc v phn hoch 3 (v d mu thuc v Nha Trang). Mi mu X c trng bi 4 vector nn ta c 4 mng con. 822 mu X, mi mu ly vector c trng th nht v1 , s c 822 vector v1. Trong c 201 vector v1 ng vi output k vng l (1, 0, 0), 367 vector ng vi output k vng l (0, 1, 0) v 254 vector ng vi k vng l (0, 0, 1); 822 vector v cc output ny s dng hun luyn cho mng con th nht RN1. Hon ton tng t cho mng con th hai, th ba v th t. 2.2.3.1 Hun luyn cho cc mng ton cc: Mng ton cc gm L mng thnh phn TPi . Qu trnh hun luyn mng ton cc: ln lt hun luyn cho cc mng thnh phn TP1, TP2, , TPL. T output k vng ca mu X ta d dng xc nh output ca cc mng thnh phn TPi. Ch mng thnh phn TPi ch c 1 nt output duy nht cng chnh l nt output th i qua ton b h thng lin mng. V d output k vng ca mu X l (1, 0, 0.., 0) trng hp ny mu X thuc v phn hoch 1 th output k vng ca mng thnh phn TP1 l 1 cn output ca cc mng thnh phn cn li l 0. By gi ta cn xc nh input ca mng thnh phn TP1 hun luyn t mu X. chnh l cc nt output th nht ca X qua m mng con ro11, ro21,.., rom1 to thnh mt vector gp m chiu R1. a vector gp R1 vo mng thnh phn TP1 ta s c mt gi tr output no vi b trng s hin ti ca mng TP1. Sau iu chnh b trng s ca mng TP1 output ny gn vi output k vng. Lp i lp li qu trnh ny da trn tp mu X hun luyn.
51
V1
Mng con RN1
Vng lp hun luyn cho mng thnh phn TP1
Vector R1
Mng TP1
V2
Mng con RN2
Vector R2
Mng TP2
Mng Kt Hp
Vector RL Vm
Mng con RNm
Mng TPL
Hnh 2.13: Hun luyn mng thnh phn TP1 ca h thng lin mng meta-Nron (m, n, L)
Sau khi hun luyn cho mng thnh phn TP1 ca mng ton cc ta tip tc hun luyn cho cc mng thnh phn cn li TP2, .., TPL. Tip tc vi v d c 822 mu (mi mu c trng bi 4 vector, mi vector 5 chiu nh v d trn phn hun luyn cc mng con) hon tt qu trnh hun luyn cc mng con. Ngha l c b trng s cho 4 mng con. Xt mu X1 (thuc v phn hoch th nht) trong 822 mu trn c 4 vector c trng v1, v2, v3, v4. Vector c trng th nht v1 ca X1 qua mng con th nht s c 3 gi tr 3 nt output gi s l (hl1=0.7, hn1=0.4, nt1=0.2). Tng t vector v2, v3,v4 qua cc mng con ln lt cho ra cc output gi s l (hl2=0.8, hn2=0.3, nt2=0.3), (hl3=0.4, hn3=0.6, nt3=0.1), (hl4=0.5, hn4=0.5, nt4=0.5). Vi cc gi tr gi s th ny sau qu
52
trnh hun luyn cc mng con, quyt nh nh gi v mu X1 ca mng con th nht v tha hai l chnh xc cn ca mng con th ba v th t th khng chnh xc. Gp cc nt output th nht ca tt c cc mng con thu c vector R1=(hl1, hl2, hl3, hl4). Vector R1 ny c gi tr output k vng l 1, s a vo mng thnh phn TP1 hun luyn (ch mng thnh phn TPi ch c mt nt output duy nht). Gp cc nt output th hai ca tt c cc mng con thu c vector R2=(hn1, hn2, hn3, hn4). Vector R2 ny c gi tr output k vng l 0, s a vo mng thnh phn TP2 hun luyn (ch mng thnh phn TPi ch c mt nt output duy nht). Tip tc gp cc nt output th ba ca tt c cc mng con thu c vector R3=(nt1, nt2, nt3, nt4). Vector R3 ny c gi tr output k vng l 0, s a vo mng thnh phn TP3 hun luyn (ch mng thnh phn TPi ch c mt nt output duy nht). Nh vy c 822 mu X th ta s c 822 vector gp R1 bit output a vo mng thnh phn TP1 ca mng ton cc. Hun luyn mng thnh phn TP1. Tng t ta cng c 822 vector R2, R3 bit output dng hun luyn cho mng thnh phn TP2, TP3. Sau khi hun luyn xong cho tt c cc mng thnh phn TPi th kt thc giai on hun luyn th hai. By gi c th chuyn sang giai on nh gi phn hoch mu X mi. 2.2.4 Qu trnh nh gi mt mu X qua h thng lin mng Khi mt mu X cn phn vo mt trong L phn hoch c a vo h thng. b trch chn c trng s rt ra m vector c trng vk vi k t 1 n m.
53
Mi vector vk qua mt mng con s cho ta mt vector output. V1 qua mng Nron con RN1 cho ta cho ra cc L nt output l ro11, ro12, , ro1L. V2 qua mng Nron con RN2 cho ta cho ra cc L nt output l ro21, ro22, , ro2L. Vm qua mng Nron con RNm cho ta cho ra cc L nt output l rom1, rom2, , romL. Gp output th nht ca tt c cc mng con li thu c vector R1=(ro11, ro21, , rom1) c m chiu. Vector R1 qua mng Nron thnh phn TP1 ca mng ton cc cho ra gi tr nt output th nht ca ton h thng lin mng (chnh l gi tr nt output duy nht ca mng thnh phn TP1). Gp output th hai ca tt c cc mng con li thu c vector R2=(ro12, ro22, , rom2) c m chiu. Vector R2 qua mng Nron thnh phn TP2 ca mng ton cc cho ra gi tr nt output th hai ca ton h thng lin mng (chnh l gi tr nt output duy nht ca mng thnh phn TP2). C tip tc gp n output th L ca tt c cc mng con li thu c vector RL=(ro1L, ro2L, , romL) c m chiu. Vector RL qua mng Nron thnh phn TPL ca mng ton cc cho ra gi tr nt output th L ca ton h thng lin mng (chnh l gi tr nt output duy nht ca mng thnh phn TPL). By gi ta xc nh c gi tr ca tt c cc nt output ca X qua h thng lin mng. Gi s, mu X qua h thng lin mng gi tr ca nt output th hai l 0.9 c ngha l xc sut mu X thuc v phn hoch th i=2 l 90%. 2.3 H thng lin mng meta-Nron cho bi ton truy vn nh Xt phn hoch = {i | 1 i L} ph kn trn tp nh T. Cc nh ging nhau theo tiu ch truy vn cng thuc mt phn hoch. Hm output ca h thng mng lin mng meta-Nron s gip ta xc nh mc tng ng gia hai nh nh sau: nh A qua h thng mng lin mng
54
meta-Nron c output l X=(X1, X2,.., XL), nh B qua h thng mng lin mng meta-Nron c output l Y=(Y1, Y2,.., YL). o s tng ng ca A v B: d(A,B) = min(|X1-Y1|, |X2-Y2|,, |XL-YL|) (2.5)
Mi nh c tch thnh m nh con k hiu i1,i2,,im. Mi nh con ik (vi k t 1 ti m) s c trng bi mt vector c trng vk gm n phn t vk(d1,d2,,dn,) . Nh vy mi nh gc ban u s c i din bi mt b gm m vector c trng mi vector c n chiu.
nh ban u
nh con I1 c trng bi vector v1 (n chiu)
nh con Im c trng bi vector vm (n chiu)
Hnh 2.14: S rt trch c trng
Sau ta p dng mt mng Nron cho tng nh con, k hiu RNk cho nh con ik. Mng Nron RNk vi k t 1 ti m s c 3 tng. Trong tng input c n nt, tng n s c s nt t 1 n 2n v nt tng output k hiu ROk. Mng Nron p dng cho cc nh con ch c mt tng n v i vi cc mng tuyn tnh v mt s mng phi tuyn th c nhiu tng n th ta cng c th quy v mt lp n. S nt tng n trong khong t 1 n 2n v qua thc nghim trong mt s h thng c th th khi s nt n tng ln qu 2n th kt qu ca qu trnh hc cng khng thay i nhiu. Vn t ra l chng ta s chn bao nhiu nt cho tng n l ti u. Trong phm vi nghin cu ny cha tm ra c cng thc ton hc xc nh s nt n
55
ti u. Vic xc nh s nt n ti u cho tng mng con s c xc nh bng thc nghim. Bng cch tin hnh hc nhanh vi s bc hu hn vi s nt n ln lt t 1 n 2n v cn c vo bng kt qu t l phn lp chnh xc v t l bao ph cao c tng cao nht s nt n bao nhiu th s xy dng mng con vi s nt n tng ng. Chng hn, gi s sau khi hc nhanh cho nh con th k v kt qu l vi 3 nt tng n th c tng t l phn lp chnh xc v t l bao ph cao nht th ta s xy dng mng con RNk s c 3 nt tng n. Nh vy ta p dng mt mng Nron con k hiu RNk cho tng nh con ik vi k t 1 ti m. Mi mng con ny s cho ta mt output gi l ROk. Ta c m nh con, qua m mng con tng ng s cho ra m output ROk. Sau khi hun luyn xong tt c m nh con trn ton c s d liu nh. Ta tin hnh tnh ton v ghi nhn cc output ca tng mng Nron ca tng nh con. Nh vy by gi mi nh s c c trng bi vector c trng mi c thnh phn l output ca cc mng Nron con RNk cho tng nh con vi k t 1 ti m. V gi y ta tin hnh hun luyn cho mng Nron ton cc gi l mng meta-Nron vi input l cc output ca cc mng Nron cc b cho tng region. S nt input ca mng meta-Nron s chnh l s nh con m. S nt n trong khong t 1 n 2m+2 v cng s c chn thng qua thc nghim nh mng con. Tuy nhin input ca mng meta-Nron s l cc output ca cc mng Nron con ch khng phi l trc tip c trng ca nh ban u. Nh vy mng meta-Nron ton cc trong tng th ca h thng ng vai tr quyt nh mc quan trng ca cc mng Nron cc b. Hay ni cch khc l output ca cc mng Nron cc b gp bao nhiu phn trm vo kt qu output cui cng s do kt qu hun luyn ca mng meta-Nron. iu ny rt quan trng trong bi ton truy vn nh v ty vo mi loi hnh nh th mc quan trng ca mi nh con khc nhau.
56
nh Con 1
Vector c trng ca nh con 1
Mng con RN1
nh Con 2
nh gc
nh Con 3
Mng con RN2
nh Con m
Mng MetaNron
Mng con RN3
Vector c trng ca nh con m
Mng con RNm
Hnh 2.15: Kin trc h thng lin mng meta-Nron p dng trn nh
H thng lin mng meta-Nron l mt ng gp trong sut hai nm nghin cu lun vn ny, da trn c s ci tin phng php kt hp thut gii di truyn vi mng Nron p dng cho bi ton nhn dng vn tay v k t c trnh by trong lun n Tin s ca tc gi L Hong Thi. Tc gi s dng thut gii di truyn nh gi mc tin cy ca cc mng Nron con. Trong phm vi lun vn ny s dng mt mng Nron ton cc gi l meta-Nron thay cho vic s dng thut gii di truyn xc nh h s tin cy ca cc mng con. Bi v trong bi ton truy vn nh tng qut, ty thuc vo tng loi nh cng nh tng mc ch truy vn c th m mc quan trng ca cc nh con s khc nhau. Thm ch cng mt tp d liu nh nhng mc ch truy vn khc nhau th mc quan trng ca cc nh con cng c th khc nhau. Do h s tin cy ca cc kt qu do
57
mng con to ra phi c xc nh qua qu trnh hc th mi tt cho bi ton truy vn nh tng qut. Tm li, gii bi ton truy vn nh, lun vn xut s dng phng php kt hp kt qu cc mng Nron con li vi nhau. Tuy nhin lun vn khng dng thut gii di truyn hay l logic m nh cc tc gi trc y m s dng mt mng Nron gi l meta-Nron kt hp cc mng Nron con li vi nhau. Mng meta-Nron s kt hp cc kt qu output ca cc mng con li thnh u vo input cho mng meta-Nron. T qua mng meta-Nron ton cc ta thu c kt qu cui cng cho ra bi ton b h thng lin mng meta-Nron. Phng php kt hp bng h thng lin mng meta-Nron thc hin s kt hp output ca cc mng con bng cc mng thnh phn ca mng meta-Nron ton cc. C th cc output th i ca tt c cc mng con s kt hp li thnh vector input ca mang thnh phn TPi ca mng meta-Nron ton cc. Mng thnh phn TPi s xc nh gi tr nt output th i ca ton h thng lin mng meta-Nron. Ngoi ra, pht trin ng dng h thng lin mng ch cn ngi lp trnh pht trin bit kin thc thun ty mng Nron. Hn th na, nu vic rt trch cc c trng c bn tt sau khi vo mng Nron thnh phn c th rt trch ra c cc ng ngha trong nh nh c thuyn, c hoa th c th trin khai thnh h thng truy vn nh da trn ng ngha nh.
58
Chng 3: MT P DNG CA H THNG LIN MNG META-NRON

Chng ny trnh by mt p dng ca h thng lin mng meta-Nron xut chng 2 vo bi ton truy vn nh phong cnh vng du lch. Tp nh hun luyn bao gm 822 nh vi 201 nh phong cnh H Long tm trn mng, 367 nh phong cnh H Ni chp bng my nh k thut s trong ln ra H Ni vo thng 8/2007, v 254 nh phong cnh Nha Trang cng chp bng my nh k thut s trong nhiu ln v qu Nha Trang. 3.1 Rt trch cc c trng ca nh V u vo ca mng Nron l d liu lng t nn trc tin t tp tin hnh nh ta cn phi rt ra vector c trng cha cc c trng trong nh. T tp c s d liu nh ta s rt ra tp vector c trng a vo hun luyn. C th mi bc nh s phn tch thnh 4 nh con nh sau: u tin chia nh thnh hai phn l phn nn v phn ni da trn mc xm. Sau , phn ni li chia lm hai phn nn v ni trn phn ni. ng thi phn nn cng tip tc chia thnh hai phn nn v ni ca nn.
nh ban u
Phn ni
Phn nn
Phn ni trn ni (Vng1)
Phn nn trn ni (Vng 2)
Phn ni trn nn (Vng 3)
Phn nn trn nn (Vng 4)
Hnh 3.1: S rt trch c trng
59
Phn ni s bao gm nhng pixel ca nh gc c mc xm cao hn mc xm trung bnh. Phn nn bao gm nhng pixel c mc thp hn mc xm trung bnh trong nh gc ban u. Phn 1 (phn ni ca phn ni) s bao gm nhng pixel c mc xm cao hn trung bnh trong phn ni ca nh gc. Phn 2 (phn nn ca phn ni) s bao gm nhng pixel c mc xm thp hn trung bnh trong phn ni ca nh gc. Phn 3 (phn ni ca phn nn) s bao gm nhng pixel c mc xm cao hn trung bnh trong phn nn ca nh gc. Phn 4 (phn nn ca phn nn) s bao gm nhng pixel c mc xm thp hn trung bnh trong phn nn ca nh gc. ng vi mi nh con s rt ra v tr ca trng tm, t l ca din tch nh con so vi nh gc ban u v chuyn t khng gian mu RGB sang khng gian mu LHC. Ti mi vng rt ra cc gi tr sau: v tr ca trng tm (1,2,3,4 tng ng vi gc trn bn tri, gc trn bn phi, gc di bn tri, gc di bn phi) 1 3 2 4
V t l gia din tch ca vng so vi ton nh = tng s pixel ca vng chia cho tng s pixel ca nh. ng thi ly ra mu L H C ca tm theo cng thc chuyn i sau:
Y L = 1 1 6 Y0 H = ta n 1 C a
*
b a
1 6
* *
(a
+ (b
)
1
2 1
X = 5 0 0 X
Y Y0 Z Z 0
R G B
(3.1)
Y b* = 2 0 0 Y0 X Y Z 2 .7 6 9 0 = 1 .0 0 0 0 0 .0 0 0 0
1 .7 5 1 8 4 .5 9 0 7 0 .0 5 6 5
1 .1 3 0 0 0 .0 6 0 1 5 .5 9 4 3
60
Vy mi nh gc ban u s c c trng bi 4 vector, mi vector c 5 phn t c trng cho nh con tng ng. Hay ni cch khc ma trn c trng ca mi nh gc ban u l ma trn 4x5 (4 hng 5 ct). Hng u tin gm 5 tng ng vi 5 c trng ca nh con th nht (phn ni ca phn ni), hng th gm 5 tng ng vi 5 c trng ca nh con th hai (phn nn ca phn ni), hng th ba gm 5 tng ng vi 5 c trng ca nh con th ba (phn ni ca phn nn), hng th t gm 5 tng ng vi 5 c trng ca nh con th t (phn nn ca phn nn). Ct th nht ng vi v tr ca trng tm, ct th hai cha t l din tch nh con so vi nh gc ban u, ct th ba l mu L, ct th t l mu H, v ct th nm l mu C ca trng tm.
Hnh 3.2: nh u vo Bng 3.1: Biu din nh thnh cc c trng
V tr nh con 1 nh con 2 nh con 3 nh con 4 3 1 1 1
T l din tch
Mu L
Mu H
Mu C
0.2622148 159.0667 0.59617 4.534818 0.33285925 226.805 0.41962 0.92006
0.32861853 55.96102 0.65679 9.151924 0.07630741 116.4482 0.74906 6.609669
61
Nh vy, mi nh s c c trng bi 4 vector c trng, mi vector 5 chiu. Cc vector c trng ny s l u vo cho h thng lin mng meta-Nron vi b tham s (m=4, n=5, L=3) s cho ra 3 gi tr kt xut. Cc gi tr kt xut ny gip ta xc nh s tng ng gia hai nh dng hm o s tng ng theo cng thc (2.5). Gi tr ca hm o s tng ng gip h thng xc nh kt qu truy vn: nh tr ra l nh ging vi nh truy vn nht trong c s d liu nh da theo gi tr o s tng ng trn (hai nh ging nhau th gi tr hm o s tng ng cng nh). Trong phm vi lun vn ny tp trung vo vic xy dng h thng lin mng meta-Nron p dng cho bi ton truy vn nh tng qut, khng tp trung vo vic ci tin cc thut ton rt trch c trng t nh cho ti u. Nu c iu kin kt hp vi cc cng trnh nghin cu khc v rt trch c trng hay cc i tng trong nh th kt qu s cao hn. Tuy nhin, phn ln cc cng trnh rt ra cc i tng trong nh c kt qu tt th phi xt trong phm vi mt bi ton c th, mt loi hnh nh c th. V d: rt trch ra cc c trng ca khun mt hay rt trch ra gng mt ngi trong nh chn dung 3.2 Kin trc h thng lin mng meta-Nron Mi nh c tch thnh 4 nh con, mi nh con rt mt vector c trng 5 chiu. Vy mu X trong trng hp ny c c trng bi m=4 vector, mi vector n=5 chiu. Phn hoch X vo mt trong L=3 lp H Long, H Ni hay Nha Trang. Cc thnh phn trong h thng lin mng gm: m=4 mng Nron con RN 1, RN2, RN3, RN4 v mt mng ton cc gm L=3 mng thnh phn TP1, TP2, TP3. Trong cc mng Nron con cng nh cc mng thnh phn ca mng ton cc u dng mng lan trruyn ngc 3 lp (1 lp input, 1 lp n v 1 lp xut) vi hm truyn Sigmod. Chi tit v mng lan truyn ngc vi hm Sigmod c trnh by trong ph lc A.
62
C th cc mng con RNk vi k=1,2,3,4 c n=5 nt input v L=3 nt output. S Nron nt n xc nh bng qu trnh thc nghim. Cc mng thnh phn TPi vi i=1,2,3 ca mng ton cc s c m=4 nt input v 1 nt output duy nht.
V1
Mng con RN1
Vector R1 V2 X Vector R2
Mng con RN2
Mng TP1
HL
Mng TP2 Mng Kt Hp
HN
V3
Mng con RN3
Vector R3
Mng TP3
NT
V4
Mng con RN4
Hnh 3.3: H thng lin mng (m=4, n=5, L=3)
3.3 Xy dng h thng lin mng meta-Nron Output ca h thng lin mng meta-Nron s gip xc nh mc tng ng gia hai nh: nh A qua h thng lin mng meta-Nron c output l X, nh B qua mng Nron c output l Y. o s tng ng ca A v B tnh theo cng thc o s tng ng (2.5) trnh by chng 2.
63
T c s d liu 822 nh phong cnh ca 3 vng H Long, H Ni v Nha Trang. Tin hnh phn tch mi nh thnh 4 nh con nh ni phn trn. Mi nh con rt ra vector c trng ca n. Ghi nhn cc c trng vo c s d liu. Tin hnh qu trnh hun luyn cho mng con th nht RN1, phn lp nh da vo cc c trng ca nh con th nht trong cc tp nh hun luyn. Tin hnh hc nhanh vi s bc hu hn 20000 bc, cho mng con th nht RN1 phn lp nh thuc v H Long hay khng vi s nt n t 1-10. Do nhc im ca h thng lin mng gm nhiu mng Nron (m+L). Mi mng Nron cn thi gian hun luyn tng i di, s nt n ti u cho mi mng cha c cng thc xc nh trc. V vy nhanh chng xc nh s nt n tt cho cc mng Nron, lun vn tin hnh thc hin qu trnh hc nhanh vi s bc hu hn chn ra s nt n ti u cho cc mng Nron trong h thng lin mng. Kt qu qu trnh hc nhanh ny nh sau:
Bng 3.2: Thc nghim phn hoch H Long theo mng con
HALONG Region1 Node Precision Recall Region2 Node Precision Recall Region3 Node Precision Recall Region4 Node Precision Recall 1 0.0% 0.0% 2 25.0% 73.1% 3 25.9% 90.5% 4 24.9% 80.6% 5 25.4% 83.1% 6 25.4% 82.6% 7 25.5% 82.6% 8 25.5% 88.6% 9 25.5% 76.6% 10 25.3% 81.1% 1 0.0% 0.0% 2 28.6% 53.7% 3 24.6% 82.1% 4 29.6% 66.2% 5 27.9% 77.1% 6 29.1% 79.1% 7 29.7% 78.1% 8 24.7% 81.6% 9 29.5% 64.7% 10 25.9% 75.1% 1 0.0% 0.0% 2 23.7% 84.6% 3 23.3% 90.5% 4 24.4% 77.1% 5 24.7% 69.7% 6 25.1% 70.1% 7 25.2% 68.7% 8 24.0% 88.1% 9 26.5% 57.2% 10 24.6% 68.7% 1 0.0% 0.0% 2 28.3% 68.7% 3 27.4% 78.6% 4 25.8% 74.1% 5 25.7% 75.1% 6 26.1% 74.6% 7 26.6% 74.6% 8 25.9% 80.6% 9 28.3% 69.7% 10 28.6% 70.6% Chn 8363
64
Tin hnh tng t cho phn lp nh H Ni thu c bng kt qu thc nghim nh sau:
Bng 3.3: Thc nghim phn hoch H Ni theo mng con
HANOI Region1 Node Precision Recall Region2 Node Precision Recall Region3 Node Precision Recall Region4 Node Precision Recall 1 44.65% 100.00% 2 44.82% 89.65% 3 45.71% 94.28% 4 45.83% 95.91% 5 45.83% 94.28% 6 46.46% 96.46% 7 47.00% 94.01% 8 45.73% 96.19% 9 45.72% 94.55% 10 44.61% 98.09% 1 44.65% 100.00% 2 47.36% 90.46% 3 49.27% 91.83% 4 55.13% 90.74% 5 48.09% 92.64% 6 49.29% 94.55% 7 53.29% 92.64% 8 49.57% 94.55% 9 47.68% 95.10% 10 49.10% 96.19% 1 44.65% 100.00% 2 45.07% 99.73% 3 44.76% 100.00% 4 44.76% 100.00% 5 44.74% 99.73% 6 44.74% 99.73% 7 44.83% 99.18% 8 44.65% 100.00% 9 44.74% 99.73% 10 44.65% 100.00% 1 44.65% 100.00% 2 45.06% 99.46% 3 45.11% 99.18% 4 44.81% 100.00% 5 44.81% 100.00% 6 44.81% 100.00% 7 44.84% 99.46% 8 44.76% 100.00% 9 44.81% 100.00% 10 44.65% 100.00% Chn 4271
Tng t c cc bng kt qu thc nghim cho qu trnh hc nhanh dng phn lp nh Nha Trang:
Bng 3.4: Thc nghim phn hoch Nha Trang theo mng con
NHATRANG Region1 Node Precision Recall Region2 Node Precision Recall Region3 Node Precision Recall Region4 Node Precision Recall 1 0.00% 0.00% 0.0000 1 0.00% 0.00%
2 30.77% 1.57% 0.3234 2 14.55% 15.35% Chn 9 2 9 10
1 0.00% 0.00% 1 0.00% 0.00%
2 68.71% 44.09%
3 78.03% 40.55% 3 42.46% 89.76% 3 33.33% 1.57% 0.3491 3 31.03% 7.09%
4 76.54% 24.41% 4 35.12% 46.46% 4 37.50% 2.36% 0.3986 4 33.33% 7.09%
5 60.51% 65.75% 5 31.36% 35.43% 5 22.22% 12.60% 0.3482 5 33.89% 55.51%
6 86.05% 29.13% 6 39.64% 86.61% 6 33.33% 0.39% 0.3373 6 45.45% 1.97%
7 78.51% 37.40% 7 43.51% 79.13% 7 41.67% 1.97% 0.4364 7 41.51% 8.66%
8 64.13% 46.46% 8 35.29% 96.85% 8 30.23% 5.12% 0.3535 8 32.32% 50.00%
9 36.72% 99.61% 9 30.89% 99.61% 9 34.71% 95.67% 1.3038 9 34.75% 100.00%
10 36.67% 99.61% 10 31.18% 98.82% 10 38.85% 90.55% 1.2940 10 35.54% 99.21%
2 35.08% 97.64%
65
Tng hp cc s liu trn, c th nhn thy gia t l chnh xc v t l bao ph tn ti mi quan h t l nghch. Mun t l chnh xc cao th t l bao ph s thp v ngc li mun t l bao ph cao th t l chnh xc s thp. V mc ch p dng cho bi ton truy vn nh sau ny, nn trong qu trnh khi to v hun luyn mng s hung n vic nng cao t l bao ph, chp nhn t l chnh xc thp. Bi l do khi a ra mt cu truy vn tm kim, cho d l cho thng tin th gic nh hay thng tin thng thng, th ngi dng lun mun kt qu cn tm phi xut hin trong cc kt qu tr v. V d: c nh A gn ging vi cc nh A1 , A2 , A3 , A4 , A5 trong c s d liu nh cn tm v khng ging vi cc nh B1 , B2 , B3 , B4 , B5. Khi t l bao ph cao v t l chnh xc thp th tp kt qu tr ra s c th l 5 nh ging v c 5 nh khc. Vy t l bao ph s l 5 nh chnh xc tr ra chia cho tng s nh chnh xc trong c s d liu bng 100%. Trong khi t l chnh xc ch bng 50% bng 5 nh chnh xc tr chia cho tng s nh tr ra l 10. Tuy nhin vi t l bao ph cao nh th th ngi dng thng qua thao tc tm kim v loi b thng tin sai s chc chn tm ra nh cn thit trong c s d liu. Ngc li, nu nng t l chnh xc ln 100% v chp nhn gim t l bao ph th kt qu tr ra nhng nh ging nh A ch c A1 , A2 , A3 v khng c thm nh B no th t l chnh xc s l 100% v t l bao ph cn 60%. Nh th nu nh cn tm ca ngi dng l nh A4 chng hn th khng th s dng kt qu tm kim ca h thng ly ra thng tin cn thit. Chnh v l do ng dng trn m khi xy dng, hun luyn v thit lp cc mng Nron phn lp theo hng t l bao ph cao v chp nhn t l chnh xc mc thp bng cch thit lp cc trng s ban u vi t l bao ph cao ti a. Sau khi c cu hnh mng ti u (tm ra s nt n tt) cho tt c cc mng con. Ta tin hnh hun luyn v ghi nhn b trng s ca cc mng con. Trn c s , tin hnh tnh ton v ghi nhn cc output ca tng mng Nron con cho ton
66
c s d liu nh. Cc output ca cc mng con s l d liu hun luyn cho mng meta-Nron ton cc . Nh vy lc ny mi nh c c trng bi vector c trng mi c thnh phn l output ca cc mng Nron cho tng nh con. V gi y ta tin hnh hun luyn cho mng Nron ton cc meta-Nron vi input l cc output ca cc mng Nron cc b cho tng nh con. Qu trnh hun luyn ca mng meta-Nron cng tng t nh cc mng con : hc nhanh tm s nt n ti u, hc vi s nt n ti u, lu gi b trng s v cp nht vo c s d liu. Lu qu trnh hun luyn cho mng meta-Nron ton cc s khng thay i b trng s hc ti u ca cc mng con. Tin hnh hc nhanh cho mng meta-Nron ton cc vi s nt n t 1- 10 = 2x4+2 tm s nt n ti u cho mng meta-Nron ton cc . Ta c bng kt qu t l phn lp chnh xc v t l bao ph nh sau :
Bng 3.5: Thc nghim phn hoch qua ton h thng lin mng
S nt n HL Precision HL Recall 10 HN Precision HN Recall 8 NT Precision NT Recall 8 42.78 64.17 106.95 42.44 62.99 105.43 41.84 62.6 104.44 42.18 62.6 104.78 36.71 45.67 82.38 41.6 65.35 106.95 41.71 65.35 107.06 42.14 66.54 108.68 41.69 56.3 97.99 41.67 64.96 106.63 90 2.45 92.45 52.75 65.4 118.15 63.88 91.55 155.43 63.93 91.28 155.21 57.71 94.82 152.53 63.21 94.55 157.76 38.75 59.13 97.88 59.87 99.18 159.05 57.24 95.91 153.15 57.42 95.91 153.33 60.56 21.39 81.95 63.16 23.88 87.04 63.33 28.36 91.69 62.73 34.33 97.06 61.34 36.32 97.66 61.54 39.8 101.34 61.36 40.3 101.66 61.29 37.81 99.1 61.68 32.84 94.52 60 43.28 103.28 1 2 3 4 5 6 7 8 9 10
Vi bng kt qu nu trn, cc biu kt qu sau qu trnh hc nhanh th hin nh sau:
67
H Long Ton Cc
80 60 40 20 0 1 3 5 7 9 S Node n
T l
T l phn lp chnh xc T l bao ph
Hnh 3.4: Biu thc nghim mng phn lp H Long
H Ni Ton Cc
150 T l 100 50 0 1 3 5 7 9 S Node n
Hnh 3.5: Biu thc nghim mng phn lp H Ni
Nha Trang Ton Cc

80 T l 60 40 20 0 1 3 5 7 9 S Node n
Hnh 3.6: Biu thc nghim mng phn lp Nha Trang
68
T kt qu trn s chn ra s nt n ti u cho cc mng thnh phn ca mng meta-Nron ton cc TP1 ,TP2 , TP3 ln lt l 10,8,8 v cho kt qu t l phn lp chnh xc v bao ph tt trong trng hp ny. Qua biu trn c th nhn thy ngay l kt qu ca ton h thng sau khi qua mng meta-Nron cho kt qu cao hn d ch qua qu trnh hc nhanh. Sau hun luyn mng meta-Nron ton cc vi input chnh l output ca cc mng con cho 822 nh trong c s d liu mt cch y ngha l hun luyn cho n khi h s li chp nhn c tc nh hn 5% hay vt qu s bc gii hn. Sau khi hun luyn xong th lu li cc trng s ca mng meta-Nron ton cc trong cc file: tcHLTotal.bpn, tcHNTotal.bpn, tcNTTotal.bpn. Sau tin hnh cp nht cc output qua mng meta-Nron ton cc ca 822 nh hun luyn vo c s d liu lm thng tin sau ny tin hnh truy vn. Lc ny, mt nh truy vn bt k dng qua cc mng con s cho ra cc output, ri cc output ny qua mng meta-Nron ton cc s cho ra cc kt qu cui cng. Kt qu cui cng ca nh truy vn s so snh vi kt qu cui cng ca cc nh hun luyn c trong c s d liu. Nu hai kt qu ny gn nhau theo cng thc o s tng ng (2.5) th hai nh s xem l ging nhau. T suy ra vng du lch ca nh truy vn. Nh vy mng meta-Nron ton cc trong tng th ca h thng ng vai tr quyt nh mc quan trng ca cc mng Nron cc b. Hay ni cch khc l output ca cc mng Nron cc b gp bao nhiu phn trm vo kt qu output cui cng s do kt qu hun luyn ca mng meta-Nron ton cc. iu ny rt quan trng trong bi ton truy vn nh v ty vo mi loi hnh nh th mc quan trng ca mi region khc nhau.
69
Vector c trng ca Vng 1
Mng con RN1
Mng con RN2
nh gc
Mng con RN3
Mng kt hp MetaNron
Output ton cc
Mng con RN4
Hnh 3.7: Tng quan qu trnh x l ca h thng lin mng c th (m=4, n=5, L=3)
Trong vector c trng ca cc nh con gm 5 thnh phn l: v tr tm ca nh con, t l din tch nh con, mu L, mu H v mu C theo cng thc trnh by trong phn rt trch c trng mc 3.1. Nh vy, mi nh qua h thng lin mng meta-Nron s cho kt qu output cui cng. Hai nh c xem l ging nhau nu c kt qu output cui cng qua h thng lin mng meta-Nron c gi tr gn nhau theo cng thc o s tng ng (2.5) trong chng 2.
70
Chng 4: CHNG TRNH NG DNG

4.1 Qu trnh x l nh trc khi a vo h thng lin mng T nh gc ban u s tch ra phn nn v phn ni. Sau li tch phn nn lm hai phn v phn ni lm hai phn gia vo mc xm trn cc b. Chy chng trnh ImageGUI.class chn: File Open
Hnh 4.1: nh gc dng truy vn
71
xem kt qu vic tch nh gc thnh phn nn v phn ni, vo Tool Background ForeGround
Hnh 4.2: Phn nn v phn ni
xem kt qu tch ra nh con th nht t nh gc, vo Tool Region1.
Hnh 4.3: Vng 1
72
xem kt qu tch ra nh con th hai t nh gc, vo Tool Region 2
Hnh 4.4: Vng 2
xem kt qu tch ra nh con th ba t nh gc, vo Tool Region 3
Hnh 4.5: Vng 3
73
xem kt qu tch ra nh con th t t nh gc, vo Tool Region 4
Hnh 4.6: Vng 4
4.2 Rt trch cc c trng v lu vo c s d liu Chy chng trnh ImageGUI chn Tool Update Folder, ri m th mc cha cc nh hun luyn v chn vng du lch ca cc nh trong folder ny. Chng trnh s ln lt rt trch cc c trng ca tt c cc nh trong th mc chn v cp nht cc c trng vo c s d liu.
74
Hnh 4.7: Cp nht c trng vo c s d liu
4.3 Tm cu hnh mng ti u Chy chng trnh myICTrainer.class, ln lt chn H Long, H Ni v Nha Trang v xem kt qu t l phn lp chnh xc v t l bao ph vi s nt n t 1 ti 10 qua qu trnh hc nhanh. Qua chn s nt n ti u cho cc mng con. Sau khi chn s nt n ti u, chy file myICTrainerUserNode.class ln lt cho H Long, H Ni v Nha Trang hun luyn v lu li trng s cc mng con ti u. Sau khi c cc mng con ti u, chy file myRegionUpdate.class cho H Long, H Ni v Nha Trang cp nht output ca 822 nh hun luyn qua cc mng con vo c s d liu.
75
Sau khi rt trch cc c trng cho tng nh con tin hnh cho hun luyn trn tng nh con theo mng Nron lan truyn ngc. Sau khi vic hun luyn cc b trn tng nh con hon tt, tin hnh tnh ton v ghi nhn cc output trn tng region xc nh vector c trng ton cc cho nh. By gi mi nh hun luyn c trng bi mt vector c 4 thnh phn l output ca 4 nh con cc b. By gi tin hnh hun luyn cho mng meta-Nron ton cc. Ln lt cho hc nhanh (chp nhn sai s ln) vi s bc n iu chnh tham s ti a 200000 v ghi nhn kt qu phn loi xem thit lp bao nhiu nt n l ti u. Mng meta-Nron ton cc s quyt nh mc quan trng ca cc mng cc b nn s nh hng ln n kt qu truy vn. Chy chng trnh myICTotalTrainer.class, ln lt chn H Long, H Ni v Nha Trang v xem kt qu t l phn lp chnh xc v t l bao ph vi s nt n t 1 ti 10 qua qu trnh hc nhanh. Qua chn s nt n ti u cho cc mng meta-Nron ton cc . Sau khi chn s nt n ti u, chy file myICTotal TrainerUserNode.class ln lt cho H Long, H Ni v Nha Trang hun luyn v lu li trng s cc mng meta-Nron ton cc ti u.
76
Hnh 4.8: Hun luyn vi s nt n ti u
Sau
khi
trng
mng
ton
cc
ti
u,
chy
file
myTotalUpdateOutput.class cho H Long, H Ni v Nha Trang cp nht output ca 822 nh hun luyn qua cc mng meta-Nron ton cc vo c s d liu. Trong phm vi nghin cu ny tin hnh trn tp 822 nh hun luyn gm 201 nh thuc v H Long, 367 nh thuc v H Ni v 254 nh thuc v Nha Trang. Cn c vo kt qu thc nghim trn th nn chn s nt n cho mng metaNron H Long l 10, cho H Ni l 8 v cho Nha Trang l 8 nt n l ti u v tng th da trn ba yu t: chnh xc, bao ph v thi gian hun luyn.
77
4.4 Thc hin truy vn tm vng du lch Chy chng trnh ImageGUI.class ri chn File Open m mt file nh dng truy vn no . Sau Vo Edit Searching, h thng s tm vng du lch v hin th nh ca vng du lch
Hnh 4.9: Kt qu truy tm vng du lch
Tin hnh truy vn kim th trn 82 nh c kt qu sau tm ng vng du lch l 59 nh t t l: 71.95%. nng cao hn na hiu qu truy vn vng du lch cn s dng h thng rt trch cc c trng trong nh tt hn ca mt s tc gi khc v ang nghin cu chuyn v rt trch c trng. Trong phm vi lun vn ny, tp trung ch yu vo vic xy dng v pht trin h thng lin mng meta-Nron.
78
Chy file ImageGUI.class, ln lt chn cc phng php khc nhau:
Hnh 4.10: Chc nng thng k xc nh vng du lch
Tin hnh truy vn tm vng du lch trn 82 nh test theo mt s phng php: da vo mt mng Nron con, kt hp trung bnh (nh ng mc tin cy ca 4 vng) v dng h thng lin mng c bng kt qu sau:
Bng 4.1: Kt qu thc nghim mt s phng php Kt Hp Mng Con I H Long H Ni Nha Trang Tng Cng 13 17 16 46 Mng Con II 13 21 15 49 Mng Con III 14 22 10 46 Mng Con IV 12 20 12 44 Trung Bnh 16 24 15 55 Kt Hp Lin Mng 15 22 22 59
79
T v ra biu so snh kt qu sau:
So Snh Kt Qu Mt S Phng Php

0.8 T L T m n g V n g D u L ch 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 Mng Con I Mng Con II Mng Con III Mng Con IV Kt Hp Trung Bnh Kt Hp Lin Mng
Phng Php
Hnh 4.11: Biu so snh mt s phng php
R rng ch da trn nh gi ca tng mng con m truy vn th t l truy tm chnh xc vng du lch khng cao, khi kt hp kt qu cc mng con li d l phng php trung bnh hay dng mng Nron kt hp th hiu qu u c nng ln ng k. Tuy nhin, phng php dng mng Nron kt hp cc kt qu sau qu trnh hun luyn s cho nh gi mc tin cy ca cc mng con chnh xc hn phng php trung bnh.
80
Chng 5: KT LUN
Truy vn nh da trn ni dung (CBIR) n nay vn l lnh vc nghin cu rt ng quan tm v c nhiu phng php v cch tip cn khc nhau. Hu ht cc ng dng hu ch ca CBIR hin nay l cc ng dng p dng trc tip k thut CBIR mc 1. Nh cc ng dng nhm ngn nga ti phm, h thng tm kim vn tay, cc h thng nhn dng khun mt hay cc ng dng trong qun i: tm kim c my bay trong mn hnh rada hay khng, nu c l my bay g loi no; cc h thng h tr qun l ng k logo (xc nh xem logo mun ng k l hon ton mi hay c logo tng t ng k trc ) Tnh khoa hc ca lun vn th hin qua phng php truy vn nh dng h thng lin mng meta-Nron. Mng Nron con vi u vo l cc vector c trng dng lng t gm c trng gm thng tin v mu sc, hnh dng v v tr xut, s kt hp cc c trng ny cho ra kt qu nh gi ca mng con. Sau , nng cao chnh xc ca h thng mng meta-Nron ton cc s kt hp kt qu ca cc mng con cho ra kt qu cui cng ca ton h thng lin mng. Xy dng h thng truy vn nh, ng thi ch ra tnh kh thi ca h thng so vi cc h thng khc qua cc kt qu thc nghim. Gi tr thc tin ca lun vn c chng minh qua ng dng thc t tra cu vng du lch. Lun vn ny xut mt phng php kt hp cc c trng mu sc, hnh dng v v tr bng h thng lin mng meta-Nron. H thng lin mng metaNron khng nhng p dng vo cc c trng mu sc, hnh dng v v tr ca nh m cn c th p dng cho cc c trng lng t khc. Cc c trng lng t bt k rt trch t nh s qua cc mng Nron con cho ra cc output cc b. Cc output ca cc mng con s l ng vo ca mng meta-Nron cho ra cc kt qu output cui cng ca ton h thng lin mng.
81
Tuy nhin, lun vn vn cn nhng hn ch nht nh: cn hon thin ng dng tra cu vng du lch v ra phng php t ng xc nh cu hnh h thng mng Nron ti u cho lp bi ton tng ng. Kt hp h thng lin mng meta-Nron vi cc phng php rt trch i tng trong nh ang nghin cu ca cc tc gi khc nng cao kt qu truy vn ca h thng xut l mt hng pht trin ca lun vn ny.
82
TI LIU THAM KHO

Ting Vit [1] Lm Th Ngc Chu (2003), "Xy dng ch mc cho C S D Liu nh", Lun vn thc s ca khoa Cng Ngh Thng Tin, Trng i hc Khoa Hc T Nhin, Tp. H Ch Minh [2] Nguyn Vn Diu (2003), "Bin i wavelet v ng dng trong tm kim trn C S D Liu nh", Lun vn thc s ca khoa Cng Ngh Thng Tin, Trng i hc Khoa Hc T Nhin, Tp. H Ch Minh [3] Hong Kim, L Hoi Bc, L Hong Thi (2000), "Mng Nron v thut gii di truyn: ng dng cho nhn dng ch vit tay", Hi ngh khoa hc ln th hai: Bo co khoa hc Cng Ngh Thng Tin, Trng i hc Khoa Hc T Nhin, Tp. H Ch Minh. [4] Nguyn Phc Lc, "Truy vn C S D Liu nh qua m hnh Mediator Markov Model", Lun vn thc s Cng Ngh Thng Tin, Trng i hc Khoa Hc T Nhin, Tp. H Ch Minh. [5] L Hong Thi (2004), Xy Dng, Pht Trin, ng Dng Mt S M Hnh Kt Hp Gia Mng Nron (NN), Logic M (FL) v Thut Gii Di Truyn (GA), Lun n Tin S Ton hc, Trng i hc Khoa Hc T Nhin, Tp. H Ch Minh. Ting Anh [6] L Hoi Bc, L Hong Thi (2004), The GA_NN_FL associated model for authenticating fingerprinter, the KES2004 International Program Committee, Wellington Institue of Technology, NEW ZEALAND.
83
[7]
Brown, R. and B. Pham (2005), Image Mining and Retrieval Using Hierarchical Support Vector Machines, Proceedings of the 11th International Multimedia Modelling Conference (MMM'05)-Volume 00, p. 446-451.
[8]
Castelli, V., et al. (1998), Progressive search and retrieval in large image archives, IBM J RES DEV, 42(2): p. 253-268.
[9]
Chen, Y. and J.Z. Wang (2002), A region-based fuzzy feature matching approach to content-basedimage retrieval, Pattern Analysis and Machine Intelligence, IEEE Transactions on, 24(9): p. 1252-1267.
[10]
Eakins, J., M. Graham, and N. University of Northumbria at (1999), Content-based Image Retrieval, University of Northumbria at Newcastle.
[11]
Ghoshal, A., P. Ircing, and S. Khudanpur (2005), Hidden Markov models for automatic annotation and content-based retrieval of images and video, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, p. 544-551.
[12]
Hoiem, D., et al. (2004), Object-based image retrieval using the statistical structure of images, Computer Vision and Pattern Recognition, CVPR 2004. Proceedings of the IEEE Computer Society Conference on. 2.
[13]
Lee, H.K. and S. Yoo (2001), A Neural Network-based Flexible Image Retrieval
[14]
Prasad, B.G., K.K. Biswas, and S.K. Gupta (2004), Region-based image retrieval using integrated color, shape, and location index, Computer Vision and Image Understanding, 94(1-3): p. 193-233.
84
[15]
Schettini, R., G. Ciocca, and S. Zuffi (2001), A survey on methods for colour image indexing and retrieval in image databases, Color Imaging Science: Exploiting Digital Media, p. 183-211.
[16]
Tong, S. and E. Chang (2001), Support vector machine active learning for image retrieval, Proceedings of the ninth ACM international conference on Multimedia, p. 107-118.
[17]
Torres, J.M. and A.P. Parkes (2000), User modelling and adaptivity in visual information retrieval systems, Workshop on Computational Semiotics for New Media, University of Surrey, Surrey, UK, June of, 2000.
[18]
Van Den Broek, E.L., P.M.F. Kisters, and L.G. Vuurpijl (2005), Contentbased image retrieval benchmarking: Utilizing color categories and color distributions, The Journal of imaging science and technology, 49(3): p. 293-301.
[19]
Van Rikxoort, E.M., E.L. Van den Broek, and T.E. Schouten (2004), the development of a human-centered object-based image retrieval engine, Proceedings of the Eleventh Annual Conference of the Advanced School for Computing and Imaging: p. 401408.
[20]
Veltkamp, R.C. and M. Tanase (2000), Content-based image retrieval systems: A survey, Ultrecht, Netherlands: Department of Computing Science, Utrecht University.
[21]
Vertan, C. and N. Boujemaa (2000), Embedding fuzzy logic in content based image retrieval, Fuzzy Information Processing Society, 2000. NAFIPS. 19th International Conference of the North American, p. 85-89.
85
[22]
Zhang, L., F. Lin, and B. Zhang (2001), Support vector machine learning for image retrieval, Image Processing, Proceedings International Conference on, 2.
Websites [23] [24] [25] [26] http://debut.cis.nctu.edu.tw/pages/slides/jeffrey/present2.pdf (Oct 2005) http://homepages.inf.ed.ac.uk/rbf/CVOnline/dbase.htm (Oct 2005) Blobworld, http://elib.cs.berkeley.edu/photos/blobworld/ (Nov 2005) AltaVista Photofinder, http://image.altavista.com/cgi-bin/avncgi. (Jan 2006) [27] [28] [29] [30] [31] [32] ImageMiner, http://www.tzi.de/bv/ImageMinerhtml/ (Jan 2006) NETRA, http://maya.ece.ucsb.edu/Netra/ (Jan 2006) Query By Image Content, http://wwwqbic.almaden.ibm.com/ (Jan 2006) VisualSeek, http://www.ctr.columbia.edu/VisualSEEk/ (Feb 2006) WebSeek, http://www.ctr.columbia.edu/WebSEEk/ (Feb 2006) Wavelet Image Search Engine, http://www.stanford.edu/~wangz/project/imsearch/ (Feb 2006) [33] Remco C. Veltkamp, Mirela Tanase, Department of Computing Science, Utrecht University, Content-Based Image Retrieval Systems: A Survey, http://give-lab.cs.uu.nl/cbirsurvey/cbir-survey/index.html (Mar 2006)
86
PH LC A: Mng Nron Lan Truyn Ngc

A.1 Cu Trc Mng
. .
Hnh A.1: Mng Nron
Hnh A.1 trn minh ha mt mng Nron gm 3 lp: 1 lp input, 1 lp n v 1 lp output. Mi lp gm nhiu n v lin kt vi cc n v ca lp k tip bi cc trng s. Lp n cha cc Nron, mi Nron c c ch x l thng tin: ni kt v bin i ton hc bn trong Nron. Hot ng ca mt Nron trong trng hp mng c 1 lp n c th minh ha nh hnh sau:
x1 w1i x2
. .
xn
w2i wni w0i
SUM
Transfer
Hnh A.2: Hot ng ca mt Nron
T cc nt nhp x, da vo hm tng (Summation) tnh ra gi tr cc nt n trung gian H. Sau , cho gi tr H qua hm truyn (Transfer) tnh ra cc gi tr xut Y = f(H) vi f l hm truyn.
87
C mt s hm truyn thng dng nh:Limiter, Rampling v Sigmod
Hnh A.3: Mt s hm truyn
A.2 Thut gii lan truyn ngc Cho khng gian cc mu hc (x,t) , x l gi tr cn hun luyn v t l gi tr output k vng ca qu trnh hun luyn, h s hc . Thut gii lan truyn ngc c tm tt nh sau: 1. To mng truyn thng gm nin nt input, h lp n mi lp n c nhidden nt v nout nt output. 2. Khi to b trng s cho mng. 3. Trong khi <iu kin dng cha tha> lm Vi mi cp (x, t) trong khng gian mu hun luyn thc hin I. Xt lp n: truyn x qua mng, ti mi lp xc nh u ra ca mi Nron. Qu trnh ny thc hin cho n khi gp lp xut.
88
II. Xt lp xut: i vi u ra Ok ca Nron k trong lp xut K, xc nh sai s k ca n: k=Ok(1-Ok)(tk-Ok) (A.1). Chuyn sang lp n L=K-1. III. Xt lp n: vi mi Nron trn lp n th L, xc nh sai s t ca n
t = Ot (1 Ot ) wit t
iL +1
(A.2)
IV. Cp nht trng s trong mng, whj=whj+*oj*oj (A.3) V. Nu (L>1) th chuyn sang lp n k tip v quay v bc III ngc li th chn cp mu hc khc v quay li bc I Tm li, gi tr sai s tnh u tin cho cc Nron lp xut, kt qu ny c dng tnh sai s ca cc Nron lp n cao nht, cc lp n k tip th tnh da theo kt qu ca lp n cao hn. C th lan truyn ngc cho n lp nhp.
89
PH LC B: C S D Liu nh
Tp nh hun luyn gm 822 nh, trong c 201 nh H Long, 367 nh H Ni v 254 nh Nha Trang. Tp nh kim tra gm 82 nh, trong c 22 nh H Long, 35 nh H Ni v 25 nh Nha Trang B.1 Mt s nh hun luyn
Hnh B.1: nh hun luyn 1
90
91
B.2 Mt s nh kim tra
Hnh B.5: nh kim tra 1
92
93
PH LC C: C S D Liu c Trng
Cc c trng ca nh c lu trong bng ImageFeatures trn database SQL Server 2000
Hnh C.1: C s d liu c trng
94
Cu trc ca bng d liu ImageFeatures nh sau:

Bng C.1: M t c s d liu c trng
Nhm Nhm m rng
Tn Ct ImageID ImagePath R1CenterPosition R1AreaRatio
ngha M Kha chnh ng dn file hnh c trng th nht ca vng 1 ca nh c trng th hai ca vng 1 ca nh c trng th ba ca vng 1 ca nh c trng th t ca vng 1 ca nh c trng th nm ca vng 1 ca nh c trng th nht ca vng 2 ca nh c trng th hai ca vng 2 ca nh c trng th ba ca vng 2 ca nh c trng th t ca vng 2 ca nh c trng th nm ca vng 2 ca nh c trng th nht ca vng 3 ca nh
Nhm cc c trng ca vng 1
R1CenterColorL R1CenterColorH R1CenterColorC R2CenterPosition R2AreaRatio
R2CenterColorL R2CenterColorH R2CenterColorC
R3CenterPosition
95
R3AreaRatio R3CenterColorL R3CenterColorH R3CenterColorC R4CenterPosition R4AreaRatio Nhm cc c trng ca vng 4 R4CenterColorH R4CenterColorC Nhm m rng Place R1HaLongLocalOutput Nhm cc output mng R1HaNoiLocalOutput con 1 R1NhaTrangLocalOutput Nhm cc output mng R2HaLongLocalOutput con 2 R4CenterColorL
c trng th hai ca vng 3 ca nh c trng th ba ca vng 3 ca nh c trng th t ca vng 3 ca nh c trng th nm ca vng 3 ca nh c trng th nht ca vng 4 ca nh c trng th hai ca vng 4 ca nh c trng th ba ca vng 4 ca nh c trng th t ca vng 4 ca nh c trng th nm ca vng 4 ca nh Vng du lch Kt qu nt output th nht ca mng con 1 Kt qu nt output th hai ca mng con 1 Kt qu nt output th ba ca mng con 1 Kt qu nt output th nht ca mng con 2
96
R2HaNoiLocalOutput R2NhaTrangLocalOutput R3HaLongLocalOutput Nhm cc output mng R3HaNoiLocalOutput con 3 R3NhaTrangLocalOutput R4HaLongLocalOutput Nhm cc output mng R4HaNoiLocalOutput con 4 R4NhaTrangLocalOutput HaLongTotalOut HaNoiTotalOut NhaTrangTotalOut Nhm m rng ContextText
Kt qu nt output th hai ca mng con 2 Kt qu nt output th ba ca mng con 2 Kt qu nt output th nht ca mng con 3 Kt qu nt output th hai ca mng con 3 Kt qu nt output th ba ca mng con 3 Kt qu nt output th nht ca mng con 4 Kt qu nt output th hai ca mng con 4 Kt qu nt output th ba ca mng con 4 Kt qu nt output th nht ton cc Kt qu nt output th hai ton cc Kt qu nt output th ba ton cc Thng tin chi tit v vng du lch
Nhm output ton cc
97
Lu cc thng tin: tn file nh, vng du lch v thng tin chi tit ca 822 nh hun luyn vo cc ct tng ng ImagePath, Place v ContextText. Rt trch cc c trng ca vng 1 ca nh vo cc nhm ct c trng ca vng 1. Rt trch cc c trng ca vng 2 ca nh vo cc nhm ct c trng ca vng 2. Rt trch cc c trng ca vng 3 ca nh vo cc nhm ct c trng ca vng 3. Rt trch cc c trng ca vng 4 ca nh vo cc nhm ct c trng ca vng 4. S dng gi tr ca tt c 822 dng ti nhm ct c trng vng 1 v Place hun luyn cho mng con th nht RN1. Hun luyn xong ghi nhn output ca mng con ny vo nhm ct cc output ca mng con 1. Tin hnh tng t cho cc mng con RN2, RN3,RN4. S dng gi tr ca tt c 822 dng ng vi cc ct R1HaLongLocalOutput, R2HaLongLocalOutput, R3HaLongLocalOutput, R4HaLongLocalOutput v Place hun luyn mng thnh phn TP1. Sau khi hun luyn xong mng thnh phn ny lu gi tr output ca mng thnh phn vo ct HaLongTotalOut. Tng t cho cc mng thnh phn TP2, v TP3.

Bao Cao Luan Van Final

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Bao Cao Luan Van Final

Uploaded by

Copyright:

Available Formats

I HC QUC GIA THNH PH H CH MINH

TRNG I HC KHOA HC T NHIN

NGHIN CU PHNG PHP KT HP CC C TRNG MU SC HNH DNG V V TR TRUY VN NH

LUN VN THC S NGNH TIN HC

NGI HNG DN KHOA HC: T.S. L HONG THI

Thnh ph H Ch Minh - 2007

Tp. H Ch Minh, ngy 31 thng 12 nm 2007 Hc vin Cao hc Tin hc kha 14

DANH MC BNG BIU

DANH MC HNH V V BIU

Chng 1: TNG QUAN V TRUY VN NH V CC HNG TIP CN

Hnh 1.1: H thng truy vn nh ca Yahoo

Rt trch c trng v o s tng ng nh truy vn

Hnh 1.2: M hnh rt trch c trng thi gian thc

nh truy vn H thng truy vn nh Rt trch c trng C s tri thc

Biu din ca nh truy vn

1.2 Cc phng php truy vn nh chnh

lab.cs.uu.nl/cbirsurvey v mc la chn c trng truy vn ca mt s h thng truy vn nh da trn ni dung c th nh sau:

1.3 Truy vn nh da trn ni dung

Hnh 1.5: H thng truy vn nh kt hp mu sc v kt cu

1.4 Mt s h thng truy vn nh c th

s mc xm t 0 n L (s mc xm), trc tung Oy biu din s im nh cho mt mc xm tng ng.

Hnh 1.6: Hai dng lc mc xm

o gia 2 histogram gi l o phn giao cp histogram (histogram intersection measure) ca nh q v nh t l:

min( p (m), p (m))

Biu mc xm s phn thnh cc loi EN, TRNG. Vi

Trong , Xi l s pixel c mc xm i. Ri EN s phn thnh 1, 2, nh sau:

Hnh 1.7: Qu trnh phn tch mc xm

Hnh 1.8: Phn vng v tr

Kt qu thc nghim ca h thng ny nh sau:

Da trn hnh dng

Trung bnh lch chun

Da trn mu sc- hnh dng

Da trn mu sc hnh dng v tr

Trung bnh lch chun

Tm kim trong c s d liu

o s tng ng kt hp cc khong cch bng mng Nron i xng tm

Hc thch nghi bng mng i xng tm

Phn hi ca ngi dng Truy vn nh

Hnh 1.9: H thng truy vn nh NNFIR

f 1q , f 2q , f 3q l cc histogram mu Red, Green, Blue xc nh nh sau:

vi q[i][ x,y]=k ngc lai

v f 7q , f 8q , f 9q ln lt l trung bnh v phng sai ca cc

thnh phn mu red, green, blue xc nh nh sau:

Hnh 1.11: nh qua php bin i wavelet song trc giao mc 1

Hnh 1.12: nh qua php bin i wavelet song trc giao mc 2

Hnh 1.13: nh qua php bin i wavelet song trc giao mc 3

so snh histogram ta dng o phn giao ca hai histogram nh sau:

Vi i=1,2,3. so snh cc c trng khc ta s dng php tr n gin:

vi = fiq fit , i = 4,5,...,29

Gi tr phn hi ca ngi dng v kt qu truy vn xc nh nh sau:

Mng Nron RBF c th minh ha nh sau:

0.9 0.4 S tng ng

0.9 0.5 Phn hi ca ngi dng

Hnh 1.15: Kt qu ln truy vn ln u

Hnh 1.16: Kt qu truy vn sau khi nhn phn hi

Kt qu t c ca h thng NNFIR so vi cc cch kt hp tuyn tnh nh sau:

Phng php kt hp tuyn tnh

NNFIR 81.70% 54.22% 16.92 msec

71.32% 40.11% 7.33 msec

T l chnh xc khi bao ph l 100% Thi gian kt hp

bao ph (Recall) = S nh ng tr ra/Tng s nh ng trong CSDL. chnh xc (Precision) = S nh ng tr ra/Tng s nh tr ra.

Chng 2: XUT H THNG LIN MNG META-NRON

Hnh 2.1: Mng Nron truyn thng

Trong g(vi) l hm truyn theo vi