Professional Documents
Culture Documents
Ci tin gii thut mng noron SOM p dng phn cm mu nh Improving som neural network algorithm for color image clustering problem
L Anh T1, Nguyn Quang Hoan2
1
Trng i hc Cng ngh thng tin v truyn thng, i hc Thi Nguyn Email: anhtucntt@gmail.com 2 Hc vin Cng ngh Bu chnh Vin thng Email: quanghoanptit@yahoo.com.vn
BMU Best Matching Unit
Tm tt
Trong qu trnh th nghim mng noron SOM gii bi ton phn cm mu nh, chng ti nhn thy vic p dng thut ton tch t to nhm l khng ph hp v vic p dng gii thut loang khng em li kt qu nh mong mun. T , bi bo ny xut gii thut SOM ci tin cho php thc hin vic phn cm noron trn lp Kohonen ngay trong qu trnh hun luyn. Chng ti ci t thut ton ci tin v th nghim phn cm mu trn nh s. Qua quan st kt qu trc quan cho thy gii thut t c nhng kt qu kh n tng.
1. t vn
Mng noron SOM c Teuvo Kohonen pht trin vo nhng nm 80 [1,2,3,4]. y l mng truyn thng s dng thut hc cnh tranh, khng gim st [1,2]. SOM l mt cng c thch hp trong khai ph d liu [5]. N c ng dng trong nhiu bi ton [6] nh nhn dng ting ni Kohonen, 1989 , robotics Ritter et al., 1989 , my o Oja, 1992 , ti u t hp Fort, 1988 , phn lp nh (Kohonen, 1984 Mng noron SOM c thit k ch yu gim s chiu d liu v trc quan thng tin. Tuy nhin, c th kt hp SOM vi cc k thut xc nh cm khc phn cm d liu [11]. Hin ti, trong cc bi ton phn cm d liu nu s dng mng noron SOM cn thc hin theo hai giai on (H.1 : giai on th nht l thc hin gii thut SOM to bn phn b c trng ca tp d liu, giai on th hai trc quan bn v hnh thnh ng bin gia cc cm trn bn (ma trn) trc quan. Giai on mt c ngha quan trng bi n to ra tp nh x c trng trn lp ra Kohonen t tp d liu vo, trong cc d liu c s tng ng nhau s c c trng bi cc noron gn nhau trn lp Kohonen. Xt v bn cht, mi noron trn lp ra Kohonen l i din cho mt hoc mt s mu d liu, do vy vic phn cm d liu chnh l phn cm cc noron (xc nh mi noron thuc v cm no). Tuy nhin, gii thut SOM ch ng vai tr gom cm d liu m khng thc s quyt nh chnh xc d liu g thuc v cm no. V th, hiu qu phn cm ph thuc vo k thut trc quan bn v ph thuc vo thut ton p dng xc nh ranh gii cm trn ma trn trc quan thuc giai on hai. K thut trc quan c s dng ph bin l ma trn khong cch, trong mi phn t ca ma trn l khong cch ca mt n v noron trong SOM n cc lng ging (noron) lin k ca n. V d k thut trc quan dng ma trn hp nht khong cch UMatrix [7] hoc dng gi tr khong cch trung bnh
Abstract
During SOM Neural network testing to solve color image clustering problem, we find out that the application of agglomerative algorithm to create groups is less inappropriate and the application of the spreading algorithm does not produce desired results. Therefore, the paper proposed an improved SOM algorithm allowing implementation of the neural clustering in the Kohonen layer during the training. We implement improved SOM algorithm and experiment color clustering on digital images. Based on visual observation results, the algorithm has achieved quite impressive results.
K hiu
K hiu
n v
ngha hm ni suy theo thi gian hc Hm xc nh bn knh ln cn ti thi im t Bn knh khi to Vector trng s ti thi im t Hm ni suy tc hc ti thi im t Gi tr khi to ca tc hc
t
0
w t
t
0
Ch vit tt
SOM
SelfOrganizing Map
VCCA-2011
743
Tp hun luyn
- Chn ngu nhin mt u vo v t tp d liu, tnh khong cch dist gia v v vector trng s w tt c cc noron. Noron b c dist nh nht c chn lm noron chin thng (BMU). C th s dng cc hm khong cch nh Euclidian thng dng , Manhattan, hay Vector Dot Product.
dist || v
- Xc inh
w b || min || v mi ||
i
(1) ca BMU:
bn
knh
ln
cn
s t
s0 exp
t l hm ni suy bn knh l
H. 3
gim dn theo s ln lp , vi 0 l bn knh ti K thi im t0; hng s thi gian l , vi log s0 K l t ng s ln lp. - Cp nht li trng s cho cc noron ln cn ca BMU theo hng gn hn vi vector u vo v
Mng noron SOM gm 2 lp: lp tn hiu vo v lp ra noron Kohonen. Lp Kohonen thng c t chc di dng mt ma trn 2 chiu cc noron. Mi n v i (noron) trng lp Kohonen c gn mt vector trng s wi= [wi1, wi2, ,win], vi n l kch thc vector u vo; wij c hiu l trng s ca noron i ng vi u vo j). 2.2 Thut ton hc Qu trnh hun luyn mng c lp nhiu ln, ti ln lp th t thc hin:
wi t
wi t
a t hbi t v
wi t
(2)
Trong : + a t
a0 exp
t l hm ni suy tc hc, l
vi 0 l gi tr khi to ca tc hc. + hbi(t) hm ni suy theo thi gian hc, th hin s tc ng ca khong cch i vi qu trnh hc,
VCCA-2011
744
cng
thc
hbi t
exp
|| rb ri || 2s 2 t
trong rb v ri l v
rc E
i 1 j 1
hbj || vi
w j ||2 trong , N l s mu
H. 4 Minh ha U-Matrix c m ha theo mc xm
u vo, M s noron trong lp Kohonen Thut ton hc SOM c tm lc trong 5 bc c bn nh sau: Bc 1: Xc nh cu hnh mng, v cc tham s. Bc 2: Khi to ngu nhin trng s ca cc noron lp Kohonen Lp li Bc 3: c mu hc v, a vo lp vo. Bc 4: Tm noron chin thng (BMU) trong lp Kohonen (gn mu hc v nht) Bc 5: Duyt mi noron trong bn knh ln cn ca BMU: - Cp nht li trng s theo cng thc (2) Cho n khi tha mn iu kin dng. Cc im cn lu trong thut ton hc: - Khi to cc tham s: SOM b nh hng rt nhiu bi qu trnh la chn cc tham s ca mng. Cc tham s ny bao gm: kch thc ca bn (Width/Height), s ln lp (K), bn knh khi to (0), gi tr khi to cho tc hc (0). Thc t khng c mt hng dn c th cho vic la chn cc tham s ny ng vi cc bi ton p dng SOM, do vy, vic th sai (trial and error) l cn thit nhm xc nh tp cc gi tr thch hp ng vi tp d liu u vo. - iu kin dng: C th da trn s ln lp, s mu hc, hay cn bng ca mng cc trng s thay i di mt ngng nht nh . 2.3 Trc quan mng s dng ma trn khong cch Phng php ny s dng khong cch gia cc vector trng s ca mi noron nh l mt tiu chun xc nh ranh gii gia cc cm. Gii php thng dng l xy dng ma trn U-Matrix [7], sau m ha ma trn ny theo mc xm (H.4). Cc cm trong ma trn l cc vng mu sng khong cch gia vector trng s ca cc noron nh , cc vng mu ti khong cch ln l min phn cch gia cc cm. xc nh mi n v trong ma trn thuc v cm no, ngi ta thng s dng thut ton tch t [9,10]. Cc bc ca thut ton nh sau: Bc 1: Quy cho mi n v trong ma trn mt cm ring Bc 2: Tnh ton khong cch gia tt c cc cm Bc 3: Ghp hai cm gn nht Bc 4: Nu s cm tn ti bng s cm do ngi dng nh ngha trc th dng, nu khng lp li t bc 2
Cng c th p dng thut ton loang pht hin cc cm mt cch t nhin. Trong trng hp gi tr trng s ca cc noron bin thin nh th gii thut ny hu nh tht bi do kh xc nh c chnh xc ranh gii ca cm . 2.4 Hn ch ca m hnh phn cm s dng gii thut SOM chun khi p dng phn cm mu trn nh Kh khn th nht l vic pht hin s lng v bin cm theo ni dung ca nh: nu p dng thut ton tch t cn bit trc s cm cn hnh thnh; cn p dng thut ton loang thng tht bi do kh xc nh c ranh gii chnh xc gia cc cm khi cc im mu trn nh c s bin thin nh H.5c). Kh khn th hai l tc hi t ca gii thut chm do khi lng tnh ton ln. Xt mt mng SOM vi kch thc 20x30=600 noron, phn gii ca bc nh u vo c tnh bng n v megapixel tc l c ti hng triu im nh. Nh vy ring trong qu trnh hun luyn, vic tm BMU phi duyt qua khong 600 triu ln cc noron. Ngoi ra, cc thut ton hnh thnh cm cng i hi s ln lp tng i ln.
a) Tp u vo b) Ma trn c) Kt qu hnh ngu nhin Kohonen thnh cm H. 5 Phn cm tht bi khi s dng thut ton loang
khc phc hai hn ch cn mt gii php hnh thnh cm ph hp v tng tc gii thut. l gii thut SOM ci tin ca bi bo ny.
VCCA-2011
745
VCCA-2011
746
4. Thc nghim
4.1 Thit k cu trc mng phn cm mu nh Mi im nh c coi l mt vector u vo vi 3 thnh phn Red, Green, Blue. Nh vy, mng gm c 3 u vo tng ng vi 3 gi tr mu ca im nh. Kch thc bn (width, height) l (20,40). 4.2 Hun luyn mng s dng PSOM Hnh H.6 th hin trc quan kt qu hun luyn v phn cm cc noron trc tip trn ma trn Kohonen bng gii thut PSOM. Kt qu H.6c vi cc cm c hnh thnh r rng, hn hn so vi kt qu H.5c s dng thut ton loang pht hin bin cm .
b)Ma trn c)Kt qu hnh a)Tp u vo Kohonen thnh cm ngu nhin H. 6 PSOM phn cm trn lp Kohonen vi tp hun luyn ngu nhin
4.3 Th nghim kh nng phn cm mu trn nh s S dng kt qu hun luyn ca PSOM phn cm mu trn cc nh. C th, mu 1 l nh vo vi cc chi tit phn bit mu sc kh r; mu 2 l nh chp t nhin. C hai trng hp u cho kt qu phn cm kh quan H.7 . Vi cc nh chp t nhin khc, kt qu th nghim l tng t. Bng trc quan cho thy cc cm c nhn dng chnh xc. Gii thut PSOM c hiu qu.
Hnh thnh cm trn ma trn Kohonen Phn cm mu trn nh
Mu
nh vo
H. 7
[5] J. Han and M. Kamber, Data Mining - Concepts and Techniques, Morgan Kaufmann, Chapter 8, 2001. [6] Jari Kangas and Teuvo Kohonen, Developments and Application of the Self-Organizing Map and Related Algorithms, Mathematics and Computers in Simulation, 1996. [7] Alfred Ultsch and H. Peter Siemon, Kohonen's self-organizing feature maps for exploratory data analysis, Proceedings of the International Neural Network Conference (INNC'90), pages 305-308. Kluwer, 1990. [8] M. A. Kraaijveldd, J. Mao, and A. K. Jain, A nonlinear projection method based on kohonens
VCCA-2011
747
VCCA-2011
748