HNG DN S DNG PHN MM MNG N RON SPICE-MLP

Cao Thng 2003 2007

Cp nht 2011 Jan.

Bias
0 Bias
0

Teta _ J 0
Teta _ K 0

wI 0 J 0
x1 w J 0 K 0
1 1 1 y1

xi j
i
wij w jk k yk

m
xn n l yl
Weight_IJ Weight_JK

INPUT LAYER HIDDEN LAYER OUTPUT LAYER

1. GII THIU
Mc ch chnh ca ti liu ny l hng dn bn c s dng
phn mm Spice-MLP, v khng i su vo l thuyt mng n
ron. Nu mun tm hiu thm v l thuyt, cc bn c th tham
kho cc ti liu v mng n ron c sn trn internet hoc sch
chuyn ngnh.
Mc ch ca cc phn mm Spice-MLP v SpiceSOM l gip
bn bit cch s dng mng n ron mt cch c bn, nhanh chng
v hiu qu m khng phi c nhiu v l thuyt mng n ron.
Khi bn hiu r tng chc nng ca cc phm mm ny, bn
c th d dng tip cn vi l thuyt cng nh cc ti liu tham
kho v mng n ron.
Spice-MLP l phn mm mng n ron 3 lp, vi nhiu u vo v
nhiu u ra. Spice-MLP c vit vi mc ch hng dn sinh
vin v nghin cu sinh hc tp v s dng mng n ron m
hnh ha nhiu loi d liu khc nhau. Hin ti Spice-MLP ang
c nhiu bn trn th gii s dng. Spice-MLP c giao din vi
ting Vit, ting Anh v ting Nht.

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 1

Ty thuc vo phin bn Spice-MLP m bn ang s dng, mt
s hng dn hoc giao din minh ha trong ti liu ny c th
khc vi thc t.

Spice-MLP c vit bi CAO THANG khi tc gi lm vic ti Soft Intelligence Laboratory,

Ritsumeikan University, Japan, 2003-2007 v thng xuyn c cp nht theo yu cu ca
ngi s dng
SpiceSOM v Spice-MLP c th download c ti:
http://www.spice.ci.ritsumei.ac.jp/~thangc/programs/
hiu hn v mng n ron vi cc ng dng nh nhn dng khun mt, ngi i b, d bo
chng khon..., cc bn nn c thm ti liu Mt s v d phn loi dng SOM v MLP
Neural Network (neural_network_practical_use.pdf).
Tc gi hi nh thng c truyn c tch, bn c th enjoy truyn c tch cng tm s ca tc
gi ti http://www.spice.ci.ritsumei.ac.jp/~thangc/vuoncotich/index.htm
Nu c thc mc hoc cn yu cu thm v chc nng ca Spice-MLP, bn c th lin h vi tc
gi ti thangc@spice.ci.ritsumei.ac.jp hoc thawngc AT gmail DOT com. Cm n cc bn.

2. CI T SPICE-MLP
Download file ci t ca Spice-MLP v chy setup.exe, trn mn hnh hin ra:

Hnh 1. Ci t

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 2

Chn Next, sau chn th mc m bn mun ci t Spice-MLP vo, chn Next v Next tip.
Spice-MLP s c ci vo th mc m bn chn.

Hnh 2. Chn Folder ci vo

Lu :
Nu sau khi ci t, chng trnh khng chy, c th bn cn ci Microsoft .NET
Framework Redistributable Package 3.5.21022 trc khi ci Spice-MLP.

Nu d liu ca bn dng di dng MDB format, c th bn cn ci thm Microsoft

Data Access Components.

3. S DNG SPICE-MLP

Chy Spice-MLP bng cch click vo biu tng Spice-MLP trn desktop hoc trong Start
Programs Cao Thangs Spice-MLP Spice-MLP.

Trn mn hnh hin ra giao din ting Anh, bn c th chn ngn ng ting Vit hoc ting Nht
bng cch chn Options Languages.

Hnh 3. Chn ngn ng

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 3

Trong cc giao din minh ha di y, ngn ng c s dng l ting Vit.
Menu V chng trnh. Hy c trc khi s dng l gii thiu vn tt v Spice-MLP v s
ng ca ngi s dng. Bn cn c k trc khi s dng Spice-MLP.

Hnh 4. V chng trnh

3.1. Chun b d liu

Spice-MLP c c d liu ca bn, bn cn chun b d liu ca mnh theo chun sau.

3.1.1. D liu dng file text

D liu dng file text cn c chun b thnh cc hng v ct. u tin l ID, sau l u vo
v tip theo l u ra. Cc gi tr c phn cch bng du phy vi file CSV (Comma
Separated Value File Format) hoc du Tab vi file TXT (Tab Separated Value File Format).
Bn c th dng MS Excel bin son d liu, sau lu vo file file text hoc file csv. V d
d liu vi 2 u vo v 3 u ra c t chc nh bng 1.

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 4

 Bng 1. D liu text vi 2 u vo v 3 u ra

ID X0 X1 Y0 Y1 Y2 LABEL
0 0 0 0 0 0 Data 1
1 0 1 1 0 1 Data 2
2 1 0 1 0 1 Data 3
3 1 1 0 1 1 Data 4

LABEL: Nhn ca
X: u vo Y: u ra
ID: th t tng DataSet
(Input Data) (Output Data)
DataSet

3.1.2. D liu dng file MDB

D liu vo (Input data) c cha trong bng c tn "Inputs. D liu ra (Output data) c
cha trong bng c tn "Outputs" . V d d liu vi 2 u vo v 3 u ra c t chc nh
sau:
Inputs
ID X0 X1 LABEL

0 0 0 X0

1 0 1 X1

2 1 0 X2

3 1 1 X3

Outputs
ID Y0 Y1 Y2

0 0 0 0

1 1 0 1

2 1 0 1

3 0 1 1

Lu :
D liu phi l dng s (ngoi tr nhn (label) v cc k hiu u vo, u ra).
Nu c d liu trng hoc null, Spice-MLP s khng c c. Trong d liu kim tra, nu
khng c gi tr u ra, cc bn cn t gi tr ra l 0 hoc 1, hoc mt gi tr s no .

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 5

Mt s v d v d liu c t trong th mc \Data ca Spice-MLP:

Boolean functions.csv l v d vi 4 datasets, 2 inputs v 3 outputs. u vo l cc gi

tr nh phn 0 v 1, u ra l gi tr ca cc hm XOR (Y0), AND (Y1) v OR(Y2) .

Herbal data.csv l v d vi 640 datasets, 16 inputs v 33 outputs. u vo l mc

triu chng c gi tr t 0 ti 1, u ra l h s cc v thuc c chun ha trong [0,
1].

sincos.csv l v d vi 100 datasets, 1 inputs v 2 outputs. u vo l i s c gi tr

t 0 ti 2, c chun ha trong [0,1] v u ra l gi tr hai hm Sin v Cos ca i s
u vo .

iris_for_mlp_4inputs_1output.csv, iris_for_mlp_4inputs_3outputs.csv l d liu ca

ba loi hoa (Iris setosa, Iris virginica v Iris versicolor), mi loi 50 mu. Cc thuc tnh
l di v rng ca i hoa (sepal) v cnh hoa (petal) tnh theo centimeters. Chi tit ti
http://archive.ics.uci.edu/ml/datasets/Iris. iris_for_mlp_4inputs_1output.csv l d liu
4 u vo 1 u ra, iris_for_mlp_4inputs_3outputs.csv l d liu 3 u vo 1 u ra.

3.2. Load d liu

Gi s chng ta dng d liu l file sincos.txt l v d vi 100 datasets, 1 u vo v 2 u ra
ni trn. Trong mc S Neuron v D liu Ta chn nh hnh 5:

Hnh 5. Chn tham s load d liu

Chn nt Ti t file text, d liu s c ti vo b nh. Trong mc XEM D LIU bn

phi, bn c th xem li tng dataset ca d liu m bn va load:

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 6

 u ra ca mng

(dng bng)

u ra ca d liu
hc (dng bng)

u vo

(dng bng)

u ra (dng th)
u ra ca d liu hc v u ra ca mng
u vo c biu th bng hai mu khc nhau
Thanh chn
d liu

Hnh 6. Xem d liu

3.3. Chun ha d liu

Nu d liu ca bn cha c chun ha, bn c th dng chc nng chun ha d liu nh
hnh 7 sau. Bn c th chun ha d liu u vo hoc u ra, hoc c hai:

Hm chun ha
La chn chun ha d
liu vo hoc d liu ra

Hnh 7. Chun ha d liu

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 7

3.4. o to mng.

3.4.1. Chia d liu

Nu bn mun chia d liu lm hai phn, mt phn hc v mt phn kim tra, bn dng
chc nng Chia d liu. Sau bn cn chn phn d liu no hc. V d sau minh ha
vic chia d liu ngu nhin thnh hai phn 70% v 30%, dng 70% hc v 30% kim tra.

Hnh 8. Chia d liu

3.4.2. Chn d liu hc v cc tham s

Tip theo, bn cn chn s nron cho lp n (hidden layer), s ln lp, thi gian hc v MSE
(Mean of Square Error) yu cu. Bn cng c th la chn hc thch nghi (t l hc bin i da
vo MSE hc.

Hm bin i: bn cn chn hm bin i (Activated Functions) cho lp n v lp ra. Spice-

MLP cung cp cho bn nhiu la chn. Nu l ngi mi bt u nghin cu v NN, bn nn
chn cc hm Sigmoid, HyperTanh, Tanh, ArcTan, ArcSinh.
Th t u vo trong khi hc: bn c9.th
Hnh chn
Chn d vo ngu
liu hc nhin
v cc hoc
tham s vo tun t.

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 8

 Hnh 10. Chn hm bin i (Activated Functions) cho lp n v lp ra

Hin ti Spice-MLP dng 27 hm bin i. Cng thc v th ca mt s hm i c minh

ha bng 2 sau.

Sigmoid HyperTanh

Tanh ArcTan

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 9

 ArcSinh Sin

Linear Cos

Exp(-x) Exp(-x*x)

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 10

 x*x*x InvertAbs

3.4.3. o to mng (training)

Sau khi chn s nron cho lp n, chn t l d liu hc v cc thng s cn thit, bn c th bt
u o to mng. Sau y l cc nt lnh chnh o to.

Khi to trng s ban u: khi to (Reset) li trng s ban u cho cc nt mng.

o to: o to mng.

Load trng s mng t File nh phn: ti trng s mng t file nh phn c sn. Lu ,
nu thng s mng t file nh phn c sn khc vi thng s mng hin ti ca bn, c
th chng trnh s bo li hoc a ra kt qu sai.

Lu trng s mng vo File nh phn: lu trng s mng hin thi vo file nh phn, mi
gi tr s c ghi vi di 4 bytes. Th t nh sau:
Weight_IJ: I0J0, I0J1,

Weight_TetaJ: Teta_J0, Teta_J1,

Weight_JK: J0K0, J0K1,

Weight_TetaK:Teta_K0, Teta_K1,

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 11

 Lu trng s mng vo File text: lu trng s mng hin thi vo file text ngi s
dng c th kim tra gi tr ca tng nt mng.
V d trng s ca mng vi 2 inputs, 2 hiddens v 3 outputs c lu trong file text nh bng
3.
Bng 3. Ni dung file text cha trng s ca mng vi 2 inputs, 2 hiddens v 3 outputs

Weights of the NN. Activated Function was Hyperbolic Tangent

Saved on 2/4/2008 2:06:11 PM

Weight_IJ: array contain the weights in the first connections between input and hidden layers

J0 J1

I0 2.26013784930634000000 3.92545735150867000000

I1 2.26013782334056000000 3.92545726757851000000

Weight_TetaJ: array contain the weights from Bias of neurons in hidden layers

Teta_J0 2.75109071396534000000

Teta_J1 0.85361332621648900000

Weight_JK: array contain the weights in the second connections between hidden and output layers

K0 K1 K2

J0 -2.41085860219597000000 2.00917738577701000000 -0.40168121642706000000

J1 2.40321691280414000000 -1.07731644733275000000 1.32590046568425000000

Weight_TetaK: array contain the weights from Bias of neurons in Output layers

Teta_K0 1.85485947371567000000

Teta_K1 -1.98609819228695000000

Teta_K2 -0.13123871869928800000

Sau khi o to mng xong, thng tin v ln hc cui cng ca mng c hin th box bn
phi pha di.

Hnh 11. Thng tin ln hc cui

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 12

3.4.4. a. Kim tra th li
Sau khi o to mng, bn c th kim tra li trong qu trnh hc bng checkbox Xem chi tit
th li. Bn cng c th lu li d liu li vo file text vi nt lnh Lu d liu li. Bng 4
minh ha mt tp d liu li c lu trong file text.
Nu bn chn checkbox Xem chi tit th li trc khi o to mng, th li s hin ra
online ngay khi bn ang tin hnh o to, tuy nhin nu dng chc nng ny thi gian o to
s tng ln ng k do my tnh phi thm vic v th cng vi o to mng.
Khi xem th bng checkbox Xem chi tit th li, bn c th xem chi tit cho tng ln lp
bng cch kck chut vo th. Hnh 13 minh ha th li v th t l hc (learning rate)
trong khong ln lp th 50 v 150.

Hnh 12. th li xem bng checkbox Xem chi tit th li

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 13

 Hnh 13. Chi tit th li

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 14

 Bng 4: d liu li c lu trong file text

SPICE-MLP by Cao Thang

Training Error

Thng tin ca ln hc cui cng (4/30/2009 10:57:49 PM)

Hm bin i cho lp n: Hyperbolic Tanh.

Hm bin i cho lp ra: Hyperbolic Tanh

T l hc cui cng: 0.007843

Gi tr MSE ca D liu hc: 0.00323196838546706

Gi tr MSE ca D liu kim tra: 0.00359799661294161

S lng d liu hc: 70, (70% of 100)

S ln lp: 5000

Iterations TrainingError TestingError LearningRate

1 1.006932778 0.999370971 0.00918

2 0.989821872 0.990941336 0.00918

3 0.976928521 0.986117834 0.00918

4 0.969271326 0.981868921 0.00918

5 0.963313559 0.977746958 0.00918

6 0.958254105 0.973941811 0.00918

7 0.953665223 0.971387056 0.00918

8 0.949320804 0.967659064 0.00918

9 0.945233933 0.964940659 0.00918

10 0.941177193 0.961143105 0.00918

11 0.936883505 0.956635027 0.00918

4995 0.003240048 0.003576933 0.007842627

4996 0.003238211 0.003618928 0.007842627

4997 0.003234612 0.003602332 0.007842627

4998 0.003227556 0.003564963 0.007842627

4999 0.003221500 0.003589969 0.007842627

5000 0.003231968 0.003597997 0.007842627

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 15

3.4.4. b. Kim tra th trng s v u vo trung bnh ca mt n ron
Spice-MLP cho php bn kim tra s bin i ca mt vi trng s v u vo trung bnh ca
mt s n ron trong qu trnh hc. Bn tri hnh 14 minh ha s la chn xem trng s n ron 0
ca lp vo ti n ron 2 ca lp n WIJ[0][2], v trng s t n ron 3 ca lp n ti n ron 1 ca
lp ra WJK[3][1]. Bn phi hnh 14 minh ha s la chn xem u vo trung bnh ca n ron n
s 2 v n ron ra s 1.
Nu bn chn checkbox Xem th trc khi o to mng, th trng s v u vo s hin
ra online ngay khi bn ang tin hnh o to, tuy nhin cng nh chn checkbox Xem chi tit
th li, nu dng chc nng ny thi gian o to s tng ln ng k do my tnh phi thm
vic v th cng vi o to mng.

Hnh 14. Chn trng s v gi tr trung bnh ca mt s n ron trong khi hc

Hnh 15. th li, th trng s v gi tr trung bnh u vo ca mt s n ron trong khi hc

Hnh 15 minh ha th li, th ca hai trng s v gi tr trung bnh u vo ca hai n ron

( chn nh trn hnh 14) trong khi hc. Bn d dng nhn thy khi mng hi t (khi training
error gim gn ti 0) th trng s v u vo trung bnh ca cc n ron chn cng hi t v
mt gi tr nht nh.

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 16

3.4.5. Xem th d liu v th u ra ca mng
Trong phn Load d liu trnh by trn, bn c th xem li tng dataset ca d liu m
bn va load cng nh gi tr ra ca mng. Trong Tab Xem d liu bn c th xem th ca
ton b d liu nu s lng u vo v u ra khng ln.
Bn c th xem ton b d liu, ch xem d liu hc hoc ch xem d liu kim tra. Cc hnh sau
minh ha ton b d liu u vo, u ra ca hm Sin v Cos trong khong [0, 2], u ra ca
mng cha c hc v u ra ca mng c hc. Cc bn d dng nhn thy khi cha c
hc, u ra ca mng l xp x 0.5 cho c hai u ra. Tuy nhin sau khi hc vi 70% d liu, u
ra thc t ca mng u xp x u ra ca d liu hc, ngha l u c dng hai hm Sin v Cos.

Hnh 16. Ton b d liu u vo, u ra v u ra ca mng ban u (cha c hc)

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 17

 u ra thc t ca mng hc gn ging vi
u ra ca d liu hc

Hnh 17. Ton b d liu u vo, u ra v u ra ca mng c hc

Hnh 18. Ch xem d liu hc

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 18

 Hnh 19. Ch xem d liu kim tra

3.4.6. Nhm d liu da trn u ra ca mng

Bn c th nhm d liu kim tra li d liu ca mnh. Spice-MLP cho php bn nhm d
liu thnh 3 nhm da trn mt u ra (do bn chn).

Nhm u ra thnh 3 nhm d liu da

trn mt u ra

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 19

3.4.7. Lu d liu c m hnh ha bi mng NN
Sau khi o to mng, bn c th lu d liu c m hnh ha bi NN. Bn c th lu d
liu vi u ra ca mng, hoc lu cng vi u ra yu cu nh c minh ha bi hnh 21 sau.

Hnh 21. Lu d liu c m hnh ha bi mng NN

4. Kt lun
Ti liu ny hng dn bn s dng phn mm mng n ron Spice-MLP. Sau khi vn dng, cc
bn c th hiu r hn v hot ng ca mng n ron a lp (Multi-Layer Neural Network).
Cng nh Spice-SOM (phn mm mng n ron t t chc), Bn c th dng Spice-MLP m
hnh ha nhiu loi d liu khc nhau v c th p dng trong cc bi ton thc t nh nhn
dng, nhm, clustering, h tr quyt nh . Tc gi hy vng Spice-MLP gip ch trong vic
nghin cu v hc tp ca cc bn.
Sau khi c ti liu ny, cc bn c th tm c ti liu neural_network_practical_use.pdf
(download ti cng a ch http://www.spice.ci.ritsumei.ac.jp/~thangc/programs/), trong c
minh ha phn loi nh khun mt, nh ngi i b, nh xe hi, d bo chng khon v mt s
v d khc.
Xin cm n cc bn c ti liu ny v s dng Spice-MLP. Nu cc bn cn thm cc chc
nng ca Spice-MLP, xin hy lin lc vi tc gi ti thangc@spice.ci.ritsumei.ac.jp hoc
thawngc AT gmail DOT com Tc gi rt mong cc kin ng gp ca cc bn.

Hng dn s dng phn mm Neural Network Spice-MLP 2011-01-20 Trang 20