Professional Documents
Culture Documents
I HC CNG NGH
-----o0o-----
BO CO
Mn: TR TU NHN TO NNG CAO
: NGUYN HU HUY
NGUYN XUN K
ON TH THY LINH
Lp
: K16T3
H ni, 4-2010
Mc lc
1. TNG QUAN V MNG NRON...............................................................4
1.1. Mng nron l g........................................................................................... 4
1.2. ng dng trong lnh vc g............................................................................4
2. CU TRC CA MT NRON..................................................................4
5. LEARNING RATE....................................................................................7
6. HM ACTIVE.........................................................................................7
6.1. M hnh hm : y = 1 / (1 + Exp(-x))..............................................................8
6.2. M hnh hm : y = x......................................................................................8
6.3. Hnh 7.3: M hnh hm y = Log(1 + |x|)........................................................8
6.4. Hnh 7. 4: M hnh hm y = sin(x).................................................................9
6.5. Hnh 7.5: M hnh hm y=Tan(x)..................................................................9
7. BN T CHC KOHONEN SOM (KOHONEN SELF -ORGANIZING MAPS). .9
8. HM NEIGHBORHOOD..........................................................................11
8.1. Tng quan................................................................................................... 11
8.2. Hnh minh ha............................................................................................. 11
9. LI TOPOLOGY..................................................................................12
2/19
3/19
Mng nron l g
Mng nron nhn to, Artificaial Neural Network (ANN) gi tt l mng nron
(neural network), l m hnh x l thng tin phng theo cch thc x l thng
tin ca cc h nron sinh hc. N c to nn t mt s lng ln cc phn t
(gi l phn t x l hay nron) kt ni vi nhau thng qua cc lin kt (gi l
trng s lin kt) lm vic nh mt th thng nht gii quyt mt vn c
th no .
1.2.
2. Cu trc ca mt nron
Cu trc tng qut
4/19
3.1.
5/19
3.2.
6/19
5. Learning Rate
Learning rate l mt trong nhng thng s m iu chnh vic lm th no
mt mng noron hc nhanh v lm th no vic hun luyn hiu qu.
Hy xem xt mt nron m ang tri qua qu trnh hc tp. Gi nh rng trng
s ca mt s lin kt trong mng mt phn c o to l 0,3. Khi mng c
gii thiu mt mu hun luyn mi, thut ton hun luyn yu cu cc lin kt
thay i trng s ca n n 0,7 n c th hc cc mu mi ph hp. Nu
chng ta cp nht trng s ngay lp tc, cc mng nron chc chn s hc cc
mu mi, nhng n c xu hng qun i tt c cc mu n hc trc .
iu ny l do trng s hin ti (0,3) l kt qu ca tt c vic hc m n tri
qua cho n nay.
V vy, chng ta khng trc tip thay i trng s ti 0,7. Thay vo , chng ta
tng n bi mt phn nh (chn 25%) ca s thay i cn thit. V vy, trng s
lin kt ca c thay i thnh 0,4 v chng ta chuyn sang mu o to tip
theo. Yu t ny (0,25 trong trng hp ny) c gi l Learning Rate. Cn c
theo cch ny, tt c cc mu hun luyn c hun luyn trong mt s th t
ngu nhin. Khi chu trnh o to lp i lp li nhiu ln, cui cng mng nron
hc tt c cc mu c hiu qu.
Learning rate l mt gi tr trong khong t 0 n 1. Chn mt gi tr rt gn
bng khng, i hi mt s lng ln cc chu trnh hun luyn. iu ny lm
cho qu trnh hun luyn rt chm. Mt khc, nu learning rate rt ln, trng s
khc nhau v lch hm mc tiu dao ng ln v mng t n mt trng
thi m vic hun luyn din ra v ch.
6. Hm Active
Hm active trong mng c xc nh l cch c c u ra ca neuron t
mt tp u vo da trn thut ton bakcpropagation.
Cc thut ton bakcpropagation yu cu mt hm active tha mn tnh lin
tc v kh vi. N yu cu cn c hm active d dng tnh ton.
Mt s hm active nh Sigmoid, Linear, Logarit, Tan, Sin
7/19
6.1.
M hnh hm : y = 1 / (1 + Exp(-x))
6.2.
M hnh hm : y = x
Hnh 7. 2: M hnh hm : y = x
6.3.
8/19
6.4.
6.5.
9/19
10/19
8. Hm Neighborhood
8.1.
Tng quan
Trong mt bn t t chc, hm neighborhood xc nh cc thng s ca mt
t bo nrol t t bo nrol ti nrol chin thng trong cng mt lp.
Gi tr Neighnorhood neuron b quyt nh bi vector trng s ca n vi
nhng thay i nrol chin thng.
N thay i t s khng (cho mt neuron khong cch xa v hn t ngi
chin thng) cui cng ngi chin thng l chnh n.
8.2.
Hnh minh ha
Mt s hm Neighborhood nh Gaussian v Mexican-Hat nh hnh v sau:
11/19
9. Li Topology
Trong bn lp Kohonen Layer li topology quy nh c th s sp xp ca
nron li hai chiu to thnh lp. Hm Neighborhood c p dng trn
topology ny.
C 2 li Topology hay dng l hnh lc gic v hnh ch nht
10.
12/19
Hnh
11.
11.1.
13/19
11.2.
11.3.
S mu hun luyn
12.
12.1.
12.2.
Phm vi ng dng
14/19
13.
13.1.
Ngn ng lp trnh
13.2.
14.
NeuronNetwork Class
Nhng thng tin m t v cc class c m t ti mc ny. V d nh: layers,
connectors, networks and TrainingSet. Tt c cc class ny c tha k t
class 'ISerializable' interface
14.1.
Neuron.Core namespace
15/19
TrainingSet : L tp hp ca cc TrainingSample.
14.2.
NeuronNetwork.Core.Initializers namespace
14.3.
NeuronNetwork.Core.LearningRateFunctions namespace
14.4.
NeuronNetwork.Core.BackPropagation namespace
BackpropagationConnector :
mt
tp
cc
14.5.
NeuronNetwork.Core.SOM namespace
16/19
Kohonen Layers
INeighborhoodFunction :
Interface
biu
din
mt
neighborhood
function
14.6.
NeuronNetwork.Core.SOM.NeighborhoodFunctions
namespace
Namespace
ny
bao
gm
cc
class
sau
GaussianFunction v MexicanHatFunction
15.
Mt vi on code hu dng
15.1.
backpropagation network
on m bn di to ra mt backpropagation network c mt lp u vo
l LinearLayer cha mi nron, mt lp n sigmoid cha nm nron v mt
lp u ra sigmoid cha by nron.
17/19
15.2.
16.
18/19
16.1.
19/19