Professional Documents
Culture Documents
Bi ging iu Khin M
GS-TS Nguyn Trng Thun
C9- phng 104- B/m TH
-------------------Bi 1 : Tp M ( 10 h)
&1- Khi nim chung .
1- Logic r v s xut hin Logic m .
2- Lch s pht trin v kh nng ng dng .
&2- Mt s vn c s ton hc ca tp m .
1- Khi nim v tp r .
Tp A , B , C , ..... ; Tp c s E , A E ,
V d E:= {190 , 200 , 210 , 220 , 230 , 240 , 250 }
A:= {210, 220, 230 } ;
B:= { 200 , 210 , 220 , 240 , 250 };
Hm ch th IA(x) = {1 khi x E
0 khi x E
(1)
(2)
(3)
(4)
Nh vy c th vit :
A: = {190/0, 200/0, 210/1 , 220/1 ,230/1, 240/0, 250/0 } ;
B:= { 190/0, 200/1 , 210/1 , 220/1 , 230/0, 240/1 , 250/1 };
(5)
(6)
2- nh ngha
A:= {x/IA(x)} vi mi x thuc E , IA(x) ch ly gi tr 0 hoc 1; (7)
3- Php ton : Giao , Hp , B cho tp r .
+ Hp : A(x)VB(x) = C(x) th : IAvB = Ic vi x hoc thuc A hoc
thuc B (vi mi x thuc E)
Ic = Max (IA,IB) vi mi x E .
+ Giao : A(x) B(x) = C(x) th : IA B = Ic vi x va thuc A va
thuc B (vi mi x thuc E)
Ic = Min (IA,IB) vi mi x E
+ B sung (B) : Gi /A l tp b sung ca A khi x thuc A th x
khng thuc /A v x khng thuc A th x thuc /A (vi mi x thuc E)
I/A = 1- IA vi mi x thuc E.
nh l De Morgan cho tp r .
&3- Tp con m .
1- t vn .
E:= {190 , 200 , 210 , 220 , 230 , 240 , 250 }
A: = {190/0, 200/0, 210/1 , 220/1 ,230/1,240/0 ,250/0} ;
(8)
(9)
(10)
- Tp m :
(11)
P = P1 P2 ,
Tp E l tp gm cc loi chim.
Vi P1 :A :={ B cu , s , Vng Anh , So su , Vt tri }
Vi P2 : B :={ B cu , s , Vng Anh , So su , chin chin ,Vt tri }
R P = P1 P2 ; C = A B
M P = P1 P2 ; Cm = Am Bm
Qua v d v : suy lun theo Logic r ta thy mnh P l ch ng cho chim
Vng Anh , nhng theo Logic m th mnh P cng th hin chim Vng anh l c u
th nht , nhng cng c kh nng cho cc loi chim khc . S i l nh vy!
&2- Mnh tng ng , mnh ko theo .
1- Khi nim .
Tng ng (Chp nhn)
Ko theo (Chp nhn)
P
q
p q
p
q
pq
Sai
Sai
ng
Sai
sai
ng
Sai
ng
Sai
Sai
ng ng
ng Sai
Sai
ng Sai
Sai
ng ng
ng
ng ng ng
Vi hai : Mnh p kt vi tp A , mnh q kt vi tp B v mnh kt vi
AB s tha mn lut tng ng p q vi thut ton Logic tng ng :
( AV B )(A V B)
Vi hai :Mnh p kt vi tp A , mnh q kt vi tp B v mnh kt vi A
B s tha mn lut ko theo p q vi thut ton Logic ko theo :
( A V B)
Khi Xem p l mnh iu kin , cn q l kt qu th p q tng ng vi
suy lun Nu ... Th
Nh vy trong k thut iu khin , Mnh p q vi p l iu kin v q l
kt qu s hon ton tng ng vi lut iu khin Nu .... Th
Nu x l A Th y l B . ( Nu x thuc A Th y thuc B )
2- V d : Xt 2 tp : A, B :
A = {x1,x2,x3,x4,x5,x6,x7} , B={y1,y2 ,y3 ,y4,y5,y6} ;(m - x v n- y)
Khi quan h gia hai tp A v B l quan h R theo lut R di y :
R
y1
y2
x1
0
1
x2
0
0
x3
1
0
x4
0
1
x5
0
0
x6
0
0
x7
0
0
Nu x = x1 thuc A
Nu x = x2
Nu x = x3
Nu x = x4
Nu x = x5
Nu x = x6
Nu x = x7
y3
0
0
0
0
1
0
1
Th
Th
Th
Th
Th
Th
Th
y4
y5
0
0
0
0
0
0
0
0
0
0
0
1
0
0
y = y2 thuc B
y = y6
y = y1
y = y2
y = y3
y = y5
y = y3
y6
0
1
0
0
0
0
0
y1
0.8
0.2
0.3
0.5
1
0.6
0.1
y2
1
0.9
0.8
0
0.2
0.8
1
y3
0.3
1
0.9
1
0.9
1
0
y4
1
0
1
1
0.6
1
0.9
y5
0.9
0.6
0.8
0.8
0
0.8
0.3
y6
0.9
1
0
0.9
0.5
1
1
Nhn quan h kiu nhn ma trn yj = x1i*Rm ij (bng php thay ly tch s bng
php ly MIN v tng bng php ly Max trn ) , ta thy :
Nu : A = {(x1/0.2), (x2/0.3), (x3/0.5),(x4/1),(x5/0),(x6/0),(x7/0.8)} ;
Th : B = {(y1/0.5), (y2/0.8), (y3/1),(y4/1),(y5/0.8),(y6/0.9)} ;
Ma trn trn cng ng cho trng hp r :
Nu A = {(x1/0), (x2/0), (x3/0),(x4/1),(x5/0),(x6/0),(x7/0)} ,
Th : B = {(y1/0), (y2/1), (y3/0),(y4/0),(y5/0),(y6/0)} = y2 ;
Nu A l x4 Th B l y2
x1,x2,x3,x4,x5,x6,x7
0 , 0 , 0 , 1, 0 , 0 , 0
y1, y2 , y3 , y4, y5 , y6
0 , 1, 0 , 0 , 0 , 0
R
x1
x2
x3
x4
x5
x6
x7
y1
0.8
0.2
0.3
0.5
1
0.6
0.1
y2
1
0.9
0.8
0
0.2
0.8
1
y3
0.3
1
0.9
1
0.9
1
0
y4
1
0
1
1
0.6
1
0.9
y5
0.9
0.6
0.8
0.8
0
0.8
0.3
y6
0.9
1
0
0.9
0.5
1
1
R rng khi x= x4 th y= y2
&3- Suy lun m v Lut hp thnh.
1- Khi nim c s .Suy lun m hay suy lun xp x (fuzzy reasoning or
approximate reasoning)l th tc suy lun suy ra kt qu t tp cc qui tc: Nu ---Th
theo mt hay nhiu iu kin .
2-Th tc suy lun m .
- Khi nim trc quan hnh hc y=f(x) v ym=f(xm) (V hnh !)
- By gi ta c cc tp Am := {x/Am(x)} , qui tc Rm v kt qu l
Bm := {x/Bm(y)} , nh vy :
Bm(y)} = Max[min {A(x),Rm(y/x)}] ;
Dng nh l B = A*R ;
- Th tc suy lun theo qui tc Nu--- Th :
Ly v d : Nu c chua th c chua chn
Gn A l tp c chua , cn B l tp c chua Chn th :
Mnh 1 (thc t) :
x l A
Mnh 2 (qui tc) :
Nu x l A th y l B
H qu :
y l B
Thc t th khai thc kha canh : Nu c chua t Th c chua t Chn , ngha l :
Mnh 1 ( thc t ) : x l A
Mnh 2 (qui tc) : Nu x l A Th y l B
H qu : y l B
3- Suy lun m vi lut hp thnh Max- Min .
Cho Am,Am v Bm cng thuc tp nn X v Y . Gi thit lut ko theo AmBm
c th hin nh mt quan h Rm trn XxY ,th t x l A vi lut x l A Th y l B th
s c y l B cho bi :
Bm(y)= Max[min {A(x),Rm(x,y)}] ;
- Trng hp mt qui tc mt iu kin : Nu x l A Th Y l B .
Mnh 1 (thc t) :
x l A
Mnh 2 (qui tc ko theo) : x l A Th y l B
H qu:
y l B
Bm(y) = Max[min {A(x),Rm(x,y)}]
= Max[{A(x) A(x)} B(y)]
= Max[min {A(x) A(x)}= H
Cho nn :
Bm(y) = {H B(y)}
(v hnh !)
B
Chm
Tng
x
y
Gi thit : A := (x1/a1 ; x2/a2 ; x3/a3 ; x4/a4 ; x5/a5 ) Th B := (y1/b1 ;y2/b2 ; y3/b3 ) .
Vi qua h A* R = B , theo lut hp thnh m Max Min , ta c :
R (x1 ,y1 ) = Min (A (x1),B (y1 )) = Min (a1 ,b1) ;
R (x1 ,y2) = Min (A (x1) B(y2 )) = Min (a1 ,b2) ;
R (x1 ,y3) = Min (A (x1) B(y3 )) = Min (a1 ,b3) ;
R (x2 ,y1) = Min (A (x2) B(y1)) = Min (a2 ,b1) ;
R (x2 ,y2) = Min (A (x2) B(y2 )) = Min (a2 ,b2) ;
R (x2 ,y3) = Min (A (x2) B(y3 )) = Min (a2 ,b3) ;
.
R (x5 ,y1) = Min (A (x5) B(y1 )) = Min (a5 ,b1) ;
R (x5 ,y2) = Min (A (x5) B(y2 )) = Min (a5 ,b2) ;
R (x5,y3) = Min (A (x5) B(y3)) = Min (a5 ,b3) ;
Hnh 11 .
Lm theo 3 bc :
- M ho u vo(fuzzify Hnh 12)
- p dng thao tc m ( Apply Fyzzy Operator) : Dng cc thao tc logic ( AND ,
OR) . Trong Toolbox th AND dng : Min, Prod , OR dng : Max , Probabilistic probor
(Probor(a,b) = a +b- ab) , v d ny Tin t dng 3 lut v dng OR
Hnh 12
Hnh 10
u im suy lun Sugeno :
- Rt hiu qu cho tnh ton
- Dng cho k thut iu khin tuyn tnh .
- Dng cho k thut iu khin ti u v thch nghi .
- Thch hp cho ton phn tch m bo s lin tc Mt u ra.
u im ca Mamdani :
-Trc gic c dng rng ri
- Ph hp suy ngh u vo con ngi (Human Input)
-----------------------------------------------------------------------------
Bi ging 3 : B iu khin m .
GS-TS Nguyn Trng Thun
&1- Khi nim v S khi chc nng b iu khin m .
c dng : - H iu khin phi tuyn ,
-H thiu thng tin : vo v ra .
- H khng c m hnh ton
S khi chc nng ca b KM :
&2- M ha (Fuzzifiers)
Bin i t khng gian r khng gian m : T gi tr r sang gi tr m
Vic m ha gp phn kh nhiu .
n gin cho tnh ton .
Thng con hn cc hm lin thuc m ha sau :
+ n tr (Singleton).A(x) = { 1 nu x= x
0 nu x x
+ M ha tuyn tnh : Hm lin thuc hnh tam gic hay hnh thang
A(x,a,b,c) = max(min[x-a/b-a ,c-x/c-b)],0) ;
A(x,a,b,c,d) = max(min[x-a/b-a ,1,d-x/d-c],0) ;
Hnh tam gic :
Hnh thang :
Hnh chung :
Hm sigmoid :
Hnh 1
Mt lot cc cp Vo/Ra c dng luyn mng nh vy v cch luyn ny
(cch hc ny ) gi l cch hc c gim st .
Cc mng Nron c luyn hon thnh cc chc nng phc tp trong cc lnh
vc khc nhau nh nhn dng mu , nhn dng , phn loi sn phm , x l ting ni ,
hnh nh v h iu khin .
Ngy nay mng nron ang c dng gii quyt nhiu bi ton kh m vi
my tnh truyn thng hay suy ngh ca con ngi khng gii quyt c.
Phng php luyn mng c gim st l phng php thng dng nht , nhng ngy
nay cng c cch luyn mng khng gim st hay phng php thit k trc tip
Mng khng gim st cng vn c dng nhn dng nhm d liu . Mt s mng
tuyn tnh v mng Hopfield l cc mng c thit k trc tip ( khng gim st) . Nh vy c
rt nhiu k thut thit k v luyn mng m ta c th la chn .
Mng nron xut hin khong 50 nm , nhng vic ng dng ch mi khong 15 nm .
Chng ny s a vo khi nim v s dng Toolbox nron , cui chng a ra mt
vi ng dng c th .
Hnh 2b
Hnh 2a
Lu :
-Hm Logsiga(n) =1/(1+e-an) =y1 ;khi ly o hm theo n ta c y1 =ay1(1-y1) ;
- Hm tansig : Hm ngng v hm Logsig c gi tr u ra t 0-1, cn hm
tansig c gi tr t -1 n +1 :
Tansiga(n) = (ean e-an)/(eau+e-an) = 2logsig2a(n) -1 = y2 ;
o hm ca hm tansiga(n) l y2 = a(1- y2) ;
Hm chuyn i f hay hm truyn t ( Transfer function ) thng dng 3 dng nh Hnh
2a,2b,2c . Hnh 2a l hm c gii hn cng (Hard limit Transfer function) , Hnh 2b l
hm truyn t tuyn tnh (Linear Transfer function) .
1.3- Nron vi vect u vo (nhiu u vo ,mt u ra) .
x2
d
n = w0x0 + w1x1+ w2x2
y= 1(n)
e= y-d
0
0
-0,2
0
0
1
1
0,3
1
0
0
1
0,5
1
0
1
1
1,0
1
0
Nhn bng ta thy : Nu dng Nron 3 u vo v 1 u ra vi tham s khi u
w0 =-0,2 ; w1 =0.7 ; w2 =0,5 , hm chuyn i l hm ngng 1(n) th hon ton m
phng chnh xc hm OR hai bin x1 ,x2 .
Nu cng nh trn nhng dng hm chuyn i l hm logsig ( kt qu nh bng
di) th sai lch e sau ln hc u tin cn rt ln , ta phi cho hc tip cc mu khc
hiu chnh cc trng s mi gim c e .
x1
x2
d
n = w0x0+ w1x1+ w2x2
y= logsig(n)
e= y-d
0
0
0
-0,2
0,450
0,450
0
1
1
0,3
0,574
-0,426
1
0
1
0,5
0,623
-0,377
1
1
1
1,0
0,731
-0,269
E = (1/2)(yi di)2
(5)
y1
y2
y3
yi
yp
W1
W2
X10 :1
X11 :0
X12 :0
X20 :1
X21 :0
X22 :1
X30 :1
X31 :1
x32 :0
X40 :1
X41 :1
X42 :1
d1 :0
d2 :1
d3 :1
d4 :1
(6)
Trong gradient ca sai s theo trng s ca cc cng thc (5),(6) tnh bng :
dE/dW= (yi-di) (dyi/dw)=(yi di)f[wjxij][d(wjxij)/dw]=(yi di)f[wjxij]xi ; (7)
Lu : Cng thc (7) dng o hm ca hm chuyn i , nn khng nn s
dng hm ngng dng 1(n) .
V d : Tnh ton cho vic hc hm OR vi hai u vo x1,x2 .
- Khi hc vi 1 mu (p=1) : x1 = x2 =1 v d=1.Cc trng s ban u chn :
[W](0) = [W0(0) W1(0) W2(0) ] =[-0,2 0,7 0,5] , hm chuyn i :Logsig(n) .
Khi : y(0) = f(n)=f(w0(0) x0+ w1(0) x1+ w2(0) x2) = f(1,0) = 0,731 ;
E(0) = (1/2)(y(0) d1)2 = (1/2)(0,731-1)2 = 0,0362 ;
Cc gi tr gradien tnh theo (7):
dE/dW0 |[w]=[w](0) = (y(0) di)f(w0(0) x0+ w1(0) x1+ w2(0) x2)x0 = (y(0)-d)y(0)(1-y(0))x0 =
=(0,731-1).0,731.(1-0,731).1= -0.0529 ;
dE/dW1 |[w]=[w](0) = (y(0) di)f(w0(0) x0+ w1(0) x1+ w2(0) x2)x1 = (y(0)-d)y(0)(1-y(0))x1 =
=(0,731-1).0,731.(1-0,731).1= -0.0529 ;
dE/dW2 |[w]=[w](0) = (y(0) di)f(w0(0) x0+ w1(0) x1+ w2(0) x2)x2 = (y(0)-d)y(0)(1-y(0))x2 =
=(0,731-1).0,731.(1-0,731).1= -0.0529 ;
Chn h s hc =1 , ta tnh c cc trng s lin kt mi :
W0(1) = W0(0) (dE/dW0)|[w] =[w](0) = -0,2 -(1.(-0,0529)) = -0,147 ;
(8)
(t) = 0,5
(t) =0,9
Cc gi tr u ra
Cc gi tr ch
y1 = 0,456
d1 = 0
y2 = 0,604
d2 = 1
y3 = 0,760
d3 = 1
y1 = 0,185
d1 = 0
y2 = 0,863
d2 = 1
y3 = 0,956
d3 = 1
y1 = 0,17
d1 = 0
y2 = 0,873
d2 = 1
y3 = 0,863
d3 = 1
Sai s
E = 0,211
E = 0,0275
E=0,0319
x1 x2
d
n = w0x0 + w1x1 + w2x2
y= logsig(n)
e=y-d
0
0
0
3,627
0,974
0,974
0
1
1
7,954
1,000
0
1
0
1
8,154
1,000
0
Ta thy mu 1 c kt qu hon ton sai , nh vy mng nhm ! Cn tng s mu hc !
--------------------------------------------------------
Bi II MNG N RON
&2.1- Khi nim .
+ Bi 1 ta kho st v m hnh 1 Nron nhn
to v hiu qu ng dng rt thp,thc t Nron
ch c hiu qu khi lin kt thnh mng , l
Mng Nron.(H thn kinh ngi c 1011 n ron v c th
n 1014 lin kt ) .
Hnh 6 .
Mng nhiu lp l cc mnh . Nu ch xt mng 2 lp vi lp u dng hm
sigmoid v lp hai dng hm tuyn tnh th c th luyn xp x bt k hm no .
Loi mng hai lp c dng cc nhiu trong thut ton Lan truyn ngc. ( Lu xem
u ra ca lp 3 l a3 vi k hiu l y )
Hm x l trc cc d liu vo v ra .
u vo ca mng c th c x l trc thun li hn cho tnh ton trong
mng ,3 hm sau s gp phn vo vic :
- u tin l dng bin i mapmimax bin i tt c gi tr u vo vo trong
khong [-1, 1] ,
- Hm removeconstantrows : B i cc gi tr u vo ging nhau ,
- Hm fixunknowns m ho li d liu cha bit thnh dng s cho mng d
x l , ngha l phn bit ra trc : d liu no bit , d liu no ch bit .
Vi d liu ra : x l d liu u ra nh cc vect mc tiu v bin i ngc li
cho tng t nh hm nguyn bn .
Hai hm mapmimax v removeconstantrows thng phi hp dng cho x l d
liu u ra .
3- Cu trc d liu (Data structures) .
y bn v cch to cu trc d liu vo nh th no c hiu qu lc m
hnh ho mng . Xt mng tnh ri s n mng ng .
Vect d liu vo c 2 dng chnh : Loi d liu cnh tranh (concurently , ngha
l loi d liu khng cng xut hin cng thi im ) , loi d liu ny ch xut hin
theo trnh t (sequentially ) thi gian . Vi loi d ny th th t tc ng l khng quan
trng , lc ny nu c cc mng chy song song th th c th t vect vo cho mi mng
ring bit . Loi d liu th hai l d liu kiu ni tip , lc ny th t tc ng ca cc
vect vo l quan trng .
Hnh 7
Gi thit ta m hnh ho mng c tp d liu vo l 4 mu (Q=4) v khng ph
thuc trnh t tc ng :
1
2
2
3
P1 = 2 , p2 = 1
, p3 = 3
, p4 = 1
( Ph vy l u vo p1 c 4 gi tr p 1 : 1 2 2 3 , cn p 2 = 2 1 3 1 ) hay cc
tn hiu vit dng vec t concurrent t vo mng l :
P =[ 1 2 2 3 ; 2 1 3 1] ;
Gi thit gi tr ra ca mng l T :
T = [-100 50 50 100 ] ;
y l mng truyn thng , dng lnh sau :
Net = newlin(p,T) ;
Gn trng ma trn trng s v bias l :
W =[ 1 2] v b =[0]
Lnh gn cc gi tr ny l :
Net.IW(1,1)= [1 2] ;
Net .b(1) = 0 ;
Ta m phng bng lnh : A = sim(net,p) th c :
A=
5
4 8 5
Kt qu cng nh trn nu ta dng 4 mng hot ng song song v mi mng
nhn mt vect vo v cho ra mt kt qu . Th t kt qu ra l khng quan trng v ch
tu thuc vo vic t vect vo .
3.2- M hnh ho vi u vo trnh t mng ng .
Khi mng c tr , th tc ng u vo i vi mng l c tr v ph thuc trnh t
V d xt mng n gin nh hnh di ( Hnh 8)
Hnh 8
Gi thit trnh t vo l :
P1 =[1] , p2 =[2] , p3= [3] , p4 = [4]
Biu din thnh mng :
T = (10 3 3 7] ;
Vy lnh to ra mng l :
Net = newlin(p,T,[0 1] ) ;
Net.biasConnect= 0 ;
Gn trng s :
W =[ 1 2] ,
Lc vit lnh : net.iw (1,1) =[1 2] ;
Nu thc hin lnh m hnh ho sau :
A = sim(net,p) th c
A=
[1] [4] [ 7]
[10]
Nh vy ta t vo mt mng cha trnh t cc tn hiu vo th mng sinh ra mt
mng ra theo trnh t . Trnh t mng vo l quan trng .
3.3- M hnh ho vi u vo concurrent mng ng .
Nu ta t vo mng mt tp vo concurrent (mc d gi tr nh tp trnh t ) th
kt qu u ra mng s khc .
Nu ta dng tp vo kiu concurrent :
P1 =[1] , p2 =[2] , p3= [3] , p4 = [4]
V c to bi m sau :
P = [ 1 2 3 4] ;
Khi m phng bi lnh :
A = sim(net,p) th c :
A=
1 2 3 4