Hi ngh ton quc v iu khin v T ng ho - VCCA-2011

Tch hp tng tc ngi-my bng ting ni trong t ng ha Integration of human-machine interaction in automation control
Nguyn Vit Tng, Phm Th Ngc Yn Trung tm MICA, HUST - CNRS/UMI 2954 - Grenoble INP, Trng HBK H Ni email: {viet-tung.nguyen; ngoc-yen.pham}@mica.edu.vn Tm tt
Cng s pht trin ca khoa hc v cng ngh, vic iu khin cc thit b, dy chuyn cng ngh ngy cng i hi kht khe hn v cht lng, tin cy iu khin cng nh s thn thin trong tng tc. Trong cc phng thc giao tip, ting ni l mt knh tng tc truyn thng v quen thuc vi con ngi. Vic nng cao cht lng tng tc gia con ngi vi h thng thng qua cc knh tng tc mi trong c ting ni l mt hng nghin cu ng ch . Bi bo ny trnh by mt gii php xy dng h tng tc ngi - my c s dng ting ni song song vi cc h thng tng tc truyn thng hin c. hay can thip vo h thng ang vn hnh, c bit l cc h thng trong cng nghip. iu ny t ra bi ton lm cch no xy dng v trin khai cc gii php tng tc mi vo cc h thng hin c. Li gii cho bi ton ny cn m bo cc yu cu nh: Tnh m, tnh d sa i, d pht trin Tnh kh chuyn Tnh tin cy Gi nguyn kh nng can thip ca ch iu khin bng tay Tnh nht qun v thng nht gia iu khin bng tay v iu khin bng ting ni. Bi bo ny trnh by mt gii php cho bi ton trn.

Abstract
Beside the development of science and technology, the device and process control are more and more strictly required towards quality, control reliablity as well as usability in interaction. Among communication methods, voice interaction is a traditional one and familiar with human. The quality enhancement in interaction between user and system via novel channels, including voice, has been becoming an attractive research topic. In this paper, a solution is introduced for establishing a humanmachine interaction system by voice together with other existing interaction systems.

2. Gii php xy dng h tng tc ngi - my

Vi cc yu cu trn v cc yu cu chc nng c th ca bi ton tng tc ngi-my trong cng nghip, chng ti xy dng gii php kt hp cc k thut sau thit k v trin khai h tng tc ngi - my c b sung knh tng tc bng ting ni: 1. S dng m hnh MVC (Model-View-Controller) trong thit k h tng tc bng ting ni. 2. S dng c ch tn hiu-khe cm (signal-slot) kt ni gia cc m un. M un ngun pht tn hiu, m un ch nhn tn hiu v thc hin cc x l tng ng. Vic kt ni do h thng qun l, m un ngun v m un ch khng cn quan tm c th m un no pht tn hiu v m un no s x l tn hiu. 3. S dng lp trnh hng s kin khi lp trnh giao din. 2.1. M hnh MVC MVC [1,2,3,4] l mt mu kin trc phn mm trong cng ngh phn mm. N gip ngi pht trin phn mm c lp cc nguyn tc nghip v v giao din ngi dng mt cch r rng. y cc nguyn tc nghip v gm (i) cc mi quan h lin ng v (ii) cc nguyn tc vn hnh c th ca qu trnh cn gim st v iu khin. Phn mm pht trin theo MVC to nhiu thun li cho vic bo tr, pht trin chng trnh v cc nguyn tc nghip v v giao din c cch ly v pht trin tng i c lp vi nhau. Trong MVC (hnh 1), m hnh (model) tng trng cho d liu ca chng trnh phn mm. Khung nhn (view) gm cc thnh phn giao din vi ngi dng. B iu khin (controller) chu tc ng iu khin ca con ngi (di dng nt bm, hoc ting ni

Ch vit tt
MVC Model-View-Controller

1. Gii thiu
Ngy nay, cc h thng gim st iu khin thm nhp mi ni, t i sng sinh hot hng ngy n cng nghip, quc phng. Bn cnh cc i hi ngy cng cao v cht lng iu khin, tnh tin dng khi s dng cc thit b, dy chuyn cng ngh ang tr thnh yu t nh hng quyt nh n cht lng h thng. C nhiu cch nng cao tnh tin dng cho mt h thng gim st iu khin nh: tm hiu thi quen, s thch ngi dng hay nghin cu cc phng thc tng tc mi cng nh cc cch thc kt hp cc phng thc tng tc vi nhau. Tuy nhin, qu trnh xy dng, th nghim v trin khai cc phng thc tng tc mi trong thc t gp nhiu kh khn. Thng thng h thng c thit k sn v vn hnh trong thc t, ngi dng khng mun thay i

VCCA-2011

500

Hi ngh ton quc v iu khin v T ng ho - VCCA-2011

thng qua b nhn dng ting ni) qun l s trao i gia d liu v cc nguyn tc ngh nghip trong cc thao tc lin quan n m hnh. B iu khin phn ng vi cc s kin v tc ng n m hnh hoc khung nhn. Ngay khi b iu khin thay i m hnh d liu v/hoc cc thuc tnh ca m hnh, tt c cc khung nhn lin quan n m hnh s c cp nht.
S kin S kin chuyn n B iu khin

Trong trng hp s dng ting ni iu khin i tng mt b nghe s kin khc s c ci t song song vi b nghe s kin hin c. Hnh 3 trnh by mt trng hp m rng bi ton hin ti vi b nhn dng ting ni (b iu khin mi). M un nghe s kin ny nhn s kin t b nhn dng ting ni v iu khin m hnh thay i theo s kin nhn c (nh tng gim nhit iu ha).
Nhn dng ting ni tng/gim tng/gim

micr

B iu khin

B iu khin thay i M hnh hoc Khung nhn

Nghe s kin
ly d liu thay i m hnh cp nht khung nhn

Nghe s kin
thay i m hnh

Khung nhn

Khung nhn

Khung nhn ly d liu t M hnh

M hnh vn bn

H. 3
M hnh cp nht cc khung nhn khi d liu thay i

MVC ca mt i tng tng tc c m rng vi b iu khin nhn tn hiu t b nhn dng ting ni.

M hnh

H. 1

M hnh MVC tng qut.

Nh c s phn tch gia khung nhn, m hnh v iu khin m nhiu khung nhn v nhiu iu khin c th giao tip ng thi vi cng mt m hnh. T chng ta d dng thm, bt, thay i khung nhn v b iu chnh m khng cn thay i thit k ca m hnh. Do vy m vic thm b nhn dng v phn hi ting ni s d dng v chng c th vn hnh song song v c lp vi h thng hin ti ang dng ca ngi dng. Trong trng hp b sung h tng tc bng ting ni, bn cnh vic p ng cc s kin n t mi trng, bn phm-chut, b iu khin s nhn thm cc s kin n t b nhn dng ting ni. S kin l nguyn nhn gy ra cc thay i m hnh, khung nhn hoc c hai. Hnh 2 minh ha v ci t MVC ca mt i tng tng tc in hnh. y khi thay i gi tr d liu bng mi tn ln v xung s to cc s kin gi n b nghe s kin (b iu khin). Tng ng vi cc s kin nhn c b iu khin s tng hoc gim mt cch tng ng gi tr trong m hnh. Ngc li, nu v mt l do no , gi tr trong m hnh thay i, hm update view s t ng c gi m bo trng thi ca khung nhn c cp nht ng nht vi m hnh d liu m n phn nh.
tng/gim

Mi khi d liu c thay i, khung nhn s c cp nht. c th phn hi thng tin ny n ngi dng di dng ting ni, mt b tng hp ting ni gn vi loa c b sung vo h thng. B tng hp ting ni ny ng vai tr nh mt khung nhn mi ca d liu (hnh 4).
tng/gim

Nghe s kin
ly d liu cp nht khung nhn thay i m hnh

M hnh vn bn

Tng hp cp nht khung nhn ting ni

loa

H. 4

MVC ca mt i tng tng tc c m rng vi phn hi bng ting ni tng hp.

Nghe s kin
ly d liu cp nht khung nhn thay i m hnh

2.2. Tn hiu-khe cm Tn hiu - khe cm l c ch c s dng trong Qt [5], mt framework lp trnh giao din a nn. Tn hiu-khe cm c dng trin khai khun mu quan st (observer pattern) [6]. Hnh 5 minh ha vic dng tn hiu-khe cm truyn thng tin gia cc i tng trong chng trnh. N cho php nhiu tn hiu kt ni n cng mt khe cm, mt tn hiu n nhiu khe cm v ni tip nhiu tn hiu vi nhau. Khi tn hiu A ni tip vi tn hiu B, tn hiu B s t ng c gi khi A c gi.

M hnh vn bn

H. 2

Ci t MVC cho i tng tng tc in hnh.

VCCA-2011

501

Hi ngh ton quc v iu khin v T ng ho - VCCA-2011

2.3. Lp trnh hng s kin Lp trnh hng s kin l chin lc lp trnh trong dng chng trnh c xc nh bi s kin. Cc s kin c th l u ra ca cm bin, lnh iu khin ca ngi dng (bng thao tc nhn chut, n phm, bt cng tc, bng ting ni) hay cc thng ip gi n t cc chng trnh khc. Lp trnh hng s kin thch hp lp trnh giao din ngi dng ha cng nh lp trnh giao din ngi dng s dng ting ni. Khi kt qu ca b nhn dng ting ni c xem nh l cc s kin. 2.4. Qu trnh xy dng giao din ngi dng V c bn, giao din ngi dng trong qu trnh tng tc ngi-my bng ting ni c thit k theo cc nguyn tc trnh by phn trn. Trnh t vic xy dng giao din ngi dng c tin hnh nh sau: 1. Xc nh cc tn hiu tng tc c trong h thng v hng i ca cc tn hiu ny. Xem xt tnh ng b, xc nh ni xut pht v ch n ca chng. 2. Xc nh cc khe cm trn cc m un. Cc khe cm ny s tng ng vi cc yu cu chc nng ca tng m un. Vic xc nh cc khe cm bao gm tn khe cm, cc tham s cn truyn, v khe cm thuc m un no, i tng no. 3. Kt ni tn hiu vi khe cm: trn c s bi cnh tng tc, tin hnh kt ni tn hiu vi khe cm trong chng trnh. 4. Xy dng cc m un theo thit k c c.

H. 5

Truyn thng ip s dng tn hiu-khe cm.

Vi tn hiu-khe cm, cc iu khin c th gi cc tn hiu cha thng tin n cc iu khin khc thng qua khe cm (slot). Do vy ta c th thit k nhiu phm bm vt l v logic iu khin cng mt i tng, s dng nhiu cng ngh nh tip xc, ting ni, c ch, ) iu khin cng mt thit b. Hnh 6 trnh by bng cu hnh tn hiu khe cm trong Qt cho bi ton iu khin n. Trong v d ny tn hiu iu khin bt tt (on/off) ca cc cng tc iu khin n trong tng phng c ni ti slot bt tt (on/off) ca cng tc iu khin nm ti bng iu khin chung (hnh 6). Nh vy khi lp trnh ta ch cn tp trung ci t phng thc bt tt cho cng tc nm ti bng iu khin chung.

3. ng dng vo vic xy dng h tng tc ngi - my bng ting ni

Gii php xy dng h tng tc ngi - my bng ting ni c trnh by trn c p dng cho vic xy dng h tng tc ngi - my bng ting ni trong phng thng minh (hnh 7) vi nm thit b in dn dng gm ca ra vo, n, tivi, iu ha v camera an ninh.

H. 6

Truyn thng ip s dng tn hiu-khe cm.

Cc kt ni tn hiu-khe cm c th c ci t khi lp trnh hoc khi thc hin chng trnh. Vic ci t khi thc hin chng trnh cho php vic kt ni gia cc m un tng tc c kh nng thch nghi theo iu kin thc t khi thc hin chng trnh. V d khi c nhiu hn mt b iu khin iu khin iu ha, hoc khi mt b iu khin no b hng cn thay th bi mt b iu khin khc c chc nng tng ng. Tm li, c ch tn hiu-khe cm gip vic trin khai chng trnh giao din ngi dng tr nn d dng ng thi tng kh nng thch nghi theo bi cnh ca giao din.

H. 7

nh chp sn phm phng thng minh vi 5 thit b in dn dng (ca ra vo, camera an ninh, n, v tuyn, iu ha) c kh nng tng tc hai chiu vi ngi iu khin bng ting ni ting Vit [KC.03.15/06-10, 2009].

VCCA-2011

502

Hi ngh ton quc v iu khin v T ng ho - VCCA-2011

Cc m un ph trch tng tc bng ting ni v giao din c kt ni vi ngun thng tin cn hin th thng qua c ch tn hiu - khe cm gip d dng xy dng tng tc a phng thc vi ngi dng. Trong phm vi bi bo ny, phng thng minh c s dng nh mt ng dng trin khai tng tc ngi - my bng ting ni lm c s nh gi cht lng tng tc cng nh hiu qu gii php ca chng ti. 3.1. Trin khai h gim st iu khin Xut pht im h thng c thit k iu khin tp trung cc thit b trong phng bng bn phm /chut ti my tnh trung tm. Cc m un cm bin cng cc thit b dn dng c kt ni vi my tnh trung tm bng cc cng ngh truyn thng khc nhau nh PLC (truyn tn hiu trn ng dy ti in), mng ni b LAN, RS232, Wifi, USB. lm c iu , cc thit b dn dng c sn trn th trng c b sung cc b chuyn i (adapter) phn cng v phn mm kt ni c vi h thng (hnh 8). V d iu ha c ni vi mt b chuyn i c nhim v kt ni vi my tnh bng cp USB. b chuyn i ny chuyn lnh iu khin nhn c t my tnh sang dng lnh iu khin c m ha di dng tn hiu hng ngoi iu khin trc tip iu ha. ci t c lp v c vn hnh song song vi nhau. Vic truyn d liu gia m un giao din ngi dng vi m un tng tc vo/ra v vi h thng trung tm c thc hin theo c ch tn hiu-khe cm (signal-slot). c th nhn dng ting ni, h thng dng micr khng dy. Micr c ni vo h thng qua mt b thu nhn khng dy, s ha (b chuyn i phn cng) sau d liu c a n b thu thp, phn tch v nhn dng trong thi gian thc (b chuyn i phn mm). u ra ca m un tng hp ting ni l d liu m thanh. D liu ny c pht trc tip ra loa ni trc tip vi my tnh trung tm.

H. 9

Giao din chnh ca chng trnh iu khin.

Mi thit b trong chng trnh u h tr iu khin bng tay v bng ting ni. Khi mun iu khin bng bn phm - chut, ngi dng cn chn thit b ti giao din chnh (hnh 9). Mt hp thoi s m ra gip ngi dng truy cp c vo cc chc nng iu khin tng ng vi thit b . Hnh 10 trnh by ca s iu khin iu ha. Sau clc trc tip vo cc nt iu khin thit b trn ca s iu khin ring cho thit b c chn. Ring chc nng iu khin ca, s ch c kch hot khi ngi dng yu cu m ca bng ting ni v trnh th ra vo hp l.

H. 8

S kt ni ca khi tng tc ngi- my bng ting ni trong h thng gim st iu khin p dng cho phng thng minh trng hp iu khin iu ha.

H. 10 Giao din iu khin iu ha.

3.2. Trin khai h tng tc bng tay v bng ting ni H thng tng tc ngi - my bng ting ni c b sung bng m un tng hp ting ni v nhn dng ting ni. H thng tng tc ngi - my c in v h thng tng tc ngi - my bng ting ni c

Vic iu khin thit b bng ting ni din ra khi ngi dng ra lnh bng cu lnh iu khin. Hin nay, cu lnh iu khin c qui c gm tn thit b theo sau bi lnh iu khin. V d: iu ha bt, iu ha tt, iu ha tng nhit , iu ha 25 .

VCCA-2011

503

Hi ngh ton quc v iu khin v T ng ho - VCCA-2011

H thng nhn dng thc hin nhn dng cu lnh v gi tn hiu tng ng vi cu lnh cho h thng. Cc m un ng k nhn tn hiu ny (m un x l trung tm) s nhn tn hiu v c x l tng ng. ng thi h thng cng s tr v thng tin bng ting ni bo hiu h thng nhn v thc hin lnh nh: iu ha bt, iu ha tt, iu ha t x (vi x l gi tr t hin ti ca iu ha). Vic ng dng gii php c xut vo trin khai xy dng h thng tng tc ngi - my bng ting ni cho phng thng minh cho thy gii php c cc u im nh: Tng hiu qu ca vic tng tc. Kt qu ca mt hnh ng c tr v trn mt hoc nhiu hnh thc tng tc, v d tr v thng qua ting ni kt hp vi mn hnh v trng thi ca i tng c iu khin (v d trng thi sng/ti ca n). Trong trng hp tr v trn nhiu hnh thc tng tc khc nhau, cc hnh thc ny s ng vai tr d tr, b sung hoc thay th ln nhau. Mt m un con ch ph trch mt hnh thc tng tc. V d m un tng hp ting ni s ph trch tng hp v biu din thng tin di dng m thanh ngi dng c th nhn thc c. iu ny cho php chia nh bi ton, thun li trong qu trnh kim tra, nh gi tng m un v kim tra ghp ni gia cc m un vi nhau. iu khin bng ting ni, hoc gim st, iu khin thit b qun s.

Li cm n
Cng trnh trnh by trong bi bo nm trong khun kh ca ti NCKH trng im cp nh nc m s KC.03.15/06-10 mang tn Nghin cu thit k ch to cc thit b v h thng t ng ho thng minh s dng tng tc ngi-my bng ting ni trong iu khin. Nhm tc gi xin chn thnh cm n s h tr v ti chnh ca B Khoa hc v Cng ngh, v cc thnh vin trong ti gip trong qu trnh thc hin cng trnh.

Ti liu tham kho

[1] Burbeck, S. Applications Programming in Smalltalk-80(TM): How to use Model-ViewController (MVC), 1992 Trygve Reenskaug: Thing-Model-View-editor an Example from a planning system. Technical note, Xerox PARC, May 1979. Trygve Reenskaug: The Model-View-Controller (MVC) Its Past and Present. JavaZONE, Oslo, 2003. Trygve Reenskaug: Models-View-Controllers. Technical note, Xerox PARC, December 1979. Jasmin Blanchette, Mark Summerfield, C++ GUI Programming with Qt 4, Second Edition, 2008. Erich Gamma, Richard Helm, Ralph Johnson and John Vlissides Design Patterns Elements of Reusable Object-Oriented Software AddisonWesley, 1995

[2]

[3]

[4] [5]

4. Kt lun
Bi bo gii thiu mt cch tip cn trong vic xy dng v trin khai h thng tng tc ngi - my cho cc ng dng cng nghip ni chung v ng dng trong phng thng minh ni ring. Vic th nghim trin khai xy dng h tng tc ngi - my bng ting ni cho thy cch tip cn chng ti xut p ng c tt c cc yu cu t ra ban u. Cch tip cn ny c th s dng trin khai cc bi ton iu khin tp trung v phn tn vi cc im iu khin phn tn ti nhiu ni khc nhau, trn nhiu thit b khc nhau (my tnh, thit b di ng, in thoi di ng, ) v dng nhiu hnh thc tng tc khc nhau (bng phm bm vt l v logic, bng c ch, bng ging ni, ) Trong tng lai xa hn, cch tip cn ny c th c p dng trin khai xy dng cc ng dng th nghim cc hnh thc tng tc ngi - my hin i khc (nh tng tc bng c ch, tng tc bng cm xc, bng ting ni) trong cng nghip cng nh dn dng v n cho php d dng trin khai song song vi cc h thng iu khin sn c. Sn phm phng thng minh ca ti c th c ng dng cho cc phng bnh, phng cho ngi khim th, ngi tn tt khng th di chuyn hoc gp kh khn trong vic di chuyn. Sn phm ny cng c th c trin khai trong cc ta nh, cn h thng minh nhm nng cao tnh tin li trong vic giao tip vi ngi dng. Sn phm ny cng l bc m trin khai cc ng dng gim st trong cng nghip

[6]

Thng tin tc gi
TS. Nguyn Vit Tng tt nghip khoa in-in t trng i hc K thut Tp.HCM nm 2000, sau theo hc thc s ngnh Cc h thng o lng v iu khin ti i hc Bch Khoa H Ni, tt nghip nm 2002. Nhn bng Tin s ngnh Tn hiu, Hnh nh, Ting ni v Truyn thng (SIPT) ti Vin i hc Bch khoa Quc gia Grenoble (INPG) Cng ha Php nm 2008. Hin ti, TS. Nguyn Vit Tng l nghin cu vin / ging vin ti Vin nghin cu quc t MICA, trng i hc Bch Khoa H Ni trong lnh vc mi trng cm th v tng tc ngi - my. GS. TS. Phm Th Ngc Yn tt nghip ngnh K thut o lng ti trng i hc Bch Khoa H Ni nm 1982, sau theo hc thc s ngnh x l tn hiu - nh ting ni nm 1990, nhn bng tin s chuyn ngnh x l ting ni nm 1995 ti Vin Bch Khoa quc gia

VCCA-2011

504

Hi ngh ton quc v iu khin v T ng ho - VCCA-2011

Grenoble (INPG), Cng ha Php, c phong Gio s nm 2010. GS.TS. Phm Th Ngc Yn hin l trng B mn k thut o v tin hc cng nghip v gim c Vin nghin cu quc t MICA, trng i hc Bch Khoa H Ni.

VCCA-2011

505