Hi ngh ton quc v iu khin v T ng ho - VCCA-2011

Thit k h thng nhn dng bin s xe ti ti cc cng t ng An Automatic Plate Recognition System Designed for Entry Gates
1

Trn Hoi Linh1, L Ng Mai1,2 Trng i hc Bch Khoa H Ni, 2Trng i hc Cng nghip Vit Tr e-mail: linh-3i@mail.hut.edu.vn

Tm tt
Trong bi bo ny, cc tc gi s xut mt gii php kh thi cho vic nhn dng t ng bin s cc xe (ti) ra vo cng nhm phc v cng tc qun l sn xut. Cc thut ton phn tch v x l nh s chp u xe vo/ra s cho php nhn dng c cc bin s ca xe lu thng vi chnh xc cao. Cc gii php ny c trin khai th im th nghim ti mt s a im trn a bn H Ni.

2. M hnh h thng thu thp, lu tr v x l nh

Abstract
In this paper, a design of an automatic plate recognition system for cars (trucks) will be presented. The system can be used at entry points at at industrial site. The algorithms for digital image analysis and recognition allow a high accuracy of plate number recognition of the trucks. The solution is already implemented and tested at some sites of Hanoi.
H. 1 M hnh h thng qun l v iu hnh vo ra s dng nhn dng hnh nh bin s

1. Phn m u
Cc h thng qun l xe lu thng ang c u t xy dng do c th a li hiu qu kinh t, x hi cao [1,3,5,9,12]. i vi cc c s cng nghip, vic qun l cht ch cc xe lu thng vo/ra c ngha rt quan trng ti cht lng sn xut. Trong iu kin cha ng b c h thng qun l bng cc thit b t nh danh t xa, vic qun l cc xe lu thng nh vo nhn dng bin s mt cch t ng t nh chp i tng l mt trong nhng phng php n gin v hiu qu kim sot xe lu thng. Kh khn ln ca gii php ny l cc thng s ca h nhn dng ph thuc rt ln v iu kin chp ca nh u vo. i vi tng nhm i tng ta cn phi iu chnh li cc m hnh cho ph hp. Hay ni cch khc ta khng th n gin ly mt h thng ang hot ng tt ti mt a im a sang a im khc s dng. Trong bi bo ny, cc tc gi s trnh by v mt h thng t ng chp nh cc i tng vo ra, tin hnh phn tch nh lc ra bin s v nhn dng cc k t trn bin s xc nh i tng vo/ra. Cc kt qu nhn dng s c s dng : thng k cc i tng vo/ra, h tr ngi iu hnh cho php cc i tng c vo/ra khu vc qun l. Ngoi ra cc hnh nh cn c lu tr di hn nhm mc ch thng k, qun l v iu hnh. Cc gii php k thut v thut ton c la chn v iu chnh cho cc iu kin lm vic thc t ti cc n v sn xut v ang ng dng h thng ny.

Trn hnh 1 l m hnh ca h thng c xut. Khu vc ra vo c hn ch bi 2 barrier t ng c iu khin t khi x l trung tm. Khi cc xe tin gn ti barrier, cc cm bin v tr v khong cch s tc ng to tn hiu ra lnh cho camera chp hnh i tng ang ti. H thng c trang b hai camera, mt cho cc i tng i vo v mt cho cc i tng i ra. Cc hnh nh chp t camera s c truyn v my tnh trung tm phn tch v x l. Ti y t cc hnh nh, phn mm nhn dng s tch ra bin s ca xe ang ti gn. Bin s ny s c tra cu vi mt c s d liu cho trc a ra c cc lnh iu khin ph hp cho cc h thng cng. ng thi thng tin (hnh nh minh chng, thi gian vo/ra,) s c lu tr trong c s d liu phc v cc cng tc thng k v truy nhp thng tin trong tng lai.

3. M hnh v gii php h thng phn tch v nhn dng nh s

3.1. Cc khi c bn trong qu trnh nhn dng nh s H thng phn tch v nhn dng nh c xy dng vi cc khi chc nng c bn nh trn hnh 2 [2,4]. Qu trnh x l nh c th c chia thnh 4 bc: 1. Thu thp, lu tr: Chp nh i tng bng camera, s ha nh v chuyn v lu tr h thng trung tm. 2. Tin x l nh: Hay cn gi l bc x l s b, nhm gim bt mt s thnh phn nhiu c bn, chun ha nh u vo cho ph hp vi cc khi tnh ton pha sau.

VCCA-2011

50

Hi ngh ton quc v iu khin v T ng ho - VCCA-2011

Lp t thun tin do theo chun Ethernet, c th d dng ghp ni nhiu camera trong h thng bng mt mng LAN, D dng truy nhp t xa theo chun Internet TCP/IP Cu hnh camera v cht lng nh c th la chn linh hot (t xa) ph hp vi thc t yu cu Trong h thng xut ca bi bo ny, cc tc gi s dng camera DS-2CD802PF ca hng HKVision vi phn gii 1M lm thit b thu thp (cc th nghim cho thy h thng hot ng tt ch vi nh 0,4M - 704 576 pixel ). Hnh nh c truyn qua mng LAN v my tnh trung tm. Vi nh 0,4M, kch thc 1 nh chp c xp x 80kB ( nn theo chun JPG).

H. 2

Cc bc chnh trong mt h thng nhn dng

Trch chn c tnh: y l nhim v phc tp nht v c ngha quyt nh nht ti cht lng ca ton h thng. Khi ny s tm ra cc thng tin c trng c th dng nhn dng i tng ( y l bin s xe v cc k t trn bin s ). Cc c trng ca mt bin s bao gm: cc ng vin quanh ca bin s, s lng vng lin thng mu trn bin s, ngng tch mu en v trng trn nh bin s, 4. Khi nhn dng: khi ny tip nhn u vo l vc t c tnh ca i tng, tin hnh tnh ton v so snh khp mu (c th coi l mt khi c hm truyn t phi tuyn) a ra quyt nh cui cng v i tng. Trong bi ton nhn dng bin s th u ra ca khi ny l cc chui k t m ca bin s (u ra nhn cc gi tr ri rc). Sau khi c kt qu nhn dng, h thng s c cc p ng theo cc kch bn nh trc v iu khin cc c cu chp hnh tng ng (v d nh khi bin s xe thuc v xe c php vo/ra th barier s c nng ln cng cc tn hiu thng bo khc nh n, ci tng ng). phn tip theo chng ta s tun t a ra cc gii php cho tng khi ca h thng. 3. 3.2. La chn cc gii php, thut ton cho cc khi chc nng ca h thng 1. i vi khi thu thp: C kh nhiu loi camera c th c s dng. Trc y cc h thng thng dng loi camera analog, tuy nhin cc camera ny c hn ch v dung lng lu tr do phi lin tc ghi hnh video nn thng ch hot ng c mt thi gian ngn (mt vi tun, mt vi thng) l y b nh, cn phi thay b nh mi hoc xa bt cc thng tin c ghi cc thng tin mi. Hin nay cc gii php IP camera ang ngy cng tr nn thng dng. Tuy gi thnh t hn so vi cc camera kinh in, nhng IP camera c kh nhiu u im ni bt nh:

H. 3

Camera HK-Vision (tri) vi cc u vo/ra (phi) s dng trong khi thu thp

Nu vi lu lng c tnh ti n v khong 500 lt xe/ngy, mi lt xe 2 nh (mt chp khi vo v mt chp khi ra) th dung lng b nh cn cho lu tr nh 1 ngy s l 80kB 500 xe 2 80MB . Dung lng cn cho 1 nm ghi s liu s xp x 30 GB . y l mt con s d dng p ng vi dung lng ca cc a cng hin nay. 2. Khi tin x l tn hiu: Khi ny c chia nh thnh 4 khu con nh trn hnh 4. Trong nh thu nhn c t camera s c ghi li di dng *.JPG tit kim dung lng lu tr. Trong trng hp h thng s dng nhiu camera khc loi, cc nh u c chun ha v kch thc chun ca camera DS2CD802PF l 704 576 pixel (hoc gn nht, ph hp vi t l nh ca camera). Tip theo sau , do v tr t camera khng c thng trc din vo i tng ang lu thng nn trn nh thu thp cc hnh nh xe s b nghing nh c minh ha trn hnh 5. ng thi, trong trng hp c hai camera gim st vo/ra, ta cng c th gp trng hp nh th hin trn hnh 5, l do thc t khu vc lm vic khng i xng nn ta thy nh xe i vo v nh xe i ra c nhiu c tnh khc nhau. V nh trn hnh 5 ta thy cc xe i vo c chp c nghing ln hn v phi chp v tr gn hn. Vic chp gn c u im l nh bin s to v nt, sng r. Tuy nhin nhc im ln l nu cc cm bin v tr v khong cch tc ng khng tt th t rt d vt qu th trng quan st ca camera, dn ti vic khng chp c vng c cha bin s trn u xe.

VCCA-2011

51

Hi ngh ton quc v iu khin v T ng ho - VCCA-2011

nh sng, cc xe i c nh sng ngc v nh ti hn. n bui chiu ta c hin tng ngc li. V cc hiu ng ny cn c quan tm khi lp trnh tnh ton. C nhiu phng php c lng vng cha bin s nhng s dng bin i Hough pht hin cc cnh ng thng, s dng ngng bin mu trng c trng ca bin s, phng php phn tch mt mu en/trng, Tuy nhin vi c th s dng cho xe ti l loi u xe ln, c nhiu ng thng trn u xe (nh hnh 5) th phng php Hough [3,5,6,8] tr nn khng hiu qu. Bn cnh , cc xe ny cng thng bi bn nn cc phng php tm kim mu trc tip cng dn ti nhiu sai s. Trong bi bo ny, phng php s dng cc cnh grandient tng phn trng/en c xut s dng. Theo , gradient theo trc x ca mt im nh trn ma trn nh xm (image in gray scale) A Ai , j c tnh bng:
grad x (i, j ) max Ai , j
1

H. 4

Cc khu chi tit trong khi Tin x l nh

Vi cc u xe nghing nh vy, trc tin ta cn phi quay nh a v nh thng nhm thun tin cho vic x l. Gc quay nh c th c xc nh t cc v tr lp t thc t ca camera v th trng quan st ca camera. Sau khi c xc nh bng thc nghim, gc quay ny s l c nh cho cc nh c x l sau ny. Trn hnh 6 l cc nh u xe t hnh 5 c quay thng.

Ai , j , Ai , j

Ai , j

(1)

Theo cng thc trn, vng c nhiu bin ng t im trng sang im en theo chiu ngang s c nhiu im c gi tr gradient ln. xc nh vng cha bin s, ta xy dng hm SumGrad ti mi im (i, j ) , SumGrad (i, j) l tng gradient ca cc im nm cch (i, j ) khng qu 10 pixel theo khong cch Minkowski bc 1.

SumGrad (i, j )
a i b j 10

grad x (a, b)

(2)

(a) H. 5

(b)

nh camera chp khi xe i vo (a) v khi i ra (b)

Vi nh trn hnh 4a v 5a, ta c hm SumGrad nh trn hnh 7b, vi nh trn hnh 4b v 5b ta c hm SumGrad nh trn hnh 7d. C th nhn thy trn hnh 7 l vng nh cha bin s c mc gradient cao nht (cc im trng). ng thi trn nh cng c mt s vng khc c mc gradient tng i cao nh vng logo v vng n pha ca xe. Trong mt s trng hp, s chnh lch nh ny s gy ra sai s l cc vng khc s c gradient cao hn so vi vng bin s v ta s c kt qu nhn dng sai. Cc vng c mc sng tng i gn nhau s c a vo danh sch ng c vin tip tc x l v tm kim bin s cc khu sau.

(a) H. 6 Kt qu xoay thng cc nh t hnh 5

(b)

Bc tip theo l xc nh s b (th) v tr ca bin s xe trn nh u xe. y l mt nhim v phc tp do v tr tng i ca bin s khng c nh i vi cc xe khc nhau, mu sc cc xe cng khc nhau. Nhiu trng hp ta cn c bin s b bn hoc bin dng. Mt vic cn ch l vi h thng c 2 camera nh trn th ch sng khi chp i vi mi camera l khc nhau. C th thy trn v d hnh 4 khi chp vo bui sng. Cc xe i vo c nh sng thun v

(a)

(b)

VCCA-2011

52

Hi ngh ton quc v iu khin v T ng ho - VCCA-2011

vo/ra. Vi h thng trin khai th bin s trn nh t camera u vo c kch thc khong 180 pixel 50 pixel , bin s trn nh t camera u ra c kch thc 140 pixel 40 pixel .Do vic nh gi ny mang tnh cht s b nn ta ct cc vng rng hn so vi kch thc bin s thc khong 20% trnh mt thng tin. Kt qu khoanh vng theo phng php trn c th hin trn hnh 9.

(c)

(a) (d) H. 7 Kt qu tm kim cc khu vc cha bin s ca nh gc (a) v (c) theo gi tr hm SumGrad tng ng (b) v (d) H. 9 Ct th cc bin s

(b)

3. Khi trch chn c tnh: Sau khi xc nh s b vng cha bin s ta kt thc khi tin x l nh v chuyn sang khi tnh ton trch chn c tnh. Ba khu c bn ca khi ny c th hin trn hnh 8.

trch cc k t ring bit ra khi bin s, trc tin ta tin hnh ct chnh xc bin s bng cch ct b cc vng khc mu bn ngoi bin s xe, sau vi vng bin s cn li ta tip tc loi b bt cc vng trng pha trn v pha di cc hng ch. Kt qu loi b ny ca cc bin s trn hnh 9 c th hin trn hnh 10.

(a)

(b) H. 10 Ct chnh xc bin s

H. 8

Cc bc chi tit trong khu trch chn c tnh

Trc tin ta s nh gi cc vng ng vin la chn mt vng duy nht cho qu trnh x l tip tc. Mt s cng trnh s dng gii php tm kim cc k t trn cc vng ny, vng no khng cha hnh k t hoc cha cc k t khng hp l s b loi b. Phng php ny c th c dng loi b cc vng cha n pha xe v trn nn thng cc thut ton tm k t khng tm thy k t no. Nhng phng php ny thng hot ng khng tt vi nhng vng logo hoc vng cha cc con s hoc ch qung co. ng thi vic tnh ton x l vi nhiu khi nh cng ko di thi gian x l chung ca c h thng cho 1 xe . Trong h thng ang xy dng, qua kho st cho thy s lng trng hp c nhiu vng gn trng nhau cng khng nhiu nn ta tm s dng php so snh gi tr cc i la chn vng bin s. Vi cc nh trn hnh 5 v 6, sau khi chn vng c gradient cc i, ta khoanh vng bin s theo kch thc bin s tnh theo pixel c xc nh t v tr t camera v v tr cc cm bin tc ng khi c xe

Sau khi loi b cc ng bin pha trn v di, ta c th chuyn t nh xm thnh nh entrng c th nh ngha cc vng ch ci l cc vng lin thng mu en c phn cch (tch bit) bi cc di trng xen gia (nhn theo hnh chiu dc) [1,6,7]. Thc hin vic ct cc k t ri khi nhau, ta c c kt qu ct ca hai bin s trn hnh 9 nh trn hnh 10.

(a)

(b) H. 11 Kt qu ct ri cc k t khi bin s hnh 9

VCCA-2011

53

Hi ngh ton quc v iu khin v T ng ho - VCCA-2011

Ta cng c th nhn thy do bin s trn hnh 9.b b ti nn khi chuyn sang nh en trng ct th cc ng bin ca cc k t khng c trn nh i vi bin s ca hnh 9.a. Sau khi ct ri cc k t, ta chuyn sang bc cui cng ca h thng nhn dng, l vic so snh vi cc mu k t cho trc nhn dng cc k t ct ra. so snh, ta s co/dn mu k t va ct ra v cng kch thc vi mu v s dng cng thc Hamming nh gi mc tng ng gia k t ang so snh A v mu B [10,11]: (xt rng) 34,01% 23,00% 21,18% 29,00% 25,38% 21,63% 20,18% 19,79% T bng trn ta thy, cc k t trn bin s t hnh 5a c nhiu thp nn c nhn dng chnh xc 100%, cc k t trn bin s t hnh 5b c nhiu cao hn nn khi khp mu ta cng c lch trung bnh cao hn so vi cc mu trn hnh 5a. Ring k t H b nhn dng nhm thnh k t 8 (vi lch 29%, trong khi nu so snh vi k t H chun th lch ca k t t bin s l 39,21%).

d A, B
i j

Ai , j XOR Bi , j

(3)

(ring k t 1 c pht hin bng chiu rng ca nh i tng do y l i tng duy nht c chiu rng nh hn cc k t cn li trong bin s). Khong cch Hamming bng s v tr m hai ma trn khc nhau v gi tr. Hai mu c coi l gn ging nhau khi khong cch Hamming gia chng nh (hai mu trng nhau c khong cch Hamming bng 0). T cng thc (3) ta cng c th a ra cng thc v sai lch phn trm gia hai mu nh nh cng thc sau:

d 2 A, B

d A, B 100% number of pixel in A and B

(4)

Mt s nh mu dng so snh trc tip c th hin trn hnh 12.

4. Kt qu thc nghim
Cc gii php c trnh by cc phn trn c lp trnh thc t v trin khai th nghim vi cc mu thu thp c hin trng. Trong thi gian th nghim, tng cng 146 mu xe c chp. Qu trnh phn tch v x l c 4 mu khng ct ng vng bin s nh (2 nh cng hng xe Hino b nhm thnh vng cha logo, mt xe b nhm vng n pha v mt xe b nhm vng tn nhit), c 24 mu khng nhn ng k t trn bin. Mt s trng hp bin s b tch nhm c gii thiu trn hnh 13 v hnh 14.

(a)

(b) H. 12 Mt s mu nh dng so snh trc tip (a) - cc mu ch s, (b) cc mu ch ci (Ch theo quy nh ta khng s dng cc ch ci O,I trnh nhm ln vi cc ch s 0 v 1)

Kt qu khp cc mu trn hnh 11.a vi cc mu chun ta c kt qu nh bng sau: Mu K t chun gn nht sai lch so vi k t chun 14,8% 26,54% 11,09% 14,22% 13,33%
(a) (b) (a) (b)

H. 13 Mu khng tch thnh cng bin s: (a) - mu tch nhm ra vng n pha ca xe (b)

VCCA-2011

54

Hi ngh ton quc v iu khin v T ng ho - VCCA-2011

H. 14 Mu khng tch thnh cng bin s: (a) mu tch nhm ra vng tn nhit ca xe (b)

Sai s ca nhn dng tng cng l 28 100% 19,18% . Nguyn nhn chnh ca sai s 146 tng i cao ny l phn ln cc trng hp cc bin s b bn hoc b bin dng, xc, mt mu. Mt s trng hp li do bin s c bt inh c vo gia k t v lm sai lch qu trnh nhn dng, hoc bt inh c dnh lin hai k t lin nhau khin cho qu trnh tch k t b sai. Ngoi ra, do vic so snh trc tip cn tng i n gin nn cc k t hay gy sai st l nhm (5,6,8,9,0). Thi gian x l trung bnh ca mt mu nh (t thu thp n lc, trch chn c tnh v nhn dng) khong 3s, hon ton p ng c thc t vn hnh ca cc barier t ng.

5. Kt lun v hng pht trin

Bi bo trnh by v mt h thng thu thp, phn tch v nhn dng bin s ca xe lu thng t nh chp u xe. H thng x l c mt s c th ca nh i tng trong thc t nh i tng b nghing trn nh, lc ct vng bin s trn u xe, tch cc k t khi vng bin s v nhn dng k t bng khp mu trc tip. Cc gii php c th nghim t chnh xc trn 80%. Phn trm sai s cn tng i ln (gn 20%) xut pht t thc t cc i tng l xe vn ti hot ng lin tc nn nhiu bin s b bn, xc, bin dng. ti c th tip tc c pht trin theo hng nng cao chnh xc trn tng khu, hoc tng tc x l ca h thng c th p dng c cho nhng trng hp xe lu thng lin tc. ng thi cng cn c pht trin cc thut ton nhn dng cc bin s c nh dng khc v kch thc v mu sc (v d nh xe bin xanh, bin , bin vung pha trc).

(Vehicle License Plate), Lecture Notes in Computer Science, 1997, vol. 1311, p. 552558. [7] H. Hontani, T. Koga, Character extraction method without prior knowledge on size and position information, Proc. IEEE Int. Conf. Vehicle Electronics, 2001, p. 6772. [8] D. S. Kim, S. I. Chien, Automatic car license plate extraction using modified generalized symmetry transform and image warping, Proc. IEEE Int. Symp. Industrial Electronics, vol. 3, 2001, p. 20222027. [9] K. Miyamoto, K. Nagano, M. Tamagawa, I. Fujita, M. Yamamoto, Vehicle license plate recognition by image analysis, in Proc. Int. Conf. Industrial Electronics, Control and Instrumentation, 1991, p. 17341738. [10] T. Naito, T. Tsukada, K. Yamada, K. Kozuka, S. Yamamoto, Robust license-plate recognition method for passing vehicles under outside environment, IEEE Trans. Veh. Technol., vol. 49, 2000, p. 23092319. [11] J. C. H. Poon, M. Ghadiali, G. M. T. Mao, L. M. Sheung, A robust vision systemfor vehicle license plate recognition using greyscalemorphology, Proc. IEEE Int. Symp. Industrial Electronics, vol. 1, 1995, p. 394399. [12] R. Valliappan, P. Sumari, H. Kamarulhaili, An Analysis of Traffic Monitoring by License Plate Recognition Method, Transactions On Engineering, Computing And Technology, ENFORMATICA, V3, 2004, p. 80-82.
Trn Hoi Linh sinh nm 1974, tt nghip HBK Vc-sa-va nm 1997 chuyn ngnh Tin hc ng dng, nhn bng Tin s chuyn ngnh K thut in nm 2000 (HBK Vc-sa-va), bng Tin s khoa hc chuyn ngnh K thut in v Tr tu nhn to nm 2005 (HBK Vcsa-va). Nm 2007 c phong Ph Gio s. Hin nay Trn Hoi Linh ang cng tc ti Vin in, trng HBK H Ni. Cc nghin cu chnh ca ng l ng dng tr tu nhn to trong cc gii php o lng, iu khin v t ng ha, cc thit b o thng minh, h chuyn gia. L Ng Mai sinh nm 1974, tt nghip i hc nm 1997 chuyn ngnh in kh ha - Cung cp in (H K thut Cng nghip - H Thi Nguyn), nhn bng Thc s chuyn ngnh T ng ha nm 2008 (H K thut Cng nghip - H Thi Nguyn). Hin nay L Ng Mai ang cng tc ti Khoa C - in, trng i hc Cng nghip Vit Tr v ang lm nghin cu sinh ti Vin in, Trng i hc Bch khoa H Ni.

Ti liu tham kho

[1] M. S. Aksoy, G. Cagil, A. K. Turker, Number plate recognition using inductive learning, Robotics and Autonomous Systems, Elsevier, Vol.33, 2000, p.149-153. K. R. Castleman, Digital Image Processing, Prentice-Hall, 1996, p. 550554. J. R. Cowell, Syntactic pattern recognizer for vehicle identification numbers, Image and Vision Comput., vol. 13, no. 1, 1995, p. 1319. R. C. Gonzalez, R. E. Woods, Digital Image Processing, Peasron Education Asia, 2nd Edition, 2002. H. A. Hegt, R. J. De la Haye, N. A. Khan, A high performance license plate recognition system, Proc. IEEE Int. Conf. System, Man, and Cybernetics, vol. 5, 1998, p. 43574362. X. F. Hermida, F. M. Rodriguez, J. L. F. Lijo, F. P. Sande, M. P. Iglesias, A system for the automatic and real time recognition of VLPs

[2] [3]

[4]

[5]

[6]

VCCA-2011

55