Mc lc

I. GII THIU ................................................................................................................................... 4 1. in ton m my l g ? .......................................................................................................... 4 2. Qun l ti nguyn trn mi trng in ton m my ............................................................ 5 3. Cc thch thc ca qun l ti nguyn trn mi trng in ton m my.............................. 5 4. Bi ton 1: Cung cp ti nguyn tnh ton cho cc yu cu Batch-job v t ch ..................... 6 5. Bi ton 2: cung cp ti nguyn tnh ton trn h thng cloud vi tiu ch tit kim nng lng: .......................................................................................................................................... 7 II. TNH HNH NGHIN CU LIN QUAN ................................................................................... 9 1. So snh in ton m my v tnh ton li ............................................................................. 9 2. Cc phn mm xy dng h tng in ton m my (cloud computing) ................................ 12 III. KT LUN ................................................................................................................................... 14 IV. Ti liu tham kho ........................................................................................................................ 14

Cc thut ng hay dng

Tn thut ng bng ting Anh Cloud computing Infrastructure-as-a-Service (IaaS) ngha in ton m my H tng nh l dch v: l mi trng in ton m my cung cp cc dch v ca to, hy, thu bao, thc thi cc my o (Virtual Machine) cha ng dng ca ngi dng, ng thi trn IaaS cn c cc dch v lu tr, qun l, tnh ph, L mi trng in ton m my di dng engine (nh l Goolge AppEngine [1]) cho php chng ta pht trin ng dng chy trn h tng phn b tri rng trn nhiu b x l. Phn mm nh l dch v: l ng dng di dng dch v trn nn in ton m my IaaS cho nhiu ngi s dng thng qua Internet. My o

Platform-as-a-Service (PaaS)

Software-as-a-Service (SaaS)

Virtual Machine

Trang 2

DANH MC HNH Hnh 1 gii thut t cc my o tit kim nng lng [11] ................................................................. 8 Hnh 2 Gii thut lp lch my o da trn cng sut [13] ................................................................... 8 Hnh 3: So snh h thng in ton m my v h thng li v kch thc (scale) v tnh hng ng dng hay hng dch v .......................................................................................................... 9 Hnh 4: So snh kin trc ca Grid v Cloud ..................................................................................... 10

DANH MC BNG Bng 1 Cc tiu ch so snh Grids v Clouds ..................................................................................... 10

Trang 3

MT NGHIN CU V QUN L TI NGUYN TRONG MI TRNG IN TON M MY

Nguyn Quang Hng hungnq2@gmail.com

I.

GII THIU

1. in ton m my l g ?
Thut ng in ton m my (TM) vi tn Compute Cloud hay ph bin l Cloud computing l khi nim mi v c nhiu cch nh ngha. nh ngha v in ton m my (Cloud computing) s ty thuc vo cch chng ta khai thc, n c th c xem nh l mt dch v tin ch cn thit th nm (bn cnh bn dch v tin ch trong sinh hot l in, nc, in thoi, gas) . Cng ngh a nhn (multicore) v cng ngh o ha (virtualization) pht trin hnh thnh cch thc s dng mi cho php chy nhiu h iu hnh trn cng mt my vy l. ng thi kt hp vi s pht trin nhanh ca cc k thut phn mm trn nn tng Internet c bit l cc chun m v Web services (nh SOAP, RESTful, XML, WSDL). S hi t ny dn n khi nim mi trong nhnh tnh ton phn b l in ton m my. Do khi nim v in ton m my c hiu theo cc ngha khc nhau, chng ta c th hiu in ton m my l kh nng cung cp ti nguyn (tnh ton CPU, b nh vt l, khng gian lu tr, ..v..v) v phn mm (km theo bn quyn phn mm) theo nhu cu di dng tnh tin theo thi gian s dng (pay-as-you-go). Hin c ba nh ngha c chp nhn trong cng ng nghin cu v in ton m my, chng l cc nh ngha ca Rajkumar Buyya (2009) [1], Ian Foster, et.al. (2008 & 2010) [2] & [3]. Ngoi ra vn cn cc nh ngha khc v in ton m my [4]. Theo Ian Foster, et.al. (2008) [2]: cloud l dng Infrastructure-as-a-Service (IaaS) cloud, nh l Amazon EC2. , h tng IT c trin khai trong datacenter ca nh cung cp cloud di dng cc my o. Theo Rajkumar Buyya (2009) [1]: mt cloud l dng h thng song song v phn b bao gm tp cc my tnh c o ha v kt ni li vi nhau, chng (cc my tnh o ny) c cung cp ng v xut hin di dng cc Trang 4

ti nguyn tnh ton thng nht da trn tha thun mc dch v (service-level agreements) tha thun gia nh cung cp dch v v khch hng. Theo [3], b sung nh ngha [2] khi a thm yu t tnh kinh t (economies of scale) v ti nguyn gm power, storage, platform, v dch v c tru tng ha, o ha, co dn ng v qun l cung cp cho ngi dng qua Internet.

V phn loi, cc h thng cloud c th xp vo ba loi, theo [4]: Infrastructure-as-a-Service (IaaS): v d: h thng Amazon EC2 [5] v S3 [8] Platform-as-a-Service (PaaS): v d: Google AppEngine [7] Software-as-a-Service (SaaS): v d: Gmail, SalesForce, Data-as-a-Service (DaaS): v d: Strikeiron.com, Kognitio.com, thc ra cng c vi kin khc xp DaaS vo dng SaaS.

2. Qun l ti nguyn trn mi trng in ton m my

Qun l ti nguyn trn mi trng in ton m my (cloud computing) c chc nng cung cp cc ti nguyn tnh ton (nh CPU, b nh) hay ti nguyn lu tr (storage) theo yu cu ca ngi s dng. Cng ngh in ton m my c thc y bi m hnh kinh t - tnh tin ngi dung theo thi gian h dng: dng bao nhiu tr by nhiu (pay-as-you-go). V d: ngi dng c th thu 2 - 3 gi my chy mt ng dng tm thi trn Amazon EC2.

3. Cc thch thc ca qun l ti nguyn trn mi trng in ton m my

ng mi gc nhn khc nhau bi ton qun l ti nguyn cho Cloud t ra cc thch thc khc nhau: gc nhn nh cung cp h tng cloud (Infrastructure-as-a-Service): c hai vn m ti s trnh by c th bn di. gc nhn ca nh cung cp dch v (mt loi ng dng no ) cho ngi dng u cui: v d mt cng ty ABC cung cp dch v ti chnh trn mi trng Internet. Thch thc t ra vi h l h h thp nht chi ph thu bao ti nguyn ca nh cung cp h tng Cloud chy ng dng, nhng ng thi vn p ng cht lng dch v i vi ngi dng cui. gc nhn ngi dng: ngi dng mun thu ti nguyn p ng tiu ch rng buc v cht lng rng buc vi nh cung cp dch v hoc h tng cloud (th hin bng SLA Service Level Agreement). Trang 5

Trong bi vit ny, ti kho st hai bi ton (problem) c xc nh trong vic qun l ti nguyn cho mi trng in ton m my. Trong tng bi ton, ti kho st mt vi hng tip cn : Bi ton 1: thch thc trong vic cung cp (provision) ti nguyn cho c hai loi : cc yu cu cho cng vic best-effort (cc chng trnh m phng yu cu tnh ton hiu nng cao (HPC batch-job)) v cc yu cu t ch trn cng mt h thng. Bi ton 2: qun l ti nguyn hiu qu v nng lng in tiu th ca c Data center.

4. Bi ton 1: Cung cp ti nguyn tnh ton cho cc yu cu Batch-job v t ch

Trong vic cung cp ti nguyn (tnh ton), thng l nhu cu s dng trong thi gian ngn (vi gi). Chng ta xt vi trng hp s dng ti nguyn sau: mt nh khoa hc cn mt s lng ln cc my tnh chy mt chng trnh gi lp (m phng) trong vi gi, mt ging vin trng i hc cn mt cluster ca 10 nt dy thc hnh MPI, mt cng ty cn ni hosting website ca cng ty c th m rng (scale up/down) theo lu lng ngi dng).

Vn l cng mt tiu ch ti u khng th p dng cho c hai trng hp : batch-job ( chy ng dng m phng) v t ch (cho trng hp lp hc MPI). Cc hng tip cn: o Da trn my o (VM-based approaches) : Virtual Clusters (Nishimura et al, Yamasaki et al, Nimbus toolkit,). o Da trn l (Batch-jobs approaches) : PBS, SGE, Condor, o M hnh thu bao (Lease based approaches) : Borja Sotomayor (2010) [8] [9] So vi nhng m hnh khc th m hnh cung cp ti nguyn tnh ton s dng tru tng l my o v lease c nhiu u im hn cc tip cn khc v c khng nh [10] [8] [9]. M hnh thu bao ti nguyn (Lease-based Model) M hnh thu bao (Lease-based Model) trong mi trng o ha dng my o c xut bi Borja Sotomayor [9]. Trang 6

Lease: tng t khi nim lease c dng trong Computer Network. V d: trong Networking, lease c th l bandwidth trong mng; hay lease c th l ti nguyn phn cng th trong datacenter, C hai nhn t: nh cung cp (lessor resource provider v lessee - resource consumer). VM-based leases: nu quan tm n cc overheads n cc my o (v d: thi gian truyn nh my o n ni thc thi, thi gian khi ng my o c th ln n 10 pht/6 GB VM image/mng 100Mbps). Do yu cu t ra l lm th no m hnh ha chnh xc & lp lch chng hiu qu (efficiently). Do hai yu cu Best-effort (BE) v Advance Reservation (AR) i khi mu thun nhau. V d: nu chp nhn nhiu AR v iu kin th c th s lm cc yu cu BE ch v thi hn; cn nu trong BE khng c chnh sch nhng ti nguyn (preempt) th s lm gim s lng AR c chp nhn (cha cn lp lch).

M hnh thu bao ti nguyn ca B. Sotomayor (2010) [9] c m t nh sau: Lease l khi nim tru tng. My o l hin thc cho i tng c thu bao (leased). Tp trung vo mt min qun tr. Hng hiu nng cao H tr c hai loi best-effort v t ch (advanced reservation). Cc best-effort job c th nhng cho yu cu t ch.

5. Bi ton 2: cung cp ti nguyn tnh ton trn h thng cloud vi tiu ch tit kim nng lng:
Vi ch s hu ca h thng cloud (cc data-centers) th h mun gim chi ph vn hnh h thng, trong tin in l chi ph khng nh. Cc data-center thng tiu th mt lng in rt ln v tng mnh (theo mt d bo ca y ban nng lng ca M), iu ny ng ngha vi vic kh thi CO2 s thi ra mi trng nhiu gy nhiu hu qu (global warming). Do , mt xu hng khc trong vic qun l ti nguyn l nng lng hiu qu (Energy-efficient resource management) : Green Cloud [11][12]. Trong vic cung cp ti nguyn th bi ton lp lch tit kim/nhn bit nng lng c xy dng, v d: mt s gii thut lp lch nhn bit nng lng n t [11][13]

Trang 7

Hnh 1 gii thut t cc my o tit kim nng lng [11]

Hnh 2 Gii thut lp lch my o da trn cng sut [13]

Trang 8

II.

TNH HNH NGHIN CU LIN QUAN

1. So snh in ton m my v tnh ton li

Phn ny trnh by tm lc so snh ca in ton m my (Cloud computing) v tnh ton li (Grid computing) da trn ti liu so snh ca Ian Foster, et.al., (2008) [2]. Ti c a vo mt s kin nh gi ca c nhn trong hnh v v bng cc tiu ch so snh chc nng, nhim v v mc tiu ca qun l ti nguyn trong Grids v Clouds. Hnh 3 bn di so snh Cloud v Grid v kch thc (scale), hng ng dng (application oriented) hay hng dch v (services oriented). Qua hnh 3, chng ta thy h thng li l nhng h thng phn b (distributed systems) bt u t hng ng dng v sau chuyn sang hng dch v. Cc chun nh Open Grid Service Archtiectures (OGSA) cng xut cc dch v mc kin trc cho cc chc nng ca h thng li. Trc tung th hin kch thc (scale) v trc honh th hin tnh hng ng dng hay hng dch v.theo hai trc: trc tung th hin kch thc (scale) v trc honh th hin tnh hng ng dng hay hng dch v.

Hnh 3: So snh h thng in ton m my v h thng li v kch thc (scale) v tnh hng ng dng hay hng dch v

Hnh 4 so snh kin trc Grid v kin trc Cloud:

Trang 9

Hnh 4: So snh kin trc ca Grid v Cloud

Bng 1: sau so snh Grid v Cloud qua mt s thuc tnh c trng lin quan n chc nng v nhim v ca qun l ti nguyn dnh cho hai h thng:
Bng 1 Cc tiu ch so snh Grids v Clouds

Tiu ch (criteria) Qun l ti nguyn - M hnh tnh ton (Compute model)

Grids

Clouds

- Qun l batch-job: + Portable Batch System (PBS), Condor, Sun Grid Engine (SGE), LSF, + ch yu h thng xp hng (queuing system).

- chia s ti nguyn cho tt c ngi dng lc cao im (c triu ngi dng).

- Data Model

Data Grid

Tnh bo mt v ring t ca d liu D liu rt ln (Tbytes) trn h thng vn c ca ngi dng, khi truyn qua mng s tn rt nhiu thi gian.

Trang 10

- Data locality

- Even harder than Cloud - Shared data stores on NFS/GPFS/PVFS/Luster - Need scheduler to be dataaware

Hardly Googles MapReduce on Google File System Need scheduler to be data-aware

- Combining compute and data management - Virtualization

- In progress of works on schedulter data-aware - Not need as much as Cloud on Virtualization - Mostly physical resource

Not yet - Needs Virtualization

- Monitoring - Built-in workflows systems: Chimera, Swift, Keepler, Tavena, - Similar to parallel & distributed computing: MPI, MPICH-G2, GridRPC, PopC++, - Across many VOs - Single Sign-On

- Hard to fully monitor resources and services on cloud systems - More difficult than in Grids

- Provenance

- Programming Models

- MapReduce - Mash-up and scripting - Clouds mostly is dedicated data centers belong to one orgranization. - SSL based -

- Security Models

Trang 11

2. Cc phn mm xy dng h tng in ton m my (cloud computing)

Hin nay cc lnh vc lin quan n Cloud computing tr thnh nhng ch quan trng v s c quan tm trong cc hi ngh khoa hc v song song v phn b ni ting trn th gii. Cloud computing cng hnh thnh cng ng nghin cu ng tri rng t M, Chu u, Chu , c (nhm Nimbus Toolkit, nhm CloudLab,). Cc hng nghin cu chnh ca Cloud gm: (i) hng nghin cu xy dng h tng Cloud theo m hnh Infrastructure as a Service (IaaS) - ging hoc tng t Amazon Elastic Computing Cloud (Amazon EC2) , cc cng c ph bin nh l EUCALYPTUS , Nimbus Toolkit , OpenNebulla ; (ii) hng nghin cu xy dng Cloud di dng Platform as a Service (PaaS) v d Google AppEngine l mt dng ny, cho php ngi dng vi ti khon ca Google c kh nng to cc ng dng trn nn tng MapReduce v BigTable ; (iii) hng nghin cu xy dng m hnh dch v phn mm trn Cloud kiu Software as a Service (SaaS) m hnh ny khc dng truyn thng im s lng ngi dng rt ln (ton cu) v n c kh nng n hi theo s lng ngi dng bi h tng bn di ca n li l mt Cloud IaaS. Nhm pht trin ng dng hin a dng v thu ht s quan tm ca c cc cng ng khc nh cc ng dng trong lnh vc cng ngh sinh hc, v d: d n ScienceCloud. S kt hp gia h tng Cloud mc Infrastructure as a Service (IaaS) v SaaS cho php chng ta pht trin khi nim gi l Computing as a Service (CaaS). Khi nim CaaS ny l mt h thng cc dch v (dng Web service) cung cp dch v tnh ton theo nhu cu s dng ca ngi dng. i vi ngi s dng khi s dng h thng (c kh nng CaaS) ny th cc yu cu v bo mt, fault-tolerant, load-balancing, software provisioning, Service Level Agreement (SLA), ...v..v... c cung cp (cho cc ngi dng). Verizon l mt doanh nghip thng mi cung cp kh nng dch v tnh ton (CaaS) vi tnh nng bo mt, m bo tnh sn sng 100%. Nhng Verizon cha cp n vn cung cp phn mm trn Cloud. nh gi v cc b khung phn mm xy dng Cloud IaaS th EUCALYPTUS l mt khung (framework) lm vic m ngun m cho Cloud computing di dng IaaS. EUCALYPTUS cung cp cc giao din tng thch vi cc th vin lp trnh API sn c ca Amazon EC2 v Amazon S3. Hin ti EUCALYPTUS cha cung cp tnh nng nh bo mt trong khi mt CaaS s phc v cho hng ngn ngi dng vi d liu ring t cao, hoc chc nng qun l ngi dng, cc nh ca my o (virtual machine image), giao din cung cp chc nng gim st (monitoring) cho tng ngi dng v cho ngi qun tr h thng cha hon thin v cn kh n gin. EUCALYPTUS cng khng c trang b Cloud gateway giao tip vi h thng Cloud khc. EUCALUPTUS cn thiu s h tr cho cc phn mm qun l cluster thng dng nh Portable Batch System (PBS), SunGrid Engine (m ch h tr Rocks cluster). EUCALYPTUS hin c pht

Trang 12

trin di dng sn phm thng mi (ngun vn ti tr l 5 triu la M) v n c dnh mt phin bn khc cho cng ng dng m ngun m. Nimbus Toolkit cung cp mi trng Workspace cho php to v thc thi cc my o trn cm cc my tnh thc. Nimbus s dng mt s dch v ca Globus Toolkit nh GridFTP di chuyn (transfer) cc nh ca cc my o n my tnh thc thc thi. Nimbus c trang b Cloud gateway giao tip vi cc h thng Cloud khc. OpenNebulla vi tng l pht trin cc tnh nng cho mt Cloud hay Hydrid Cloud nh mt DataCenter. Kin trc ca OpenNebulla cho php chng ta m rng b lp lch ca n d dng. OpenNebulla c li th l s hu thun ca d n EUs Reservoir (www. reservoir-fp7.eu) ca y Ban Chu u v c s lin kt thc hin ca nhiu nhm nghin cu cc trng i hc khc nhau ca Chu u (Ty Ban Nha,). Trong cc h tng Cloud IaaS thng mi th tuy khng phi l ni u tin a ra tng Cloud computing, nhng Amazon Elastic Compute Cloud (Amazon EC2) v Amazon Simple Storage Service (Amazon S3) l hai trong s cc dch v dng Cloud c cung cp bi Amazon AWS rt thnh cng hin nay. Ngi dng ch cn th tn dng (Credit Card, hay Master Card) c kh nng thanh ton qua mng l c th ng k ti khon trn Amazon AWS thu cc dch v nh: thu chy mt hay nhiu my o trn Amazon EC2, thu khng gian lu tr trn Amazon S3 Virtual Computing Lab (VCL) c quan tm trng i hc M, mt m hnh in hnh l Virtual Computing Lab ca trng i hc tiu bang Bc Carolina. H cung cp m ngun m Apache VCL cho cng ng nghin cu. Hin ti Apache VCL c trin khai tm trng khc (thng tin trn web site d n http://vcl.ncsu.edu/academic-partners). Mc tiu ca Apache VCL l cung cp mi trng tnh ton theo yu cu cho ngi dng c gii hn thi gian thng qua trnh duyt. Mi trng tnh ton ny c th n gin l vic chy mt my o, chy mt ng dng tun t hoc song song (v d: CAD, GIS, cc gi phn mm thng k, doanh nghip) trn mt cm my tnh vt l. V mt tng, ngi dng c th dng trnh duyt trn my tnh Desktop hay di ng gi yu cu thc thi mt ng dng (trn mt my o) qua ng truyn Internet n b lp lch ca Apache VCL, b lp lch s la chn v thc thi yu cu (nu c), kt qu ngi dng c th tng tc vi giao din ng dng t xa. Hin ti, Apache VCL dng mi trng o ha l VMware ESXi, VMware ESX Standard Server, VMWare Free Server m cha h tr XEN , Microsoft Hyper-V,. B lp lch ca Apache VCL khng th quyt nh khi no my vt l s thc thi my o v thc thi nh th no (do mi my thc s b qun l bi phn o ha nh VMware ESXi).

Trang 13

III.

KT LUN

Bi bo ny ti trnh by v khi nim v phn loi v in ton m my (cloud computing) qua cc nh ngha ca nhiu ngi, nhiu gc khc nhau. Bi bo cng kho st cc vn lin quan n vic cung cp ti nguyn trn mi trng in ton m my. ng thi bi bo cng cp n vic so snh gia cc h thng Grids v Clouds trn cc tiu ch ca qun l ti nguyn.

IV.
[1]

Ti liu tham kho

R. Buyya, C. Shin, S. Venugopal, J. Broberg, and I. Brandic, Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility, Future Generation Computer Systems, vol. 25, 2009, pp. 599-616. I. Foster, Y. Zhao, I. Raicu, and S. Lu, Cloud Computing and Grid Computing 360Degree Compared, 2008 Grid Computing Environments Workshop, Nov. 2008, pp. 1-10. B. Sotomayor, S. Montero, I.M. Llorente, and I. Foster, An Open Source Solution for Virtual Infrastructure Management in Private and Hybrid Clouds, IEEE Internet Computing Special Issue on CLoud Computing, vol. 13, 2009, pp. 14-22. M. Armbrust, A.D. Joseph, R.H. Katz, and D.A. Patterson, Above the Clouds : A Berkeley View of Cloud Computing, Technical Report No. UCB/EECS-2009-28, 2009, pp. 1-23. A.P.I. Reference and A.P.I. Version, Amazon Elastic Compute Cloud, 2010. Amazon simple storage service - http://aws.amazon.com/s3/. Google appengine - http://code.google.com/appengine/. B. Sotomayor, K. Keahey, and I. Foster, Combining batch execution and leasing using virtual machines, Proceedings of the 17th international symposium on High performance distributed computing - HPDC 08, New York, New York, USA: ACM Press, 2008, p. 87. B. Sotomayor, Provisioning Computational Resources Using Virtual Machines and Leases, PhD Thesis submited to The University of Chicago, 2010.

[2]

[3]

[4]

[5] [6] [7] [8]

[9]

[10] B. Sotomayor, K. Keahey, I. Foster, and T. Freeman, Enabling Cost-Effective Resource Leases with Virtual Machines, Hot Topics session in HPDC 2007, Monterey Bay, CA (USA): 2007, pp. 16-18.

Trang 14

[11] A. Beloglazov and R. Buyya, Energy Efficient Resource Management in Virtualized Cloud Data Centers, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, May. 2010, pp. 826-831. [12] . Goiri, F. Juli, R. Nou, and J.L. Berral, Energy-Aware Scheduling in Virtualized Datacenters, 2010, pp. 1-23. [13] A.J. Younge, G.V. Laszewski, L. Wang, S. Lopez-alarcon, and W. Carithers, Efficient Resource Management for Cloud Computing Environments, To appear in the Work in Progress in Green Computing with the IEEE International Green Computing Conference (IGCC), I.A. Behrooz Shirazi, ed., Chicago, IL USA: IEEE, 2010.

Trang 15