صفحه 1:
صفحه 2:
© Dhis talk is based vo speeches ۱
0 حمحتحصحصل هه أ
rer ae ۲ روج و جزنن
© bot oF people thick they wil eG
woke u lot oP woury — sv there SY
i bs of برها ¥
© But there seews to be Once sua
chars?
صفحه 3:
62
* متسس و0 ۱
ke abiliy to reo wuliple pperciay systews وه a sicrcfe
Pkysicd systew aed stare the vader biog hardware
تسم تما
©» لیسان Cowputer:
۱ tao toe (aru oa tester),
وی لمومجلحود ty dow the scubay up ard deuva oF
wee
تما
* OOwar white paper, Ornatzatios Overview
** los Dikkxoova, quoted it Obrid Botany Darck CD09
20090O0O_OrratrsennDbnt 8
صفحه 4:
Tee Tretiond Gerver Cowept
Hardware platform
Ovb Gerver Opp Gerver O® Gener 60
Ordos Dine Dice Oreos
© امیس 0۵0 Crckone
صفحه 5:
Hardware platform
Hardware platform Hardware platform
Ovb Gerver pp Gerver O® Gener 60
Ordos 0000۱ ما Oreos
© 0۵0 Crckone
صفحه 6:
62
Tee Tretiond Gerver Cowept UWE
© Opstew Odkoistruors Ped tik ubout servers us u Whole
wail thot tarkides the hurdwore, the OG, the storage, ord the
اون
the .عز میت ولا روا ما وتو ماه چه Geners و
xchange server, the GOD server, the Pile server, ptr.
Pile server Pils up, or the xchange server با 1 و
bevowes vuertoxed, thea the Gpstes Odewivistrators wust
ud ito Ge Server.
20090O0O_OrratrsennDbnt 8
صفحه 7:
2
Wee Treitiond Gerver Ovwept UWE
9 Odless there ue wutiple servers, Pu service
pxpeneuves u hardware Puture, theo the service is
dows.
9 Gpstew Odwies coc koplewedt clusters oP servers
to woke thew wore Pout toler. owever, eveo
Dhusters hove licvits vo their svutubiliy, ard aot oft
upplicaiivas work io clustered euvircawet.
صفحه 8:
62
Tee Tretiond Gerver Cowept UWE
Pros ° Cow و
Cosy i orwepandse © Cxpewive tp wquire od ©
wort harcore تابط نا رح نيم 6
Cy w bok © Oot ven soukbe ©
Oltualy cay oppicaicd/ service * OP Pivul to replicate ©
to له سا رل * pan be res Pro this ype of
موز ماود
ون لها و0 عون ۶
جا ۳9 ,جیوه روم ۰
۳
20090O0O_OrratrsennDbnt 9
صفحه 9:
Wee Orrtud Gerver Cowept UWE
ات تست تا سح
ts 00 ea ia 7
۳ ا YY
"Ye ۲
9 9 9 9 9
صفحه 10:
4 #رپسییاظ
* دمب (])0) جا بمصوكمكء و م۳ لول white paper, Oirtuatzatica Overview: UWF
20090O0O_OrratrsennDbnt
صفحه 11:
2
The Orrtud Gerver Couwept UWF
5 Oitud servers seek to eucupsulie the server
soPiware away Brow the ولو
© Dhis با لیا OG, the upphoaiogs, wed the storage
Por that server.
و Gervers ew up oe were Piles stored oo a physic
box, or ia euterprise .سرك ساك
۰ © virttud server own be serviced by vue pr wore
hosts, cod vor host way house wore the vor virtudl
BEYVEr.
صفحه 12:
۳
(۲۰ لسب0 Gerver Cowept fe
5 Ointtud servers con stil be neR erred to by their
Puuction ie. ewuil server, dutubuse server, Pip.
. OP the eewiroavedt is built correct, vittudl servers
wil aot be oPP ected by the loss oP ۰ host.
© Losts way be rewoved ued fateoduced ukvvst ut will
ماو وله و
صفحه 13:
۳
Phe Otte Gerver Ovwept 4
ooo be svded put easily. رو لمیر و
AP the ackvinistrutors Pied that the respurces supportiog a virtual ©
server are betey taxed tov wurk, they coc odust the aout oF
resources ulovoted to thot virtual server
17 موی امش و و Gener tewphites on be outed و
be used to reat wutiple, decid virtua servers
servers thewseves vou be wiqrated Prow host to بر و
host okeost ot will.
20090O0O_OrratrsennDbnt 9
صفحه 14:
۳
۰ لمبین Gerver Oowept 4
5 Cow
Resvurce povka © Ghehiy harder to coacephraize
Dich) recent © Chey wore cosy (wast buy
رم سارت را ترا OG, Opps, ocd
ول رل vow servers cow the obstraction ker)
Cusy to deploy
© ReoodPurable while services
05
eee eg
© Optcotzes physicd resources
وت مج بط with bess
20090O0O_OrratrsennDbnt or
صفحه 15:
۳
Otrtudizatiod Grats ©;
Prow woop vowpodes نان و
ey OOuwwe, Diervsvht, Gua, ... ©
Wardwure support °
Pits well wits the wove to OF bit (very large wewories) ©
wulti-oone (cowwurnreuy) provessvrs.
4Aetel OT (Oirtucizaiva Peckarloyy) provides hardware ©
to support the Oirtudl Mackie Doctor ker
توصاصجادها لجواكناتل ادوع وب د is ww یبن و
صفحه 16:
صفحه 17:
۳
موی rect © Oy pw Por او ان رون و
fee stock worket dota weekeuds, pverciht?
0 5 60-5 FO,
1 00
) oF =
Gerver “
حیسم
0 Pb OTHER
a ۵0۵
20090O0O_OrratrsennDbnt
صفحه 18:
۳
Porbes' Ookiton fe
© Wot the web site in Owen's CCC Elastic
Cowpute Chud
9 rovisiva vew servers every doy, od deprovisioa
thew every vight
° Pap just $0.0* per server per hour
© * core Por higher vapuriy servers
۰ bet @weazve worry وله لا تاه
صفحه 19:
Cloud vpowputcy ص1 مایا حول 4
the vext step UWE
© You dou! hove ty pw the hardware
© You “red” tos ceeded Prow امه هن
© Phere ure public clouds
© ey. Owarvd CCO, ud ww woop vers
(Dirverht, WO, Gua, ocd thers ...)
در هه po wpe ooo 059 ©
جات اوه هه ایو ik wore ©
20090O0O_OrratrsennDbnt
صفحه 20:
6
Grd تست سسکا pet
بسن و
© مرو رمبت() hove vortuble dewueds
© Oak provesstay (ey. Dew York Dives)
© Deb sites wi peaks (F-y. Porbes)
© Grotups wi uhowwwe dewadd (ey. the Oust Por
Ohmkers pron)
© Reduce risk
© Ooo! ceed ty buy karo ul pou ceed it
صفحه 21:
۳
God © - Owkess Bolty fe
® One tho sculubiliy - efesticay!
© Gly Lily ic rapid) choogiey heath more busivess
© وله و لول 9 - 6 woods to ورف 0 deported 0 server
hoster, thea they would koord if!
©» Osx BCC, vbow S wicntes!
۶ od they que it buck whe they ore doce!
9 دن بدالمجك جه أموعصوض ا جه طز عأصدط بجنتامج8)
صفحه 22:
۳
God 9 - Gtick t حوصبی() بر UWF
9 Ovst powpenties don't 00000041“ صا do spotew
وله
© Porbes sus:
© Oe ae isu pubtskicy cowpooy, wt a svPiwvare و
:جورروط ن8) *
® Oo pu reddy swe wok oo spe ockvia?
© You ded! kwe the kardwore, but pou stl کیجم ها لصو
tke OG!
20090O0O_OrratrsennDbnt ee
صفحه 23:
۳
Wow Chi Cowputtry Oorks ©;
© Oaives providers let pou pred virtudl servers
© Get wp oo woot, perkops just wi a credit card
You crede virtud servers ("“virttuctizativa") و
Choose the OG und spPiware cock “isteae" will hove ©
ual ros coo forge server Pars located somewhere ©
وصامه You coo estodioie wore ooo Pew wicuies! &
© Sou co shut dow tostoores tao wists عاج 56
© Dhep sec pou o bill Por wht pou use
6ه 1577
صفحه 24:
Details? 6 ریعه() رب
(bods of thew!) UWF
bow do 1 pick a provider?
vw 1 tocked صا جز 0 provider?
Okere do 1 put wp dota?
Okat hoppece ty cy dota wheo 41 shot dow?
Wow do 1 box نرب صا جز server?
Wow do 1 keep others Proc boxing ict (secur)?
Dow do 1 yet ot IP oktess?
Ew.
20090O0O_OrratrsennDbnt 3
صفحه 25:
2
Oud Our أكداصورص ]| “ مادج set UWF
Remember though .. Ea ۱
“+ These solutions will not
auto-seale themselves ۰ 5
+ They are merely ۰
مج
09
+ You must manage the
scaling as f you has
them running in your
own data cenire
>, GRE =) Goigle oes | Menu
* Obud PrrtOCurpe Dark CODD
20090O0O_OrratrsennDbnt مه
صفحه 26:
9 (Brew out of ePPorts to wore (ward's put
5۳۳/۲ 25
© (Cock نهر ما yet a page Pro Owe, vero
* Gee rePerewe Owozrd Prckiecture on their service
desi pouvepts
© Dkey wt sv youd oft trot they knocked Para
صفحه 27:
۳
Chad Cowputtery Grates ©;
9 Geews to be rapidy bevowieg 0 wousiredd
pruviive
© Ouwers providers
© Owed ECC tevitators ...
© dust about every wor iodusiry wave
© 100, Gua, DierosvF, ...
روص بصاك كوا ام حصحا عروزه (1) ۰
20090O0O_OrratrsennDbnt
صفحه 28:
62
© 2 ددا( the Tuhe-Bwwy? UWF
© Phere seews to be a wor revoloivd
edderway it how وله موی جنر
© Cpeniy (jackie per service or var bry wacker _ >
wits woop virtd servers ad
© مس )یی or red Prow vb 0
cho)
۵ Wise Grae Fede renner
© Oe ww weed to rethick bots our research und
]
20090O0O_OrratrsennDbnt 6ه
صفحه 29:
Por OC: ۳
Obet Obout Reseach? UWF
© Dke Cucdbpis Prvect ۱
© Crow Ouversiy oP CdlPorca Gaota Barbara
© Ou vpes source ooleviivd oP tools to build pour pu لنصات
© Lieu ustcegy Kea Por virtuaizatioa
© @u upporeuly oped research ured! ولمم dot
© Reyer dotsboses upponeaty doo't svole well
© @spevidly bord to woke elostic (svule up | soe dow)
20090O0O_OrratrsennDbnt 29
صفحه 30:
Por OO: ۳
سا م0 Peackicry? لاو
© Ow yreduotes should koow ری لمات تاه /
© twill be usePul Por sowe upplicaioas, hough ut Por oll
و But what ae the شوه رها او
© سا عا) مر ...(
© صصو ه توت ۱ نو و و نو .(
© Oesiqa (how to woke وولو و service ...(
© 222
20090O0O_OrratrsennDbnt
صفحه 31:
۳
۲ 009 ۰ 4
© Cunedly developiog o Omrtuntzativd / Cloud
Coxnputiery ”عب يوي"
© 0-6 ches sessinw phe uw exercise
(Opvewber): ین و
COP 9990 - Oul-Provess Cowputtay (Gta) ®
CVG FOU? — Orb Gerver Ockriaistraivg (Owscick- ©
ewe)
° Obevives
* Qworess ow werkouirs oP ECC
20090O0O_OrratrsennDbnt oa
صفحه 32:
۳
(hs oe ered w of Gepewber, CD09) UWE
© OOunre Ia., Oitvakzaizd Overview,
ما اه ود نطو
© Dodd مه Prokiectrr,
hip: |(hick=rokibhy.corimcrrarchiectur, Gept. 2, EDO?
* امد Corp., مین ماه ولو تا روا
Teckel, bi!) /dounioe jel creche / iar SDE GO اس
* WOO bid, )لو Dark C009,
که بانط
7 uk/kelp dowdbooiranp warkOOOO Pw
20090O0O_OrratrsennDbnt ee
صفحه 33:
ORere 0 ۱/۸۲ 7 Prow here?
© Oxy dew keep we vu oP the ran?
Virtualization and Cloud
Computing
Norman Wilde
Thomas Huber
20090909_VirtualizationAndCloud
1
An opening caveat ...
This talk is based on speeches
at conferences, discussions
with people in industry, and
some experimentation.
A lot of people think they will
make a lot of money – so there
is lots of hype!
But there seems to be
something fundamental going on.
20090909_VirtualizationAndCloud
Some sun
behind the
clouds?
2
Two Technologies for Agility
Virtualization:
The ability to run multiple operating systems on a single
physical system and share the underlying hardware
resources*
Cloud
Computing:
“The provisioning of services in a timely (near on instant),
on-demand manner, to allow the scaling up and down of
resources”**
* VMware white paper, Virtualization Overview
** Alan Williamson, quoted in Cloud BootCamp March 2009
20090909_VirtualizationAndCloud
3
The Traditional Server Concept
Web Server
App Server
DB Server
EMail
Windows
Linux
Linux
Windows
IIS
Glassfish
MySQL
Exchange
20090909_VirtualizationAndCloud
4
And if something goes wrong ...
Web Server
App Server
DB Server
EMail
Windows
DOWN!
Linux
Windows
MySQL
Exchange
IIS
20090909_VirtualizationAndCloud
5
The Traditional Server Concept
System Administrators often talk about servers as a whole
unit that includes the hardware, the OS, the storage, and the
applications.
Servers are often referred to by their function i.e. the
Exchange server, the SQL server, the File server, etc.
If the File server fills up, or the Exchange server
becomes overtaxed, then the System Administrators must
add in a new server.
20090909_VirtualizationAndCloud
6
The Traditional Server Concept
Unless
there are multiple servers, if a service
experiences a hardware failure, then the service is
down.
System Admins can implement clusters of servers
to make them more fault tolerant. However, even
clusters have limits on their scalability, and not all
applications work in a clustered environment.
20090909_VirtualizationAndCloud
7
The Traditional Server Concept
Pros
Easy to conceptualize
Fairly easy to deploy
Easy to backup
Virtually any application/service
can be run from this type of
setup
Cons
Expensive to acquire and
maintain hardware
Not very scalable
Difficult to replicate
Redundancy is difficult to
implement
Vulnerable to hardware outages
In many cases, processor is
under-utilized
20090909_VirtualizationAndCloud
8
The Virtual Server Concept
Virtual Machine Monitor (VMM) layer between Guest OS and hardware
20090909_VirtualizationAndCloud
9
Close-up*
* adapted from a diagram in VMware white paper, Virtualization Overview
Server
1
Guest OS
Server
2
Guest OS
Clustering
Service
Console
VMM (Virtual Machine Monitor)
x86 Architecture
Intercepts hardware
requests
20090909_VirtualizationAndCloud
10
The Virtual Server Concept
Virtual
servers seek to encapsulate the server
software away from the hardware
This includes the OS, the applications, and the storage
for that server.
Servers
end up as mere files stored on a physical
box, or in enterprise storage.
A virtual server can be serviced by one or more
hosts, and one host may house more than one virtual
server.
20090909_VirtualizationAndCloud
11
The Virtual Server Concept
Virtual
servers can still be referred to by their
function i.e. email server, database server, etc.
If the environment is built correctly, virtual servers
will not be affected by the loss of a host.
Hosts may be removed and introduced almost at will
to accommodate maintenance.
20090909_VirtualizationAndCloud
12
The Virtual Server Concept
Virtual servers can be scaled out easily.
If the administrators find that the resources supporting a virtual
server are being taxed too much, they can adjust the amount of
resources allocated to that virtual server
Server templates can be created in a virtual environment to
be used to create multiple, identical virtual servers
Virtual servers themselves can be migrated from host to
host almost at will.
20090909_VirtualizationAndCloud
13
The Virtual Server Concept
Pros
Resource pooling
Highly redundant
Highly available
Rapidly deploy new servers
Easy to deploy
Reconfigurable while services
are running
Optimizes physical resources
by doing more with less
Cons
Slightly harder to conceptualize
Slightly more costly (must buy
hardware, OS, Apps, and
now the abstraction layer)
20090909_VirtualizationAndCloud
14
Virtualization Status
Offerings
from many companies
e.g. VMware, Microsoft, Sun, ...
Hardware
support
Fits well with the move to 64 bit (very large memories)
multi-core (concurrency) processors.
Intel VT (Virtualization Technology) provides hardware
to support the Virtual Machine Monitor layer
Virtualization
is now a well-established technology
20090909_VirtualizationAndCloud
15
So what about
Cloud Computing?
20090909_VirtualizationAndCloud
16
Suppose you are Forbes.com
You offer on-line real
time stock market data
Why pay for capacity
weekends, overnight?
9 AM - 5 PM,
M-F
Rate of
Server
Accesses
ALL OTHER
TIMES
20090909_VirtualizationAndCloud
17
Forbes' Solution
Host
the web site in Amazon's EC2 Elastic
Compute Cloud
Provision
new servers every day, and deprovision
them every night
Pay just $0.10* per server per hour
* more for higher capacity servers
Let
Amazon worry about the hardware!
20090909_VirtualizationAndCloud
18
Cloud computing takes virtualization to
the next step
You don’t have to own the hardware
You “rent” it as needed from a cloud
There are public clouds
e.g. Amazon EC2, and now many others (Microsoft,
IBM, Sun, and others ...)
A company can create a private one
With more control over security, etc.
20090909_VirtualizationAndCloud
19
Goal 1 – Cost Control
Cost
Many
systems have variable demands
Batch
processing (e.g. New York Times)
Web sites with peaks (e.g. Forbes)
Startups with unknown demand (e.g. the Cash for
Clunkers program)
Reduce
Don't
risk
need to buy hardware until you need it
20090909_VirtualizationAndCloud
20
Goal 2 - Business Agility
More
Ely Lilly in rapidly changing health care business
than scalability - elasticity!
Used to take 3 - 4 months to give a department a server
cluster, then they would hoard it!
Using EC2, about 5 minutes!
And they give it back when they are done!
Scaling
back is as important as scaling up
20090909_VirtualizationAndCloud
21
Goal 3 - Stick to Our Business
Most
companies don't WANT to do system
administration
Forbes says:
But
We are is a publishing company, not a software company
beware:
Do you really save much on sys admin?
You don't have the hardware, but you still need to manage
the OS!
20090909_VirtualizationAndCloud
22
How Cloud Computing Works
Various providers let you create virtual servers
You create virtual servers ("virtualization")
Set up an account, perhaps just with a credit card
Choose the OS and software each "instance" will have
It will run on a large server farm located somewhere
You can instantiate more on a few minutes' notice
You can shut down instances in a minute or so
They send you a bill for what you use
20090909_VirtualizationAndCloud
23
Any Nasty Details?
(loads of them!)
How do I pick a provider?
Am I locked in to a provider?
Where do I put my data?
What happens to my data when I shut down?
How do I log in to my server?
How do I keep others from logging in (security)?
How do I get an IP address?
Etc.
20090909_VirtualizationAndCloud
24
And One Really Important Caveat*
* Cloud BootCamp March 2009
20090909_VirtualizationAndCloud
25
(footnote)
How come Amazon?
Grew
out of efforts to manage Amazon’s own
services
(Each time you get a page from Amazon, over a
hundred servers are involved)
See reference Amazon Architecture on their service
design concepts
They
got so good at it that they launched Amazon
Web Services (AWS) as a product
20090909_VirtualizationAndCloud
26
Cloud Computing Status
Seems
to be rapidly becoming a mainstream
practice
Numerous providers
Amazon EC2 imitators ...
Just about every major industry name
IBM, Sun, Microsoft, ...
Major
buzz at industry meetings
20090909_VirtualizationAndCloud
27
So What’s the Take-Away?
There seems to be a major revolution underway in
how we manage hardware
Specify (machine per service or one big machine with
many virtual servers
Purchase (own it yourself or rent from a public cloud)
Use (always-on, or flexible provisioning as needed ...)
and
software?
We may need to rethink both our research and teaching
20090909_VirtualizationAndCloud
28
For UWF:
What About Research?
The
From University of California Santa Barbara
An open source collection of tools to build your own cloud
An
Eucalyptus Project
Linux using Xen for virtualization
apparently open research area: handling data
Regular databases apparently don't scale well
Especially hard to make elastic (scale up / scale down)
20090909_VirtualizationAndCloud
29
For UWF:
What About Teaching?
Our
graduates should know about cloud computing /
virtualization
It will be useful for some applications, though not for all
But
what are the right learning objectives?
Awareness (its there ...)
Mechanics (here’s how to instantiate a server ...)
Design (how to make a scalable service ...)
???
20090909_VirtualizationAndCloud
30
For Fall 2009 ...
Currently
developing a Virtualization / Cloud
Computing “module”
1 – 2 class sessions plus an exercise
Target
courses (November):
COP 6990 – Multi-Process Computing (Simmons)
CTS 4817 – Web Server Administration (OwsnickiKlewe)
Objectives
Awareness and mechanics of EC2
20090909_VirtualizationAndCloud
31
References
(links are current as of September, 2009)
VMware Inc., Virtualization Overview, http://www.vmware.com/pdf/virtuali
zation.pdf
Todd Hoff, Amazon Architecture, http://highscalability.com/amazon-architect
ure, Sept. 18, 2007
Intel Corp., Technology brief: Understanding Intel® Virtualization
Technology, http://download.intel.com/technology/virtualization/320426.pdf
aw2.0 Ltd, Cloud BootCamp March 2009, http://www.aw20.co.uk/he
lp/cloudbootcamp_march2009.cfm
20090909_VirtualizationAndCloud
32
Where do we go from here?
Any
ideas to keep us out of the rain?
20090909_VirtualizationAndCloud
33