CMA. TCA Srinivasa Prasad €¦ · –Debug problems (suspend and resume the problem machine),...

1

CMA. TCA Srinivasa Prasad+91 947 770 [email protected]

25/06/18 CMA. TCA Srinivasa Prasad

CloudComputing

Cloud – DemystArichetureTechnologyBenefitsChallenges & Concerns

3



4

WhatisCloudComputing?• CloudComputingisageneraltermusedtodescribeanew

classofnetworkbasedcomputingthattakesplaceovertheInternet,– basicallyasteponfromUtilityComputing– acollection/groupofintegratedandnetworkedhardware,softwareandInternetinfrastructure(calledaplatform).

– UsingtheInternetforcommunicationandtransportprovideshardware,softwareandnetworkingservicestoclients

• TheseplatformshidethecomplexityanddetailsoftheunderlyinginfrastructurefromusersandapplicationsbyprovidingverysimplegraphicalinterfaceorAPI(ApplicationsProgrammingInterface).


5

WhatisCloudComputing?

• Inaddition,theplatformprovidesondemandservices,thatarealwayson,anywhere,anytimeandanyplace.

• Payforuseandasneeded,elastic– scaleupanddownincapacityandfunctionalities

• Thehardwareandsoftwareservicesareavailableto– generalpublic,enterprises,corporationsandbusinessesmarkets


6

CloudSummary• CloudcomputingisanumbrellatermusedtorefertoInternetbaseddevelopmentandservices

• Anumberofcharacteristicsdefineclouddata,applicationsservicesandinfrastructure:– Remotelyhosted:Servicesordataarehostedonremoteinfrastructure.

– Ubiquitous:Servicesordataareavailablefromanywhere.– Commodified:Theresultisautilitycomputingmodelsimilartotraditionalthatoftraditionalutilities,likegasandelectricity- youpayforwhatyouwouldwant!


7

Architecture

• Thearchitecturebehindcloudcomputingisamassivenetwork.

• Thecloudcomputinginfrastructureconsistsofreliableservices.

• TheCloudappearsasasinglepointofaccessforallthecomputingneedsofconsumers.

9

CloudArchitecture


10

WhatisCloudComputing

10Adopted from: Effectively and Securely Using the Cloud Computing Paradigm by peter Mell, Tim Grance

• Sharedpoolofconfigurablecomputingresources• On-demandnetworkaccess• ProvisionedbytheServiceProvider


11

CloudComputingCharacteristics

11

Common Characteristics:

Low Cost Software

Virtualization Service Orientation

Advanced Security

Homogeneity

Massive Scale Resilient Computing

Geographic Distribution

Essential Characteristics:

Resource PoolingBroad Network Access Rapid Elasticity

Measured Service

On Demand Self-Service

Adopted from: Effectively and Securely Using the Cloud Computing Paradigm by peter Mell, Tim Grance


12

CloudServiceModels

12

Software as a Service (SaaS)

Platform as a Service (PaaS)

Infrastructure as a Service (IaaS)

Google App Engine

SalesForce CRM

LotusLive

Adopted from: Effectively and Securely Using the Cloud Computing Paradigm by peter Mell, Tim Grance


13

SaaSMaturityModel

13Source: Frederick Chong and Gianpaolo Carraro, “Architectures Strategies for Catching the Long Tail”

Level2:Configurablepercustomer

Level3:configurable&Multi-Tenant-Efficient

Level1:Ad-Hoc/Custom–OneInstancepercustomer

Level4:Scalable,Configurable&Multi-Tenant-Efficient


14

DifferentCloudComputingLayers

Application Service(SaaS)

Application Platform

Server Platform

Storage Platform Amazon S3, Dell, Apple, ...

3Tera, EC2, SliceHost, GoGrid, RightScale, Linode

Google App Engine, Mosso,Force.com, Engine Yard,Facebook, Heroku, AWS

MS Live/ExchangeLabs, IBM, Google Apps; Salesforce.comQuicken Online, Zoho, Cisco


15

Services

Application

Development

Platform

Storage

Hosting

CloudComputingServiceLayersDescriptionServices – Complete business services such as PayPal, OpenID, OAuth, Google Maps, Alexa

Services

ApplicationFocused

InfrastructureFocused

Application – Cloud based software that eliminates the need for local installation such as Google Apps, Microsoft Online

Storage – Data storage or cloud based NAS such as CTERA, iDisk, CloudNAS

Development – Software development platforms used to build custom cloud based applications (PAAS & SAAS) such as SalesForce

Platform – Cloud based platforms, typically provided using virtualization, such as Amazon ECC, Sun Grid

Hosting – Physical data centers such as those run by IBM, HP, NaviSite, etc.


16

BasicCloudCharacteristics• The“no-need-to-know”intermsoftheunderlyingdetailsofinfrastructure,applicationsinterfacewiththeinfrastructureviatheAPIs.

• The“flexibilityandelasticity”allowsthesesystemstoscaleupanddownatwill– utilisingtheresourcesofallkinds

• CPU,storage,servercapacity,loadbalancing,anddatabases

• The“payasmuchasusedandneeded”typeofutilitycomputingandthe“alwayson!,anywhereandanyplace”typeofnetwork-basedcomputing.


17

BasicCloudCharacteristics

• Cloudaretransparenttousersandapplications,theycanbebuiltinmultipleways– brandedproducts,proprietaryopensource,hardwareorsoftware,orjustoff-the-shelfPCs.

• Ingeneral,theyarebuiltonclustersofPCserversandoff-the-shelfcomponentsplusOpenSourcesoftwarecombinedwithin-houseapplicationsand/orsystemsoftware.


18

SoftwareasaService(SaaS)• SaaSisamodelofsoftwaredeploymentwhereanapplicationishostedasaserviceprovidedtocustomersacrosstheInternet.

• Saasalleviatestheburdenofsoftwaremaintenance/support– butusersrelinquishcontroloversoftwareversionsandrequirements.

• Termsthatareusedinthissphereinclude– PlatformasaService(PaaS)and– InfrastructureasaService(IaaS)


19

Virtualization• Virtualworkspaces:

– Anabstractionofanexecutionenvironmentthatcanbemadedynamicallyavailabletoauthorizedclientsbyusingwell-definedprotocols,

– Resourcequota(e.g.CPU,memoryshare),– Softwareconfiguration(e.g.O/S,providedservices).

• ImplementonVirtualMachines(VMs):– Abstractionofaphysicalhostmachine,– HypervisorinterceptsandemulatesinstructionsfromVMs,andallows

managementofVMs,– VMWare,Xen,etc.

• ProvideinfrastructureAPI:– Plug-instohardware/supportstructures Hardware

OS

App App App

Hypervisor

OS OS

Virtualized Stack1925/06/18 CMA. TCA Srinivasa Prasad

20

VirtualMachines

• VMtechnologyallowsmultiplevirtualmachinestorunonasinglephysicalmachine.

Hardware

Virtual Machine Monitor (VMM) / Hypervisor

Guest OS(Linux)

Guest OS(NetBSD)

Guest OS(Windows)

VM VM VM

AppApp AppAppAppXen

VMWare

UML

Denalietc.

Performance: Para-virtualization (e.g. Xen) is very close to raw physical performance!


21

VirtualizationinGeneral• Advantagesofvirtualmachines:

– Runoperatingsystemswherethephysicalhardwareisunavailable,

– Easiertocreatenewmachines,backupmachines,etc.,– Softwaretestingusing“clean”installsofoperatingsystemsandsoftware,

– Emulatemoremachinesthanarephysicallyavailable,– Timesharelightlyloadedsystemsononehost,– Debugproblems(suspendandresumetheproblemmachine),– Easymigrationofvirtualmachines(shutdownneededornot).– Runlegacysystems!


22

Whatisthepurposeandbenefits?

• Cloudcomputingenablescompaniesandapplications,whicharesysteminfrastructuredependent,tobeinfrastructure-less.

• ByusingtheCloudinfrastructureon“payasusedandondemand”,allofuscansaveincapitalandoperationalinvestment!

• Clientscan:– PuttheirdataontheplatforminsteadofontheirowndesktopPCsand/orontheirownservers.

– Theycanputtheirapplicationsonthecloudandusetheserverswithinthecloudtodoprocessinganddatamanipulationsetc.


23

Cloud-Sourcing• WhyisitbecomingaBigDeal:

– Usinghigh-scale/low-costproviders,– Anytime/placeaccessviawebbrowser,– Rapidscalability;incrementalcostandloadsharing,– CanforgetneedtofocusonlocalIT.

• Concerns:– Performance,reliability,andSLAs,– Controlofdata,andserviceparameters,– Applicationfeaturesandchoices,– InteractionbetweenCloudproviders,– NostandardAPI– mixofSOAPandREST!– Privacy,security,compliance,trust…


24

SomeCommercialCloudOfferings


25

CloudTaxonomy


26

CloudStorage• SeverallargeWebcompaniesarenowexploitingthefactthattheyhavedatastoragecapacitythatcanbehiredouttoothers.– allowsdatastoredremotelytobetemporarilycachedondesktopcomputers,mobilephonesorotherInternet-linkeddevices.

• Amazon’sElasticComputeCloud(EC2)andSimpleStorageSolution(S3)arewellknownexamples– MechanicalTurk


27

AmazonSimpleStorageService(S3)

• UnlimitedStorage.• Payforwhatyouuse:

– $0.20perGByteofdatatransferred,– $0.15perGByte-Monthforstorageused,– SecondLifeUpdate:

• 1TBytes,40,000downloadsin24hours- $200,


28

UtilityComputing– EC2• AmazonElasticComputeCloud(EC2):

– Elastic,marshal1to100+PCsviaWS,– MachineSpecs…,– Fairlycheap!

• PoweredbyXen– aVirtualMachine:– DifferentfromVmwareandVPCasuses“para-virtualization”where

theguestOSismodifiedtousespecialhyper-calls:– HardwarecontributionsbyIntel(VT-x/Vanderpool)andAMD(AMD-V).– Supports“LiveMigration”ofavirtualmachinebetweenhosts.

• Linux,Windows,OpenSolaris• ManagementConsole/AP


29

EC2– TheBasics

• LoadyourimageontoS3andregisterit.• BootyourimagefromtheWebService.• Openuprequiredportsforyourimage.• ConnecttoyourimagethroughSSH.• Executeyouapplication…


30

OpportunitiesandChallenges• Theuseofthecloudprovidesanumberofopportunities:– Itenablesservicestobeusedwithoutanyunderstandingoftheirinfrastructure.

– Cloudcomputingworksusingeconomiesofscale:• Itpotentiallylowerstheoutlayexpenseforstartupcompanies,astheywouldnolongerneedtobuytheirownsoftwareorservers.

• Costwouldbebyon-demandpricing.• VendorsandServiceprovidersclaimcostsbyestablishinganongoingrevenuestream.

– Dataandservicesarestoredremotelybutaccessiblefrom“anywhere”.


31

OpportunitiesandChallenges• Inparalleltherehasbeenbacklashagainstcloudcomputing:

– Useofcloudcomputingmeansdependenceonothersandthatcouldpossiblylimitflexibilityandinnovation:

• TheothersarelikelybecomethebiggerInternetcompanieslikeGoogleandIBM,whomaymonopolisethemarket.

• SomearguethatthisuseofsupercomputersisareturntothetimeofmainframecomputingthatthePCwasareactionagainst.

– Securitycouldprovetobeabigissue:• Itisstillunclearhowsafeout-sourceddataisandwhenusingtheseservicesownershipofdataisnotalwaysclear.

– Therearealsoissuesrelatingtopolicyandaccess:• Ifyourdataisstoredabroadwhosepolicydoyouadhereto?• Whathappensiftheremoteservergoesdown?• Howwillyouthenaccessfiles?• Therehavebeencasesofusersbeinglockedoutofaccountsandlosingaccesstodata.


32

AdvantagesofCloudComputing

• Lowercomputercosts:– Youdonotneedahigh-poweredandhigh-pricedcomputertoruncloudcomputing'sweb-basedapplications.

– Sinceapplicationsruninthecloud,notonthedesktopPC,yourdesktopPCdoesnotneedtheprocessingpowerorharddiskspacedemandedbytraditionaldesktopsoftware.

– Whenyouareusingweb-basedapplications,yourPCcanbelessexpensive,withasmallerharddisk,lessmemory,moreefficientprocessor...

– Infact,yourPCinthisscenariodoesnotevenneedaCDorDVDdrive,asnosoftwareprogramshavetobeloadedandnodocumentfilesneedtobesaved.


33


• Improvedperformance:– Withfewlargeprogramshoggingyourcomputer'smemory,youwillseebetterperformancefromyourPC.

– Computersinacloudcomputingsystembootandrunfasterbecausetheyhavefewerprogramsandprocessesloadedintomemory…

• Reducedsoftwarecosts:– Insteadofpurchasingexpensivesoftwareapplications,youcangetmostofwhatyouneedforfree-ish!

• mostcloudcomputingapplicationstoday,suchastheGoogleDocssuite.

– betterthanpayingforsimilarcommercialsoftware• whichalonemaybejustificationforswitchingtocloudapplications.


34


• Instantsoftwareupdates:– Anotheradvantagetocloudcomputingisthatyouarenolongerfaced

withchoosingbetweenobsoletesoftwareandhighupgradecosts.– Whentheapplicationisweb-based,updateshappenautomatically

• availablethenexttimeyoulogintothecloud.

– Whenyouaccessaweb-basedapplication,yougetthelatestversion• withoutneedingtopayforordownloadanupgrade.

• Improveddocumentformatcompatibility.– Youdonothavetoworryaboutthedocumentsyoucreateonyour

machinebeingcompatiblewithotherusers'applicationsorOSes– Therearepotentiallynoformatincompatibilitieswheneveryoneis

sharingdocumentsandapplicationsinthecloud.


35

AdvantagesofCloudComputing• Unlimitedstoragecapacity:

– Cloudcomputingoffersvirtuallylimitlessstorage.– Yourcomputer'scurrent1Tbyte harddriveissmallcomparedtothehundredsofPbytes availableinthecloud.

• Increaseddatareliability:– Unlikedesktopcomputing,inwhichifaharddiskcrashesanddestroyallyourvaluabledata,acomputercrashinginthecloudshouldnotaffectthestorageofyourdata.

• ifyourpersonalcomputercrashes,allyourdataisstilloutthereinthecloud,stillaccessible

– InaworldwherefewindividualdesktopPCusersbackuptheirdataonaregularbasis,cloudcomputingisadata-safecomputingplatform!


36


• Universaldocumentaccess:– Thatisnotaproblemwithcloudcomputing,becauseyoudonottakeyourdocumentswithyou.

– Instead,theystayinthecloud,andyoucanaccessthemwheneveryouhaveacomputerandanInternetconnection

– Documentsareinstantlyavailablefromwhereveryouare

• Latestversionavailability:– Whenyoueditadocumentathome,thateditedversioniswhatyouseewhenyouaccessthedocumentatwork.

– Thecloudalwayshoststhelatestversionofyourdocuments• aslongasyouareconnected,youarenotindangerofhavinganoutdatedversion


37


• Easiergroupcollaboration:– Sharingdocumentsleadsdirectlytobettercollaboration.– Manyusersdothisasitisanimportantadvantagesofcloudcomputing

• multipleuserscancollaborateeasilyondocumentsandprojects

• Deviceindependence.– Youarenolongertetheredtoasinglecomputerornetwork.– Changestocomputers,applicationsanddocumentsfollowyouthroughthecloud.

– Movetoaportabledevice,andyourapplicationsanddocumentsarestillavailable.


38

DisadvantagesofCloudComputing

• RequiresaconstantInternetconnection:– CloudcomputingisimpossibleifyoucannotconnecttotheInternet.

– SinceyouusetheInternettoconnecttobothyourapplicationsanddocuments,ifyoudonothaveanInternetconnectionyoucannotaccessanything,evenyourowndocuments.

– AdeadInternetconnectionmeansnoworkandinareaswhereInternetconnectionsarefeworinherentlyunreliable,thiscouldbeadeal-breaker.


39


• Doesnotworkwellwithlow-speedconnections:– Similarly,alow-speedInternetconnection,suchasthatfoundwithdial-upservices,makescloudcomputingpainfulatbestandoftenimpossible.

– Web-basedapplicationsrequirealotofbandwidthtodownload,asdolargedocuments.

• Featuresmightbelimited:– Thissituationisboundtochange,buttodaymanyweb-basedapplicationssimplyarenotasfull-featuredastheirdesktop-basedapplications.

• Forexample,youcandoalotmorewithMicrosoftPowerPointthanwithGooglePresentation'sweb-basedoffering


40


• Canbeslow:– Evenwithafastconnection,web-basedapplicationscansometimesbeslowerthanaccessingasimilarsoftwareprogramonyourdesktopPC.

– Everythingabouttheprogram,fromtheinterfacetothecurrentdocument,hastobesentbackandforthfromyourcomputertothecomputersinthecloud.

– Ifthecloudservershappentobebackedupatthatmoment,oriftheInternetishavingaslowday,youwouldnotgettheinstantaneousaccessyoumightexpectfromdesktopapplications.


41


• Storeddatamightnotbesecure:– Withcloudcomputing,allyourdataisstoredonthecloud.

• ThequestionsisHowsecureisthecloud?

– Canunauthorisedusersgainaccesstoyourconfidentialdata?

• Storeddatacanbelost:– Theoretically,datastoredinthecloudissafe,replicatedacrossmultiplemachines.

– Butontheoffchancethatyourdatagoesmissing,youhavenophysicalorlocalbackup.

• Putsimply,relyingonthecloudputsyouatriskifthecloudletsyoudown.


42


• HPCSystems:– Notclearthatyoucanruncompute-intensiveHPCapplicationsthatuseMPI/OpenMP!

– Schedulingisimportantwiththistypeofapplication• asyouwantalltheVMtobeco-locatedtominimizecommunicationlatency!

• GeneralConcerns:– EachcloudsystemsusesdifferentprotocolsanddifferentAPIs

• maynotbepossibletorunapplicationsbetweencloudbasedsystems

– AmazonhascreateditsownDBsystem(notSQL92),andworkflowsystem(manypopularworkflowsystemsoutthere)

• soyournormalapplicationswillhavetobeadaptedtoexecuteontheseplatforms.


43

TheFuture• Manyoftheactivitieslooselygroupedtogetherundercloud

computinghavealreadybeenhappeningandcentralisedcomputingactivityisnotanewphenomena

• GridComputingwasthelastresearch-ledcentralisedapproach

• Howeverthereareconcernsthatthemainstreamadoptionofcloudcomputingcouldcausemanyproblemsforusers

• Manynewopensourcesystemsappearingthatyoucaninstallandrunonyourlocalcluster– shouldbeabletorunavarietyofapplicationsonthesesystems


44



CMA. TCA Srinivasa Prasad €¦ · –Debug problems (suspend and resume the problem machine),...

Documents

Transcript of CMA. TCA Srinivasa Prasad €¦ · –Debug problems (suspend and resume the problem machine),...