devOps - Katedra počítačov a informatiky the visual evidence and full ... § Delphix (Database...

DevOps

Operate Develop/Test

Deploy

Plan

DevOpsContinuous Feedback

[email protected]

§Introduction§ContinuousBusinessPlanning§CollaborativeDevelopment§ContinuousTesting§ContinuousReleaseandDeployment§ContinuousMonitoring§ContinuousCustomerFeedbackandOptimization§DevOpsinBlueMix

IssueswithtraditionalsoftwaredeliverymethodsBusinessesarechallengedtomeettimepressureswithqualitysoftware.

TypicalSoftwareDeliveryPainPoints:

*Forrester/IBMStudy:ANewViewofIBM’sOpportunityforIntegratedOptimizedSystemsAddress,2011**Forrester“FiveWaysToStreamlineReleaseManagement”,2011

experiencedelaysareduetoconfigurationanddeployment.

41%ofallnewITprojectsare

deliveredlate.

34%applicationsarerolledbackduetoqualityissuesescapinginto

production.

51%

GAPGAPGAPGAP

Business Owners CustomersIT OperationsDevelopment

& TestLine of

Business

Ittakes4– 6weeks tocompleteasmallrelease.

Forcesofchange

Mobileandsocialarechangingcustomerexpectations.

FocusofITischangingfrom“systemsofrecord”to“systemofengagement”.

CloudandtechnologyisblurringthetraditionalrolesbetweentheDevandOpsteams.

Acceleratessoftwaredelivery–

forfastertimetovalue

Balancesspeed,cost,quality,andrisk–

forincreasedcapacitytoinnovate

Reducestimeforcustomerfeedback–

forimprovedcustomerexperience

ContinuousCustomer

FeedbackandOptimization

CollaborativeDevelopmentandContinuousIntegration

ContinuousReleaseandDeployment

ContinuousMonitoring

ContinuousBusinessPlanning

ContinuousTesting


Deploy

Steer

DevOpsContinuousFeedback

People Process

Technology

Continuouslyplan,measure,andintegratebusinessstrategyandcustomerfeedbackintothedevelopmentlifecycle

Enablecollaborationbetweenbusiness,development,andQAtodeliverinnovativeandqualitysoftwarecontinuously

Reducethecostoftestingwhilehelpingdevelopmentteamsbalancequalityandspeed

Deliversoftwaretocustomersandinternalusersfasterandmorefrequentlywithbetterquality,lowercosts,andreducedrisk

Understandandaccommodatetheuserperspectivetoachieveservicelevelswithbettervisibilityandcontinuousfeedbackacrosstheentiresoftwarelifecycle


CollaborativeDevelopment

ContinuousTesting



ContinuousCustomerFeedbackandOptimization

Providethevisualevidenceandfullcontextforanalyzingcustomerbehaviorandpinpointingpainpoints

Steer Develop/Test Deploy Operate

§ Agileplanningandtracking§ Applicationauto-scaling§ AppScanmobileanalyzer§ Continuousdeliverypipeline§ Githosting

§ Mobileapplicationsecurity§ Mobiledata§ Mobilequalityassurance§ Monitorandanalytics§ Push

§ RapidApps(beta)§ Server-sidecode§ WebIDE

BluemixDevOpsServices

Continuousbusinessplanning

Tooling Process

Outcome

§ Helpscontinuouslyplanbusinessneeds§ Integratescustomerfeedbackwith business

strategy§ Alignscustomerfeedbackintothedevelopment

lifecycle§ Focuseson“doingtherightthings”§ Focusesonbusinessneedsthataddthemost

value

DevOpseco-system

Focusedonbusinessplanning

Continuoussteering





ContinuousTesting


Deploy

Steer




Deploy

Steer


ContinuousUserFeedbackandOptimization

Helpsorganizationsfocusonactivitieswheretheywillgainmostvalue:

§ Attacksthehighvalueandhighriskitemsfirst

§ Predictsandquantifiestheoutcomesandresources

§ Measureshonestlywithdistributionsofoutcomes

§ Learningwhatcustomersreallywantandsteerwithagility







§ RationalTeamConcert§ RationalDOORSNext

Generation§ CLMaaS§ JIRA§ Kanboard.net


Deploy

Steer

DevOpsContinuousinnovation,

feedback,andimprovements

LegendIBMSoftwareProduct/OfferingOpenSource/ThirdParty

ContinuousTesting

Collaborativedevelopment

§ Bringstogethercustomerandteamstakeholderstowardsapartneredgoal

§ Workswithinatime-boxedscope§ Focusesondeliveringatangibleand

functionalbusinessoutcome

Focusedonacceleratedoutcomes

Tooling Process

Outcome

DevOpseco-system

Continuousintegration

§ Thisreferstothebestpracticeofintegratingcodeoftheentireteamregularlytoverifythatitworkswelltogether.

§ Eachdeveloperintegratesdaily,whichleadstomultipleintegrationsperday.

§ Integrationsareverifiedbyautomatedbuildsthatrunregressionteststodetectintegrationerrorsasquicklyaspossible.

§ Smallincrementalfrequentbuildshelpwithearlyerrordetectionandlessrework.

§ Continuousintegrationisthebestpracticeforsuccessfulglobalcollaborativedevelopment.

Focusedonerrorfreeoutcomes

Tooling Process

Outcome

DevOpseco-system

Collaborativedevelopmentandcontinuousintegration







Deploy

Steer



ContinuousTesting

§ RationalCollaborationLifecycleManagement

§ RationalLifecycleIntegrationAdapter

§ RationalDeveloperforSystemZ§ IBMWorklightStudio§ IBMUrbanCodeBuild§ Git§ Jenkins§ Gerrit§ Bugzilla


CollaborativeDevelopment:Usecase

ConnectedCarSolutionwanttoexposebillingsystemfunctionstocustomers.

Theissue:Dataisspreadacrossmultiplelegacyapps.Moreover,peaksellingseasoncomingup.

14

InitialUseCasesandWireFramesandDeign

ClientIBM

ProposesCollaborativeDevelopmentsolution:UseAPIstocapturelegacybillingsystemappdata,createwebUIandmobileUItomakedataaccessible,andthen,hostitonsecureIBMCloud.

Collaborativeconfiguration

Agreedtiming

AgreedOutcomes

andRates

Base

Specialty

Collaborativedevelopmentteam

AgreedOutcomes

APIlinksandMobileAppPrototypes

APIlinksandMobileAppsolution

ExtratimepurchasedforWeb/Mobiletesting

AgreedOutcomes

AgreedOutcomes

Accepted Paid Accepted PaidAccepted Paid

Deliverqualitycustomerexperienceswithspeed!

2

3

4

5

6

Theneedforcontinuoustesting

TestingLabor TestLabComplexity

HeterogeneousEnvironments

PublicCloudPrivateCloud

DataWarehouse Mainframe EnterpriseServiceBus

DirectoryIdentity

FileSystems

CollaborationWeb/Internet

RoutingService

Third-partyServices Portals

ContentProviders EJB

SharedServicesArchives

BusinessPartners

MessagingServices

TraditionalTesting

Othercosts

Testingcosts

Manualhandoffs

GAP

SoftwareDevelopment

Manualhandoffs

GAP

OperationsTestLine ofBusiness

Pooralignment

GAP

ofcustomersexperienceproduction

delays.

>45 %todelivervalidatedtest

environments.

~2-8weeks

oflargeorganizationsspendapproximately25%–30%ofprojectbudgetontesting.

>60 % Manualhandoffs

GAP

SoftwareDevelopment

Manualhandoffs

GAP

OperationsTestLine ofBusiness

Pooralignment

GAP

DevelopmentVelocity

Continuoustesting

!

IMPACT

CAUSE

SOLUTION

§ Testdelaysanddisruptions§ Higherriskofcomponentfailure§ Manual,inefficient,andinaccurate§ MoreunplannedITwork

§ Manualprovisionoftestenvironments§ Manualgapsbetweenautomatedprocesses§ Manualinstallation/configuration§ Manualtestsetup(backendproviders,datasetup,and

resourcedependency)

?AutomatedIntegrationTesting

ServiceVirtualization

DeploymentAutomation ContinuousTesting

Continuoustesting







Deploy

Steer



ContinuousTesting

§ HATc§ IntegrationwithRTC§ Greenhat§ Delphix(Database

Virtualization)§ Selenium§ JUnit§ Cucumber


ContinuousReleaseandDeployment:Continuousdelivery

§ Thisreferstothebestpracticeofdeployingcoderapidlyandsafelyintoproduction-likeenvironments.

§ Deploymentskickoffautomatedteststoensurecomponentsperformbusinessfunctionsasexpected.

§ Everychangeisautomaticallydeployedtostaging.

§ Deploymentsareon-demandandselfservice.§ Applicationscanbedeployedintoproduction

withapushofabutton,whenbusinessisready.

Focusedonrapidandautomateddelivery

Tooling Process

Outcome

DevOpseco-system

Continuousreleaseanddeployment

IMPACT

CAUSE

SOLUTION

§ Delayedenvironmentsdelivery…§ Delayedturnaroundfromdevtotest…andback…

§ Manual,inefficient,inaccurate,andlong

§ Highlevelofre-workanderrors§ Costsincreased§ MoreunplannedITwork

§ Manualenvironmentsplanning/delivery§ Manualprovisionofdevenvironments§ Manualinstallation/configurationofbadly-documentedOS/MW/APPS§ Manualintegration(backendproviders,datasetupandresourcedependency)

?

Middleware

Security Compliance Backup and Recovery

Infrastructure

Private

Application / Database

Hybrid

IBM UrbanCodeDeploy

I

ProductionContinuous Integration

Storage

Continuous Delivery

Continuous Deploy

Continuousreleaseanddeployment







Deploy

Steer



ContinuousTesting

§ IBMUrbanCodeDeploywithPatterns

§ IBMUrbanCodeRelease

§ Chef§ Puppet§ Juju§ Docker§ Ansible


Continuouscustomerfeedbackandoptimization

§ EfficientDevOpsallowsfasterfeedback.§ Continuouscustomerfeedbackandoptimization

providesvisualevidenceandfullcontexttoanalyzecustomerbehavior,pinpointcustomerstruggles,andunderstandcustomerexperiences usingwebormobileapplications.

§ Experimentation,learningthroughfirst-handclientexperiences,andcontinuousfeedbackarecriticaltobeingsuccessfulinthisnewworld.

§ Deliveringaminimalviableproduct,learning,andpivotinginaresponsivewaywillchallengethestatusquo.

§ Instrumentedfeedbackalongwithsponsorusersconnectedintocrossfunctionalfeatureteamscanbeanincrediblecombination.

§ Evolveinadisruptiveyethealthywaythatenablestheteamtoinnovatewhileremainingconnectedwiththesystemofrecordteamwherethedataandtransactionslive.

Focusedonlearningandfinetuning

Tooling Process

Outcome

DevOpseco-system


Focusonuserengagementandfeedback

Needforrapidresponse

Organizationsarechallengedtoapplynewapproachestoassessingthequalityoftheirmobileapps.

Wemustbemuchmoreefficientandeffectiveinourtestingandassessmentofmobileappquality.








Deploy

Steer



ContinuousTesting§ TealeafCustomerBehavior

AnalysisSuite§ IBMDigitalAnalytics§ MobileFirstQuality

Assurance§ OpenWebAnalytics(OWA)§ Webalizer§ W3Perl


Continuousmonitoring§ Continuousmonitoringoffersenterprise-

class,easy-to-usereportingthathelpsdevelopersandtestersunderstandtheperformanceandavailabilityoftheirapplication,evenbeforeitisdeployedtoproduction.

§ Inproduction,theoperationsteammanagesandensuresthattheapplicationisperformingasdesiredandtheenvironmentisstableviacontinuousmonitoring.

§ Thresholdscanbesetforwhatisconsidered“optimal.”

§ Anyuntowardincidenttriggersanautomaticalertand/orremediation

§ Monitoringlogsareusedforoperationalanalytics.

Focusedonoperationalefficiency

Tooling Process

Outcome

DevOpseco-system

Continuousmonitoring







Deploy

Steer



ContinuousTesting

§ SmartCloudApplicationPerformanceManagement(APM)

§ IBMServiceEngage§ Nagios§ Nmon§ Cacti§ Logtash§ Fluentd


Withapplicationperformancemanagement….

8:02am AffectedapplicationserverDBisfull.

8:02am Applicationserverisbroughtdown,DBextended,andproblemresolved.

8:00amAllcriticalapplicationsaremonitoredwithintheDevOpsdashboard.

8:03amL2/L3teamsimplementautoextendparametersinapplicationprocedurestopreventproblemfromreoccurring.

8:01amApplicationincriticalstatus.Widgetallowsdrill-downtoidentifytheroot-cause.

§ Drilldownindicatesthatthe“OnlineCatalog”applicationishavingprobleminthe“Transactions”areaand“Components”area.

§ Drill-downto“Transactions”areaindicatesthatthereisaproblemwith“EndUserTransactions.”Specifically,theproblemiswith“create_account,”“search_books,”and“check_out”operations.“Create_account”operationseemstobefailingalways(100%),“search_books”33%ofthetime.

§ Furtherdrilldownindicatesthatthe“create_account”operationisrealizedbyanapplicationhostedonserverwithIPAddress10.32.173.102andisrunningonportnumber80.Additionaltoolingisavailabletofurtherdrill-downandpin-pointtheproblem(includingloganalytics).

Bluemix andDevOps 1

2

3

4

devOps - Katedra počítačov a informatiky the visual evidence and full ... § Delphix (Database...

Documents

Transcript of devOps - Katedra počítačov a informatiky the visual evidence and full ... § Delphix (Database...