Monitoring and Troubleshooting Docker Across Cloud and On-prem ...
Transcript of Monitoring and Troubleshooting Docker Across Cloud and On-prem ...
![Page 1: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/1.jpg)
Copyright©2016Splunk Inc.
MarcChénéITMarketsProductManager,Splunk
DenisGladkikhPrincipalDevEngineer(akaoutcoldman),Splunk
MonitoringandTroubleshootingDockerAcrossCloudandOn-prem Environments
![Page 2: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/2.jpg)
Whoweare?MarcChéné– Engineer,ITMarketsProductManager,APMer– Dadto3,super-fanandcoach– Loverofskiing,golfing,musicandgooddrink– Residentgroundskeeper/gardener– Twitter:@marccheneDenisGladkikh– Systemprogrammingdeveloper - building
Enterpriseapplications,MobileApps,DevToolsand scalablesystems
– Opensourcecontributor(VSCode, Docker,cAdvisor,antigen,MongoCDriver andmore...).
– Skydiver,Scuba diver,Downhill/nordic skier,hiker, GSDowner
– Twitter:@outcoldman
![Page 3: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/3.jpg)
Disclaimer
3
Duringthecourseofthispresentation,wemaymakeforwardlookingstatementsregardingfutureeventsortheexpectedperformanceofthecompany.Wecautionyouthatsuchstatementsreflectourcurrentexpectationsandestimatesbasedonfactorscurrentlyknowntousandthatactualeventsorresultscoulddiffermaterially.Forimportantfactorsthatmaycauseactualresultstodifferfromthose
containedinourforward-lookingstatements,pleasereviewourfilingswiththeSEC.Theforward-lookingstatementsmadeinthethispresentationarebeingmadeasofthetimeanddateofitslivepresentation.Ifreviewedafteritslivepresentation,thispresentationmaynotcontaincurrentoraccurateinformation.Wedonotassumeanyobligationtoupdateanyforwardlookingstatementswemaymake.Inaddition,anyinformationaboutourroadmapoutlinesourgeneralproductdirectionandissubjecttochangeatanytimewithoutnotice.Itisforinformationalpurposesonlyandshallnot,beincorporatedintoanycontractorothercommitment.Splunkundertakesnoobligationeithertodevelopthefeaturesor
functionalitydescribedortoincludeanysuchfeatureorfunctionalityinafuturerelease.
![Page 4: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/4.jpg)
Agenda Agenda
WhatisDocker?HowtoMonitorContainers?Splunk AnalyticsforDockerMonitoringyourCloudContainers
![Page 5: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/5.jpg)
First,abitaboutcontainers…
![Page 6: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/6.jpg)
Docker,inoneSlide
6
Build- Ship- Runyourapplications– ”Infrastructureascode”– Enablesmicroservices architectures– Portable– EnablesCloudMigration
OpenSourceandCommunityMinded– DockerEngineisOpenSource– Thousandsofappscanbe“pulled”in
DockerHub/DockerStore– YourdevelopersLOVEDocker
![Page 7: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/7.jpg)
Docker– It’snotVirtualization
7
VMs– focusonOSDocker– focusonapplicationsDocker– lightweightandFASTNOTmutuallyexclusivewithVMs
![Page 8: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/8.jpg)
Docker– it’sabigdeal
8
OpenSourcedrivenecosystem
Massiveincreaseinadoption…
…Butthegrowthisjustgettingstarted
![Page 9: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/9.jpg)
3PrimaryContainerUseCases
ApplicationModernization
DevOps – NewApps
CloudMigration
9
![Page 10: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/10.jpg)
![Page 11: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/11.jpg)
DockerAddressesCustomerPainPoints
11
StandardizationbetweendevandproductionenvironmentsLessefforttoputintoreleasemanagement=fasterdevelopment
“Butitworkedindev...”
![Page 12: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/12.jpg)
DockerCreatesNewMonitoringChallenges
12
NewlayersofabstractionContainershaveShortlifespansYoustillhavedependenciesonotherlevelsofthestackNewconsumersofmonitoringdata
Containermonitoringandtroubleshootingneedstobeeasy,focusedonanalytics,andrelatedwithotherpartsofyourinfrastructure
![Page 13: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/13.jpg)
HowtoMonitorContainers?- GettingDataIn(GDI)
13
![Page 14: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/14.jpg)
Splunk LogStreamingOptionsforDockerDockerNativeLogging– Splunkloggingdriver,Syslog,AWS,JSONfiles,etc.
Logginglibraries in.NET,Javaandnode.js
Custom(e.g.,KafkawithHTTPEventCollector)
UniversalForwarder– AppLogs,Syslogforwarding,Performance,etc.
Cloud– AWS,GCP,Azure
Usetheoptionthatisrightforyou!
![Page 15: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/15.jpg)
VisibilitytoyourContainerEnvironments
Secure—supportsTLS/SSLandtokensSimple– config-basedsetupandcollectdataScale– BasedonHTTPDataCollectorBasedonSplunk HTTPConfigurable- Supportscontainerlabels,environmentvariables
SplunkLoggingDriverforDocker
BasedonSplunkHTTPEventCollector+DriverbuiltdirectlyintoDocker
![Page 16: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/16.jpg)
VisibilityintoyourContainerEnvironmentsSkipverificationforthevalidsplunk urlRawdatacollectionfromthenativelogdriverEmbeddedjson formatsupport
SplunkLoggingDriverforDocker(comingsoondocker 1.13)
![Page 17: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/17.jpg)
VisibilitytoyourContainerEnvironmentsLogs– AccesstoApplogs,syslogUDPforwarding,JournalDStats– DatafromDockercontainersSearch– TroubleshootDockerrelatedproblemsDashboardsandAlerts-ProactivelymonitorDockerenvironments
AddingUniversalForwarderstoyourDockerEnvironments
ManywaystogetDocker-basedmachinedata– choosewhat’sbestforyou
![Page 18: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/18.jpg)
Splunk Analytics
- Splunk Images- It’sTimeforAnalytics
18
![Page 19: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/19.jpg)
DeliveringSplunkasaContainerImage
19
Splunk containerimages– Splunk Enterprise6.4.1– Splunk UniversalForwarder6.4.1IncludesconfigurationandDockerAdd-Onforcontainermonitoringout-of-the-boxCertifiedimageComingsoontotheDockerStore(http://store.docker.com)
docker run splunk/enterprise:6.4.1-monitordocker run splunk/universalforwarder:6.4.1-monitor
![Page 20: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/20.jpg)
DemoSetup
20
Usecase:ContainerLogAnalysisandMonitoring“fullstack”applicationwith4containersmonitoredwithSplunk– MariaDB – ouropensourcedatabaselayer– Wordpress -- aratherbusyapplication– My_app – ourmade-upapp– Splunk – yes,we’rerunningSplunk INACONTAINER!Keytakeaways– Time-to-value– Splunk ispre-configuredtodiscoverandcollectmachinefromall
yourcontainersrunningonanode– Insightacrosslogsandmetrics– Insightintocontainers,applications,compliance,andthedatathoseapplications
generate– Docker– upandrunningfast!
![Page 21: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/21.jpg)
DemoTime!
- GettingDataIn(GDI)- Splunk LoggingDriver- Analytics
21
![Page 22: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/22.jpg)
MonitoringyourCloudContainers
22
![Page 23: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/23.jpg)
MonitoringforYourCloudEnvironments
23
AmazonWebServiceintegrationviaCloudWatch andElasticContainerService(ECS)GoogleCloudPlatformintegrationviaStackdriver Pub/SubandcloudmonitoringAPIs
![Page 24: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/24.jpg)
SampleDockerCloudData
![Page 25: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/25.jpg)
VisibilitytoyourContainerEnvironmentsSplunkAdd-OnforDockerUniversalControlPlane
MonitorChanges– Identifychangesincontainers,updatestocontainerdeploymentsUsageInsight– Insightintocontainers,clusters,andnodesAnalyzeandCorrelate– Changes,usage,errorsandconfiguration
ImproveDockercontainercompliance,availabilityandperformance
![Page 26: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/26.jpg)
# 1. Come visit us at our boothdocker run splunk/visitourboothvisitourbooth_1 | Booth IT Markets
# 2. Test out our Splunk logging driverdocker run --name wordpress --label web=wordpress \--log-driver=splunk \--log-opt splunk-token=00000000-0000-0000-0000-000000000000 \--log-opt splunk-url=https://192.168.99.100:8088 \--log-opt labels=web --log-opt tag="{{.Name}}" \--publish 80:80 \-d wordpress
CalltoAction…
![Page 27: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/27.jpg)
# 3. Try out our docker images in Docker Storedocker run splunk/enterprise:6.4.1-monitordocker run splunk/universalforwarder:6.4.1-monitor
# 4. Demos will all be available on GitHub under Splunk!git clone https://github.com/splunk/docker-gettingstarted-conf2016.git
# 5. Visit our site to learn more about containerscurl http://www.splunk.com/containers
CalltoAction…
![Page 28: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/28.jpg)
WhatNow?
28
HowtorunSplunk asaDockerImage?SessionID:SF88089
Relatedbreakoutsessionsandactivities…
![Page 29: Monitoring and Troubleshooting Docker Across Cloud and On-prem ...](https://reader031.fdocuments.net/reader031/viewer/2022030323/58a1a8071a28abd8728bf3bc/html5/thumbnails/29.jpg)
THANKYOU