How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage
-
Upload
cloudcontroller -
Category
Technology
-
view
811 -
download
0
description
Transcript of How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage
![Page 2: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/2.jpg)
28,000,000+TOTAL USERS AROUND THE WORLD
Edmodo is the largest social learning network
in the world
![Page 3: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/3.jpg)
20M+ Registered Users
The Edmodo user base has grown REALLY FAST and so has our AWS usage.
Dec 09 Dec 12Dec 10 Dec 11
2,000,000
6,000,000
10,000,000
18,000,000
14,000,000
20M+ users
4.8M users
1.1M users225K users
Investors
• New Features
▸ Require new backend clusters
• More Employees
▸ Launch more development servers
• New Investors
▸ Want assurances we spend money wisely
![Page 4: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/4.jpg)
100’s of production, development, reporting and
operations instances are managed on Amazon Web Services Elastic Compute
Cloud.
20 employees across 5 teams can launch EC2 instances.
![Page 5: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/5.jpg)
We tried lots of slow, pricey, hosted apps.None had what we REALLY Needed …
![Page 6: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/6.jpg)
Real Time RI vs On-Demand UsageDo we have enough RI coverage? Are our RIs being used?
![Page 7: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/7.jpg)
Getting Usage Data In front of TeamsMaking Real Time Usage Data Visible Encourages Action
Problem:
The default Splunk for AWS App configuration is based on billing “subaccounts”, which Edmodo does not use.
Edmodo uses tags to differentiate between cost centers.
![Page 8: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/8.jpg)
Use These Tags: Product, Service, SpaceConfigurable Metadata Available for All AWS Resources
• Product
▸ designation is derived from the end user perspective. Where component resources serve overlapping Products, the Product designation is that which uses/requires a resource most or the resource's reason for existing.
• Service is the primary function of the resource. Examples are
▸ mysql
▸ apache
▸ active-directory
• Space a logical workplace designation. Examples are:
▸ Development
▸ Production
![Page 9: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/9.jpg)
Edit the Splunk For AWS Scripts for Tagsget_instances.py and get_ops.py
![Page 10: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/10.jpg)
Create Lookup Tables For The TagsSimple .csv files are referenced by dashboard view files
![Page 11: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/11.jpg)
Personalize Your Dashboard ViewsThe Dashboard XML format is easy to customize
![Page 12: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/12.jpg)
Drill Down Into Usage Data by TagsTeams Can Now Evaluate Usage For The Services They Manage
![Page 13: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/13.jpg)
Drill Down Into Usage Data by TagsTeams Can Now Evaluate Usage For The Services They Manage
![Page 14: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/14.jpg)
Drill Down Into Usage Data by TagsTeams Can Now Evaluate Usage For The Services They Manage
![Page 15: How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage](https://reader035.fdocuments.net/reader035/viewer/2022062616/54b5190c4a79591a608b4584/html5/thumbnails/15.jpg)
Download Tag Customizations
http://public.edim.com.s3.amazonaws.com/splunk-aws-app-for-tags.tgz