How Edmodo Uses Splunk App for AWS

Jack Murgia
NetOps Architect
jack@edmodo.com
Edmodo is the largest social learning network
in the world

28,000,000+
TOTAL USERS AROUND THE WORLD
The Edmodo user base has grown REALLY
FAST and so has our AWS usage.
• New Features
20M+ users

18,000,000

▸ Require new ...
100’s of
production, development, reporting
and operations instances are
managed on Amazon Web
Services Elastic Compute Cl...
We tried lots of slow, pricey, hosted apps.
None had what we REALLY Needed …
Real Time RI vs On-Demand Usage
Do we have enough RI coverage? Are our RIs being used?
Getting Usage Data In front of Teams
Making Real Time Usage Data Visible Encourages Action

Problem:
The default Splunk fo...
Use These Tags: Product, Service, Space
Configurable Metadata Available for All AWS Resources
• Product
▸ designation is d...
Edit the Splunk For AWS Scripts for Tags
get_instances.py and get_ops.py
Create Lookup Tables For The Tags
Simple .csv files are referenced by dashboard view files
Personalize Your Dashboard Views
The Dashboard XML format is easy to customize
Drill Down Into Usage Data by Tags
Teams Can Now Evaluate Usage For The Services They Manage
Drill Down Into Usage Data by Tags
Teams Can Now Evaluate Usage For The Services They Manage
Drill Down Into Usage Data by Tags
Teams Can Now Evaluate Usage For The Services They Manage
Download Tag Customizations

http://public.edim.com.s3.amazonaws.com/splunk-aws-app-for-tags.tgz
Upcoming SlideShare
Loading in …5
×

How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

1,273 views
1,113 views

Published on

Don't pay up to 10% of your monthly AWS bill to report on AWS charges and Instance usage with products like Cloudability and Cloudcheckr. Get a Splunk! free license and the free app Splunk App for AWS usage tracking (http://apps.splunk.com/app/1274/). This presentation from splunk > live! San Francisco 2013 shows how Edmodo stays on top of Reserved Instance usage and uses AWS resource tag-based reporting to help teams manage their AWS usage,

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,273
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
12
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • The power of Edmodo has now fuelled record-breaking growth It's no longer about bringing teachers into the 21st century, but how you can leverage the network effort. Up 240% in user sign-ups since last school year (Sept 2011 data)1 in 7 of all teachers use EdmodoIn 85% of top US school districts1 in 7 teacher calculation derivation:- Assume 80% of all 12M are US- 1:10 ratio of teachers to students- 7.2M teachers K-12 in US according to US 2010 Census
  • 95%of schools are connected to broadband600 K-12 Districts provide tablets to students55% of students access the Internet at home through mobile devices76% of teachers stream or download videos in classiPad sales in schools have doubled since last year
  • How Edmodo Uses Splunk For Real-Time Tag-Based Reporting of AWS Billing and Usage

    1. 1. How Edmodo Uses Splunk App for AWS Jack Murgia NetOps Architect jack@edmodo.com
    2. 2. Edmodo is the largest social learning network in the world 28,000,000+ TOTAL USERS AROUND THE WORLD
    3. 3. The Edmodo user base has grown REALLY FAST and so has our AWS usage. • New Features 20M+ users 18,000,000 ▸ Require new backend clusters • More Employees 14,000,000 ▸ Launch more development servers 20M+ Registered Users • New Investors ▸ Want assurances we spend money wisely 10,000,000 Investors 6,000,000 4.8M users 1.1M users 2,000,000 225K users Dec 09 Dec 10 Dec 11 Dec 12
    4. 4. 100’s of production, development, reporting and operations instances are managed on Amazon Web Services Elastic Compute Cloud. 20 employees across 5 teams can launch EC2 instances.
    5. 5. We tried lots of slow, pricey, hosted apps. None had what we REALLY Needed …
    6. 6. Real Time RI vs On-Demand Usage Do we have enough RI coverage? Are our RIs being used?
    7. 7. Getting Usage Data In front of Teams Making Real Time Usage Data Visible Encourages Action Problem: The default Splunk for AWS App configuration is based on billing “subaccounts”, which Edmodo does not use. Edmodo uses tags to differentiate between cost centers.
    8. 8. Use These Tags: Product, Service, Space Configurable Metadata Available for All AWS Resources • Product ▸ designation is derived from the end user perspective. Where component resources serve overlapping Products, the Product designation is that which uses/requires a resource most or the resource's reason for existing. • Service is the primary function of the resource. Examples are ▸ mysql ▸ apache ▸ active-directory • Space a logical workplace designation. Examples are: ▸ Development ▸ Production
    9. 9. Edit the Splunk For AWS Scripts for Tags get_instances.py and get_ops.py
    10. 10. Create Lookup Tables For The Tags Simple .csv files are referenced by dashboard view files
    11. 11. Personalize Your Dashboard Views The Dashboard XML format is easy to customize
    12. 12. Drill Down Into Usage Data by Tags Teams Can Now Evaluate Usage For The Services They Manage
    13. 13. Drill Down Into Usage Data by Tags Teams Can Now Evaluate Usage For The Services They Manage
    14. 14. Drill Down Into Usage Data by Tags Teams Can Now Evaluate Usage For The Services They Manage
    15. 15. Download Tag Customizations http://public.edim.com.s3.amazonaws.com/splunk-aws-app-for-tags.tgz

    ×