Customer Presentation Delivered by Rene Parra, HomeAway

1. Copyright © 2015 Splunk Inc.
Splunk
@ HomeAway
René X. Parra
Principal Architect

2. 2
Speaker Bio
Principal Architect – Cloud Engineering / Multi-Paas
Principal Architect – Big Data
Software Architect – CoreApi
Staff Engineer eBay Motors
– Served on Developer Council for eBay API
21+ years as a Java developer in Austin
MIT ’94, S.B. VI-III Computer Science and Electrical Engineering
Café Java, Taco Deli are some of my local favs – Keep Austin WIRED!
Texas Native, born in El Paso, TX

3. 3
The world’s leading marketplace
for Vacation Rentals
HomeAway

4. 4
Agenda
The Journey
Where we are today
Humble Beginnings
Splunk Growth / Adoption
High Volume AND Near-Realtime
Demo
Key TakeAways for your data journey

5. You are on a data journey

6. “Without data you are just another
person with an opinion”
Michael Connor
Sr. Platform Architect, Coca-Cola
William Edwards Deming
Engineer, 1900-1993

7. If you can log it,
you can analyze it!

8. HomeAway data!

9. 9
Machine Data Usage
 1 TB ingest/day
 9 indexers, 3 search heads (SHC)
1 Deployment Server, 1 Cluster Master
1 License Server, 1 search head deployer
1 Hunk Search Head, tens of hundreds forwarders
 ~175 searches/min
 ~6-9 unique concurrent users/min

10. 10
Machine Data Usage (continued)
 2 clusters
 Prod Cluster – 20 data nodes
 Using 220TB of 660TB total available
 2+TB / day ingest, 90 day retention raw,
aggregates have higher retention rates

11. Humble beginnings

12. 12
In the beginning…
• grep, sed, awk, perl, scripts
ruled the land
• Limited
• Manual
• Clunky
• Required arcane super sysadmin
commandline FU
Screenshot here

13. 13
… then there was Splunk
• Shorter debug sessions
• Increased Visibility
• Easier to diagnose
cause/effect

14. 14
… and all was very good
Log Aggregation

15. 15
Until…
Michael Wilde happened

16. Splunk Growth and Adoption

17. 17
Before
• Simple Log Aggregation
• “Needle in a Haystack”
• Event Results only (text)

18. 18
After
• Field Extractions
• Event types
• Reports
• Dashboards
• Alerts
• Visualizations
App SLA /
Monitoring

19. 19
The Challenge: Data Growth
Log Growth!
logs SLA / app
monitoring
analytics future

20. 20

21. High Volume AND Near Realtime

22. 22
First Solve for Volume : Hunk
• Batch
• Low Value Density
• “High” Volume

23. 23
Next Solve for Real Time : Samza + Splunk
• Near Real Time
• High Value Density
• “Low” Volume

24. 24
A self-service, scaleable,
streaming analytics system

25. DEMO

26. Key takeaways for your data journey

27. 27
Take Aways
• Do your homework!
• Engage your account rep and the splunk university and training team
• Use Splunk with the proper sizing for your deployment (do your homework)
• Evaluate, Measure, Optimize, Repeat!
• Consider Enterprise Security, Hadoop, Hunk
• Engage the community : learn from others as much as you can.
• You are not alone…

28. “Without data you are just another
person with an opinion”
William Edwards Deming
Engineer, 1900-1993
“It is not enough to do your best.
You must first know what to do.
Then, do your best.”

29. If you can log it,
you can analyze it!
René X. Parra
Principal Architect

30. Thank You