Splunk for Online Services Event featuring Groupon

2,906 views

Published on

Groupon uses Splunk for API management, security, DevOps, business analytics, mobile app monitoring and more.

Watch the presentation live here: http://bit.ly/xAHcgI

Published in: Technology

Splunk for Online Services Event featuring Groupon

  1. 1. Online  Services  March  8,  2012  
  2. 2. Online  Services  Andrei  Akainine,  Program  Manager  Peter  Ellehauge,  Produc:on  Engineer  
  3. 3. !  Launched  in  November  2008  !  Over  33  million  ac:ve  customers  (as  of  December  2011)  !  More  than  11,000  employees  worldwide  !  Ac:ve  in  48  countries  !  Running  over  1,000  deals/day  worldwide   Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  4. 4. Who  we  are  !  Andrei  Akaikine     –  API  program  management   –  Outbound  product  management  for  Groupon  APIs   –  Daily  Splunk  user    !  Peter  Ellehauge   –  Produc:on  Engineer  (liaison  between  Dev  &  Opera:ons)   –  Sys  admin  for  Splunk  at  Groupon   –  Implementa:on  of  new  Splunk  Use  Cases  across  Groupon   Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  5. 5. Splunk  Use  Cases  at  Groupon   Performance   Management     Infrastructure  &  Applica:on  Management   Mobile  &  Public  APIs   Security   Data  acquisi:on  for  BI   Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  6. 6. Groupon  Mobile  Apps  Deal  Distribu:on   Groupon  API   Public  API   Customer  Acquisi:on   Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  7. 7. Daily  Uses  of  Splunk   Key  Ac:vi:es   Splunk  Use  Cases  !  Guarantee  API  performance   !  All  log  data  is  available  through  Splunk  !  Monitor  API  data  usage   !  Dashboards  !  Early  access  to  key  business  metrics   (conversions,  funnel,  etc.)   >   !  !  No:fica:ons   Near  real-­‐:me  !  End-­‐to-­‐end  tes:ng  !  Ad  hoc  troubleshoo:ng   Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  8. 8. Dashboards  Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  9. 9. Splunk  for  Groupon  API  Management   Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  10. 10. Current  Deployment  @  Groupon   “Can  not  have  a  server  !  6  indexers   that  is  not  sending  data  !  Over  500  GB  per  day   into  Splunk”  -­‐-­‐Peter  !  150  –  200  users  !  Consumers:  Engineering,  Opera:ons,   and  Execu:ves  !  More  than  500  servers   Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  11. 11. DevOps  and  Applica:on  Management   !  Data  from  custom  applica:ons   (Ruby,  Java,  PHP…)   !  Used  by  engineering  and   opera:ons  for  debugging  /visibility   !   Forwarding  to  Hadoop   !   Real  :me  monitoring   Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  12. 12. Splunk  Monitors  at  Groupon  Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  13. 13. Infrastructure  and  Opera:ons  !  All  server  and  network  data  from   public  cloud  (EC2),  private  cloud  and   data  center  !   Over  500  servers,  rapidly  growing  !  Easy  to  add  files  !   Easy  to  add  real  :me  monitors   Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  14. 14. Real  Time  Monitor  Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  15. 15. Splunk  -­‐>  Hadoop   Business   >   Intelligence   { Splunk  to  Hadoop  Connector   (In  Beta  from  Splunk)  Data  from  Splunk  Cri:cal  to  Providing  Business  Insights   Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  16. 16.   Hadoop  Connector  Architecture   !   Goals   –  real-­‐:me  indexing     –  reliable  data  forwarding  to  BI   !  The  buffer  is  a  workaround  for  the   bofleneck  that  results  form  high   latency  connec:on  to  Hadoop  Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  17. 17. Driving  Adop:on  at  Groupon  !  Brown  bags  on  Splunk  use  cases  !   Training  sessions   “Teams  are  now   –  Define  use  cases  and    queries   coming  to  us  for   –  Guide  on  data  format  !  Shared  services   different  Splunk   –  Set  up  Splunk  infrastructure  and  access   use  cases”  -­‐-­‐Peter   –  Enable  self-­‐service  configura:on   –  Discussion  group   Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  18. 18. What’s  Next?  !  Con:nue  to  scale  exis:ng  use  cases  with  company  growth  !   Enhanced  dashboards  and  metrics  across  use  cases  !  Expansion  into  EMEA  /  Support  privacy  use  cases  !   Hadoop  Integra:on  enhancements   Burlingame,  March  8,  2012   Copyright  ©  2011,  Splunk  Inc.  
  19. 19. Thanks!   Ques:ons?  Copyright  ©  2012,  Splunk  Inc.   Listen  to  your  data.  

×