Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

ATAGTR2017 HikeRunner: Load Test Framework

695 views

Published on

The presentation on HikeRunner: Load Test Framework was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.

Author and presenter : Harsh Verma

Published in: Technology
  • Be the first to comment

  • Be the first to like this

ATAGTR2017 HikeRunner: Load Test Framework

  1. 1. #ATAGTR201 7 16th 17th March HikeRunner: LoadTestFramework - Siva Subramanian - Harsh Verma
  2. 2. Agile Testing Alliance Global Testing Retreat 2017 Indian Messaging App ● Launched globally in December 2012 ● 100m+ users ● 40 billion + messages per month ● iOS/Android Based in ● Bengaluru ● New Delhi What we do at Hike?
  3. 3. Agile Testing Alliance Global Testing Retreat 2017 Why Load Test Hike ? ● 100+ Millions users, 40 billion+ messages per month ● To mimic user journey based on analytics data ● To cover all permutations of user flows ● To scale infra systems based on results ● To find performance degradation point of Hike services Our Solution : HikeRunner
  4. 4. Agile Testing Alliance Global Testing Retreat 2017 Metrics we take into consideration ? ● Throughput ● CPU Utilization ● Memory Consumption ● Network Bandwidth ● Latency ● Load Average on system
  5. 5. Agile Testing Alliance Global Testing Retreat 2017 HikeRunner: LoadTest Framework HikeRunner: In-house Load Test Framework to mock user journey based on data from analytics system. ● Mimic Real Time Scenarios ● Vertically load test any service ● Robust and easily scalable ● Can be used for soak testing ● Benchmark(releases), throughput ● Help in finding bottleneck in system What it does:
  6. 6. Agile Testing Alliance Global Testing Retreat 2017 Architecture of HikeRunner
  7. 7. Agile Testing Alliance Global Testing Retreat 2017 Load Configurator Config
  8. 8. Agile Testing Alliance Global Testing Retreat 2017 Generator Json Output {"plan":[{"offlineMode":false,"task":"SignUpHttpTask","data":[{"considerUsers":2,"activeUsers":2}] ,"actions":[{"action":"SignUp"}]},{"offlineMode":false,"task":"OneToOne","data":[{"considerUsers" :2,"activeUsers":2}],"actions":[{"action":"HikeToHike"}]},{"offlineMode":false,"task":"Multiforward MessageTask","data":[{"considerUsers":14,"activeUsers":15}],"actions":[{"action":"Multiforward"}] },{"offlineMode":false,"task":"FileTransferTask","data":[{"considerUsers":2,"activeUsers":2}],"actio ns":[{"action":"FileTransfer"}]}]}
  9. 9. Agile Testing Alliance Global Testing Retreat 2017 CI Integration- HikeRunner
  10. 10. Agile Testing Alliance Global Testing Retreat 2017 Generated Report ● Throughput ● Cpu Utilization ● Latency ● Threshold Point ● Benchmark(successive releases) Load generated Hike Messages Latency, Threshold point Active connections results
  11. 11. Agile Testing Alliance Global Testing Retreat 2017 Demo: HikeRunner
  12. 12. Agile Testing Alliance Global Testing Retreat 2017 Our Key Takeaways: ● Mocking user journey based on analytics help us finding bottleneck points, performance degradation at various layers of db/cache/service ● Assertion scripts are useful to find threshold point and generate alerts ● Infrastructure scalability can be taken into consideration based on load generated results ● Disk Utilization and archiving of generated component logs.
  13. 13. Agile Testing Alliance Global Testing Retreat 2017 Questions?
  14. 14. Agile Testing Alliance Global Testing Retreat 2017 Siva Subramanian (Specialist SDET) Hike Messenger Linkedin: https://in.linkedin.com/in/siva- subramanian-537b227b Email : siva@hike.in Mobile : 9916205202 Harsh Verma (SDET) Hike Messenger Linkedin : https://in.linkedin.com/in/harshverma59 Email : harsh@hike.in phn : 7042060555

×