1. Intuit Continuous Performance Testing
Thiru – Principal Engineer
Ramki – Staff Engineer in Quality
people

2. Agenda
• Takeaway
• Context & overview
• Solution details
• Samples
•Q & A

3. Takeaway
• Performance Testing Landscape
• Building blocks
• Achieve automation
• Available tools
• Benefits of automation

4. Overview

6. Build
• What:
– Code to artifact
• Challenges:
– Wait time
– Failures
• Technology:

7. Deploy
• What:
– Artifacts to system
under test
– Setup
• Challenges:
– Multiple subsystems
– Configuration change
• Technology:

8. Test
• What:
– Simulate load and
observe system under
test
• Challenges:
– Too many systems and
parameters to watch for
– Babysitting to detect
failures
– Decide test
• Technology:

9. Metrics collection and Monitoring
• What:
– CPU, load average, JVM
heap, Memory, swap,
disk IO, network IO,
sockets, DB connections
etc
• Challenges:
– Too many systems and
parameters to watch for
– Babysitting to detect
failures
– Decide test
• Technology:
–Twiddle
–Oracle AWR
(automatic workload repo)

10. Analyze
• What:
– Gather measurements
and extract meaning
information
• Challenges:
– Too many systems and
parameters
– Consolidation
– Volume
• Technology:

11. Report
• What:
– Meaning information
to easy to digest form
• Challenges:
– Make reports
available
– Communication out
– Format/Layout
– Consolidated graphs
– Volume
• Technology:

12. Solution

13. CPU graph
Tool: gnuplot (open source)

15. Challenges

16. Challenges
• Collecting system resources usage
• Grouping of system resource graphs for all servers
• Multiple subsystems/technologies

17. Benefits
•
•
•
•
•
•
•
Quick Turnaround
Reduce resource cost
Effectively using hardware
No human errors
Accurate
Multiple iterations on demand
History and trend

18. Q&A
Want to talk more?
We’ll be at the Intuit booth today 11:30am-3:30pm.
Thirugnanam_subbiah@intuit.com
Ramakrishna_kollipara@intuit.com

19. Intuit Speakers @ Silicon Code Camp 2013:
SATURDAY
9:45 a.m. - Ramakrishna Kollipara – “Complete Automation of Performance Testing”
1:45 p.m. - Joe Wells - “QBO: Journey From legacy Java app to a Client-side HTML5 app”
3:30 p.m. - Naga Addagadde & Sangeeta Narang – “Intuit APIs for Financial Transaction
Aggregation”
5:00 p.m. Ted Drake –“Hitting the Accessibility High Notes with ARIA”
SUNDAY
9:15 a.m. - Eugene Krivopaltsev –“Building Native Mobile Apps with Custom Views”
1:15 p.m. - Tim Hobson – “Developing Highly Instrumental Applications with Minimal Effort”
For more information about joining our organization visit our booth or
connect with our onsite recruiter:
Chriscox_recruiter@intuit.com
You don't want to miss out on a chance to win this cool headset.
Stop by our booth to enter!