Addressing Performance Testing Challenges in
Agile
Outline
• Traditional approach to Performance Engineering
• Performance Engineering in Agile
• Continuous performance mana...
Introduction
• Enterprises are moving towards Agile
– Improved Quality
– Midcourse corrections
– Customer satisfaction
– Q...
Traditional approach to Performance
Engineering
• Waterfall model
• Afterthought in SDLC
• Reactive approach
• Insufficien...
Testing Challenges in Agile
• Time boxed sprints
– Shorter time to test
• Test Environment
– H/w infrastructure
– Test Dat...
Performance Engineering in Agile
© 2013 Impetus Technologies
Release Lifecycle
Recorded version available at
http://www.im...
Performance Planning
• Define
performance
requirements
– User
– System
• Performance
test strategy
• Workload analysis
• T...
Sprint Execution
• Performance centric
development
• Scripting and
Execution
• Performance unit
testing
• Continuous
Perfo...
Performance Centric Development
• Technology evaluation
• Architecture and Design Review
• Prototyping
• Deployment and Pr...
Performance Unit Testing
• Unit tests as performance tests
• Performance Evaluation
– Code Level
– Single user performance...
Performance Unit Testing
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_webinar...
Continuous Performance Management
• Integrate test execution
& Continuous
Integration
• Component level
performance
• Auto...
Continuous Performance Management
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archive...
Bottleneck Identification
• Using Diagnostic tools
• Profiling
– Code
– Database
• System tuning
– Thread pool
– Connectio...
Hardening Sprint
• Dedicated sprint for performance testing
• End-to-end performance testing
• Stress andVolume testing
• ...
Bill Payment Solutions
© 2013 Impetus Technologies
Impetus Contributions
• Defined and established Performance
engineering...
Digital Mailbox Solution
© 2013 Impetus Technologies
Impetus Contributions
• Automated tasks for performance test
data, en...
CPM in Digital Mailbox Solution
© 2013 Impetus Technologies Recorded version available at
http://www.impetus.com/archived_...
Summary
© 2013 Impetus Technologies
• Proactive performance engineering
– Early detection and resolution
• Performance uni...
• Over 20 years focus on technology
• Innovation is in our DNA
• Technology thought leaders
• Process engineering maturity...
Q&A
Please send in your questions
Recorded version available at
http://www.impetus.com/archived_webinar?eventid=68
Legal
© 2013 Impetus Technologies
© 2013 Impetus Technologies.All rights reserved.
You are prohibited from making a copy o...
Thank you
inquiry@impetus.com | www.impetus.com
Upcoming SlideShare
Loading in …5
×

Addressing Performance Testing Challenges in Agile- Impetus Webinar

837 views

Published on

Impetus webcast ‘Addressing Performance Testing Challenges in Agile’ available at
http://lf1.me/ocb/

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
837
On SlideShare
0
From Embeds
0
Number of Embeds
12
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Founded in 1996. Over 1400 engineers. Located in Silicon Valley, NYC, Atlanta, Banglore, Delhi, Indore
  • Addressing Performance Testing Challenges in Agile- Impetus Webinar

    1. 1. Addressing Performance Testing Challenges in Agile
    2. 2. Outline • Traditional approach to Performance Engineering • Performance Engineering in Agile • Continuous performance management • Case Studies © 2013 Impetus Technologies Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    3. 3. Introduction • Enterprises are moving towards Agile – Improved Quality – Midcourse corrections – Customer satisfaction – Quicker time-to-market – Competition © 2013 Impetus Technologies Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    4. 4. Traditional approach to Performance Engineering • Waterfall model • Afterthought in SDLC • Reactive approach • Insufficient time – testing, tuning, optimization and forecasting • Adverse system performance • Business losses © 2013 Impetus Technologies Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    5. 5. Testing Challenges in Agile • Time boxed sprints – Shorter time to test • Test Environment – H/w infrastructure – Test Data • Customer expectations • Frequent changes • Delivery pressures • Defining performance user stories © 2013 Impetus Technologies Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    6. 6. Performance Engineering in Agile © 2013 Impetus Technologies Release Lifecycle Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    7. 7. Performance Planning • Define performance requirements – User – System • Performance test strategy • Workload analysis • Tool selection • Test data © 2013 Impetus Technologies Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    8. 8. Sprint Execution • Performance centric development • Scripting and Execution • Performance unit testing • Continuous Performance Management • Bottleneck Identification © 2013 Impetus Technologies Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    9. 9. Performance Centric Development • Technology evaluation • Architecture and Design Review • Prototyping • Deployment and Production monitoring © 2013 Impetus Technologies Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    10. 10. Performance Unit Testing • Unit tests as performance tests • Performance Evaluation – Code Level – Single user performance • Automated unit testing – ANT, Maven • Tools – Junit, junitperf,TestNG, Solex,TPTP, p-unit © 2013 Impetus Technologies Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    11. 11. Performance Unit Testing © 2013 Impetus Technologies Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    12. 12. Continuous Performance Management • Integrate test execution & Continuous Integration • Component level performance • Automated result analysis – Alerts and Notifications • Performance comparison • Tools – Jenkins, SVN,ANT, Maven, JMeter, SandStorm, Profilers © 2013 Impetus Technologies Automated Build Trigger Dev Environment Code Repository CI tool Performance testing tool Performance Environment Performance Scripts Test scripts and Scenarios Test Execution Generate Load Results Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    13. 13. Continuous Performance Management © 2013 Impetus Technologies Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    14. 14. Bottleneck Identification • Using Diagnostic tools • Profiling – Code – Database • System tuning – Thread pool – Connection pool – JVM – Queries • Tools – Yourkit, Jprofiler, visualVM, jConsole,AWR, SQL profiler, GC Analyzer, Glassbox, jwebApp, Jamon © 2013 Impetus Technologies Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    15. 15. Hardening Sprint • Dedicated sprint for performance testing • End-to-end performance testing • Stress andVolume testing • Endurance, Reliability, Fail over testing • Production monitoring – Nagios, Zabbix,Wily, Dynatrace,AppDynamics • Performance certification © 2013 Impetus Technologies Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    16. 16. Bill Payment Solutions © 2013 Impetus Technologies Impetus Contributions • Defined and established Performance engineering process in Scrum • Defined performance tasks in product backlog • Performance benchmarking for critical web services • Defined optimal set of JVM parameters for maximum throughput • Recommended optimum hardware based on expected user base • Automated monitoring utilities to debug performance issues The Challenge • Scrum development cycle • Identify performance bottlenecks during the development • Identify hardware requirements for deployment of new release • Define optimized set of parameters for JVM • Benchmark and tune the individual web services Benefits Realized • In time release with zero performance issues • Cost savings due to early identification and resolution of performance issues Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    17. 17. Digital Mailbox Solution © 2013 Impetus Technologies Impetus Contributions • Automated tasks for performance test data, environment and execution • Performance test execution via Hudson • Performance benchmarking for critical web services • Recommended optimum hardware based on expected user base • Automated monitoring utilities to monitor sub-system performance The Challenge • Identify performance bottlenecks during the development • H/w sizing for the production deployment • Benchmark and tune the individual web services • Monitoring performance of multiple- sub-systems during test execution • Performance testing via CI Benefits Realized • In time release with zero performance issues • Significant cost savings due to use of open source tools Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    18. 18. CPM in Digital Mailbox Solution © 2013 Impetus Technologies Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    19. 19. Summary © 2013 Impetus Technologies • Proactive performance engineering – Early detection and resolution • Performance unit testing and optimization • High degree of automation • Extensive collaboration between teams • Certainty in Deployment Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    20. 20. • Over 20 years focus on technology • Innovation is in our DNA • Technology thought leaders • Process engineering maturity • World-class user experience designs What Sets Us Apart Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    21. 21. Q&A Please send in your questions Recorded version available at http://www.impetus.com/archived_webinar?eventid=68
    22. 22. Legal © 2013 Impetus Technologies © 2013 Impetus Technologies.All rights reserved. You are prohibited from making a copy or modification of, or from redistributing, rebroadcasting, or re-encoding of this content without the prior written consent of Impetus Technologies. This presentation includes images from other products and services.These images are used for illustrative purposes only. There is no explicit or implied endorsement or sponsorship of these products by Impetus.All copyrights and trademarks are property of their respective owners.
    23. 23. Thank you inquiry@impetus.com | www.impetus.com

    ×