As organizations embrace agile and DevOps delivery models, non-functional performance testing becomes a challenge. While functional validation continues to mature in Agile, many organizations are either struggling to integrate application performance into the delivery model or are addressing performance through an end of sprint hardening approach. Join Syed Hossain as he explores the challenges of performance testing in agile and DevOps environments. Learn proven approaches to performance testing—staggered sprints, incremental testing, and targeted sprints. Discover how to apply existing or new performance testing tools— StormRunner Load, Neotys, SOASTA, HP Mobile Center, Perfecto Mobile—that reduce the need for heavy scripting and dramatically cut down on test preparation time. This allows you to focus on the most important tasks at hand—validating, measuring, and optimizing application performance. Leave with new ideas and proven approaches for completing performance testing in agile and DevOps environments.

1. W7
Session
10/26/2016 11:30:00 AM
Performance Testing in Agile and
DevOps Environments
Presented by:
Syed Hossain
QA Consultants
Brought to you by:
350 Corporate Way, Suite 400, Orange Park, FL 32073
888-­‐268-­‐8770 ·∙ 904-­‐278-­‐0524 - info@techwell.com - http://www.starcanada.techwell.com/

2. Syed Hossain
QA Consultants
Syed Hossain is a proven test management consultant with more than twelve
years of experience in top-tier retail, financial, and workforce industries. At QA
Consultance he provides consulting services in designing and implementing
performance testing solutions. Syed has successfully developed, managed, and
executed QA programs and projects that helped clients deliver optimized
solutions to meet business needs. He is skilled in designing tests that reduce
business risk. Syed engages effectively with senior management, business,
technology, and vendors to plan, negotiate, and execute plans. He is experienced
in building and implementing testing practices, standards, and methodology.

3. 10/17/2016
1
AGILE PERFORMANCE TESTING
AGENDA
• Why Performance Testing in AGILE is a ‘brave new world’
• The role you will play
• When to conduct performance testing
• How to optimize performance testing

4. 10/17/2016
2
ABOUT QA CONSULTANTS
QA Consultants helps companies maintain strongQA Consultants helps companies maintain strong
reputations for building software products and systems.
QA Consultants accomplish this by conducting
comprehensive software testing.p g
WHY PERFORMANCE TESTING IN AGILE IS A ‘BRAVE
NEW WORLD’

5. 10/17/2016
3
WHAT IS DONE?
SCRUM FRAMEWORK & PERFORMANCE TESTING
Use Story 1
User Stories
Product Backlog
Use Story 1
User Stories
Sprint Backlog
Use Story 1
User Stories
Use Story 1Tasks to Deliver
User Stories
Shippable Product
Increment
2 – 4 Week
Sprints
Scrum Meetings &
Re-prioritization
DONE

6. 10/17/2016
4
AGILE MANIFESTO & TESTING
Individuals and interactions over processes and tools
- Product quality is whole cross-functional team’s responsibility
Working software over comprehensive documentation
- Test requirements from user stories, examples and interactions
Customer collaboration over contract negotiation
- Testing requirements developed with customer engagement
Responding to change over following a plan
- Enables continuous improvement of the testing process
http://agilemanifesto.org
THE ROLE YOU WILL PLAY

7. 10/17/2016
5
TEAMS AND MANAGER RESPONSIBILITIES
• Teams self manage
• Team is responsible for delivery and quality
• Performance test manager focuses on enabling the performance testers
• Organizational standards & governance models
• ToolingTooling
• Best practices
THE ‘TRADITIONAL MINDSET’
• All or nothing
• Require documentation
• Too slow
• Preparation
• Execution
• Test early, test often
• Code level
• Component level
• Build performance acceptance into
user stories
• Preparation
• Scripting – tools like neoload,
SOASTA, Taurus
• Isolated Environment – envExecution
• Functionality unstable
• Time pressed
Isolated Environment env
virtualizaion
• Test Data – stub, service
virtualizaion, autonomous tests
• Execution
• Automated test execution,
analysis & reporting
• Utilize coding standards that helps
build script robustness – e.g. use
unique identifiers• Incorporate separate sprints for long
running or end-to-end tests

8. 10/17/2016
6
WHEN TO CONDUCT PERFORMANCE TESTING
WHEN TO CONDUCT PERFORMANCE TESTS
DELIVERY MODELS – STAGGERED SPRINTS AKA N-1
Hardening
Sprints
Feature
Sprint Team
Feature
Sprint Team
PerformancePerformance
Sprint Team

9. 10/17/2016
7
DELIVERY MODELS – TARGETED SPRINTS / SPIKES
Hardening
Sprints
Feature
Sprint Team
Feature
Sprint Team
PerformancePerformance
Sprint Team
DELIVERY MODELS – IN SPRINT
Hardening
Sprints
Feature
Sprint Team
Feature
Sprint Team
PerformancePerformance
Sprint Team

10. 10/17/2016
8
HOW TO OPTIMIZE PERFORMANCE TESTING
CONTINUOUS PERFORMANCE TESTING DEMO

11. 10/17/2016
9
SUMMARY
• The ‘brave new world’
• The role of Managers and Team
• Timing options: Staggered, Targeted, and ‘In sprint’
• Leveraging the latest automation tools
AGILE PERFORMANCE TESTING