Madhavi and Amruta delivered a Lightning Talk on AWS Performance Testing – How To Do It Right..! ATAGTR2020 was the 5th Edition of Global Testing Retreat. Madhavi has 10 years of IT experience in Non-Functional testing with background of development and production support, currently working as a Performance Test Lead with Leading UK Financial organization Amruta has 9 years of experience in IT industry with Performance Testing and Performance Engineering as core competencies. The video recording of the session is now available on the following link: https://youtu.be/p0pxODuHIiI To know more about #ATAGTR2020, please visit: https://gtr.agiletestingalliance.org/

1. #ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
#ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
AWS Performance Testing –
How To Do It Right
Madhavi Patel
Amruta Dungarwal

2. #ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
#ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
Why AWS ?
AWS is amazon web service which provides on demand cloud computing
platforms.
Cloud offers a virtually infinite pool of resources for computing, storage and
networking resources where applications can be scaled as desired typically over
the internet and on a pay-as-you-go basis.
Due to following benefits AWS continues to be the market share leader
owning 33% of the Market Share.
• Easy to use
• Flexible
• Cost-Effective
• Reliable
• Scalable and High Performance
• Secure

3. #ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
#ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
AWS Performance Testing
In this presentation we will be covering one of the performance testing approach for AWS based
on our experience.
Test Objective :
The performance testing objective was to:
• Prove the ability of the system to support the predicted Peak and future growth workload.
• Validate response time .
• Test Auto Scaling feature /Elasticity of AWS.

4. #ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
#ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
Types of Performance Tests
Load Testing: Induce normal/expected workload to the
system to determine latency, throughput, capacity of system,
ideally to figure out the capacity per resource (e.g. AWS
Redshift /Elastic Search/EMR)
Stress Testing: Induce the future growth workload to
determine the system Auto Scaling behaviour of a resource
(e.g. AWS Redshift) under increased Load .
Soak Testing : To determine system behaviour (e.g. Elastic
Search) over longer period of times .
Performance
Tests
Load Test
Soak Test
Stress
Test

5. #ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
#ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
Test Data Creation
PDF Creator Utility: A complete test data generation process automated with the help of PDF creator utility
created in Java to create 1 million PDF files with specific name.
The volumetric used was representative of Current production usage profile which contained millions of records .

6. #ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
#ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
Jmeter Use In Execution
Apache JMeter V5.0 was
used as a primary test
execution tool for
performance testing as
being an open source tool
there is no cost for tool
usage

7. #ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
#ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
Performance Monitoring
Following AWS components were
monitored during tests to capture
server metrics :
• APPLICATION SERVER (Splunk)
• AMAZON REDSHIFT DATABASE
(Cloud watch)
• EMR (Cloud watch)
• ELASTIC Search (Cloud watch)
•Benefits
•Capture Server Metrics
•Converts complex logs to visual graphs
•Capture, index and correlate real time data
•Generate Alerts
•Customized dashboards
Splunk
•Benefits
•Detect anomalous behaviour in your
environments
•Set alarms
•Visualize logs and metrics
• Take automated actions by setting up Alerts
• Help in Troubleshooting issues
Cloud Watch

8. #ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
#ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
Performance Tuning
 Modifying the Server’s ulimit as to unlimited to make more memory available
 Change in Queue Concurrency of Redshift
 Reducing Locking Table on Redshift
 Removal of Commit for INSERT and DELETE
 Query Cache turned OFF for all the content validation queries
 Max Concurrency cluster settings of Redshift
Following Best Practices were followed for Tuning application to improve Performance

9. #ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
#ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
Conclusion
• As AWS is constantly evolving Understanding is key, and testing is one tool to get there ,Complexity has not
vanished, it has been shifted .
• Utilize the cloud to make test setups simpler and achievable.
• Using a review process based on benchmarks and load tests will allow you to select the appropriate resource
types and configurations.
• Putting in place a combination of active and passive monitoring will ensure that the performance of your
architecture does not degrade over time.

10. #ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
#ATAGTR2020
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)