Emerging trends in
test automation
I AM SRIRAM ANGAJALA –
Eurostar Trains
I am here because I love AUTOMATION since 2003.
Worked in Silk Test, Winrunner, QTP, Selenium RC….
Find me at “sriram.angajala” in Linkedin
3
I have a Question?
4
What Percentage of
the tests are
Automated in your
Company?
X%
5
Similar conversation happened.
QA from Eurostar and QA from
other company
6
“
7
“
8
“
9
“
10
“
11
“
12
“
13
“
14
“
15
“
16
“
17
“
18
“
19
“
20
What more can be automated apart from functional tests, load , Api???
Visual Automated Tests
Look and Feel across
browsers, devices and
responsiveness -
Automation.
Mock – the – Services –
Test
Run automated tests while
mocking the services – and
test every edge case.
Dev ops
Automation(CI,CD)
Run automated test on every
merge of code.
21
. Visual Regression
TestingIf it doesn't break any functionality, but doesn't look the way it
should, then that's a visual regression
22
Then Visual Regression testing
… is taking the screen shots for
every page and compare them
with past...
Many of companies does this..
23
Then Visual Regression testing
… is taking the screen shots for
every page and compare them
with past...
NO
Many of companies does this..
24
What to look in Visual Automated Tool
⬞Adds extra pairs of eyes to our existing tests
⬞Fit into BDD along with functional steps
⬞Focus on specific elements only – not on dynamic
content and take screen shots against baseline
⬞Capable of fine tuning the results
⬞Run across browsers and mobile devices
25
What to look in Visual Automated Tool
▪Feature: Eurostar’s direct Train’s Pages
⬞Scenario: Traveller can buy a tickets through new responsive website
Given a Traveller is in the new booking magnet
When he go to travel to “Paris” page
Then the user experience looks as expected on booking magnet section
When he continues his booking
Then the print at home tickets looks great with new design and qr code is
readable
26
Tools – Fits BDD
▪PhantomCSS
▪Applitools – not open source
▪Webdrivercss – Works with Webdriver.IO
▪Galen Framework
27
DEMO – How it works
▪WebdriverCSS
▪Mocha
▪Webdriver-Admin-Panel – Reports
▪Meetup – Sriram Angajala – East london testers
28
Mock Services
our office
29
How Mock Services works
our office
30
What to look in mock service Automation
▪Feature: Loyal customer books tickets
⬞Scenarios: Traveller with Loyalty card books tickets
Given traveller selects his travel details with last name “lewis”
Then his loyalty card shows 10000 points balance
When he buys ticket and current points add to loyalty
Then he can get 30% discount in his travel cost
And the loyalty system responds SYSTEM ERROR
Then user receives a warning and can continue his booking
31
How to mock
Integrate mock service
tools to automation
framework.
Java – Cucumber –
Selenium - Wiremock
Set predefined rules and
response
Eg. Always respond with
200
Filter Responses based
in Requests.
Eg. If user name is
“Lewis” then respond with
10000 points
32
Error scenario simulation
and edgecase.
Eg. If the user is “lewis”
fail a specific response
with 400
Record and playback
the real requests and
responses
System under tests is
now fully tested

Tools
–Wiremock – Used in Eurostar
–Apiary
–Mockable.IO
–Soap UI
–Charles
–Meet up – East london testers
33
Advantages of Mocking
Reduce cost by not hitting external api
Minimize the downtime from external systems
Emulated test conditions which cannot be tested in real
services – Network down
Emulate network delays and test how the system reacts
Develop Front end with out the apis. For POC etc
34
Continuous Integration – Deployment – Devops Automation
Testing
Automation can help to make deployments faster by adding
quality gates in GIT Flow – Tests - Part of Development Build
Test Automation should be embedded into Dev-ops automation
process to enable Trash and Rebuild environment – Run Tests
- Provide confidence on deployments
35
36
Future
▪Gesture controls
▪Record play back SDK plugins for
mobile apps
▪Script less testing
▪Cucumber Pro
37
Summary / Conclusion
Conclusion
Automation tests can be extended
beyond what we think
1. Visual testing
2. Mock Services
3. Dev-ops Automation
4. And More…
Q&A Session
Questions
Thank You !
THANK YOU ALL!
Search for “Sriram Angajala”

Emerging5.0

  • 2.
  • 3.
    I AM SRIRAMANGAJALA – Eurostar Trains I am here because I love AUTOMATION since 2003. Worked in Silk Test, Winrunner, QTP, Selenium RC…. Find me at “sriram.angajala” in Linkedin 3
  • 4.
    I have aQuestion? 4
  • 5.
    What Percentage of thetests are Automated in your Company? X% 5
  • 6.
    Similar conversation happened. QAfrom Eurostar and QA from other company 6
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
    What more canbe automated apart from functional tests, load , Api??? Visual Automated Tests Look and Feel across browsers, devices and responsiveness - Automation. Mock – the – Services – Test Run automated tests while mocking the services – and test every edge case. Dev ops Automation(CI,CD) Run automated test on every merge of code. 21
  • 22.
    . Visual Regression TestingIfit doesn't break any functionality, but doesn't look the way it should, then that's a visual regression 22
  • 23.
    Then Visual Regressiontesting … is taking the screen shots for every page and compare them with past... Many of companies does this.. 23
  • 24.
    Then Visual Regressiontesting … is taking the screen shots for every page and compare them with past... NO Many of companies does this.. 24
  • 25.
    What to lookin Visual Automated Tool ⬞Adds extra pairs of eyes to our existing tests ⬞Fit into BDD along with functional steps ⬞Focus on specific elements only – not on dynamic content and take screen shots against baseline ⬞Capable of fine tuning the results ⬞Run across browsers and mobile devices 25
  • 26.
    What to lookin Visual Automated Tool ▪Feature: Eurostar’s direct Train’s Pages ⬞Scenario: Traveller can buy a tickets through new responsive website Given a Traveller is in the new booking magnet When he go to travel to “Paris” page Then the user experience looks as expected on booking magnet section When he continues his booking Then the print at home tickets looks great with new design and qr code is readable 26
  • 27.
    Tools – FitsBDD ▪PhantomCSS ▪Applitools – not open source ▪Webdrivercss – Works with Webdriver.IO ▪Galen Framework 27
  • 28.
    DEMO – Howit works ▪WebdriverCSS ▪Mocha ▪Webdriver-Admin-Panel – Reports ▪Meetup – Sriram Angajala – East london testers 28
  • 29.
  • 30.
    How Mock Servicesworks our office 30
  • 31.
    What to lookin mock service Automation ▪Feature: Loyal customer books tickets ⬞Scenarios: Traveller with Loyalty card books tickets Given traveller selects his travel details with last name “lewis” Then his loyalty card shows 10000 points balance When he buys ticket and current points add to loyalty Then he can get 30% discount in his travel cost And the loyalty system responds SYSTEM ERROR Then user receives a warning and can continue his booking 31
  • 32.
    How to mock Integratemock service tools to automation framework. Java – Cucumber – Selenium - Wiremock Set predefined rules and response Eg. Always respond with 200 Filter Responses based in Requests. Eg. If user name is “Lewis” then respond with 10000 points 32 Error scenario simulation and edgecase. Eg. If the user is “lewis” fail a specific response with 400 Record and playback the real requests and responses System under tests is now fully tested 
  • 33.
    Tools –Wiremock – Usedin Eurostar –Apiary –Mockable.IO –Soap UI –Charles –Meet up – East london testers 33
  • 34.
    Advantages of Mocking Reducecost by not hitting external api Minimize the downtime from external systems Emulated test conditions which cannot be tested in real services – Network down Emulate network delays and test how the system reacts Develop Front end with out the apis. For POC etc 34
  • 35.
    Continuous Integration –Deployment – Devops Automation Testing Automation can help to make deployments faster by adding quality gates in GIT Flow – Tests - Part of Development Build Test Automation should be embedded into Dev-ops automation process to enable Trash and Rebuild environment – Run Tests - Provide confidence on deployments 35
  • 36.
  • 37.
    Future ▪Gesture controls ▪Record playback SDK plugins for mobile apps ▪Script less testing ▪Cucumber Pro 37
  • 38.
    Summary / Conclusion Conclusion Automationtests can be extended beyond what we think 1. Visual testing 2. Mock Services 3. Dev-ops Automation 4. And More…
  • 39.
  • 40.
    Thank You ! THANKYOU ALL! Search for “Sriram Angajala”

Editor's Notes

  • #39 © Copyright Showeet.com
  • #40 © Copyright Showeet.com
  • #41 © Copyright Showeet.com