Hello how are you?

1. Confidential. Do not distribute.
INTRODUCTION

2. Confidential. Do not distribute.
“NEARLY 1 MILLION NEW MALWARE THREATS RELEASED EVERY
DAY.”“Sydney cash machine glitch gives customers extra
money”
THE COST OF QUALITY… OR LACK THEREOF…
CNN, APRIL 14, 2015
BBC, MARCH 1,
2011
‘UNACCEPTABLE’ COMPUTER FAILURE”
“RBS FINED £56M OVER
BBC, NOVEMBER 20,
2014
“Hackers stole $1 billion in high-
techbank heists, researchers say”
CS MONITOR, FEBRUARY 17,
2015
“PROVIDENT BANK HIT
BY SOFTWARE GLITCH”
WOLD NEWS, MAY 6, 2015
“The Year 2010 Bug Strikes German Bank Cards”
TIME.COM, JANUARY 7, 2010
POPSCI.COM, SEPTEMBER 22, 2015
“VW: 11 MILLION DIESELS HAD CHEATING
SOFTWARE,
$7.3 BILLION SET ASIDE”
“Amazon sellers hit by nightmare
beforeChristmas as glitch cuts prices to
1p” THE GUARDIAN, DECEMBER 14, 2014
“DEUTSCHE BANK FINED £4.7
MILLIONOVER CODING ERRORS” ITPRO.COM.UK, SEP 1,
2014
“AXA Rosenberg paying
$242M BUSINESSWEEK, FEB 3,
2011
“IS KNIGHT’S $440 MILLION GLITCH THE COSTLIEST COMPUTER BUG
EVER?” CNN AUG 9, 2012
“Bloomberg glitch causes chaos in finance
sector”
COMPUTER WEEKLY, APR 17, 2015
“APPLE PAY SEES PROBLEMS AS USERS GET CHARGED
TWICE” CNET, OCTOBER 22, 2014
“ICICI Bank computer ‘bug’, cripples banking operations”
to settle case on
case”
BUSINESSTODAY.IN, MAY 14, 2015

3. Confidential. Do not distribute.
AND IT CONTINUES TO INTENSIFY…
Supported PlatformsSoftware Velocity Release Frequency Cost of Defects
Increased Stress on Quality
There is More Feature/Functionality to Test on More
Platforms, More Often and in a More Compressed Timeframe

4. Confidential. Do not distribute.
Plan Code Deploy
Continuous
Delivery
Continuous
Integration
Agile
Development
OperateBuild Test Release
Devops & TESTING
DevOps

5. Confidential. Do not distribute.
Plan Code Release
Continuous
Delivery
DeployBuild Test Release
Devops & TESTING
DevOps
Continuous
Integration
Tes
t
Agile
Development

6. Confidential. Do not distribute.
Continuous Testing is essential to achieve Continuous Delivery
Devops & TESTING
Plan Code Deploy
Continuous
Delivery
Continuous
Integration
Agile
Development
OperateBuild Release
DevOps
Test
automation

7. Confidential. Do not distribute.
TEST AUTOMATION BENEFITS
Start @ the Start…Continue Throughout the SDLC
Maintenance
Planning
Acceptance
Test
Analysis
Design
Implement
Software
Development
Life Cycle
Continuous Testing Early Detection
Consistent Results
Reusability
• Releases
• Environments
• Platforms
Time Savings
Cost Savings

8. Confidential. Do not distribute.
HELPING TEAMS ADOPT AUTOMATION… EFFECTIVELY...
# of validations & fails

9. Confidential. Do not distribute.
AND OUR COMPREHENSIVE SERVICES OFFERINGS
Consulting
Operating
Offshore
Training
We provide consulting services that
evaluate how you can best implement
Awetest.
We offer full-scale QA services to your
company.
We will train you in Awetest, as well as any
testing tools and technologies that you wish to
use.
Our offshore team provides comprehensive
manual and automated QA services at a fraction
of the cost.

10. Confidential. Do not distribute.
BY SUPPORTING VARIOUS TYPES OF TESTS
Responsiv
e
Mobile APIs Browsers Data

11. Confidential. Do not distribute.
Platforms Technologies 3rd Party Integrations
MAKING OPEN SOURCE AUTOMATION ENTERPRISE-READY

12. Confidential. Do not distribute.
SIMPLE, SCALABLE ARCHITECTURE
Tomcat
Ruby/Rails
MySQL
Redis
Shamisen Desktops +
Physical Devices
Awetest Device Lab
Test Assets
Results, Logs
1
2
3
4
5
2
3
4

13. Confidential. Do not distribute.
Defect Defect Rate &
Distribution Analysis
Full Video
Recording/Playback
WITH DETAILED, ACTIONABLE “INTELLIGENCE”
Detailed Click-by-Click
Reporting w/ Screenshots

14. Confidential. Do not distribute.
Application Team/Reference
CCER Mark Ellefson, Felix Lau
iHub Jay Mendicino
Global Wires Bryan Millmore
NX/WRIA Joan Redwing, Tom Johnson
Mobile Wallet Bipin Sahni, Nik Stroke
RELMS Monnie Mcmohan, Mike Rugh
IBM BPM Kelly Liston, Matt Bach
Profit View Maureen Davoren, Greg Cooper
Innovation Team (WMS APIs) Bipin Sahni, Nik Stroke
CEO Mobile Bryan Millmore, Julie Pua
3Qi Labs & AWETEST @ WELLS FARGO

15. Confidential. Do not distribute.
CASE STUDY: MOBILE WALLET

16. Confidential. Do not distribute.
MOBILE WALLET: TESTING REQUIREMENTS
Application
Mobile Wallet/Payment Application
Dev. Process/Setup
Testing Requirements
Distributed (Onsite-
Offshore) Development
Team
Agile/Scrum
Development Process
Multiple Handoffs w/
External & Internal Vendors
& Partners
10+ Platforms (Device-SDK
Combinations) To Be Tested
Functional Test
Case/Scenarios
400+ 1,000+
scenarios
Integration with 8
External APIs
Man Week End-To-End Manual Test
Cycle…Per Device-SDK Combination1

17. Confidential. Do not distribute.
TDD using Cucumber & Ruby
Data Driven Framework Using Excel & Ruby
Open Source Automation Libraries (Appium, Calabash & Watir-
WebDriver)
REST & SOAP Scenarios Automated
MOBILE WALLET: 3Qi Labs IMPLEMENTATION
Awetest
On-Device Parallel
Execution across
iOS & Android Devices
Awetest Device Lab

18. Confidential. Do not distribute.
RESULTS
over
75%
20x Increase In Coverage
Automated
Manua
l
In
progress
of Functional Tests Automated
API/Web Services Scenarios
Covered
1,000+
Zero P0/P1 Defects across last 5 Releases
Automation Started in Advance of Dev. Release
Automation Reused across Multiple
(Development, UAT, Pre-Prod, Production)
Environments

19. Confidential. Do not distribute.
AWETEST DEMO