1. Wargaming Public API: Quality Assurance
The Dark Side of the PAPI
Pavel Rebrov
QAAutomation Engineer
Anton Kapitanenko
QA Manager
1

2. 2
2.5 years ago…
World of
Tanks
methods
PAPI WG Quality Assurance
Unit

3. 3
2 years ago…
World of
Tanks
methods
DevRoom
+
API
Explorer
PAPI WG Quality Assurance
Unit Unit
Manual
Tests

4. 4
2 years ago…
WoT v.1
methods
Manual Tests
PAPI WG Quality Assurance
Unit

5. 5
1.5-1 years ago
WoT v.1
methods
Manual Tests
UI Tests
Functional
Unit
A
u
t
o
m
a
t
e
d
Selenium
Python (nose)
PAPI WG Quality Assurance

6. 6
Cost of Change
PAPI WG Quality Assurance
Cost
Phase
Requirements Design Coding Testing Prod
x150
x50
x20
x5x1

7. 7PAPI WG Quality Assurance 7
Cost of Change
Cost
Phase
Requirements Design Coding Testing Prod
x150
x50
x20
x5x1
Unit Func. UI Manual
PAPI WG Quality Assurance

8. Tests
Spec
8
Requirement to feature workflow
PDM
Dev QA
Suite
PM
Dev QA
Scripts
Test
data
Code
PM
DocsTRUNKSTABLE
Req
Accept. criterias
Requirements
Accept. criterias
Requirements
DoD
PAPI WG Quality Assurance

9. 9
Requirement to feature workflow
PM
STABLE
QA
PROD
PAPI WG Quality Assurance

10. Unit
WoWP
10
1.5 years ago: Tests Prioritizing
Manual Tests
UI Tests
Functional
Unit
Functional
UI
Manual
Manual
Tests
UI Tests
Functional
Unit
1st Priority
2nd Priority
PAPI WG Quality Assurance

11. 11
Now…
UI
Functional
Unit
Manual
2 years
ago
Now
Developers 3 5
QA 1 2
Components 2 > 6
Methods ~15 > 100
Downtime 6 – 8 h 20 – 30 min
PAPI WG Quality Assurance

12. 12
Future…
1) Webium — common WG automation
framework
2) … Continuous Delivery  Continuous Deployment
PAPI WG Quality Assurance

13. Thanks! Any questions?
Pavel Rebrov
QAAutomation Engineer
p_rebrov@wargaming.net
Anton Kapitanenko
QA Manager
a_kapitanenko@wargaming.net