More Related Content Similar to Data Driven Testing (Part 5) (19) Data Driven Testing (Part 5)1. ®
WEBINAR: Planet Test Automation: First Steps
Part 5: Data-Driven Testing
• December 18th, 2019 – Denis Markovtsev, @dmarkovtsev
We will be starting the webinar shortly, please stand by…
All phones will be automatically on mute until the Q&A.
2. ®
2 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Hey, I am Denis
• Working on Rapise test
automation tool @Inflectra
• 20 years in software
development
• 10 years in test automation
• Twitter: @dmarkovtsev
• Email: denis@Inflectra.com
3. ®
3 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Webinar Series: Useful Information
• Housekeeping Matters
• Post Webinar Follow-Up:
• Blog
• Webinar Recording
• Presentation On Slideshare
• Post-Webinar Quiz
• Webinar Series: Planet Test
Automation: First Steps
• Webinar Series Certificate Rules &
FAQs
4. ®
4 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Data-Driven Testing
5. ®
5 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Formal Diagram of Data-Driven Testing
Data
Source
Test
Expected
Output
Actual
Output
Input
Data
Compare
Test Result
6. ®
6 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Advantages of Data-Driven Testing
Reveals power of test automation
Running same test cases with different input data. Scalability!
Separates data from test logic
Easier to manage data
Enables work breakdown
Automation engineer creates tests
Manual testers and domain experts prepare data
7. ®
7 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Complexity of Data-Driven Testing
You may need to know:
How to parameterize a test
How to work with files, spreadsheets and databases within a test
How to code
Such techniques as
equivalence class testing,
boundary values testing,
pairwise testing.
8. ®
8 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Agenda
Data Sources
Data Origin
Data Output & Comparison
Data Usage Scenarios
Data Selection
9. ®
9 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Data Sources
Text File CSV File XML File JSON File
Excel File Database RVL Map Generators
10. ®
10 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Data Origin
Fixed
Random
Unique
Sequences
Encrypted
11. ®
11 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Data Output & Comparison
Text File CSV File
XML File JSON File
Excel File
Bitmap
File
Built-In Comparison
Colorful bitmaps
BW bitmaps
Spreadsheets
Excel
CSV
User-Defined Comparison
Text file
JSON file
XML file
12. ®
12 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Data Usage Scenarios
Data seeding
Testing with valid data
Testing with invalid data
13. ®
13 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Data Selection
Equivalence class testing
Boundary value testing
Pairwise testing
14. ®
14 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Equivalence Class Testing
Bar operation rules:
1 – 50 beers – take the order
51+ beers – refuse the order
any other input is invalid
Take one value from each class:
10, 100, qwerty
15. ®
15 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Boundary Value Testing
Bar operation rules:
1 – 50 beers – take the order
51+ beers – refuse the order
any other input is invalid
Take boundary values + some edge cases:
1, 50, 51, 1000000, 0, -1
16. ®
16 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Pairwise Testing
Most of bugs are caused by combination of at most two
factors
A set of all-pairs combinations is signifiactly smaller than a
set of all combinations
Learn mode on http://www.pairwise.org/
18. ®
18 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
AUT: OpenMRS
Online
https://demo.openmrs.org
Standalone
https://openmrs.org/download/
19. ®
19 | 12/18/2019 © Copyright 2006-2019 Inflectra Corporation
Sample Framework: OpenMRS_DDT
https://github.com/Inflectra/rapise-framework-
examples/tree/master/OpenMRS_DDT