SW Verification presentation

Verification of Software
Systems
Presenter:
Kiril Delovski
Software Testing Community Macedonia
10th February 2016

SOFTWARE DEVELOPMENT LIFECYCLES
(PHASES OF SOFTWARE PROJECT)
Development methodologies
Verification of Software Systems | Kiril Delovski | delovski.office@gmail.com
Requirements
Deployment and
Maintenance
Implementation
(developing or coding)
Design
Testing (verification)
• Waterfall

CMC Limited
• Software Testing is the process used to help to identify the correctness, completeness, security,
and quality of developed computer software, matching the specification and execution in its
intended environment.
DEFINITION OF SOFTWARE TESTING

TEST CYCLE
Software testing is maintain through a chain of cycle
• Requirements Analysis
• Design phase
• Test Planning
• Test Development
• Test Execution
• Test Reporting
• Retesting the Defects

INTRODUCTION TO TESTING
• Debugging and testing are not the same thing!
• Testing is a systematic attempt to break a program.
• Correct, bug-free programs by construction are the goal but until that is possible
(if ever!) we have testing.
• Testing is a process of executing a program with the intent of finding an error.

CMC Limited
TESTING OBJECTIVES
• Uncover as many as errors in the software as possible in a given timeline, and make sure get fixed
• Demonstrate a given software product matching its requirement specifications.
• Validate the quality of a software testing using the minimum cost and efforts.
• Generate high quality test cases, perform effective tests, and issue correct and helpful problem reports.

LIMITATIONS OF TESTING
• Programs take input in a variety of ways: mouse, keyboard,
• Must test valid and invalid inputs.
• There are an infinite amount of sequences of inputs to be tested.
• To test all possible inputs is impractical or Impossible
• To test all possible paths is impractical or impossible
• Too Many Possible User Environments

WHEN TO START / END TESTING
When to start
• In the early stage of testing life cycle it reduces the errors.
• The goal of Software Tester is to find bugs, find them as early as possible, and make sure being fixed.
When to end
• It is difficult to determine.
• There are common factors in deciding when to stop testing:
 Deadlines (release deadlines, testing deadlines.)
 Test cases completed with certain percentages passed
 Test budget depleted
 Coverage of code/functionality/requirements reaches a specified point
 The rate at which Bugs can be found is too small
 Beta or Alpha Testing period ends

BASIC SOFTWARE TESTING TYPES
• Security Testing
• Stress Testing
• Load testing
• Performance Testing

Severity
Factor that shows how bad the defect is and the impact it has on the product
Priority
Based upon input from users regarding which defects are most important to them, and
be fixed first.
SEVERITY VS PRIORITY

SEVERITY LEVELS
• Critical
• Major / High
• Average / Medium
• Minor / low
• Cosmetic defects

SOFTWARE TESTING ACTIVITIES
- Test Planning
- a need for test schedule for a test process and its activities
- test requirements and items
- test strategy and supporting tools
- Test Design and Specification
- Conduct software design based on well-defined test generation methods.
- Specify test cases to achieve a targeted test coverage.
- Test Set up:
- Testing Tools and Environment Set-up
- Test Suite Set-up
- Test Operation and Execution
- Run test cases manually or automatically

SOFTWARE TESTING ACTIVITIES
- Test Result Analysis and Reporting
Report software testing results and conduct test result analysis
- Problem Reporting
Report program errors using a systematic solution.
- Test Management and Measurement
Manage software testing activities, control testing schedule, measure testing complexity and cost
- Test Automation
- Define and develop software test tools
- Adopt and use software test tools
- Write software test scripts and facility
- Test Configuration Management
- Manage and maintain different versions of software test suites, test environment and tools, and
documents for various product versions.

TEST DOCUMENTS
• Test plan
• Quality objectives, resource needs, schedules, assignments, methods, etc.
• Test cases
• Inputs and expected outputs.
• Bug reports
• E.g., the Bugzilla web-based bug tracker.
• Test tools and automation
• Metrics, statistics, and summaries
• Number of unresolved bugs, (time to repair a bug, etc.)

GOOD TEST PLANS
• Developed and Reviewed early.
• Clear, Complete and Specific
• Staff knows what to expect and when to expect it.
• Realistic quality levels for goals
• Includes time for planning
• Can be monitored and updated
• Includes user responsibilities
• Based on past experience

TEST CASES, SUITES, SCRIPTS AND SCENARIOS
Test Case
Is a set of conditions or variables under which a tester will determine if a requirement or use case upon
an application is partially or fully satisfied.
Test Script
A test script is a short program written in a programming language used to test part of the
functionality of a software system.
Test Suite
The most common term for a collection of test cases is a test suite.
Test Scenario
Scenario testing is a software testing activity. It uses scenario tests, or simply scenarios, which are
based on a hypothetical story to help a person think through a complex problem or system.

GOOD TEST CASES
• Have high probability of finding a new
defect.
• Repeatable and predictable.
• Traceable to requirements or design
documents
• Execution and tracking can be automated
• Do not mislead
• Feasible
Purpose to Find Defects

WHY AUTOMATION?
When to Automate?
-Stable Application
-Manual Efforts are high
-Regression comes frequently
-We have plenty of time for
testing
When not to Automate?
- Application changes frequently
- Testing time is not defined or agreed
- Budget does not allow us
Automation Tools
- QTP
- Cucumber
- Soap UI
- Selenium
- Jmeter
- LoadRunner
- SilkTest etc.
Benefits
- One Time effort
- Saves Time
- Saves Money
- Better Outputs

SELENIUM

• Selenium 1.0 - Selenium RC or Remote Control
• support for several languages (Java, Javascript, Ruby, PHP, Python, Perl and C#)
• Selenium IDE (Integrated Development Environment)
• Selenium-Grid 1.0
SELENIUM’S TOOL SUITE
* Via appium, Selendroid,
ios-driver and WP driver.
WEB, NATIVE, AND HYBRID APPLICATIONS

1. Selenium IDE (Integrated Development Environment)
• Is a prototyping tool for building test scripts
• A Firefox Add-on provides easy-to-use interface for recording user actions,
editing and running automated tests.
• Exports user actions as a reusable script in one of many programming
languages that can be later executed
• Can be downloaded from seleniumhq.org
SELENIUM IDE
Advantages:
• No programming skills required
• Easy record and playback
• Step by step debugger
• Play tests on any browser
• Export tests as WebDriver tests
• Extensible
Disadvantages:
• Based on SeleniumCore
• No code reuse
• No iterations and conditional statements
• No exception handling
• No error recovery

SELENIUM IDE
Disadvantages:
• Based on SeleniumCore
• No code reuse
• No iterations and conditional statements
• No exception handling
• No error recovery

SELENIUM ELEMENT LOCATORS
• 1. ID
• 2. Name
• 3. LinkText
• 4. TagName
• 5. Partial Link Text
• 6. CSS
• 7. xPath (Absolute and Relative)

• storeText ( locator, variableName )
• From getText ( locator ) command
• storeLocation (variableName)
• From getLocation() command
• assertText(locator, pattern)
from getText(locator)command
• assertLocation(pattern)
from getLocation() command
• verifyText
• waitForText
• verifyLocation
• waitForLocation
• 1. open (url)
• 2. click (locator)
• 3. type (locator, value)
• 4. select (locator, optionLocator)
SELENIUM COMMANDS

Practical Example with Presentation
Requirements:
Java JDK
IntelliJ IDE
Junit 4 – an unit testing framework
Selenium - tool for automatic testing
Apache Maven – for building the tests and creating the reports

ВИ БЛАГОДАРАМ ЗА ВНИМАНИЕТО
ПРАШАЊА? / QUESTIONS?
КРАЈ / THE END
THANK YOU FOR YOUR ATTENTION
https://www.facebook.com/groups/SoftwareTestingCommunityMacedonia/

More About Me
https://www.facebook.com/kdelovski
http://delovski.innosmartsoft.mk/Online CV -
https://mk.linkedin.com/in/kdelovski6
delovski.office@gmail.comEmail:

SW Verification presentation

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to SW Verification presentation

Similar to SW Verification presentation (20)

SW Verification presentation