This document discusses a test management tool called TestRail and provides an overview of its benefits and limitations. Some key points: - TestRail can help manage test cases, track test results, monitor defects and automated tests, and generate reports to save time and increase quality. - Benefits include being easy to use, flexible, allowing test case and run creation and integration with bug tracking systems. It also enables organizing test suites/sections/cases and project iterations. - Limitations are that it does not have an out-of-the-box automation solution and there is a cost associated with the tool. - Examples are provided of how the tool was used to save time on test case support and

1. Тест-менеджер:
достоинства, недостатки и
советы по применению на
примере TestRail
Oksana Kharchuk
QA Engineer
Oksana.Kharchuk@dataart.com

2. Недостатки работы без test
management tool
• Отсутствует связь с баг репортами
• Трата времени на поиски необходимых тест кейсов
• Неудобное прохождение тест кейсов
• Неудобство предоставления отчетной информации заказчику
• Документация не упорядочена
• Документация не up to date
• У каждого члена команды своя версия документа
• Нет взаимодействия с автотестами
• Один член команды не имеет представления что тестирует другой

3. Mobile application testing
Project Name: Mobile testing
Mobile Devise: Google Nexus 7.2
Tester(s): Oksana
Test Environment: Android 4.3
high
Test Case No
Scenario No
Priorities Test Summary Preconditions Steps Expected Result
Functionality
1.1 high Verifying the possibility to open web site
1. The device is connected to the Internet.
2. The browser is opened.
1.Input link http://pencil.evolus.vn into browser's adress field.
2. Follow to link
The Page http://pencil.evolus.vn is open
1.2 high Portrait/Landscape view the Home page of web site
1. The device is connected to the Internet.
2. The browser is opened.
3. The tab is oriented Landscape.
1. Follow to link http://pencil.evolus.vn with browser
2. Open home page
3. Rotate device to Portrait and check view
4. Rotate device toLandscape and check view
1. The Header and Footer are present
2. Image of Preview Pencil Tool is present.
3. The button "Download" is present.
4. Some informatioon about application is present.
1.3 high
Verifing the possibility to download application
"Pencil"
1. The device is connected to the Internet.
2. The browser is opened.
1. Follow to link http://pencil.evolus.vn with browser
2. Open home page
3. Click to the button "Download for Android"
1. The application is downloaded in mobile device.
2. User can install application.
1.4 high Unsuccessful download when connection is lost
1. The device is connected to the Internet.
2. The browser is opened
3. Home pade of http://pencil.evolus.vn is open
1. Click to the button "Download for Android"
2. While downloading is run – switch off the Internet (WiFi/Mobile data).
3. Verify results at the Notifications from the Status Bar and in SD card =>
‘Download’ folder.
1. Download is unsuccessful.
2. Unsuccessful notification is shown.
3. Downloaded file is not in ‘Download’ folder.
1.5 high
Verifing the possibility to download the application
when screen is turn off
1. The device is connected to the Internet.
2. The browser is opened
3. Home pade of http://pencil.evolus.vn is open
1. Click to the button "Download for Android"
2. While downloading is run – turn off screen, afrer 10 sec turn on it
3. Verify results at the Notifications from the Status Bar and in SD card =>
‘Download’ folder.
1. Browser is opened with appropriate site.
2. Download is successful.
3. Downloaded file is displayed at the Notifications.
4. Downloaded file is in ‘Download’ folder.
1.6 high Verifying the possibility to open web site
1. The device is connected to the Internet.
2. The browser is opened.
1.Input link http://pencil.evolus.vn into browser's adress field.
2. Follow to link
The Page http://pencil.evolus.vn is open
1.7 high Portrait/Landscape view the Home page of web site
1. The device is connected to the Internet.
2. The browser is opened.
3. The tab is oriented Landscape.
1. Follow to link http://pencil.evolus.vn with browser
2. Open home page
3. Rotate device to Portrait and check view
4. Rotate device toLandscape and check view
1. The Header and Footer are present
2. Image of Preview Pencil Tool is present.
3. The button "Download" is present.
4. Some informatioon about application is present.
1.8 high
Verifing the possibility to download application
"Pencil"
1. The device is connected to the Internet.
2. The browser is opened.
1. Follow to link http://pencil.evolus.vn with browser
2. Open home page
3. Click to the button "Download for Android"
1. The application is downloaded in mobile device.
2. User can install application.
1.9 high Unsuccessful download when connection is lost
1. The device is connected to the Internet.
2. The browser is opened
3. Home pade of http://pencil.evolus.vn is open
1. Click to the button "Download for Android"
2. While downloading is run – switch off the Internet (WiFi/Mobile data).
3. Verify results at the Notifications from the Status Bar and in SD card =>
‘Download’ folder.
1. Download is unsuccessful.
2. Unsuccessful notification is shown.
3. Downloaded file is not in ‘Download’ folder.
1.10 high
Verifing the possibility to download the application
when screen is turn off
1. The device is connected to the Internet.
2. The browser is opened
3. Home pade of http://pencil.evolus.vn is open
1. Click to the button "Download for Android"
2. While downloading is run – turn off screen, afrer 10 sec turn on it
3. Verify results at the Notifications from the Status Bar and in SD card =>
‘Download’ folder.
1. Browser is opened with appropriate site.
2. Download is successful.
3. Downloaded file is displayed at the Notifications.
4. Downloaded file is in ‘Download’ folder.
1.11 high Verifying the possibility to open web site
1. The device is connected to the Internet.
2. The browser is opened.
1.Input link http://pencil.evolus.vn into browser's adress field.
2. Follow to link
The Page http://pencil.evolus.vn is open
1.12 high Portrait/Landscape view the Home page of web site
1. The device is connected to the Internet.
2. The browser is opened.
3. The tab is oriented Landscape.
1. Follow to link http://pencil.evolus.vn with browser
2. Open home page
3. Rotate device to Portrait and check view
4. Rotate device toLandscape and check view
1. The Header and Footer are present
2. Image of Preview Pencil Tool is present.
3. The button "Download" is present.
4. Some informatioon about application is present.
1.13 high
Verifing the possibility to download application
"Pencil"
1. The device is connected to the Internet.
2. The browser is opened.
1. Follow to link http://pencil.evolus.vn with browser
2. Open home page
3. Click to the button "Download for Android"
1. The application is downloaded in mobile device.
2. User can install application.
1.14 high Unsuccessful download when connection is lost
1. The device is connected to the Internet.
2. The browser is opened
3. Home pade of http://pencil.evolus.vn is open
1. Click to the button "Download for Android"
2. While downloading is run – switch off the Internet (WiFi/Mobile data).
3. Verify results at the Notifications from the Status Bar and in SD card =>
‘Download’ folder.
1. Download is unsuccessful.
2. Unsuccessful notification is shown.
3. Downloaded file is not in ‘Download’ folder.
1.15 high
Verifing the possibility to download the application
when screen is turn off
1. The device is connected to the Internet.
2. The browser is opened
3. Home pade of http://pencil.evolus.vn is open
1. Click to the button "Download for Android"
2. While downloading is run – turn off screen, afrer 10 sec turn on it
3. Verify results at the Notifications from the Status Bar and in SD card =>
‘Download’ folder.
1. Browser is opened with appropriate site.
2. Download is successful.
3. Downloaded file is displayed at the Notifications.
4. Downloaded file is in ‘Download’ folder.

4. Жизнь тестировщика без
test management tool

5. Или так

6. Спасение есть!!!

7. Что такое Test Management Tool?
Согласно ISTQB:
Полезный инструмент, помогающий в управлении тестированием и
контроле процесса тестирования. Обычно включает в себя такие
функции как:
• управление тестовым обеспечением
• планирование графика тестов
• протоколирование результатов
• отслеживание прогресса
• управление инцидентами
• составление отчетов о тестировании.

8. Анализ ваших требований к
Test Management Tool
• Объем информации
• Удобная совместная работа
• Возможность разбиения информации по разным репозиториям
• Интеграция с баг трекинговыми системами
• Спец требования вашего проекта (сколько человек в команде,
автоматизация, размещение инструмента, политика проекта,
поддержка)

9. Как продать Test Rail?
• Описать все плюсы, которые влечет за собой приобретение данного
продукта
• Показать наглядный пример использования продукта с реальными
данными заказчика
• Исходить из потребностей проекта
• О цене говорить в последнюю очередь
• Дать заказчику возможность подумать

10. Как это делали мы:
Benefits for customer
• Save time for supporting test cases up to date
• Save time for test cases execution
• Save time to perform functional and regression testing
• Save time for analyzing regression results
• Track test results and provide reports
• Organize test suites, sections and cases
• Project iterations: separate testing process for iterations
• Integration with TFS, Automation framework
• Usable UI
• Highly flexible and customizable for our needs
• Convenient in collaboration work
• Flexible permission configuration

12. Цена вопроса:

13. • Manage Test cases
• Monitor Defects
• Monitor Automated tests
• Reports about testing progress
• All information in one place
• Increase quality level
Что нам дал Test Rail

14. Достоинства Test Rail:
• Удобный в использовании
• Очень гибкий инструмент
• Легко создавать тест кейсы, тест раны
• Интеграция с баг трекинговой системой
• Генерация отчетов
• Экономия времени
• Хорошая поддержка
• Много обучающих видео по работе с Test Rail

15. Недостатки Test Rail
• Нет готового решения для автоматизации
• Цена

17. Questions?