Доклад будет посвящен выбору инструментов Автоматизации Desktop-ных приложений. Какие критерии (22) выбора инструмента существуют, подмножество наиболее важных и интересных заказчику, «исполнителю», менеджеру. Какие инструменты (16) представлены сегодня на рынке? Сравнительные характеристики каждого из инструментов по 22 критериям. Также затронем тренды в Автоматизации тестирования Desktop-ных приложений.
STX Next - Scrum Development Process OverviewSTX Next
An overview of Software Development Process at STX Next presenting basic SCRUM ceremonies and workflows. To learn more about STX Next visit https://stxnext.com
The document provides information about manual testing processes and concepts. It discusses 1) why manual testing is chosen as a career, 2) the skills needed to get a manual testing job, 3) when testing occurs in the software development lifecycle, and 4) the different types and levels of testing. It also defines key terms like requirements documents, test cases, defects, environments, and software development process models.
Continuous integration practices can improve software quality through continuous delivery. The document discusses analyzing workflows to automate processes, enabling self-service builds and deployments through push buttons, and designing pipelines for product lines. It also covers patterns like committing code daily, independent builds, fast feedback at commit stages, stopping broken builds, and using visible dashboards. Continuous integration supports agile methods by enabling daily builds and feedback within sprints to continuously improve quality.
Presentation (animated) on Agilve vs Iterative vs Waterfall models in SDLC.
Detailed comparison across Process, Planning, Execution and Completion.
#Cricket Analogy#
Waterfall (Test Match) vs Iterative (ODI) Format vs Agile (T20)
#Waterfall: Test Match Format - Strategic-Phase by Phase like Innings by Innings.
Game for Specialists, Slow and Steady.
#One Day (ODI) Format : Strategic approach – First10/Middle/Slog overs.
Mix of Specialists and
All-Rounders, Result oriented.
#T20 Format: Lively,Dynamic, Full of Action. Game for All-Rounders. Changes with every over.
Highly Result oriented
The document provides an overview of agile software development methods. It discusses the history and principles of agile development, including the Agile Manifesto. Specific agile methods like Scrum, XP, RAD, TDD, Crystal and Kanban are covered. For Scrum, it describes the roles of Product Owner, Scrum Master and Development Team. It also explains Scrum events like Sprint Planning, Daily Scrums, Sprint Review and Retrospective. The document aims to give the reader a brief introduction to common agile concepts and practices.
Product QA - A test engineering perspectiveImaginea
Imaginea's time test product qa methodology. Our hawkeye methodology helps products get released to maker more efficiently and in lesser time. Products have to be tested with a gotomarket testing approach and thats what we specialize at.
Test Driven Development su iOS è possibile e persino utile.
Invece di leggere blog post che sottointendono che TDD su iOS sia difficile e inutile venite a vedere chi lo usa sul serio e ha il coraggio di programmare ad una conferenza davanti ad altre persone.
Avvertenze:
questo talk non contiene paternali sul perché si dovrebbe (o non si dovrebbe) fare TDD
in questo talk non verranno usati strumenti complicati
in questo talk verrà scritto ed eseguito codice dal vivo
Dopo una brevissima introduzione passerò a sviluppare guidato dai test una semplice applicazione per iPhone.
STX Next - Scrum Development Process OverviewSTX Next
An overview of Software Development Process at STX Next presenting basic SCRUM ceremonies and workflows. To learn more about STX Next visit https://stxnext.com
The document provides information about manual testing processes and concepts. It discusses 1) why manual testing is chosen as a career, 2) the skills needed to get a manual testing job, 3) when testing occurs in the software development lifecycle, and 4) the different types and levels of testing. It also defines key terms like requirements documents, test cases, defects, environments, and software development process models.
Continuous integration practices can improve software quality through continuous delivery. The document discusses analyzing workflows to automate processes, enabling self-service builds and deployments through push buttons, and designing pipelines for product lines. It also covers patterns like committing code daily, independent builds, fast feedback at commit stages, stopping broken builds, and using visible dashboards. Continuous integration supports agile methods by enabling daily builds and feedback within sprints to continuously improve quality.
Presentation (animated) on Agilve vs Iterative vs Waterfall models in SDLC.
Detailed comparison across Process, Planning, Execution and Completion.
#Cricket Analogy#
Waterfall (Test Match) vs Iterative (ODI) Format vs Agile (T20)
#Waterfall: Test Match Format - Strategic-Phase by Phase like Innings by Innings.
Game for Specialists, Slow and Steady.
#One Day (ODI) Format : Strategic approach – First10/Middle/Slog overs.
Mix of Specialists and
All-Rounders, Result oriented.
#T20 Format: Lively,Dynamic, Full of Action. Game for All-Rounders. Changes with every over.
Highly Result oriented
The document provides an overview of agile software development methods. It discusses the history and principles of agile development, including the Agile Manifesto. Specific agile methods like Scrum, XP, RAD, TDD, Crystal and Kanban are covered. For Scrum, it describes the roles of Product Owner, Scrum Master and Development Team. It also explains Scrum events like Sprint Planning, Daily Scrums, Sprint Review and Retrospective. The document aims to give the reader a brief introduction to common agile concepts and practices.
Product QA - A test engineering perspectiveImaginea
Imaginea's time test product qa methodology. Our hawkeye methodology helps products get released to maker more efficiently and in lesser time. Products have to be tested with a gotomarket testing approach and thats what we specialize at.
Test Driven Development su iOS è possibile e persino utile.
Invece di leggere blog post che sottointendono che TDD su iOS sia difficile e inutile venite a vedere chi lo usa sul serio e ha il coraggio di programmare ad una conferenza davanti ad altre persone.
Avvertenze:
questo talk non contiene paternali sul perché si dovrebbe (o non si dovrebbe) fare TDD
in questo talk non verranno usati strumenti complicati
in questo talk verrà scritto ed eseguito codice dal vivo
Dopo una brevissima introduzione passerò a sviluppare guidato dai test una semplice applicazione per iPhone.
The document discusses the evolution of testing from traditional to modern software development approaches. In traditional approaches, testing occurred late and was seen as a separate function focused on scripts and automation. Modern approaches integrate testing throughout development with quality as a shared responsibility. Test engineering aims to enhance productivity by establishing frameworks for automated testing, tools for exploratory testing, and processes for collaboration. Key roles of SET and TE are discussed, with SET focusing on code quality and frameworks, and TE acting as product experts and customer advocates.
Shift left as first transformation step into Quality AssuranceZbyszek Mockun
Do you work in a company which has established effective testing process, which ensure high quality and support Agile methodologies? Can your testing process be used as a model for other companies? Fortunately, we were in that place a few years ago and had to ask ourselves a question about the next step. The answer was: Let’s be Quality Assurance Engineers rather than Testers. But what should we do? How can we do this transformation?
At the same time, I got feedback from my colleague – Head of Java practice: “Your testers found defects in areas / scenarios which weren’t included in development scope / my devs didn’t know that should cover those edge cases. What can we do with that?”
I had to agree with him. There is no sense to test scenarios which weren’t implemented. This was the starting point of our transformation. We decided to implement Shift left model as it looks like the most promising one. But when we implemented it not everything worked as smooth as we wished. New challenges appeared, but more in my presentation.
The document discusses key topics from a session on build and release engineering, including continuous integration, continuous delivery, and continuous deployment. It defines these terms and lists the main steps and principles associated with each. Specific topics covered include software release principles, configuring management, deployment pipelines, testing approaches, and managing environments and releases of complex systems. The target audience for these concepts is listed as various engineering and operations roles.
Team Foundation Server Process Templates For Effective Project ManagementAaron Bjork
An introduction to process templates, an overview of the Microsoft Process Template, and new process template features shipping in Team Foundation Server 2010.
The document discusses agile methodologies like Scrum and how they address issues with traditional "Waterfall" project management approaches. It provides an overview of Scrum roles and processes like sprints, daily stand-ups, sprint reviews and retrospectives. While Scrum is effective, the document notes it is just one part of agile and recommends combining it with technical practices like eXtreme Programming, Test Driven Development, and Continuous Integration to fully leverage agile principles.
The document provides an introduction and overview of software testing concepts. It discusses software testing methodology, techniques and processes like the software development life cycle (SDLC), waterfall model, V-model and agile model. It also covers different testing types like unit testing, integration testing, system testing and acceptance testing. Key aspects covered include verification vs validation, test planning, defect management, and the software testing life cycle.
xUnit and TDD: Why and How in Enterprise Software, August 2012Justin Gordon
“A comprehensive suite of JUnit tests is one of the most import aspects of a software project because it reduces bugs, facilitates adding new developers, and enables refactoring and performance tuning with confidence. Test-driven development (TDD) is the best way to build a suite of tests. And the Dependent Object Framework is the best way to test against database objects.” This presentation covers the benefits of TDD along with practical advice on how to implement TDD in complex projects.
This document provides an overview of Extreme Programming (XP), an agile software development methodology. It discusses XP's history and features, which include short 2-week development cycles, pair programming, test-driven development, and frequent refactoring. The core principles of XP are also examined, such as incremental planning, small releases, simple design, and sustainable pace. Various phases of the XP process are outlined, from exploration to productionizing. Requirements are captured as scenarios and prioritized by the customer. Automated testing is a key practice in XP. Both advantages like collective code ownership and disadvantages like its unsuitability for large projects are noted.
The document discusses unit testing and test-driven development (TDD). It introduces unit testing and TDD, explaining their benefits and how they can improve quality. It also provides an overview of JUnit for unit testing in Java and the red-green-blue process for TDD. The document concludes with a live demo of TDD and suggestions for implementing TDD and acceptance test-driven development.
These slides generally are about to find the major differences between the two major software development methods - traditional and agile methods. Also some brief review about these two methods will be presented. But the major focus is on comparison between them.
The document provides a comparison of various agile methods used in software development. It discusses the processes, roles and responsibilities, practices, and scope of several agile methods including eXtreme Programming (XP), Scrum, Crystal, Feature Driven Development, Rational Unified Process, Dynamic System Development Method, and Adaptive Software Development. The methods are compared based on their iterative processes, roles such as product owner and scrum master, common practices like daily stand-ups and planning games, and typical project sizes they work best for.
Saurav Kumar is a senior build and release engineer with over 5 years of experience in configuration and release management. He has expertise in Jenkins, TFS ALM, build automation, release management, and scripting languages like Python, Perl, and Batch. Currently working as a senior product engineer at Persistent Systems Ltd where he administers Jenkins, manages daily builds and releases, automates processes using scripts, and works closely with development and QA teams. He holds a B.E. in IT from Rajendra Mane College of Engineering.
This document introduces concepts of agile testing and compares it to traditional testing practices. It discusses the fundamental shift in thought process required for agile testing and provides some pointers on tools and techniques used. The traditional software development process involves separate sequential phases of analyze, design, code, and test/bug fix, while agile embraces uncertainty and a more iterative approach.
Software development lifecycle_release_managementnetdbncku
This document discusses the software development lifecycle and release management. It begins with an overview of the speaker's experience in various roles related to software product development. It then covers topics like product release cycles, roles in product development, and the key phases of the software development lifecycle including planning, design, implementation, testing, and release. It emphasizes best practices for coding, testing, documentation, and working as part of a team through an organized process.
Saurav Kumar is an experienced SCM Engineer with 6 years of experience in configuration and release management using tools like Jenkins, SVN, and JIRA who is currently working as an Associate in SCM and DevOps Services at JP Morgan Chase & Co, where his responsibilities include managing the release process and automation of tasks. He has a BE in IT from Rajendra Mane College of Engineering and is based in Bangalore.
K.R Sandeep Kamath is a Senior Software Engineer with over 7.6 years of experience developing Java applications. He has worked on projects using technologies like Spring, Hibernate, ICEFaces, JSF and RESTful web services. Some of his responsibilities include requirements gathering, design, development, testing, and release preparation. He has worked as a team lead and technical lead on projects for Saint-Gobain Grindwell Norton Limited.
Introduction to the fundamentals of eXtreme programming (XP). XP is a software development approach which stresses on improving software quality and respond according to changing business requirements.
Вячеслав Черников (Binwell) | Xamarin на практике RIF-Technology
1. Обзор платформы
Тенденции развития и ситуация на рынке
Технические нюансы платформы в разрезе применимости
Дополнительные сервисы Xamarin Test Cloud и HockeyApp
2. Классический Xamarin и Xamarin.Forms: что нового, что планируется, общий подход, проблемы и юзеркейсы.
3. DevOps в мобильной разработке на базе сервисов Bitrise, HockeyApp и Xamarin Test Cloud.
Сергей Смирнов (Altair Engineering Inc.) | Организация работы распределенной ...RIF-Technology
В рамках доклада рассмотрим вопросы формирования команды с помощью модели МакКинси 7с (McKinsey 7s), поговорим о процессах разработки программного продукта, системе релизов, системном инжиниринге и рекомендациях по системе управления процессами.
Выступление будет интересно руководителям команд разработчиков, особенно тем, кто фокусируется на предсказуемости сроков и качестве создаваемого решения.
The document discusses the evolution of testing from traditional to modern software development approaches. In traditional approaches, testing occurred late and was seen as a separate function focused on scripts and automation. Modern approaches integrate testing throughout development with quality as a shared responsibility. Test engineering aims to enhance productivity by establishing frameworks for automated testing, tools for exploratory testing, and processes for collaboration. Key roles of SET and TE are discussed, with SET focusing on code quality and frameworks, and TE acting as product experts and customer advocates.
Shift left as first transformation step into Quality AssuranceZbyszek Mockun
Do you work in a company which has established effective testing process, which ensure high quality and support Agile methodologies? Can your testing process be used as a model for other companies? Fortunately, we were in that place a few years ago and had to ask ourselves a question about the next step. The answer was: Let’s be Quality Assurance Engineers rather than Testers. But what should we do? How can we do this transformation?
At the same time, I got feedback from my colleague – Head of Java practice: “Your testers found defects in areas / scenarios which weren’t included in development scope / my devs didn’t know that should cover those edge cases. What can we do with that?”
I had to agree with him. There is no sense to test scenarios which weren’t implemented. This was the starting point of our transformation. We decided to implement Shift left model as it looks like the most promising one. But when we implemented it not everything worked as smooth as we wished. New challenges appeared, but more in my presentation.
The document discusses key topics from a session on build and release engineering, including continuous integration, continuous delivery, and continuous deployment. It defines these terms and lists the main steps and principles associated with each. Specific topics covered include software release principles, configuring management, deployment pipelines, testing approaches, and managing environments and releases of complex systems. The target audience for these concepts is listed as various engineering and operations roles.
Team Foundation Server Process Templates For Effective Project ManagementAaron Bjork
An introduction to process templates, an overview of the Microsoft Process Template, and new process template features shipping in Team Foundation Server 2010.
The document discusses agile methodologies like Scrum and how they address issues with traditional "Waterfall" project management approaches. It provides an overview of Scrum roles and processes like sprints, daily stand-ups, sprint reviews and retrospectives. While Scrum is effective, the document notes it is just one part of agile and recommends combining it with technical practices like eXtreme Programming, Test Driven Development, and Continuous Integration to fully leverage agile principles.
The document provides an introduction and overview of software testing concepts. It discusses software testing methodology, techniques and processes like the software development life cycle (SDLC), waterfall model, V-model and agile model. It also covers different testing types like unit testing, integration testing, system testing and acceptance testing. Key aspects covered include verification vs validation, test planning, defect management, and the software testing life cycle.
xUnit and TDD: Why and How in Enterprise Software, August 2012Justin Gordon
“A comprehensive suite of JUnit tests is one of the most import aspects of a software project because it reduces bugs, facilitates adding new developers, and enables refactoring and performance tuning with confidence. Test-driven development (TDD) is the best way to build a suite of tests. And the Dependent Object Framework is the best way to test against database objects.” This presentation covers the benefits of TDD along with practical advice on how to implement TDD in complex projects.
This document provides an overview of Extreme Programming (XP), an agile software development methodology. It discusses XP's history and features, which include short 2-week development cycles, pair programming, test-driven development, and frequent refactoring. The core principles of XP are also examined, such as incremental planning, small releases, simple design, and sustainable pace. Various phases of the XP process are outlined, from exploration to productionizing. Requirements are captured as scenarios and prioritized by the customer. Automated testing is a key practice in XP. Both advantages like collective code ownership and disadvantages like its unsuitability for large projects are noted.
The document discusses unit testing and test-driven development (TDD). It introduces unit testing and TDD, explaining their benefits and how they can improve quality. It also provides an overview of JUnit for unit testing in Java and the red-green-blue process for TDD. The document concludes with a live demo of TDD and suggestions for implementing TDD and acceptance test-driven development.
These slides generally are about to find the major differences between the two major software development methods - traditional and agile methods. Also some brief review about these two methods will be presented. But the major focus is on comparison between them.
The document provides a comparison of various agile methods used in software development. It discusses the processes, roles and responsibilities, practices, and scope of several agile methods including eXtreme Programming (XP), Scrum, Crystal, Feature Driven Development, Rational Unified Process, Dynamic System Development Method, and Adaptive Software Development. The methods are compared based on their iterative processes, roles such as product owner and scrum master, common practices like daily stand-ups and planning games, and typical project sizes they work best for.
Saurav Kumar is a senior build and release engineer with over 5 years of experience in configuration and release management. He has expertise in Jenkins, TFS ALM, build automation, release management, and scripting languages like Python, Perl, and Batch. Currently working as a senior product engineer at Persistent Systems Ltd where he administers Jenkins, manages daily builds and releases, automates processes using scripts, and works closely with development and QA teams. He holds a B.E. in IT from Rajendra Mane College of Engineering.
This document introduces concepts of agile testing and compares it to traditional testing practices. It discusses the fundamental shift in thought process required for agile testing and provides some pointers on tools and techniques used. The traditional software development process involves separate sequential phases of analyze, design, code, and test/bug fix, while agile embraces uncertainty and a more iterative approach.
Software development lifecycle_release_managementnetdbncku
This document discusses the software development lifecycle and release management. It begins with an overview of the speaker's experience in various roles related to software product development. It then covers topics like product release cycles, roles in product development, and the key phases of the software development lifecycle including planning, design, implementation, testing, and release. It emphasizes best practices for coding, testing, documentation, and working as part of a team through an organized process.
Saurav Kumar is an experienced SCM Engineer with 6 years of experience in configuration and release management using tools like Jenkins, SVN, and JIRA who is currently working as an Associate in SCM and DevOps Services at JP Morgan Chase & Co, where his responsibilities include managing the release process and automation of tasks. He has a BE in IT from Rajendra Mane College of Engineering and is based in Bangalore.
K.R Sandeep Kamath is a Senior Software Engineer with over 7.6 years of experience developing Java applications. He has worked on projects using technologies like Spring, Hibernate, ICEFaces, JSF and RESTful web services. Some of his responsibilities include requirements gathering, design, development, testing, and release preparation. He has worked as a team lead and technical lead on projects for Saint-Gobain Grindwell Norton Limited.
Introduction to the fundamentals of eXtreme programming (XP). XP is a software development approach which stresses on improving software quality and respond according to changing business requirements.
Вячеслав Черников (Binwell) | Xamarin на практике RIF-Technology
1. Обзор платформы
Тенденции развития и ситуация на рынке
Технические нюансы платформы в разрезе применимости
Дополнительные сервисы Xamarin Test Cloud и HockeyApp
2. Классический Xamarin и Xamarin.Forms: что нового, что планируется, общий подход, проблемы и юзеркейсы.
3. DevOps в мобильной разработке на базе сервисов Bitrise, HockeyApp и Xamarin Test Cloud.
Сергей Смирнов (Altair Engineering Inc.) | Организация работы распределенной ...RIF-Technology
В рамках доклада рассмотрим вопросы формирования команды с помощью модели МакКинси 7с (McKinsey 7s), поговорим о процессах разработки программного продукта, системе релизов, системном инжиниринге и рекомендациях по системе управления процессами.
Выступление будет интересно руководителям команд разработчиков, особенно тем, кто фокусируется на предсказуемости сроков и качестве создаваемого решения.
Ксения Стернина | (Mail.Ru Group)Gamer Experience Research на различных этапа...RIF-Technology
На примерах реальных кейсов Mail.Ru Group я расскажу о том, как методы UX исследований помогают разрабатывать игры на различных этапах от идеи до проверки готовых решений. Обсудим, какие методики UXR можно оставить без изменения, а какие требуют адаптации.
Юрий Буянов | (Одноклассники)Нюансы разработки мобильного мессенджера RIF-Technology
1. Зачем Одноклассникам мессенджер
2. Неочевидные требования
- Устойчивая работа в ненадёжных сетях и на слабых устройствах
- Полная совместимость с существующим сервисом сообщений в Одноклассниках
3. Общая концепция проекта
- Целевая аудитория
- Платформы
- Скоуп (что точно должно было войти, и что осталось за бортом)
4. Сетевое взаимодействие
- Протокол (общее описание и обоснование, почему сделали именно так)
- Особенности API
4. Архитектура iOS-клиента
- Адаптации под изменчивость требований
- MVVM
- Навигация
- Service Layer
- Dependency Injection
- Кеширование, офлайн-режим, YapDatabase
- Оптимизации и хаки
5. Статистика и аналитика
Алексей Раменский (Тэглайн) | Обзор рынка российской заказной веб-разработки ...RIF-Technology
Российский рынок заказной веб-разработки: структура и специализации компаний, города-лидеры, используемые технические решения и инструменты автоматизации, принципы работы, проблемы и перспективы.
Обзор российского рынка веб-разработки будет полезен большинству российских технических и маркетинговых руководителей — как компаний-разработчиков, так и представителей клиентской стороны.
Также Тэглайн представит Рейтинг аутсорс-продакшнов в digital — компаний, которые сфокусированы на производстве digital-продуктов по четким требованиям под руководством более крупного продакшна, агентства или опытного прямого клиента. Рейтинг компаний, которые на самом деле программируют, верстают, тестируют, рисуют и анимируют все то, что вы видите каждый день.
I, For One, Welcome Our New Robot OverlordsSteve Malsam
This document discusses replacing manual mobile app testing with automated testing using Cucumber and Calabash. It outlines the benefits of automated testing such as being able to run tests anytime without requiring testers. It then provides an example of how to write Cucumber feature files and step definitions in plain language to test app features. Finally, it discusses best practices for writing good automated tests, such as making them concise, independent, flexible, and run often without relying on implementation details.
Олег Бунин (Онтико) | Менеджмент и бизнес-процессы в разработке highload-прое...RIF-Technology
Самый большой проект, с котором сталкивалась наша команда занял у нас порядка 70 человеко-месяцев, к концу в проекте было около 9000 тикетов, объединённых в 318 эпиков. Объём технического задания превышал 1000 страниц. Как мы справились с этим довольно небольшой командой? Один менеджер, один аналитик, несколько разработчиков.
Нам помогли бизнес-процессы или попросту жёстко прописанные workflow для любой ситуации, любого вида задач или входных данных. Как задача обрабатывается аналитиком, когда она попадает программистам, когда пишется технический дизайн. Как эта схема накладывается на тикетную систему, как использовать эпики и задачи. Все эти правила мы выписали болью ошибок в планировании (и финансах) и я уверен, что они могут сэкономить вам несколько месяцев собственных опытов.
Continuous Deployment pipeline demonstration spiced with Robot Framework and ...Antti Pohjonen
This document provides an agenda for a workshop on continuous deployment and acceptance test driven development. It introduces the presenters and their company, which focuses on agile testing and test automation services. It then defines continuous deployment and explains how it builds on continuous integration by adding more layers of testing and validation. The workshop example demonstrates roles like product owner and developers, and walks through a sample story of new feature development using ATDD and continuous integration/deployment practices. The workshop exercise invites participants to work in small groups to implement tests for a sample application using tools like Robot Framework, Git, and Jenkins.
Как надо правильно строить автоматизацию тестирования с нуля, что нужно применять, а то не нужно применять при проектировании архитектуры. Какие виды фреймворков бывают, что с ними надо делать. Все и много другое вы сможете найти в этой презентации
Robot Framework is a keyword-driven testing framework for acceptance testing and automation. It has an architecture that supports keyword-driven testing and continuous integration. The framework aims to simplify test automation by providing tools for test data structuring, test execution and reporting.
This document discusses test automation within a Scrum process. It begins by providing background on the author and defining test automation. It then discusses how to start with automation, including using frameworks and learning programming skills. It describes how to plan test automation in a Scrum process, including when to automate, criteria for choosing what to automate, and how to plan the automation work. The document then discusses automating test cases, executing automation scripts, and delivering the automation work in a Scrum process. Finally, it briefly discusses some newer trends in test automation.
The document discusses using the Groovy scripting language for manual and automated testing with the Robot Framework. It covers topics like why to use Groovy for testing, Groovy and various testing tools/frameworks, an overview of the Robot Framework, integrating Groovy with the Robot Framework for automated testing, and includes example test cases. The presentation aims to provide information on performing testing with Groovy and the Robot Framework.
Sphinx + robot framework = documentation as result of functional testingplewicki
Sphinx is a Python documentation generator, Robot Framework is a test automation framework. These tools combined make documentation a part of the test coverage. Tests are written in human (customer) readable form and the result documentation contains screenshots from product in development.
Robot Framework is a generic test automation framework for acceptance and regression testing. It has easy-to-use tabular test data syntax and supports test automation using the keyword-driven testing approach. Tests are created using test cases composed of test data and keywords. Keywords are provided by test libraries that extend the functionality of the framework. Robot Framework can be installed on Windows using pip and supports creating and running tests from the command line or using the RIDE test data editor.
This document discusses why checklists are better than test cases for documentation in quality assurance. It argues that test cases become overcrowded and focus too much on documentation rather than core functions. Checklists are more time-saving and easy to update. An example compares a test case to a checklist for login/registration flows. The author's company Hipo uses a test pad and robot framework integrated with checklists to share with clients and team members.
Functional Tests Automation with Robot Frameworklaurent bristiel
The document discusses Robot Framework, an open source test automation framework written in Python. It can be used to write functional, end-to-end, component, and unit tests. Robot Framework uses a keyword-driven, data-driven, or behavior-driven approach. It provides built-in keywords and libraries that allow tests to be written in a simple, lightweight manner and executed across multiple platforms and applications. Case studies are presented on large companies using Robot Framework to automate testing of their products. Both advantages and limitations of the framework are covered.
The presentation on Expanding test horizons with Robot Framework was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Kushan Amarasiri
If you’re responsible for creating diverse, scalable automated tests but don’t have the time, budget, or a skilled-enough team to create yet another custom test automation framework, then you need to know about Robot Framework!
In this webinar, Bryan Lamb (Founder, RobotFrameworkTutorial.com) and Chris Broesamle (Solutions Engineer, Sauce Labs) will reveal how you can use this powerful, free, open source, generic framework to create continuous automated regression tests for web, batch, API, or database testing. With the simplicity of Robot Framework, in conjunction with Sauce Labs, you can improve your test coverage and time to delivery of your applications.
The document discusses an automation framework for testing an application under test (AUT). It summarizes that an automation framework uses an automation tool to test an AUT by executing and comparing test results. It then evaluates different automation tools based on features and selects TestComplete as the most suitable tool. Finally, it discusses implementing the framework using block diagrams, test scripts, function libraries and storing results in CSV files for reporting.
0/5
You’ve built a new feature in your app that is ready ship. Or is it? How can you be sure you’ve not introduced regressions in cases you forgot to test? What if your code crashes only on certain devices? Could the feature freeze up for a few users?
Shipping frequently with little to no functional, UX or performance issues or regressions is not easy - but it’s also a problem that has been solved before. Where things get a lot more interesting is how to keep the same quality bar when you have hundreds of pull requests going in every day, with tens or hundreds of developers working on the same project? How do you test that your app still works - with this kind of scale?
In this talk, you’ll learn about the different approaches we combined into a system used by hundreds of mobile engineers at Uber to test our native iOS and Android apps during development, at release as well as when in production. We’ll talk about what did and what did not work for us on our journey of iterating frequently and continuously improving the quality bar.
This presentation provides an overview of automation testing and the Selenium tool. It defines automation as a way to overcome manual testing limitations by adding speed and accuracy. The benefits of automation testing are discussed, including time savings, reduced costs, accuracy, and quality assurance. Two main types of automation tools are described: functional testing tools and performance testing tools. Selenium is introduced as an open source tool for automating web applications across browsers. Its components and advantages over commercial tools like QTP are outlined, such as being open source, flexible, and supporting multiple browsers and platforms. Some disadvantages of Selenium are also noted, such as only testing web applications and slower automation compared to proprietary IDEs.
Overview and Analysis of Automated Testing Tools: Ranorex, Test Complete, Se...IRJET Journal
This document provides an overview and analysis of three automated testing tools: Ranorex, Test Complete, and Selenium. It compares the tools based on their execution speed, supported platforms and languages, data handling capabilities, playback features, cost, and report generation. The document concludes that each tool has its own strengths and weaknesses, and the most suitable tool depends on the type of application being tested and scope of the testing project. Ranorex is recommended for beginners testing web applications due to its simplicity, while Test Complete and Selenium may be better for more advanced users or different application types.
This document provides an overview and comparison of several popular open source automation tools, including Selenium, Watir, FlexMonkey, TurnkeyLinux, TestLink, and Redmine. Selenium is a suite of tools for automating web browsers across different browsers and operating systems. Watir is a Ruby library for automating web browsers. FlexMonkey is a tool for testing Flex and Air applications. TurnkeyLinux provides over 45 ready-to-use Linux solutions. TestLink is an open source test management tool. Redmine is an open source project management and issue tracking tool. The document compares the pros and cons of each tool and provides example usages and links for further information.
The document discusses a blueprint for automating web application testing using WebDriver. The blueprint proposes using page object modeling and separating test code from page interaction code. It aims to make automation easy to use, maintain low maintenance costs, and allow multiple team members to contribute tests across browsers and operating systems.
The resume summarizes Abhiram Bharadwaj Kasuba's experience as a Senior Test Engineer and Performance Test Lead working on automation testing projects for Stanley Black and Decker and Dell International Service PVT Ltd. He has over 3 years of experience in test automation, performance testing, and developing hybrid test frameworks using tools like Selenium, Visual Studio, Cucumber, and SQL. His responsibilities include authoring test cases, executing regression and performance tests, analyzing results, and reporting progress.
Check out this blog to find out the top 10 automation testing tools in 2020, that is open-source, free, and commercial. These tools can help your business conduct quality software testing.
The Best Automation Testing Tools To Use In 2022 | BMN InfotechBMN Infotech
Automation Testing Tools are great for ensuring that the product you are developing is ready for release. Here is a list of the best automation testing tools to use in 2022.
Automated Visual Testing System focuses on the correctness of content and layout being positioned properly on screen in respect to size and shape. It also checks for overlaps, hiding elements or visual mismatching contents along with correct font, colour and image.
This document discusses how to improve testing of UI5 web applications. It proposes moving UI tests into the development cycle by having developers write tests in JavaScript that run directly in the browser. This allows tests to be executed frequently and catch defects earlier. It introduces the OPA (Open UI5 Application) testing framework, which allows writing tests this way by providing page objects and helpers that work with UI5 controls instead of directly manipulating the DOM. OPA aims to make UI tests stable, easy to debug and reproduce by automatically waiting for asynchronous operations to complete.
The document discusses the importance of testing mobile applications for quality and performance. It notes that only 16% of consumers will try a failing app more than twice and that a 5-star app makes 6 times more money than a 3-star app. The document then introduces Mobitop, a mobile testing platform that allows testing applications on real devices without coding through an easy click-and-record interface. Mobitop provides automated testing, real-time monitoring of performance metrics, and detailed reports.
The document discusses the importance of testing mobile applications for quality and performance. It notes that only 16% of consumers will try a failing app more than twice and that a 5-star app makes 6 times more money than a 3-star app. The document then introduces Mobitop, a mobile testing platform that allows testing applications on real devices without coding through an easy click-and-record interface. Mobitop provides automated testing, metrics on performance, and actionable results without the need for experienced developers or expensive tools.
The document discusses the importance of testing mobile applications for quality and performance. It notes that only 16% of consumers will try a failing app more than twice and that a 5-star app makes 6 times more money than a 3-star app. The document then introduces Mobitop, a mobile testing platform that allows testing applications on real devices without coding through an easy click-and-record interface. Mobitop provides automated testing, real-time monitoring of performance metrics, and detailed reports.
The document discusses the importance of testing mobile applications for quality and performance. It notes that only 16% of consumers will try a failing app more than twice and that a 5-star app makes 6 times more money than a 3-star app. The document then introduces Mobitop, a mobile testing platform that allows testing applications on real devices without coding through an easy click-and-record interface. Mobitop provides automated testing, real-time monitoring of performance metrics, and detailed reports.
This document discusses automation testing. It begins by defining automation testing and listing its benefits, which include saving time and money, improving accuracy, and increasing test coverage. It then covers levels of automation testing, frameworks, approaches like record and playback, modular scripting, and keyword-driven testing. The document also discusses the automation testing lifecycle, how to choose a testing tool, types of tools, when to automate and who should automate, supporting practices, and skills needed for automation testing.
STARWEST 2010 - 7 Steps To Improving Software Quality using Microsoft Test Ma...Anna Russo
Using Visual Studio 2010, teams can improve software quality through 7 steps: 1) work management with hierarchical tasks and improved reporting; 2) defining "done" with dashboards; 3) automated builds with traceability from development to testing; 4) manual and automated testing tools; 5) developer quality tools to find and fix bugs early; 6) test lab management with virtual environments; and 7) continuous improvement through an integrated and productive environment.
This document provides information about Unified Functional Testing (UFT), formerly known as QuickTest Professional (QTP). It discusses the history of UFT/QTP, key features of UFT including support for GUI, API, mobile and collaboration testing. It also describes different types of testing tools that work with UFT including test management, configuration management, static analysis, test data preparation, test execution, and coverage measurement tools. The advantages and disadvantages of UFT compared to the open source Selenium tool are also summarized in a table.
2.Android App Development_ Types of Automated Unit Tests.pdfBelayet Hossain
Both a team of automation testing android and Android developers are capable of using a variety of testing approaches. Whether creating websites or mobile apps, automated unit testing is essential. Every Android mobile app development project must start with automated unit tests for mobile apps.
https://itphobia.com/android-app-development-types-of-automated-unit-tests/
“An Outlook of the Ongoing and Future Relationship between Blockchain Technologies and Process-aware Information Systems.” Invited talk at the joint workshop on Blockchain for Information Systems (BC4IS) and Blockchain for Trusted Data Sharing (B4TDS), co-located with with the 36th International Conference on Advanced Information Systems Engineering (CAiSE), 3 June 2024, Limassol, Cyprus.
Full-RAG: A modern architecture for hyper-personalizationZilliz
Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024Neo4j
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...SOFTTECHHUB
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Building RAG with self-deployed Milvus vector database and Snowpark Container...Zilliz
This talk will give hands-on advice on building RAG applications with an open-source Milvus database deployed as a docker container. We will also introduce the integration of Milvus with Snowpark Container Services.
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/
Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit.
In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing.
van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!SOFTTECHHUB
As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Speck&Tech
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
3. Agenda, part 2 (tools and criteria's)
1. Tools to be compared (15)
2. How why we selected this list of tools?
3. Comparison criteria types (3)
4. Stakeholders oriented comparison criteria (7)
5. Mixed comparison criteria (7)
6. Tech stuff oriented comparison criteria (8)
7. How why we selected these lists of criteria's?
8. How to select proper criteria's for your project
4. Agenda, part 3 (comparison analyses)
1. Mixed comparison criteria
2. Tech stuff oriented comparison criteria
3. Stakeholders oriented comparison criteria
4. Define our “standard” context
5. Summarized scores
6. How to calculate scores
7. How to use scores / presentation
8. 4 summarized tables
5. Agenda, part 4 (tools, “how to” and examples)
1. How to define proper tool based on selected criteria's
2. How to link information from presentation to QA Automation
metrics
3. How to link information from presentation to Project Health Check
4. How to link information from presentation to QA Automation ROI
5. Tools tiny overview
6. Tools overview structure
7. Example of tool usage structure
6. Agenda, part 5 (trends, science and “what’s next”)
1. Define a Trend! Is it possible ..?
2. Trend – an option
3. Why so?
4. What’s next
12. Stakeholders oriented comparison criteria
1. Approximate complexity of auto-test development
2. Approximate complexity of auto-test support
3. Approximate “entrance” level
4. Required technical skills level
5. Tests readability
6. How fast tests run
7. Ability to re-use "Business-Logic" layer in other technical context
13. Mixed comparison criteria
1. Supported platforms
2. Supported technologies
3. Licensing
4. Maturity
5. Record-Play system support
6. Standard actions pack
14. Tech stuff oriented comparison criteria
1. Programming languages support
2. Have tools for mapping
3. Self-Made architecture support
4. Data-Driven testing support
5. Test-Driven development support
6. Key-word driven
7. Behavior Driven Development support
8. Continues integration system support
15. How why we selected these lists of criteria's?
18. Supported platforms – “the best” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10. Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
19. Supported platforms
Tool Platforms Mark
TestComplete Desktop Windows
Unified Functional
Testing
Windows
Ranorex Windows
Telerik Test Studio Windows
Zeenyx AscentialTest Windows
MS VS Coded UI ; CUIT Windows
AUTOIT Windows
Sikuli Windows, Unix-like Good
Jubula Windows, Unix-like Good
Robot Framework Windows, Unix-like Good
Winium / WinAppDriver
;
QTWebDriver
Windows / Windows;
Cross-Platform
/ ; Good
PyWinAuto Windows
20. Supported technologies – “the best” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10.Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
21. Supported technologies
Tool Technologies Mark
TestComplete Desktop C/C++, WinForms, WPF,
Java, Qt
Unified Functional Testing WinForms, WPF, Java, SAP
Ranorex WinForms, WPF, Java, Qt,
SAP
Telerik Test Studio WPF Bad
Zeenyx AscentialTest Win Forms, WPF, Java Bad
MS VS Coded UI ; CUIT Win Forms (partial), WPF Bad
AUTOIT OS level Good
Sikuli Image recognition based Good
Jubula WinForms, WPF, Java Bad
Robot Framework Uses AutoIT (and co inside) Good
Winium / WinAppDriver ;
QTWebDriver
WinForms, WPF / Any ; QT Bad
PyWinAuto Win32 API, WinForms
(partial, Win32 API bases)
Bad
22. Licensing – “the worst” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10. Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
23. Licensing
Tool License Mark
TestComplete Desktop Paid Bad
Unified Functional Testing Paid Bad
Ranorex Paid Bad
Telerik Test Studio Paid Bad
Zeenyx AscentialTest Paid Bad
MS VS Coded UI ; CUIT Paid Bad
AUTOIT Free
Sikuli Open source Good
Jubula Open source Good
Robot Framework Open source Good
Winium / WinAppDriver ;
QTWebDriver
Open source Good
PyWinAuto Open source Good
24. Maturity – “the worst” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10.Jubula
11.Robot Framework
12.Winium
13.WinAppDriver
14.QTWebDriver
15.PyWinAuto
25. Maturity
Tool Maturity
TestComplete Desktop Good
Unified Functional Testing Good
Ranorex Good
Telerik Test Studio Good
Zeenyx AscentialTest
MS VS Coded UI ; CUIT Good
AUTOIT
Sikuli
Jubula
Robot Framework
Winium / WinAppDriver ;
QTWebDriver
Bad
PyWinAuto
27. Record-Play support
Tool Record-Play Mark
TestComplete Desktop Yes Good
Unified Functional
Testing
Yes Good
Ranorex Yes Good
Telerik Test Studio Yes Good
Zeenyx AscentialTest No
MS VS Coded UI ; CUIT No
AUTOIT No
Sikuli No
Jubula No
Robot Framework No
Winium / WinAppDriver
;
QTWebDriver
No
PyWinAuto No
29. Standard actions pack
Tool STD actions Mark
TestComplete Desktop No
Unified Functional Testing No
Ranorex No
Telerik Test Studio No
Zeenyx AscentialTest Yes Good
MS VS Coded UI ; CUIT No
AUTOIT No
Sikuli Yes Good
Jubula Yes Good
Robot Framework No
Winium / WinAppDriver ;
QTWebDriver
No
PyWinAuto Yes / No (via SWAPY)
31. Programming languages – “the best” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10. Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
32. Programming languages support
Tool Language Mark
TestComplete Desktop Python, C#Script, JScript,
C++Script, VBScript,
DelphiScript
Good
Unified Functional
Testing
VBScript Bad
Ranorex C#, VB.Net
Telerik Test Studio C#, VB.Net
Zeenyx AscentialTest Own DSL Bad
MS VS Coded UI ; CUIT C#, VB.Net
AUTOIT Own Basic-like language Bad
Sikuli Jython, Java
Jubula -
Robot Framework Own DSL, Java, Python
Winium / WinAppDriver ;
QTWebDriver
Java, JavaScript, PHP,
Python, Ruby, C#
Good
PyWinAuto CPython
33. Tools for mapping – “the best” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10. Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
34. Tools for mapping
Tool Tools for mapping Mark
TestComplete Desktop Yes Good
Unified Functional Testing Yes Good
Ranorex Yes Good
Telerik Test Studio Yes Good
Zeenyx AscentialTest Yes / No Good
MS VS Coded UI ; CUIT No
AUTOIT No
Sikuli Yes / No
Jubula Yes Good
Robot Framework No
Winium / WinAppDriver ;
QTWebDriver
No
PyWinAuto No
35. Custom architecture – “the worst” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10. Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
36. Custom architecture
Tool Custom architecture Mark
TestComplete Desktop Yes / No
Unified Functional Testing Yes / No
Ranorex Yes / No
Telerik Test Studio Yes / No
Zeenyx AscentialTest No Bad
MS VS Coded UI ; CUIT Yes Good
AUTOIT No Bad
Sikuli Yes Good
Jubula No / Yes
Robot Framework Yes Good
Winium / WinAppDriver ;
QTWebDriver
Yes Good
PyWinAuto Yes Good
37. DDT support – “the worst” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10. Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
38. DDT support
Tool DDT support Mark
TestComplete Desktop Yes Good
Unified Functional Testing Yes Good
Ranorex Yes Good
Telerik Test Studio Yes Good
Zeenyx AscentialTest Yes Good
MS VS Coded UI ; CUIT Yes Good
AUTOIT No Bad
Sikuli Yes / No Good
Jubula Yes Good
Robot Framework Yes Good
Winium / WinAppDriver ;
QTWebDriver
Yes Good
PyWinAuto Yes Good
39. TDD support – “the worst” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10.Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
40. TDD support
Tool TDD Mark
TestComplete Desktop Yes / No Good
Unified Functional Testing Yes / No Good
Ranorex Yes / No Good
Telerik Test Studio Yes / No Good
Zeenyx AscentialTest No Bad
MS VS Coded UI ; CUIT Yes Good
AUTOIT No Bad
Sikuli Yes / No Good
Jubula Yes Good
Robot Framework Yes Good
Winium / WinAppDriver ;
QTWebDriver
Yes Good
PyWinAuto Yes Good
41. Key-word driven – “the best” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10. Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
42. Key-word driven support
Tool Key-word Mark
TestComplete Desktop No Bad
Unified Functional Testing No Bad
Ranorex Yes / No
Telerik Test Studio Yes / No
Zeenyx AscentialTest Yes Good
MS VS Coded UI ; CUIT Yes / No
AUTOIT No Bad
Sikuli Yes / No
Jubula No Bad
Robot Framework Yes Good
Winium / WinAppDriver ;
QTWebDriver
Yes / No
PyWinAuto Yes / No
43. BDD support – “the worst” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10. Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
44. BDD support
Tool BDD Mark
TestComplete Desktop No Bad
Unified Functional Testing No Bad
Ranorex Yes Good
Telerik Test Studio Yes Good
Zeenyx AscentialTest No Bad
MS VS Coded UI ; CUIT Yes Good
AUTOIT No Bad
Sikuli Yes Good
Jubula No Bad
Robot Framework Yes / No
Winium / WinAppDriver ;
QTWebDriver
Yes Good
PyWinAuto Yes Good
45. CI support – “the worst” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10. Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
46. CI support
Tool CI Mark
TestComplete Desktop Automated Build Studio
Unified Functional Testing Jenkins plugin
Ranorex Jenkins
Telerik Test Studio Bamboo
Zeenyx AscentialTest Test Execution
Management
MS VS Coded UI ; CUIT Any Good
AUTOIT - / Any
Sikuli - / Any Java-compatible
Jubula No Bad
Robot Framework Jenkins plugin
Winium / WinAppDriver ;
QTWebDriver
Any Good
PyWinAuto Any Good
49. Approximate complexity of auto-test development
Tool Development Mark
TestComplete Desktop ~3h
Unified Functional Testing ~3h
Ranorex ~2h Good
Telerik Test Studio ~2h Good
Zeenyx AscentialTest ~2h Good
MS VS Coded UI ; CUIT ~3h ; 2h ; Good
AUTOIT ~1h Good
Sikuli ~2h Good
Jubula ~2h Good
Robot Framework ~4h
Winium / WinAppDriver ;
QTWebDriver
~3h / 6h -> 2h / Bad -> Good
PyWinAuto ~1h Good
50. Approximate complexity of auto-test
support (per year)
Tool Support Mark
TestComplete Desktop ~3h Bad
Unified Functional Testing ~3h Bad
Ranorex ~2h Good
Telerik Test Studio ~2h Good
Zeenyx AscentialTest ~3h Bad
MS VS Coded UI ; CUIT ~2h ; 1h Good
AUTOIT ~4h Bad
Sikuli ~5h Bad
Jubula ~2h Good
Robot Framework ~1h Good
Winium / WinAppDriver ;
QTWebDriver
~2h / 10h -> 1h Good / Bad -> Good
PyWinAuto ~2h Good
51. Approximate “entrance” level – “the best” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10.Jubula
11.Robot Framework
12.Winium
13.WinAppDriver
14.QTWebDriver
15.PyWinAuto
52. Approximate “entrance” level
Tool Level
TestComplete Desktop High
Unified Functional Testing High
Ranorex
Telerik Test Studio
Zeenyx AscentialTest
MS VS Coded UI ; CUIT High
AUTOIT Low
Sikuli Low
Jubula
Robot Framework High
Winium / WinAppDriver ;
QTWebDriver
High ->
PyWinAuto
53. Required “technical skills” level – “the best” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10. Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
54. Required “technical skills” level
Tool Level
TestComplete Desktop
Unified Functional Testing
Ranorex
Telerik Test Studio
Zeenyx AscentialTest Low
MS VS Coded UI ; CUIT High ;
AUTOIT Low
Sikuli Low
Jubula Low
Robot Framework High
Winium / WinAppDriver ;
QTWebDriver
High ->
PyWinAuto Low
55. Test readability – “the worst” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10. Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
56. Test readability
Tool Level
TestComplete Desktop
Unified Functional Testing
Ranorex
Telerik Test Studio
Zeenyx AscentialTest High
MS VS Coded UI ; CUIT
AUTOIT Low
Sikuli High
Jubula High
Robot Framework - > High
Winium / WinAppDriver ;
QTWebDriver
- > High
PyWinAuto High
57. How fast tests run – “the best” tool?
1. TestComplete Desktop
2. Unified Functional Testing (UFT)
3. Ranorex
4. Telerik Test Studio
5. Zeenyx AscentialTest
6. MS VS Coded UI
7. CUIT
8. AUTOIT
9. Sikuli
10. Jubula
11. Robot Framework
12. Winium
13. WinAppDriver
14. QTWebDriver
15. PyWinAuto
58. How fast tests run
Tool Level
TestComplete Desktop Bad
Unified Functional Testing Bad
Ranorex
Telerik Test Studio
Zeenyx AscentialTest
MS VS Coded UI ; CUIT Good
AUTOIT Good
Sikuli Bad
Jubula Bad
Robot Framework Good
Winium / WinAppDriver ;
QTWebDriver
Good
PyWinAuto Good
59. Ability to re-use "Business-Logic" layer
Tool “BDD” Mark
TestComplete Desktop No Bad
Unified Functional Testing No Bad
Ranorex Yes Good
Telerik Test Studio Yes Good
Zeenyx AscentialTest No Bad
MS VS Coded UI ; CUIT Yes Good
AUTOIT No Bad
Sikuli Yes Good
Jubula No Bad
Robot Framework Yes Good
Winium / WinAppDriver ;
QTWebDriver
Yes Good
PyWinAuto Yes Good
67. How to define proper tool based on selected
criteria's
68. How to
1. link information from presentation to QA Automation metrics
2. link information from presentation to Project Health Check
3. link information from presentation to QA Automation ROI
70. Tools overview structure
1. Pros
2. Cons
3. What kind of project / product / problem / situation
certain tools could be used for!
71. Example of tool usage structure
1. Plus several examples of each tool usage
— Example structure:
• Values:
— Value the individual
— Act as a team
— Strive for excellence
— Focus on customer
— Act with integrity
• Prisms:
— Technology
— Delivery
— Leadership
75. Test Complete Desktop
1. Pros
• Low entrance level
• High level of test scripts’ flexibility
• Huge knowledge base (at about MSDN level)
• Wide choice of script languages which look like common languages
2. Cons
• Very expensive license
• Very specific own script languages
76. Unified functional testing
1. Pros
• Low “entrance” level
• High level of test scripts’ flexibility
• Good tech support
2. Cons
• Strict integration with other HP solutions
• Very specific own DSL
77. Ranorex
1. Pros
• Low “entrance” level
• Script tests are written on common languages (C#, VB,Net)
• Good tech support
2. Cons
• Paid license
78. Telerik Test Studio (Desktop)
1. Pros
• Low “entrance” level
• Great parameterization of Keyword tests
• DDT support using common formats (CSV, XLS, DB)
• Converting tests to common languages (C#, VB.NET)
2. Cons
• Only WPF-applications
79. Zeenyx
1. Pros
• Supporting complex logic
• Great organization of DDT
• Using standard .Net libraries support
2. Cons
• Need time to learn how to use
• Specific own DSL
80. MS VS Coded UI
1. Pros
• “Native” for Windows
• Supports a huge set of UI technologies
• Generated UI Map
• Ready to go infrastructure
• Good documentation and support
2. Cons
• License cost
• Relatively “low level” API
81. MS VS Coded UI + CUIT
1. Pros
• The same as for MS VS Coded UI
• Elegant “High level” API
2. Cons
• The same as for MS VS Coded UI
82. AutoIT
1. Pros
• Easy
• Universal
• Free
2. Cons
• There is no ready-to-use verification instruments
• Test = exe file
• There is no ready-to-use reports
83. Sikuli
1. Pros
• IDE is easy to learn and use
• Standard actions pack
• Supports an ability to write tests using common languages (Java, Python)
• Supports an ability to work on different platforms and with any applications
• Free
2. Cons
• Low test’s reliability
• Slow tests work
• No ability to work with texts
• Complicated to support tests
84. Jubula
1. Pros
• IDE is easy to use
• Supports an ability to work on requirement base
• Integrated DB for storing test data and results
• Free
2. Cons
• No flexibility which is ingrain to script tests
• No CI support
85. Robot Framework
1. Pros
• Their own not complex and easy-to-read Keyword-based language
• Plugins for different IDE’s
• Work with different Oss
• Different programming languages support
• Tools for creating user-own libraries
• Free
2. Cons
• High entrance level
86. Winium
1. Pros
• Familiar syntax and API
• Supports all the languages that are supported by Selenium WebDriver
• Free
2. Cons
• “Immature” testing tool
• Incomplete way of locating elements
• A lack of documentation
87. WinAppDriver
1. Pros
• Familiar syntax and API
• “Native” for Windows
• Free
2. Cons
• “Immature” testing tool
• Complicated (in special case usage)
• A lack of documentation
88. QTWebDriver
1. Pros
• Familiar syntax and API
• QT Applications oriented / “Native” (unique tool)
• Free
2. Cons
• “Immature” testing tool
• Complicated (in special case usage)
• A lack of documentation
89. PyWinAuto
1. Pros
• Extremely simple to use
• Easy to support
• Free
2. Cons
• Do not support all popular UI technologies
• CPython only
92. Why so?
“Scientific” technical prove of Trend
• Hegel’s dialectics
• Bifurcation mathematical apparat (Bifurcation Theory)
• Sedov’s law of hierarchical compensation
• Pannov-Snuks Vertical
• Big History
93. Why so?
Non-technical scientific prove of Trend
• Peter Drucker “Management. Challenges for the 21st Century”
Note: It’s a topic of the whole big conversation, and I’m sure we’re going to
get back to it, but not today…
94. How to
1. use this presentation on different project phases
2. use this presentation based on main project roles
95. What’s next (just a possible way)
• Shu
1. Use Presentation
1. Please, follow recommendations
a) “How to select proper criteria's for your project”
b) “How to define proper tool based on selected criteria's”
c) “How to link information from presentation to QA Automation metrics”
d) “How to link information from presentation to Project Health Check”
e) “How to link information from presentation to QA Automation ROI”
f) “How to use this presentation on different project phases”
g) “how to use this presentation based on main project roles”
96. What’s next
• Ha
1. Update a set of criteria's
2. Update a set of tools
3. Update Presentation
4. Read “Scientific” prove of Trend
97. What’s next
• Ri
1. Re-Read “Scientific” prove of Trend
2. Update a set of criteria's
3. Update a set of tools
4. Update Presentation
5. Predict the “Trend”
6. Manage the “Trend”
98. Next iteration
• Move from static (Presentation) to dynamic (Application)
• For example, “https://telescope.epam.com”