Every company with a digital presence aims at delivering a great digital experience. But why do some web and mobile apps succeed better than others? As part of our ongoing search to find out, we surveyed over 1,000 technical experts and business leaders from various industries.
Join us for a live webinar as we discuss the findings of this report with experts from Perfecto, Cigna and Shop.com! Topics include:
-The four main obstacles preventing digital success and how to overcome them
-How web & mobile teams are organized to meet the demand for faster releases
-The digital testing strategies that increase velocity and allow teams to keep up with consumer demand
-Why automation and real-user condition testing is critical for achieving success
One of the common challenges in the digital space is improving the speed of releases without compromising the of quality of your app. The root of the problem is the market - customer expectations are on the rise, the app market is crowded, and app development is difficult. The solution is test automation.
Watch Perfecto and Infostretch demonstrate Quantum, an established open-source test framework, to run robust, repeatable, and continuous test scenarios.
In this technical webinar, the audience will learn how to use the test framework to
-Create robust and maintainable test automation scripts
-Extend open-source with advanced automation capabilities
-Execute cross-platform mobile and web tests in parallel
-Plug the newly created tests easily to the CI (Continuous Integration) workflow
-Drive fast developer feedback with an advanced reporting library
Listen to the recording by registering here: http://info.perfectomobile.com/Summer-of-Selenium-Webinar-Registration.html
We’ll cover how to overcome common testing challenges and show you things you never thought you could automate with Selenium WebDriver, including:
-Navigation, bar code readers and iOT
-New platforms, devices and operating systems like iOS10 Beta
-Visual validation
-Zero effort test automation with Selenium: test scripts automatically generated
Adopting agile practices is a struggle for many mobile teams. While the answer sounds simple – automate process, testing, environment provisioning and deployment – in reality this can be hard to achieve. This webinar will show you how to run automation in parallel on real devices without manual intervention. Replay of live event: http://info.perfectomobile.com/Overcoming-Test-Automation-Obstacles-Webinar.html
Watch the webinar here:
http://info.perfectomobile.com/App-Dev-Daily-Grind.html?utm_source=dlc-od
Learn how to spend less time putting out fires in production, respond quickly to new platform challenges, and reclaim your time for more feature work! You'll see how to:
-Catch bugs as early as possible with improved feedback in every CI build
-Speed up test execution with Espresso and XCTest
-Quickly gain visibility into test failures that impact deployment readiness
-Perform rapid debugging and troubleshooting with access to real mobile devices right from your IDE
This year, we’ve seen incredible improvements to Selenium WebDriver and now Selenium 3.0, but what does this mean for modern teams that still have trouble balancing quality and time to market? In this webinar, we uncover how you can overcome common automated testing challenges and do things you never thought possible using the Selenium WebDriver! You will learn:
-What’s new in Selenium 3.0
-How open source is changing business dynamics
-The impact of HTML5 and Responsive Web Design in mobile development
-Bridging the gap between mobile and desktop testing strategies
-Success beyond off-the-shelf components
Your mobile test plan can't be adhoc. Watch this webinar and learn how to start testing more methodically to provide test coverage that reflects your users and ensures a great digital experience.
We'll cover the most important insights from the latest issue of the Digital Mobile Test Coverage Index, including benchmarks, geographies and the latest devices and OS's that app developers and testers need to know.
7 Keys for Unattended Test AUtomation webinar deckPerfecto Mobile
The document discusses recommendations for building a solid test automation suite. It outlines some common challenges with test automation such as executing tests across platforms and maintaining test scripts over time. It then discusses strategies for defining appropriate digital test coverage, including determining which devices, OS versions, and platforms to test. The presentation recommends starting with a small set of tests and growing automation over time. It also emphasizes debugging tests across different platforms and environments. The last part of the document demonstrates automated testing using Perfecto's tools and discusses maintaining robust automation.
One of the common challenges in the digital space is improving the speed of releases without compromising the of quality of your app. The root of the problem is the market - customer expectations are on the rise, the app market is crowded, and app development is difficult. The solution is test automation.
Watch Perfecto and Infostretch demonstrate Quantum, an established open-source test framework, to run robust, repeatable, and continuous test scenarios.
In this technical webinar, the audience will learn how to use the test framework to
-Create robust and maintainable test automation scripts
-Extend open-source with advanced automation capabilities
-Execute cross-platform mobile and web tests in parallel
-Plug the newly created tests easily to the CI (Continuous Integration) workflow
-Drive fast developer feedback with an advanced reporting library
Listen to the recording by registering here: http://info.perfectomobile.com/Summer-of-Selenium-Webinar-Registration.html
We’ll cover how to overcome common testing challenges and show you things you never thought you could automate with Selenium WebDriver, including:
-Navigation, bar code readers and iOT
-New platforms, devices and operating systems like iOS10 Beta
-Visual validation
-Zero effort test automation with Selenium: test scripts automatically generated
Adopting agile practices is a struggle for many mobile teams. While the answer sounds simple – automate process, testing, environment provisioning and deployment – in reality this can be hard to achieve. This webinar will show you how to run automation in parallel on real devices without manual intervention. Replay of live event: http://info.perfectomobile.com/Overcoming-Test-Automation-Obstacles-Webinar.html
Watch the webinar here:
http://info.perfectomobile.com/App-Dev-Daily-Grind.html?utm_source=dlc-od
Learn how to spend less time putting out fires in production, respond quickly to new platform challenges, and reclaim your time for more feature work! You'll see how to:
-Catch bugs as early as possible with improved feedback in every CI build
-Speed up test execution with Espresso and XCTest
-Quickly gain visibility into test failures that impact deployment readiness
-Perform rapid debugging and troubleshooting with access to real mobile devices right from your IDE
This year, we’ve seen incredible improvements to Selenium WebDriver and now Selenium 3.0, but what does this mean for modern teams that still have trouble balancing quality and time to market? In this webinar, we uncover how you can overcome common automated testing challenges and do things you never thought possible using the Selenium WebDriver! You will learn:
-What’s new in Selenium 3.0
-How open source is changing business dynamics
-The impact of HTML5 and Responsive Web Design in mobile development
-Bridging the gap between mobile and desktop testing strategies
-Success beyond off-the-shelf components
Your mobile test plan can't be adhoc. Watch this webinar and learn how to start testing more methodically to provide test coverage that reflects your users and ensures a great digital experience.
We'll cover the most important insights from the latest issue of the Digital Mobile Test Coverage Index, including benchmarks, geographies and the latest devices and OS's that app developers and testers need to know.
7 Keys for Unattended Test AUtomation webinar deckPerfecto Mobile
The document discusses recommendations for building a solid test automation suite. It outlines some common challenges with test automation such as executing tests across platforms and maintaining test scripts over time. It then discusses strategies for defining appropriate digital test coverage, including determining which devices, OS versions, and platforms to test. The presentation recommends starting with a small set of tests and growing automation over time. It also emphasizes debugging tests across different platforms and environments. The last part of the document demonstrates automated testing using Perfecto's tools and discusses maintaining robust automation.
Finding and fixing bugs early requires an automated UI testing strategy that fits into the release schedule. But how do you get complete, early feedback into development cycles when UI regression testing takes longer to complete than the build process?
Join this web seminar to discover how to introduce stable UI validation into every continuous integration cycle. This regression testing strategy meets the development cadence of mobile and web app teams, providing the necessary feedback early and often.
You will learn how to:
-Overcome long test cycles
-Create stable tests to run on every build
-Segment test suites to better fit into development cycles
-Drive early feedback on every build with real devices and browsers
The ultimate guide to mobile app testing with appiumheadspin2
Appium is an open-source test automation tool that allows developers to test mobile apps across platforms. It works by communicating with the mobile device and app to run automated tests scripts written in various programming languages. Appium tests can check that the user experience is seamless across different devices. The tool was initially created to test iOS apps but now supports Android as well. It has become popular for testing apps with user interfaces like games and banking apps across both iOS and Android devices.
Bringing Quality Design Systems to Life with Storybook & ApplitoolsApplitools
** Full webinar recording: https://youtu.be/R6WnEzlMHac **
Bringing design systems and component libraries to life can be a large, challenging process without the right tools. On top of that, maintaining a high level of quality throughout those systems brings its own challenge.
While there’s no shortage of ways to manually create a design system from scratch, doing so can be time consuming and can lead to technical debt when the system itself isn’t itself in a structure.
Storybook is a tool for developers that helps bring design systems and component libraries to life, providing structured tooling and a web dashboard. It gives those developers, and even designers, a way to focus on each individual component while being able to see the system from a higher perspective.
On top of that, Applitools is an automated Visual Testing solution that easily stacks right on top of Storybook with the Storybook Eyes SDK. With a single command, Applitools provides full test coverage for each component of your design system.
Join Developer Advocate, Colby Fayock, as he walks through:
How to take advantage of using Storybook to build scalable design systems
How Applitools makes automating the testing of those components easy
How to focus on building great experiences while automating quality checks with visual testing
Functional to Visual: AI-powered UI Testing from Testim and ApplitoolsApplitools
As leaders in the application of AI to test automation, Applitools and Testim have come together to simplify test creation, maintenance and execution. Join this webinar to learn how you can elevate your approach to test automation with AI-powered codeless functional and visual UI testing.
Stop Testing (Only) The Functionality of Your Mobile Apps!Applitools
The document discusses different strategies for testing mobile apps, including testing functionality, usability, performance, and more extensively than just functionality. It addresses testing on real devices versus emulators, the need for accessibility testing, and tools for testing areas like contrast, text-to-speech, location services and network bandwidth. The document also discusses visual testing strategies like using AI to detect visual differences and validating user interfaces.
Testing Hourglass at Jira Frontend - by Alexey Shpakov, Sr. Developer @ Atlas...Applitools
Alexey Shpakov presents on testing in Jira Frontend. He discusses the testing pyramid with unit, integration, and end-to-end tests. He then introduces the concept of a "testing hourglass" which adds deployment and post-deployment verification to the pyramid. Key aspects of each type of test are discussed such as using feature flags, monitoring for flaky tests, and gradual rollouts to reduce risk.
Our "Mobile DevTest Dictionary" is a go-to slideshare for developers, testers and practitioners to stay informed on the resources they need to excel at their jobs.
The slides are divided into six categories with terms covering automation and CI tools, testing styles, Agile best practices, and more. Happy reading!
3 Free Tools That Will Help You Create the Right Mobile & Web Test StrategyPerfecto by Perforce
Am I testing on the right platforms? This is the question that app developers and testers ask themselves every day. As more brands connect with users digitally, it’s getting harder to ensure a great user experience across mobile, web & wearables.
In this webinar, you’ll learn how to create an effective and customized test coverage strategy. We’ll describe how our new Test Coverage Toolkit’s combination of resources, recommendations and research can help you:
Know exactly what mix of mobile devices and browsers to test on
Keep up with the latest mobile devices, operating systems and browsers
Learn how to setup and maintain a robust and scalable test lab
Deliver a great digital user experience across devices
Web Accessibility Testing Trends and Shift Left Testing of accessibility usin...Narayanan Palani
Accessibility Testing is not easy and it needs right expertise and focus on WCAG guidelines to perform test design, execution and reporting right defects to prevent accessibility violations. This presentation helps in highlighting some of the key issues to address and best practises to use during accessibility testing.
As the digital space continues to evolve, Progressive Web Apps (PWA) are gaining momentum. PWAs aim to improve user experience and are about to become a game changer – will you be ready?
Join us for this live webinar & learn:
* What Progressive Web Apps are and why they're gaining momentum
* Key differences between Progressive Web Apps, responsive web design, hybrid and native apps
* Best practices and tools for testing Progressive Web Apps
And see a live demo of a Progressive Web App in action
"Software Quality in the Service of Innovation in the Insurance Industry"Applitools
This document discusses software quality in the insurance industry. It introduces Joe Emison, CTO of Branch Insurance, and discusses how Branch builds software frequently in small increments using test automation. It notes challenges with traditional test automation approaches and outlines Branch's approach using unit tests, API tests, and data-driven end-to-end tests run continuously. The document also discusses how ProdPerfect and Applitools can work together to provide effortless functional and visual testing through data analysis, test case discovery, and visual AI.
Have you been staying up to date on Perfecto's biggest product updates?
In this special Mid-Year edition, we will discuss the latest technology in test automation so you can ensure quality and agility for your application teams.
Topic will include:
- Apple’s recent change to XCUITest automation framework with iOS 11
- Fingerprint (touch ID) automation
- New network traffic
- Reporting at scale
- Live Demos
Stay until the end to participate in a live Q&A with our experts!
Automation is a key requirement in DevOps. Yet, the 2017 World Quality Report has shown that only 16% of tests are automated.
Whether you're in dev, test or operations, this webinar will help you solve the 5 key challenges teams face in scaling up their test automation. You will learn how to:
* Overcome tight release schedule challenges
Stabilize your test automation practices to achieve continuous testing
*Enable the DevOps pipeline activities by optimizing test execution management
*Maintain test sets that maximize productivity
Get your tool stack ready and in sync with organizational capabilities
Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...Perfecto by Perforce
Video delivery is becoming more and more prevalent on mobile applications. Customer expectations for video are higher than ever and cannot be neglected. According to Nielsen, smartphones and tablets were responsible for the highest growth rates in video consumption in 2015-2016.
In this webinar, experts from Perfecto and Accenture StormTest, and British Telecom will show how you can automate your video quality performance testing while simultaneously measuring customer experience.
The document discusses open source testing tools for mobile applications. It begins by explaining that mobile testing requires automating both the application and the full user environment. It then reviews five popular open source test frameworks - Selenium, Appium, Calabash, Espresso, and XCTest UI - comparing their suitability for different uses like web, native, and hybrid apps. Key criteria that organizations should consider when choosing a framework include supporting multiple frameworks, flexibility, autonomy, full end-to-end coverage, and unattended reliable testing. The document concludes with a demonstration of a test automation tool called Quantum that integrates various open source frameworks.
Advanced Techniques for Testing Responsive Apps and Sites -- By Aakrit PrasadApplitools
** Full webinar recording: https://youtu.be/Y2MHNnWOznQ **
Responsive web design has become the preferred approach for building sites and apps that provide an optimal viewing and interaction experience on any phone, tablet, desktop or wearable device.
However, automatically testing these responsive sites and apps can be quite a challenge, due to the need to cover all supported layouts, their respective navigation, and visible content.
This presentation is part of an hands-on advanced hands-on session (https://youtu.be/Y2MHNnWOznQ) about how to effectively test apps and sites with responsive design -- and teaches you how to:
* Implement generic tests that work for all the layouts of your app
* Control the browser and viewport size in order to accurately target layout transition points
* Incorporate layout-specific assertions in your tests
* Effectively design responsive page objects
* Visually validate the correctness of your app’s layout
* Bonus: tips for planning and executing responsive website testing
This document discusses how to improve testing of UI5 web applications. It proposes moving UI tests into the development cycle by having developers write tests in JavaScript that run directly in the browser. This allows tests to be executed frequently and catch defects earlier. It introduces the OPA (Open UI5 Application) testing framework, which allows writing tests this way by providing page objects and helpers that work with UI5 controls instead of directly manipulating the DOM. OPA aims to make UI tests stable, easy to debug and reproduce by automatically waiting for asynchronous operations to complete.
Covered in this webinar:
- Intro to Perfecto
- Digital Challenges
- Understanding the Perfecto CQ Lab
- Architecture/Setup
- Perfecto University, Community and Partner Portal
- Perfecto Solution Look and Feel
- Q&A
By the end of this webinar, you'll have a solid foundation of Perfecto's tools, resources, and products.
This document introduces UIVeri5, an end-to-end testing framework for UI5 applications. UIVeri5 uses Selenium to drive tests in a real browser similarly to how a user would interact with the application. While OPA5 provides in-browser testing, UIVeri5 has advantages like using the same JavaScript syntax as the application, reliable synchronization logic, control locators that match the UI5 API, and support for common authentication flows. The document demonstrates UIVeri5 and notes it provides page objects, screenshots in HTML reports, and is open source.
Why Apps Succeed: 4 Keys to Winning the Digital Quality GamePerfecto by Perforce
Every company with a digital presence aims at delivering a great digital experience. But why do some web and mobile apps succeed better than others? As part of our ongoing search to find out, we surveyed over 1,000 technical experts and business leaders from various industries.
Join us for a live webinar as we discuss the findings of this report with experts from Perfecto, Cigna and Shop.com! Topics include:
-The four main obstacles preventing digital success and how to overcome them
-How web & mobile teams are organized to meet the demand for faster releases
-The digital testing strategies that increase velocity and allow teams to keep up with consumer demand
-Why automation and real-user condition testing is critical for achieving success
The document discusses testing and distribution of mobile apps. It provides an overview of:
1) A mobile maturity model that organizations can use to assess their mobile strategy and capabilities across different areas including testing.
2) The importance of testing throughout the app development lifecycle from definition to development to acceptance. It describes various testing types like unit, integration, and usability testing.
3) How automated testing can help with frequent verification but still requires manual testing. It provides examples of unit and functional automated tests.
4) The different phases of testing in a project including definition to set testing requirements, development where testing is integrated, and acceptance testing by the customer.
Finding and fixing bugs early requires an automated UI testing strategy that fits into the release schedule. But how do you get complete, early feedback into development cycles when UI regression testing takes longer to complete than the build process?
Join this web seminar to discover how to introduce stable UI validation into every continuous integration cycle. This regression testing strategy meets the development cadence of mobile and web app teams, providing the necessary feedback early and often.
You will learn how to:
-Overcome long test cycles
-Create stable tests to run on every build
-Segment test suites to better fit into development cycles
-Drive early feedback on every build with real devices and browsers
The ultimate guide to mobile app testing with appiumheadspin2
Appium is an open-source test automation tool that allows developers to test mobile apps across platforms. It works by communicating with the mobile device and app to run automated tests scripts written in various programming languages. Appium tests can check that the user experience is seamless across different devices. The tool was initially created to test iOS apps but now supports Android as well. It has become popular for testing apps with user interfaces like games and banking apps across both iOS and Android devices.
Bringing Quality Design Systems to Life with Storybook & ApplitoolsApplitools
** Full webinar recording: https://youtu.be/R6WnEzlMHac **
Bringing design systems and component libraries to life can be a large, challenging process without the right tools. On top of that, maintaining a high level of quality throughout those systems brings its own challenge.
While there’s no shortage of ways to manually create a design system from scratch, doing so can be time consuming and can lead to technical debt when the system itself isn’t itself in a structure.
Storybook is a tool for developers that helps bring design systems and component libraries to life, providing structured tooling and a web dashboard. It gives those developers, and even designers, a way to focus on each individual component while being able to see the system from a higher perspective.
On top of that, Applitools is an automated Visual Testing solution that easily stacks right on top of Storybook with the Storybook Eyes SDK. With a single command, Applitools provides full test coverage for each component of your design system.
Join Developer Advocate, Colby Fayock, as he walks through:
How to take advantage of using Storybook to build scalable design systems
How Applitools makes automating the testing of those components easy
How to focus on building great experiences while automating quality checks with visual testing
Functional to Visual: AI-powered UI Testing from Testim and ApplitoolsApplitools
As leaders in the application of AI to test automation, Applitools and Testim have come together to simplify test creation, maintenance and execution. Join this webinar to learn how you can elevate your approach to test automation with AI-powered codeless functional and visual UI testing.
Stop Testing (Only) The Functionality of Your Mobile Apps!Applitools
The document discusses different strategies for testing mobile apps, including testing functionality, usability, performance, and more extensively than just functionality. It addresses testing on real devices versus emulators, the need for accessibility testing, and tools for testing areas like contrast, text-to-speech, location services and network bandwidth. The document also discusses visual testing strategies like using AI to detect visual differences and validating user interfaces.
Testing Hourglass at Jira Frontend - by Alexey Shpakov, Sr. Developer @ Atlas...Applitools
Alexey Shpakov presents on testing in Jira Frontend. He discusses the testing pyramid with unit, integration, and end-to-end tests. He then introduces the concept of a "testing hourglass" which adds deployment and post-deployment verification to the pyramid. Key aspects of each type of test are discussed such as using feature flags, monitoring for flaky tests, and gradual rollouts to reduce risk.
Our "Mobile DevTest Dictionary" is a go-to slideshare for developers, testers and practitioners to stay informed on the resources they need to excel at their jobs.
The slides are divided into six categories with terms covering automation and CI tools, testing styles, Agile best practices, and more. Happy reading!
3 Free Tools That Will Help You Create the Right Mobile & Web Test StrategyPerfecto by Perforce
Am I testing on the right platforms? This is the question that app developers and testers ask themselves every day. As more brands connect with users digitally, it’s getting harder to ensure a great user experience across mobile, web & wearables.
In this webinar, you’ll learn how to create an effective and customized test coverage strategy. We’ll describe how our new Test Coverage Toolkit’s combination of resources, recommendations and research can help you:
Know exactly what mix of mobile devices and browsers to test on
Keep up with the latest mobile devices, operating systems and browsers
Learn how to setup and maintain a robust and scalable test lab
Deliver a great digital user experience across devices
Web Accessibility Testing Trends and Shift Left Testing of accessibility usin...Narayanan Palani
Accessibility Testing is not easy and it needs right expertise and focus on WCAG guidelines to perform test design, execution and reporting right defects to prevent accessibility violations. This presentation helps in highlighting some of the key issues to address and best practises to use during accessibility testing.
As the digital space continues to evolve, Progressive Web Apps (PWA) are gaining momentum. PWAs aim to improve user experience and are about to become a game changer – will you be ready?
Join us for this live webinar & learn:
* What Progressive Web Apps are and why they're gaining momentum
* Key differences between Progressive Web Apps, responsive web design, hybrid and native apps
* Best practices and tools for testing Progressive Web Apps
And see a live demo of a Progressive Web App in action
"Software Quality in the Service of Innovation in the Insurance Industry"Applitools
This document discusses software quality in the insurance industry. It introduces Joe Emison, CTO of Branch Insurance, and discusses how Branch builds software frequently in small increments using test automation. It notes challenges with traditional test automation approaches and outlines Branch's approach using unit tests, API tests, and data-driven end-to-end tests run continuously. The document also discusses how ProdPerfect and Applitools can work together to provide effortless functional and visual testing through data analysis, test case discovery, and visual AI.
Have you been staying up to date on Perfecto's biggest product updates?
In this special Mid-Year edition, we will discuss the latest technology in test automation so you can ensure quality and agility for your application teams.
Topic will include:
- Apple’s recent change to XCUITest automation framework with iOS 11
- Fingerprint (touch ID) automation
- New network traffic
- Reporting at scale
- Live Demos
Stay until the end to participate in a live Q&A with our experts!
Automation is a key requirement in DevOps. Yet, the 2017 World Quality Report has shown that only 16% of tests are automated.
Whether you're in dev, test or operations, this webinar will help you solve the 5 key challenges teams face in scaling up their test automation. You will learn how to:
* Overcome tight release schedule challenges
Stabilize your test automation practices to achieve continuous testing
*Enable the DevOps pipeline activities by optimizing test execution management
*Maintain test sets that maximize productivity
Get your tool stack ready and in sync with organizational capabilities
Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...Perfecto by Perforce
Video delivery is becoming more and more prevalent on mobile applications. Customer expectations for video are higher than ever and cannot be neglected. According to Nielsen, smartphones and tablets were responsible for the highest growth rates in video consumption in 2015-2016.
In this webinar, experts from Perfecto and Accenture StormTest, and British Telecom will show how you can automate your video quality performance testing while simultaneously measuring customer experience.
The document discusses open source testing tools for mobile applications. It begins by explaining that mobile testing requires automating both the application and the full user environment. It then reviews five popular open source test frameworks - Selenium, Appium, Calabash, Espresso, and XCTest UI - comparing their suitability for different uses like web, native, and hybrid apps. Key criteria that organizations should consider when choosing a framework include supporting multiple frameworks, flexibility, autonomy, full end-to-end coverage, and unattended reliable testing. The document concludes with a demonstration of a test automation tool called Quantum that integrates various open source frameworks.
Advanced Techniques for Testing Responsive Apps and Sites -- By Aakrit PrasadApplitools
** Full webinar recording: https://youtu.be/Y2MHNnWOznQ **
Responsive web design has become the preferred approach for building sites and apps that provide an optimal viewing and interaction experience on any phone, tablet, desktop or wearable device.
However, automatically testing these responsive sites and apps can be quite a challenge, due to the need to cover all supported layouts, their respective navigation, and visible content.
This presentation is part of an hands-on advanced hands-on session (https://youtu.be/Y2MHNnWOznQ) about how to effectively test apps and sites with responsive design -- and teaches you how to:
* Implement generic tests that work for all the layouts of your app
* Control the browser and viewport size in order to accurately target layout transition points
* Incorporate layout-specific assertions in your tests
* Effectively design responsive page objects
* Visually validate the correctness of your app’s layout
* Bonus: tips for planning and executing responsive website testing
This document discusses how to improve testing of UI5 web applications. It proposes moving UI tests into the development cycle by having developers write tests in JavaScript that run directly in the browser. This allows tests to be executed frequently and catch defects earlier. It introduces the OPA (Open UI5 Application) testing framework, which allows writing tests this way by providing page objects and helpers that work with UI5 controls instead of directly manipulating the DOM. OPA aims to make UI tests stable, easy to debug and reproduce by automatically waiting for asynchronous operations to complete.
Covered in this webinar:
- Intro to Perfecto
- Digital Challenges
- Understanding the Perfecto CQ Lab
- Architecture/Setup
- Perfecto University, Community and Partner Portal
- Perfecto Solution Look and Feel
- Q&A
By the end of this webinar, you'll have a solid foundation of Perfecto's tools, resources, and products.
This document introduces UIVeri5, an end-to-end testing framework for UI5 applications. UIVeri5 uses Selenium to drive tests in a real browser similarly to how a user would interact with the application. While OPA5 provides in-browser testing, UIVeri5 has advantages like using the same JavaScript syntax as the application, reliable synchronization logic, control locators that match the UI5 API, and support for common authentication flows. The document demonstrates UIVeri5 and notes it provides page objects, screenshots in HTML reports, and is open source.
Why Apps Succeed: 4 Keys to Winning the Digital Quality GamePerfecto by Perforce
Every company with a digital presence aims at delivering a great digital experience. But why do some web and mobile apps succeed better than others? As part of our ongoing search to find out, we surveyed over 1,000 technical experts and business leaders from various industries.
Join us for a live webinar as we discuss the findings of this report with experts from Perfecto, Cigna and Shop.com! Topics include:
-The four main obstacles preventing digital success and how to overcome them
-How web & mobile teams are organized to meet the demand for faster releases
-The digital testing strategies that increase velocity and allow teams to keep up with consumer demand
-Why automation and real-user condition testing is critical for achieving success
The document discusses testing and distribution of mobile apps. It provides an overview of:
1) A mobile maturity model that organizations can use to assess their mobile strategy and capabilities across different areas including testing.
2) The importance of testing throughout the app development lifecycle from definition to development to acceptance. It describes various testing types like unit, integration, and usability testing.
3) How automated testing can help with frequent verification but still requires manual testing. It provides examples of unit and functional automated tests.
4) The different phases of testing in a project including definition to set testing requirements, development where testing is integrated, and acceptance testing by the customer.
This document provides an overview of DevOps and how to adopt a DevOps approach. It discusses that DevOps aims to shorten the systems development life cycle and provide continuous delivery with high software quality. The document outlines that adopting DevOps involves changes to an organization's people, processes and technologies. It provides strategies for building a collaborative culture and implementing shared goals and metrics. It also discusses implementing efficient processes for continuous integration, delivery, testing and monitoring. The document recommends technologies like infrastructure as code, collaboration tools, and release automation to support the DevOps approach.
Enabling Continuous Quality in Mobile App DevelopmentMatthew Young
This document discusses how organizations can extend continuous integration (CI) practices to mobile app development. CI allows for continuous feedback throughout development to improve quality while speeding up time to market. However, mobile app testing presents new challenges due to the large number of device and OS combinations. The document recommends that mobile CI solutions provide scalable test automation across many devices, emulate real-world conditions on real devices, and integrate seamlessly with development tools and workflows to provide actionable feedback. This will allow mobile teams to thoroughly test apps and build quality in from the start to meet demanding timelines.
The document discusses IBM's MobileFirst DevOps approach for continuously delivering high quality mobile apps and rapidly responding to feedback. It promotes leveraging collaborative development, continuous integration, release and deployment, and testing practices. Example case studies are provided that demonstrate how these practices can increase customer renewal rates, reduce release times, and decrease problems. The IBM toolset for supporting these DevOps capabilities is also outlined.
The document discusses IBM's MobileFirst DevOps approach for continuously delivering high quality mobile apps and rapidly responding to feedback. It promotes automating continuous development, testing, deployment, and monitoring processes to balance speed and quality. Key capabilities highlighted include collaborative development using Rational tools, continuous integration, testing, release, and monitoring across mobile, backend systems and cloud.
Accelerate Mobile Success with a Mobile Center of ExcellenceXamarin
From streamlining employee activities to providing customers access to your business anywhere and any time, mobile is a crucial driver in transforming the enterprise. A successful mobile program is critical in order to innovate in your business and remain competitive for your customers, but going mobile presents numerous challenges to the enterprise that can force long delivery cycles and costly projects. An incomplete mobile strategy that is executed without proper governance and delivery framework will impair your mobile programs.
What does it take to be successful with your mobile strategy? How can you navigate the multiple stages involved in creating a mobile app? How do you apply best practices and reduce maintenance costs on apps? And, lastly, how do you scale your mobile initiatives to dozens or potentially hundreds of apps across your enterprise?
A Mobile Center of Excellence (MCoE) is the key to implementing your mobile strategy and setting up a scalable solution.
* How a MCoE enables you to accelerate and scale in a manageable way
* The five stages of the Mobile App Lifecycle: Design, Build, Test, Monitor, Maintain
* The key elements to keep in mind when setting up a MCoE, including standards and governance
* Insights on MCoE’s role with respect to Security, Integration, DevOps, Testing and Partnering
Quality Assurance and mobile applications!Bagaria Swati
Quality assurance is the planned and systematic set of activities that ensures that software processes and products conform to requirements, standards, and procedures.
Processes include all of the activities involved in designing, developing, enhancing, and maintaining software.
Products include the software, associated data, its documentation, and all supporting and reporting paperwork.
QA includes the process of assuring that standards and procedures are established and are followed throughout the software development lifecycle.
Standards are the established criteria to which the software products are compared.
Procedures are the established criteria to which the development and control processes are compared.
Compliance with established requirements, standards, and procedures is evaluated through process monitoring, product evaluation, audits, and testing.
The three mutually supportive activities involved in the software development lifecycle are management, engineering, and quality assurance.
Software management is the set of activities involved in planning, controlling, and directing the software project.
Quality assurance at CodeMyMobile is a high priority and forms an integral part of our Mobile app development lifecycle.
Accelerate and Streamline Performance Testing with AI-powered Test Automation...RohitBhandari66
Performance testing is the process of determining a system's stability and responsiveness under a particular workload. Performance tests are typically conducted to assess application size, speed, resilience, and dependability.
Continuous Performance Testing and Monitoring in Agile DevelopmentNeotys
Continuous Performance testing and monitoring is the best way to ensure application performance with quicker development cycles. Balancing Agile and DevOps velocity with the need for ongoing performance testing and monitoring is essential. We call it Continuous Performance Validation.
DevOps evolution architecting the modern software factory - cloud expo east 2017Anand Akela
This document discusses the evolution of DevOps and how companies are adopting DevOps practices like continuous delivery to accelerate software delivery and improve customer experience. It outlines how traditional development methods can no longer keep up with rising customer expectations for faster and higher quality software. Companies are turning to DevOps and agile methodologies like continuous development, testing and delivery to reduce cycle times, improve quality and collaboration between development and operations teams. The document provides examples of how companies across industries like PayPal, L'Oreal, Sprint and Charter have benefited from DevOps adoption including increased velocity, reduced costs and better customer satisfaction.
A new approach to delivering applications with speed, quality, and scale to accelerate business success
Experience the next generation of Application Lifecycle Management – with support for waterfall projects, agile, and everything in between.
implementing_ai_for_improved_performance_testing_the_key_to_success.pdfsarah david
Experience a revolution in software testing with our AI-driven Performance Testing solutions at Cuneiform Consulting. In a world dominated by technological advancements, implementing AI is the key to unlocking unparalleled software performance. Boost your applications with speed, scalability, and responsiveness, ensuring a seamless user experience. Cuneiform Consulting leads the way in reshaping quality assurance, adhering to the predictions of the World Quality Report for AI's significant role in the next decade. Join us to stay ahead, save costs with constant AI-powered testing, and explore the boundless possibilities of AI/ML development services. Contact us now for a future-proof digital transformation!
Intuit - How to Scale Your Experimentation ProgramOptimizely
Here’s the playbook Intuit uses to increase its experimentation velocity — even when they face traffic limitations.
Mike Loveridge is not new to running experimentation teams. Before Intuit, he built out programs at Ancestry.com, GE, Humana, and CheapOair. He's an expert at making experimentation work at high velocity, even in traffic-challenged situations.
In this webinar, Mike Loveridge shared his best practices for making CRO work at high velocity, key lessons from scaling multiple teams, and why he's bullish on the future of "test and learn".
IT organisations are measured based on how they mitigate risk and ensure changes adhere to compliance policies. High-performing organisations pull Information Security earlier into the development process by automating compliance tests.
Becoming a high-performing, risk averse organisation is about two things:
• How frequently (and automatically & trivially) you can run compliance assessments;
• and once you discover vulnerabilities, how quickly you can then remediate them.
Are you ready to bridge the gap between DevOps & InfoSec?
The journey to Continuous Automation - Chef AutomateKangaroot
Chef Automate helps companies achieve continuous automation across their software delivery process. It is a single platform that allows companies to detect issues, correct problems, and automate workflows to improve speed, efficiency, and reduce risk. The platform provides visibility across an organization's entire infrastructure and enables centralized management of compliance policies. It treats infrastructure and application configurations as code, allowing for consistent, automated updates at scale.
Creating a successful continuous testing environment by Eran KinsbrunerQA or the Highway
This document discusses continuous testing and provides an overview of key concepts. It defines continuous testing as executing automated tests as part of the software delivery pipeline to rapidly obtain feedback on release candidates. The benefits of continuous testing discussed include fast feedback, continuous visibility, and testing that matches different skill levels. It also covers topics like test authoring best practices, key performance indicators for continuous testing, and the potential future role of machine learning. Continuous testing is presented as a way to mature an organization's path toward DevOps practices.
UiPath Test Automation using UiPath Test Suite series, part 1DianaGray10
In this session, we will showcase how to revolutionize automated testing for your software, automation, and QA teams with UiPath Test Suite.
In part 1 of UiPath test automation using UiPath Test Suite – developer series, we will cover,
Software testing overview
What is software testing
Why software testing is required
Typical test types and levels
Continuous testing and challenges
Introduction to UiPath Test Suite
UiPath Test Suite family of products
Speaker:
Atul Trikha, Chief Technologist & Solutions Architect, Peraton and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Option 2015- Getting Started with Optimizely for MobileOptimizely
This document provides an overview of Optimizely for mobile apps. It discusses how mobile usage is growing rapidly and time spent on mobile devices now exceeds desktop. It then shares customer stories from French Girls and Secret Escapes who significantly improved key metrics like activation and signups through mobile A/B testing. The document demonstrates Optimizely's visual editor and code capabilities. It proposes a framework to test across acquisition, engagement, retention and monetization. Specific mobile testing ideas are outlined for each area like layouts, feature placement, checkout flows, permissions and reviews. Best practices are shared around integrating Optimizely, planning a testing roadmap, and verifying experiments.
Similar to Why Apps Succeed: 4 Keys to Winning the Digital Quality Game (20)
Option 2015- Getting Started with Optimizely for Mobile
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
1. Why Apps Succeed
How enterprises can overcome challenges in
delivering digital experiences
2. Some housekeeping before we start
6/30/2016 2
Submit questions
using the Q&A
panel.
We’ll email you the
webinar recording
and slides.
Complete the
survey following
the webinar.
We’ll have a live
poll.
View webinar in
full screen mode
for optimal
viewing!
3. With us today:
Paul Dumas
Director of API
Shop.com
Paul Bruce
Developer Evangelist
Perfecto Mobile
Maheema Raghunath
Mobile QA Manager
Cigna
4. What we’ll cover:
• “Why Apps Succeed” Report / Methodology
• What is a “Digital Experience”?
• Key Findings
• 4 Challenges to Digital Excellence
• Releasing new functionality faster
• Testing for real user environments
• Staying up to date on devices and platforms
• Building a more efficient lab for mobile testing
• Takeaways
• Q & A
5. Methodology
• April-May 2016
• 1,000+ respondents
• Demographics
• Roles
• Industry
• Size of Organization
• Geographic
• Questions
• Digital experience
• Responsive web
• Automation
• Devices and Testing
10. Digital Experience: Perspective on Engagement
• ...from the perspective of a customer
• ...over multiple devices and channels
• ...across different locations and times of day
• ...at varying levels of interaction
What it means to your organization:
• ...adoption in new technologies
• ...demanding more from all teams
• ...delivering more than any single channel
• ...presenting challenges to how we do business
12. The Journey to Digital For Apps Team
“Mobile also” strategy
projects run separately
“Agilefall” process
Business Synergy (-)
“Mobile first” strategy
projects run separately
Adopting DevOps Process
Business Synergy (+)
Better understanding of
customer needs.
Mobile + Web converge
under same organization
Business Synergy (++)
Technology to business
alignment
Still lacking a common
language that connect app
quality and quality of
engagement of the biz.
Unified Digital Organization
Continuous measurement/
improvement of QoE and
Digital experience.
Shared KPIs for both
business AND engineering
teams.
Common language for
evaluating quality of app and
risk to the business
Have a mobile initiative
Optimizing lifecycle to
shorten feedback loop.
DevOps
Merge Web + Mobile
Full Digital Strategy
(Organization)
(Paradigm Shift)
(Process)
(Technology)
14. Live Poll: What Experiences Do You Provide?
What experiences does your organization provide?
• Mobile and web apps
• Only mobile app
• Only web (dot.com) site/app
16. A Unified Web & Mobile Strategy Is Prevalent Everywhere
17. Providing a Reliable and Consistent Experience Is Challenging
What’s in the 3%?
How is your digital testing team
structured? - Unified team
● No challenge: 68%
● Challenge: 59%
What conditions do you test
against?
● Background apps: 55% / 71%
● Low memory: 61% / 51%
How many employees? > 1000
● No challenge: 39%
● Challenge: 50%
19. #1: Releasing new digital functionality faster
2 or fewer 3-6 7-12 13-25 26 or more 2 or fewer 3-6 7-12 13-25 26 or more
Only 21% > 1/mo
Est. 31% in 2016
21. Is mobile testing really harder than web testing?
• Physical devices
• Real conditions
• Latest updates
• Execution speed
“What percentage of your mobile/web testing is done
automatically versus manually?”
N/A 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% N/A 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
22. Live Poll: Responsive Web
Is your customer web experience a responsive web app?
• Yes, our responsive app works for both desktop & mobile browsers
• No, we have separate versions for desktop and mobile
• I don’t know
• Doesn’t apply to my organization
25. Real user environments in testing:
• Identify your target users (“persona”)
• Integrating user traits into testing
• Switching networks
• Background Apps
• Interruptions
• Low memory / battery
• Geography matters
• Actionable reporting
• Sharable results
• Visual validation of test steps
26. #3: Staying up to date on devices and platforms
• iOS / Android have separate
release cycles
• Android manufacturers release
all the time
• Operating system updates
• Customers migrate when they
want/need to
• Migration means support for
multiple versions at the same
time bit.ly/testcoveragekit
27. Varying your strategy for testing digital experiences
• Visual validation
facilitates interactions
between Dev & QA
• Most apps require
navigation
• Matching speed of test
execution to dev/test
workflows
30. A Strategy for Digital Excellence
Organizational Goals
Team Structure
Testing Process
31. Takeaways
Maheema Raghunath
Mobile QA Manager
Cigna
“Change is the new Business as Usual for
anyone in the Digital solutions market.
As such, your Digital testing strategy must be
adaptive, responsive, user-centric, and
above all agile to succeed in the dynamic
landscape of technology.”
32. Takeaways
“Anyone employed with the same business
should be on the same team.
How you structure your SDLC will either
create a collaborative team environment or
it will encourage isolation.”Paul Dumas
Director of API
Shop.com
33. Takeaways
Paul Bruce
Developer Evangelist
Perfecto Mobile
“Digital experiences require more than
testing a single application or platform.
They require quality to be built in to the
mindset of technical teams and business
leaders.”
34. Q & A
Submit questions using the chat panel
Download the Report!
bit.ly/whyappssucceed
Editor's Notes
Without further ado, I’d like to introduce our guests for today’s webinar:
Maheema Raghunath is the Mobile Quality Manager for Cigna Health and has years of experience managing software quality teams in multiple locations around the world. Maheema (she’s sitting right next to me here), how are you today?
And also we have Paul Dumas, Directory of API platform at Shop.com. Paul has been integral to numerous project in his past related to Digital Promotions and now works as a product owner and manager over the APIs that serve internal product groups and external partners. Paul, welcome. Wish you could be with the two of us over here, but glad you could join today’s conversation. How are you?
Also, since there are two Paul’s here, we can all refer to me today as “Bruce” for simplicity’s sake.
So today I want to cover some of the basics of our report and have that serve as an opportunity to have a discussion about how technical teams are dealing with shifts in what and how we deliver digital experiences. We’ll start with...
So just as background for the data you’ll see today and in the report, it’s available online…
We had some demographic questions to help segment in deeper analysis.
Questions about how frequently they released software in 2015 and how they see those expectations will change in 2016.
What their development and testing environments look like, their strategies for testing.
The importance of user experience across all digital channels in their organization.
Their challenges, team structure, and then a few questions related specifically to Perfecto’s line of business over how they manage their testing lab.
Based on the demographic questions, we can get a sense of who is represented in the findings. We had a lot of people from the high tech and financial services industries. Also, telecoms, retail, and healthcare responded. From that we also see that just about half of the respondents were from the enterprise segment, though there were plenty of others from startups on through to mid-size organizations too.
Now I want to take a moment to define a term that we use in the report and in today’s webinar. “Digital experience”
Everyone has a mobile phone and everyone ends up using its browser. We also use our desktops more than ever. This is not news.
What is new is that we don’t use them exclusively for any one task. As consumers, we also expect that the voice of a brand is the same regardless of what device we use. The fact is, “and” is the normal state, not “or” when it comes to how we experience things.
A practical example is Finn. Finn is a gadget lover and loves watching documentaries in high-def. …This is a perfect example of an engaging digital experience built to be great from the customer’s perspective.
That’s why “digital experience” is such a powerful concept for organizations to adopt right now. It is aligned with how people actually use what we provide.The characterizing aspect of a “digital experience” mindset is that it’s all about engaging users from their perspective. … And it has an impact on the organization…
@Maheema @Paul: any color you want to add?
And beyond that, it’s important to understand how classical thinking over channels (the delivery of your organization’s message) versus devices. Interactions with a consumer don’t just happen one device at a time; they happen through all the devices to varying degrees, purposely designed to do so.Through the conversations we have with our customers, we also see that doing this successfully requires a unified strategy across teams and devices.
@Paul: you’re no stranger to aligning teams and resources to business strategy. How have you seen the way organizations adapt with new strategies for engaging customers over multiple channels?
So let’s take a look at two of the findings in the report.
When asked, “How important is it to your organization to deliver a reliable, consistent, and engaging user experience across all digital channels?”, a combined 80% of respondents said that it was a matter of survival or critical to their competitive positioning.
This is very interesting because I’d expect leadership (people who are setting the vision) to understand this, but I’m surprised that so many people from various lines of business understand its competitive importance.@Maheema: You’ve covered projects across devices; how have you seen the quality landscape change now that we’re unifying multiple devices and channels in the customer’s digital experience?
@Paul: In your work with APIs, how do you see “digital experience” thinking impact the business lines your APIs serve?
From the report, we also see very few respondents say they have just mobile only or web only environments, and that a mix of the two is by far the majority. We also see that a majority of organizations have one team for both mobile and desktop web testing. Makes sense now that responsive web design has hit it’s stride technologically. Looking into the data further, we see that 80% of small orgs and 50% of enterprises have a single team for their web presence on both mobile devices and in web browsers. If I had to guess, I’d imagine that their web team’s mobile testing strategy has considerable overlap with their native mobile app’s testing strategy in terms of reserving device time and synchronizing design resources and branding.
@Maheema: from your point of view, what are some advantages and disadvantage if there’s one team for mobile devices and one for desktop browser environments?
@Paul: where does the back-end team fit? How have you seen enterprises evolve testing to accommodate rapid API development used on the front-end?
We also see that many respondents consider providing a reliable and consistent experience quite a challenge. Two-third say that it is a major challenge. Of the small sliver of people who don’t think it’s a challenge, there were small but potentially relevant differences.
But really, I want to leverage the experience of our guests in helping to shed light on why this is a challenge.
@Paul: What are some things you’ve seen get in the way of delivering quickly and consistently?@Maheema: How about from your vantage point: what are some ways that consistency and reliability can be hard to achieve at the same time?
Also in the report, we identified four main challenges that organizations currently face when delivering excellent digital experiences.
The first is quite frankly, growth. People are having a hard time keeping up with releasing functionality faster, and the software business never sleeps. We asked the question “How many product releases…?” both for 2015 and what people estimate 2016 will look like for them. As you can see, from 21% to 31%, a 10 point difference represents 50% growth YoY. That’s huge expectations on technical teams, considering all that goes into a release.
I know some shops have tried to go Continuous Delivery, most of the enterprises we talk to are heavily agile, but have had some difficulty going to CD.
@Maheema: what have you seen in the teams you’ve worked with in the past? Are expectations that high?
@Paul: What do you think is driving this kind of growth in expectations?
At first it seems like a “duh” moment. Everyone knows that automation is required to accelerate development and delivery. But when I dove deeper into the data, I found that while a majority of people seem to be on board, really only around half of all organizations have automated more than 40% of testing. Both in what people say they need to do to speed up and what they don’t quite have yet, it’s clear that automated testing is a top requirement to speed up.
@Paul: At a management level, where have you seen teams get stuck when they don’t have proper automation in place?
@Maheema: How have you seen testing teams adapt to go from manual to automated test technologies?
When we asked people what percentage of automated testing they perform, there’s considerable differences in the trend between mobile and web testing. Looks like the difficulty starts earlier with mobile testing than with web.
@Maheema: as our resident QA expert, what can you tell us about why mobile testing is such a challenge? Why don’t we see more of it?
And speaking of speed, I have to mention as a side note, when digging in deeper and segmenting by release frequency, I did notice a difference related to responsive web teams which lead me to a thought process around the technology you’re delivering. Does it lend itself to fast deployment? Does it require the user to accept updates, or is the new version seamlessly delivered? Do you as the vendor control all the resources required for a “successful” deployment of new versions, or are we waiting for things like the app store to accept our new version?
With things like responsive websites and APIs, you have the authority to update them without prior notification.
@Paul: as someone who owns the decisions around back-end technologies like APIs, how do you see the teams (like an API team vs. a mobile or web team) making different decisions around releases? What’s the coordination look like between teams that depend on each other for functionality?
Another challenge we identified was that while a good portion of people test with other apps running in the background and test network switching, other real-world conditions we experience every day like interruptions outside the app, low memory and battery conditions, and performance problems aren’t as prevalent in the testing strategy.
@Maheema: Why is this? What do you focus on in your testing strategy? How do you know if and when to incorporate greater realism into your tests?
@Paul: I wanted to ask you, specifically related to performance testing, where does that fit into the overall strategy for quality in your products?
So at Perfecto, what we see in our engagements with enterprises is that when they are transitioning to a digital experience, it’s important to have a framework around what that means. Across multiple devices, personas become really important; having a concrete understanding of who you’re designing for really translates into the overall design and testing strategy. Integrating traits of the real world into your strategy makes measuring success along the customer journey much easier, not to mention detecting failure or regression proactively.
And though there were a lot of U.S. companies who responded to our survey, it’s the end-user whose geographic region matters. It’s their experience, and if you’re not thinking about that in your simulations, you may want to check with marketing or ops analytics to see how much of the world you’re actually serving versus what you should be covering in automated tests.
The last thing I’ll mention here is that diagnosing issues as they arise really needs reporting to contain things like visuals, steps to reproduce, and what conditions mobile devices were under when failures happen. This dramatically simplifies and speeds hand-off between testing experts, developers, and anyone else involved.
Obviously there’s lots of devices out there, but it’s the ones that your customers are using that matters.
A digital experience is only as strong as its weakest link, so you need late-breaking support for the latest OS updates to test that when your customers go through that process, they’ll be happy. That means keeping up with major hardware and software vendor cycles, OS updates, could even mean that you’ll get pushed to test more based on what the development team uses for a software platform, i.e. Xamarin/Cordova
Importantly though, supporting your apps and sites on multiple platforms means that you need a solid understanding of what’s coming out and when.
@Maheema: what’s it like going through an OS update or certifying new devices? Where have you seen testing teams work through these challenges well? What slows this process down?
Additionally, I’d suggest that visual validation (much like I mentioned around reporting) dramatically simplifies the hand-offs and communications between teams and actors when troubleshooting and resolving issues.
Everyone in mobile generally seems to agree that navigation is pain to test, and even the cutting-edge app providers like Facebook and Google require major architectural changes to avoid this with stateless, argument-based workflows. For us normal people, we have apps that have navigation like buttons, menus, and input elements. If you are struggling to speed automated testing, you may want to look into how efficient your script and testing framework is around navigation.
The more efficient your tests are and the more relevant information you get out of them, the easier it will be for your organization to incorporate them into other workflows. Developers especially need to cycle fast when they’re implementing code, and your testing strategy needs to reflect this. Do as much automated unit testing as you can provided it doesn’t unnecessarily impede development time, and split off long-running tests into a build or nightly cycle.
Near to our heart at Perfecto is how people are still trying to manage in-house testing labs. We provide a cloud-based solution for that, so of course we had to ask some questions specifically about it. Once again, we see that the top challenge is keeping up with new browser versions and devices.
We also see that for those who have an on-prem lab, it take staff to run it.
@Maheema: in your experience, how does a cloud-based device lab enable organizations to ship better software? How does near-real-time availability of latest devices and versions help technical teams keep up with demand to deliver faster?
@Paul: in your experience, how have you seen transitions to cloud-based services help software teams re-focus on their core competencies?
I want to drill into that point for a moment because it’s at the core of what Perfecto does, this is where I come in with my one major value proposition.
We see that delivering really great digital experiences place considerable demand on organizations to provide real devices for testing from two directions: 1) external influences like hardware and framework updates from the market, and 2) internal teams who are trying to speed delivery through parallel (hence more) testing. Doing this yourself is like a science in and of itself. It’s really hard, and takes constant maintenance.
Questions:Prashant: How can QA get more unit testing from developers? => Why are developers not shipping unit tests? Low coverage or no coverage? Dev testing is all about TTM slippage risk; untested code takes longer to resolve downstream. PoCs are tough to make the case for testing unless part of a strategic motion.
Xien (Jen): What’s the best tools for testing cross web site and mobile app? => depends on the skills and team; open source is good but needs to have support to fit into the enterprise; flexibility is also important along the toolchain; standards help
John: DevOps is hard because everyone wants to use different tools. How can we fix this? => less about tools, more about attitude and sesing the need to change; fragmented toolchain can hinder automation; pilot how successful DevOps is in one or two projects and use that as your own case study