Enabling CI / CD in your mobile development process means understanding the different solutions, overcoming unique challenges and ensuring the right ownership of the processes. In this webinar, you will learn the steps required to enable Continuous Delivery of Mobile Application Platforms.
This talk describes how we use a scaled approach for CI/CD. The system is set up for iOS and Android Apps but many of the concepts presented are applicable for any type of application. We will cover the different pipeline stages a change goes through, how we automate many levels of testing, treat our CI infrastructure as code, which key metrics we use and we track them on dashboards. All this demonstrates how we can get close to Continuous Delivery for platforms still ruled by App stores.
Presenters: Kristian Lindwall - Tribe lead, Spotify
Presented on Mar 22 at 12:30pm
Over the last 2 years, Spotify has put a serious effort into raising the bar on mobile continuous delivery. This talk will be about that journey. What major obstacles have we overcome, where are we and what are the current biggest challenges?
Talk at Iqnite conference for software quality and testing about how we have do continuous delivery at here.com
Together with Siddharth Somasundaram
http://www.iqnite-conferences.com/suisse/programme/programme.aspx
Continuous integration is old hat in the web world, but it’s still rare for native mobile apps. For true continuous integration, we ship every commit directly to production – but this is clearly not realistic in the world of native apps, where binaries must be published in the App Store (with Apple’s week-long review process) and Google Play, then downloaded by members.
On the engineering side, we needed an aggressive goal to ensure we didn’t fall back into the pattern of manual verification of each release. We also wanted our product partners to be free to ship as often as they want (without annoying members of course!). We settled on a rule that we call “3x3”.
CloudTest Lite is the newest member of SOASTA’s growing line of CloudTest editions. It is an enterprise-class offering that enables rapid test creation and real-time resolution for performance testing early and often throughout the development lifecycle. Delivering internal testing behind the firewall on a single server, customers can execute performance tests of up to 100 concurrent virtual users in development, QA, staging or production. With CloudTest Lite, customers can:
- Test Web and mobile applications, including applications using the latest technologies from HTML5 to REST Web services
- Quickly build tests with visual test creation tools
- Integrate application, system, and network monitoring data
- Analyze results in real-time through an interactive, integrated dashboard
- Easily upgrade to a more scalable CloudTest edition to meet expanding testing requirements
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...SOASTA
How to use Jenkins for Continuous Load Testing and Mobile Automation
Today’s rapid development pace demands continuous testing, and Jenkins, the leading open source automation platform, has emerged as the hub of continuous delivery. SOASTA and CloudBees have tapped Jenkins to enable more test types and approaches that utilize cloud and agile processes for higher quality apps.
Join this free webinar and learn:
How to use Jenkins for continuous delivery and load testing of mobile applications
How to incorporate cloud resources into your development and test environments
Using the largest global test cloud for load generation
CloudBees’ on premise, in the cloud and hybrid solutions for continuous delivery with Jenkins
SOASTA’s Jenkins plugins for testing with real mobile devices and tracking performance baselines
Experts from both companies will share stories and demonstrations that will help you implement a continuous approach to quality.
Mobile performance metrics and performance monitoring meetup 2017 05 10Bitbar
Bitbar hosted a local meetup in Helsinki where we discussed mobile performance metrics, performance testing/monitoring and using production data to optimize testing.
This talk describes how we use a scaled approach for CI/CD. The system is set up for iOS and Android Apps but many of the concepts presented are applicable for any type of application. We will cover the different pipeline stages a change goes through, how we automate many levels of testing, treat our CI infrastructure as code, which key metrics we use and we track them on dashboards. All this demonstrates how we can get close to Continuous Delivery for platforms still ruled by App stores.
Presenters: Kristian Lindwall - Tribe lead, Spotify
Presented on Mar 22 at 12:30pm
Over the last 2 years, Spotify has put a serious effort into raising the bar on mobile continuous delivery. This talk will be about that journey. What major obstacles have we overcome, where are we and what are the current biggest challenges?
Talk at Iqnite conference for software quality and testing about how we have do continuous delivery at here.com
Together with Siddharth Somasundaram
http://www.iqnite-conferences.com/suisse/programme/programme.aspx
Continuous integration is old hat in the web world, but it’s still rare for native mobile apps. For true continuous integration, we ship every commit directly to production – but this is clearly not realistic in the world of native apps, where binaries must be published in the App Store (with Apple’s week-long review process) and Google Play, then downloaded by members.
On the engineering side, we needed an aggressive goal to ensure we didn’t fall back into the pattern of manual verification of each release. We also wanted our product partners to be free to ship as often as they want (without annoying members of course!). We settled on a rule that we call “3x3”.
CloudTest Lite is the newest member of SOASTA’s growing line of CloudTest editions. It is an enterprise-class offering that enables rapid test creation and real-time resolution for performance testing early and often throughout the development lifecycle. Delivering internal testing behind the firewall on a single server, customers can execute performance tests of up to 100 concurrent virtual users in development, QA, staging or production. With CloudTest Lite, customers can:
- Test Web and mobile applications, including applications using the latest technologies from HTML5 to REST Web services
- Quickly build tests with visual test creation tools
- Integrate application, system, and network monitoring data
- Analyze results in real-time through an interactive, integrated dashboard
- Easily upgrade to a more scalable CloudTest edition to meet expanding testing requirements
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...SOASTA
How to use Jenkins for Continuous Load Testing and Mobile Automation
Today’s rapid development pace demands continuous testing, and Jenkins, the leading open source automation platform, has emerged as the hub of continuous delivery. SOASTA and CloudBees have tapped Jenkins to enable more test types and approaches that utilize cloud and agile processes for higher quality apps.
Join this free webinar and learn:
How to use Jenkins for continuous delivery and load testing of mobile applications
How to incorporate cloud resources into your development and test environments
Using the largest global test cloud for load generation
CloudBees’ on premise, in the cloud and hybrid solutions for continuous delivery with Jenkins
SOASTA’s Jenkins plugins for testing with real mobile devices and tracking performance baselines
Experts from both companies will share stories and demonstrations that will help you implement a continuous approach to quality.
Mobile performance metrics and performance monitoring meetup 2017 05 10Bitbar
Bitbar hosted a local meetup in Helsinki where we discussed mobile performance metrics, performance testing/monitoring and using production data to optimize testing.
Join us as we walk you through several technical challenges and solutions around test automation for responsive sites. See live demos around testing responsive web sites using extended test automation capabilities that can increase your test coverage suite.
You'll learn how to:
- Author basic selenium scripts using a powerful recorder for both mobile and web
- Define a robust XPath using an innovative free online tool
- Build a test lab for parallel script Execution on multiple devices and browsers
- Gain high quality analysis post execution with mature digital reporting
Drive Faster Quality Insights through Customized Test Automation - Part 2Perfecto by Perforce
When making the transformation to DevOps and agile, many organizations find it hard to meet tough product release schedules and to cope with large data sets. Triaging failures across multiple platforms has become tedious and time-consuming.
Reporting test-driven development (RTDD) is an innovative approach to agile testing that helps you write and implement tests with the end in mind (i.e., the test reports). RTDD puts structure, governance, and advanced capabilities into your test automation strategy.
RTDD enables the entire product team to collaborate and make data-driven decisions in real time, resulting in test scenarios and test suites that are structured and easy to manage.
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...SOASTA
Build, Test, Deploy Mobile Apps with a fully automated Continuous Intergration solution..in the Cloud...for free...
Kohsuke Kawaguchi, Jenkins creator, and Mark Prichard of CloudBees join SOASTA for a demos and discussion of CI for mobile in the cloud. From Nov. 15, 2012 webinar. (a repeat of Sept 27, 2012 webinar)
Every DevOps implementation is unique, but certain challenges are the same. Establishing fast feedback loops, formulating a better definition of done, and anticipating technical gaps to delivery are all milestones to transformation.
In this session, our panel of experts will share their experiences in DevOps transformation. Learn how to:
-Improve your team’s definition of done to cut down rework
-Identify automation gaps that lead to later holding patterns
-Inject fast feedback to catch bugs as early as possible
-Establish autonomy and ownership over winning customer-focused experiences
Covered in this Session:
- Intro to Perfecto
- Monitoring Discovery Questions
- Monitoring Key Requirements
- Real User Monitoring vs. Synthetic Monitoring
- Steps to Set Up Monitoring
- Demo
- Success Story
- Q&A
Covered in this Session:
Intro to Perfecto
Automation Testing with Appium and Perfecto
- High Level Overview of Appium & how Perfecto fits in
Mobile Application Types
Understanding the CQ Lab - Architecture/Setup
iOS, Appium and Perfecto
- As of iOS 10, Apple has announced deprecation of its legacy UI Automation framework. Official Apple testing framework for
- iOS 11 is XCUITest framework.
What is Perfecto doing and additional information
Q&A
Deeper Root Cause Analysis to App Performance Bottlenecks with Appvance APM I...Clever Moe
Appvance coined the term "Proactive APM" (Application Performance Management) to demonstrate techniques and tools for business managers, engineers, and testers a way to anticipate the end-user experience while the app is under development. It simulates user load on apps once the app launches. This allows for instant diagnoses when there are production issues, by comparing expected transaction times with potential issues. If you are already using New Relic, you’ll want to add Appvance PerformanceCloud to your app development and testing environment.
Covered in this webinar:
- What is Continuous Integration and Why Should You Care?
- CI Workflow and Tools
- CI Example
- Perfecto and CI
- Q&A
By the end of this webinar, you'll be recommending Perfecto for all your customers' CI needs!
Exercising and Scaling Up Mobile DevOps in the EnterpriseBitbar
Adopting the mobile devops culture, processes and practices in any organization may not happen overnight. The transformation from agile to true mobile devops requires identification of inefficiencies and understanding of how process, practice and infrastructure can be scaled up.
Stay tuned and join our upcoming webinars at bitbar.com/testing/webinars/
Use Jenkins For Continuous Load Testing And Mobile Test AutomationClever Moe
Building mobile apps and Ajax apps effectively requires a blended approach to test automation. Frank Cohen, CTO/Founder at Appvance, shows how to leverage the best application performance test methodology with test tools to deliver excellent Ajax, iOS and Android apps. Learn how to: * Effectively choose a mobile testing method for Agile shops * Reduce costs by choosing the best tools (Appium, Jenkins, Appvance PerformanceCloud) * Scale-up your mobile testing to thousands of test suites automatically * The mix-and-match mobile testing methodology for just-in-time performance testing
STARWest: Use Jenkins For Continuous Load Testing And Mobile Test AutomationClever Moe
Frank Cohen's session from the STARWest (Software Test Automation) conference, October 2014. Building mobile apps and Ajax apps effectively requires a blended approach to test automation. Frank Cohen, CTO/Founder at Appvance, shows how to leverage the best application performance test methodology with test tools to deliver excellent Ajax, iOS and Android apps. Learn how to: * Effectively choose a mobile testing method for Agile shops * Reduce costs by choosing the best tools (Appium, Jenkins, Appvance PerformanceCloud) * Scale-up your mobile testing to thousands of test suites automatically * The mix-and-match mobile testing methodology for just-in-time performance testing
Your Framework for Success: introduction to JavaScript Testing at ScaleSauce Labs
There are countless ways to set up your automated testing environment. When it comes to stability and maintainability, it’s crucial to choose the right frameworks at the beginning of the journey, to set yourself up for success and save yourself time and headaches further down the road.
In addition to traditional WebDriver-based JavaScript frameworks like Selenium or WebdriverIO, many new projects have popped up in recent years that provide even more capabilities, particularly for web UI testing. With the emergence of new frameworks like Puppeteer, Playwright, Cypress, and others, how do you choose which one’s right for you and your team? And how do you integrate the chosen framework into your testing practice, to shift testing left and speed up your software delivery lifecycle?
In this webinar, Sauce Labs experts will provide an overview of the JavaScript framework landscape for automated functional testing, with a focus on Cypress, TestCafe, and Playwright. They will explore the differences between these frameworks, and discuss how to choose and implement the right tool for your project.
Key Takeaways:
- Understand how browser automation emerged over the last decade
- Learn about the technical differences of traditional and new frameworks
- Learn to pick the right JavaScript framework for your project
Speakers:
Christian Bromann | Staff Software Engineer, Sauce Labs
Daniel Graham | Senior Software Engineer, Sauce Labs
Testers are under big new pressure to use Agile software methods, Ajax environments, and Mobile environments. In this session, Frank Cohen of Appvance will show how Best Buy and PepsiCo cope with the changes: How they select test tools, test management tools, and create operational test data. See how this all fits together in an Agile environment using Continuous Integration, Source Repository, Test Scripting, and Agile Test Management for Agile Stories. Frank will show practical examples - to the code level - to deal with desktop browsers, iOS and Android native apps, WebKit and Mobile Web browsers.
Continuous Integration, Deploy, Test From Beginning To End 2014Clever Moe
Frank Cohen, CTO/Founder at Appvance, teaches developers and testers how to become more closely aligned with easily deployable and configurable tools such as Jenkins CI and performance testing platforms. Learn how to: * Merge Agile SDLC and Performance Testing * Speed-up test operations by configuring Jenkins for automatic build, deploy, and tests * Instantly identify functional and performance issues using Jenkins as a performance dashboard * Use effective choices in Jenkins deployment – in the cloud, hosted, or in your datacenter
Agile-plus-DevOps Testing for Packaged ApplicationsWorksoft
Guest presenter Forrester VP and Principal Analyst Diego Lo Giudice joined Worksoft Agile expert Chris Kraus for an exploration of the state of adoption of Agile, DevOps and test automation in the enterprise packaged application space. Learn why it is important to include testing of packaged apps and mainframe as part of an Agile-plus-DevOps strategy and how the adoption of Agile and DevOps varies for packaged vs. custom-built applications. View the recorded event at: https://www.worksoft.com/downloads/worksoft-forrester-webinar-agile-plus-devops-testing-for-packaged-applications.
Drive Faster Quality Insights through Customized Test AutomationPerfecto by Perforce
When making the transformation to DevOps and agile, many organizations find it hard to meet tough product release schedules and to cope with large data sets. Triaging failures across multiple platforms has become tedious and time-consuming.
Reporting test-driven development (RTDD) is an innovative approach to agile testing that helps you write and implement tests with the end in mind (i.e., the test reports). RTDD puts structure, governance, and advanced capabilities into your test automation strategy.
RTDD enables the entire product team to collaborate and make data-driven decisions in real time, resulting in test scenarios and test suites that are structured and easy to manage.
Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...Perfecto by Perforce
Video delivery is becoming more and more prevalent on mobile applications. Customer expectations for video are higher than ever and cannot be neglected. According to Nielsen, smartphones and tablets were responsible for the highest growth rates in video consumption in 2015-2016.
In this webinar, experts from Perfecto and Accenture StormTest, and British Telecom will show how you can automate your video quality performance testing while simultaneously measuring customer experience.
CloudBees Continuous Integration and Test with Appvance PerformanceCloudClever Moe
Frank Cohen's keynote talk at the CloudBees Jenkins user conference in 2013. Shows how to extend CloudBees Jenkins to all aspects of testing: Functional, Performance, Stress, and Security Tests
Covered in this webinar:
- Perfecto 101
- Core Diffs for Insurance
- Insurance Case Studies
- Open Discussion
By the end of this webinar, you'll be chomping at the bit for your next opportunity to work with an insurance customer and Perfecto.
Speaker:
Amir Rozenberg
Director of Product Management
Perfecto
Experitest-Infosys Co-Webinar on Mobile Continuous IntegrationExperitest
Experitest & Infosys held a co-webinar, discussing Continuous Integration & Mobile Performance Test Strategies, Tools and Certification services that can guarantee a quality app for the end user.
Serhii Nezdolii about Mobile apps development (Android, iOS) best practices: Test Driven Development (unit/UI tests), Continuous Integration (Jenkins), Continuous Delivery (TestFlightApp)
Сергій Нездолій про кращі практики розробки мобільних додатків
Сергей Нездолий о лучших практиках разработки мобильных приложений
Join us as we walk you through several technical challenges and solutions around test automation for responsive sites. See live demos around testing responsive web sites using extended test automation capabilities that can increase your test coverage suite.
You'll learn how to:
- Author basic selenium scripts using a powerful recorder for both mobile and web
- Define a robust XPath using an innovative free online tool
- Build a test lab for parallel script Execution on multiple devices and browsers
- Gain high quality analysis post execution with mature digital reporting
Drive Faster Quality Insights through Customized Test Automation - Part 2Perfecto by Perforce
When making the transformation to DevOps and agile, many organizations find it hard to meet tough product release schedules and to cope with large data sets. Triaging failures across multiple platforms has become tedious and time-consuming.
Reporting test-driven development (RTDD) is an innovative approach to agile testing that helps you write and implement tests with the end in mind (i.e., the test reports). RTDD puts structure, governance, and advanced capabilities into your test automation strategy.
RTDD enables the entire product team to collaborate and make data-driven decisions in real time, resulting in test scenarios and test suites that are structured and easy to manage.
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...SOASTA
Build, Test, Deploy Mobile Apps with a fully automated Continuous Intergration solution..in the Cloud...for free...
Kohsuke Kawaguchi, Jenkins creator, and Mark Prichard of CloudBees join SOASTA for a demos and discussion of CI for mobile in the cloud. From Nov. 15, 2012 webinar. (a repeat of Sept 27, 2012 webinar)
Every DevOps implementation is unique, but certain challenges are the same. Establishing fast feedback loops, formulating a better definition of done, and anticipating technical gaps to delivery are all milestones to transformation.
In this session, our panel of experts will share their experiences in DevOps transformation. Learn how to:
-Improve your team’s definition of done to cut down rework
-Identify automation gaps that lead to later holding patterns
-Inject fast feedback to catch bugs as early as possible
-Establish autonomy and ownership over winning customer-focused experiences
Covered in this Session:
- Intro to Perfecto
- Monitoring Discovery Questions
- Monitoring Key Requirements
- Real User Monitoring vs. Synthetic Monitoring
- Steps to Set Up Monitoring
- Demo
- Success Story
- Q&A
Covered in this Session:
Intro to Perfecto
Automation Testing with Appium and Perfecto
- High Level Overview of Appium & how Perfecto fits in
Mobile Application Types
Understanding the CQ Lab - Architecture/Setup
iOS, Appium and Perfecto
- As of iOS 10, Apple has announced deprecation of its legacy UI Automation framework. Official Apple testing framework for
- iOS 11 is XCUITest framework.
What is Perfecto doing and additional information
Q&A
Deeper Root Cause Analysis to App Performance Bottlenecks with Appvance APM I...Clever Moe
Appvance coined the term "Proactive APM" (Application Performance Management) to demonstrate techniques and tools for business managers, engineers, and testers a way to anticipate the end-user experience while the app is under development. It simulates user load on apps once the app launches. This allows for instant diagnoses when there are production issues, by comparing expected transaction times with potential issues. If you are already using New Relic, you’ll want to add Appvance PerformanceCloud to your app development and testing environment.
Covered in this webinar:
- What is Continuous Integration and Why Should You Care?
- CI Workflow and Tools
- CI Example
- Perfecto and CI
- Q&A
By the end of this webinar, you'll be recommending Perfecto for all your customers' CI needs!
Exercising and Scaling Up Mobile DevOps in the EnterpriseBitbar
Adopting the mobile devops culture, processes and practices in any organization may not happen overnight. The transformation from agile to true mobile devops requires identification of inefficiencies and understanding of how process, practice and infrastructure can be scaled up.
Stay tuned and join our upcoming webinars at bitbar.com/testing/webinars/
Use Jenkins For Continuous Load Testing And Mobile Test AutomationClever Moe
Building mobile apps and Ajax apps effectively requires a blended approach to test automation. Frank Cohen, CTO/Founder at Appvance, shows how to leverage the best application performance test methodology with test tools to deliver excellent Ajax, iOS and Android apps. Learn how to: * Effectively choose a mobile testing method for Agile shops * Reduce costs by choosing the best tools (Appium, Jenkins, Appvance PerformanceCloud) * Scale-up your mobile testing to thousands of test suites automatically * The mix-and-match mobile testing methodology for just-in-time performance testing
STARWest: Use Jenkins For Continuous Load Testing And Mobile Test AutomationClever Moe
Frank Cohen's session from the STARWest (Software Test Automation) conference, October 2014. Building mobile apps and Ajax apps effectively requires a blended approach to test automation. Frank Cohen, CTO/Founder at Appvance, shows how to leverage the best application performance test methodology with test tools to deliver excellent Ajax, iOS and Android apps. Learn how to: * Effectively choose a mobile testing method for Agile shops * Reduce costs by choosing the best tools (Appium, Jenkins, Appvance PerformanceCloud) * Scale-up your mobile testing to thousands of test suites automatically * The mix-and-match mobile testing methodology for just-in-time performance testing
Your Framework for Success: introduction to JavaScript Testing at ScaleSauce Labs
There are countless ways to set up your automated testing environment. When it comes to stability and maintainability, it’s crucial to choose the right frameworks at the beginning of the journey, to set yourself up for success and save yourself time and headaches further down the road.
In addition to traditional WebDriver-based JavaScript frameworks like Selenium or WebdriverIO, many new projects have popped up in recent years that provide even more capabilities, particularly for web UI testing. With the emergence of new frameworks like Puppeteer, Playwright, Cypress, and others, how do you choose which one’s right for you and your team? And how do you integrate the chosen framework into your testing practice, to shift testing left and speed up your software delivery lifecycle?
In this webinar, Sauce Labs experts will provide an overview of the JavaScript framework landscape for automated functional testing, with a focus on Cypress, TestCafe, and Playwright. They will explore the differences between these frameworks, and discuss how to choose and implement the right tool for your project.
Key Takeaways:
- Understand how browser automation emerged over the last decade
- Learn about the technical differences of traditional and new frameworks
- Learn to pick the right JavaScript framework for your project
Speakers:
Christian Bromann | Staff Software Engineer, Sauce Labs
Daniel Graham | Senior Software Engineer, Sauce Labs
Testers are under big new pressure to use Agile software methods, Ajax environments, and Mobile environments. In this session, Frank Cohen of Appvance will show how Best Buy and PepsiCo cope with the changes: How they select test tools, test management tools, and create operational test data. See how this all fits together in an Agile environment using Continuous Integration, Source Repository, Test Scripting, and Agile Test Management for Agile Stories. Frank will show practical examples - to the code level - to deal with desktop browsers, iOS and Android native apps, WebKit and Mobile Web browsers.
Continuous Integration, Deploy, Test From Beginning To End 2014Clever Moe
Frank Cohen, CTO/Founder at Appvance, teaches developers and testers how to become more closely aligned with easily deployable and configurable tools such as Jenkins CI and performance testing platforms. Learn how to: * Merge Agile SDLC and Performance Testing * Speed-up test operations by configuring Jenkins for automatic build, deploy, and tests * Instantly identify functional and performance issues using Jenkins as a performance dashboard * Use effective choices in Jenkins deployment – in the cloud, hosted, or in your datacenter
Agile-plus-DevOps Testing for Packaged ApplicationsWorksoft
Guest presenter Forrester VP and Principal Analyst Diego Lo Giudice joined Worksoft Agile expert Chris Kraus for an exploration of the state of adoption of Agile, DevOps and test automation in the enterprise packaged application space. Learn why it is important to include testing of packaged apps and mainframe as part of an Agile-plus-DevOps strategy and how the adoption of Agile and DevOps varies for packaged vs. custom-built applications. View the recorded event at: https://www.worksoft.com/downloads/worksoft-forrester-webinar-agile-plus-devops-testing-for-packaged-applications.
Drive Faster Quality Insights through Customized Test AutomationPerfecto by Perforce
When making the transformation to DevOps and agile, many organizations find it hard to meet tough product release schedules and to cope with large data sets. Triaging failures across multiple platforms has become tedious and time-consuming.
Reporting test-driven development (RTDD) is an innovative approach to agile testing that helps you write and implement tests with the end in mind (i.e., the test reports). RTDD puts structure, governance, and advanced capabilities into your test automation strategy.
RTDD enables the entire product team to collaborate and make data-driven decisions in real time, resulting in test scenarios and test suites that are structured and easy to manage.
Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...Perfecto by Perforce
Video delivery is becoming more and more prevalent on mobile applications. Customer expectations for video are higher than ever and cannot be neglected. According to Nielsen, smartphones and tablets were responsible for the highest growth rates in video consumption in 2015-2016.
In this webinar, experts from Perfecto and Accenture StormTest, and British Telecom will show how you can automate your video quality performance testing while simultaneously measuring customer experience.
CloudBees Continuous Integration and Test with Appvance PerformanceCloudClever Moe
Frank Cohen's keynote talk at the CloudBees Jenkins user conference in 2013. Shows how to extend CloudBees Jenkins to all aspects of testing: Functional, Performance, Stress, and Security Tests
Covered in this webinar:
- Perfecto 101
- Core Diffs for Insurance
- Insurance Case Studies
- Open Discussion
By the end of this webinar, you'll be chomping at the bit for your next opportunity to work with an insurance customer and Perfecto.
Speaker:
Amir Rozenberg
Director of Product Management
Perfecto
Experitest-Infosys Co-Webinar on Mobile Continuous IntegrationExperitest
Experitest & Infosys held a co-webinar, discussing Continuous Integration & Mobile Performance Test Strategies, Tools and Certification services that can guarantee a quality app for the end user.
Serhii Nezdolii about Mobile apps development (Android, iOS) best practices: Test Driven Development (unit/UI tests), Continuous Integration (Jenkins), Continuous Delivery (TestFlightApp)
Сергій Нездолій про кращі практики розробки мобільних додатків
Сергей Нездолий о лучших практиках разработки мобильных приложений
Top Best Practices for Successful Mobile Test AutomationFred Beringer
Mobile apps have brought a whole new set of challenges when it comes to testing: Fast paced development cycles with multiple releases per week, multiple app technologies and development platforms to support, tons of devices and form factors, and additional pressure from enterprise and consumers less patient with low quality apps. With these new challenges, come a new set of mistakes testers can make!
Fred has worked with dozens of mobile test teams to help them avoid common traps when building test automation for mobile apps and would like to share some best practices that could be useful to a lot of developers and testers starting with mobile test automation.
Best practices such as:
• When, what and where to automate?
• Picking the right wait to handle unreliable back-end calls or device performance
• Building testability in a mobile app
• Automating the automation (!)
• Mix and match performance testing and functional testing
In this talk, Fred will bring some real stories (struggles!) and how small changes in process made these mobile apps 10x more reliable!
Improving Android app testing with Appium and Sauce LabsIsaac Murchie
Test Android application in a better way, using Appium and Sauce Labs. Don't be locked into Android's way of doing things.
Talk given at Apps World North America 2015 (https://www.apps-world.net/northamerica/).
Continuous Load Testing with CloudTest and JenkinsSOASTA
Two key challenges to continuous load testing are provisioning a test system to handle the load and accessing load generators to drive the traffic.
In this webinar from SOASTA & CloudBees, you will learn how to:
Build realistic automated web performance tests and run them in Jenkins
Architect and launch a test environment that auto-provisions in the cloud
Manage a load generation grid to drive load tests in a lights-out mode
Establish a performance baseline in your daily Jenkins reports
Join Perfecto & CloudBees for a presentation on how to drive mobile app quality feedback in every build, on real devices. Watch a demo featuring the CloudBees Jenkins Workflow showcasing automated testing with Perfecto's Continuous Quality Lab.
We Are Social's comprehensive new Digital in 2016 report presents internet, social media, and mobile usage statistics and trends from all over the world. It contains more than 500 infographics, including global data snapshots, regional overviews, and in-depth profiles of the digital landscapes in 30 of the world's key economies.
Pimp your Continuous Delivery Pipeline with Jenkins workflow (W-JAX 14)CloudBees
Continuous delivery pipelines are, by definition, workflows with parallel job executions, join points, retries of jobs (Selenium tests are fragile) and manual steps (validation by a QA team). Come and discover how the new workflow engine of Jenkins CI and its Groovy-based DSL will give another dimension to your continuous delivery pipelines and greatly simplify your life.
Sample workflow groovy script used in this presentation: https://gist.github.com/cyrille-leclerc/796085e19d9cec4a71ef
Jenkins workflow syntax reference card: https://github.com/cyrille-leclerc/workflow-plugin/blob/master/SYNTAX-REFERENCE-CARD.md
This presentation was a part of a webinar series titled "How To Combine Back-End & Front-End Testing with BlazeMeter & Sauce Labs" which you can find in Sauce Labs slideshare account. This presentation walks through what Sauce Labs provides.
Continuous Integration for Mobile App TestingMartin Smith
An introduction to Continuous Integration with a focus on mobile app testing. This presentation takes you through the benefits, tools and systems needed to make CI a success.
Enterprise QA and Application Testing ServicesHemang Rindani
Cygnet’s innovation and insight-driven software testing services have paved way for numerous path-breaking software applications. Our meticulous approach towards application testing eliminates pesky bugs, reduces the time-to-market while optimizing the total-cost-of-ownership.
Enterprise QA and Application Testing ServicesCygnet Infotech
Cygnet’s innovation and insight-driven software testing services have paved way for numerous path-breaking software applications. Our meticulous approach towards application testing eliminates pesky bugs, reduces the time-to-market while optimizing the total-cost-of-ownership.
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...RapidValue
A live webinar hosted by RapidValue Solutions on "Making Test Automation 10X Faster for Continuous Delivery".
Key takeaways:
1. Achieving test automation in a DevOps world
2. Building a business-tailored test automation framework
3. Overcoming limitations of open source tools
4. Case study: Creating 2000+ test cases in less than a month for a product development firm
5. Demo: Zero-code test automation for non-testers using AccuRate ( test automation suite by RapidValue)
Top 5 automation testing tools to gear up website developmentBJIT Ltd
Web application testing solutions optimize ROI, reliability, and turnaround time. Website testing smoothers out code and eliminates bugs, helping you to meet business goals. Automation testing solutions are vital in today's fast-paced software development community to deliver quality products quickly. According to the World Quality Report, a lack of test automation tools hinders QA testing's growth. Continuous Integration (CI), Automated testing systems now focus on improving testing coverage and utilization.
Read more: https://bjitgroup.com/bjit-blog
The quality assurance checklist for progressive testingMaitrikpaida
Quality assurance (QA) is a strategic way of preventing mistakes and defects in developed products and avoiding problems when delivering products or services to customers. This defect prevention in quality assurance differs subtly from defect detection and rejection in quality control and has been referred to as a shift left since it focuses on quality earlier in the process
The Quality Assurance Checklist for Progressive TestingCygnet Infotech
Quality assurance (QA) is a strategic way of preventing mistakes and defects for engineering solutions that are ready-to-market. At Cygnet we adopt the progressive testing approach to deliver high performing solutions. This presentation highlights key factors we consider when creating QA strategies.
Software Testing is the last phase in software development lifecycle which has high impact on the quality of the final product delivered to the customer. Even after being a critical phase, it was not given the importance as it actually deserves. The schedule constraints and slippage carry forwarded from the previous phase also make the testing phase more torrent. History reveals that the situation has changed with time, wherein testing is now visualized as one of the most critical, phase of software development. This makes software testing a discipline which demands for continuous and systematic growth. Software testing is a trade-off between Cost, Time and Quality.
Implementing Continuous Integration to Improve Software QualityRocket Software
Continuous Integration (CI) can dramatically improve the effectiveness of the software development process, which in turn can lead to improved product quality. This session provides a case study of the CI implementation for U2 databases and tools. We will cover just what is CI, examine the challenges faced, explore the business value of CI and how it can improve quality, and view a demonstration of CI projects.
"Software Quality in the Service of Innovation in the Insurance Industry"Applitools
** Webinar recording: **
Branch Insurance is disrupting the insurance industry by allowing customers to bundle home and car insurance in as little as 30 seconds.
What exactly is under the hood that helps a company like Branch to disrupt a well-established industry such as insurance?
In this webinar, Joe Emison -- Co-founder and CEO of Branch Insurance -- shared the technology he relies on. He also discussed in detail his approach to software quality, his requirements from technology partners, his tech-stack, and how AI has helped him on this journey.
Joe was joined by Erik Fogg -- Co-Founder & CRO of ProdPerfect -- and Daniel Levy -- Sr. Director of Product Marketing at Applitools -- as they demonstrate how Branch Insurance has achieved effortless, self-updating functional and visual testing that gives them an unparalleled advantage of deploying faster at lower costs, all while making QA coverage one less thing for Joe's team to worry about.
UiPath Amsterdam DEV meet-up For Developers, By DevelopersCristina Vidu
Who can join?
UiPath RPA Developers in the Netherlands and anyone from the UiPath global community interested in our experience exchange. This is an EN language event.
Please note, that this event will have a dedicated focus on UiPath RPA Developers and that we remain the right to deny participation in case of oversubscription.
Agenda:
14:40 Keynote: Dion Mes (UiPath) on UiPath Integration Service
14:55 Keynote: Peter Vlam (Nationale-Nederlanden) on Citizen Development
15:10 Deep-Dive sessions (2 rounds with 4 topics)
1. Configuration management using JSON - Worth more than you might think (Mike de Waard, Tech Lead @Nationale-Nederlanden)
2. AI Center and use-cases (Thomas Janssen, Senior RPA Developer & Trainer @Node1)
3. RPA Testing with UiPath Test Manager (Remco Kwinkelenberg, Principal Sales Engineer EMEA @UiPath )
4. RPA x Low-Code: combining UiPath & Mendix for end-to-end process improvement (Sander ter Horst, Senior Manager @Tacstone)
1
DevOps Continuous Integration & Delivery - A Whitepaper by RapidValueRapidValue
In this whitepaper, we will deep dive into the concept of continuous integration, continuous delivery and continuous deployment and explain how businesses can benefit from this. We will also elucidate on how to build an effective CI/CD pipeline and some of the best practices for your enterprise DevOps journey.
Keys to continuous testing for faster delivery euro star webinar TEST Huddle
Your business needs to deliver faster. To accommodate, Development needs to introduce fewer changes but in a much more frequent cadence. This creates a challenge for test teams to keep up with the rapid pace of change without compromising on quality. Automation is paramount to the success or failure of Continuous Delivery, and Continuous Testing enables early and frequent quality feedback throughout the CI/CD pipeline.
In this webinar, Eran & Ayal will explore how to implement Continuous Testing to ensure high quality releases in a Continuous Delivery environment; including what to test and when to automate new functionality in order to optimize your efforts.
Is Codeless Automation Testing Revolutionizing the Testing Industry.pdfMindfire LLC
Codeless automation testing has been an industry buzzword for a while, and with good reason. It is quickly becoming an indispensable tool in test automation. Automation testing validates software’s proper functioning and features before launching it into production. Automation testing uses scripted sequences executed by various testing tools. It helps reduce human errors in application testing, simplifies the testing process into a set of scripts, ensures faster checking of the system, and runs multiple tests a day.
Similar to Managing Continuous Delivery of Mobile Apps - for the Enterprise (20)
Simplify Salesforce Testing with AI-Driven Codeless ToolsSauce Labs
Testing Salesforce Apps presents numerous challenges for enterprise organizations. Teams have to navigate complex architecture, integration workflows, and continuous changes in the customized SFDC implementation, as well as a wide range of different applications hosted on Salesforce Cloud. If left unchecked, these challenges can hamper critical enterprise processes like the revenue-generating Quote to Cash process.
During this webinar, you will learn how to automate functional testing and thoroughly test both the UIs and the APIs in your Salesforce applications using AutonomIQ’s AI-driven codeless tool. We’ll discuss how Aryaka Networks, a global leader in WAN transformation solutions, uses AutonomIQ to autonomously test critical business processes like Quote to Cash in their customized Salesforce application, and we’ll show you how to streamline UI testing to improve test creation, execution, and maintenance, and easily add API testing to your strategy for better coverage.
Key Takeaways:
Simplify the creation of your test scripts using plain English statements and a codeless studio
Learn how to autonomously create UI and API tests for Salesforce and integrations with other applications
Ensure the health of your end-to-end SFDC applications for key business processes like quote to cash
Testing on Mobile Devices with Location ServicesSauce Labs
During this webinar we look into location services on Android and iOS real devices, as well as emulators and simulators.
We provide you with tips and tricks on when to change the mobile Geo-IP and when to change the mobile GPS, how to use ADB commands to enable the device location, and how to handle the location services permission alerts. We also discuss Appium capabilities for Location Services, using GeoLocation with Appium Desktop, and more.
Key takeaways:
- Understand what Location Services are
- Understand GPS compare to Geo-IP
- Know the Appium commands for Location Services
- The differences in the use of Location Services between Android and iOS
- Learn how to automate tests that involve Location Services
Automating Hybrid Applications with AppiumSauce Labs
When creating a mobile application, organisations have a few options to choose from; mobile web, native or a hybrid application. Where web apps are just websites that can be accessed on the internet via a mobile browser like Chrome or Safari, native apps are applications that are developed for a specific platform such as Android or iOS. Hybrid apps are different because they possess elements from native apps and web apps.
When automating web applications, Selenium commands are used. Nine out of ten times the same automation script can be used for mobile web applications as our desktop web applications. With native apps however, we need to look deeper into the differences between Android and iOS apps before we can use Appium commands.
But how should you automate hybrid apps, can or do you need to choose one of the two automation strategies or is there also a hybrid approach for automating hybrid apps?
That’s what we are going to talk about during this webinar. We will be looking into how to detect a hybrid application for Android and iOS, the do’s and the don’ts when it comes to automating a hybrid application and we will provide you with tips and tricks on how to make this work for both Android and iOS.
By the end of this webinar, you’ll be able to create your own Appium scripts to automate Android and iOS hybrid mobile applications.
Key Takeaways:
- Understand what a hybrid mobile application is
- How to detect a hybrid mobile application
- Learn how iOS and Android handle hybrid mobile applications
- Learn how to automate hybrid mobile applications
Quality at Speed: More API Testing, Less UI TestingSauce Labs
Whether your company is a digital native or you’re just starting or well on your way to digital transformation, you know that your web services, mobile apps, and API programs need faster time-to-market without increasing risk.
More full-stack and backend developers as well as QA/testing, architecture, and DevOps leaders are trying to inject rocket fuel into their agile development by doing more API testing. But how much UI testing can be moved over to much faster API testing? And then, how short can you make your testing sprints with API testing?
With the right provisioning of UI, visual, and API testing, your organization can measurably improve DevOps metrics as you begin to do far more testing in much less time - without increasing on-hand IT resources.
In this webinar, Sauce Labs experts will clarify what parts of the “quality spectrum” are better covered by UI testing vs. API testing. Learn why API testing can be much faster and more reliable than UI testing, and how you can leverage API testing to achieve quality at speed.
Key Takeaways:
- Easily extend your Selenium and Appium UI testing suite with API testing automation for much faster, more reliable functional, integration, and load/performance testing
- Implement a CI/CD pipeline and DevOps workflows safely and securely with Sauce Labs full quality spectrum testing
- Achieve quality at speed with significant improvements in time to market and quality to market
Creating Digital Confidence with Test AutomationSauce Labs
Engineering teams understand the importance of a comprehensive continuous testing strategy to build digital confidence, improve user experience, and accelerate release velocity. However, when beginning on the journey to continuous testing, the task of building and executing a strategy that provides clear value can be challenging. Whether it’s designing automation from scratch, understanding where you can scale the value of your tests throughout the pipeline and across teams, or demonstrating the value that quality brings to larger business objectives, building a test automation strategy sometimes creates a web that is seemingly too complex to untangle.
In this webinar, Yoosuf Maktoum, Senior Manager of Quality Engineering at Sysco Corporation, will share a test automation design and implementation strategy that helped his own team achieve success. Yoosuf will discuss a unique test automation design pattern that both supports and accelerates automation efforts. This framework, leveraging open source technologies, enables reusability, smarter and faster automation, and is suitable in both a DevOps and Agile workflow. He will then demonstrate how this framework can be applied to a single test automation script for functional and nonfunctional tests, test data management, and test environment management, as well as how it can support testing for both legacy and modern applications. Through these methods, his team is able to provide quality as a service across the organization.
Attendees of this session will learn:
- Basic design principles to consider when building out automation, and how open source can augment your strategy
- How to apply a single automation framework across various types of testing (web, mobile, API, and standalone automation)
- Strategies for aligning testing with business objectives to demonstrate value to leadership
The challenge for every product is to ship bug-free code as often as possible. Whether you are an early stage startup with a pilot application or a large corporation with myriad services, you’re dealing with this problem every day.
We usually end up with either too little or too much testing and it’s hard to find the sweet spot. Too little testing and you have bugs and application instability, leading to time spent fixing bugs and manually regression testing your apps. You’re asking yourself, “isn’t there an easier way to do this?” Too much testing and you have slow release times and high automation maintenance costs. In this scenario, you’re asking yourself, “are the bugs I’m catching worth the time I’m spending maintaining this code?”
In this webinar, software engineer Kate Green will go over a framework for evaluating your testing situation in order to find your organization’s sweet spot.
Key Takeaways
- Understanding where you are today
- Identifying weak, brittle, or buggy parts of your application
- Figuring out where to test first, and with what types of tests
- How to pare down an excessively large automation suite
Measuring test effectiveness
Using Axe to Add Accessibility Checks to Your Existing Selenium TestsSauce Labs
Accessibility is no longer a nice to have but rather a must have for many applications. Luckily there are things like the W3C’s WCAG (Web Content Accessibility Guidelines) that help testers understand accessibility standards. But wait, it gets better for teams that are using Selenium. This is because adding accessibility checks to your automation is both quick and easy.
In this webinar, Magenic Practice Lead Troy Walsh will show how to leverage Axe, an accessibility testing engine, to add accessibility checks to your existing Selenium test suite. You will see just how easy it is, and be left wondering why it took you so long to get started.
Key Takeaways
- Why accessibility has become a must have for many applications
- How to use the W3C’s Web Content Accessibility Guidelines to understand accessibility standards
- How to easily add accessibility checks to your existing Selenium suite using Axe
How Open Source Helps to Bring Back Product ObsessionSauce Labs
When a company relies heavily on open source, it is a common practice to develop strategies and long term goals to manage the relationship between the company’s products and the open source ecosystem. We created the Open Source Program Office to:
- Make sure the important open source projects for Sauce are in a healthy state
- Motivate all Sauce Labs employees to consume and contribute to OSS in a simple, secure and healthy way
- Facilitate communication between product and the open source ecosystem
- Bring developers closer to the community to enable innovation and product obsession
- Shape and build important standards for Sauce Labs, such as WebDriver, in collaboration with other open source groups
This talk will show how we are doing all this in small steps, planning for the long run and involving all teams to increase the sense of belonging of OSS. And more importantly, it will show why having an open source strategy matters, and how can this benefit everyone in the long term.
Key Takeaways
- Why Sauce Labs created the Open Source Program Office, current projects and vision for the future
- Why having a healthy open source ecosystem matters and how that can help your organization down the road
- How open source can motivate teams to develop a product obsession
Webinar: A Sneak Peek at Selenium 4 with Simon StewartSauce Labs
Selenium 4 is coming. What’s in it? In this webinar, Simon Stewart, creator of WebDriver and core-contributor to the Selenium project, will talk about the next major Selenium release.
- How is Selenium 4 different from Selenium 3?
- What are the most relevant features?
- Can you really deploy it into the Cloud?
In this webinar, you will find out everything you ever wanted to know about Selenium 4, including demos of some of the new features! Watch the webinar: https://saucelabs.com/selenium-4
[Deu] Test Automatisierung Mit Web Driver.ioSauce Labs
In diesem Webinar schauen wir uns ein Open Source Framework genauer an: Webdriver.IO. Es ist eines der längsten entwickelten Projekte mit einer großen Community. Wir schauen uns an, wie die Automatisierung von Browsern oder mobilen Geräten überhaupt funktioniert und wie man Webdriver.IO geschickt dazu einsetzen kann, dies in einer Reihe von Test Skripten zu organisieren.
Accelerating Innovation: Leveraging Open Source to Optimize Your Shift-Left I...Sauce Labs
In this in-depth webcast, Joanna Schloss and Thomas Boyles of Sauce Labs will join Bloor Group analyst Eric Kavanaugh to examine the link between open source and successful DevOps. Drawing on their personal experience as engineers building technology within a DevOps framework, Schloss and Boyles will discuss:
- Why open source technologies are often the missing link for businesses struggling to achieve their DevOps objectives
- How progressive organizations are leveraging open source to optimize their shift-left initiatives, implement automated testing and accelerate innovation
- How open source can simultaneously insulate your organization against risk while also encouraging exploration and innovation
- The role and relevance of open source for different players in the DevOps world, from QAs and SDETs to developers and heads of engineering
Accelerating Your Digital Agenda with Continuous Testing ft. ForresterSauce Labs
Presenting 2019 developer research, Diego Lo Giudice, Vice President, Principal Analyst at Forrester Research, will provide insight into how enterprise organizations are adopting and adapting for quality at great speed, while exploring:
- How this increasing emphasis on speed and quality has put testing in the eye of the Agile+DevOps hurricane
- What continuous testing means for testers, developers and business users today
Diego will also present findings on the trends and practices poised to shape the testing market in 2019 and beyond.
How to Measure Success in Continuous TestingSauce Labs
In this webinar, Amir Rozenberg and Fernando Vidal will discuss the Sauce Labs Continuous Testing Benchmark Report, a new index based on insights gleaned from the more than 2 billion tests run on the Sauce Labs Continuous Testing platform. The index can be used by any organization to evaluate their progress towards continuous testing. Joining Amir and Fernando will be Phil Wells from the New York Times, a Sauce Labs customer that has achieved a nearly perfect 100 against the Continuous Testing Benchmark index.
Key takeaways:
- The components of the new continuous testing index
- What makes those components such strong maturity indicators
- How can organizations improve on each of the metrics
- What happens organizationally when those metrics are improved
- How the NY Times manages their continuous testing pipeline to deliver quality crosswords while driving constant improvements
From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...Sauce Labs
Hear from Verizon Media’s Venu Narayanabhatla (Director, Software Development Engineering) and Sauce Labs’ Alissa Lydon (Continuous Testing SME/Product Marketing Manager) as they discuss:
- Why Verizon Media decided to standardize their testing practices across a number of distributed teams, and how they implemented that change
- The development of Screwdriver, now an open source CI tool, and how it solved internal challenges and enabled teams to embrace continuous integration
- Their decision to integrate Screwdriver with Sauce Labs, and how it allowed for scaling to 2.7 million automated tests run per month against all of their applications
5 Steps to Jump Start Your Test AutomationSauce Labs
With the acceleration of software creation and delivery, test activities must align to the new tempo. Developers need immediate feedback to be efficient and correct defects as those are introduced. The path to achieving this vision is to build a reliable and scalable continuous test solution.
All beginnings are hard. Having a well-defined plan outlining the approach for your organization to create test automation is key to ensure long term success. Join Diego Molina, Senior Software Engineer at Sauce Labs as he discusses:
The importance of setting up the team correctly from the start
Choosing the right Testing Framework for your organization
Identifying the right scenarios and workflows to test
Learning to avoid common pitfalls at the beginning of the transformation journey
Sauce Labs Webinar: Rising Importance of Software TestingSauce Labs
Our own Marcus Merrell, Director of Technical Services in Customer Success and Thomas Boyles, Director of Engineering in Development, will speak with Aberdeen Research Director Jim Rapoza and discuss:
- How testing is evolving to better meet the demands and current trends in DevOps and application development
- The challenges organizations are facing when it comes to delivering high performing and reliable applications across platforms
- Strategies leading organizations are following to shift testing left and right
- How continuous testing can help you become a leader
Selenide is an open source library that can make a huge impact and accelerate software delivery by introducing concise API, shorter expressions and many other capabilities. In this SauceCon 2019 presentation, Hima Bindu Peteti explains:
- Key features of Selenide that can be used to make automation code simpler, easier to read and more maintainable
- The most effective test automation design patterns with Selenide
- Selenide support for Angular-based applications and other advanced Javascript libraries
- How to use Selenide with Cucumber for BDD
- Execution and generation of reports
Closer To the Metal - Why and How We Use XCTest and Espresso by Mario Negro P...Sauce Labs
In this SauceCon 2019 presentation, Mario describes the practices that ABN AMRO adopted in mobile teams when it comes to testing native applications on real devices. Since using Espresso and XCUITest is still relatively uncommon for large apps and there are various unique challenges due to being in an EU-regulated industry with various security restrictions, Mario will share the ABN AMRO team’s experiences, including:
- A brief architectural overview of the Mobile Banking app: why it is all native (Objective-C/Swift and Java/Kotlin), how it communicates with other apps and websites
- Why ABN AMRO choose to adopt Espresso and XCUITest: the advantages and the limitations of this choice
- How ABN AMRO runs their test pipelines to spread them across time and devices and prevent teams from being blocked
Continuous Delivery for "Mature" Codebases by Melisa BenuaSauce Labs
When starting up a greenfield project, it’s easy to take advantage of the most modern development practices. But what about the rest of us, who are working on codebases greater than five minutes old? How do you take code that’s four years and hundreds of thousands of SLOC, and turn that into a lean, mean, continuous-deploying machine? In this SauceCon 2019 presentation, Melissa Benua walks through what continuous integration and deployment means for teams working on mature code bases, and what the roadmap looks like to get from a release cycle that may take weeks or months to one that deploys on-demand.
Building Automation Engineers From Scratch by Jenny BrambleSauce Labs
Creating automation engineers from manual testers is hard. Even if testers are willing, they have a lot of hurdles to get over to feel like the same kind of subject matter experts in automation as they are in manual testing.
As a career-long manual tester making the leap to automation, Jenny Bramble has experience to explain frustrations and provide solutions. In this SauceCon 2019 presentation, she discusses managing the expectations of testers and their managers (what’s the time frame? Why isn’t this working?), techniques for teaching (such as games! Pair/mob programming! Software fundamentals!), and how to know when testers have made it (what should manual testers be aiming for when they start?)
18. Agile Testing Success Mantras!
One team approach
Co-locate, Empower, 2 Pizza Teams
Advanced – Read Spotify Model of Squad/Tribes/Guilds
(https://dl.dropboxusercontent.com/u/1018963/Articles/SpotifyScaling.pdf)
QA Engage early
Quality is every ones responsibility
QA Ops Focus is important
CI, Tools, Infrastructure (lab), Reporting, Dependency Management
Invest in Scale – goal to run deploy+automation in under 60 m
Design and implement for Testability
Focus on Automation – automate every thing – smoke->regression
CI is the life saver
19. Enterprise Shift Left Objectives
•Write Automation Early
•Find Defects Early/Lower defects in Prod
•Run Automation in Dev Environments
•Engage every one (at least QA in Automation)
•Keep Test cases in sync with user stories
Shift Quality Left
•Higher Confidence in builds
•Increase Engineering Velocity
•Increase Scale – Make automation massively parallel (check-in to release in 60 minutes)
Make build and deployment more reliable
•Reduce regression cost and time
•Automate Ops – CI, Deployments, Test Data and Environment Buildup
•Automate root cause analysis
•Isolate Layers (Mock Objects and Virtualization)
Automate the Quality Process
19
21. Why BDD?
• Faster cycle time – Shift-Left imperative
• Easy to understand tests and test results
• Closer QE/Dev/Product collaboration to help us get the tests
right early
• Features and Scenarios serve as easy to access, verifiable,
living documentation of an application
21
28. Case Study: CI implementation for Leading Healthcare Provider
Customer Challenges
Slow automation execution Time- 22 mins per test case
Sequential module wise execution on one device @ a time
Already automated script not utilizing in regression cycles
Lots of test data dependencies and require regular maintenance
No framework available for Responsive web design for mobile
InfoStretch Approach
Recommended best practices for automating native & web
app using device cloud
Collaborated with Scrum Team and understand web-
service/JSON role in test data generation/creation
Setup continuous integration for nightly execution for
utilizing cloud devices on free time
Proposed HP ALM integration along with Jenkins for
complete automation life cycle
Engagement Benefits
Optimize automation execution to 8-10 mins per test cases
[Reduce 50%]
Enabling parallel execution on Selenium Grid
Utilizing automation script in regular code drop/release cycle
[2-3 times per week- average 1200 test cases executed in
each cycle]
Develop framework utilizing JSON response instead of test
data in xls sheet on run time. [Almost 0% test data
dependency and maintenance]
Created new framework which supports common code for
execution on desktop and mobile browsers on emulators/real
devices for Response Web design
Alicia can you put relevant logos for each of the tools.
Page 27 from PDF document.
Alicia can you put relevant logos for each of the tools.
Page 35 of PDF and logo for SonarQube and Fortify
Significantly reduces the amount of operational IT support needed for environment setup, application installation/configuration, and teardown necessary to move applications from development to production
80-90% decrease in ops support with accelerated delivery
) You are stuck in a "hot mess" of hotfixes. Not uncovering problems early. Forced into making changes late in the game.
You are deploying manually between environments. It's slow. It's brittle. It's painful.
You hear the all too common "it works on my device" uttered by your developers. Then it breaks
on staging and production.
Defects are detected and fixed sooner – Integrating testing throughout the development process would give QA teams more time to find bugs and help prevent bugs from effecting later code.
Health of software is measurable – By establishing continuous testing into the automated integration process, the software health attributes such as complexity can be tracked over time.
Reduce assumptions – Continuous Integration gives the chance to replace assumptions with knowledge thereby eliminating all cross-platform errors at the development stage.
Reduce overheads – Finding a bug at the development stage is the cheapest possible way to find it. If the same bug was to be fixed in any other environment, it would cost more. Setting up a CI system may cost an overhead, but will outweigh the man-hours saved along the way.
Brings quality assurance – This is the biggest benefit from a client perspective, continuous integration can enable you to release deployable software at any point in time. In the absence of CI, projects are prone to delayed releases because of unforeseen issues which arise from deployment.
Enables better project visibility – Since integration occur frequently, it provides the opportunity to notice trends and make informed decisions. Noticing trends in build success or failure, overall quality becomes possible. With CI, you can access real-time data on the code quality metrics to innovate new improvements and support decisions. It also offers the ability to generate API-like documentation for all committed code, making the software architecture immediately visible to new developers and other team membersIn terms of software quality, CI can help you measure cyclomatic complexity, code duplication, dependencies and coding standards so that developers can proactively refactor code before a defect is introduced. If a defect is introduced into a code base, CI can provide feedback soon after, when defects are less complex and less expensive to fix. Also, when using an effective developer testing regimen, CI provides quick feedback, via regression tests, on software that was previously working and is adversely affected by a new change. How about ROI?
Calculate how much time your team spends on fixing defects once the software is with the testing team -- QA, integration testing, etc. Of course, it costs considerably more once it enters production. When implementing effective CI practices, you can discover many of these defects as soon as they are introduced, which significantly decreases the cost of fixing each defect.
CI is really important to moving fast, or just to move with the confidence you are not breaking anything
CI provides benefits like :
Rapid feedback on the "health" of the software under development
Identification of defects early on in the development cycle
Significant reduction to the cost of fixing each defect
CHANGED BUILD & UNIT TESTS, need to add deployment in here.
A Flexible and Mobile-ready Plugin – Support your most complex use cases by automatically deploying mobile apps, executing your test code, and assuring high quality delivery of any mobile app style.
Unlimited Scalability and Device Elasticity for Your Entire Release Cycle – Ramp up from single device testing to full, cross-platform load testing on hundreds of devices worldwide.
Enterprise-ready and Continuous Quality - Our SLA based cloud and local deployment services are consistent, stable and secure, which is great for global, distributed team collaboration.
Leverage Existing Processes and Assets Within Your Organization - Connect your existing mobile app development tools to the Jenkins plugin in order to execute your test code against your "hybrid" MobileCloud lab of real devices.
Enhance Mobile CI Workflow in Real User Conditions - Test on real devices, in real-time with real network conditions across different geographies.
On-demand Availability – Execute tests anytime, from anywhere with continuous access to a cloud-based test bed of active, carrier connected mobile devices
Faster Issue Resolution – Foster agility with rich reports that include screenshots and videos to clearly demonstrate what went wrong and where
Cloud
Distributed Team Access
Cost Efficient Team Engagement
Sharing / Test Execution Proofs
Automation
What type of tools / language support
Selenium / UFT Support
Integrations
Test Management System / CI Integration
Social media icons would be good for presentations done for outside of InfoStretch audiences.