Measuring your way_to_successful_automation_webinar

•

7 likes•922 views

Developing a set of metrics is the first step to make in your transition to automation. A quantitative goal will help convince your boss what you need now and help you measure improvement over time. In this Webinar, Rajeev Rai, the CEO of QASource, who has over 25 years of experience in QA and is a veteran at creating and managing high quality teams, will discuss metrics that helped him overcome challenges to drive automation success.

Technology

Measuring Your Way to
Successful Automation
Brought To You By:

QASource Confidential
§  Over 500 engineers
§  500+ years collective automation experience
§  100,000+ automated test cases
§  100+ automation frameworks
§  100s of successful engagements
QASource: Automation Experts
Over 500 engineers
100+ automation frameworks
500+ years collective automation experience
100,000+ automated test cases
100s of successful engagements

QASource Confidential
Q1. How large is your QA team?
<5 Engineers
Attendee’s Poll
5-10 Engineers 11-25 Engineers >25 Engineers
Q2. What is the main reason you want to measure your test automation?
Track Progress Utilize Resources
Effectively
Plan & Budget for
Future
Detect Performers
vs Non-performers
Q3. How would you rate your current automation metrics?
Top Notch:
Many metrics that
measure resource
utilization, track
progress and show
value
Pretty Good:
Basic & consistent
metrics
Needs
Improvement:
Some metrics, but
they keep changing
No Metrics
at All

QASource Confidential
Co-Founder of QASource
20+ Years Experience in QARajeev Rai,
CEO, QASource
QASource Confidential

QASource ConfidentialQASource Confidential
Your challenges, if you
let them, become your
greatest allies.
– Richard Paul Evans
““

QASource ConfidentialQASource Confidential
Measuring Your Way To
Successful Automation

QASource ConfidentialQASource Confidential
What You Will Learn
How to get a
BUDGET for automation
How to demonstrate
VALUE of automation
How to monitor team performance to
OPTIMIZE your automation efforts

QASource ConfidentialQASource Confidential
Budget
Automation
For
QASource Confidential

QASource Confidential
Breakeven in Automation
300
Hours of
Manual Effort
Saved

QASource ConfidentialQASource Confidential
Effort
Optimization

QASource Confidential
Effort Optimization
1000
1050
1150
1300
150
350
47014%
30%
36%
0%
5%
10%
15%
20%
25%
30%
35%
40%
0
200
400
600
800
1000
1200
1400
1600
Sprint 1 Sprint 2 Sprint 3 Sprint 4
PercentageofManualEffortsSaved
TestCases
Sprint Cycles
Test Cases Automated Manual Effort SavedTotal Test Cases Test Cases Automated Manual Effort Saved

QASource ConfidentialQASource Confidential
Task
Distribution

QASource Confidential
Task Distribution: Sprint 4

QASource Confidential
Task Distribution: Sprint 4 (Drilldown)

QASource ConfidentialQASource Confidential
Team
Velocity
Test Case Automation

QASource Confidential
Team Test Case Automation Velocity
30
32
34
36
38
40
42
44
46
48
50
Week 1 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8
TestCases
Week
Expected maximum Expected minimum
36
45
49
Expected Maximum Expected Minimum Test Cases Automated

QASource ConfidentialQASource Confidential
Team Effort
Distribution

QASource Confidential
Team Effort Distribution
Execution Analysis
Review & Fixing
Test Case
Automation
Framework
Development
Test Suite
Maintenance
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Week 1 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8
PercentageEffort
Week

QASource ConfidentialQASource Confidential
Engineer
Velocity
Test Case Automation

QASource Confidential
Engineer Test Case Automation Velocity
8
9
10
11
12
13
14
15
16
17
18
19
20
Week 1 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8
TestCases
Week
Kevin Kamet John Expected Maximum Expected Minimum
11
18
19

QASource ConfidentialQASource Confidential
Engineer Effort
Distribution

QASource Confidential
Engineer Effort Distribution
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60%
Execution
Analysis
Review &
Fixing
Test Case
Automation
Framework
Development
Test Suite
Maintenance
Percentage Effort
Tasks
Kevin Kamet John

QASource ConfidentialQASource Confidential
Recap
Breakeven in
Automation
Effort Optimization Task Distribution:
Sprint 4
Task Distribution:
Sprint 4 (Drilldown)
Team Test Case
Automation Velocity
Team Effort
Distribution
Engineer Test Case
Automation Velocity
Engineer Effort
Distribution

QASource ConfidentialQASource Confidential
Key Learnings
How to get a
BUDGET for automation
How to demonstrate
VALUE of automation
How to monitor team performance to
OPTIMIZE your automation efforts

QASource Confidential
FREE Whitepaper
Want To Learn More About QA Automation?
Visit us at QASOURCE.COM
qasource.com/20-metrics

The document discusses making the transition from manual to automated testing. It provides an agenda that covers planning the transition, keeping automation going once started, considerations in tool selection, and a demo of eureQa and Sauce Labs. The transition involves scoping what to automate, organizing tests for reuse, ensuring traceability, and selecting tools based on team strengths and capabilities. Key aspects of keeping automation running include ease of maintenance, integrating testing into development, and managing results through reporting and analytics.

Real Devices or Emulators: Wen to use What for Automated Testing

Sauce Labs

Managers, Future Proof Your Automation

Sauce Labs

Compatibility Testing of Your Web Apps - Tips and Tricks for Debugging Locall...

Sauce Labs

Test automation is all about running the most tests in the least amount of time. This is great for mature apps, but in the early stages of developing your web or mobile app, developers need to run a number of tests to ensure the app runs at all. Further complicating the issue is that often, your app is architect-ed differently for web and mobile which makes writing automated tests tricky. Test Automation Specialist Max Saperstone from Coveros will cover some simple testing examples and demonstrate how to expand these for testing over multiple web architectures. He will briefly cover the difference in the design of these sites with a focus on how tests can be designed to overcome their limitations, minimizing duplicate code, and following best practices.

Continuous testing webinar 041017 slideshare

QualiQuali

Modern release management teams pride themselves on setting up a seamless workflow for continuous integration and delivery. However, continuous testing – which is one of the most critical components of the workflow is often taken for granted or marginalized without clear ownership leading to impediments in quality. With the advent of DevOps and the movement to break down silos between developers and operations, it becomes critically important that all members of an IT team - regardless of what tools they use, or role they play - understand the essentials of continuous testing.

Amalgamation of BDD, parallel execution and mobile automation

Agile Testing Alliance

Tests for Every Branch Using CircleCI and Sauce Labs to Continuously Test CS ...

Sauce Labs

In this webinar presentation, Brian Jordan gives a tour of Code.org’s continuous, automated cross-browser testing suite, newly integrated with CircleCI. Brian discusses how Code.org’s small engineering team approaches testing throughout the product development cycle, including a suite of cross-browser tests using Sauce Labs that now run for every single commit an engineer pushes to their feature branch.

Functional to Visual: AI-powered UI Testing from Testim and Applitools

Applitools

This presentation was originally given at Quality Jam London. Elise covered test automation and the progression for test automation that you might encounter. The session agenda included: The stages of the test team Why are we automating? What are we automating? How are we automating? What languages should we use? What frameworks and libraries should we use? Open source or proprietary? Learn more at www.qualityjam.com

ATAGTR2017 Keeping pace with Product Evolution: UI Automation Framework Guide...

Agile Testing Alliance

The document discusses how to structure automation test frameworks to help them withstand changes to the application under test. It recommends separating automation code into business, implementation, and element repository layers. The business layer defines test cases agnostic of the application, while the implementation layer defines how actions are performed. The element repository stores locators, allowing them to change without breaking tests. When the application evolves, changes are typically needed only in the element repository layer. Structuring tests in this way helps automation scripts remain useful despite application changes.

ATAGTR2017 Testing in DevOps Culture

Agile Testing Alliance

Use Automation to Assist -Not Replace- Manual Testing

SmartBear

Quality at Speed: More API Testing, Less UI Testing

Sauce Labs

Whether your company is a digital native or you’re just starting or well on your way to digital transformation, you know that your web services, mobile apps, and API programs need faster time-to-market without increasing risk. More full-stack and backend developers as well as QA/testing, architecture, and DevOps leaders are trying to inject rocket fuel into their agile development by doing more API testing. But how much UI testing can be moved over to much faster API testing? And then, how short can you make your testing sprints with API testing? With the right provisioning of UI, visual, and API testing, your organization can measurably improve DevOps metrics as you begin to do far more testing in much less time - without increasing on-hand IT resources. In this webinar, Sauce Labs experts will clarify what parts of the “quality spectrum” are better covered by UI testing vs. API testing. Learn why API testing can be much faster and more reliable than UI testing, and how you can leverage API testing to achieve quality at speed. Key Takeaways: - Easily extend your Selenium and Appium UI testing suite with API testing automation for much faster, more reliable functional, integration, and load/performance testing - Implement a CI/CD pipeline and DevOps workflows safely and securely with Sauce Labs full quality spectrum testing - Achieve quality at speed with significant improvements in time to market and quality to market

Enterprise Ready Test Execution Platform for Mobile Apps

Vijayan Srinivasan

When it comes to Mobile test execution, appium framework is the default choice of engineers for writing test cases. Running the appium testcases against multiple Android versions in parallel can be achieved via another open source tool called selenium grid. Unfortunately selenium grid is not enterprise ready. Meaning the selenium grid cannot be used as a single test execution platform across enterprise level companies due to following issues • Not available as a Web Application to run from Intuit Standard Containers (Tomcat, WHP) • Device registry is maintained in-memory • No support for High Availability / Disaster Recovery • No support for External Device Cloud • Not much debugging support (Screenshot, Exception or Log messages) This talk will be covering the limitations of selenium grid and how Intuit modified the selenium grid to suit for enterprise needs.

[TAQfull Meetup] Angie Jones + Expert Panel: Best Practices in Quality Manage...

Applitools

** Meetup session recording: https://youtu.be/Vo-PhgrOT0A ** While test automation is a struggle for most teams across the globe, there are companies who have mastered this -- and are executing a very successful test automation strategy. In this special 90-minute live session, industry thought-leader Angie Jones shares the research on how top brands & global companies are approaching test automation, how they are successfully implementing it, and what are their building blocks for their top-notch quality teams. Angie was joined by Quality Engineering executives, who shared what they are seeing in the industry in regards to successful (and not so successful) test automation practices: * Stuart Day - Principal QA - Digital @ Dunelm and co-founder/ organizer @ TAQfull Meet-Up * Marie Drake - Principle Test Automation Engineer @ NewsUK / Cypress.io Ambassador * Matt Lowry - Principle Test Engineer @ BP (via ECS)

Appium vs Espresso and XCUI Test

Perfecto by Perforce

The rise of DevOps and the increase in developer-QA collaboration has led to the introduction of new testing frameworks such as Espresso and XCUITest. Join us and learn how organizations are improving pipeline efficiency by adding Espresso to their CI process as well as learn the basic concepts of instrumented test tools such as Espresso and XCUITest. This webinar will cover: -Latest market trends causing this shift and why organizations are moving from Appium to Espresso -For each framework (Espresso, XCUITest and Appium), we will cover: -Characteristics -Technology/Architecture -Pros & Cons -Demo of Espresso

"Software Quality in the Service of Innovation in the Insurance Industry"

Applitools

This document discusses software quality in the insurance industry. It introduces Joe Emison, CTO of Branch Insurance, and discusses how Branch builds software frequently in small increments using test automation. It notes challenges with traditional test automation approaches and outlines Branch's approach using unit tests, API tests, and data-driven end-to-end tests run continuously. The document also discusses how ProdPerfect and Applitools can work together to provide effortless functional and visual testing through data analysis, test case discovery, and visual AI.

From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...

Sauce Labs

Hear from Verizon Media’s Venu Narayanabhatla (Director, Software Development Engineering) and Sauce Labs’ Alissa Lydon (Continuous Testing SME/Product Marketing Manager) as they discuss: - Why Verizon Media decided to standardize their testing practices across a number of distributed teams, and how they implemented that change - The development of Screwdriver, now an open source CI tool, and how it solved internal challenges and enabled teams to embrace continuous integration - Their decision to integrate Screwdriver with Sauce Labs, and how it allowed for scaling to 2.7 million automated tests run per month against all of their applications

Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...

QA or the Highway

This document discusses strategies for scaling test automation. It begins with an introduction of the speakers and an overview of continuous testing and the need for scale. It then covers cross-browser testing, the mobile landscape, and how to mix technologies like Selenium, headless browsers, and codeless testing for maximum coverage. The document compares tools and practices, and provides best practices for scaling test automation, including strategies for test data, certification of test scenarios, and measuring return on investment. It concludes with a live demo of scaling Selenium tests on Perfecto.

Continuous Testing Odyssey: Learn Best Practices for End-to-End Web App Testing

Sauce Labs

If you’re building sophisticated, data-intensive web applications but have not implemented a comprehensive end-to-end testing strategy, join our webinar to learn how. You’ll learn how you can create unit and end-to-end functional tests quickly and execute them on multiple browsers simultaneously, which in turn will increase team productivity and accelerate release cycles. In this session, we will provide real-world examples including how we’ve tested our own complex web app framework Sencha Ext JS to show how you can scale the automated test suite to over thousands of test cases and cross-browser combinations for a complete regression cycle. We will demonstrate how we are able to test individual UI components, combinations of components, and finally as part of an application. Join us and you will learn how to: -Create a robust test strategy for Web Application Testing -Implement page object design to improve long term maintenance -Implement an automated DevOps process to execute tests in parallel, drastically reducing the time spent on a browser farm

Your Framework for Success: introduction to JavaScript Testing at Scale

Sauce Labs

There are countless ways to set up your automated testing environment. When it comes to stability and maintainability, it’s crucial to choose the right frameworks at the beginning of the journey, to set yourself up for success and save yourself time and headaches further down the road. In addition to traditional WebDriver-based JavaScript frameworks like Selenium or WebdriverIO, many new projects have popped up in recent years that provide even more capabilities, particularly for web UI testing. With the emergence of new frameworks like Puppeteer, Playwright, Cypress, and others, how do you choose which one’s right for you and your team? And how do you integrate the chosen framework into your testing practice, to shift testing left and speed up your software delivery lifecycle? In this webinar, Sauce Labs experts will provide an overview of the JavaScript framework landscape for automated functional testing, with a focus on Cypress, TestCafe, and Playwright. They will explore the differences between these frameworks, and discuss how to choose and implement the right tool for your project. Key Takeaways: - Understand how browser automation emerged over the last decade - Learn about the technical differences of traditional and new frameworks - Learn to pick the right JavaScript framework for your project Speakers: Christian Bromann | Staff Software Engineer, Sauce Labs Daniel Graham | Senior Software Engineer, Sauce Labs

ATAGTR2017 Performance Automation in Dev-Ops

Agile Testing Alliance

This document summarizes an agenda for a conference on performance testing in DevOps. It discusses automated performance testing using Jenkins, including developing plugins for tools like JMeter and Silk Performer. Approaches covered include identifying critical use cases, automating tests, running them through Jenkins, parsing results, and using the data to decide on production deployments. Advantages are reducing testing efforts and easily detecting regressions. Limitations include manually editing scripts and validating changes. The future plans discussed shifting performance testing left and automating resource utilization stats.

Evolving from Automated to Continous Testing for Agile and DevOps

Parasoft

ISTQB Foundation and Selenium Java Automation Testing

HiraQureshi22

This document provides an overview and summary of an ISTQB Foundation and Selenium Java Automation Testing course. The course covers ISTQB certification based professional training using the 2018 syllabus, as well as test automation using Selenium Java and .NET frameworks. It is designed to help students learn software testing skills and prepare for careers as test analysts or test automation engineers. Key topics include dynamic testing techniques, testing throughout the software development lifecycle, component testing, test management, and static testing. The course also provides hands-on training in test automation using Selenium WebDriver, building reusable automation components, cross-browser testing, and XSLT reporting.

Simplify Salesforce Testing with AI-Driven Codeless Tools

Sauce Labs

Testing Salesforce Apps presents numerous challenges for enterprise organizations. Teams have to navigate complex architecture, integration workflows, and continuous changes in the customized SFDC implementation, as well as a wide range of different applications hosted on Salesforce Cloud. If left unchecked, these challenges can hamper critical enterprise processes like the revenue-generating Quote to Cash process. During this webinar, you will learn how to automate functional testing and thoroughly test both the UIs and the APIs in your Salesforce applications using AutonomIQ’s AI-driven codeless tool. We’ll discuss how Aryaka Networks, a global leader in WAN transformation solutions, uses AutonomIQ to autonomously test critical business processes like Quote to Cash in their customized Salesforce application, and we’ll show you how to streamline UI testing to improve test creation, execution, and maintenance, and easily add API testing to your strategy for better coverage. Key Takeaways: Simplify the creation of your test scripts using plain English statements and a codeless studio Learn how to autonomously create UI and API tests for Salesforce and integrations with other applications Ensure the health of your end-to-end SFDC applications for key business processes like quote to cash

Start Your Automation Journey With Rapise

Inflectra

ATAGTR2017 Static and dynamic code analysis for mobile applications - Act ear...

Agile Testing Alliance

ATAGTR2017 Upgrading a mobile tester's weapons with advanced debugging

Agile Testing Alliance

Functional testing the_good_the_bad_and_the_ugly

John Ferguson Smart Limited

In the pursuit of continuous delivery, here is our reality: Unit testing is good, but just not enough. Every Project dedicate a big Functional Testing part at the end to deliver only the top of the testing pyramid. Then the questions are: - How can you deliver quickly if you need to retest your entire application manually for each release? - What automation tools can you use to ensure that your automated tests do not become a maintenance nightmare? - How can you write automated tests that testers can leverage to make their own manual testing more effective? The Agile Sydney Community is proud to receive John Ferguson Smart. Come and join us to challenge John on giving a live demonstration of automated acceptance criteria using JBehave, Selenium 2 and Thucydides. This will give us the opportunity to discuss a number of open source and commercial automated testing tools, with many examples and stories from real-world projects. John talks about a range of tools and approaches to automated functional testing, and discuss the place of functional testing in a modern agile project. He will look at topics such as: - Where does testing fit into an agile development life-cycle - Why it's too late to start testing at the end of the project or iteration - What tests should you automate, and how - What tools work best for different types of tests.

Functional and Non-functional Test automation

Dr Ganesh Iyer

What's hot

Diving into the World of Test Automation The Approach and the Technologies

QASymphony

ATAGTR2017 Keeping pace with Product Evolution: UI Automation Framework Guide...

Agile Testing Alliance

ATAGTR2017 Testing in DevOps Culture

Agile Testing Alliance

Use Automation to Assist -Not Replace- Manual Testing

SmartBear

Quality at Speed: More API Testing, Less UI Testing

Sauce Labs

Enterprise Ready Test Execution Platform for Mobile Apps

Vijayan Srinivasan

[TAQfull Meetup] Angie Jones + Expert Panel: Best Practices in Quality Manage...

Applitools

Appium vs Espresso and XCUI Test

Perfecto by Perforce

"Software Quality in the Service of Innovation in the Insurance Industry"

Applitools

From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...

Sauce Labs

Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...

QA or the Highway

Continuous Testing Odyssey: Learn Best Practices for End-to-End Web App Testing

Sauce Labs

Your Framework for Success: introduction to JavaScript Testing at Scale

Sauce Labs

ATAGTR2017 Performance Automation in Dev-Ops

Agile Testing Alliance

Evolving from Automated to Continous Testing for Agile and DevOps

Parasoft

ISTQB Foundation and Selenium Java Automation Testing

HiraQureshi22

Simplify Salesforce Testing with AI-Driven Codeless Tools

Sauce Labs

Start Your Automation Journey With Rapise

Inflectra

ATAGTR2017 Static and dynamic code analysis for mobile applications - Act ear...

Agile Testing Alliance

ATAGTR2017 Upgrading a mobile tester's weapons with advanced debugging

Agile Testing Alliance

What's hot (20)

Diving into the World of Test Automation The Approach and the Technologies

ATAGTR2017 Keeping pace with Product Evolution: UI Automation Framework Guide...

ATAGTR2017 Testing in DevOps Culture

Use Automation to Assist -Not Replace- Manual Testing

Quality at Speed: More API Testing, Less UI Testing

Enterprise Ready Test Execution Platform for Mobile Apps

[TAQfull Meetup] Angie Jones + Expert Panel: Best Practices in Quality Manage...

Appium vs Espresso and XCUI Test

"Software Quality in the Service of Innovation in the Insurance Industry"

From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...

Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...

Continuous Testing Odyssey: Learn Best Practices for End-to-End Web App Testing

Your Framework for Success: introduction to JavaScript Testing at Scale

ATAGTR2017 Performance Automation in Dev-Ops

Evolving from Automated to Continous Testing for Agile and DevOps

ISTQB Foundation and Selenium Java Automation Testing

Simplify Salesforce Testing with AI-Driven Codeless Tools

Start Your Automation Journey With Rapise

ATAGTR2017 Static and dynamic code analysis for mobile applications - Act ear...

ATAGTR2017 Upgrading a mobile tester's weapons with advanced debugging

Viewers also liked

Functional testing the_good_the_bad_and_the_ugly

John Ferguson Smart Limited

Functional and Non-functional Test automation

Dr Ganesh Iyer

functional testing

bharathanche

Functional testing is a type of software testing that validates software functions or features based on requirements specifications. It involves testing correct and incorrect inputs to check expected behaviors and outputs. There are different types of functional testing including unit testing, integration testing, system testing, and acceptance testing. Testers write test cases based on requirements and specifications to test the functionality of software under different conditions.

10 Benefits of Automated Testing

TestObject - Mobile Testing

Non-Functional testing

Kanoah

Automated Testing

John Paulett

The document discusses different types of automated software testing including unit testing, functional testing, load testing, requirements testing, and test coverage. It provides examples of unit tests written in JUnit and describes how unit testing can help design better code and prevent regressions. It also lists several popular open source testing tools and frameworks for different testing types. The document advocates starting with unit testing on new code and working towards automating testing and achieving full code coverage.

Agile metrics and quality

Anu Khendry,ACC,SAFe Aglst, PMI-ACP,CSPO,PMP

The document discusses various agile metrics that can be used to improve quality, shorten product cycle times, decrease costs and risks, and increase predictability. It describes metrics like defects trends, test automation coverage, flow diagrams to measure lead and cycle times, earned value analysis to track costs and wastage. Control limits and variances can be set for work in progress, defects, team size and velocity. The focus should be on analyzing trends rather than individual values to identify special causes of variation and lead indicators.

13 software metrics

University of Computer Science and Technology

Software metrics involve collecting measurements related to software development processes, projects, and products. There are different types of metrics including process, project, and product metrics. Process metrics measure the software development lifecycle, project metrics measure team efficiency, and product metrics measure quality. Metrics can also be private, used by individuals, or public, used to measure teams and processes. Size-oriented metrics are computed based on the size of the software, often expressed in lines of code.

Testing Metrics

PM Venkatesha Babu

Testing metrics provide objective measurements of software quality and the testing process. They measure attributes like test coverage, defect detection rates, and requirement changes. There are base metrics that directly capture raw data like test cases run and results, and calculated metrics that analyze the base metrics, like first run failure rates and defect slippage. Tracking these metrics throughout testing provides visibility into project readiness, informs management decisions, and identifies areas for improvement. Regular review and interpretation of the metrics is needed to understand their implications and make changes to the development lifecycle.

Viewers also liked (9)

Functional testing the_good_the_bad_and_the_ugly

Functional and Non-functional Test automation

functional testing

10 Benefits of Automated Testing

Non-Functional testing

Automated Testing

Agile metrics and quality

13 software metrics

Testing Metrics

Similar to Measuring your way_to_successful_automation_webinar

Transforming Your QA and Test Team

TechWell

QA and test departments often are composed of employees with business backgrounds who have little training when it comes to software testing. Though they are engaged, these team members can get overwhelmed by the thousands of test cases they have to execute over and over, and they don’t see a future career path in testing. What can be done to address these challenges? Join Sophie Benjamin as she presents her personal step-by-step recipe to transform QA and test teams and position them for success within IT. She talks about the essential roles in QA and test teams, their skills and contributions within the software delivery cycle, and tips and tricks to keep employees motivated and willing to invest in their careers. Attendees will leave with practical advice on what leaders and managers can do to ensure that their QA and test teams deliver results and add value to their organizations, today and in the future.

Decreasing false positives in automated testing

Sauce Labs

QASource presented on reducing false positives in automated testing. Some key points: 1. False positives occur when tests are incorrectly marked as failed when they should have passed. Common causes include reliance on UI elements, synchronization issues, and unstable test code. 2. False positives can impact automation by wasting time investigating failures, decreasing productivity, and obscuring real bugs. 3. Strategies to reduce false positives include using stable locators, short independent tests, dynamic synchronization, teardown logic, and re-execution of failed tests. 4. Eliminating false positives leads to more certainty in test results and reduced costs of automation.

Quality Jam 2017: Jesse Reed & Kyle McMeekin "Test Case Management & Explorat...

QASymphony

#speakgeek - Testing Recipe: The iconnect360 Way

Derek Chan

Tech open day - Testing recipe: The iconnect360 way

M Rizwanur Rashid

Software Development And Delivery Metrics That Matter

William Simms

The document discusses techniques for measuring key metrics in software development and delivery to improve visibility, manage costs, and ensure success. It provides examples of metrics to measure at different stages of the development lifecycle, including code coverage, team velocity, defect rates, testing times, and story completion rates. The document emphasizes establishing a measurement process to identify problems, take action, and continuously improve product quality and delivery.

Best Practices for a Repeatable Shift-Left Commitment

Applause

This document discusses best practices for implementing a "shift-left" strategy to move quality assurance activities earlier in the software development lifecycle. It recommends having quality be everyone's responsibility, focusing on delivering valuable features, adopting an automation-first mentality, embracing continuous feedback through a "fail or learn fast" approach, and continuously improving processes. The document provides examples of how some organizations are successfully shifting left, such as through continuous integration/delivery pipelines, minimum viable products, and behavior-driven development. It also describes how Applause's in-sprint testing service can help teams validate features within a sprint to avoid context switching for developers.

Building QA Team that matters for an Agile World

Maurizio Mancini

Agile Gurugram 2016 | Conference | Continuous Agile Testing @ Naukri | Meetu...

AgileNetwork

This document summarizes the journey of the testing team at Naukri.com from 2006 to present day. It began with a small manual testing team and has transitioned to include more automation testing. Key steps included identifying metrics to measure, transitioning testers to learn automation skills, creating frameworks to support automation testing, and integrating automation into continuous testing practices. As a result, the team has seen improvements such as a 50% reduction in post-live defects, a 44% increase in automation coverage, and a 25% increase in team velocity. The document emphasizes the importance of defining the right metrics to measure, taking a progressive approach to automation, and focusing on defect prevention.

Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...

Codemotion

Performance tests are not only an important instrument for understanding a system and its runtime environment. It is also essential in order to check stability and scalability – non-functional requirements that might be decisive for success. But won't my cloud hosting service scale for me as long as I can afford it? Yes, but… It only operates and scales resources. It won't automatically make your system fast, stable and scalable. This talk shows how such and comparable questions can be clarified with performance tests and how DevOps teams benefit from regular test practise.

An Agile Testing Dashboard: Metrics that Matter

TechWell

Has your organization moved to agile but your metrics have not? Do you spend multiple hours each week generating separate sets of metrics for your agile squad, management, and C-level executives? Do you find yourself questioning the things you measure and actions you take as a result of those measurements? Prachi Maini introduces you to a set of lean but comprehensive metrics that show the efficiency and effectiveness of the squads, the primary activities of the squad, and that of the overall project. Learn the key evaluators for measuring quality of code, quality of quality assurance (testing), project progress, automation ROI, and team sentiments. Take back an agile dashboard that can easily be generated to provide measurable data to both squad members and key executives, to help quantify risk and process improvements, and to allow for more effective and efficient project planning, forecasting, and estimating.

Zero touch QA automation platform for DevOps

TaUB Solutions

Presentation based on the Award Winning Paper by Varadarajan Srinivasan on Zero Touch QA Automation Platform at STC Nov 2018. Companies that are in DevOps Journey go through a rough weather in QA Automation initiatives. With the industry transformation to Digital Trend, there is always a need for an efficient streamlined Continuous Delivery. This Webinar would talk about Zero Touch QA Automation Platform. It deals with the Solution on Integrated DevOps & Quality Approach. This would consist of Artificial Intelligence in Reporting and Data Visualization. The Complete QA Cycle is automated from Test Design to Test Closure with Continuous Monitoring, involving no manual intervention. The Webinar would also give insights on Business benefits/outcome on adopting this approach with streamlined Governance.

Learn Key Insights from The State of Web Application Testing Research Report

Sencha

In a recent study by Dimensional Research of 1,011 development and QA professionals, almost every survey respondent cited that application quality is important, with 84% believing it is very or critically important. Despite this, findings revealed that 94% of teams still face challenges when it comes to conducting adequate QA. View the presentation to learn why organizations must prioritize automated testing and QA practices to deliver high-quality applications and increase customer satisfaction.

DeviQA

Artem Pavlov

DeviQA is one of the global leaders in Quality Assurance and Software Testing. To prove that, we propose a high level of protection for you as our potential client consisting of making a quote, providing the references, conducting a free POC, and finally a trial engagement. After these four steps, you’ll know for sure that DeviQA is a right partner. Our offerings include: Automated testing for Web; Automated testing for Mobile; API Testing; Full-cycle testing; QA process design and setup; Performance, Load and Stress testing; Responsibility for quality of your project; QA consultancy & Audit, etc. Reliability, efficiency, and expertise are the core principles of our QA services. We pay close attention to the privacy and security of customer data storage and all intellectual property.

BenchmarkQA Services Overview

mattpagel

Evolution of the DevOps Quality Management Office

Capgemini

This document discusses the evolution of the DevOps Quality Management Office (QMO). It outlines the vision of continuous business-driven testing to reduce the time between development and operations. Key aspects of the DevOps-driven testing approach include continuous integration and delivery, lean techniques, standardization, test optimization, and establishing a hybrid test organization. The document also compares traditional vs DevOps testing approaches and provides examples of DevOps testing success levers. It proposes that the QMO can advise on developing a DevOps strategy and roadmap to improve throughput, availability, and time to market.

About Indium Software - Software Testing Service Offering

Indium Software

Indium Software is an independent software testing firm that has been in business for 17 years. It provides testing services across 6 countries with over 450 career testers and pools of subject matter experts. It has delivery centers in India, the United States, Canada, Singapore, Malaysia, and the UAE. Indium offers a variety of testing services including functionality testing, user acceptance testing, compatibility testing, regression testing, and specialized testing services for areas like gaming, mobile, DevOps, big data, and more. It also provides regulatory compliance testing and test automation/transformation services.

Sap Application Assurance Service Offerings

Uma Narayan

The document discusses SAP testing services provided by EnterprizeERP, including SAP application assurance, integrated SAP testing, and an SAP testing automation framework. It notes that lack of testing is a major concern for customers and can lead to high costs and risks. The company provides consulting services around SAP test strategy, automation, and integrating testing into the SAP lifecycle to help customers improve quality assurance and reduce risks.

Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".

Emerasoft, solutions to collaborate

- The document outlines Polarion's test management software capabilities including creating and managing test cases, defects, requirements and specifications with Polarion LiveDocs. It allows defining and running test runs with the Polarion Testing Framework. - It discusses how Polarion can help integrate requirements, testing and defect management and manage activities with all stakeholders. - The presentation then demonstrates Polarion's abilities like requirements and test traceability, test planning and execution, impact analysis and reporting across projects.

DOES15 - Ramona Jackson and Aji Rajappan - Continuous Delivery at Cisco IT

Gene Kim

Cisco IT implemented a large-scale continuous delivery transformation to improve software quality, optimize costs, and accelerate time to capability. Their approach included establishing a core team, adopting agile methodologies, automating testing, embedding subject matter experts, and grouping applications into adoption waves. Key results were increased agile adoption rates, productivity savings, and measurable business value. The transformation required addressing needs like environment refreshes and concurrent code versions, as well as focusing on areas like tools, training, processes, and culture change.

Similar to Measuring your way_to_successful_automation_webinar (20)

Transforming Your QA and Test Team

Decreasing false positives in automated testing

Quality Jam 2017: Jesse Reed & Kyle McMeekin "Test Case Management & Explorat...

#speakgeek - Testing Recipe: The iconnect360 Way

Tech open day - Testing recipe: The iconnect360 way

Software Development And Delivery Metrics That Matter

Best Practices for a Repeatable Shift-Left Commitment

Building QA Team that matters for an Agile World

Agile Gurugram 2016 | Conference | Continuous Agile Testing @ Naukri | Meetu...

Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...

An Agile Testing Dashboard: Metrics that Matter

Zero touch QA automation platform for DevOps

Learn Key Insights from The State of Web Application Testing Research Report

DeviQA

BenchmarkQA Services Overview

Evolution of the DevOps Quality Management Office

About Indium Software - Software Testing Service Offering

Sap Application Assurance Service Offerings

Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".

DOES15 - Ramona Jackson and Aji Rajappan - Continuous Delivery at Cisco IT

More from Sauce Labs

Testing on Mobile Devices with Location Services

Sauce Labs

During this webinar we look into location services on Android and iOS real devices, as well as emulators and simulators. We provide you with tips and tricks on when to change the mobile Geo-IP and when to change the mobile GPS, how to use ADB commands to enable the device location, and how to handle the location services permission alerts. We also discuss Appium capabilities for Location Services, using GeoLocation with Appium Desktop, and more. Key takeaways: - Understand what Location Services are - Understand GPS compare to Geo-IP - Know the Appium commands for Location Services - The differences in the use of Location Services between Android and iOS - Learn how to automate tests that involve Location Services

Automating Hybrid Applications with Appium

Sauce Labs

When creating a mobile application, organisations have a few options to choose from; mobile web, native or a hybrid application. Where web apps are just websites that can be accessed on the internet via a mobile browser like Chrome or Safari, native apps are applications that are developed for a specific platform such as Android or iOS. Hybrid apps are different because they possess elements from native apps and web apps. When automating web applications, Selenium commands are used. Nine out of ten times the same automation script can be used for mobile web applications as our desktop web applications. With native apps however, we need to look deeper into the differences between Android and iOS apps before we can use Appium commands. But how should you automate hybrid apps, can or do you need to choose one of the two automation strategies or is there also a hybrid approach for automating hybrid apps? That’s what we are going to talk about during this webinar. We will be looking into how to detect a hybrid application for Android and iOS, the do’s and the don’ts when it comes to automating a hybrid application and we will provide you with tips and tricks on how to make this work for both Android and iOS. By the end of this webinar, you’ll be able to create your own Appium scripts to automate Android and iOS hybrid mobile applications. Key Takeaways: - Understand what a hybrid mobile application is - How to detect a hybrid mobile application - Learn how iOS and Android handle hybrid mobile applications - Learn how to automate hybrid mobile applications

Creating Digital Confidence with Test Automation

Sauce Labs

Engineering teams understand the importance of a comprehensive continuous testing strategy to build digital confidence, improve user experience, and accelerate release velocity. However, when beginning on the journey to continuous testing, the task of building and executing a strategy that provides clear value can be challenging. Whether it’s designing automation from scratch, understanding where you can scale the value of your tests throughout the pipeline and across teams, or demonstrating the value that quality brings to larger business objectives, building a test automation strategy sometimes creates a web that is seemingly too complex to untangle. In this webinar, Yoosuf Maktoum, Senior Manager of Quality Engineering at Sysco Corporation, will share a test automation design and implementation strategy that helped his own team achieve success. Yoosuf will discuss a unique test automation design pattern that both supports and accelerates automation efforts. This framework, leveraging open source technologies, enables reusability, smarter and faster automation, and is suitable in both a DevOps and Agile workflow. He will then demonstrate how this framework can be applied to a single test automation script for functional and nonfunctional tests, test data management, and test environment management, as well as how it can support testing for both legacy and modern applications. Through these methods, his team is able to provide quality as a service across the organization. Attendees of this session will learn: - Basic design principles to consider when building out automation, and how open source can augment your strategy - How to apply a single automation framework across various types of testing (web, mobile, API, and standalone automation) - Strategies for aligning testing with business objectives to demonstrate value to leadership

Just Enough (Automated) Testing

Sauce Labs

The challenge for every product is to ship bug-free code as often as possible. Whether you are an early stage startup with a pilot application or a large corporation with myriad services, you’re dealing with this problem every day. We usually end up with either too little or too much testing and it’s hard to find the sweet spot. Too little testing and you have bugs and application instability, leading to time spent fixing bugs and manually regression testing your apps. You’re asking yourself, “isn’t there an easier way to do this?” Too much testing and you have slow release times and high automation maintenance costs. In this scenario, you’re asking yourself, “are the bugs I’m catching worth the time I’m spending maintaining this code?” In this webinar, software engineer Kate Green will go over a framework for evaluating your testing situation in order to find your organization’s sweet spot. Key Takeaways - Understanding where you are today - Identifying weak, brittle, or buggy parts of your application - Figuring out where to test first, and with what types of tests - How to pare down an excessively large automation suite Measuring test effectiveness

Using Axe to Add Accessibility Checks to Your Existing Selenium Tests

Sauce Labs

Accessibility is no longer a nice to have but rather a must have for many applications. Luckily there are things like the W3C’s WCAG (Web Content Accessibility Guidelines) that help testers understand accessibility standards. But wait, it gets better for teams that are using Selenium. This is because adding accessibility checks to your automation is both quick and easy. In this webinar, Magenic Practice Lead Troy Walsh will show how to leverage Axe, an accessibility testing engine, to add accessibility checks to your existing Selenium test suite. You will see just how easy it is, and be left wondering why it took you so long to get started. Key Takeaways - Why accessibility has become a must have for many applications - How to use the W3C’s Web Content Accessibility Guidelines to understand accessibility standards - How to easily add accessibility checks to your existing Selenium suite using Axe

How Open Source Helps to Bring Back Product Obsession

Sauce Labs

This document discusses how open source can help organizations bring back product obsession. It outlines Sauce Labs' approach to open source which includes establishing an Open Source Program Office (OSPO) to manage open source consumption and contributions. The OSPO aims to increase customer engagement, shape industry standards, and build Sauce Labs' reputation through open source. Guidelines are provided for how employees can participate in open source through code and non-code contributions. The benefits of open source for customers, engineering culture, and bringing product obsession are discussed.

Webinar: A Sneak Peek at Selenium 4 with Simon Stewart

Sauce Labs

Selenium 4 is coming. What’s in it? In this webinar, Simon Stewart, creator of WebDriver and core-contributor to the Selenium project, will talk about the next major Selenium release. - How is Selenium 4 different from Selenium 3? - What are the most relevant features? - Can you really deploy it into the Cloud? In this webinar, you will find out everything you ever wanted to know about Selenium 4, including demos of some of the new features! Watch the webinar: https://saucelabs.com/selenium-4

[Deu] Test Automatisierung Mit Web Driver.io

Sauce Labs

This presentation provides an overview of WebDriver.io, an open-source automation framework for browser and mobile testing. It discusses the key features of WebDriver.io, including its simple installation, integration with other tools, online tutorials and support community. The presentation also demonstrates different modes for using WebDriver.io (standalone, bare metal, test runner), custom commands, multi-remote testing, and visual and performance testing capabilities. Examples are provided to illustrate interacting with elements, selecting elements, and React support.

Accelerating Innovation: Leveraging Open Source to Optimize Your Shift-Left I...

Sauce Labs

In this in-depth webcast, Joanna Schloss and Thomas Boyles of Sauce Labs will join Bloor Group analyst Eric Kavanaugh to examine the link between open source and successful DevOps. Drawing on their personal experience as engineers building technology within a DevOps framework, Schloss and Boyles will discuss: - Why open source technologies are often the missing link for businesses struggling to achieve their DevOps objectives - How progressive organizations are leveraging open source to optimize their shift-left initiatives, implement automated testing and accelerate innovation - How open source can simultaneously insulate your organization against risk while also encouraging exploration and innovation - The role and relevance of open source for different players in the DevOps world, from QAs and SDETs to developers and heads of engineering

Accelerating Your Digital Agenda with Continuous Testing ft. Forrester

Sauce Labs

Presenting 2019 developer research, Diego Lo Giudice, Vice President, Principal Analyst at Forrester Research, will provide insight into how enterprise organizations are adopting and adapting for quality at great speed, while exploring: - How this increasing emphasis on speed and quality has put testing in the eye of the Agile+DevOps hurricane - What continuous testing means for testers, developers and business users today Diego will also present findings on the trends and practices poised to shape the testing market in 2019 and beyond.

How to Measure Success in Continuous Testing

Sauce Labs

In this webinar, Amir Rozenberg and Fernando Vidal will discuss the Sauce Labs Continuous Testing Benchmark Report, a new index based on insights gleaned from the more than 2 billion tests run on the Sauce Labs Continuous Testing platform. The index can be used by any organization to evaluate their progress towards continuous testing. Joining Amir and Fernando will be Phil Wells from the New York Times, a Sauce Labs customer that has achieved a nearly perfect 100 against the Continuous Testing Benchmark index. Key takeaways: - The components of the new continuous testing index - What makes those components such strong maturity indicators - How can organizations improve on each of the metrics - What happens organizationally when those metrics are improved - How the NY Times manages their continuous testing pipeline to deliver quality crosswords while driving constant improvements

5 Steps to Jump Start Your Test Automation

Sauce Labs

With the acceleration of software creation and delivery, test activities must align to the new tempo. Developers need immediate feedback to be efficient and correct defects as those are introduced. The path to achieving this vision is to build a reliable and scalable continuous test solution. All beginnings are hard. Having a well-defined plan outlining the approach for your organization to create test automation is key to ensure long term success. Join Diego Molina, Senior Software Engineer at Sauce Labs as he discusses: The importance of setting up the team correctly from the start Choosing the right Testing Framework for your organization Identifying the right scenarios and workflows to test Learning to avoid common pitfalls at the beginning of the transformation journey

Sauce Labs Webinar: Rising Importance of Software Testing

Sauce Labs

Our own Marcus Merrell, Director of Technical Services in Customer Success and Thomas Boyles, Director of Engineering in Development, will speak with Aberdeen Research Director Jim Rapoza and discuss: - How testing is evolving to better meet the demands and current trends in DevOps and application development - The challenges organizations are facing when it comes to delivering high performing and reliable applications across platforms - Strategies leading organizations are following to shift testing left and right - How continuous testing can help you become a leader

BDD With Selenide by Hima Bindu Peteti

Sauce Labs

Selenide is an open source library that can make a huge impact and accelerate software delivery by introducing concise API, shorter expressions and many other capabilities. In this SauceCon 2019 presentation, Hima Bindu Peteti explains: - Key features of Selenide that can be used to make automation code simpler, easier to read and more maintainable - The most effective test automation design patterns with Selenide - Selenide support for Angular-based applications and other advanced Javascript libraries - How to use Selenide with Cucumber for BDD - Execution and generation of reports

Closer To the Metal - Why and How We Use XCTest and Espresso by Mario Negro P...

Sauce Labs

In this SauceCon 2019 presentation, Mario describes the practices that ABN AMRO adopted in mobile teams when it comes to testing native applications on real devices. Since using Espresso and XCUITest is still relatively uncommon for large apps and there are various unique challenges due to being in an EU-regulated industry with various security restrictions, Mario will share the ABN AMRO team’s experiences, including: - A brief architectural overview of the Mobile Banking app: why it is all native (Objective-C/Swift and Java/Kotlin), how it communicates with other apps and websites - Why ABN AMRO choose to adopt Espresso and XCUITest: the advantages and the limitations of this choice - How ABN AMRO runs their test pipelines to spread them across time and devices and prevent teams from being blocked

Continuous Delivery for "Mature" Codebases by Melisa Benua

Sauce Labs

When starting up a greenfield project, it’s easy to take advantage of the most modern development practices. But what about the rest of us, who are working on codebases greater than five minutes old? How do you take code that’s four years and hundreds of thousands of SLOC, and turn that into a lean, mean, continuous-deploying machine? In this SauceCon 2019 presentation, Melissa Benua walks through what continuous integration and deployment means for teams working on mature code bases, and what the roadmap looks like to get from a release cycle that may take weeks or months to one that deploys on-demand.

Building Automation Engineers From Scratch by Jenny Bramble

Sauce Labs

This document outlines a plan for building automation engineers from scratch. The plan assumes resources like a group of manual testers and time are available. It discusses setting expectations around perceptions of ability, velocity, and success. The framework involves identifying existing knowledge and skills, learning new skills like coding, and finding a mentor. Challenges like deprioritization are addressed by making automation invaluable and embracing change. The overall goal is to empower a whole team with automation skills.

Automated Testing at The Speed of Headless by Alissa Lydon and Samantha Coffman

Sauce Labs

In this SauceCon 2019 presentation, Samantha Coffman, Product Manager at Sauce Labs, and Alissa Lydon, Product Marketing Manager at Sauce Labs, discuss Sauce Headless, the industry’s first cloud-based headless testing solution, making it a fast and affordable option for early pipeline testing at scale. They will cover the benefits of using Sauce Headless in conjunction with Sauce Labs traditional VM offering to increase the release velocity, as well as examples of customers who are experiencing upwards of 50% faster test times using Sauce Headless.

Building The Blocks of Trust in Automation by Sneha Viswalingam

Sauce Labs

Having followed best practices from previous Selenium Conference talks, the Zoll Lifevest team was able to shift from flaky tests to stable and reliable automated tests. During that time, Sneha Viswalingam learned the importance of building trust in the test suite to unite the team as a whole. Once trust is established in the automated tests, it became crucial to the overall software development lifecycle. In this talk, Sneha covers the following topics: - Strategies that she used to make the tests reliable - Trainings for the manual testers to contribute to the automation efforts - Importance of having an Automation Test Reporting Dashboard - Presenting the project status and test reports on a wallboard to reinforce trust By implementing these steps in her organization, Sneha has built trust not only within the test suite but into the team as a whole.

What's that smell? Tidying Up our Test Code by Angie Jones

Sauce Labs

We are often reminded by those experienced in writing test automation that code is code. The sentiment being conveyed is that test code should be written with the same care and rigor with which production code is written. However, many people who write test code may not have experience writing production code, so it’s not exactly clear what is meant by this sentiment. And even those who write production code find that there are unique design patterns and code smells that are specific to test code in which they are not aware. Given a smelly test automation code base that is littered with several bad coding practices, Angie walks through each of the smells, discusses why it is considered a violation, and demonstrates a cleaner approach by refactoring the code live on stage. Key takeaways include how to identify code smells within test code, understanding the reasons why an approach is considered problematic, and how to implement clean coding practices within test automation

More from Sauce Labs (20)

Testing on Mobile Devices with Location Services

Automating Hybrid Applications with Appium

Creating Digital Confidence with Test Automation

Just Enough (Automated) Testing

Using Axe to Add Accessibility Checks to Your Existing Selenium Tests

How Open Source Helps to Bring Back Product Obsession

Webinar: A Sneak Peek at Selenium 4 with Simon Stewart

[Deu] Test Automatisierung Mit Web Driver.io

Accelerating Innovation: Leveraging Open Source to Optimize Your Shift-Left I...

Accelerating Your Digital Agenda with Continuous Testing ft. Forrester

How to Measure Success in Continuous Testing

5 Steps to Jump Start Your Test Automation

Sauce Labs Webinar: Rising Importance of Software Testing

BDD With Selenide by Hima Bindu Peteti

Closer To the Metal - Why and How We Use XCTest and Espresso by Mario Negro P...

Continuous Delivery for "Mature" Codebases by Melisa Benua

Building Automation Engineers From Scratch by Jenny Bramble

Automated Testing at The Speed of Headless by Alissa Lydon and Samantha Coffman

Building The Blocks of Trust in Automation by Sneha Viswalingam

What's that smell? Tidying Up our Test Code by Angie Jones

Recently uploaded

Mariano G Tinti - Decoding SpaceX

Mariano Tinti

GraphRAG for Life Science to increase LLM accuracy

Tomaz Bratanic

みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...

名前です男

20240607 QFM018 Elixir Reading List May 2024

Matthew Sinclair

“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...

Edge AI and Vision Alliance

For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/ Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit. In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing. van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.

Infrastructure Challenges in Scaling RAG with Custom AI models

Zilliz

Building Retrieval-Augmented Generation (RAG) systems with open-source and custom AI models is a complex task. This talk explores the challenges in productionizing RAG systems, including retrieval performance, response synthesis, and evaluation. We’ll discuss how to leverage open-source models like text embeddings, language models, and custom fine-tuned models to enhance RAG performance. Additionally, we’ll cover how BentoML can help orchestrate and scale these AI components efficiently, ensuring seamless deployment and management of RAG systems in the cloud.

UiPath Test Automation using UiPath Test Suite series, part 6

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI. UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities. Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes. What will you get from this session? 1. Insights into integrating generative AI. 2. Understanding how this integration enhances test automation within the UiPath platform 3. Practical demonstrations 4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath Topics covered: What is generative AI Test Automation with generative AI and Open AI. UiPath integration with generative AI Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

Programming Foundation Models with DSPy - Meetup Slides

Zilliz

How to use Firebase Data Connect For Flutter

Daiki Mogmet Ito

“I’m still / I’m still / Chaining from the Block”

Claudio Di Ciccio

GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...

Neo4j

Leonard Jayamohan, Partner & Generative AI Lead, Deloitte This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.

Introduction to CHERI technology - Cybersecurity

mikeeftimakis1

Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack

shyamraj55

GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...

Neo4j

Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.

HCL Notes and Domino License Cost Reduction in the World of DLAU

panagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/ The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this! We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model. Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward. These topics will be covered - Reducing license cost by finding and fixing misconfigurations and superfluous accounts - How do CCB and CCX licenses really work? - Understanding the DLAU tool and how to best utilize it - Tips for common problem areas, like team mailboxes, functional/test users, etc - Practical examples and best practices to implement right away

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

Malak Abu Hammad

Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers: * What is Vector Search? * Importance and benefits of vector search * Practical use cases across various industries * Step-by-step implementation guide * Live demos with code snippets * Enhancing LLM capabilities with vector search * Best practices and optimization strategies Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications. #MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology

Presentation of the OECD Artificial Intelligence Review of Germany

innovationoecd

RESUME BUILDER APPLICATION Project for students

KAMESHS29

Best 20 SEO Techniques To Improve Website Visibility In SERP

Pixlogix Infotech

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...

Neo4j

Dr. Sean Tan, Head of Data Science, Changi Airport Group Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.

Recently uploaded (20)

Mariano G Tinti - Decoding SpaceX

GraphRAG for Life Science to increase LLM accuracy

20240607 QFM018 Elixir Reading List May 2024

“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...

Infrastructure Challenges in Scaling RAG with Custom AI models

UiPath Test Automation using UiPath Test Suite series, part 6

Programming Foundation Models with DSPy - Meetup Slides

How to use Firebase Data Connect For Flutter

“I’m still / I’m still / Chaining from the Block”

GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...

Introduction to CHERI technology - Cybersecurity

Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack

GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...

HCL Notes and Domino License Cost Reduction in the World of DLAU

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

Presentation of the OECD Artificial Intelligence Review of Germany

RESUME BUILDER APPLICATION Project for students

Best 20 SEO Techniques To Improve Website Visibility In SERP

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...

Measuring your way_to_successful_automation_webinar

1. Measuring Your Way to Successful Automation Brought To You By:

2. QASource Confidential §  Over 500 engineers §  500+ years collective automation experience §  100,000+ automated test cases §  100+ automation frameworks §  100s of successful engagements QASource: Automation Experts Over 500 engineers 100+ automation frameworks 500+ years collective automation experience 100,000+ automated test cases 100s of successful engagements

3. QASource Confidential Q1. How large is your QA team? <5 Engineers Attendee’s Poll 5-10 Engineers 11-25 Engineers >25 Engineers Q2. What is the main reason you want to measure your test automation? Track Progress Utilize Resources Effectively Plan & Budget for Future Detect Performers vs Non-performers Q3. How would you rate your current automation metrics? Top Notch: Many metrics that measure resource utilization, track progress and show value Pretty Good: Basic & consistent metrics Needs Improvement: Some metrics, but they keep changing No Metrics at All

4. QASource Confidential Co-Founder of QASource 20+ Years Experience in QARajeev Rai, CEO, QASource QASource Confidential

5. QASource ConfidentialQASource Confidential Your challenges, if you let them, become your greatest allies. – Richard Paul Evans ““

6. QASource ConfidentialQASource Confidential Measuring Your Way To Successful Automation

7. QASource ConfidentialQASource Confidential What You Will Learn How to get a BUDGET for automation How to demonstrate VALUE of automation How to monitor team performance to OPTIMIZE your automation efforts

8. QASource ConfidentialQASource Confidential Budget Automation For QASource Confidential

9. QASource Confidential Breakeven in Automation 300 Hours of Manual Effort Saved

10. QASource ConfidentialQASource Confidential Effort Optimization

11. QASource Confidential Effort Optimization 1000 1050 1150 1300 150 350 47014% 30% 36% 0% 5% 10% 15% 20% 25% 30% 35% 40% 0 200 400 600 800 1000 1200 1400 1600 Sprint 1 Sprint 2 Sprint 3 Sprint 4 PercentageofManualEffortsSaved TestCases Sprint Cycles Test Cases Automated Manual Effort SavedTotal Test Cases Test Cases Automated Manual Effort Saved

12. QASource ConfidentialQASource Confidential Task Distribution

13. QASource Confidential Task Distribution: Sprint 4

14. QASource Confidential Task Distribution: Sprint 4 (Drilldown)

15. QASource ConfidentialQASource Confidential Team Velocity Test Case Automation

16. QASource Confidential Team Test Case Automation Velocity 30 32 34 36 38 40 42 44 46 48 50 Week 1 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 TestCases Week Expected maximum Expected minimum 36 45 49 Expected Maximum Expected Minimum Test Cases Automated

17. QASource ConfidentialQASource Confidential Team Effort Distribution

18. QASource Confidential Team Effort Distribution Execution Analysis Review & Fixing Test Case Automation Framework Development Test Suite Maintenance 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Week 1 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 PercentageEffort Week

19. QASource ConfidentialQASource Confidential Engineer Velocity Test Case Automation

20. QASource Confidential Engineer Test Case Automation Velocity 8 9 10 11 12 13 14 15 16 17 18 19 20 Week 1 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 TestCases Week Kevin Kamet John Expected Maximum Expected Minimum 11 18 19

21. QASource ConfidentialQASource Confidential Engineer Effort Distribution

22. QASource Confidential Engineer Effort Distribution 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% Execution Analysis Review & Fixing Test Case Automation Framework Development Test Suite Maintenance Percentage Effort Tasks Kevin Kamet John

23. QASource ConfidentialQASource Confidential Recap Breakeven in Automation Effort Optimization Task Distribution: Sprint 4 Task Distribution: Sprint 4 (Drilldown) Team Test Case Automation Velocity Team Effort Distribution Engineer Test Case Automation Velocity Engineer Effort Distribution

24. QASource ConfidentialQASource Confidential Key Learnings How to get a BUDGET for automation How to demonstrate VALUE of automation How to monitor team performance to OPTIMIZE your automation efforts

25. QASource Confidential Q & A

26. QASource Confidential FREE Whitepaper Want To Learn More About QA Automation? Visit us at QASOURCE.COM qasource.com/20-metrics

27. QASource Confidential

Measuring your way_to_successful_automation_webinar

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (9)

Similar to Measuring your way_to_successful_automation_webinar

Similar to Measuring your way_to_successful_automation_webinar (20)

More from Sauce Labs

More from Sauce Labs (20)

Recently uploaded

Recently uploaded (20)

Measuring your way_to_successful_automation_webinar