How to Un-Flake Flaky Tests - A New Hire's Toolkit

•

0 likes•783 views

This is a presentation I gave at SeleniumConf India 2018. There are many slides with video - sorry that the video won't resolve in this format. But I hope the content is still useful.

Technology

How to Un-flake Flaky
Tests - A New Hire’s
Toolkit
Zachary Attas | Senior Test Engineer | ReviewTrackers

Keep the Flakiness for Your
Croissant - How to Un-Flake
Your Automated Tests
Zachary Attas | Senior Test Engineer | ReviewTrackers

Bake the Flake Out of
Your Tasty Test Cake
Zachary Attas | Senior Test Engineer | ReviewTrackers

Flake It Off, Flake It Off:
How to Un-Flake Your
Flaky Tests
Zachary Attas | Senior Test Engineer | ReviewTrackers

Test Stack
• Ruby
• Capybara
• SitePrism
• ParallelRSpec
• Jenkins
• Selenium Grid
• Docker

Takeaways
• Confidence
• Awareness
• Persistence

What is Flakiness?
• Non-deterministic
• False negative / positive
• Hard to reproduce

Common Causes of Flakiness
• Changed selectors
• Changed application behavior
• Waiting
• Test order dependency
• Test parallelization
• Test setup
• 3rd party code

Common Selenium Errors
• StaleElementReference
• Element is not clickable at point
(x,y)
• ElementNotFound
*https://www.seleniumhq.org/exceptions/stale_element_reference.jsp

How to Un-flake Flaky
Tests - A New Hire’s
Toolkit Hat Collection
Zachary Attas | Senior Test Engineer | ReviewTrackers

Hat Collection
Selenium
Speed
Super User Triage
Debugger Diffing HTML
Application
Changes
Application
Versions
The Complications
of CI
The Internet
Application
Internals

Selenium Speed
• It’s faster than you
• Can uncover bugs

Super User
• Test workflow valid?
• Foreseeable error?

Debugging
Selenium Code Application Code
The error

Chrome Dev Console Tricks
• $x for xpath

Chrome Dev Console Tricks
• document.querySelectorAll for css

Chrome Dev Console Tricks
• Draw a red box around element
Capybara
.current_session
.driver
.browser
.execute_script(
"arguments[0].style.border='3px solid red’",
<element>)

Chrome Dev Console Tricks
• Draw a red box around element

Application Log Tailing
(while test is running)

Xmllint
xmllint -- format <original_file> >> <beautified_file>

Beautified HTML
• First beautify the HTML file, it makes for
easier diff-ing
• xmllint -- format <file> >> <beautified_file>

The Internals of Your Application
• System Architecture
• “Where the bodies are buried”
• Which flavor of Javascript?
• Who to ping in Engineering

Application Changes
• Recent development logs
• Release notes
• Bug database

Incompatible Versions
• Selenium/Selenium Grid
• Drivers
• Browser version
• OS

Incompatible Versions
* https://github.com/SeleniumHQ/selenium/issues/5058

The Complications of CI
• Different runtime
• Network latency
• Browser window size
• Blacklisting
• Timezones

The Last Hat!
• Code review tests like application code
• Test fixes 10x (or more) in parallel
• Test fixes how they are run in CI

Recap
Selenium
Speed
Super User
Triage
Debugger Diffing HTML
Application
Changes
Application
Versions
The Complications
of CI
The Internet
Application
Internals
Hazmat
Suit

Thank you!
/snackattas
in/zachary-attas
Question?

This document provides a 10 step guide to using Selenium successfully. It begins by defining a test strategy and choosing a programming language. It then covers Selenium fundamentals like locators and common actions. Steps include writing the first test, implementing page objects, making tests resilient with waits, and adding cross-browser execution. The guide also discusses test frameworks, continuous integration, and finding additional information. The overall goal is to write reusable, maintainable tests that run across browsers to provide automated feedback and catch issues early.

Getting Started with Selenium

Dave Haeffner

The document provides an overview of getting started with Selenium and outlines 8 steps to write automated tests: 1. Define a test strategy by determining what to test and which browsers to support 2. Choose a programming language like Java and set up dependencies 3. Learn Selenium fundamentals like locating elements and common actions 4. Write a first test to log in to a sample site 5. Create page objects and a base page to make tests reusable and maintainable 6. Add waits to make tests more resilient when waiting for elements 7. Set up a test harness for centralized setup/teardown, reporting and parallelization 8. Add cross-browser testing by using browser drivers locally or remotely

Beyond the Release: CI That Transforms Organizations

Sauce Labs

When DevOps talk meets DevOps tactics, companies are finding that Continuous Integration (CI) is the make or break point. And implementing CI is one thing, but making it healthy and sustainable takes a little bit more consideration. In this webinar, Chris Riley (DevOps Analyst) and Andy Pemberton (CloudBees) will show you how Jenkins and Sauce Labs can work together to build a comprehensive CI tool set to help you release faster, at a higher quality and with more visibility.

Jest: Frontend Testing richtig gemacht @WebworkerNRW

Holger Grosse-Plankermann

Mal ganz ehrlich: Testen im Frontend hat noch nie viel Spaß gemacht. In meinem Talk möchte ich mit Jest eine Testbibliothek vorstellen, die genau das ändern kann. Jest ist ohne viel Konfiguration direkt einsetzbar und bringt alles mit, was man von einer Testbibliothek erwartet (und noch mehr). An vielen praktischen Beispielen möchte ich meine Lieblingsfeatures wie z.B. Snapshot-Tests, Mocking oder das tolle CLI erläutern und zeigen, dass Testen im Frontend durchaus Spaß machen kann. Eine Ausrede weniger, um auf das Testen im Frontend zu verzichten!

Using Selenium to Improve a Teams Development Cycle

seleniumconf

Selenium course training institute ameerpet hyderabad – Best software trainin...

Sathya Technologies

Dan Cuellar discusses strategies for writing automated tests that are robust and maintainable in the face changing codebases and features. These include separating logical test actions from direct controller calls, centralizing site elements and logic, adding self-testing capabilities, consolidating product actions into abstracted libraries, and creating platform-agnostic test scripts. The goal is to design tests that can adapt easily without extensive rework when underlying systems evolve rapidly.

Apex Testing Deep Dive

Adam Olshansky

Expert selenium with core java

Ishita Arora

XpDays - Automated testing of responsive design (GalenFramework)

Alex Fruzenshtein

This document discusses automated testing of responsive web design using the Galen Framework. It provides an overview of Galen and how it allows writing specifications to test layouts across different screen sizes and devices. Key aspects covered include the Galen specification language using tags to target different devices, the test suite syntax, and examples of integrating Galen with Java tests using Maven, TestNG, and custom reporting.

Java Basics for selenium

apoorvams

This document provides an overview of test automation using Selenium. It discusses reasons to automate testing such as supporting regression testing and finding defects missed by manual testing. It also discusses when not to automate, such as when an application's behavior is unstable. The document then covers the Selenium framework, its components like Selenium IDE and WebDriver, and languages it supports like Java. It also discusses concepts in object-oriented programming relevant to test automation like classes, objects, inheritance and more.

Selenium RC: Automated Testing of Modern Web Applications

qooxdoo

Automated Acceptance Tests in .NET

Wyn B. Van Devanter

The document discusses automated acceptance testing (AAT) in .NET. It provides an overview of AAT, including the benefits of communication, catching mistakes, and automation. It then discusses various AAT tools and frameworks for .NET, with a focus on SpecFlow for writing tests in Gherkin. The document demonstrates SpecFlow's workflow and syntax. It concludes by addressing challenges with AAT and providing tips for overcoming issues like brittle tests through techniques like page objects and headless browsers.

Tdd

sweekar Attavar K

This document discusses test-driven development (TDD) and testing approaches for Ruby on Rails projects. It introduces TDD as writing test code before development code to ensure requirements are met. Common testing frameworks for Rails like RSpec and Cucumber are presented. RSpec is highlighted for its ease of use and features to support TDD. The document also covers concepts like the red-green-refactor TDD cycle and using tools like Factory Girl to generate test data.

Foundation selenium java

seleniumbootcamp

Rethinking Testing

pdejuan

Sharing the pain using Protractor

Anand Bagmar

Unit testing hippo

Ebrahim Aharpour

Hibernate performance tuning

Mikalai Alimenkou

Many Java developers use ORM in their projects but most of them don’t do deep dive into configuration, settings and tuning to achieve really good performance. What is worse most of them even don’t know what options do they have to improve performance. In this talk we will review them on practical samples and give concrete recommendations how to make your Hibernate work much better in real projects. Code samples can be found here: https://github.com/xpinjection/hibernate-performance .

Level Up Your Salesforce Unit Testing

Gordon Bockus

How To Use Selenium Successfully (Java Edition)

Sauce Labs

Dave Haeffner, a Selenium expert and active member of the Selenium project, steps through the why, how, and what of Selenium (the open-source automated web-testing tool for functional testing). He also discusses how to start from nothing and build out a well-factored, maintainable, resilient, fast and scalable set of tests in Java. These will test your app across all of the browsers you care about, while exercising relevant functionality that matters to your business.

Unit Testing - Calgary .NET User Group - Nov 26 2014 - Depth Consulting

Dave White

Self-Generating Test Artifacts for Selenium/WebDriver

seleniumconf

The document discusses issues with maintaining automated tests when a website undergoes frequent changes. It proposes generating page object models on every build to account for changes as they happen. This avoids failures from id, type, or navigation path changes. Developers must fix type changes before check-in. With regeneration, tests absorb insignificant changes and the test pass rate improves from identifying issues within 24 hours without noise. The approach provides a model to generate additional tests around standards, errors, forms and security. While reported defects did not decrease, the solution allowed increased velocity and faster feature addition.

Make Everyone a Tester: Natural Language Acceptance Testing

Viget Labs

Property-Based Testing for Services

jessitron

The document discusses property-based testing for services in Scala. It introduces property-based testing as an alternative to example tests that can generate random inputs to test definitions of how a program should behave. The document provides an example of generating test data using Scalacheck, writing properties to define expected outputs, and using for-comprehensions to combine generated values into more complex types for testing.

Heavenly hell – automated tests at scale wojciech seliga

Atlassian

The document summarizes Atlassian's journey to improve their automated test suite over 2.5 years. They had over 20,000 slow and fragile tests that resulted in dispirited developers accepting failures as normal. Through efforts like restructuring tests, parallelizing execution, removing flaky tests, and splitting the codebase into modules, they were able to reduce build times from over 2 hours to under 1 hour and make passes the norm. Continuous measurement, removing technical debt, and prioritizing test performance were key to their success in improving development feedback loops.

How to use selenium successfully

TEST Huddle

Escaping Test Hell - ACCU 2014

Wojciech Seliga

My talk delivered on 10th of April 2014 in Bristol at ACCU Conference. This is the combination of a few talks I delivered over 2012 and 2013 with some latest updates. This is an experience report based on the work of many developers from Atlassian and Spartez working for years on Atlassian JIRA. If you have (or going to have) thousands of automated tests and you are interested how it may impact you, this presentation is for you.

What's hot

Testing Rapidly Changing Applications With Self-Testing Object-Oriented Selen...

seleniumconf

Apex Testing Deep Dive

Adam Olshansky

Expert selenium with core java

Ishita Arora

XpDays - Automated testing of responsive design (GalenFramework)

Alex Fruzenshtein

Java Basics for selenium

apoorvams

Selenium RC: Automated Testing of Modern Web Applications

qooxdoo

Automated Acceptance Tests in .NET

Wyn B. Van Devanter

Tdd

sweekar Attavar K

Foundation selenium java

seleniumbootcamp

Rethinking Testing

pdejuan

Sharing the pain using Protractor

Anand Bagmar

Unit testing hippo

Ebrahim Aharpour

Hibernate performance tuning

Mikalai Alimenkou

Level Up Your Salesforce Unit Testing

Gordon Bockus

How To Use Selenium Successfully (Java Edition)

Sauce Labs

Unit Testing - Calgary .NET User Group - Nov 26 2014 - Depth Consulting

Dave White

Self-Generating Test Artifacts for Selenium/WebDriver

seleniumconf

Make Everyone a Tester: Natural Language Acceptance Testing

Viget Labs

Property-Based Testing for Services

jessitron

What's hot (19)

Testing Rapidly Changing Applications With Self-Testing Object-Oriented Selen...

Apex Testing Deep Dive

Expert selenium with core java

XpDays - Automated testing of responsive design (GalenFramework)

Java Basics for selenium

Selenium RC: Automated Testing of Modern Web Applications

Automated Acceptance Tests in .NET

Tdd

Foundation selenium java

Rethinking Testing

Sharing the pain using Protractor

Unit testing hippo

Hibernate performance tuning

Level Up Your Salesforce Unit Testing

How To Use Selenium Successfully (Java Edition)

Unit Testing - Calgary .NET User Group - Nov 26 2014 - Depth Consulting

Self-Generating Test Artifacts for Selenium/WebDriver

Make Everyone a Tester: Natural Language Acceptance Testing

Property-Based Testing for Services

Similar to How to Un-Flake Flaky Tests - A New Hire's Toolkit

Heavenly hell – automated tests at scale wojciech seliga

Atlassian

How to use selenium successfully

TEST Huddle

Escaping Test Hell - ACCU 2014

Wojciech Seliga

33rd degree

Dariusz Kordonski

The document discusses challenges faced with automated testing at scale for a large codebase with many dependencies, technologies, and test types. It describes how the large number of tests led to slow build times, failures blocking changes, and reduced developer productivity. Specific issues mentioned include monolithic test organization, slow unit/functional tests, non-deterministic races/timeouts, and re-running all tests on every commit. The document advocates for strategies like separating test types, running in parallel, and using page objects to isolate tests from UI changes.

Performance Testing using Real Browsers with JMeter & Webdriver

BlazeMeter

Learn how to easily run performance tests with real browsers using Selenium WebDriver. Ophir Prusak, BlazeMeter’s Chief Evangelist, gives step-by-step instructions on doing this using BlazeMeter and/or JMeter. Learn how to: - Correlate actual browser-based user experience with the load tests - Run multiple Selenium Webdriver tests in parallel at scale by using the power of the cloud - Do it all without any prior JMeter knowledge or experience!

Escaping Test Hell - Our Journey - XPDays Ukraine 2013

Wojciech Seliga

Continuous Delivery - Automate & Build Better Software with Travis CI

wajrcs

First Section: Continuous Delivery as a software engineering approach. (This is beneficial for Project Managers, DEVs & QAs.) 1. Projects Case Studies to explain why you should adopt Continuous Delivery. 2. Advantages & Reasons for releasing software more frequently. 3. How to make a Reliable / Production Ready Software. 4. Ingredients of Continues Delivery. 5. Tools/ approaches to choose while using Continues Delivery Methodology. Second Section: Technical side of Continuous Delivery. (This is more beneficial for DEVs/ QAs than Project Managers.) 1. Testing a Software. 2. Measuring Code Quality / Analytic to visualize teams performances. 3. Tools: Code Syntax Checker, Testing Framework, Build Automation, Automated Reporting/ Analytic Dashboard. 4. Continuous Delivery Automation over Cloud using Travis CI - Live demonstration. Third Section: 1. Sample Projects for audience to adopt right tools for development, testing & deployments. 2. Q&A. ------------------------------------------------- By Waqar Alamgir http://waqaralamgir.tk

Selenium Tips & Tricks, presented at the Tel Aviv Selenium Meetup

Dave Haeffner

The document provides tips and strategies for using Selenium to write automated tests. It begins with an overview of Selenium and outlines a 10 step process to write successful tests. The steps include defining a test strategy, choosing a programming language, learning Selenium fundamentals, writing the first test, implementing page objects for maintainable code, making tests resilient to failures, adding cross-browser testing, creating an automated feedback loop through continuous integration, and finding additional information resources. The document emphasizes writing reusable, maintainable and resilient tests that can run across browsers to test an application.

Migration strategies 4

Wenhua Wang

These slides would share our experiences in reusing the legacy automation testing code (Selenium+xpath) in IE. To reuse our legacy code in IE, we explored three techinques, i.e., CSS selectors, jQuery selectors, Javascript-xpath library. These slides would discuss each technique and explain how we addressed the limitations of existing teachniques. The discussions would present how to rejuvenate the legacy code at code level and library level. Finally, the best practices would be summarized based on the practical experiences.

Selenium Tips & Tricks

Dave Haeffner

This document provides tips and tricks for using Selenium. It discusses using headless browsers like PhantomJS to speed up test execution. It also covers visual testing, using a proxy server to manipulate requests, and workarounds for actions like uploading files and downloading secure files without the browser dialog. Additional resources are provided for getting started with Selenium Grid and for subscribing to weekly Selenium tips.

Practical Tips & Tricks for Selenium Test Automation - Dave Haeffner

Applitools

Escaping Automated Test Hell - One Year Later

Wojciech Seliga

Slides from my talk at 33rd Degree 2013 Conference in Warsaw. More than year ago we faced the fact that we are hitting the wall with our large scale automated testing in Atlassian JIRA. We analysed the problems and possible solutions and shared them with community at 33rd Degree in 2012. Since then we've implemented a lot of our ideas and come up with new, learnt new quite unexpected things and got rid of Selenium 1 completely. This session shows the learnings from our journey – escaping from Test Hell – back to the normality. If you are interested to hear what problems you can (and probably will) face if you have thousands of automated tests on on levels of abstractions (functional, integration, unit, UI, performance) and what solutions can be applied to remedy them – this presentation is for you.

Introduction to cypress in Angular (Chinese)

Hong Tat Yew

Performance Test Driven Development with Oracle Coherence

aragozin

This presentation discusses test driven development with Oracle Coherence. It outlines the philosophy of PTDD and challenges of testing Coherence, including the need for a cluster and sensitivity to network issues. It discusses automating tests using tools like NanoCloud for managing nodes and executing tests remotely. Different types of tests are described like microbenchmarks, performance regression tests, and bottleneck analysis. Common pitfalls of performance testing like fixed users vs fixed request rates are also covered.

Mastering Test Automation: How to Use Selenium Successfully

Applitools

** WATCH FULL WEBINAR RECORDING HERE: https://youtu.be/06H-6hjyyvI ** What is Selenium? Why should you use it? And how do you use it successfully? In this webinar, Automation expert Dave Haeffner answers these questions as he steps through the why, how, and what of Selenium. Dave also discusses how to start from nothing and build out a well factored, maintainable, resilient, fast and scalable set of tests. These tests will not only work well, but across all of the browsers you care about, while exercising relevant functionality that matters to your business. Watch this webinar and learn how to: * Decompose an existing web application to identify what to test * Pick the best language for you and your team * Write maintainable and reusable Selenium tests that will be cross-browser compatible and performant * Dramatically improve your test coverage with automated visual testing * Build an integrated feedback loop to automate test runs and find issues fast

Jakarta EE Test Strategies (2022)

Ryan Cuprak

Embracing Jakarta EE 10 not only enable you to write better structured applications, it also enables you to write more testable applications. Correctly leveraging CDI enables integration testing where you can simulate a database error and verify that JMS messages are lost due to a RuntimeException. This session will focus on strategies and techniques for testing message handing, transaction management, security, and data model integrity. You will see how you can check message delivery and error handling, session failover, database versioning, and two-phase commits with JMS and databases. All too often assumptions are made that are proven wrong in production. This session will show you how to take your testing to the next level.

Web testing with selenium and by quontra solutions

QUONTRASOLUTIONS

Selenium is a portable software testing framework for web applications. It supports multiple locator strategies including id, name, link, DOM, CSS, and xpath to find elements on a page. Selenium tests can be slow to execute compared to unit tests due to browser automation and page load latency. Techniques like adding ids to elements, reusing browser sessions, testing local builds, and parallelizing tests can help speed up Selenium tests.

Practical Tips & Tricks for Selenium Test Automation

Sauce Labs

CBDW2014 - MockBox, get ready to mock your socks off!

Ortus Solutions, Corp

Android testing-with-selenium-webdriver Online Training

Nagendra Kumar

Similar to How to Un-Flake Flaky Tests - A New Hire's Toolkit (20)

Heavenly hell – automated tests at scale wojciech seliga

How to use selenium successfully

Escaping Test Hell - ACCU 2014

33rd degree

Performance Testing using Real Browsers with JMeter & Webdriver

Escaping Test Hell - Our Journey - XPDays Ukraine 2013

Continuous Delivery - Automate & Build Better Software with Travis CI

Selenium Tips & Tricks, presented at the Tel Aviv Selenium Meetup

Migration strategies 4

Selenium Tips & Tricks

Practical Tips & Tricks for Selenium Test Automation - Dave Haeffner

Escaping Automated Test Hell - One Year Later

Introduction to cypress in Angular (Chinese)

Performance Test Driven Development with Oracle Coherence

Mastering Test Automation: How to Use Selenium Successfully

Jakarta EE Test Strategies (2022)

Web testing with selenium and by quontra solutions

Practical Tips & Tricks for Selenium Test Automation

CBDW2014 - MockBox, get ready to mock your socks off!

Android testing-with-selenium-webdriver Online Training

Recently uploaded

How to use Firebase Data Connect For Flutter

Daiki Mogmet Ito

GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024

Neo4j

Artificial Intelligence for XMLDevelopment

Octavian Nadolu

In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject. We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup. Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved. The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring. The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise. By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.

Presentation of the OECD Artificial Intelligence Review of Germany

innovationoecd

Essentials of Automations: The Art of Triggers and Actions in FME

Safe Software

In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation. We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios. Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!

GraphRAG for Life Science to increase LLM accuracy

Tomaz Bratanic

“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...

Edge AI and Vision Alliance

For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/ Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit. In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing. van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.

Mariano G Tinti - Decoding SpaceX

Mariano Tinti

AI 101: An Introduction to the Basics and Impact of Artificial Intelligence

IndexBug

National Security Agency - NSA mobile device best practices

Quotidiano Piemontese

Driving Business Innovation: Latest Generative AI Advancements & Success Story

Safe Software

Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency. During the hour, we’ll take you through: Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board. Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes. Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI. We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI. This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!

RESUME BUILDER APPLICATION Project for students

KAMESHS29

Communications Mining Series - Zero to Hero - Session 1

DianaGray10

This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered: • Communication Mining Overview • Why is it important? • How can it help today’s business and the benefits • Phases in Communication Mining • Demo on Platform overview • Q/A

Building Production Ready Search Pipelines with Spark and Milvus

Zilliz

UiPath Test Automation using UiPath Test Suite series, part 6

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI. UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities. Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes. What will you get from this session? 1. Insights into integrating generative AI. 2. Understanding how this integration enhances test automation within the UiPath platform 3. Practical demonstrations 4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath Topics covered: What is generative AI Test Automation with generative AI and Open AI. UiPath integration with generative AI Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

HCL Notes and Domino License Cost Reduction in the World of DLAU

panagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/ The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this! We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model. Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward. These topics will be covered - Reducing license cost by finding and fixing misconfigurations and superfluous accounts - How do CCB and CCX licenses really work? - Understanding the DLAU tool and how to best utilize it - Tips for common problem areas, like team mailboxes, functional/test users, etc - Practical examples and best practices to implement right away

20240605 QFM017 Machine Intelligence Reading List May 2024

Matthew Sinclair

UiPath Test Automation using UiPath Test Suite series, part 5

DianaGray10

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

Paige Cruz

Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack. While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack. I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:

Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack

shyamraj55

Recently uploaded (20)

How to use Firebase Data Connect For Flutter

GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024

Artificial Intelligence for XMLDevelopment

Presentation of the OECD Artificial Intelligence Review of Germany

Essentials of Automations: The Art of Triggers and Actions in FME

GraphRAG for Life Science to increase LLM accuracy

“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...

Mariano G Tinti - Decoding SpaceX

AI 101: An Introduction to the Basics and Impact of Artificial Intelligence

National Security Agency - NSA mobile device best practices

Driving Business Innovation: Latest Generative AI Advancements & Success Story

RESUME BUILDER APPLICATION Project for students

Communications Mining Series - Zero to Hero - Session 1

Building Production Ready Search Pipelines with Spark and Milvus

UiPath Test Automation using UiPath Test Suite series, part 6

HCL Notes and Domino License Cost Reduction in the World of DLAU

20240605 QFM017 Machine Intelligence Reading List May 2024

UiPath Test Automation using UiPath Test Suite series, part 5

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack

How to Un-Flake Flaky Tests - A New Hire's Toolkit

1. How to Un-flake Flaky Tests - A New Hire’s Toolkit Zachary Attas | Senior Test Engineer | ReviewTrackers

2. Keep the Flakiness for Your Croissant - How to Un-Flake Your Automated Tests Zachary Attas | Senior Test Engineer | ReviewTrackers

3. Bake the Flake Out of Your Tasty Test Cake Zachary Attas | Senior Test Engineer | ReviewTrackers

4. Flake It Off, Flake It Off: How to Un-Flake Your Flaky Tests Zachary Attas | Senior Test Engineer | ReviewTrackers

5. ReviewTrackers

6. A Warning

7. Test Stack • Ruby • Capybara • SitePrism • ParallelRSpec • Jenkins • Selenium Grid • Docker

8. How I Came Up With This Topic

9. Takeaways • Confidence • Awareness • Persistence

10. What is Flakiness? • Non-deterministic • False negative / positive • Hard to reproduce

11. Common Causes of Flakiness • Changed selectors • Changed application behavior • Waiting • Test order dependency • Test parallelization • Test setup • 3rd party code

12. Common Selenium Errors • StaleElementReference • Element is not clickable at point (x,y) • ElementNotFound *https://www.seleniumhq.org/exceptions/stale_element_reference.jsp

13. Selenium Silliness

14. ToolkitToolkit

15. How to Un-flake Flaky Tests - A New Hire’s Toolkit Hat Collection Zachary Attas | Senior Test Engineer | ReviewTrackers

16. Hat Collection Selenium Speed Super User Triage Debugger Diffing HTML Application Changes Application Versions The Complications of CI The Internet Application Internals

17. Hat Collection Selenium Speed Super User Triage Debugger Diffing HTML Application Changes Application Versions The Complications of CI The Internet Application Internals

18. Selenium Speed • It’s faster than you • Can uncover bugs

19. Selenium Speed Example

20.

21. Hat Collection Selenium Speed Super User Triage Debugger Diffing HTML Application Changes Application Versions The Complications of CI The Internet Application Internals

22. Super User • Test workflow valid? • Foreseeable error?

23. Can The Super User Spot The Error?

24.

25. Hat Collection Selenium Speed Super User Triage Debugger Diffing HTML Application Changes Application Versions The Complications of CI The Internet Application Internals

26. Triage

27. Triage

28. Stacktrace

29. Stacktrace

30. Screenshots

31. Video

32.

33. Hat Collection Selenium Speed Super User Triage Debugger Diffing HTML Application Changes Application Versions The Complications of CI The Internet Application Internals

34. Debugging Selenium Code Application Code The error

35. Breakpoints in the Test

36. Network Traffic

37. Chrome Dev Console Tricks • $x for xpath

38. Chrome Dev Console Tricks • document.querySelectorAll for css

39. Chrome Dev Console Tricks • Draw a red box around element Capybara .current_session .driver .browser .execute_script( "arguments[0].style.border='3px solid red’", <element>)

40. Chrome Dev Console Tricks • Draw a red box around element

41. Application Logs

42. Application Log Tailing (while test is running)

43.

44. Hat Collection Selenium Speed Super User Triage Debugger Diffing HTML Application Changes Application Versions The Complications of CI The Internet Application Internals

45. Diffing HTML

46. Capture HTML changes

47. Xmllint xmllint -- format <original_file> >> <beautified_file>

48. Beautified HTML • First beautify the HTML file, it makes for easier diff-ing • xmllint -- format <file> >> <beautified_file>

49. KDiff3 to diff the HTML

50.

51. Hat Collection Selenium Speed Super User Triage Debugger Diffing HTML Application Changes Application Versions The Complications of CI The Internet Application Internals

52. The Internals of Your Application • System Architecture • “Where the bodies are buried” • Which flavor of Javascript? • Who to ping in Engineering

53.

54. Hat Collection Selenium Speed Super User Triage Debugger Diffing HTML Application Changes Application Versions The Complications of CI The Internet Application Internals

55. Application Changes • Recent development logs • Release notes • Bug database

56.

57. Hat Collection Selenium Speed Super User Triage Debugger Diffing HTML Application Changes Application Versions The Complications of CI The Internet Application Internals

58. Incompatible Versions • Selenium/Selenium Grid • Drivers • Browser version • OS

59. Incompatible Versions * https://github.com/SeleniumHQ/selenium/issues/5058

60.

61. Hat Collection Selenium Speed Super User Triage Debugger Diffing HTML Application Changes Application Versions The Complications of CI The Internet Application Internals

62. The Complications of CI • Different runtime • Network latency • Browser window size • Blacklisting • Timezones

63.

64. Hat Collection Selenium Speed Super User Triage Debugger Diffing HTML Application Changes Application Versions The Complications of CI The Internet Application Internals

65. The Internet

66.

67. Hat Collection Selenium Speed Super User Triage Debugger Diffing HTML Application Changes Application Versions The Complications of CI The Internet Application Internals

68. The Last Hat! • Code review tests like application code • Test fixes 10x (or more) in parallel • Test fixes how they are run in CI

69. Recap Selenium Speed Super User Triage Debugger Diffing HTML Application Changes Application Versions The Complications of CI The Internet Application Internals Hazmat Suit

70. Thank you! /snackattas in/zachary-attas Question?

How to Un-Flake Flaky Tests - A New Hire's Toolkit

Recommended

Recommended

More Related Content

What's hot

What's hot (19)

Similar to How to Un-Flake Flaky Tests - A New Hire's Toolkit

Similar to How to Un-Flake Flaky Tests - A New Hire's Toolkit (20)

Recently uploaded

Recently uploaded (20)

How to Un-Flake Flaky Tests - A New Hire's Toolkit