Making Your Results Visible - A Test Result Dashboard and Comparison Tool

•

3 likes•9,304 views

This document introduces REPAUTO, a test automation framework that aims to address common issues like flaky tests. It summarizes the key problems such as the large number of tests, devices and networks that can cause failures, and the difficulty of debugging issues. The framework proposes centralized logging, history comparison and flake detection to make triaging easier. It was built with technologies like Allure and MVC, and the source code is available on GitHub for feedback.

INTRODUCTION
James Farrier
• Test Engineering Lead Fiserv
• Love warm weather and walks along the beach
Xiaoxing Hu
• Test Engineer
• Evangelizing Ruby to C# developers
• Don’t try to poach him! I will be watching…

THANKS TO
• Sumit Poddar
• Tim Goodwin
• Brian Brewer
• Team at FISERV
(Especially Tristan Worley)

AUTOMATION EVERYWHERE 
what, where, who?

“So, for our XXXXX iPhone app we have  
8 UNIT TESTSall together.  
One of the unit tests is just an  
EXAMPLEthough. ☺ ”
-Developer
(Yes he really did put the smiley face in there)

One framework to rule them all…
and selenium to bind them

Seconf 14 - Allure
http://allure.qatools.ru

Positive feedback => jamesfarrier@gmail.com 
Technical support => dawnstar.hu@gmail.com 
Negative feedback => jamesfarrier+spam@gmail.com 
 
 
Github – https://github.com/xiaoxinghu/repauto
FEEDBACK / QUESTIONS

Modern development practices include testing our Web applications as a fundamental part of the application development lifecycle. Web UIs though can be particularly difficult to test with basic tools. Arquillian is an award-winning integration testing framework and Selenium WebDriver is an outstanding tool for UI test automation. Together they offer a base for high-quality tests. This session looks to the Arquillian Universe for help. Equipped with the Arquillian extensions - Drone, Graphene and Warp - we will show you tests that cover both client-side (REST) and server-rendered (JSF) web applications. With a single test it is now possible to assert state (both in the server and on the client) at arbitrary points within the request lifecycle! We will look at current best practices for how to achieve a rapid turnaround when doing test development by minimizing the effort required to write tests, and thereby increase productivity and thus making these tests future-proof. Additionally we will show tools and techniques that provide a separation of concerns between test authors (developers) and test automators (QA). How to execute a single test in both arbitrary server containers as well as arbitrary client browsers. And how it can enable us to run test suites in constrained environments like cloud-based continuous integration providers.

Yandex allure

Anton Shapin

This session outlines how to effectively test Java EE APIs like JSF, Servlet, CDI, EJB 3, JPA, WebSocket and JAX-RS. Java EE includes a number of new features that enhance testability like generic dependency injection, CDI @Alternative, portable extensions, embedded containers and JSF project stages. Using these features and best of breed tools like JUnit and Arquillian it is possible to perform unit, integration, system and functional testing for Java EE APIs at all layers of the application. In addition to discussing tools and features, the session will also demonstrate testing techniques like designing for testability, mock objects, isolation and test configuration.

Page Objects Done Right - selenium conference 2014

Oren Rubin

Reactive Java EE - Let Me Count the Ways!

Reza Rahman

As our industry matures there are pockets of increased demand for high-throughput, low-latency systems heavily utilizing event-driven programming and asynchronous processing. This trend is gradually converging on the somewhat well established but so-far not well understood term "Reactive". This session explores how vanilla Java SE and Java EE aligns with this movement via features and APIs like JMS, MDB, EJB @Asynchronous, JAX-RS/Servlet/WebSocket async, CDI events, Java EE concurrency utilities and so on. We will also see how these robust facilities can be made digestible even in the most complex cases for mere mortal developers through Java SE 8 Lambdas and Completable Futures.

[Report] Social Data Intelligence, by Susan Etlinger

Altimeter, a Prophet Company

According to Altimeter Group research, the average enterprise-class company owns 178 social media accounts, while 13 departments—from marketing to customer support to legal-- actively engage in social media. Yet social media— and as a result, social data— are still largely isolated from business-critical enterprise data sourced from platforms such as Customer Relationship Management, Business Intelligence and market research. This lack of a holistic view of social signals in the context of other enterprise and external data can lead to partially-informed decisions, missed opportunity, and increased risk and cost, as the organization makes decisions without the benefit of critical input from external constituencies. In this Altimeter Group research report reflecting input from 35 enterprise-class organizations and technology ecosystem contributors, industry analyst Susan Etlinger lays out an imperative for Social Data Intelligence, identifying key dimensions that organizations must understand, pragmatic steps they can take toward mature integration, and how successful businesses are already using social data in the context of other critical enterprise data to drive measurable value throughout the organization.

Automated Visual Testing That Does Not Suck

adamcarmi

Creating QA DashboardPetro Porchuk

QA Automation Solution

DataArt

BoxLang: Review our Visionary Licenses of 2024

Ortus Solutions, Corp

AI Pilot Review: The World’s First Virtual Assistant Marketing Suite

Google

AI Pilot Review: The World’s First Virtual Assistant Marketing Suite 👉👉 Click Here To Get More Info 👇👇 https://sumonreview.com/ai-pilot-review/ AI Pilot Review: Key Features ✅Deploy AI expert bots in Any Niche With Just A Click ✅With one keyword, generate complete funnels, websites, landing pages, and more. ✅More than 85 AI features are included in the AI pilot. ✅No setup or configuration; use your voice (like Siri) to do whatever you want. ✅You Can Use AI Pilot To Create your version of AI Pilot And Charge People For It… ✅ZERO Manual Work With AI Pilot. Never write, Design, Or Code Again. ✅ZERO Limits On Features Or Usages ✅Use Our AI-powered Traffic To Get Hundreds Of Customers ✅No Complicated Setup: Get Up And Running In 2 Minutes ✅99.99% Up-Time Guaranteed ✅30 Days Money-Back Guarantee ✅ZERO Upfront Cost See My Other Reviews Article: (1) TubeTrivia AI Review: https://sumonreview.com/tubetrivia-ai-review (2) SocioWave Review: https://sumonreview.com/sociowave-review (3) AI Partner & Profit Review: https://sumonreview.com/ai-partner-profit-review (4) AI Ebook Suite Review: https://sumonreview.com/ai-ebook-suite-review

Viewers also liked

Arquillian

Korhan Gülseven

Distributed automation sel_conf_2015

Testing the Java EE

Allure framework

Arquillian

Arquillian - Integration Testing Made Easy

JBUG London

Arquillian : An introduction

Vineet Reynolds

Allure framework. Пример настройки исчерпывающего репорта на реальном проекте

COMAQA.BY

Allure FrameworkArtem Eroshenko

Responsive Web Design testing using Galen Framework

Birudugadda Pranathi

COMAQA.BY Conf #2: “Настройка Allure при использовании TestNG-Retry, Антон Ем...

COMAQA.BY

AQA TALKS 4 - AUTOMATION TEST REPORTER

Taras Lytvyn

How to Use Selenium, Successfully

Sauce Labs

Testing Java EE Applications Using Arquillian

Reza Rahman

Page Objects Done Right - selenium conference 2014

Oren Rubin

Reactive Java EE - Let Me Count the Ways!

Reza Rahman

[Report] Social Data Intelligence, by Susan Etlinger

Altimeter, a Prophet Company

Automated Visual Testing That Does Not Suck

adamcarmi

Creating QA DashboardPetro Porchuk

QA Automation Solution

DataArt

Viewers also liked (20)

Arquillian

Distributed automation sel_conf_2015

Testing the Java EE

Allure framework

Arquillian

Arquillian - Integration Testing Made Easy

Arquillian : An introduction

Allure framework. Пример настройки исчерпывающего репорта на реальном проекте

Allure Framework

Responsive Web Design testing using Galen Framework

COMAQA.BY Conf #2: “Настройка Allure при использовании TestNG-Retry, Антон Ем...

AQA TALKS 4 - AUTOMATION TEST REPORTER

How to Use Selenium, Successfully

Testing Java EE Applications Using Arquillian

Page Objects Done Right - selenium conference 2014

Reactive Java EE - Let Me Count the Ways!

[Report] Social Data Intelligence, by Susan Etlinger

Automated Visual Testing That Does Not Suck

Creating QA Dashboard

QA Automation Solution

Recently uploaded

BoxLang: Review our Visionary Licenses of 2024

Ortus Solutions, Corp

AI Pilot Review: The World’s First Virtual Assistant Marketing Suite

Google

OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam

takuyayamamoto1800

Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf

AMB-Review

Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos https://www.amb-review.com/tubetrivia-ai Exclusive Features: AI-Powered Questions, Wide Range of Categories, Adaptive Difficulty, User-Friendly Interface, Multiplayer Mode, Regular Updates. #TubeTriviaAI #QuizVideoMagic #ViralQuizVideos #AIQuizGenerator #EngageExciteExplode #MarketingRevolution #BoostYourTraffic #SocialMediaSuccess #AIContentCreation #UnlimitedTraffic

Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better

XfilesPro

Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...

Globus

Large Language Models (LLMs) are currently the center of attention in the tech world, particularly for their potential to advance research. In this presentation, we'll explore a straightforward and effective method for quickly initiating inference runs on supercomputers using the vLLM tool with Globus Compute, specifically on the Polaris system at ALCF. We'll begin by briefly discussing the popularity and applications of LLMs in various fields. Following this, we will introduce the vLLM tool, and explain how it integrates with Globus Compute to efficiently manage LLM operations on Polaris. Attendees will learn the practical aspects of setting up and remotely triggering LLMs from local machines, focusing on ease of use and efficiency. This talk is ideal for researchers and practitioners looking to leverage the power of LLMs in their work, offering a clear guide to harnessing supercomputing resources for quick and effective LLM inference.

Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf

Jay Das

Understanding Globus Data Transfers with NetSage

Globus

NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?

Globus Compute wth IRI Workflows - GlobusWorld 2024

Globus

As part of the DOE Integrated Research Infrastructure (IRI) program, NERSC at Lawrence Berkeley National Lab and ALCF at Argonne National Lab are working closely with General Atomics on accelerating the computing requirements of the DIII-D experiment. As part of the work the team is investigating ways to speedup the time to solution for many different parts of the DIII-D workflow including how they run jobs on HPC systems. One of these routes is looking at Globus Compute as a way to replace the current method for managing tasks and we describe a brief proof of concept showing how Globus Compute could help to schedule jobs and be a tool to connect compute at different facilities.

Quarkus Hidden and Forbidden Extensions

Max Andersen

Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...

Mind IT Systems

Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...

Anthony Dahanne

Les Buildpacks existent depuis plus de 10 ans ! D’abord, ils étaient utilisés pour détecter et construire une application avant de la déployer sur certains PaaS. Ensuite, nous avons pu créer des images Docker (OCI) avec leur dernière génération, les Cloud Native Buildpacks (CNCF en incubation). Sont-ils une bonne alternative au Dockerfile ? Que sont les buildpacks Paketo ? Quelles communautés les soutiennent et comment ? Venez le découvrir lors de cette session ignite

Enterprise Resource Planning System in Telangana

NYGGS Automation Suite

Enterprise Resource Planning System includes various modules that reduce any business's workload. Additionally, it organizes the workflows, which drives towards enhancing productivity. Here are a detailed explanation of the ERP modules. Going through the points will help you understand how the software is changing the work dynamics. To know more details here: https://blogs.nyggs.com/nyggs/enterprise-resource-planning-erp-system-modules/

Lecture 1 Introduction to games development

abdulrafaychaudhry

How Recreation Management Software Can Streamline Your Operations.pptx

wottaspaceseo

Recreation management software streamlines operations by automating key tasks such as scheduling, registration, and payment processing, reducing manual workload and errors. It provides centralized management of facilities, classes, and events, ensuring efficient resource allocation and facility usage. The software offers user-friendly online portals for easy access to bookings and program information, enhancing customer experience. Real-time reporting and data analytics deliver insights into attendance and preferences, aiding in strategic decision-making. Additionally, effective communication tools keep participants and staff informed with timely updates. Overall, recreation management software enhances efficiency, improves service delivery, and boosts customer satisfaction.

Accelerate Enterprise Software Engineering with Platformless

WSO2

Key takeaways: Challenges of building platforms and the benefits of platformless. Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience. How Choreo enables the platformless experience. How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo. Demo of an end-to-end app built and deployed on Choreo.

Using IESVE for Room Loads Analysis - Australia & New Zealand

IES VE

Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...

Globus

The Earth System Grid Federation (ESGF) is a global network of data servers that archives and distributes the planet’s largest collection of Earth system model output for thousands of climate and environmental scientists worldwide. Many of these petabyte-scale data archives are located in proximity to large high-performance computing (HPC) or cloud computing resources, but the primary workflow for data users consists of transferring data, and applying computations on a different system. As a part of the ESGF 2.0 US project (funded by the United States Department of Energy Office of Science), we developed pre-defined data workflows, which can be run on-demand, capable of applying many data reduction and data analysis to the large ESGF data archives, transferring only the resultant analysis (ex. visualizations, smaller data files). In this talk, we will showcase a few of these workflows, highlighting how Globus Flows can be used for petabyte-scale climate analysis.

SOCRadar Research Team: Latest Activities of IntelBroker

SOCRadar

The European Union Agency for Law Enforcement Cooperation (Europol) has suffered an alleged data breach after a notorious threat actor claimed to have exfiltrated data from its systems. Infamous data leaker IntelBroker posted on the even more infamous BreachForums hacking forum, saying that Europol suffered a data breach this month. The alleged breach affected Europol agencies CCSE, EC3, Europol Platform for Experts, Law Enforcement Forum, and SIRIUS. Infiltration of these entities can disrupt ongoing investigations and compromise sensitive intelligence shared among international law enforcement agencies. However, this is neither the first nor the last activity of IntekBroker. We have compiled for you what happened in the last few days. To track such hacker activities on dark web sources like hacker forums, private Telegram channels, and other hidden platforms where cyber threats often originate, you can check SOCRadar’s Dark Web News. Stay Informed on Threat Actors’ Activity on the Dark Web with SOCRadar!

Providing Globus Services to Users of JASMIN for Environmental Data Analysis

Globus

JASMIN is the UK’s high-performance data analysis platform for environmental science, operated by STFC on behalf of the UK Natural Environment Research Council (NERC). In addition to its role in hosting the CEDA Archive (NERC’s long-term repository for climate, atmospheric science & Earth observation data in the UK), JASMIN provides a collaborative platform to a community of around 2,000 scientists in the UK and beyond, providing nearly 400 environmental science projects with working space, compute resources and tools to facilitate their work. High-performance data transfer into and out of JASMIN has always been a key feature, with many scientists bringing model outputs from supercomputers elsewhere in the UK, to analyse against observational or other model data in the CEDA Archive. A growing number of JASMIN users are now realising the benefits of using the Globus service to provide reliable and efficient data movement and other tasks in this and other contexts. Further use cases involve long-distance (intercontinental) transfers to and from JASMIN, and collecting results from a mobile atmospheric radar system, pushing data to JASMIN via a lightweight Globus deployment. We provide details of how Globus fits into our current infrastructure, our experience of the recent migration to GCSv5.4, and of our interest in developing use of the wider ecosystem of Globus services for the benefit of our user community.

Recently uploaded (20)

BoxLang: Review our Visionary Licenses of 2024

AI Pilot Review: The World’s First Virtual Assistant Marketing Suite

OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam

Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf

Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better

Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...

Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf

Understanding Globus Data Transfers with NetSage

Globus Compute wth IRI Workflows - GlobusWorld 2024

Quarkus Hidden and Forbidden Extensions

Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...

Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...

Enterprise Resource Planning System in Telangana

Lecture 1 Introduction to games development

How Recreation Management Software Can Streamline Your Operations.pptx

Accelerate Enterprise Software Engineering with Platformless

Using IESVE for Room Loads Analysis - Australia & New Zealand

Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...

SOCRadar Research Team: Latest Activities of IntelBroker

Providing Globus Services to Users of JASMIN for Environmental Data Analysis

Making Your Results Visible - A Test Result Dashboard and Comparison Tool

1. REPAUTO Reporting made better

2. INTRODUCTION James Farrier • Test Engineering Lead Fiserv • Love warm weather and walks along the beach Xiaoxing Hu • Test Engineer • Evangelizing Ruby to C# developers • Don’t try to poach him! I will be watching…

3. THANKS TO • Sumit Poddar • Tim Goodwin • Brian Brewer • Team at FISERV (Especially Tristan Worley)

4. STORY TIME

5. Sometimes things just go WRONG 

6. AUTOMATION EVERYWHERE  what, where, who?

7. “So, for our XXXXX iPhone app we have   8 UNIT TESTSall together.   One of the unit tests is just an   EXAMPLEthough. ☺ ” -Developer (Yes he really did put the smiley face in there)

8. WHY are we doing this?

9. One framework to rule them all… and selenium to bind them

10.

11. Seconf 14 - Allure http://allure.qatools.ru

12.

13. Thousands of  TESTS

14. 9/10 testers agree ‘FLAKES are bad’

15. Devices are HARD

16. ANYTHING can go wrong

17. ANYTHING…

18. So many DEVICES

19. Network   PROBLEMS…

20. Boy who CRIEDwolf

21. Information  OVERLOAD

22. DEBUGGING  is hard

23.

24. Why don’t  we try something   NEW?

25. CENTRALIZED

26.

27. Pick out the FLAKES

28. HISTORY and COMPARISON

29. Easy TRIAGING

30.

31.

32. How did we BUILD it?

33. Allure ADAPTORS

34. M V C

35. Thin Model

36.

37. Controller Simplified

38.

39. https://github.com/xiaoxinghu/datacraft

40. $ dcraft build sync.rb

41. Same Good View

42.   Positive feedback => jamesfarrier@gmail.com  Technical support => dawnstar.hu@gmail.com  Negative feedback => jamesfarrier+spam@gmail.com      Github – https://github.com/xiaoxinghu/repauto FEEDBACK / QUESTIONS

Making Your Results Visible - A Test Result Dashboard and Comparison Tool

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (20)

Recently uploaded

Recently uploaded (20)

Making Your Results Visible - A Test Result Dashboard and Comparison Tool