A Future where we don’t write tests

•

0 likes•65 views

Felix Dobslaw

A (slightly provocative) view on the future of testing. :)

Technology

A Future where we don’t write tests
Felix Dobslaw
#TestVikings

What do we mean by test
automation?
Often: running (human created) tests automatically

What do we mean by test
automation?
Often: running (human created) tests automatically
Here: running machine created tests (automatically)

program
Specification:
inputs
outputs
requirements
constraints

program
Specification:
tests
verify
Specification
inputs
outputs
requirements
constraints

Boundary Value Analysis/Testing
Why? Find bugs, anomalies, deviation from specification

Boundary Value Analysis/Testing
Why? Find bugs, anomalies, deviation from specification
What are program boundaries?

Boundary Value Analysis/Testing
Why? Find bugs, anomalies, deviation from specification
What are program boundaries?
Take 1: where things are supposed to change (specification focus)

Pizza order
curl -X POST https://www.FelixPizza.com/order -d "type=hawaii&number=2"

Pizza order
curl -X POST https://www.FelixPizza.com/order -d "type=hawaii&number=2"
... -d "type=hawaii&number=1000"

Boundary Without Oracle
month
day of month
year

program
Specification:
tests
inputs
outputs
requirements
constraints
T D

program
Specification:
tests
inputs
outputs
requirements
constraints
T
D
boundary
implementation

program
Specification:
tests
inputs
outputs
requirements
constraints
T
D
boundary
implementation
boundary
mining

program
Specification:
tests
inputs
outputs
requirements
constraints
T
D
boundary
implementation
boundary
mining
Specification Pull Request:
PizzeriaId = 42 && -1 < number < 1_000_000

Specification Pull Request Update:
PizzeriaId = 42 && 0 < number < 12
program
Specification:
tests
inputs
outputs
requirements
constraints
T
D
boundary
implementation
boundary
mining
Specification Pull Request:
PizzeriaId = 42 && -1 < number < 1_000_000

programprogramteststests
Specification Pull Request Update:
PizzeriaId = 42 && 0 < number < 12
program
Specification:
tests
inputs
outputs
requirements
constraints
T
D
boundary
implementation
boundary
mining
Specification Pull Request:
PizzeriaId = 42 && -1 < number < 1_000_000

TestVikings

“We come over land and sea to break your code”
Find us at: https://testvikings.github.io/
Feel free to add me on LinkedIn for updates (Felix Dobslaw)

What's hot

Code metrics in PHP

Julio Martinez

Programmers aren’t perfect. Testing and manual code reviews can’t find every problem in code. So, bugs persist. And it’s only going to get worse as your systems grow larger and more complex. How can you find critical problems in your code? And still release a quality product on time? Static code analysis might be the answer you’re looking for. Find out why: -Bug-free software is hard to achieve. -Automated tools are the way to go. -Safe, secure, and reliable software can be achieved at lower costs. Plus, you’ll see examples of bugs easily missed by manual code reviews. And you’ll learn how static code analysis and manual code reviews work together.

How To Improve Quality With Static Code Analysis

Perforce

Code Review

rantav

Mahesh_Chaudhar_Softwaare_Engg_Automation

Mahesh Chaudhar

Soirée du Test Logiciel - Présentation de Kiuwan (Jack ABDO)

TelecomValley

Code Coverage and Test Suite Effectiveness: Empirical Study with Real Bugs in...

Pavneet Singh Kochhar

Personalized Defect Prediction

Sung Kim

Top 10 static code analysis tool

scmGalaxy Inc

Designing Test Cases for the Gilded Rose Kata v2 (2015)

Peter Kofler

Dw testing

Gayatri P

2010 US Codility Product Demo

Codility

Crowd debugging (FSE 2015)

Sung Kim

Automatically Generated Patches as Debugging Aids: A Human Study (FSE 2014)

Sung Kim

Static Code Analysis

Obika Gellineau

Improving Code Quality Through Effective Review Process

Dr. Syed Hassan Amin

Chapter17 of clean code

Kuyseng Chhoeun

Presentation slides: "How to get 100% code coverage"

Rapita Systems Ltd

API World 2016 - A five-sided prism polarizing Web API development

Restlet

Code Coverage Revised : EclEmma on JaCoCo

Evgeny Mandrikov

Cross-browser test automation continues to be a huge challenge. Test flakiness and code maintenance — together with the complexity of automating advanced scenarios in shrunken timelines — has created a need for next-gen test automation. And that’s where codeless testing can help. Powered by machine-learning and AI, codeless testing is best positioned to support test automation challenges and compliment code-based test scripts. Join Eran Kinsbruner, Chief Evangelist and author at Perfecto, along with Tzvika Shahaf, AVP Sales Engineering, as they take codeless test automation to the next level. In this webinar, you will learn how to create a robust codeless Selenium test script that can run in parallel against multiple browser permutations from within continuous integration (Jenkins, TeamCity, e.g.) environments. In this live webinar, Eran and Tzvika will cover the following: • The key benefits of codeless test automation and the challenges it solves. • How to configure codeless testing to run from within a scheduler or leading CI servers. • How to visualize parallel codeless testing via a CI dashboard. • How to get a single view of code-based and codeless in a single report.

Advanced Codeless Testing for Web Apps

Perfecto by Perforce

What's hot (20)

Code metrics in PHP

How To Improve Quality With Static Code Analysis

Code Review

Mahesh_Chaudhar_Softwaare_Engg_Automation

Soirée du Test Logiciel - Présentation de Kiuwan (Jack ABDO)

Code Coverage and Test Suite Effectiveness: Empirical Study with Real Bugs in...

Personalized Defect Prediction

Top 10 static code analysis tool

Designing Test Cases for the Gilded Rose Kata v2 (2015)

Dw testing

2010 US Codility Product Demo

Crowd debugging (FSE 2015)

Automatically Generated Patches as Debugging Aids: A Human Study (FSE 2014)

Static Code Analysis

Improving Code Quality Through Effective Review Process

Chapter17 of clean code

Presentation slides: "How to get 100% code coverage"

API World 2016 - A five-sided prism polarizing Web API development

Code Coverage Revised : EclEmma on JaCoCo

Advanced Codeless Testing for Web Apps

Similar to A Future where we don’t write tests

Software Testing - Day One

Govardhan Reddy

Tec314

John Art

Using Diversity for Automated Boundary Value Testing

Felix Dobslaw

Tdd & clean code

Eyal Vardi

Professional Code Reviews - Bogdan Gusiev

Ruby Meditation

As release velocity increases, teams are finding innovative ways to detect and resolve performance issues earlier in the development cycle. This session will explore how to integrate performance testing into a development lifecycle and why the practice is gaining popularity. Learn how to create a balanced test strategy that matches test type, coverage, environment, and defect target. Scale to deliver high-performing applications. Through continuous integration platforms, performance testing tools, and AppDynamics, see how automated performance testing can reduce time-to-market while increasing overall quality. Key takeaways: o How to get started with performance test automation o How to detect and resolve performance issues earlier in the development lifecycle with AppDynamics o How to maximize the quality and value of your performance test strategy Brad Stoner Senior Sales Engineer, AppDynamics Resources: KonaKart - http://www.konakart.com/ Adminer - https://www.adminer.org/ Jenkins - https://jenkins.io/ NeoLoad - http://www.neotys.com/neoload/overview AppDynamics - https://www.appdynamics.com/free-trial/ GitHub - https://github.com/ Docker Hub - https://hub.docker.com/

AppSphere 2016 - Automate performance testing with AppDynamics using continuo...

Brad Stoner

A journey to_be_a_software_craftsman

Jaehoon Oh

Presented at SeleniumConf 2023, this talk explores the experience of building Quality Gates using ReportPortal.io for a test regression suite with 200,000 test cases. The discussion highlights the distinctions between functional and non-functional quality gates, explaining why Sonarqube's Quality Gates may be insufficient. It also outlines how to break down the regression structure to organize execution sequences controlled by quality gate checks. These checks are based on various factors, including functional application aspects, test failure types, test case priorities, tested components, user flows, and more—providing a comprehensive approach to ensuring software quality. Speaker: Dmitriy Gumeniuk, CEO ReportPortal.io, Head of Testing Products at EPAM Systems. The talk on youtube: https://www.youtube.com/watch?v=At5MEWqf_TI

Building functional Quality Gates with ReportPortal

Dmitriy Gumeniuk

Quality Control Proposal

Maia Reshef

The promise of DevOps is that we can push new ideas out to market faster while avoiding delivering serious defects into production. Andreas Grabner explains that testers are no longer measured by the number of defect reports they enter, nor are developers measured by the lines of code they write. As a team, you are measured by how fast you can deploy high quality functionality to the end user. Achieving this goal requires testers to increase their skills. It’s all about finding solutions—not just problems. Testers must transition from reporting “app crashes” to providing details such as “memory leak caused by bad cache implementation.” Instead of reporting “it’s slow,” testers must discover “wrong hibernate configuration causes too much traffic from the database.” Using three real-life examples, Andreas illustrates what it takes for testing teams to become part of the DevOps transformation—bringing more value to the entire organization.

DevOps: Find Solutions, Not More Defects

TechWell

Becoming the next Uber is only possible if you can deliver your code updates faster to your end users. But for your organization, does delivering code faster present a higher likelihood of failing faster? Discover four metrics you should be tracking starting from your workstation all the way through CI and into Ops. Learn how companies like Facebook, CreditOne, and others apply metric-driven DevOps. See use cases of crashed rapid deployments and how they used the metrics to detect the root cause. Learn how to apply these metrics to steer your pipeline to build better code and deploy faster, without failing faster!

Metrics-Driven Devops: Delivering High Quality Software Faster!

Dynatrace

Kim Carter (BinaryMist)

AgileNZ Conference

Framework Engineering Revisited

YoungSu Son

Preparing for Enterprise Continuous Delivery - 5 Critical Steps

XebiaLabs

Introduction to DevOps

OCTO Technology

Testing Vue Apps with Cypress.io (STLJS Meetup April 2018)

Christian Catalan

Continuous delivery is more than dev ops

Agile Montréal

Optimizely Agent: Scaling Resilient Feature Delivery

Optimizely

Let's not rewrite it all

Michelle Brush

We are in the midst of a revolution. The ways in which software and value is delivered to users and the role that very frequent user feedback plays in the development lifecycle is radically different from legacy models that had software delivered on yearly cycles. The IT processes in place today cannot meet the new demands for weekly or daily releases, so we must change them. But these existing processes are serving a purpose, ensuring the quality, robustness, security and compliance of the software. Today’s processes are centered on the client-server architectures that have reigned since the 1990s, and as a result the steps in the software development lifecycle (SDLC) predominantly involve performing operations on servers (and storage and networks). Further, IT job functions have been established to execute those processes. In this talk we look at key existing requirements such as security and compliance, as well as some new ones such as rapid experimentation. We will rethink processes to satisfy these requirements and propose new organizational structures to execute them (spoiler alert, it is not a plan/build/run structure). Finally, we will detail some of the requirements on the IT system architectures that will allow these marked process changes. Session participants will leave with a concrete framework for transforming current IT practices, roles and responsibilities, and a clear understanding of the key technology enablers thereof.

Velocity NY 2016 - Devops: Who Does What?

cornelia davis

Similar to A Future where we don’t write tests (20)

Software Testing - Day One

Tec314

Using Diversity for Automated Boundary Value Testing

Tdd & clean code

Professional Code Reviews - Bogdan Gusiev

AppSphere 2016 - Automate performance testing with AppDynamics using continuo...

A journey to_be_a_software_craftsman

Building functional Quality Gates with ReportPortal

Quality Control Proposal

DevOps: Find Solutions, Not More Defects

Metrics-Driven Devops: Delivering High Quality Software Faster!

Kim Carter (BinaryMist)

Framework Engineering Revisited

Preparing for Enterprise Continuous Delivery - 5 Critical Steps

Introduction to DevOps

Testing Vue Apps with Cypress.io (STLJS Meetup April 2018)

Continuous delivery is more than dev ops

Optimizely Agent: Scaling Resilient Feature Delivery

Let's not rewrite it all

Velocity NY 2016 - Devops: Who Does What?

Recently uploaded

Introduction to use of FHIR Documents in ABDM

Kumar Satyam

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

In this session, we will discuss the journey of API governance from its initial, ungoverned state to the development of sophisticated models that tackle contemporary challenges. We'll explore how APIs have become essential in the intersection of business and technology, adapting to advancements and evolving needs. We'll focus on how organizations have moved from launching to monetizing APIs, using models like pay-per-use and subscriptions, and finding the right balance between technical implementation and business strategy. We'll also highlight the impact of governance on monetization strategies, especially how data security, compliance, and service quality influence pricing. Real-world examples will demonstrate the effective integration of governance with monetization, including AI's role in dynamic pricing. Looking ahead, we'll share insights into future trends in API governance and monetization, emphasizing the importance of adaptability, continuous learning, and innovation.

API Governance and Monetization - The evolution of API governance

WSO2

DBX First Quarter 2024 Investor Presentation

Dropbox

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Zilliz

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

Simplifying Mobile A11y Presentation.pptx

MarkSteadman7

Dubai, known for its towering skyscrapers, luxurious lifestyle, and relentless pursuit of innovation, often finds itself in the global spotlight. However, amidst the glitz and glamour, the emirate faces its own set of challenges, including the occasional threat of flooding. In recent years, Dubai has experienced sporadic but significant floods, disrupting normalcy and posing unique challenges to its infrastructure. Among the critical nodes in this bustling metropolis is the Dubai International Airport, a vital hub connecting the world. This article delves into the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Orbitshub

Design and Development of a Provenance Capture Platform for Data Science

Paolo Missier

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

In today's digital world, trust is key to customer relationships, but keeping it is a huge challenge. Customers are well-informed and empowered, quick to change brands if their trust is broken, even if it costs them more. This puts a lot of pressure on organizations to handle trust and safety issues with great care and transparency. The challenge, however, is real. Fragmented solutions have left privacy, legal, and security teams in a perpetual cycle of catch-up, struggling to update privacy notices, manage customer data rights, and answer lengthy security questionnaires—all while trying to prove ROI to the business. It's a thankless job, filled with repetition, tedious tasks, and constant interdepartmental coordination. Combine this with fast regulatory changes and the quick evolution of AI, and it becomes overwhelming. Join this webinar to learn more about TrustArc's new innovative solution Trust Center, the only unified, no-code online hub for trust and safety information built for privacy, security, compliance, and legal teams. Trust Center streamlines your path to compliance, shortens the pre-sales cycle, and reduces both legal and regulatory risks, saving time, effort, and cost. This webinar will review: - Why companies are building unified Trust Centers for a robust privacy program. - How unified Trust Centers streamline sales cycles, ensure regulatory compliance, and reduce operational bottlenecks. - How compliance, legal, security, GRC, and privacy teams benefit from a unified Trust Center in terms of needs, pains, and outcomes. - How TrustArc Trust Center saves time and work while reducing legal, reputational, and compliance risk by effectively managing policies, notices, terms, and disclosures, and providing real-time updates on subprocessors.

TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...

TrustArc

WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...

WSO2

At its core, the challenge of managing Human Resources data is an integration challenge: estimates range from 2-3 HR systems in use at a typical SMB, up to a few dozen systems implemented amongst enterprise HR departments, and these systems seldom integrate seamlessly between themselves. Providing a multi-tenant, cloud-native solution to integrate these hundreds of HR-related systems, normalize their disparate data models and then render that consolidated information for stakeholder decision making has been a substantial undertaking, but one significantly eased by leveraging Ballerina. In this session, we’ll cover: The overall software architecture for VHR’s Cloud Data Platform Critical decision points leading to adoption of Ballerina for the CDP Ballerina’s role in multiple evolutionary steps to the current architecture Roadmap for the CDP architecture and plans for Ballerina WSO2’s partnership in bringing continual success for the CD

Less Is More: Utilizing Ballerina to Architect a Cloud Data Platform

WSO2

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

MINDCTI Revenue Release Quarter One 2024

MIND CTI

Recently uploaded (20)