Bro, manage test data like a pro! [QA Fest 2018]

•

1 like•766 views

This document provides guidance on effectively managing test data for software testing. It discusses 6 approaches to preparing test data: 1) using the user interface, 2) inserting data via API calls, 3) direct SQL insertion into the database, 4) using data sets with DBUnit, 5) versioned data dumps, and 6) reusing production data. The key recommendations are to choose the approach that best fits the system under test, speed up test data management with APIs, reuse live data when possible, and mix strategies as needed to build reliable test cases.

Technology

Bro, manage your test data
like a pro!
Mikalai Alimenkou
@xpinjection
http://xpinjection.com

Telegram channel
https://t.me/xpinjection_channel

Test
Data
Application
Driver
Test
Logic
Test components

Try to avoid
dependent tests
to improve
stability and
speed

Data independency as performance driver
• Most dependencies are data related
• Dependent tests = no parallel execution
• Data should be test specific with no reuse
• Use small focused datasets

Regular system example
SYSTEM
DB
QUEUE
UI
API
EXTERNAL
SERVICES
API CONTRACTS

If you have user
interface, then
you can use it for
testing

#1. Prepare test data using UI
SYSTEM
DB
QUEUE
UI
API
EXTERNAL
SERVICES
API CONTRACTS
#1. UI

Easiest approach to start with
Blackbox solution
Clear and simple
Unstable
Too long
Failures chaining

If UI is unreliable,
you can switch to
API level

#2. Data insertion via API
SYSTEM
DB
QUEUE
UI
API
EXTERNAL
SERVICES
API CONTRACTS
#2. API

Reuse existing API for tests
Data oriented
Much quicker
Require clear API
Greybox
Coding skills
Existing tools

If you have data,
put it in the
database

#3. SQL for direct data insertion to DB
SYSTEM
DB
QUEUE
UI
API
EXTERNAL
SERVICES
API CONTRACTS
#3. SQL

Use internal system knowledge
Flexibility
Quickest way
Whitebox
Support and sync
Too verbose
Direct data access
Caching

#4. Datasets with optional commit
SYSTEM
DB
QUEUE
UI
API
EXTERNAL
SERVICES
API CONTRACTS
#4. DBUnit

Additional level of data abstraction
Great tools around DBUnit
Suitable format
Whitebox
Support and sync
Small datasets
Caching
Flexible constraints

#5. Versioned DUMPs
SYSTEM
DB
QUEUE
UI
API
EXTERNAL
SERVICES
API CONTRACTS
#5. DUMPs

Support DUMPs for different suites
/serviceA/dump/smoke/v50/data.tar.gz
/serviceA/dump/smoke/v51/data.tar.gz
/serviceA/schema/v51/db.jar
/serviceA/dump/regression/v50/data.tar.gz
/serviceA/dump/regression/v51/data.tar.gz

DB Object Pools
• DB instance
• Heavy domain objects
• Available data roots

Version your test data with schema
Direct data access
Quick
Unclear
Required skills
DUMP preparation via UI
Infrastructure support
Artifact repository

If your live system
produces data, it
can be used for
testing

#6. Production data DUMP
SYSTEM
DB
QUEUE
UI
API
EXTERNAL
SERVICES
API CONTRACTS
#6. LIVE DATA

Real data is always better for testing
Live data
No preparation
Large
Permissions
More realistic cases
Security

Summary
• Use UI for test data if the system is black box for you
• Speed up you test data management with API calls
• Put data directly in DB if system is white box for you
• Actively use Docker to prepare test DB images
• Reuse live data if possible for complex systems
• Mix approaches to fill test DB and store dumps to build
Docker images
• Be happy unicorn in the rainbow world ;)

It is not an easy
task to create
reliable tests, try
hard and know
your tools

@xpinjection
http://xpinjection.com
mikalai.alimenkou@xpinjection.com

In this talk, we will go through the design process of modern CI/CD for the microservices-based system with Kubernetes support. We will discuss how to verify consistency between microservices, apply different levels of quality gates and promote artifacts between environments. Thanks to Kubernetes we will review different approaches of environment resources optimization for development needs during CI/CD cycles.

Ride the database in JUnit tests with Database Rider

Mikalai Alimenkou

For a long time DB related testing in Java world has been a real pain and most developers tried to reduce number of such tests as much as possible. With good in-memory database implementations like H2, schema migration solutions like Liquibase or Flyway, containerization with libraries like TestContainers, database management is now much simpler. But test data management is still a pain. Some developers use SQL dumps, others insert data via JPA/JDBC or rely on prepared data sets. Good old DBUnit may be a good option, but it is not so developer friendly and not adopted well for modern annotations driven development style. Database Rider closes the gap between modern Java development environment and DBUnit, bringing DBUnit closer to your JUnit tests, so database testing will feel like a breeze. In addition to flexible data sets management this library provides other useful features: programmatic data sets definition, leak hunting, data sets export, constraints management, etc. As contributor and loyal user for many years, I would like to share my experience with Database Rider and demonstrate how to make database testing a fun again!

Effectiveness tips from Kubernetes trenches by Captain Obvious

Mikalai Alimenkou

Managing Microservices at Scale

Perforce

Microservices allow for extensible app architecture and a vendor-agnostic, scalable infrastructure. While microservices simplify app deployments, they come at a price: because they’re so fragmented, it is more difficult to track and manage all the independent, yet interconnected components of an app. All this information (requirements, code, test cases and results, build artifacts, and deployment blueprints) needs to live somewhere and most importantly be versioned. Using a real example and a live demonstration of Perforce Helix, Docker and Selenium, get best practices and tips for enabling a robust, scalable and extensible pipeline to support today’s modern app delivery.

A practical introduction to observability

Nikolay Stoitsev

Good observability is essential for modern software. It gives us confidence that our systems are working properly. And it also allows us to debug issues efficiently. In this talk, we’ll explore everything you need to know to start applying good observability to your projects. And we’ll see the most common pitfalls you need to be aware of. We will start with the tools and basic concepts in monitoring. And we’ll go over the 3 most common mistakes people make with it. Then we’ll see how to have automatic alerts to detect issues. And, we’ll touch on the principles for setting up good alerts. As a final step, we’ll see how to build our logging system and how to apply it in the most efficient way to debug issues easily.

Open source cloud native security with threat mapper

LibbySchulze

Webinar: Introduction to CloudBees Jenkins Platform

Kiratech

Il Webinar a cura di Kiratech e CloudBees si è tenuto il giorno 04 Aprile 2017. Il webinar andrà ad introdurre CloudBees Jenkins Enterprise, una delle principali soluzioni Enterprise che consente di implementare sistemi di Continuous Integration e Continuous Delivery per software. La piattaforma è basata su Jenkins, uno dei più importanti server open source per l’automation al mondo. Durante il Webinar, potrete approfondire le funzionalità aggiuntive offerte dalla CloudBees Jenkins Platform, rispetto alla comune piattaforma Jenkins Open source. Approfondiremo in particolare i seguenti aspetti: Produttività di Developer e Administrator Scalabilità ed ottimizzazione dell’infrastruttura per installazioni su larga scala High-availability e tolleranza ai guasti Sicurezza avanzata e gestione dei Team Build e Performance Analytics

Redefining cloud native debugging

LibbySchulze

DevOps is a software development methodology that emphasizes communication, collaboration, integration and automation. The DevOps movement at Scania is yet in its early stages, but from the very beginning, the Development and Operations teams have been working in close collaboration. I’ll present key takeaways on how best to proceed with implementing a DevOps culture within a large globally dispersed IT department.

How Samsung Engineers Do Pre-Commit Builds with Perforce Helix Streams

Perforce

Enforce compliance policy with model-driven automation

Puppet

Leveraging the Cloud for Continuous Delivery while Protecting your IP

Perforce

Globally distributed product teams face unique challenges in pursuing Continuous Delivery. Remote team members need latest changes within an expected response time from their peers, development require continuous software integration via build & test automation, and network latency and bandwidth can become critical bottlenecks for distributed teams. Learn how VMware vCloud Hybrid Service with Perforce can serve your remote teams and/or scale your build & test environment

Infrastructure as Code principles and practices

OpenSense Labs

GOTOpia 2020: "The Past, Present, and Future of Cloud Native API Gateways"

Daniel Bryant

Many engineers are confused about how a cloud-native API gateway relates to Kubernetes Ingress or a Service load balancer. This talk will unravel this confusion. An API gateway is at the core of how APIs are managed, secured and presented within any web-based system. Although the technology has been in use for many years, it has not always kept pace with recent developments within the cloud-native space. Join the expert to experts Daniel Bryant in uncovering the evolution of API gateways over the past ten years and how the original problems they were solving have shifted in relation to cloud-native technologies and workflow. Current challenges of using an API gateway within Kubernetes: scaling the developer workflow, and supporting multiple architecture styles and protocols In this talk, you'll learn: How the evolution of API gateways looks Strategies for exposing Kubernetes services and APIs at the edge of your system A brief guide to the (potential) future of cloud-native API gateways

Testing Microservices

Anil Allewar

Once you have your Microservices setup, the most pertinent question is how to I test Microservices and ensure that all the moving parts of this distributed system stay in sync. The presentation provides testing strategies on how to test Microservices and provides focussed understanding of using Consumer Driven Contracts (CDC) to test Microservices API. Additionally it provides pointers around how to do debug Microservices and trace the performance of individual services. Please read the following presentations before referencing "Testing Microservices" 1. Introduction to Microservices - https://www.slideshare.net/anilallewar/introduction-to-microservices-78270318 2. Build the Microservices sample application - https://www.slideshare.net/anilallewar/building-microservices-sample-application

Vulnerability Discovery in the Cloud

DevOps.com

In the era of cloud generation, the constant activity around workloads and containers create more vulnerabilities than an organization can keep up with. Using legacy security vendors doesn't set you up for success in the cloud. You’re likely spending undue hours chasing, triaging and patching a countless stream of cloud vulnerabilities with little prioritization. Join us for this live webinar as we detail how to streamline host and container vulnerability workflows for your software teams wanting to build fast in the cloud. We'll be covering how to: Get visibility into active packages and associated vulnerabilities Reduce false positives by 98% Reduce investigation time by 30% Spot a legacy vendor looking to do some cloud washing

Software Testing in a Distributed Environment

Perforce

Distributed development across countries creates both challenges and opportunities for the production of high quality software. We’ll look at new ways of achieving automation for testing software in a continuous delivery context, using parallelization techniques and automated analysis fully integrated with a reliable and scalable SCM system. A new optimal method of testing common code in similar branches is presented along with the semantic merging of testing results.

Embacing service-level-objectives of your microservices in your Cl/CD

Nebulaworks

Shifting left - How to use Continuous Integration tools to bring security into the DevOps world In today's modern software factories, organizations are shifting security to the left. No longer just the purview of firewalls, security needs to be built in during development and deployment processes. By doing so, organizations can ensure they are limiting vulnerabilities getting into production while cutting costs of both downtime and code rework. Key Takeaways: ○ How to ensure that the use of open source doesn’t introduce vulnerabilities and other security risks ○ How to automate the delivery of trusted images using a policy-driven approach ○ Empowering developers to secure their applications, while maintaining segregation of duties ○ Ensuring the consistent flow of images through the pipeline, with no side-doors or introduction of unvetted images ○ Enforcing immutability of containers, preventing container-image drift

Monitoring in a Microservices World

Docker, Inc.

Fabian Stäber, Instana - In recent years, we saw a great paradigm shift in software engineering away from static monolithic applications towards dynamic distributed horizontally scalable architectures. Docker is one of the key technologies enabling this development. This shift poses a lot of new challenges for application monitoring, ranging from practical issues (need for automation) to technical challenges (Docker networking) to organizational topics (blurring line between software engineers and operations) to fundamental questions (define what is an application). In this talk we show how Docker changed the way we do monitoring, how modern application monitoring systems work, and what future developments we expect.

What's New in Puppet Enterprise 2016.4

Puppet

Major updates to Puppet Enterprise give you the power to use automation as the bridge to your future, whether that's moving to the cloud or adopting containers in production. New change reporting and orchestration features make it easy to drive change with confidence, and tools for building and deploying popular cloud and container technologies give you a standard way to automate the delivery and operation of all of your software. Join us for a webinar to see the latest release in action. You’ll learn about: Orchestration enhancements to give you even more control to run phased deployments and coordinated roll-outs of change Corrective change reporting to gain insight into why changes occur across your infrastructure Tools to automate the build of Docker container images Integration with VMware's vRealize Suite (vRA/vRO) to enable fully automated, self-service provisioning workflows Integration with Jenkins to easily enable you to scale your DevOps practice by building continuous delivery pipelines and orchestrating infrastructure deployment

Toward Hybrid Cloud Serverless Transparency with Lithops Framework

LibbySchulze

DevOpsDaysPhoenix - CI/CD Pipelines for CDN

Akshay Ranganath

Feast '20 slides

gailkaiser

Introduction to Puppet Enterprise 2016.4

Puppet

Fundamental Spring Boot: Keep it Simple, Get it Right, Be Productive and Have...

VMware Tanzu

Cooking Up Windows with Chef Automate

Matt Ray

Bro, manage test data like a pro!

Mikalai Alimenkou

Almost any application or software system manages data. It is hard to imagine test automation that is not affected by this fact. There are many differenct approaches how to prepare system under test, providing predefined test data: use application UI, invoke API methods, run business logic directly, access DB from test scenarios, etc. In this talk we will review most of existing approaches, starting from the easiest and the most popular ones and finishing with really tricky ways to manage your test data for large distributed systems. There is no ideal solution for every case or silver bullet, but I hope your toolset will become wider after visiting this talk.

Building a Testable Data Access Layer

Todd Anglin

All developers understand the theoretical value of unit testing, but with data driven applications, figuring out how to create tests can be hard. In this session, you will learn how to design and build a data layer that can be tested. We will introduce data layer architecture practices and methodologies that make testing possible, and cover the basics of unit test mocking. You will also be guided through various types of testing, including unit, integration, and functional testing. Leave this session with the basics needed to start creating tests for application data layers, including those powered by LinqToSQL and Entity Framework.

What's hot

App sec in the time of docker containers

Akash Mahajan

Infrastructure and Compliance Delight with Chef Automate

Matt Ray

Scania: A DevOps Journey in an Automotive Enterprise

Perforce

How Samsung Engineers Do Pre-Commit Builds with Perforce Helix Streams

Perforce

Enforce compliance policy with model-driven automation

Puppet

Leveraging the Cloud for Continuous Delivery while Protecting your IP

Perforce

Infrastructure as Code principles and practices

OpenSense Labs

GOTOpia 2020: "The Past, Present, and Future of Cloud Native API Gateways"

Daniel Bryant

Testing Microservices

Anil Allewar

Vulnerability Discovery in the Cloud

DevOps.com

Software Testing in a Distributed Environment

Perforce

Embacing service-level-objectives of your microservices in your Cl/CD

Nebulaworks

Monitoring in a Microservices World

Docker, Inc.

What's New in Puppet Enterprise 2016.4

Puppet

Toward Hybrid Cloud Serverless Transparency with Lithops Framework

LibbySchulze

DevOpsDaysPhoenix - CI/CD Pipelines for CDN

Akshay Ranganath

Feast '20 slides

gailkaiser

Introduction to Puppet Enterprise 2016.4

Puppet

Fundamental Spring Boot: Keep it Simple, Get it Right, Be Productive and Have...

VMware Tanzu

Cooking Up Windows with Chef Automate

Matt Ray

What's hot (20)

App sec in the time of docker containers

Infrastructure and Compliance Delight with Chef Automate

Scania: A DevOps Journey in an Automotive Enterprise

How Samsung Engineers Do Pre-Commit Builds with Perforce Helix Streams

Enforce compliance policy with model-driven automation

Leveraging the Cloud for Continuous Delivery while Protecting your IP

Infrastructure as Code principles and practices

GOTOpia 2020: "The Past, Present, and Future of Cloud Native API Gateways"

Testing Microservices

Vulnerability Discovery in the Cloud

Software Testing in a Distributed Environment

Embacing service-level-objectives of your microservices in your Cl/CD

Monitoring in a Microservices World

What's New in Puppet Enterprise 2016.4

Toward Hybrid Cloud Serverless Transparency with Lithops Framework

DevOpsDaysPhoenix - CI/CD Pipelines for CDN

Feast '20 slides

Introduction to Puppet Enterprise 2016.4

Fundamental Spring Boot: Keep it Simple, Get it Right, Be Productive and Have...

Cooking Up Windows with Chef Automate

Similar to Bro, manage test data like a pro! [QA Fest 2018]

Bro, manage test data like a pro!

Mikalai Alimenkou

Building a Testable Data Access Layer

Todd Anglin

Service Virtualization: What Testers Need to Know

TechWell

Unrestrained access to a trustworthy and realistic test environment—including the application under test and all of its dependent components—is essential for achieving “quality @ speed” with agile, DevOps, and continuous delivery. Service virtualization is an emerging technology that provides teams access to a complete test environment by simulating the dependent components that are beyond their control, still evolving, or too complex to configure in a test lab. Arthur Hicken covers the ABCs of service virtualization—what it is and how it impacts Access, Behavior, Cost, and Speed. Learn how it can help you test more rigorously, avoid parallel development bottlenecks, and isolate application layers for debugging and performance testing in two ways—first, by providing access to dependent system components that would otherwise delay development and testing tasks; and second, by allowing you to alter the behavior of those dependent components in ways that would be impossible with a staged test environment.

The Importance of Data for DevOps: How TCF Bank Meets Test Data Challenges

Compuware

Generating realistic, privatized test data and delivering it to your teams fast enough to meet the demands of your business is a growing issue at agile organizations. To help you overcome these challenges, TCF Bank shares how they are innovatively using DevOps-supporting test data management techniques with the help of Compuware to effectively: • Deliver test data to internal teams with agility • Develop repeatable processes that fit within two-week sprints • Privatize data based on nuanced demands from development teams • Manage an influx of test data requests from internal teams • Automate processes to ensure test data management aligns with security protocols • Work across mainframe and distributed teams with their own priorities and deliverables

Automated Testing with Databaseselliando dias

Machine Data 101

Splunk

Who should attend? Beginner - New to Splunk and have not used it before. Description: Machine-generated data is one of the fastest growing and complex areas of big data. It's also one of the most valuable, containing a definitive record of all user transactions, customer behavior, machine behavior, security threats, fraudulent activity and more. Join us as we explore the basics of machine data analysis and highlight techniques to help you turn your organization’s machine data into valuable insights. This introductory workshop includes a hands-on(bring your laptop) demonstration of Splunk’s technology and covers use cases both inside and outside IT. Learn why more than 13,000 customers in over 110 countries use Splunk to make business, government, and education more efficient, secure, and profitable.

Database CI/CD Pipeline

muhammadhashir57

Spirent: Datum User Experience Analytics System

Sailaja Tennati

Data Services: Whether in the lab or the live network, Datum efficiently measures the user experience of data services. Evaluate user experience with a unified approach across all major mobile OS platforms and access technologies including LTE, 3G, and Wi-Fi. Click here to find out more about Spirent Communication's User Experience Evaluation System Suite: http://www.spirent.com/Products/User_Experience_Evaluation

APT iTest and Velocity 7.3 Use Cases.pptx

RajeshParmar99

Critical Preflight Checks for Your EPM Applications

Datavail

The environment which houses your business critical EPM applications is complex. Maybe as complex as the cockpit of an aircraft. Just as a pilot might not be able to build or fix everything on their plane, you might be using applications but not know how to build or fix everything that’s being used. This shouldn’t stop you from doing a pre-flight check to ensure that all your Hyperion systems are running properly and set for you and your end users. Let’s talk about some different strategies to achieve this and give you the confidence in your systems so that you can know when things are running well—or more importantly, when they need attention before takeoff.

Modernizing Testing as Apps Re-Architect

DevOps.com

Applications are moving to cloud and containers to boost reliability and speed delivery to production. However, if we use the same old approaches to testing, we'll fail to achieve the benefits of cloud. But what do we really need to change? We know we need to automate tests, but how do we keep our automation assets from becoming obsolete? Automatically provisioning test environments seems close, but some parts of our applications are hard to move to cloud.

Kevin Slade - CVKevin Slade

QAing INFRASTRUCTURE- A QA's role in the DevOps World-Aroj P George & Harshad...bhumika2108

Spark Infrastructure Made Easy

BlueData, Inc.

BlueData makes on-premises Spark infrastructure easy. With BlueData, you can spin up virtual Spark clusters within minutes – providing secure, on-demand access to Big Data analytics and infrastructure. You can use Spark with or without the Hadoop ecosystem of tools – using HDFS, Tachyon, or any shared storage system. You can also build analytical pipelines and create Spark clusters using our RESTful APIs. BlueData’s software platform leverages virtualization and patent-pending innovations to make it simpler, faster, and more cost-effective to deploy Hadoop or Spark infrastructure on-premises. Learn more at http://www.bluedata.com

Wamika Singh, Suman Kumari - Let's decipher the DevOps macedonia - Codemotion...

Codemotion

There’s a lot of buzz around different DevOps tools being thrown around, and it can be difficult to break through the noise. We plan to share our success story of what to do/not to do while powering your software with the most acclaimed DevOps technologies. From provisioning clusters with Kubernetes to scaling the product for global user base; from Streaming live data using Kafka/Spark to consolidating it in Athena; from monitoring with Kibana to continuously integrating & deploying with GoCD, we promise to you a smooth ride. Come hear our journey of moving a monolith to elastic infrastructure

AzureSQL Managed Instance (SQLKonferenz 2018)

Jovan Popovic

Testing for Logic App Solutions | Integration Monday

BizTalk360

Don't Fumble the Data! Integrate Database Automation into your DevOps Toolchain

DevOps.com

Today, we have proven techniques for many DevOps practices. For provisioning a new environment, we apply file based environment definitions to dynamic infrastructure: Helm for Kubernetes, Heat for OpenStack or Terraform for other clouds. For automating an application deployment, we can turn to basic pipelines like Jenkins provides or release automation tools like IBM UrbanCode deploy. However, one area is a constant sticking point. Data. A provisioned test lab is useless without test data. Automated deployment tied to a manual schema update is only as fast as good as the DBA's working by hand. Meanwhile, data is different. There can be a lot of it. It's often sensitive. Changes to schema are generally incremental. Naively applying something like Terraform to the data problem is a recipe for trouble. There is good news. Tools that specialize in managing databases are easy to integrate into your DevOps toolchain. Join Actifio's Jay Livens, DBmaestro's Chris Lucca and IBM's Eric Minick for a lively conversation examining how to overcome this stumbling block.

ETL Testing Services - Safeguard Your Data

BugRaptors

DataOps as a Service

AgitaJaunzeme

Modern data engineering needs to be agile and respond quickly to a changing business landscape without sacrificing data quality. DevOps revolutionized Software engineering by adopting agile, lean practices and fostering collaboration. We can see the same need in Data Engineering. In this talk, we will go over how we can adopt the best DevOps practices in the space of data engineering. And what are the challenges in adopting them considering the different skill sets of the data engineers and the various needs? - What is the API for Data? - What types of SLOs and SLAs do data engineers need to track? - How do we adapt and automate the DevOps cycle - plan, code, build, test, release, deploy, operate, and monitor for data? Those are challenging questions, and the data engineering space does not have a good answer yet. We will demonstrate how a new open source project Versatile Data Kit (https://github.com/vmware/versatile-data-kit), answers those questions and helps introduce DevOps practices in data engineering. At VMware, we have tackled such problems and devised a solution that we think would benefit the whole community.

Similar to Bro, manage test data like a pro! [QA Fest 2018] (20)

Bro, manage test data like a pro!

Building a Testable Data Access Layer

Service Virtualization: What Testers Need to Know

The Importance of Data for DevOps: How TCF Bank Meets Test Data Challenges

Automated Testing with Databases

Machine Data 101

Database CI/CD Pipeline

Spirent: Datum User Experience Analytics System

APT iTest and Velocity 7.3 Use Cases.pptx

Critical Preflight Checks for Your EPM Applications

Modernizing Testing as Apps Re-Architect

Kevin Slade - CV

QAing INFRASTRUCTURE- A QA's role in the DevOps World-Aroj P George & Harshad...

Spark Infrastructure Made Easy

Wamika Singh, Suman Kumari - Let's decipher the DevOps macedonia - Codemotion...

AzureSQL Managed Instance (SQLKonferenz 2018)

Testing for Logic App Solutions | Integration Monday

Don't Fumble the Data! Integrate Database Automation into your DevOps Toolchain

ETL Testing Services - Safeguard Your Data

DataOps as a Service

More from Mikalai Alimenkou

Rise and fall of Story Points. Capacity based planning from the trenches.

Mikalai Alimenkou

Люди в мире Agile используют Story Points - для Agile коучей и тренеров это самый простой способ объяснить, как следует проводить оценку и планирование в «новом мире». Но тогда эта простая концепция нарушает реальные практические кейсы. В настоящее время команды состоят из очень специализированных людей, работающих над бэкендом, фронтэндом, тестировании, инфраструктуре и прочим. Для них почти невозможно иметь общий уровень сложности. Это только одна из проблем, которые мы собираемся осветить в этом докладе. Чтобы оставаться конструктивным, а не просто старомодным парнем из XP, Николай поделится своим опытом с более точной и прагматичной техникой оценки/планирования - планированием на основе возможностей.

Static analysis tools as the best friend of QA

Mikalai Alimenkou

We have spent many years testing our applications and systems manually and with test automation tools. During this time many bug root causes have been classified and could be detected automatically with special static analysis tools. Most of them could be applied at the early stages of development even before code is integrated into the main development branch. In this talk, I will go through available solutions and demonstrate what kinds of issues may be detected automatically reducing the time and effort of traditional testing.

Saga about distributed business transactions in microservices world

Mikalai Alimenkou

Most of people nowadays think microservices architecture is a great way to build any system. They visit conference talks, read books and review tutorials, where ‘hello world’ applications are built just in several minutes using microservices approach. But the reality is not so wonderful and one of the biggest pain is hidden inside distributed business transactions. In monolith application this topic is almost completely covered with DB level transactions. In distributed world you have to face many issues trying to implement reliable and consistent business logic. In this talk we will review different types of problems related to distributed business transactions, popular SAGA pattern, frameworks and techniques to simplify your life without compromising quality of the system.

Wastful waste or why everything is so slow in development

Mikalai Alimenkou

I think almost everybody experienced cases when things are moving very slowly in IT companies or teams. You have many people, talented engineers, Agile process and development speed is still below expectations. We try to focus on performance and efficiency last 10 years, improving our practices and tools. But we are still there in terms of speed when they are applied to real life cases. How is it possible? In this talk we will review the concept of waste circles and understand what are the main sources of time waste in development process. This concept would help you to check your processess, focus on right things and achieve much better results in your organization or team.

Hexagonal architecture with Spring Boot

Mikalai Alimenkou

Nowadays traditional layered monolithic architecture in Java world is not so popular as 5-10 years ago. I remember how we wrote tons of code for each layer repeating almost the same parts for every application. Add unit and integration testing to understand how much time and efforts has been spent on repeatable work. All cool ideas around DDD (domain driven design) and Hexagonal Architecture was just a nice theory because reality hasn’t allow us to implement it easily. Even Dependency Injection with Spring framework was completely focused on traditional layered approach, not even talking about JavaEE platform. Today we have Spring Boot ecosystem covering most of our needs for integration with almost all possible technologies and microservices architectural trend, enabling completely new approach to build Java applications around domain model. It is so natural to build Java domain-oriented services and connect them with external world using ports and adapters, that Hexagonal Architecture is almost enabled by default. You just need to switch your way of thinking…

Wastful waste or why everything is so slow in development

Mikalai Alimenkou

DevOps checklist or how to understand where is your team in DevOps landscape ...

Mikalai Alimenkou

DevOps become a buzzword in a last few years. Several companies, development and product teams have achieved quite impressive results in this area making cultural changes, transforming their processes and practices, introducing new roles, tools and techniques. Do you think is achievable for you team or it’s still a bunch of drama? There is no common approach for measuring achievements and understanding how much DevOps’ich the current team/company is. In this talk I will provide attendees with basic checklist to start with and some reliable tools/techniques to monitor progress of “DevOps transformation”.

DevOps checklist or how to understand where is your team in DevOps landscape

Mikalai Alimenkou

DevOps is a hot topic during last several years. Some companies, teams and products have achieved quite impressive results in this area making cultural changes, transforming their processes and practices, introducing new roles, tools and techniques. At the same time there is no common approach for measuring achievements and understanding “how DevOps” the current team/company is. In this talk I will provide attendees with basic checklist to start with and some reliable tools/techniques to monitor progress of “DevOps transformation”.

Практические трудности в разработке Медкарты для целой страны

Mikalai Alimenkou

Почти год мы в Whirl Software разрабатываем систему Медкарта в масштабе целой страны. За это время мы столкнулись с множеством интересных сложностей и проблем, часть из которых успешно победили, а для некоторых хорошего решения до сих пор не найдено. В этом докладе мы поделимся накопленным практическим опытом и некоторыми техническими решениями, которые могут быть полезны в рамках разработки электронных медицинских систем.

Hexagonal architecture with Spring Boot [EPAM Java online conference]

Mikalai Alimenkou

Agile antipatterns: review after 10 years of practice

Mikalai Alimenkou

Вот уже более 10 лет Agile движение шагает по Украине и стучится практически в каждую компанию. Но приносят ли новые процессы, принципы и практики реальную практическую пользу? Получается ли изменить к лучшему команды, проекты, компании? Я в роли консультанта за эти 10 лет поработал с более чем 100 компаниями, поэтому повидал много хорошего и плохого. В данном докладе хочется пробежаться по основным проблемам, сложностям и анти-паттернам в переходе отечественных компаний на "Agile рельсы". Мы рассмотрим какие практики не очень хорошо приживаются, от чего страдает большинство команд, какие основные препятствия встречают на своем пути и как умудряются их обходить. Я надеюсь, доклад поможет зародиться множеству интересных дискуссий.

Hexagonal architecture with Spring Boot

Mikalai Alimenkou

Бытовая классификация тестировщиков с точки зрения разработчика

Mikalai Alimenkou

Тестировщики часто говорят о противостоянии и конфликтах с разработчиками. Но ведь есть команды, где все живут в мире и согласии. Видимо что-то тут не так? Я хочу поговорить о том, как тестировщиков видят сами разработчики. В докладе будет проведена забавная классификация. Кроме известного всем тестировщика-обезьянки будут представлены тестировщик-муха, тестировщик-нацист, тестировщик-панда и многие другие герои. Высможете лишний раз задуматься над тем, как вас видят со стороны и, возможно, изменить ситуацию к лучшему. Доклад будет также полезен менеджерам проектов и лидерам команд. Вы сможете быстрее распознавать те или иные шаблоны поведения тестировщикови принимать меры по повышению уровня командной работы. Приходите, будет интересно!

Code Review tool for personal effectiveness and waste analysis

Mikalai Alimenkou

Usually it is hard to analyze personal effectiveness and detect wastes in development process because developer’s work decomposition is not transparent and available for analysis. As a good sample of ineffective process imagine developer, who spends 1 day on task implementation and then reimplements it several times according to code review notes during next 2 days. Or another developer, who is waiting for code review during 2 days, switching context to other tasks, finally gets notes and switches back to initial task, trying to refresh all details in his head. And so on and so forth… Code review tool usage helps to aggregate lots of useful information about any code change at any stage (static analysis, code review, rework, acceptance, integration into main branch). In this talk I’m going to demontrate how this information could be used for detailed analysis of development effectiveness and wastes detection. Based on mentioned analysis you could implement many improvements for your development process and then measure their success.

Funny stories and anti-patterns from DevOps landscape

Mikalai Alimenkou

During last several years DevOps became strong buzzword used almost in every project, team and company. But almost everywhere it is used in very funny and strange context. For example, existing ops guys are renamed to DevOps just to sell them to the client for more money. Or DevOps is used as new job title for some magically powerful person who is able to operate cloud environment and modern infrastructure related tools, leading team of old school ops and participating in management meetings. In this talk I’m going to review all different anti-patterns and bad practices in DevOps landscape using stories from my personal experience as Delivery Manager and independent consultant.

Developer + tester = quality++

Mikalai Alimenkou

With Agile adoption many things have changed in quality assurance and tester role. Ourdays the whole team is responsible for product quality. But not so many people understand how such high level approaches work in practice, how developer interacts with tester, what stages each task passes on the way from requirements specification to customer acceptance, who is doing what at each stage. I have met only few teams, where developer and tester work closely together on a daily basis. Some projects try to same money on developer's time, others try to have independent testing team without influence from developers side. Developers also don't understad how tester could help them in practice. But this pair is able to significantly improve product quality and avoid many common issues. In this talk we will cover motivation behind pair work of develoeper and tester, concrete practices and approaches at different stages, and advantages that both sides could achieve from such work style.

Continuous improvements of developer efficiency with modern IDE

Mikalai Alimenkou

Nowadays IDE are much more intelligent than 10 years ago when they played mainly code editor functions. At the same time number of good practices and techniques is growing from day to day and most developers don’t have time to learn them with the same pace. So it could be a good idea to use IDE as continuous learning tool. In this talk we will cover following areas of developer efficiency: automated refactorings, live templates, useful suggestions, code standards, code navigation, code generation… I hope after this talk your daily job will become much more effective.

Design patterns in test automation

Mikalai Alimenkou

Design patters exist for years in software development. Some developers love them, some think they are useless. But design patters has very clear goals: describe common solutions for common problems, create shared language for community, improve understanding and reuse of existing approaches. Test automation has its own set of problems, so there is a set of helpful design patterns for this area. In this talk I will run through all known patterns and describe them in details with several practical samples.

5 top pain points of test automation

Mikalai Alimenkou

Working in many companies as consultant, delivery manager or tech lead I have always seen the same mistakes made in test automation process. I could count successful cases on fingers of one hand. Sometimes people don’t understand the true value of test automation, sometimes just could not organize this process spending lots of money and time without any significant result. I want to share 5 top mistakes aggregated from whole my practice and solutions I recommend for them.

Gamification in outsourcing company: experience report.

Mikalai Alimenkou

Most of us used to hear word gamification only for end user engagement into product usage. Some of us know about usage of similar approaches in product development teams to improve and tune development process. But almost nobody believes that gamification is possible in the context of outsourcing companies and teams. This talk is experience report of gamification usage on very large project with detailed reusable framework demonstration. If you want to bring some fun and really engage your team, then this talk is for you.

More from Mikalai Alimenkou (20)

Rise and fall of Story Points. Capacity based planning from the trenches.

Static analysis tools as the best friend of QA

Saga about distributed business transactions in microservices world

Wastful waste or why everything is so slow in development

Hexagonal architecture with Spring Boot

Wastful waste or why everything is so slow in development

DevOps checklist or how to understand where is your team in DevOps landscape ...

DevOps checklist or how to understand where is your team in DevOps landscape

Практические трудности в разработке Медкарты для целой страны

Hexagonal architecture with Spring Boot [EPAM Java online conference]

Agile antipatterns: review after 10 years of practice

Hexagonal architecture with Spring Boot

Бытовая классификация тестировщиков с точки зрения разработчика

Code Review tool for personal effectiveness and waste analysis

Funny stories and anti-patterns from DevOps landscape

Developer + tester = quality++

Continuous improvements of developer efficiency with modern IDE

Design patterns in test automation

5 top pain points of test automation

Gamification in outsourcing company: experience report.

Recently uploaded

FIDO Alliance Osaka Seminar: Overview.pdf

FIDO Alliance

The Future of Platform Engineering

Jemma Hussein Allen

Connector Corner: Automate dynamic content and events by pushing a button

DianaGray10

Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to: Create a campaign using Mailchimp with merge tags/fields Send an interactive Slack channel message (using buttons) Have the message received by managers and peers along with a test email for review But there’s more: In a second workflow supporting the same use case, you’ll see: Your campaign sent to target colleagues for approval If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team But—if the “Reject” button is pushed, colleagues will be alerted via Slack message Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors. And... Speakers: Akshay Agnihotri, Product Manager Charlie Greenberg, Host

UiPath Test Automation using UiPath Test Suite series, part 3

DianaGray10

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Product School

Epistemic Interaction - tuning interfaces to provide information for AI support

Alan Dix

Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024 https://alandix.com/academic/papers/synergy2024-epistemic/ As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...

Product School

GraphRAG is All You need? LLM & Knowledge Graph

Guy Korland

Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs. 1. Unifying Large Language Models and Knowledge Graphs: A Roadmap. https://arxiv.org/abs/2306.08302 2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs: https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/

The Art of the Pitch: WordPress Relationships and Sales

Laura Byrne

Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes? All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.

Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...

Ramesh Iyer

In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.

UiPath Test Automation using UiPath Test Suite series, part 4

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap. The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies. Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques What will you get from this session? 1. Insights into SAP testing best practices 2. Heatmap utilization for testing 3. Optimization of testing processes 4. Demo Topics covered: Execution from the test manager Orchestrator execution result Defect reporting SAP heatmap example with demo Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

DevOps and Testing slides at DASA Connect

Kari Kakkonen

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

91mobiles

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

James Anderson

Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management. The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM). Speakers: Bob Boule Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle. Gopinath Rebala Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

Product School

Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...

Thierry Lestable

Leading Change strategies and insights for effective change management pdf 1.pdf

OnBoard

Knowledge engineering: from people to machines and back

Elena Simperl

When stars align: studies in data quality, knowledge graphs, and machine lear...

Elena Simperl

Assuring Contact Center Experiences for Your Customers With ThousandEyes

ThousandEyes

Recently uploaded (20)

FIDO Alliance Osaka Seminar: Overview.pdf

The Future of Platform Engineering

Connector Corner: Automate dynamic content and events by pushing a button

UiPath Test Automation using UiPath Test Suite series, part 3

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Epistemic Interaction - tuning interfaces to provide information for AI support

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...

GraphRAG is All You need? LLM & Knowledge Graph

The Art of the Pitch: WordPress Relationships and Sales

Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...

UiPath Test Automation using UiPath Test Suite series, part 4

DevOps and Testing slides at DASA Connect

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...

Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...

Leading Change strategies and insights for effective change management pdf 1.pdf

Knowledge engineering: from people to machines and back

When stars align: studies in data quality, knowledge graphs, and machine lear...

Assuring Contact Center Experiences for Your Customers With ThousandEyes

Bro, manage test data like a pro! [QA Fest 2018]

1. Bro, manage your test data like a pro! Mikalai Alimenkou @xpinjection http://xpinjection.com

3. Telegram channel https://t.me/xpinjection_channel

4. Test Data Application Driver Test Logic Test components

5. Try to avoid dependent tests to improve stability and speed

6. Data independency as performance driver • Most dependencies are data related • Dependent tests = no parallel execution • Data should be test specific with no reuse • Use small focused datasets

7. Regular system example SYSTEM DB QUEUE UI API EXTERNAL SERVICES API CONTRACTS

8. If you have user interface, then you can use it for testing

9. #1. Prepare test data using UI SYSTEM DB QUEUE UI API EXTERNAL SERVICES API CONTRACTS #1. UI

10. Data Registry

11. Easiest approach to start with Blackbox solution Clear and simple Unstable Too long Failures chaining

12. If UI is unreliable, you can switch to API level

13. #2. Data insertion via API SYSTEM DB QUEUE UI API EXTERNAL SERVICES API CONTRACTS #2. API

14. Reuse existing API for tests Data oriented Much quicker Require clear API Greybox Coding skills Existing tools

15. If you have data, put it in the database

16. #3. SQL for direct data insertion to DB SYSTEM DB QUEUE UI API EXTERNAL SERVICES API CONTRACTS #3. SQL

17. Unit/integration tests

18. Use internal system knowledge Flexibility Quickest way Whitebox Support and sync Too verbose Direct data access Caching

19. #4. Datasets with optional commit SYSTEM DB QUEUE UI API EXTERNAL SERVICES API CONTRACTS #4. DBUnit

20. Unit/integration tests

21. API/System level tests

22. The same approach for NoSQL

23. Managed or embedded NoSQL storage

24. Additional level of data abstraction Great tools around DBUnit Suitable format Whitebox Support and sync Small datasets Caching Flexible constraints

25. #5. Versioned DUMPs SYSTEM DB QUEUE UI API EXTERNAL SERVICES API CONTRACTS #5. DUMPs

26. Support DUMPs for different suites /serviceA/dump/smoke/v50/data.tar.gz /serviceA/dump/smoke/v51/data.tar.gz /serviceA/schema/v51/db.jar /serviceA/dump/regression/v50/data.tar.gz /serviceA/dump/regression/v51/data.tar.gz

27. Wrap DUMPs in Docker images

28. DB Object Pools • DB instance • Heavy domain objects • Available data roots

29. Version your test data with schema Direct data access Quick Unclear Required skills DUMP preparation via UI Infrastructure support Artifact repository

30. If your live system produces data, it can be used for testing

31. #6. Production data DUMP SYSTEM DB QUEUE UI API EXTERNAL SERVICES API CONTRACTS #6. LIVE DATA

32. Real data is always better for testing Live data No preparation Large Permissions More realistic cases Security

33. Summary • Use UI for test data if the system is black box for you • Speed up you test data management with API calls • Put data directly in DB if system is white box for you • Actively use Docker to prepare test DB images • Reuse live data if possible for complex systems • Mix approaches to fill test DB and store dumps to build Docker images • Be happy unicorn in the rainbow world ;)

34.

35. It is not an easy task to create reliable tests, try hard and know your tools

36. @xpinjection http://xpinjection.com mikalai.alimenkou@xpinjection.com

Editor's Notes

Департаменты развивают принципы локализации ответственности, что очень вредно.
Департаменты развивают принципы локализации ответственности, что очень вредно.
Департаменты развивают принципы локализации ответственности, что очень вредно.
Департаменты развивают принципы локализации ответственности, что очень вредно.
Департаменты развивают принципы локализации ответственности, что очень вредно.
Департаменты развивают принципы локализации ответственности, что очень вредно.

Bro, manage test data like a pro! [QA Fest 2018]

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Bro, manage test data like a pro! [QA Fest 2018]

Similar to Bro, manage test data like a pro! [QA Fest 2018] (20)

More from Mikalai Alimenkou

More from Mikalai Alimenkou (20)

Recently uploaded

Recently uploaded (20)

Bro, manage test data like a pro! [QA Fest 2018]

Editor's Notes