Continuous Performance Regression Testing with JfrUnit

•

0 likes•1,181 views

Gunnar Morling is a software engineer and open-source enthusiast by heart. He is leading the Debezium project, a platform for change data capture (CDC). He is a Java Champion, the spec lead for Bean Validation 2.0 (JSR 380) and has founded multiple open source projects such as Deptective and MapStruct. Prior to joining Red Hat, Gunnar worked on a wide range of Java EE projects in the logistics and retail industries. He's based in Hamburg, Germany.

Technology

Brought to you by
Continuous Performance
Regression Testing with JfrUnit
Gunnar Morling
Principal Software Engineer at

Today’s Objective: Learn About...
■ Implementing performance regression tests with JDK Flight Recorder
and JfrUnit
■ Analyzing performance regressions in JDK Mission Control
■ Emitting JFR events from 3rd party libraries

Gunnar Morling
Principal Software Engineer at Red Hat
■ Debezium
■ Quarkus
■ JfrUnit, ModiTect, kcctl
■ Spec Lead for Bean Validation 2.0
■ Java Champion
■ @gunnarmorling

Challenges of Performance Tests
■ Tests based on throughput or latency are dependent on speciﬁcs of the
environment
● Require production-like set-up
● Impacted by unrelated concurrent load (e.g. on CI server)

JfrUnit — Assert Performance Impacting Metrics
■ Assert proxy metrics like memory allocation or IO
● Based on JDK Flight
Recorder events
● Failures may indicate a
performance regression
■ Plain unit tests
■ Analyse in JDK Mission Control

OpenJDK Flight Recorder
■ “Troubleshooting, monitoring, and proﬁling framework
embedded into the JVM”
■ 150+ built-in event types; custom ones
■ Open-source since Java 11 (backported to 8)
■ Low overhead, meant for “always-on”
■ Accessible via recording ﬁles and streaming

JFR Event Types
https://bestsolution-at.github.io/jfr-doc/

OpenJDK Mission Control
■ Control, visualize, and
analyze JFR recordings
■ And more:
● JMX console
● heap dump analyzer
● etc.

JfrUnit — Discussion and Limitations
■ Robust tests with very fast feedback cycle
● Independent from environment
● Proactive identiﬁcation of issues
■ Metrics need solid understanding; e.g. increased allocation may or may not
be a problem
■ Cannot identify all issues, e.g. locks showing up only under load
■ Won’t help with issues elsewhere, e.g. a bad query execution plan

Take Aways
■ JfrUnit: a tool in the performance testing box
● Complement - no replacement - for other tests
■ JMC Agent: produce events from code not under your control
■ Move beyond Java 1.8 🚀

Outlook — Keeping Track of Historic Values
https://horreum.hyperfoil.io/

Resources
■ JfrUnit
https://github.com/moditect/jfrunit
■ Introduction to JfrUnit
https://www.morling.dev/blog/towards-continuous-performance-regression-t
esting/
■ Introduction to JMC Agent
https://developers.redhat.com/blog/2020/10/29/collect-jdk-ﬂight-recorder-ev
ents-at-runtime-with-jmc-agent/
■ Proﬁling Java inside containers with ContainerJFR
https://developers.redhat.com/devnation/tech-talks/containerjfr

Brought to you by
Gunnar Morling
gunnar@hibernate.org
@gunnarmorling

What's hot

Apache Kafka is a highly popular distributed system used by many organizations to connect systems, build microservices, create data mesh, etc. However, as a distributed system, understanding its performance could be a challenge, so many moving parts exist. In this talk, we are going to review the key moving parts (producers, consumers, replication, network, etc), a strategy to measure and interpret the performance results for consumers and producers and a general guideline for deciding about performance in Apache Kafka. An attendee will take home after the talk a proven method to measure, evaluate and optimise the performance of an Apache Kafka based infrastructure. A key skill for low throughput users, but especially for the biggest scale deployments.

Understanding Apache Kafka P99 Latency at Scale

ScyllaDB

Three engineers, at various points, each take their own approach adding Rust to a C codebase, each being more and more ambitious. I initially just wanted to replace the server’s networking and event loop with an equally fast Rust implementation. We’d reuse many core components that were in C and just call into them from Rust. Surely it wouldn’t be that much code… Pelikan is Twitter’s open source and modular framework for in-memory caching, allowing us to replace Memcached and Redis forks with a single codebase and achieve better performance. At Twitter, we operate hundreds of cache clusters storing hundreds of terabytes of small objects in memory. In-memory caching is critical, and demands performance, reliability, and efficiency. In this talk, I’ll share my adventures in working on Pelikan and how rewriting it in Rust can be more than just a meme.

Whoops! I Rewrote It in Rust

ScyllaDB

In the networking world there are a number of ways to increase performance over naive use of basic Berkeley sockets. These techniques have ranged from polling blocking sockets, non-blocking sockets controlled by Epoll, all the way through completely bypassing the Linux kernel for maximum network performance where you talk directly to the network interface card by using something like DPDK or Netmap. All these tools have their place, and generally occupy a space from convenience to performance. But in recent years, that landscape has changed massively.. The tools available to the average Linux systems developer have improved from the creation of io_uring, to the expansion of bpf from a simple filtering language to a full-on programming environment embedded directly in the kernel. Along with that came something called XDP (express datapath). This was Linux kernel's answer to kernel-bypass networking. AF_XDP is the new socket type created by this feature, and generally works very similarly to something like DPDK. History lessons out of the way, this talk will look into, and discuss the merits of this technology, it's place in the broader ecosystem and how it can be used to attain the highest level of performance possible. This talk will dive into crucial details, such as how AF_XDP works, how it can be integrated into a larger system and finally more advanced topics such as request sharding/load balancing. There will be detailed look at the design of AF_XDP, the eBpf code used, as well as the userspace code required to drive it all. It will also include performance numbers from this setup compared to regular kernel networking. And most importantly how to put all this together to handle as much data as possible on a single modern multi-core system.

High-Performance Networking Using eBPF, XDP, and io_uring

ScyllaDB

Rust, Wright's Law, and the Future of Low-Latency Systems

ScyllaDB

P99 CONF Unikernels are famous for providing excellent performance in terms of boot times, throughput and memory consumption, to name a few metrics. However, they are infamous for making it hard and extremely time consuming to extract such performance, and for needing significant engineering effort in order to port applications to them. We introduce Unikraft, a novel micro-library OS that (1) fully modularizes OS primitives so that it is easy to customize the unikernel and include only relevant components and (2) exposes a set of composable, performance-oriented APIs in order to make it easy for developers to obtain high performance. Our evaluation using off-the-shelf applications such as nginx, SQLite, and Redis shows that running them on Unikraft results in a 1.7x-2.7x performance improvement compared to Linux guests. In addition, Unikraft images for these apps are around 1MB, require less than 10MB of RAM to run, and boot in around 1ms on top of the VMM time (total boot time 3ms-40ms). Unikraft is a Linux Foundation open source project and can be found at www.unikraft.org.

Unikraft: Fast, Specialized Unikernels the Easy Way

ScyllaDB

What is special about community-industry collaboration around an open architecture like RISC-V is that the community can join development around key kernel subsystems in parallel with the semiconductor companies and manufacturers as they are producing the new chipsets and boards. Open silicon design, open board design, and open kernel software speeds bring-up of new boards and fosters greater innovation due to the diversity of talent contributing to the technology. For many kernel developers, tackling RISC-V is becoming harder to resist now that commercially viable and scalable hardware has begun to enter the market. A private beta program launched by the BeagleBoard Foundation in March 2021 placed an affordable, yet powerful prototype RISC-V board into the hands of Roman Shaposhnik. What did Roman do? He joined a diverse team of software and hardware hackers to tackle bringing up Linux on the new board. In this talk, Roman will tell you about his experience porting Alpine Linux and LF Edge EVE-OS to the new RISC-V architecture.

RISC-V on Edge: Porting EVE and Alpine Linux to RISC-V

ScyllaDB

Unikernels have been demonstrated to deliver excellent performance in terms of throughput and latency, while providing high isolation. However they have also been shown to underperform in some types of workloads when compared to a generic OS like Linux. In this presentation, we demonstrate that certain types of workloads - web servers, microservices, and other stateless and/or serverless apps - can greatly benefit from OSv optimized networking stack and other features. We describe number of experiments where OSv outperforms Linux guest: most notably we note 1.6 throughput (req/s) and 0.6 latency improvement (at p99 percentile) when running nginx and 1.7 throughput (req/s) and 0.6 latency improvement (at p99 percentile) when running simple microservice implemented in Golang. We also show that OSv' small kernel, low boot time and memory consumption allow for very high density when running server-less workloads. The experiment described in this presentation shows we can boot 1,800 OSv microVMs per second on AWS c5n.metal machine with 72 CPUs (25 boots/sec on single CPU) with guest boot time recorded as low as 8.98ms at p50 and 31.49ms at p99 percentile respectively. Lastly we also demonstrate how to automate the build process of the OSv kernel tailored exactly to the specific app and/or VMM so that only the code and symbols needed are part of the kernel and nothing more. OSv is an open source project and can be found at https://github.com/cloudius-systems/osv.

OSv Unikernel — Optimizing Guest OS to Run Stateless and Serverless Apps in t...

ScyllaDB

Spying on the Linux kernel for fun and profit

Andrea Righi

Realtime

Mark Veltzer

Watch this Tech Talk: https://do.co/video_pdougherty With DigitalOcean App Platform, you get out-of-the-box support for several programming languages and application frameworks. For those languages and frameworks that DigitalOcean doesn’t currently support, learn how you can utilize the Dockerfile mechanism and still benefit from a fully managed PaaS experience. About the Presenter Phil Dougherty is a Senior Product Manager at DigitalOcean focused on Kubernetes, container registry, and PaaS. With over 15 years of professional experience in data centers, networking, security, and automation, he has seen the evolution of scale out hosting platforms go from homegrown shell scripts on dedicated servers to multi-cloud micro service based architectures running on Kubernetes. In his free time he likes to ride motorcycles both on and off road, travel, and spend time in the great outdoors. New to DigitalOcean? Get US $100 in credit when you sign up: https://do.co/deploytoday To learn more about DigitalOcean: https://www.digitalocean.com/ Follow us on Twitter: https://twitter.com/digitalocean Like us on Facebook: https://www.facebook.com/DigitalOcean Follow us on Instagram: https://www.instagram.com/thedigitalocean/ We're hiring: http://do.co/careers

Escape the Walls of PaaS: Unlock the Power & Flexibility of DigitalOcean App ...

DigitalOcean

Rust has something unique to offer that languages in that space have never had before, and that is a degree of safety that languages like C and C++ have never had. Rust promises to deliver equivalent or better performance and greater productivity with guaranteed memory safety and data race freedom while allowing complete and direct control over memory. This video will cover: What is Rust? Benefits of Rust Rust Ecosystem Popular Applications in Rust

Rust Primer

Knoldus Inc.

Watch this Tech Talk: https://do.co/video_snormore An engineering-led talk that covers the challenges DigitalOcean encountered with a Droplet-based architecture and why we pivoted to using Kubernetes. Steven Normore, Engineering Manager at DigitalOcean, shares the benefits that a Kubernetes-based architecture provides to customers, and shares guidance on what to keep in mind as you build your business on DigitalOcean. About the Presenter Steven Normore is an Engineering Manager at DigitalOcean. He builds and operates systems for production web applications. He has an education in computer science and mathematics with a focus on combinatorics and distributed systems. New to DigitalOcean? Get US $100 in credit when you sign up: https://do.co/deploytoday To learn more about DigitalOcean: https://www.digitalocean.com/ Follow us on Twitter: https://twitter.com/digitalocean Like us on Facebook: https://www.facebook.com/DigitalOcean Follow us on Instagram: https://www.instagram.com/thedigitalocean/ We're hiring: http://do.co/careers

Combining Cloud Native & PaaS: Building a Fully Managed Application Platform ...

DigitalOcean

This talk describes how to use some available technologies (the SCHED_DEADLINE scheduling policy, the PREEMPT_RT patchset, etc…) to execute real-time applications in kvm-based virtual machines while still providing performance guarantees to the virtualized applications. In recent years, there has been a growing interest in supporting virtualized services even in embedded and real-time systems. However, executing real-time applications (characterized by temporal constraints) in virtual machines is not straightforward and presents some non-trivial challenges. This talk will describe how to use some technologies already available in the Linux kernel (the SCHED_DEADLINE scheduling policy, the PREEMPT_RT patchset, etc…) to execute real-time applications in kvm-based virtual machines while still providing performance guarantees to the virtualized applications. After presenting the problem (and providing a quick summary about real-time scheduling), it will be shown how to configure the host and guest kernels and the virtual machine, and how to schedule the VM threads in order to achieve predictable response times and to provide real-time guarantees.

Luca Abeni - Real-Time Virtual Machines with Linux and kvm

linuxlab_conf

Java performance monitoring

Simon Ritter

Introduction to GraalVM

SHASHI KUMAR

An Introduction to the Formalised Memory Model for Linux Kernel

SeongJae Park

gcma: guaranteed contiguous memory allocator

SeongJae Park

Kernel Recipes 2016 - Speeding up development by setting up a kernel build farm

Anne Nicolas

[POSS 2019] OVirt and Ceph: Perfect Combination.?

Worteks

P99 CONF We all know that distributed transactions are expensive, have higher latency and lower throughput compared to a non-transactional workload. It's just common sense that when we ask a system to maintain transactional guarantees it should spend more time on coordination and thus have poorer performance, right? Well, it's true that we can't get rid of this overhead. But at the same time each transaction defines a unit of work, so the system stops dealing with individual requests and becomes more aware about the whole workload. Basically it gets more information and may use it for new kinds of optimizations which compensate for the overhead. In this talk I'll describe how Redpanda optimized the Kafka API and pushed throughput of distributed transactions up to eight times beyond an equivalent non-transactional workload while preserving sane latency.

Is It Faster to Go with Redpanda Transactions than Without Them?!

ScyllaDB

What's hot (20)

Understanding Apache Kafka P99 Latency at Scale

Whoops! I Rewrote It in Rust

High-Performance Networking Using eBPF, XDP, and io_uring

Rust, Wright's Law, and the Future of Low-Latency Systems

Unikraft: Fast, Specialized Unikernels the Easy Way

RISC-V on Edge: Porting EVE and Alpine Linux to RISC-V

OSv Unikernel — Optimizing Guest OS to Run Stateless and Serverless Apps in t...

Spying on the Linux kernel for fun and profit

Realtime

Escape the Walls of PaaS: Unlock the Power & Flexibility of DigitalOcean App ...

Rust Primer

Combining Cloud Native & PaaS: Building a Fully Managed Application Platform ...

Luca Abeni - Real-Time Virtual Machines with Linux and kvm

Java performance monitoring

Introduction to GraalVM

An Introduction to the Formalised Memory Model for Linux Kernel

gcma: guaranteed contiguous memory allocator

Kernel Recipes 2016 - Speeding up development by setting up a kernel build farm

[POSS 2019] OVirt and Ceph: Perfect Combination.?

Is It Faster to Go with Redpanda Transactions than Without Them?!

Similar to Continuous Performance Regression Testing with JfrUnit

Using Java Mission Control & Java Flight Recorder

Isuru Perera

Performance testing with jmeter

Knoldus Inc.

Apache jMeter

NexThoughts Technologies

JDK Flight Recorder (JFR) is a mechanism for collecting diagnostic and profiling data from the JVM. A lot of information can be obtained, with low overhead, about CPU, memory, GC, I/O, method calls, thread dumps, events, and more. And now, as JFR is integrated into OpenJDK, JFR is not only free but also supports convenient new APIs. For example, you can add and record your own metrics and analyze the JFR log files directly, using Java code. These features extend the use case of JFR. This session explains how to program custom events and visualize them for monitoring with, for example, Kibana or Grafana. JFR provides you with a next-generation standard JVM monitoring solution.

Performance Monitoring with Java Flight Recorder on OpenJDK [DEV2406]

Hiroaki NAKADA

Automation for developers

Dharshana Kasun Warusavitharana

Bots on guard of sdlc

Alexey Tokar

Gatling - Bordeaux JUG

slandelle

How to jSparrow Jenkins?

jSparrow

See what pitfalls companies are facing when running Liferay portal. In the previous year, our company has audited 5 real-life projects based on Liferay Portal which are now running in production mode and serving many users. The audits were focused on architecture, infrastructure, technical design and implementation. During the presentation, we will show you common anti-patterns we have found during the audits and their impacts and consequences on the portal.

Liferay portals in real projects

IBACZ

DevDays: Profiling With Java Flight Recorder

Miro Wengner

Everyone wants to understand what their application is really doing in production, but this information is normally invisible to developers. Profilers tell you what code your application is running but few developers profile and mostly on their development environments. Thankfully production profiling is now a practical reality that can help you solve and avoid performance problems. Profiling in development can be problematic because it’s rare that you have a realistic workload or performance test for your system. Even if you’ve got accurate perf tests maintaining these and validating that they represent production systems is hugely time consuming and hard. Not only that but often the hardware and operating system that you run in production are different from your development environment. This pragmatic talk will help you understand the ins and outs of profiling in a production system. You’ll learn about different techniques and approaches that help you understand what’s really happening with your system. This helps you to solve new performance problems, regressions and undertake capacity planning exercises.

Production profiling what, why and how technical audience (3)

RichardWarburton

Inside the JVM - Performance & Garbage Collector Tuning in JAVA

Rafael Monteiro e Pereira

Diagnosing HotSpot JVM Memory Leaks with JFR and JMC

Mushfekur Rahman

Spinning up new instances fast, and effective JIT compilation, may be game changers these days, but they are just a part of the story. What about leaks in the code taking all gained speed away? Java Flight Recorder is an event based tracing framework. It is built directly into the Java runtime and provides access to all internal data, while allowing additional custom enhancements. The goal is to present the value of JFR and how it is able to achieve low overhead (cca 1%). We explain fundamental elements and the performance. We also explore newly added features in current and upcoming releases of JDK Mission Control 8.x.

ASML_FlightRecorderMeetsJava.pdf

Miro Wengner

Understanding the XPages architecture is key to building performant scalable enterprise-ready Lotus Domino web applications. We'll show how to go under the hood to discover functional features that help your application perform and scale well. You'll learn about design patterns and techniques that ensure your applications are optimally tuned for your business requirements, and we'll show how to integrate existing business logic -- without increasing performance cost.

Ad109 - XPages Performance and Scalability

ddrschiw

Testing Django APIs

tyomo4ka

Tools in action jdk mission control and flight recorder

Jean-Philippe BEMPEL

Perofrmance testing and apache jmeter

lethibichhoa

Jmeter

Sun Technlogies

Ob1k is a new open source RPC container. it belongs to a new breed of frameworks that tries to improve on the classic J2EE model by embedding the server and reducing redundant bloatware. Ob1k supports two modes of operations: sync and async, the async mode aims for maximum performance by adopting reactive principals like using non-blocking code and functional composition using futures. Ob1k also aims to be ops/devops friendly by being self contained and easily configured.

Ob1k presentation at Java.IL

Eran Harel

Similar to Continuous Performance Regression Testing with JfrUnit (20)

Using Java Mission Control & Java Flight Recorder

Performance testing with jmeter

Apache jMeter

Performance Monitoring with Java Flight Recorder on OpenJDK [DEV2406]

Automation for developers

Bots on guard of sdlc

Gatling - Bordeaux JUG

How to jSparrow Jenkins?

Liferay portals in real projects

DevDays: Profiling With Java Flight Recorder

Production profiling what, why and how technical audience (3)

Inside the JVM - Performance & Garbage Collector Tuning in JAVA

Diagnosing HotSpot JVM Memory Leaks with JFR and JMC

ASML_FlightRecorderMeetsJava.pdf

Ad109 - XPages Performance and Scalability

Testing Django APIs

Tools in action jdk mission control and flight recorder

Perofrmance testing and apache jmeter

Jmeter

Ob1k presentation at Java.IL

More from ScyllaDB

See where an RDBMS-pro’s intuition leads him astray – and learn practical tips for the data modeling transition ScyllaDB has the potential to deliver impressive performance and scalability. The better you understand how it works, the more you can squeeze out of it. However, developers new to high-performance NoSQL intuitively shoot themselves in the foot with respect to things like table design, query design, indexing, and partitioning. Watch where our experienced Postgres developer intuitively falls into traps that hurt performance and scalability. And learn with him as our database performance expert offers friendly guidance on navigating all the unexpected behaviors that tend to trip up RDBMS experts. This webinar focuses on common data modeling and querying mistakes that occur when developers move from SQL to NoSQL. For example: - Understanding query first design principles - Planning for schema evolution - Steering clear of common pitfalls and anti-patterns - Assessing data access patterns This isn’t “Death-by-Powerpoint.” We’ll walk through problems encountered while migrating a real application from Postgres to ScyllaDB – and try to fix them live as well.

Developer Data Modeling Mistakes: From Postgres to NoSQL

ScyllaDB

See where an RDBMS-pro’s intuition leads him astray – and learn practical tips for the transition ScyllaDB has the potential to deliver impressive performance and scalability. The better you understand how it works, the more you can squeeze out of it. However, developers new to high-performance NoSQL intuitively shoot themselves in the foot with respect to things like table design, query design, indexing, and partitioning. Watch where our experienced Postgres developer intuitively falls into traps that hurt performance and scalability. And learn with him as our database performance expert offers friendly guidance on navigating all the unexpected behaviors that tend to trip up RDBMS experts. Our first webinar of this series will cover common mistakes with practices such as: - Translating the data model to NoSQL - Optimizing table design - Optimizing query performance - Planning for partitioning This isn’t “Death-by-Powerpoint.” We’ll walk through problems encountered while migrating a real application from Postgres to ScyllaDB – and try to fix them live as well.

What Developers Need to Unlearn for High Performance NoSQL

ScyllaDB

Expert tips on how to maximize your database performance at scale Untangle the complexity of achieving database performance at scale. Join this webinar to discover commonly overlooked ways to get predictable low latency, even at extreme scale. Our Solution Architects will walk you through the strategies and pitfalls learned by working on thousands of real-world distributed database projects, many reaching 1M OPS with single-digit MS latencies. In addition to offering clear recommendations, we’ll also explain the process behind how we arrived at them – so you can benefit from the lessons learned by other teams. We’ll cover how to: - Design and deploy a large-scale distributed database cluster - Optimize your clients’ interactions with it - Expand the cluster horizontally and globally - Ensure it survives whatever disasters the world throws at it

Low Latency at Extreme Scale: Proven Practices & Pitfalls

ScyllaDB

Tackling your own database performance challenges is serious business. For a change of pace, let’s have some fun learning from other teams’ performance predicaments. Join us for an interactive session where we dissect four specific database performance challenges faced by teams considering or using ScyllaDB. For each dilemma, we'll: - Examine the context and technical requirements - Talk about potential solutions and cover the pros and cons of each - Disclose what approach the team took, and how it worked out About the speaker: Felipe is an IT specialist with years of experience on distributed systems and open-source technologies. He is one of the co-authors of "Database Performance at Scale", an Open Access, freely available publication for individuals interested on improving database performance. At ScyllaDB, he works as a Solution Architect.

Dissecting Real-World Database Performance Dilemmas

ScyllaDB

Linear scaling (sometimes near linear scaling) is often mentioned in several benchmarks, articles and product comparisons as proof that a given technology and algorithmic optimizations perform better than another. But is that really what performance is all about, and should you even care? This webinar discusses performance beyond linear scalability, including what typically matters more when running high throughput and low latency workloads at scale. We'll cover how ScyllaDB offers unparalleled performance and share our insights on: - The hidden aspects of linear scaling - When linear scaling matters most and when it’s simply irrelevant - Often overlooked considerations for optimizing and measuring distributed systems performance Watch now to learn from our experience (and lessons learned) in building the fastest NoSQL database in the world.

Beyond Linear Scaling: A New Path for Performance with ScyllaDB

ScyllaDB

Navigating Complex Database Performance Hurdles Tackling your own database performance challenges is serious business. For a change of pace, let’s have some fun learning from other teams’ performance predicaments. Join us for an interactive session where we dissect 4 specific database performance challenges faced by teams considering or using ScyllaDB. For each dilemma: - The presenters will describe the context and technical requirements - Together, we’ll talk about potential solutions and cover the pros and cons of each - Finally, we’ll disclose what approach the team took, and how it worked out Throughout the event, we’ll have opportunities to win ScyllaDB swag and prizes! Come prepared to engage in lively discussions and gain valuable insight into database performance strategies.

Dissecting Real-World Database Performance Dilemmas

ScyllaDB

Database Performance at Scale Masterclass: Workload Characteristics by Felipe...

ScyllaDB

Database Performance at Scale Masterclass: Database Internals by Pavel Emelya...

ScyllaDB

Database Performance at Scale Masterclass: Driver Strategies by Piotr Sarna

ScyllaDB

Technical risks of putting a cache in front of your database– and what to do instead Teams experiencing subpar latency commonly turn to an external cache to meet the required SLAs. Placing a cache in front of your database might seem like a fast and easy fix, but it often ends up introducing unanticipated complexity, costs, and risks. External caches can be one of the more problematic components of distributed application architecture. Join this webinar for a technical discussion of the risks associated with using an external cache and a look at how ScyllaDB’s cache implementation simplifies your architecture without compromising latency. We’ll cover: - Different approaches to caching (pre-caching vs. caching, side cache vs. transparent cache) - 7 specific reasons why external caching ia a bad choice - Why Linux’s default caching doesn’t work well for databases - The advantages & architecture of ScyllaDB's specialized row-based cache - Real-world examples of why and how teams eliminated their external cache with ScyllaDB

Replacing Your Cache with ScyllaDB

ScyllaDB

Discover how your team can achieve low latency at the extreme scale that your data-intensive applications require. We’ll walk you through an example of how ScyllaDB scales linearly to achieve 1M and then 2M OPS – with <1ms P99 latency. We’ll cover how this works on a sample realtime app (an ML feature store), share best practices for performance, and talk about the most important tradeoffs you’ll need to negotiate. Join us to learn: - Why and how to ensure your database takes full advantage of your cloud infrastructure - What architectural considerations matter most for high throughput and low latency - Key factors to consider when selecting a high-performance database

Powering Real-Time Apps with ScyllaDB_ Low Latency & Linear Scalability

ScyllaDB

Teams experiencing subpar latency commonly turn to an external cache to meet the required SLAs. Placing a cache in front of your database might seem like a fast and easy fix, but it often ends up introducing unanticipated complexity, costs, and risks. Caches can be one of the more problematic components of distributed application architecture. Join this webinar for a technical discussion of the risks associated with using an external cache and a look at an alternative strategy that simplifies your architecture without compromising latency. We’ll cover: - Different approaches to caching (pre-caching vs. caching, side cache vs. transparent cache) - 7 specific reasons why external caching can be a bad choice - Why Linux’s default caching doesn’t work well for databases - The advantages & architecture of specialized row-based caches - Real-world examples of why and how teams eliminated their external cache

7 Reasons Not to Put an External Cache in Front of Your Database.pptx

ScyllaDB

Expert tips on how to maximize your database potential If you’re considering or getting started with ScyllaDB, you’re probably intrigued by its potential to achieve high throughput and predictable low latency at a reasonable cost. So how do you ensure that you’re maximizing that potential for your team’s specific workloads and use case? This webinar offers practical advice for navigating the various decision points you’ll face as you assess whether ScyllaDB is a good fit for your team and later roll it out into production. We’ll cover the most critical considerations, tradeoffs, and recommendations related to: - Infrastructure selection - ScyllaDB configuration - Client-side setup - Data modeling

Getting the most out of ScyllaDB

ScyllaDB

NoSQL Database Migration Masterclass - Session 2: The Anatomy of a Migration

ScyllaDB

NoSQL Database Migration Masterclass - Session 3: Migration Logistics

ScyllaDB

NoSQL Data Migration Masterclass - Session 1 Migration Strategies and Challenges

ScyllaDB

Build the foundation for success with ScyllaDB Ready to try out ScyllaDB and want to make sure you’re “doing it right?” We’ll help you get up and running, fast. Spend an hour with our architects for a crash course in what ScyllaDB is all about, the core concepts you need to know, and a step-by-step demonstration of how to get started. During the live, interactive one-hour session, you will learn: - Critical considerations for designing a NoSQL system and NoSQL data model - The technology underlying ScyllaDB’s high performance, availability, and scalability – and best practices for taking advantage of it - How to install, deploy and operate a full working ScyllaDB system, including multi-data center deployment, monitoring, and connecting an application to the ScyllaDB cluster By the end of the session, you’ll have the knowledge and tools you need to get ScyllaDB running on your laptop, connect your application to it, and see what it’s like to use ScyllaDB for your specific use case.

ScyllaDB Virtual Workshop

ScyllaDB

What do you give up – and gain – when moving to a fully-managed cloud database? Now that database-as-a-Service (DBaaS) offerings have been “battle tested” in production, how is the reality matching up to the expectation? What can teams thinking of adopting a fully-managed DBaaS can learn from teams who have years of experience working with this deployment model? Join this webinar to dive into the reality of working with various high-performance DBaaS offerings. We’ll cover the following topics, all supported with real-world examples: - Developer flexibility - Cost variability - Security & privacy - Performance impact - Transparency & troubleshooting

DBaaS in the Real World: Risks, Rewards & Tradeoffs

ScyllaDB

Hands-on workshop to explore the affinities between Rust, the Tokio framework, and ScyllaDB NoSQL. ScyllaDB is a perfect match for Rust. Similar to the Rust programming language and the Tokio framework, ScyllaDB is built on an asynchronous, non-blocking runtime that works extremely well for building highly-reliable low-latency distributed applications. In this workshop, we’ll build a sample Rust application on our high performance native Rust client driver. By compiling and walking through the code, you’ll learn how to craft queries to a locally running ScyllaDB cluster. We’ll cover how to: - Install and compile a sample app, built on ScyllaDB’s native Rust SDK. - Get a ScyllaDB cluster up and running - Connect the application to the database - Review data modeling, query types, and best practices - Manage and monitor the database for consistently low latencies If you’re an application developer with an interest in Rust and Tokio, this workshop is for you!

Build Low-Latency Applications in Rust on ScyllaDB

ScyllaDB

NoSQL Data Modeling 101

ScyllaDB

More from ScyllaDB (20)

Developer Data Modeling Mistakes: From Postgres to NoSQL

What Developers Need to Unlearn for High Performance NoSQL

Low Latency at Extreme Scale: Proven Practices & Pitfalls

Dissecting Real-World Database Performance Dilemmas

Beyond Linear Scaling: A New Path for Performance with ScyllaDB

Dissecting Real-World Database Performance Dilemmas

Database Performance at Scale Masterclass: Workload Characteristics by Felipe...

Database Performance at Scale Masterclass: Database Internals by Pavel Emelya...

Database Performance at Scale Masterclass: Driver Strategies by Piotr Sarna

Replacing Your Cache with ScyllaDB

Powering Real-Time Apps with ScyllaDB_ Low Latency & Linear Scalability

7 Reasons Not to Put an External Cache in Front of Your Database.pptx

Getting the most out of ScyllaDB

NoSQL Database Migration Masterclass - Session 2: The Anatomy of a Migration

NoSQL Database Migration Masterclass - Session 3: Migration Logistics

NoSQL Data Migration Masterclass - Session 1 Migration Strategies and Challenges

ScyllaDB Virtual Workshop

DBaaS in the Real World: Risks, Rewards & Tradeoffs

Build Low-Latency Applications in Rust on ScyllaDB

NoSQL Data Modeling 101

Recently uploaded

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

Scaling API-first – The story of a global engineering organization

Radu Cotescu

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

Finology Group – Insurtech Innovation Award 2024

The Digital Insurer

Discord is a free app offering voice, video, and text chat functionalities, primarily catering to the gaming community. It serves as a hub for users to create and join servers tailored to their interests. Discord’s ecosystem comprises servers, each functioning as a distinct online community with its own channels dedicated to specific topics or activities. Users can engage in text-based discussions, voice calls, or video chats within these channels. Understanding Discord Servers Discord servers are virtual spaces where users congregate to interact, share content, and build communities. Servers may revolve around gaming, hobbies, interests, or fandoms, providing a platform for like-minded individuals to connect. Communication Features Discord offers a range of communication tools, including text channels for messaging, voice channels for real-time audio conversations, and video channels for face-to-face interactions. These features facilitate seamless communication and collaboration. What Does NSFW Mean? The acronym NSFW stands for “Not Safe For Work,” indicating content that may be inappropriate for professional or public settings. NSFW Content NSFW content encompasses material that is sexually explicit, violent, or otherwise graphic in nature. It often includes nudity, profanity, or depictions of sensitive topics.

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

UK Journal

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

🐬 The future of MySQL is Postgres 🐘

RTylerCroy

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

A Domino Admins Adventures (Engage 2024)

Gabriella Davis

Histor y of HAM Radio presentation slide

vu2urc

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

BooK Now Call us at +918448380779 to hire a gorgeous and seductive call girl for sex. Take a Delhi Escort Service. The help of our escort agency is mostly meant for men who want sexual Indian Escorts In Delhi NCR. It should be noted that any impersonator will get 100 attention from our Young Girls Escorts in Delhi. They will assume the position of reliable allies. VIP Call Girl With Original Photos Book Tonight +918448380779 Our Cheap Price 1 Hour not available 2 Hours 5000 Full Night 8000 TAG: Call Girls in Delhi, Noida, Gurgaon, Ghaziabad, Connaught Place, Greater Kailash Delhi, Lajpat Nagar Delhi, Mayur Vihar Delhi, Chanakyapuri Delhi, New Friends Colony Delhi, Majnu Ka Tilla, Karol Bagh, Malviya Nagar, Saket, Khan Market, Noida Sector 18, Noida Sector 76, Noida Sector 51, Gurgaon Mg Road, Iffco Chowk Gurgaon, Rajiv Chowk Gurgaon All Delhi Ncr Free Home Deliver

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men

Delhi Call girls

08448380779 Call Girls In Friends Colony Women Seeking Men

Delhi Call girls

08448380779 Call Girls In Civil Lines Women Seeking Men

Delhi Call girls

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

debabhi2

Handwritten Text Recognition for manuscripts and early printed texts

Maria Levchenko

Sara Mae O’Brien Scott and Tatiana Baquero Cakici, Senior Consultants at Enterprise Knowledge (EK), presented “AI Fast Track to Search-Focused AI Solutions” at the Information Architecture Conference (IAC24) that took place on April 11, 2024 in Seattle, WA. In their presentation, O’Brien-Scott and Cakici focused on what Enterprise AI is, why it is important, and what it takes to empower organizations to get started on a search-based AI journey and stay on track. The presentation explored the complexities of enterprise search challenges and how IA principles can be leveraged to provide AI solutions through the use of a semantic layer. O’Brien-Scott and Cakici showcased a case study where a taxonomy, an ontology, and a knowledge graph were used to structure content at a healthcare workforce solutions organization, providing personalized content recommendations and increasing content findability. In this session, participants gained insights about the following: Most common types of AI categories and use cases; Recommended steps to design and implement taxonomies and ontologies, ensuring they evolve effectively and support the organization’s search objectives; Taxonomy and ontology design considerations and best practices; Real-world AI applications that illustrated the value of taxonomies, ontologies, and knowledge graphs; and Tools, roles, and skills to design and implement AI-powered search solutions.

IAC 2024 - IA Fast Track to Search Focused AI Solutions

Enterprise Knowledge

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Rafal Los

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

Recently uploaded (20)

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Partners Life - Insurer Innovation Award 2024

Scaling API-first – The story of a global engineering organization

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Finology Group – Insurtech Innovation Award 2024

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

Axa Assurance Maroc - Insurer Innovation Award 2024

🐬 The future of MySQL is Postgres 🐘

How to Troubleshoot Apps for the Modern Connected Worker

A Domino Admins Adventures (Engage 2024)

Histor y of HAM Radio presentation slide

presentation ICT roal in 21st century education

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men

08448380779 Call Girls In Friends Colony Women Seeking Men

08448380779 Call Girls In Civil Lines Women Seeking Men

Exploring the Future Potential of AI-Enabled Smartphone Processors

Handwritten Text Recognition for manuscripts and early printed texts

IAC 2024 - IA Fast Track to Search Focused AI Solutions

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Powerful Google developer tools for immediate impact! (2023-24 C)

Continuous Performance Regression Testing with JfrUnit

1. Brought to you by Continuous Performance Regression Testing with JfrUnit Gunnar Morling Principal Software Engineer at

2. Today’s Objective: Learn About... ■ Implementing performance regression tests with JDK Flight Recorder and JfrUnit ■ Analyzing performance regressions in JDK Mission Control ■ Emitting JFR events from 3rd party libraries

3. Gunnar Morling Principal Software Engineer at Red Hat ■ Debezium ■ Quarkus ■ JfrUnit, ModiTect, kcctl ■ Spec Lead for Bean Validation 2.0 ■ Java Champion ■ @gunnarmorling

4. Challenges of Performance Tests ■ Tests based on throughput or latency are dependent on speciﬁcs of the environment ● Require production-like set-up ● Impacted by unrelated concurrent load (e.g. on CI server)

5. JfrUnit — Assert Performance Impacting Metrics ■ Assert proxy metrics like memory allocation or IO ● Based on JDK Flight Recorder events ● Failures may indicate a performance regression ■ Plain unit tests ■ Analyse in JDK Mission Control

6. Hello, JfrUnit!

7. Tools

8. OpenJDK Flight Recorder ■ “Troubleshooting, monitoring, and proﬁling framework embedded into the JVM” ■ 150+ built-in event types; custom ones ■ Open-source since Java 11 (backported to 8) ■ Low overhead, meant for “always-on” ■ Accessible via recording ﬁles and streaming

9. JFR Event Types https://bestsolution-at.github.io/jfr-doc/

10. OpenJDK Mission Control ■ Control, visualize, and analyze JFR recordings ■ And more: ● JMX console ● heap dump analyzer ● etc.

11. Demo Time!

12. JfrUnit — Discussion and Limitations ■ Robust tests with very fast feedback cycle ● Independent from environment ● Proactive identiﬁcation of issues ■ Metrics need solid understanding; e.g. increased allocation may or may not be a problem ■ Cannot identify all issues, e.g. locks showing up only under load ■ Won’t help with issues elsewhere, e.g. a bad query execution plan

13. Wrap-Up

14. Take Aways ■ JfrUnit: a tool in the performance testing box ● Complement - no replacement - for other tests ■ JMC Agent: produce events from code not under your control ■ Move beyond Java 1.8 🚀

15. Outlook — Keeping Track of Historic Values https://horreum.hyperfoil.io/

16. Resources ■ JfrUnit https://github.com/moditect/jfrunit ■ Introduction to JfrUnit https://www.morling.dev/blog/towards-continuous-performance-regression-t esting/ ■ Introduction to JMC Agent https://developers.redhat.com/blog/2020/10/29/collect-jdk-ﬂight-recorder-ev ents-at-runtime-with-jmc-agent/ ■ Proﬁling Java inside containers with ContainerJFR https://developers.redhat.com/devnation/tech-talks/containerjfr

17. Brought to you by Gunnar Morling gunnar@hibernate.org @gunnarmorling

Continuous Performance Regression Testing with JfrUnit

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Continuous Performance Regression Testing with JfrUnit

Similar to Continuous Performance Regression Testing with JfrUnit (20)

More from ScyllaDB

More from ScyllaDB (20)

Recently uploaded

Recently uploaded (20)

Continuous Performance Regression Testing with JfrUnit