"Performance measurements with Java Microbenchmark Harness (JMH)" at Eclipse Demo Camp 2017 by Vadym Kazulkin

•

0 likes•230 views

Vadym Kazulkin

Technology

by Vadym Kazulkin, ip.labs GmbH
Performance measurements
with Java Microbenchmarking Harness (JMH) Framework in your IDE

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
ip.labs GmbH

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
Purpose of benchmarking
• Compare different implementations of code the same logic and choose the most
performant one.
• Identify bottlenecks in a suspected area of code

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
Performance Measurement
this.initializeAndFillMyCollection();
final long start=System.nanoTime();
Collections.sort(myCollection);
final long end=System.nanoTime();
System.out.prinltn(“ “ +end-start);
First naive attempt

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
Performance Measurement
public void measure(final int iterations)
{
for(int i=0; i<iterations; i++)
{
this.initializeAndFillMyCollection();
final long start=System.nanoTime();
Collections.sort(myCollection);
final long end=System.nanoTime();
}
System.out.prinltn(“average time “ +(end-start)/iterations);
}
Second naive attempt

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
Multiply Performance Measurement
JMH Solution

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
Multiply Performance Measurement
Corrected JMH Solution

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
Log Performance Measurement
JMH Solution

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
Collection Performance Measurement 1
JMH Solution

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
Collection Performance Measurement 2
JMH Solution

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
Just-In-Time Compiler Optimizations
• Dead code elimination
• Constant folding
• Loop unrolling
• Devirtualization
• Method inlining
• ….

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
@CompilerControl

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
Performance Measurement
pom.xml dependencies

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
Performance Measurement
pom.xml maven compiler

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
Performance Measurement
Eclipse -> Project -> Run As

Java Microbenchmarking Harness (JMH) Framework by Vadym Kazulkin, ip.labs GmbH
Questions?

Not long ago in Akka.NET-land we had an issue occur where users noticed a dramatic drop in throughput in Akka.Remote’s message processing pipeline - and to make matters worse, this occurred in a production release of AKka.NET! Yikes, how did that happen? The answer is that although you can use unit tests and code reviews to detect functional problems with code changes and pull requests, using those same mechanisms to detect performance problems with code is utterly ineffective. Even skilled developers who have detailed knowledge about the internals of the .NET framework and CLR are unable to correctly predict how changes to code will impact its performance. Hence why we developed NBench - a .NET performance-testing, stress-testing, and benchmarking framework for .NET applications that works and feels a lot like a unit test.

First QTP Tutorial

tjdhans

Dhanasekaran 2008-2009 Quick Test Pro Presentation

Dhanasekaran Nagarajan

Boost your App with Gatling

Knoldus Inc.

Agile2013 - Integration testing in enterprises using TaaS - via Case Study

Anand Bagmar

Educating your app – adding ML edge to your apps - Maoz Tamir

DroidConTLV

Who needs MVVM? Architecture components & MVP - Timor Surkis, Colu

DroidConTLV

Lessons Learned in Software Development: QA Infrastructure – Maintaining Rob...

Cωνσtantίnoς Giannoulis

Java is for many years one of the most popular programming languages, but it used to have hard times in the Serverless Community. Java is known for its high cold start times which may heavily impact the latencies of your application. But the times change: Community and AWS as a cloud providers improve things steadily for Java developers. In this talk we look at the best practices, features and possibilities AWS offers for the Java developers to reduce the cold start times like GraalVM Native Image and AWS Lambda SnapStart based on CRaC (Coordinated Restore at Checkpoint) project.

Benchmarking on JVM

Vladimir Tsanev

Javascript-heavy Salesforce Applications

Salesforce Developers

Whether you're creating a totally customized UI, blending data from various sources, or using frameworks such as Angular and Backbone, there are many situations where you might need to make heavy use of Javascript. Join us as we offer an introduction to Javascript-heavy development in Salesforce, and present tips and tricks to make development easier and make your code scalable, testable, and efficiently integrated with Salesforce.

Js tacktalk team dev js testing performance

Артем Захарченко

JavaScript development methodology

Aleksander Fabijan

[FullStack NYC 2019] Effective Unit Tests for JavaScript

Hazem Saleh

Unit testing coverage is a great way to show us the amount of tested lines and branches of code, but is this really enough? The answer is "no" since unit testing coverage does not really fully measure the efficiency of the unit tests. This is why there is a need for using techniques that can improve unit tests efficiency. Mutation testing is one of these powerful techniques. The main idea of mutation testing is to automatically insert bugs (mutants) into production code and then run unit tests to check if they are strong enough to fail as a result of these mutations. This session discusses mutation testing techniques and demonstrates Stryker as a powerful mutation testing tool for JavaScript applications.

Unit Testing with Jest

Maayan Glikser

Java Attacks & Defenses - End of Year 2010 Presentation

James Hamilton

Decompilation is a problem for the software industry, with the global revenue loss due to software piracy estimated to be more than $50 billion in 2008. There are several Java decompilers available but none are 100% effective, and many are obsolete/unmaintained. We found Java Decompiler, JODE and Dava to be good Java decompilers but not perfect. Dava is particularily suited to aribtrary bytecode, while others are suited to javac generated bytecode. Static watermarking techniques can be used to protect a program from being copied by giving the ability to easily identify the owner of such software. However, static watermarking techniques are higher susceptible to semantics-preserving transformations. We show that the majority of the current implementations of watermarking systems are based on static techniques are fail when attacked with obfuscations and optimisations. Further work will involve evaluating dynamic watermarking algorithms in a similar manner, and compare them to their static counterparts. Techniques such as program slicing can be used to attack software watermarks, in subtractive attacks on software.

AppSec California 2016 - Making Security Agile

Oleg Gryb

Amazon CodeGuru vs SonarQube for Java Developers at JCon 2022

Vadym Kazulkin

In this talk I will compare 2 services which aim at automatically identifing critical issues, security vulnerabilities, and hard-to-find bugs during application development: Amazon CodeGuru and SonarQube from the perspective of the Java developer on AWS. Amazon CodeGuru Reviewer uses ML and automated reasoning to provide recommendations to developers on how to fix issues to improve code quality and dramatically reduce the time it takes to fix bugs before they reach customer-facing applications and result in a bad experience. SonarQube is an open-source platform for continuous inspection of code quality to perform automatic reviews with static analysis of code to detect bugs, code smells, and security vulnerabilities on 20+ programming languages. SonarQube offers reports on duplicated code, coding standards, unit tests, code coverage, code complexity, comments, bugs, and security vulnerabilities

Gallio Crafting A ToolchainConSanFrancisco123

Usemon; Building The Big Brother Of The Java Virtual MachinvePaul René Jørgensen

Testing in a glance

Rajesh Kumar

What is testing? What is agile testing? What is automated testing? What is agile testing? Unit testing Mock testing Functional testing Acceptance testing Integration testing Performance/load/stress testing Deployment testing Methods of testing White/black/grayboxtesting GUI vs. businesslogictesting Improving code testability Codefacing vs. businessfacingtesting Smoke testing Automated testing strategies Virtualization Code coverage Resources File Can be downloaded from: http://community.scmgalaxy.com/

Scjp 16-pdf-e book-exam-questionsRaghavendra V Gayakwad

"Java memory model for practitioners" at JavaLand 2017 by Vadym Kazulkin/Rodi...

Vadym Kazulkin

Behavior Driven Development by Example

Nalin Goonawardana

A Glance At The Java Performance Toolbox

Ana-Maria Mihalceanu

Is it tuning the garbage collector? Writing clean(er) code? No, the first step is understanding what’s going on in your application! Performance tuning starts with analysis, and JDK tools can help you gain insights on classes and threads and can perform live GC analysis or heap dump postprocessing: jcmd, jconsole, jstat, jmap and jfr. We’ll examine the functional visibility areas essential to Java and how these tools provide that information. Moreover, will discuss options on how to integrate information gathered from these tools with widespread monitoring systems like Prometheus. After this talk, you will be ready to understand what your application spends time on and why so you can start improving its perform

How to reduce cold starts for Java Serverless applications in AWS at InfoShar...

Vadym Kazulkin

"Reactive Programming in Java" at Froscon 2017 by Vadym Kazulkin/Rodion Alukh...

Vadym Kazulkin

TechEvent Graal(VM) Performance Interoperability

Trivadis

High performance Serverless Java on AWS at GeeCon 2024 Krakow

Vadym Kazulkin

Java is for many years one of the most popular programming languages, but it used to have hard times in the Serverless community. Java is known for its high cold start times and high memory footprint, comparing to other programming languages like Node.js and Python. In this talk I'll look at the general best practices and techniques we can use to decrease memory consumption, cold start times for Java Serverless development on AWS including GraalVM (Native Image) and AWS own offering SnapStart based on Firecracker microVM snapshot and restore and CRaC (Coordinated Restore at Checkpoint) runtime hooks. I'll also provide a lot of benchmarking on Lambda functions trying out various deployment package sizes, Lambda memory settings, Java compilation options and HTTP (a)synchronous clients and measure their impact on cold and warm start times.

Amazon DevOps Guru for Serverless Applications at DevOpsCon 2024 London

Vadym Kazulkin

In this talk, we’ll use a standard serverless application that uses API Gateway, Lambda, DynamoDB, SQS, Step Functions (and other AWS-managed services). We'll explore how Amazon DevOps Guru recognizes operational issues and anomalies like increased latency and error rates (timeouts, throttling, and resource limits) and integrate DevOps Guru with PagerDuty to provide even better incident management. Amazon DevOps Guru analyzes data like application metrics, logs, events, and traces to establish baseline operational behavior and then uses ML to detect anomalies. The service uses pre-trained ML models that are able to identify spikes in application requests, so it knows when to alert and when not to.

Similar to "Performance measurements with Java Microbenchmark Harness (JMH)" at Eclipse Demo Camp 2017 by Vadym Kazulkin

How to reduce cold starts for Java Serverless applications in AWS at JCON Wor...

Vadym Kazulkin

Benchmarking on JVM

Vladimir Tsanev

Javascript-heavy Salesforce Applications

Salesforce Developers

Js tacktalk team dev js testing performance

Артем Захарченко

JavaScript development methodology

Aleksander Fabijan

[FullStack NYC 2019] Effective Unit Tests for JavaScript

Hazem Saleh

Unit Testing with Jest

Maayan Glikser

Java Attacks & Defenses - End of Year 2010 Presentation

James Hamilton

AppSec California 2016 - Making Security Agile

Oleg Gryb

Amazon CodeGuru vs SonarQube for Java Developers at JCon 2022

Vadym Kazulkin

Gallio Crafting A ToolchainConSanFrancisco123

Usemon; Building The Big Brother Of The Java Virtual MachinvePaul René Jørgensen

Testing in a glance

Rajesh Kumar

Scjp 16-pdf-e book-exam-questionsRaghavendra V Gayakwad

"Java memory model for practitioners" at JavaLand 2017 by Vadym Kazulkin/Rodi...

Vadym Kazulkin

Behavior Driven Development by Example

Nalin Goonawardana

A Glance At The Java Performance Toolbox

Ana-Maria Mihalceanu

How to reduce cold starts for Java Serverless applications in AWS at InfoShar...

Vadym Kazulkin

"Reactive Programming in Java" at Froscon 2017 by Vadym Kazulkin/Rodion Alukh...

Vadym Kazulkin

TechEvent Graal(VM) Performance Interoperability

Trivadis

Similar to "Performance measurements with Java Microbenchmark Harness (JMH)" at Eclipse Demo Camp 2017 by Vadym Kazulkin (20)

How to reduce cold starts for Java Serverless applications in AWS at JCON Wor...

Benchmarking on JVM

Javascript-heavy Salesforce Applications

Js tacktalk team dev js testing performance

JavaScript development methodology

[FullStack NYC 2019] Effective Unit Tests for JavaScript

Unit Testing with Jest

Java Attacks & Defenses - End of Year 2010 Presentation

AppSec California 2016 - Making Security Agile

Amazon CodeGuru vs SonarQube for Java Developers at JCon 2022

Gallio Crafting A Toolchain

Usemon; Building The Big Brother Of The Java Virtual Machinve

Testing in a glance

Scjp 16-pdf-e book-exam-questions

"Java memory model for practitioners" at JavaLand 2017 by Vadym Kazulkin/Rodi...

Behavior Driven Development by Example

A Glance At The Java Performance Toolbox

How to reduce cold starts for Java Serverless applications in AWS at InfoShar...

"Reactive Programming in Java" at Froscon 2017 by Vadym Kazulkin/Rodion Alukh...

TechEvent Graal(VM) Performance Interoperability

More from Vadym Kazulkin

High performance Serverless Java on AWS at GeeCon 2024 Krakow

Vadym Kazulkin

Amazon DevOps Guru for Serverless Applications at DevOpsCon 2024 London

Vadym Kazulkin

Making sense of service quotas of AWS Serverless services and how to deal wit...

Vadym Kazulkin

There is a misunderstanding that everything is possible with the Serverless Services in AWS. For example, the misunderstanding that your Lambda function may scale without limitations. But each AWS service (not only Serverless) has a big list of quotas that everybody needs to be aware of, understand, and take into account during the development. In this talk, I'll explain the most important quotas (in terms of scaling, but not only that) of Serverless services like API Gateway, Lambda, DynamoDB, SQS, and Aurora Serverless and how to architect your solution with these quotas in mind.

How to reduce cold starts for Java Serverless applications in AWS at Serverle...

Vadym Kazulkin

Revolutionize DevOps lifecycle with Amazon CodeCatalyst and DevOps Guru at De...

Vadym Kazulkin

AWS is on a journey to revolutionize DevOps using the latest technologies. In this talk I'll introduce 2 Amazon services which cover different stages of the DevOps lifecycle: CodeCatalyst and DevOps Guru. Amazon CodeCatalyst is an integrated service for software development teams adopting continuous integration and deployment practices into their software development process. CodeCatalyst puts the tools you need all in one place. You can plan work, collaborate on code, and build, test, and deploy applications with continuous integration/continuous delivery (CI/CD) tools. You can also integrate AWS resources with your projects by connecting your AWS accounts to your CodeCatalyst space. By managing all of the stages and aspects of your application lifecycle in one tool, you can deliver software quickly and confidently. Amazon DevOps Guru analyzes data like application metrics, logs, events, and traces to establish baseline operational behavior and then uses ML to detect anomalies. The service uses pre-trained ML models that are able to identify spikes in application requests, so it knows when to alert and when not to.

Amazon DevOps Guru for the Serverless Applications at AWS Community Day NL 2023

Vadym Kazulkin

In this talk we’ll use a standard Serverless application which uses of API Gateway, Lambda, DynamoDB, SQS, Step Functions (and other AWS managed services) and explore how Amazon DevOps Guru recognizes operational issues like increased latency and error rates (timeouts, throttling and resource limits) and integrate DevOps Guru with PagerDuty for providing even better incident management. Amazon DevOps Guru analyzes data like application metrics, logs, events, and traces to establish baseline operational behavior and then uses ML to detect anomalies. The service uses pre-trained ML models that are able to identify spikes in application requests, so it knows when to alert and when not to.

Making sense of service quotas of AWS Serverless services and how to deal wit...

Vadym Kazulkin

There is a misunderstanding, that everything is possible with the Serverless Services in AWS, for example that your Lambda function may scale without limitations . But each AWS service (not only Serverless) has a big list of quotas that everybody needs to be aware of, understand and take into account during the development. In this talk I'll explain the most important quotas of the Serverless Services like API Gateway, Lambda, DynamoDB, SQS and Aurora Serverless and how to architect your solution with these quotas in mind.

Adopting Java for the Serverless World at Voxxed Days Bruxelles 2023

Vadym Kazulkin

Java is for many years one of the most popular programming languages, but it used to have hard times in the Serverless Community. Java is known for its high cold start times and high memory footprint. For both you have to pay to the cloud providers of your choice. That's why most developers tried to avoid using Java for such use cases. But the times change: Community and cloud providers improve things steadily for Java developers. In this talk we look at the features and possibilities AWS cloud provider offers for the Java developers and look the most popular Java frameworks, like Micronaut, Quarkus and Spring (Boot) and look how (AOT compiler and GraalVM Native Image play a huge role) they address Serverless challenges and enable Java for broad usage in the Serverless world. We'll also look into AWS Lambda SnapStart feature based on CRaC (Coordinated Restore at Checkpoint) project which also reduces the cold start time of Java Serverless application on AWS. We also look into the tools which help us figure out the optimal balance between Lambda memory footprint, invocation time and execution cost.

Github Copilot vs Amazon CodeWhisperer for Java developers at JCON 2023

Vadym Kazulkin

In this talk I will compare 2 services Github Copilot (including Copilot X) and Amazon CodeWhisperer from the perspective of the Java developers in terms of the quality of the given recommendations for simple tasks, complex algorithms, Spring Boot and AWS development, IDE integration and pricing. Both services are the machine learning-powered services that help improve developer productivity by generating code recommendations based on developers’ comments in natural language and their code. Based on natural language comments, these services also automatically recommend unit test code that matches your implementation code.

AWS Lambda SnapStart: Why, How and What AWS Serverless Meetup New York Boston...

Vadym Kazulkin

- Challenges of AWS Serverless applications written in Java - Challenges and limitations of existing solutions like Graal VM Native Image - What is AWS SnapStart and how it addresses those challenges - Benchmarking AWS Lambda SnapStart using plain Java and also frameworks like Quarkus, Micronaut and SpringBoot - Optimization techniques like Priming - Current challenges and limitations of AWS Lambda SnapStart

Revolutionize DevOps with ML capabilities. Deep dive into Amazon CodeGuru and...

Vadym Kazulkin

I will introduce two AWS services: CodeGuru and DevOps Guru. CodeGuru Reviewer uses ML and automated reasoning to automatically identify critical issues, security vulnerabilities, and hard-to-find bugs during application development. DevOps Guru analyzes data like application metrics, logs, events, and traces to establish baseline operational behavior and then uses ML to detect anomalies. It does this by having the ability to correlate and group metrics together to understand the relationships between those metrics, so it knows when to alert.

Amazon DevOps Guru for the Serverless Applications at AWS Community Day Bene...

Vadym Kazulkin

In this talk we’ll build a standard Serverless application which uses of API Gateway, Lambda and DynamoDB and explore how Amazon DevOps Guru recognizes operational issues like increased latency and error rates (timeouts and throttles) and integrate DevOps Guru with PagerDuty for providing even better incident management Amazon DevOps Guru analyzes data like application metrics, logs, events, and traces to establish baseline operational behavior and then uses ML to detect anomalies. The service uses pre-trained ML models that are able to identify spikes in application requests, so it knows when to alert and when not to.

Adopting Java for the Serverless World at JUG Saxony Day 2022

Vadym Kazulkin

Java is for many years one of the most popular programming languages, but it used to have hard times in the Serverless Community. Java is known for its high cold start times and high memory footprint. For both you have to pay to the cloud providers of your choice. That's why most developers tried to avoid using Java for such use cases. But the times change: Community and cloud providers improve things steadily for Java developers. In this talk we look at the features and possibilities AWS cloud provider offers for the Java developers and look the most popular Java frameworks, like Micronaut, Quarkus and Spring (Boot) and look how (AOT compiler and GraalVM native images play a huge role) they address Serverless challenges and enable Java for broad usage in the Serverless world.

Projects Valhalla and Loom DWX 2022

Vadym Kazulkin

Adopting Java for the Serverless World at VoxxedDays Luxemburg

Vadym Kazulkin

Java is for many years one of the most popular programming languages, but it used to have hard times in the Serverless Community. Java is known for its high cold start times and high memory footprint. For both you have to pay to the cloud providers of your choice. That's why most developers tried to avoid using Java for such use cases. But the times change: Community and cloud providers improve things steadily for Java developers. In this talk we look at the features and possibilities AWS cloud provider offers for the Java developers and look the most popular Java frameworks, like Micronaut, Quarkus and Spring (Boot) and look how (AOT compiler and GraalVM native images play a huge role) they address Serverless challenges and enable Java for broad usage in the Serverless world.

Revolutionize DevOps with ML capabilities. Introduction to Amazon CodeGuru an...

Vadym Kazulkin

Adopting Java for the Serverless World at JUG Bonn 2022

Vadym Kazulkin

Java is for many years one of the most popular programming languages, but it used to have hard times in the Serverless Community. Java is known for its high cold start times and high memory footprint. For both you have to pay to the cloud providers of your choice. That's why most developers tried to avoid using Java for such use cases. But the times change: Community and cloud providers improve things steadily for Java developers. In this talk we look at the features and possibilities AWS cloud provider offers for the Java developers and look the most popular Java frameworks, like Micronaut, Quarkus and Spring (Boot) and look how (AOT compiler and GraalVM native images play a huge role) they address Serverless challenges and enable Java for broad usage in the Serverless world.

Adopting Java for the Serverless World at JUG Darmstadt 2022

Vadym Kazulkin

Java is for many years one of the most popular programming languages, but it used to have hard times in the Serverless Community. Java is known for its high cold start times and high memory footprint. For both you have to pay to the cloud providers of your choice. That's why most developers tried to avoid using Java for such use cases. But the times change: Community and cloud providers improve things steadily for Java developers. In this talk we look at the features and possibilities AWS cloud provider offers for the Java developers and look the most popular Java frameworks, like Micronaut, Quarkus and Spring (Boot) and look how (AOT compiler and GraalVM native images play a huge role) they address Serverless challenges and enable Java for broad usage in the Serverless world.

Adopting Java for the Serverless World at JAX 2022

Vadym Kazulkin

Java is for many years one of the most popular programming languages, but it used to have hard times in the Serverless Community. Java is known for its high cold start times and high memory footprint. For both you have to pay to the cloud providers of your choice. That's why most developers tried to avoid using Java for such use cases. But the times change: Community and cloud providers improve things steadily for Java developers. In this talk we look at the features and possibilities AWS cloud provider offers for the Java developers and look the most popular Java frameworks, like Micronaut, Quarkus and Spring (Boot) and look how (AOT compiler and GraalVM native images play a huge role) they address Serverless challenges and enable Java for broad usage in the Serverless world.

Adopting Java for the Serverless World at JUG Hessen 2022

Vadym Kazulkin

Java is for many years one of the most popular programming languages, but it used to have hard times in the Serverless Community. Java is known for its high cold start times and high memory footprint. For both you have to pay to the cloud providers of your choice. That's why most developers tried to avoid using Java for such use cases. But the times change: Community and cloud providers improve things steadily for Java developers. In this talk we look at the features and possibilities AWS cloud provider offers for the Java developers and look the most popular Java frameworks, like Micronaut, Quarkus and Spring (Boot) and look how (AOT compiler and GraalVM native images play a huge role) they address Serverless challenges and enable Java for broad usage in the Serverless world.

More from Vadym Kazulkin (20)