Delivering Java Applications? Ensure Top Performance Every Time, with Intelligent Monitoring and Platform Optimization

© eG Innovations, Inc | www.eginnovations.com
Delivering Java Applications?
Ensure Top Performance Every Time with Intelligent
Monitoring & Platform Optimization
Bala Vaidhinathan
CTO,
eG Innovations
Simon Ritter
Deputy CTO,
Azul Systems

Moderator
John Worthington
Director of U.S Product Marketing
eG Innovations
John.Worthington@eginnovations.com

Logistics
 Please submit your questions at any time during the
webinar using the questions panel on the
GoToWebinar client.
 This webinar is being recorded. You will receive a
link to the recording in a few days.
 A copy of this presentation is posted on Slideshare:
http://www.slideshare.net/eginnovations/

Today’s Presenters
Bala Vaidhinathan
CTO
eG Innovations
Simon Ritter
Deputy CTO
Azul Systems

Agenda
• About eG Innovations
• About Azul Systems
• Challenges with Java Performance Management
• Java Performance Management Success
• eG & Azul Integration
• Q & A

eG Innovations is dedicated to helping businesses across the globe
transform IT services delivery into a competitive advantage and a center
for productivity, growth and profit.
About eG Innovations

4/26/2
017
Oracle Confidential –
Internal/Restricted/Highly Restricted
7

© Copyright Azul Systems 2017
Azul: Java Expertise
 Award-Winning Leader in Java Technology
 Extensive ISV and OEM ecosystem
 Member of JCP Executive Committee
 Project lead for OpenJDK 6
 Member of Expert Group for Java SE 9

Consistency: Java’s Achilles Heel
 Java can be very fast
– Widely used in mission-critical systems
 Optimising JIT compilers
– Produce great code...
 Things run great - for a while...
 ...but then the application glitches
– stalls, freezes, OOM crashes
9

3 Big JVM Challenges
Managed runtime environment
1. The Garbage Collector
– Inherently non-deterministic
– Pause times can be big
2. Thread handling
– Disconnect between application, JVM and OS
3. Bytecodes, not machine code
– Adaptive compilation strategies
– Speed of code ‘warm-up’
1

What If There Was A Better JVM?
1
There is: Zing

Zing: Solves The GC Problem
 No Serial, parallel, CMS or G1 collector
 No full compacting old-gen fallback
 No pauses proportional to heap size
– Scales from 1Gb to 2Tb heaps
 Continuous Concurrent Compacting Collector (C4)
– Uses read-barrier rather than write-barrier
– The bigger the heap, the better the results

Zing ThreadOpt
 Fixes the CPU-Thread disconnect problem
 JVM determines best strategy for threads
– Uses internal metrics
– Controls thread affinity
– Can ‘pin’ threads to cores
– Co-locate related threads on same CPU
– Improved cache coherency on shared data
1

Zing And JIT Compilation
 Falcon
– Replacement for C2 compiler
 Originally written in 1998
 Extremely difficult to add new optimimsations
– Based on LLVM modular compiler project
 ReadyNow!
– Addresses Java “warm-up” issue
– Record JIT profile
– Load profile when application starts
– Integrated with Falcon
1

How Zing Improves Business
 Increased sales and revenue
Better, more reliable application response time
Better, happier customer experience
Reduced missed opportunity costs
 Reduced engineering and operational effort
Improved developer productivity and app time to market
Eliminates JVM tuning
 Improved infrastructure economics
Better server efficiency and utilization
Practical rapid deployment via containers and microservices
1

Zing And eG Innovations
 Identify where platform problems are that affect application
– Often eliminating GC issues reveals other effects
 eG Enterprise easily configured for Zing
– Zing has high GC count in normal operation (concurrent)
– Alerts based on use of contingency/pause prevention
memory
1

Audience Poll
What are your key challenges with Java Application
Performance?
(Select all that applies )
 User Experience Issues
 Takes too long to identify performance issues
 Database or Infrastructure tier issues
 Lack of Performance at high scale
 Memory/thread management

Slow-Time vs. Down-Time
Down-time : $21,000 Slow-time : $4,100
Average revenue loss due to 1 hour of:
However, slowness occurs 10 times more often than downtime.
A 1 sec delay in response time decreases customer satisfaction
by 16%, reduces conversions by 7%.

Database
User
Java Applications are Hard to Manage

Database
User
Multi-Tier Event Storm

 Is it due to the client device/ application?
 Is it the server side Java code?
 Is it in the database queries?
 Is it due to the Java platform/ framework?
 Is it due to the virtual/cloud platform?
 Is there a slowness in the local or regional
network?
 Could it be due to storage?
When your Java Application is Slow …

Java Application Performance Monitoring
Framework
Defines APM as a 5
Dimensional Model
End User
Experience
Monitoring
Business
Transaction
Tracing
Application
Component
Deep-Dive
Application
Topology
Discovery/
Visualization
IT Analytics

Java Application Performance Monitoring
Framework
End User
Experience
Monitoring
Business
Transaction
Tracing
Application
Component
Deep-Dive
Application
Topology
Discovery/Vi
sualization
IT Analytics

User Experience Monitoring
 Emulates users
 Imposes the same workload again
and again
 Provides a measure of experience
EVEN when there is no real load
Synthetic Monitoring
 Monitors real users
 Actual workloads
 Direct measure of what users
are seeing
Real User MonitoringSynthetic Monitoring

User Experience - Best Practice
Use a combination of synthetic and real user monitoring
approaches to gain a complete view of the user experience.
Synthetic Monitoring Real User MonitoringSynthetic Monitoring

ClassFile
Transformer
Business Transaction Tracing
 Application is not modified
 Introduces some overhead
 Tag and follow transactions
 Ideal when problems are
in the application code
Using byte-code instrumentation
JVM
ClassLoader
Class A
Class B
Class C
Agent
1. Premain
2. addTransformer
5. redefineClass
4. transform
3. When
Loading…

Transaction Tracing - Best Practice
• Transaction tracing is very important for identifying coding
issues and poor database queries.
• May not provide true end-to-end visibility for off-the-shelf
applications like SAP, PeopleSoft, etc.
• 3% - number of respondents to Gartner’s APM Survey who
ranked this as #1 priority for APM.
Use transaction tracing as one part (not the only part) of your
end-to-end application performance monitoring strategy.

Application Performance Monitoring
Framework
End User
Experience
Monitoring
Business
Transaction
Tracing
Application
Component
Deep-Dive
Application
Topology
Discovery/Vi
sualization
IT Analytics

Application Monitoring = Transaction Tracing
Transaction tracing will NOT point to the root-cause of an
infrastructure problem.

Server
Infrastructure
Health
Application Processes
TCP
Network
Operating System
Application
Infrastructure Health
Server/Container
JVM
Application Monitoring = Transaction Tracing
Business
Transaction Health
App hosted on
Container
CUSTOM

Component Deep Dive – Best Practice
Have the right mix of reach and depth when it comes to
monitoring capabilities.

Application Performance Monitoring
Framework
End User
Experience
Monitoring
Business
Transaction
Tracing
Application
Component
Deep-Dive
Application
Topology
Discovery/
Visualization
IT Analytics

Application Topology Discovery
Inter-dependencies abound in today’s
application infrastructures:
– Application to application
(Java to SQL)
– Application to VM/cloud
instance
– VM to physical machine/
cloud service
– Application to external service
– Application to infrastructure services (DNS)

Topology Discovery – Best Practice
Don’t just discover – use application dependencies
for root-cause diagnosis.

IT Analytics
• Auto-baselining
• Automatic correlation
• Prediction
• Capacity analysis
• Historical reporting
• Bottleneck detection
• Optimization recommendations

Auto-Baselining for Proactive Alerting
Automatic, time
varying baselines
make monitoring
PROACTIVE

Make Optimization Decisions Based on
Empirical Data
A few of the servers
are handling most of
the sessions

Invest Wisely with Capacity Analytics

IT Analytics – Best Practice
IT Analytics is 2nd in importance to user experience!
Look for monitoring tools that reduce your burden by automating
analysis and providing you actionable insights.

Java Performance Success
Live Tour

Monitoring Azul Zing® JVM
Using eG Enterprise

Data Collection from Zing JVM
User Accessing
eG Enterprise on Web Console
Java Application
Java Application
Java Application
eG Manager
eG Agent
HTTP/S
HTTP/S
• The eG Agent collects JVM performance metrics from Java
applications using JMX and Zing MXBeans

Key JVM Performance Metrics Provided by
eG Enterprise
• Heap memory
• Non-heap memory
• Reservable,
contingency and pause
prevention memory
• CPU utilization of JVM
JVM Resource Usage
• Blocked threads
• Waiting threads
• High CPU threads
• Peak threads
• Started threads
• Daemon threads
• Deadlock threads
JVM Threads
• Loaded classes
• Unloaded classes
• Total classes
Java Classes
• Number of garbage
collection operations
• Time taken for garbage
collection
• % of time spent by JVM
for garbage collection
Garbage Collection
• JMX availability
• JMX response time
• Any changes to PID?
JMX Connection to JVM
• Incoming and outgoing
traffic at the JVM
server
• Server uptime, disk
activity, CPU and
memory statistics
Visibility into the JVM
Server Hardware

Monitor Zing JVM Memory Metrics
– A particular JVM instance’s heap and
non-heap memory are captured as
part of the JVM Engine layer
– The overall reservable, contingency,
and pause prevention pool memory
(which is shared across all JVM
instances) are captured in the
Operating System layer
• Since memory management is handled differently in Zing
(when compared to other conventional JVMs), eG Enterprise
has developed a customized monitoring model to capture
Zing JVM memory metrics
• Each Zing JVM instance is monitored as a separate component
in eG Enterprise:

Monitor JVM Heap Memory
Monitor heap and non-heap
memory and know whether
the JVM is sized correctly
Find out if heap memory has
exceeded the reserved
memory for the JVM
Be informed of memory
pool type: Fixed or Elastic

Monitor Reservable, Contingency, and Pause
Prevention Pool Memory (at the OS Level)
Track total memory usage of
the Linux server and memory
used by the Linux OS
Know how much Reservable,
Contingency and Pause
Prevention Memory is used
Easily drill down and find out
which JVM process is consuming
how much memory

Going Beyond JVM Monitoring
Real User Monitoring
tracks end-user experience in real
time, and identifies locations where
users are affected and why (due to
front end, content download,
network, or server issue)
Business Transaction Monitoring
traces Java transactions across the server-
side application runtime architecture, and
identifies which tier is causing slowdown
(inefficient code in the app server, slow
query processing, remote procedure calls
taking high execution time, etc.)

Full Stack Java Application Monitoring with
eG Enterprise
On-Premises Cloud
End-User Experience
Java Business Transactions
Java Container
Java Virtual Machine
Operating System
Server (Physical/Virtual)
Network, Storage, AD, etc.
JavaApplicationStack
eG Enterprise provides end-to-
end performance visibility of Java
applications and the supporting
infrastructure
 User experience
 Business transactions
 Java application
 Infrastructure performance

Benefits of Monitoring Using eG Enterprise
 Proactively detect and resolve Java application problems to
ensure high service uptime and business continuity
 Troubleshoot faster: Real-time alerts pinpoint the exact line of
code that is impacting Java applications
 In-depth analytics enable architects to optimize Java applications
to scale and support additional users
 Single pane of glass to monitor everything Java—from app
server, JVM and database, all the way down to server and storage
infrastructure
 Eliminate finger-pointing: easily determine if it is a server,
network, virtualization, or code-level issue

Resources to Help You
 More details
http://www.eginnovations.com/freetrial
 Send an Email
info@eginnovations.com
 Call Us
+1 (866) 526 6700

Thank You!
www.eginnovations.com

Delivering Java Applications? Ensure Top Performance Every Time, with Intelligent Monitoring and Platform Optimization

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Delivering Java Applications? Ensure Top Performance Every Time, with Intelligent Monitoring and Platform Optimization

Similar to Delivering Java Applications? Ensure Top Performance Every Time, with Intelligent Monitoring and Platform Optimization (20)

Recently uploaded

Recently uploaded (20)

Delivering Java Applications? Ensure Top Performance Every Time, with Intelligent Monitoring and Platform Optimization

Editor's Notes