Virtualizing Java in Java (jug.ru)

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Virtualizing Java in Java

How?
Alexey Ragozin

jug.ru
12 Dec 2013

Virtualizing Java in Java
Single JVM hosting
•
•
•
•
•

multiple “pseudo JVMs”, which
Have independent system properties
H...

All started with Oracle Coherence
Native Java distributed peer-to-peer key/value storage
With a lot of extension points
 ...

And we need to test
Behavior of very specific features
Serialization/deserialization defects
Data routing and collocati...

Multiplexing singletons
Custom classloader
Force to reload classes already loaded by
parent (second copy of class loaded...

Heated competition
Three open source “cluster virtualizing” effort around
Oracle Coherence

 GridKit (ChTest)
code.google...

“Distributing” test case
How to start The Application on “virtual cluster”?

Old school
 Main classes and command line ar...

But how all this is relevant to me?
Normal client/server application
 You can use your real main classes instead of mocki...

“Distributing” test case
Transparent remotting
client1.exec(new Runnable() {
@Override
public void run() {
NamedCache cach...

We want to test more!
We are in control class loading
— let’s tweak classpath on flight
 Inject resources
 Remove server...

Backward compatibility testing

Master JVM, client regression test pack
[trunk version]
Case

Client
[version X]

Server
[...

Cross version tests

Master JVM, client regression test pack
[trunk version]
Case
Client
[version X]

Client
[version Y]

...

Managing artifacts
… a bunch of black magic to find local repo
and managing classpath as easy as …
<plugin>
<groupId>org.a...

Managing artifacts
How to get needed artifact on local disk
- Maven will disallow two versions of same artifact
- but we c...

Transparent remotting
Own implementation of RMI
 Standard Java serialization
 Serializing of anonymous Runnable/Callable...

Bidirectional communications
public interface RemotePut extends Remote {
public void put(Object key, Object value);
}

pub...

Bidirectional communications
Extending java.rmi.Remotexec
will mark interface for auto export
public interface RemotePut e...

Sneak peek: Instrumentation
 System.exit() – is still fatal
 Some cases need “virtual time”
 Tweaking monolithic code
...

Sneak peek: Instrumentation
PowerMock
 Recompiles everything (Coherence ～ 5000 classes)

AspectJ
 Static interceptors
By...

Sneak peek: Instrumentation
ViNode node = ...
ViHookBuilder
.newCallSiteHook()
.onTypes(System.class)
.onMethod("exit")
.d...

LET’S TAKE A BREAK HERE

Questions?

From “virtual” to real cluster

Alexey Ragozin

jug.ru
12 Dec 2013

Virtual stuff is so good
Managing virtual nodes in deterministic way, in
Java, having all luxury of exception handling and...

Your network is Big JVM
Same API
3 types of nodes: in-process, local, remote
Transparent remotting
SSH to manage remot...

New opportunities
Performance testing





deploy system under test
deploy load generators
deploy monitoring agents
ga...

$As easy as … @Test public void remote_hello_world() throws InterruptedException { ViManager cloud = CloudFactory.createSim...$

Behind the scene
•
•
•
•

JSCh – SSH client (slightly patched)
Collected classpath artifacts
SCP jars to remote target
Sta...

Death clock is ticking
Master JVM kills slave processes, unless
 SSH session was interrupted
 someone kill -9 master JVM...

Performance testing
•
•
•
•
•

Master JVM is running on CI
JUnit to start test
Loaded generator farm is deployed on test s...

Coding for 200+ processes
Driver - concept
• Driver – Java interface encapsulates test
action
• One way methods
• Friendly...

Monitoring
Sigar - http://www.hyperic.com/products/sigar
• collecting common system metrics
Attach API – built-n JVM monit...

Links
NanoCloud
• https://code.google.com/p/gridkit/wiki/NanoCloudTutorial
• Maven Central: org.gridkit.lab:telecontrol-ss...

Thank you
http://blog.ragozin.info
- my articles
http://code.google.com/p/gridkit
http://github.com/gridkit
- my open sour...

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

Filtering 100M objects in Coherence... by aragozin 7219 views
Garbage collection in JVM by aragozin 12859 views
Java GC tuning and monitoring (by A... by aragozin 11169 views
Cборка мусора в Java без пауз (Hig... by aragozin 6443 views
Performance Test Driven Development... by aragozin 4310 views
JIT-компиляция в виртуальной машине... by aragozin 7467 views

View on Slideshare

1 of 33 Ad

View on Slideshare

1 of 33 Ad