Uploaded byjaxLondonConference
PDF, PPTX1,373 views

Packed Objects: Fast Talking Java Meets Native Code - Steve Poole (IBM)

The presentation by Steve Poole focuses on IBM's development of 'packed objects' or 'compact off-heap structures in the Java language', aimed at enhancing interoperability between Java and non-Java applications. Packed objects allow for efficient data sharing with minimal overhead, improving performance over JNI while maintaining a simpler programming model. The talk includes demonstrations of this technology's benefits, particularly in graphics processing using SDL and discusses the implications for future Java development.

Embed presentation

Download as PDF, PPTX
Steve Poole IBM Fast Talking Java Meets Native Code
Important Disclaimers THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES ONLY. WHILST EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE INFORMATION CONTAINED IN THIS PRESENTATION, IT IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. ALL PERFORMANCE DATA INCLUDED IN THIS PRESENTATION HAVE BEEN GATHERED IN A CONTROLLED ENVIRONMENT. YOUR OWN TEST RESULTS MAY VARY BASED ON HARDWARE, SOFTWARE OR INFRASTRUCTURE DIFFERENCES. ALL DATA INCLUDED IN THIS PRESENTATION ARE MEANT TO BE USED ONLY AS A GUIDE. IN ADDITION, THE INFORMATION CONTAINED IN THIS PRESENTATION IS BASED ON IBM’S CURRENT PRODUCT PLANS AND STRATEGY, WHICH ARE SUBJECT TO CHANGE BY IBM, WITHOUT NOTICE. IBM AND ITS AFFILIATED COMPANIES SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION. NOTHING CONTAINED IN THIS PRESENTATION IS INTENDED TO, OR SHALL HAVE THE EFFECT OF: - CREATING ANY WARRANT OR REPRESENTATION FROM IBM, ITS AFFILIATED COMPANIES OR ITS OR THEIR SUPPLIERS AND/OR LICENSORS
Steve Poole ! Works at IBM’s Hursley Laboratory in the UK Involved in IBM Java VM development since before Java was 1 Currently leading IBM’s OpenJDK technical engagement
What this talk is about “Packed Objects” aka “Compact Off-Heap Structures in the Java Language” ! This technology is being developed to help address important pressures on Java ! This talk focuses on how to improve Java interop to Non Java applications
You’ll learn “Compact Off-Heap Structures in the Java Language” 1. An overview of this technology 2. Why we need your input and support 3. How to get started with using this technology yourself
Part 1 Native interoperability Why it’s so important C
Interoperability - why is it important? Java is built on talking native ! Operating Systems Processor Architectures File Systems User interfaces Network Interfaces ! Java keeps the WORA monsters away ! !
WORA - the components JDK Java code JVM JIT native Class Library Native code Your JNI code Your Java application
2013 - Not so Java-centric JVM JIT Class Library native Your Native code JDK Java code Your JNI code Your Java application
2013 - clusters and new processors non Java Runtime High speed memory channels (RDMA etc) Specialised Processors (GPUs etc)
2013 - Can we survive with JNI 1.1? JIT ? Other runtime JVM Class Library Your Native code JDK Java code Your JNI code Your Java application native High speed memory channels (RDMA etc) Specialised Processors (GPUs etc) ? ?
2013 - we can’t survive with JNI 1.1 • 1997 - JNI 1.1 • Designed for independence • Version independence • Platform Independence • VM Independence • Java at the centre of the world • Not performance focused
Packed Objects to the rescue • What we need is • To be able to share data between Java and other runtimes with minimal overhead • To not require a Java centric data view • and share data off-heap too! • Can we do that? • Time for a demo.
A simple demo • • Screensaver style Rectangles moved around the screen, bounce off the sides…
A simple demo Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! RGB colour elements ! typedef struct { int red,green,blue; float vx,vy; SDL_Rect rec; float x,y; ! } RECT; !15 position adjustment vectors SDL structure contains location , height and width float version of location - makes it easier to handle different h/w speeds
A simple demo Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! Initialise Per frame Update rectangle locations Draw rectangles with SDL terminate !16
More than one demo Demo Standard - all C code calling the SDL graphics routines Mixed C and JNI. Java updates the location of each element Mixed C with PackedObjects Java updates the location of each element !17 Frames per second number of JNI calls per frame
Demo 1 - all C Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! Initialise Per frame Update rectangle locations Draw rectangles with SDL terminate !18
Results Demo Standard - all C code calling the SDL graphics routines Mixed C and JNI. Java updates the location of each element Mixed C with PackedObjects Java updates the location of each element !19 Frames per second 20 number of JNI calls per frame 0
Demo 2- Mixed JNI and C Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! Initialise Per frame Update rectangle locations Draw rectangles with SDL terminate !20
Results Demo Standard - all C code calling the SDL graphics routines Mixed C and JNI. Java updates the location of each element Mixed C with PackedObjects Java updates the location of each element !21 Frames per second 20 number of JNI calls per frame 0
er frame) Results Demo Frames per second Standard - all C code calling the SDL graphics routines 20 Mixed C and JNI. Java updates the location of each element 11 number of JNI calls per frame 0 200000 (~4MB per frame) Mixed C with PackedObjects Java updates the location of each element 200 000 JNI calls per frame. Copying data, validating data everytime. AND ensuring there is no chance of optimization by the JIT. !22
Demo 2- Details Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! Initialise Per frame Update rectangle locations Draw rectangles with SDL terminate !23
Demo 2- Details Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! for every rectangle… C function calls Java method via JNI passes in x,y, vx and vy (by copy) Java method updates the rectangles new position Java native calls native method passing in new x,y, vx and vy values (by copy) C native method returns Java method returns C function returns !24
Demo 3 - Packed Objects Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! Initialise Per frame Update rectangle locations Draw rectangles with SDL terminate !25
er frame) Results Demo Frames per second Standard - all C code calling the SDL graphics routines 20 Mixed C and JNI. Java updates the location of each element 11 Mixed C with PackedObjects Java updates the location of each element !26 number of JNI calls per frame 0 200000 (~4MB per frame)
er frame) Results Demo Frames per second number of JNI calls per frame Standard - all C code calling the SDL graphics routines Mixed C and JNI. Java updates the location of each element 11 200000 (~4MB per frame) Mixed C with PackedObjects Java updates the location of each element !27 20 18 1 (4 bytes per frame) 0
Demo 3 - Packed Objects Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! Initialise Per frame Update rectangle locations Draw rectangles with SDL terminate !28
Demo 3 - Packed Objects Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! once per frame.. Java method updates each rectangle’s position directly ! } !29 for(Rectangle r: rectangles) { r.x=r.x+r.vx; r.y=r.y+r.vy; …
Today Java only speaks Java • Getting data into and out of Java has always required some form of marshaling or serialization process ! • Interaction with native data structures in memory is particularly problematic • JNI is the slowest but safest – But you need good C / C++ knowledge • Unsafe and NIO are faster but more challenging to use – They both have their own programming ‘model’ • If the Java side is in control of storage layouts it’s easier • When mapping existing native structures it’s much, much, much more difficult ! • Ironically the JVM is completely aware of native data formats
Tomorrow, with Packed Objects.. Java will let you reference data stored like this ! typedef struct { int red,green,blue; float vx,vy; SDL_Rect rec; float x,y; ! } RECT; C structure
Tomorrow, with Packed Objects.. as if it looked like this ! ! typedef struct { public class Rectangle { ! int red,green,blue; float vx,vy; SDL_Rect rec; float x,y; ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; ! } RECT; C structure } Java structure
Tomorrow, with Packed Objects.. ! ! typedef struct { public class Rectangle { ! int red,green,blue; float vx,vy; SDL_Rect rec; float x,y; ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; without copying ! } RECT; C structure } Java structure
Tomorrow, with Packed Objects.. ! !! ! typedef struct { ! int red,green,blue; ! float vx,vy; ! SDL_Rect rec; ! float x,y; !! ! } RECT; ! ! ‘C’ runtime And off ! ! ! public class Rectangle { ! ! ! int red,green,blue; ! float vx,xy; ! heap SDLRect rec; ! float x,y; ! ! ! } ! ! Java heap
Part 2 Under the covers http://www.flickr.com/photos/mwichary/
Under the covers ! public class Rectangle { Let’s look at these classes from a JVM point of view.. ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; ! } public class SDLRect { short x,y int width,height }
Under the covers ! ! ! ! ! ! ! ! ! ! ! int red int green int blue float vx float vy SLDRect ptr float x float y Java heap ! public class Rectangle { ! short x short y int width int height int red,green,blue; float vx,xy; SDLRect rec; float x,y; ! } public class SDLRect { short x,y int width,height } Java structure !37 J
! ! ! ! ! ! ! ! ! ! ! Questions ! int red int green int blue float vx float vy SLDRect ptr float x float y Java heap !38 1 - How does a JVM ‘know’ the class of these objects? ! ! short x short y int width int height 2 - What are the data format rules for these types? ! ! 3 - When synchonizing on a object - where is the monitor stored?
! ! ! ! ! ! ! ! ! ! ! int red int green int blue float vx float vy SLDRect ptr float x float y Java heap !39 Answers class ptr monitor ! class ptr monitor short x short y int width int height 1 - How does a JVM ‘know’ the class of these objects? Additional internal ptr ! 2 - What are the data format rules for these types? JVM impl specific (including ordering) 3 - When synchonizing on a object - where is the monitor stored? Additional internal field
How to add the metadata ! ! ! ! ! ! ! ! ! ! ! class ptr monitor int red int green int blue float vx float vy SLDRect ptr float x float y Java heap !40 class ptr monitor short x short y int width int height ! ! ! ! ! ! ! ! ! ! ! [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime No space No space for the extra for the extra Java fields -Java fields what do we what do we do? do?
Under the covers ! ! ! ! ! ! ! ! ! ! ! Java heap !41 ! ! ! ! ! ! ! ! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height }
Under the covers ! ! ! ! ! ! ! ! ! ! ! Java heap ! ! ! ! ! ! ! ! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height } Rectangle r=PackedObject.newNativePackedObject(Rectangle.class,0x******); !42
Under the covers ! ! ! ! ! ! ! ! ! ! ! class ptr monitor data ptr “r” Java heap !43 ! ! ! ! ! ! Constructor ! was not ! called! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height }
Rectangle r=PackedObject.newNativePackedObject(Rectangle.class,0x******); Under the covers ! ! ! ! ! ! ! ! ! ! ! class ptr monitor data ptr “r” Java heap SDLRect s=r.rect; ! !44 ! ! ! ! ! ! ! ! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height }
Rectangle r=PackedObject.newNativePackedObject(Rectangle.class,0x******); Under the covers ! ! ! ! ! ! ! ! ! ! ! class ptr monitor data ptr “r” “s” class ptr monitor data ptr Java heap SDLRect s=r.rect; ! !45 ! ! ! ! ! ! ! ! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height }
Rectangle r=PackedObject.newNativePackedObject(Rectangle.class,0x******); Under the covers ! ! ! ! ! ! ! ! ! ! ! class ptr monitor data ptr “r” “s” class ptr monitor data ptr Java heap SDLRect s=r.rect; SDLRect t=r.rect; !46 ! ! ! ! ! ! ! ! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height }
Rectangle r=PackedObject.newNativePackedObject(Rectangle.class,0x******); Under the covers ! ! ! ! ! ! ! ! ! ! ! class ptr monitor data ptr “r” “s” class ptr monitor data ptr “t” class ptr monitor data ptr Java heap SDLRect s=r.rect; SDLRect t=r.rect; !47 ! ! ! ! ! ! ! ! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height }
Part 3 Truth and Consequences
Design considerations • Off heap Packed Objects are considered to already exist so constructors are not called. • Since there is limited opportunity to store the vital metadata it is constructed when needed. • The assumption is that creating new objects when accessing embedded data is confusing and dangerous. • How does ‘==‘ work? • What about synchronization? • The idea of ‘identityless’ objects is being discussed. • Something that PackedObjects has in common with ValueTypes • Could you handle Objects of this style?
The way forward? • This approach offers Java a way forward in the multi environment world • Almost zero cost data interop will benefit Java when exploiting new processors and memory systems. • There are additional use cases that ‘fall out’ from this design. • Low cost r/w of files • Instant application startup • Basic unmanaged memory capabilities • Under the covers heap usage benefits through better control for ‘locality of reference’
Is this the right or only way? • IBM and Oracle have been discussing these sorts of concepts for some time • We need your input. How important are these use cases to you? What’s missing, not needed? What do you hate? • We are trying to keep clear of syntax discussions at this point - it’s too early and just distracting.
You too can use Packed Objects • Google for “IBM Java 8 Beta”
Hard hats must be worn… The current prototype implementation surfaces a lot of the internals that will eventually just disappear This approach makes it easier for us to quickly revise the design but means users of the prototype have to work harder. ! AND ! it avoids syntax wars :-) picture courtesy http://www.flickr.com/people/karen_od/
Wrap up -hopefully you now: “Compact Off-Heap Structures in the Java Language” 1. Have a basic understanding of this technology 2. Know why we need your input and support 3. Know how to get started with using this technology Thank You

More Related Content

PDF
Real-world polyglot programming on the JVM - Ben Summers (ONEIS)
byjaxLondonConference
 
PPTX
Deep Learning: DL4J and DataVec
byJosh Patterson
 
PPTX
TheEdge10 : Big Data is Here - Hadoop to the Rescue
byShay Sofer
 
PPTX
Ruby Under The Hood
bycraig lehmann
 
PPT
Breaking The Clustering Limits @ AlphaCSP JavaEdge 2007
byBaruch Sadogursky
 
PDF
REST and JAX-RS
byGuy Nir
 
PDF
Chris Fregly, Research Scientist, PipelineIO at MLconf ATL 2016
byMLconf
 
PPTX
Smart Data Conference: DL4J and DataVec
byJosh Patterson
 
Real-world polyglot programming on the JVM - Ben Summers (ONEIS)
byjaxLondonConference
 
Deep Learning: DL4J and DataVec
byJosh Patterson
 
TheEdge10 : Big Data is Here - Hadoop to the Rescue
byShay Sofer
 
Ruby Under The Hood
bycraig lehmann
 
Breaking The Clustering Limits @ AlphaCSP JavaEdge 2007
byBaruch Sadogursky
 
REST and JAX-RS
byGuy Nir
 
Chris Fregly, Research Scientist, PipelineIO at MLconf ATL 2016
byMLconf
 
Smart Data Conference: DL4J and DataVec
byJosh Patterson
 

What's hot

KEY
Everything I Ever Learned About JVM Performance Tuning @Twitter
byAttila Szegedi
 
PDF
Spark as the Gateway Drug to Typed Functional Programming: Spark Summit East ...
bySpark Summit
 
PDF
High Performance Python on Apache Spark
byWes McKinney
 
PPTX
Deep Learning and Recurrent Neural Networks in the Enterprise
byJosh Patterson
 
PPTX
Inferno Scalable Deep Learning on Spark
byDataWorks Summit/Hadoop Summit
 
PDF
Deploying Machine Learning Models to Production
byAnass Bensrhir - Senior Data Scientist
 
PPT
An Introduction to JVM Internals and Garbage Collection in Java
byAbhishek Asthana
 
PPTX
From I/O To RAM
byBaruch Sadogursky
 
PDF
The Future of Real-Time in Spark
byReynold Xin
 
PPT
Persisting Your Objects In The Database World @ AlphaCSP Professional OSS Con...
byBaruch Sadogursky
 
ODP
Quick introduction to Java Garbage Collector (JVM GC)
byMarcos García
 
PPTX
Deep Learning Intro - Georgia Tech - CSE6242 - March 2015
byJosh Patterson
 
PDF
.NET Fest 2018. Maarten Balliauw. Let’s refresh our memory! Memory management...
byNETFest
 
PDF
JavaOne 2013: Memory Efficient Java
byChris Bailey
 
PDF
Making Sense of Spark Performance-(Kay Ousterhout, UC Berkeley)
bySpark Summit
 
PDF
Deep Dive: Memory Management in Apache Spark
byDatabricks
 
PDF
Super Sizing Youtube with Python
bydidip
 
PPTX
Georgia Tech cse6242 - Intro to Deep Learning and DL4J
byJosh Patterson
 
PPT
Java Performance Monitoring & Tuning
byMuhammed Shakir
 
PDF
Remote Log Analytics Using DDS, ELK, and RxJS
bySumant Tambe
 
Everything I Ever Learned About JVM Performance Tuning @Twitter
byAttila Szegedi
 
Spark as the Gateway Drug to Typed Functional Programming: Spark Summit East ...
bySpark Summit
 
High Performance Python on Apache Spark
byWes McKinney
 
Deep Learning and Recurrent Neural Networks in the Enterprise
byJosh Patterson
 
Inferno Scalable Deep Learning on Spark
byDataWorks Summit/Hadoop Summit
 
Deploying Machine Learning Models to Production
byAnass Bensrhir - Senior Data Scientist
 
An Introduction to JVM Internals and Garbage Collection in Java
byAbhishek Asthana
 
From I/O To RAM
byBaruch Sadogursky
 
The Future of Real-Time in Spark
byReynold Xin
 
Persisting Your Objects In The Database World @ AlphaCSP Professional OSS Con...
byBaruch Sadogursky
 
Quick introduction to Java Garbage Collector (JVM GC)
byMarcos García
 
Deep Learning Intro - Georgia Tech - CSE6242 - March 2015
byJosh Patterson
 
.NET Fest 2018. Maarten Balliauw. Let’s refresh our memory! Memory management...
byNETFest
 
JavaOne 2013: Memory Efficient Java
byChris Bailey
 
Making Sense of Spark Performance-(Kay Ousterhout, UC Berkeley)
bySpark Summit
 
Deep Dive: Memory Management in Apache Spark
byDatabricks
 
Super Sizing Youtube with Python
bydidip
 
Georgia Tech cse6242 - Intro to Deep Learning and DL4J
byJosh Patterson
 
Java Performance Monitoring & Tuning
byMuhammed Shakir
 
Remote Log Analytics Using DDS, ELK, and RxJS
bySumant Tambe
 

Viewers also liked

PPTX
Legal and ethical considerations redone
byNicole174
 
PDF
Garbage Collection: the Useful Parts - Martijn Verburg & Dr John Oliver (jCla...
byjaxLondonConference
 
PDF
Scaling Scala to the database - Stefan Zeiger (Typesafe)
byjaxLondonConference
 
PDF
Databases and agile development - Dwight Merriman (MongoDB)
byjaxLondonConference
 
PDF
How Hailo fuels its growth using NoSQL storage and analytics - Dave Gardner (...
byjaxLondonConference
 
PPTX
Bringing your app to the web with Dart - Chris Buckett (Entity Group)
byjaxLondonConference
 
PPT
How Java got its Mojo Back - James Governor (Redmonk)
byjaxLondonConference
 
PDF
Introducing Vert.x 2.0 - Taking polyglot application development to the next ...
byjaxLondonConference
 
PDF
Designing and Building a Graph Database Application - Ian Robinson (Neo Techn...
byjaxLondonConference
 
PPTX
Interactive media applications
byNicole174
 
PDF
Big Events, Mob Scale - Darach Ennis (Push Technology)
byjaxLondonConference
 
PDF
What makes Groovy Groovy - Guillaume Laforge (Pivotal)
byjaxLondonConference
 
PDF
Are Hypermedia APIs Just Hype? - Aaron Phethean (Temenos) & Daniel Feist (Mul...
byjaxLondonConference
 
PDF
Streams and Things - Darach Ennis (Ubiquiti Networks)
byjaxLondonConference
 
PPTX
Why other ppl_dont_get_it
byjaxLondonConference
 
PDF
Big data from the LHC commissioning: practical lessons from big science - Sim...
byjaxLondonConference
 
PDF
How Windows 10 will change the way we use devices
byCommelius Solutions
 
PPTX
45 second video proposal
byNicole174
 
PDF
The state of the art biorepository at ILRI
byAbsolomon Kihara
 
PDF
Lambda Expressions: Myths and Mistakes - Richard Warburton (jClarity)
byjaxLondonConference
 
Legal and ethical considerations redone
byNicole174
 
Garbage Collection: the Useful Parts - Martijn Verburg & Dr John Oliver (jCla...
byjaxLondonConference
 
Scaling Scala to the database - Stefan Zeiger (Typesafe)
byjaxLondonConference
 
Databases and agile development - Dwight Merriman (MongoDB)
byjaxLondonConference
 
How Hailo fuels its growth using NoSQL storage and analytics - Dave Gardner (...
byjaxLondonConference
 
Bringing your app to the web with Dart - Chris Buckett (Entity Group)
byjaxLondonConference
 
How Java got its Mojo Back - James Governor (Redmonk)
byjaxLondonConference
 
Introducing Vert.x 2.0 - Taking polyglot application development to the next ...
byjaxLondonConference
 
Designing and Building a Graph Database Application - Ian Robinson (Neo Techn...
byjaxLondonConference
 
Interactive media applications
byNicole174
 
Big Events, Mob Scale - Darach Ennis (Push Technology)
byjaxLondonConference
 
What makes Groovy Groovy - Guillaume Laforge (Pivotal)
byjaxLondonConference
 
Are Hypermedia APIs Just Hype? - Aaron Phethean (Temenos) & Daniel Feist (Mul...
byjaxLondonConference
 
Streams and Things - Darach Ennis (Ubiquiti Networks)
byjaxLondonConference
 
Why other ppl_dont_get_it
byjaxLondonConference
 
Big data from the LHC commissioning: practical lessons from big science - Sim...
byjaxLondonConference
 
How Windows 10 will change the way we use devices
byCommelius Solutions
 
45 second video proposal
byNicole174
 
The state of the art biorepository at ILRI
byAbsolomon Kihara
 
Lambda Expressions: Myths and Mistakes - Richard Warburton (jClarity)
byjaxLondonConference
 

Similar to Packed Objects: Fast Talking Java Meets Native Code - Steve Poole (IBM)

PDF
NDK Primer (Wearable DevCon 2014)
byRon Munitz
 
PDF
NASAfinalPaper
byDanish Vaid
 
PDF
NDK Primer (AnDevCon Boston 2014)
byRon Munitz
 
PDF
Jvm internals
byLuiz Fernando Teston
 
PDF
IBM Java PackedObjects
byMarcel Mitran
 
PDF
JNA - Let's C what it's worth
byIdan Sheinberg
 
PDF
Runtime Innovation - Nextgen Ninja Hacking of the JVM, by Ryan Sciampacone
byZeroTurnaround
 
PPTX
Java on arm theory, applications, and workloads [dev5048]
byAleksei Voitylov
 
PPTX
GOTO Night with Charles Nutter Slides
byAlexandra Masterson
 
PPT
Android JNI
bySiva Ramakrishna kv
 
PDF
JavaOne 2013: Introduction to PackedObjects
byRyan Sciampacone
 
PDF
Ola Bini Evolving The Java Platform
bydeimos
 
PPTX
Simple insites into JVM
byRamakanth Tarimala
 
PDF
Programming in Java Unit 1 lesson Notes for Java
byssuserd0b11b
 
PDF
Understanding the Dalvik bytecode with the Dedexer tool
byGabor Paller
 
PPTX
Java 7 - New Features - by Mihail Stoynov and Svetlin Nakov
bySvetlin Nakov
 
PDF
Android and cpp
byJoan Puig Sanz
 
PPTX
Intel JIT Talk
byiamdvander
 
PDF
JVM Under the Hood
bySerkan Özal
 
PPT
What is Java Technology (An introduction with comparision of .net coding)
byShaharyar khan
 
NDK Primer (Wearable DevCon 2014)
byRon Munitz
 
NASAfinalPaper
byDanish Vaid
 
NDK Primer (AnDevCon Boston 2014)
byRon Munitz
 
Jvm internals
byLuiz Fernando Teston
 
IBM Java PackedObjects
byMarcel Mitran
 
JNA - Let's C what it's worth
byIdan Sheinberg
 
Runtime Innovation - Nextgen Ninja Hacking of the JVM, by Ryan Sciampacone
byZeroTurnaround
 
Java on arm theory, applications, and workloads [dev5048]
byAleksei Voitylov
 
GOTO Night with Charles Nutter Slides
byAlexandra Masterson
 
Android JNI
bySiva Ramakrishna kv
 
JavaOne 2013: Introduction to PackedObjects
byRyan Sciampacone
 
Ola Bini Evolving The Java Platform
bydeimos
 
Simple insites into JVM
byRamakanth Tarimala
 
Programming in Java Unit 1 lesson Notes for Java
byssuserd0b11b
 
Understanding the Dalvik bytecode with the Dedexer tool
byGabor Paller
 
Java 7 - New Features - by Mihail Stoynov and Svetlin Nakov
bySvetlin Nakov
 
Android and cpp
byJoan Puig Sanz
 
Intel JIT Talk
byiamdvander
 
JVM Under the Hood
bySerkan Özal
 
What is Java Technology (An introduction with comparision of .net coding)
byShaharyar khan
 

More from jaxLondonConference

PDF
Conflict Free Replicated Data-types in Eventually Consistent Systems - Joel J...
byjaxLondonConference
 
PDF
JVM Support for Multitenant Applications - Steve Poole (IBM)
byjaxLondonConference
 
PDF
What You Need to Know About Lambdas - Jamie Allen (Typesafe)
byjaxLondonConference
 
PDF
Java Testing With Spock - Ken Sipe (Trexin Consulting)
byjaxLondonConference
 
PDF
The Java Virtual Machine is Over - The Polyglot VM is here - Marcus Lagergren...
byjaxLondonConference
 
PDF
Java EE 7 Platform: Boosting Productivity and Embracing HTML5 - Arun Gupta (R...
byjaxLondonConference
 
PPT
Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Br...
byjaxLondonConference
 
PDF
The Curious Clojurist - Neal Ford (Thoughtworks)
byjaxLondonConference
 
PPTX
TDD at scale - Mash Badar (UBS)
byjaxLondonConference
 
PDF
Run Your Java Code on Cloud Foundry - Andy Piper (Pivotal)
byjaxLondonConference
 
PDF
Put your Java apps to sleep? Find out how - John Matthew Holt (Waratek)
byjaxLondonConference
 
PPTX
Project Lambda: Functional Programming Constructs in Java - Simon Ritter (Ora...
byjaxLondonConference
 
PPTX
Do You Like Coffee with Your dessert? Java and the Raspberry Pi - Simon Ritte...
byjaxLondonConference
 
PDF
Little words of wisdom for the developer - Guillaume Laforge (Pivotal)
byjaxLondonConference
 
PPTX
Large scale, interactive ad-hoc queries over different datastores with Apache...
byjaxLondonConference
 
PDF
Designing Resilient Application Platforms with Apache Cassandra - Hayato Shim...
byjaxLondonConference
 
PPTX
Practical Performance: Understand the Performance of Your Application - Chris...
byjaxLondonConference
 
Conflict Free Replicated Data-types in Eventually Consistent Systems - Joel J...
byjaxLondonConference
 
JVM Support for Multitenant Applications - Steve Poole (IBM)
byjaxLondonConference
 
What You Need to Know About Lambdas - Jamie Allen (Typesafe)
byjaxLondonConference
 
Java Testing With Spock - Ken Sipe (Trexin Consulting)
byjaxLondonConference
 
The Java Virtual Machine is Over - The Polyglot VM is here - Marcus Lagergren...
byjaxLondonConference
 
Java EE 7 Platform: Boosting Productivity and Embracing HTML5 - Arun Gupta (R...
byjaxLondonConference
 
Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Br...
byjaxLondonConference
 
The Curious Clojurist - Neal Ford (Thoughtworks)
byjaxLondonConference
 
TDD at scale - Mash Badar (UBS)
byjaxLondonConference
 
Run Your Java Code on Cloud Foundry - Andy Piper (Pivotal)
byjaxLondonConference
 
Put your Java apps to sleep? Find out how - John Matthew Holt (Waratek)
byjaxLondonConference
 
Project Lambda: Functional Programming Constructs in Java - Simon Ritter (Ora...
byjaxLondonConference
 
Do You Like Coffee with Your dessert? Java and the Raspberry Pi - Simon Ritte...
byjaxLondonConference
 
Little words of wisdom for the developer - Guillaume Laforge (Pivotal)
byjaxLondonConference
 
Large scale, interactive ad-hoc queries over different datastores with Apache...
byjaxLondonConference
 
Designing Resilient Application Platforms with Apache Cassandra - Hayato Shim...
byjaxLondonConference
 
Practical Performance: Understand the Performance of Your Application - Chris...
byjaxLondonConference
 

Recently uploaded

PDF
Designing a Blog Using Wordpress
bymarkzubi50
 
PDF
Taxonomy Alignment for SDG Tagging - ASHA Case Study
byEnterprise Knowledge
 
PDF
When Drones Decide for Themselves_ Inside the Rise of Machine-Led Flight.pdf
byLyra Anderson
 
PPTX
The Lex Wire Precedent: A Technical Standard for Machine-Mediated Authority ...
byJeff Howell
 
PDF
OpenCharacter AI Reviews: Features, Plans, and Best Alternative
byOpenCharacter AI
 
PDF
What Is the Azure AI Foundry and Why Does It Matter for Enterprises?
byjohncarterjn
 
PPTX
Introduction to Industrial-Arts Grade 8 ppt Lesson 1
byFSBTLEDNathanVince
 
PDF
What Thema can do: Leveraging metadata to support the discoverability of Firs...
byBookNet Canada
 
PDF
Transcript: EU regulations for the North American book supply chain - Tech Fo...
byBookNet Canada
 
PPTX
2026 SCORM Troubleshooting Rustici + dominKnow.pptx
byRustici Software
 
PDF
Chapter 4 Network Security in computer security
byGetnet Tigabie Askale -(GM)
 
PDF
TrustArc Webinar - From Zero to Privacy Hero: Launching Your Program Right an...
byTrustArc
 
PPTX
Introduction to Artificial Intelligence (AI).pptx
byammar414783
 
PDF
ICT500 - CRITICAL AND CREATIVE THINKING FOR INFORMATION TECHNOLOGY SOLUTIONS:...
by2024432452
 
PDF
January 2026 OpenMetadata Community Spotlight - OpenMetadata @ Wix.pdf
byOpenMetadata
 
PDF
"Painless Major Upgrade: A Strategy for Updating Large Codebases", Andrii Yat...
byFwdays
 
PDF
The Enterprise Web3 Landscape - a view from Kaleido based on the past 10 year...
byPeter Broadhurst
 
PPTX
Software Engineering in the Age of AI Agents
byHusseinMalikMammadli
 
PDF
UiPath Automation Developer Associate Training Series 2026 - Session 1
byDianaGray10
 
PDF
Bettersize | BeSEC Series Product Brochure
byBettersize Instruments
 
Designing a Blog Using Wordpress
bymarkzubi50
 
Taxonomy Alignment for SDG Tagging - ASHA Case Study
byEnterprise Knowledge
 
When Drones Decide for Themselves_ Inside the Rise of Machine-Led Flight.pdf
byLyra Anderson
 
The Lex Wire Precedent: A Technical Standard for Machine-Mediated Authority ...
byJeff Howell
 
OpenCharacter AI Reviews: Features, Plans, and Best Alternative
byOpenCharacter AI
 
What Is the Azure AI Foundry and Why Does It Matter for Enterprises?
byjohncarterjn
 
Introduction to Industrial-Arts Grade 8 ppt Lesson 1
byFSBTLEDNathanVince
 
What Thema can do: Leveraging metadata to support the discoverability of Firs...
byBookNet Canada
 
Transcript: EU regulations for the North American book supply chain - Tech Fo...
byBookNet Canada
 
2026 SCORM Troubleshooting Rustici + dominKnow.pptx
byRustici Software
 
Chapter 4 Network Security in computer security
byGetnet Tigabie Askale -(GM)
 
TrustArc Webinar - From Zero to Privacy Hero: Launching Your Program Right an...
byTrustArc
 
Introduction to Artificial Intelligence (AI).pptx
byammar414783
 
ICT500 - CRITICAL AND CREATIVE THINKING FOR INFORMATION TECHNOLOGY SOLUTIONS:...
by2024432452
 
January 2026 OpenMetadata Community Spotlight - OpenMetadata @ Wix.pdf
byOpenMetadata
 
"Painless Major Upgrade: A Strategy for Updating Large Codebases", Andrii Yat...
byFwdays
 
The Enterprise Web3 Landscape - a view from Kaleido based on the past 10 year...
byPeter Broadhurst
 
Software Engineering in the Age of AI Agents
byHusseinMalikMammadli
 
UiPath Automation Developer Associate Training Series 2026 - Session 1
byDianaGray10
 
Bettersize | BeSEC Series Product Brochure
byBettersize Instruments
 

Packed Objects: Fast Talking Java Meets Native Code - Steve Poole (IBM)

  • 1.
    Steve Poole IBM FastTalking Java Meets Native Code
  • 2.
    Important Disclaimers THE INFORMATIONCONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES ONLY. WHILST EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE INFORMATION CONTAINED IN THIS PRESENTATION, IT IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. ALL PERFORMANCE DATA INCLUDED IN THIS PRESENTATION HAVE BEEN GATHERED IN A CONTROLLED ENVIRONMENT. YOUR OWN TEST RESULTS MAY VARY BASED ON HARDWARE, SOFTWARE OR INFRASTRUCTURE DIFFERENCES. ALL DATA INCLUDED IN THIS PRESENTATION ARE MEANT TO BE USED ONLY AS A GUIDE. IN ADDITION, THE INFORMATION CONTAINED IN THIS PRESENTATION IS BASED ON IBM’S CURRENT PRODUCT PLANS AND STRATEGY, WHICH ARE SUBJECT TO CHANGE BY IBM, WITHOUT NOTICE. IBM AND ITS AFFILIATED COMPANIES SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION. NOTHING CONTAINED IN THIS PRESENTATION IS INTENDED TO, OR SHALL HAVE THE EFFECT OF: - CREATING ANY WARRANT OR REPRESENTATION FROM IBM, ITS AFFILIATED COMPANIES OR ITS OR THEIR SUPPLIERS AND/OR LICENSORS
  • 3.
    Steve Poole ! Works atIBM’s Hursley Laboratory in the UK Involved in IBM Java VM development since before Java was 1 Currently leading IBM’s OpenJDK technical engagement
  • 4.
    What this talkis about “Packed Objects” aka “Compact Off-Heap Structures in the Java Language” ! This technology is being developed to help address important pressures on Java ! This talk focuses on how to improve Java interop to Non Java applications
  • 5.
    You’ll learn “Compact Off-HeapStructures in the Java Language” 1. An overview of this technology 2. Why we need your input and support 3. How to get started with using this technology yourself
  • 6.
  • 7.
    Interoperability - whyis it important? Java is built on talking native ! Operating Systems Processor Architectures File Systems User interfaces Network Interfaces ! Java keeps the WORA monsters away ! !
  • 8.
    WORA - thecomponents JDK Java code JVM JIT native Class Library Native code Your JNI code Your Java application
  • 9.
    2013 - Notso Java-centric JVM JIT Class Library native Your Native code JDK Java code Your JNI code Your Java application
  • 10.
    2013 - clustersand new processors non Java Runtime High speed memory channels (RDMA etc) Specialised Processors (GPUs etc)
  • 11.
    2013 - Canwe survive with JNI 1.1? JIT ? Other runtime JVM Class Library Your Native code JDK Java code Your JNI code Your Java application native High speed memory channels (RDMA etc) Specialised Processors (GPUs etc) ? ?
  • 12.
    2013 - wecan’t survive with JNI 1.1 • 1997 - JNI 1.1 • Designed for independence • Version independence • Platform Independence • VM Independence • Java at the centre of the world • Not performance focused
  • 13.
    Packed Objects tothe rescue • What we need is • To be able to share data between Java and other runtimes with minimal overhead • To not require a Java centric data view • and share data off-heap too! • Can we do that? • Time for a demo.
  • 14.
    A simple demo • • Screensaverstyle Rectangles moved around the screen, bounce off the sides…
  • 15.
    A simple demo Draw100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! RGB colour elements ! typedef struct { int red,green,blue; float vx,vy; SDL_Rect rec; float x,y; ! } RECT; !15 position adjustment vectors SDL structure contains location , height and width float version of location - makes it easier to handle different h/w speeds
  • 16.
    A simple demo Draw100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! Initialise Per frame Update rectangle locations Draw rectangles with SDL terminate !16
  • 17.
    More than onedemo Demo Standard - all C code calling the SDL graphics routines Mixed C and JNI. Java updates the location of each element Mixed C with PackedObjects Java updates the location of each element !17 Frames per second number of JNI calls per frame
  • 18.
    Demo 1 -all C Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! Initialise Per frame Update rectangle locations Draw rectangles with SDL terminate !18
  • 19.
    Results Demo Standard - allC code calling the SDL graphics routines Mixed C and JNI. Java updates the location of each element Mixed C with PackedObjects Java updates the location of each element !19 Frames per second 20 number of JNI calls per frame 0
  • 20.
    Demo 2- MixedJNI and C Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! Initialise Per frame Update rectangle locations Draw rectangles with SDL terminate !20
  • 21.
    Results Demo Standard - allC code calling the SDL graphics routines Mixed C and JNI. Java updates the location of each element Mixed C with PackedObjects Java updates the location of each element !21 Frames per second 20 number of JNI calls per frame 0
  • 22.
    er frame) Results Demo Frames persecond Standard - all C code calling the SDL graphics routines 20 Mixed C and JNI. Java updates the location of each element 11 number of JNI calls per frame 0 200000 (~4MB per frame) Mixed C with PackedObjects Java updates the location of each element 200 000 JNI calls per frame. Copying data, validating data everytime. AND ensuring there is no chance of optimization by the JIT. !22
  • 23.
    Demo 2- Details Draw100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! Initialise Per frame Update rectangle locations Draw rectangles with SDL terminate !23
  • 24.
    Demo 2- Details Draw100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! for every rectangle… C function calls Java method via JNI passes in x,y, vx and vy (by copy) Java method updates the rectangles new position Java native calls native method passing in new x,y, vx and vy values (by copy) C native method returns Java method returns C function returns !24
  • 25.
    Demo 3 -Packed Objects Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! Initialise Per frame Update rectangle locations Draw rectangles with SDL terminate !25
  • 26.
    er frame) Results Demo Frames persecond Standard - all C code calling the SDL graphics routines 20 Mixed C and JNI. Java updates the location of each element 11 Mixed C with PackedObjects Java updates the location of each element !26 number of JNI calls per frame 0 200000 (~4MB per frame)
  • 27.
    er frame) Results Demo Frames persecond number of JNI calls per frame Standard - all C code calling the SDL graphics routines Mixed C and JNI. Java updates the location of each element 11 200000 (~4MB per frame) Mixed C with PackedObjects Java updates the location of each element !27 20 18 1 (4 bytes per frame) 0
  • 28.
    Demo 3 -Packed Objects Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! Initialise Per frame Update rectangle locations Draw rectangles with SDL terminate !28
  • 29.
    Demo 3 -Packed Objects Draw 100 000 random sized rectangles using SDL ! Move them around the screen and get them to change direction if they hit the sides ! once per frame.. Java method updates each rectangle’s position directly ! } !29 for(Rectangle r: rectangles) { r.x=r.x+r.vx; r.y=r.y+r.vy; …
  • 30.
    Today Java onlyspeaks Java • Getting data into and out of Java has always required some form of marshaling or serialization process ! • Interaction with native data structures in memory is particularly problematic • JNI is the slowest but safest – But you need good C / C++ knowledge • Unsafe and NIO are faster but more challenging to use – They both have their own programming ‘model’ • If the Java side is in control of storage layouts it’s easier • When mapping existing native structures it’s much, much, much more difficult ! • Ironically the JVM is completely aware of native data formats
  • 31.
    Tomorrow, with PackedObjects.. Java will let you reference data stored like this ! typedef struct { int red,green,blue; float vx,vy; SDL_Rect rec; float x,y; ! } RECT; C structure
  • 32.
    Tomorrow, with PackedObjects.. as if it looked like this ! ! typedef struct { public class Rectangle { ! int red,green,blue; float vx,vy; SDL_Rect rec; float x,y; ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; ! } RECT; C structure } Java structure
  • 33.
    Tomorrow, with PackedObjects.. ! ! typedef struct { public class Rectangle { ! int red,green,blue; float vx,vy; SDL_Rect rec; float x,y; ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; without copying ! } RECT; C structure } Java structure
  • 34.
    Tomorrow, with PackedObjects.. ! !! ! typedef struct { ! int red,green,blue; ! float vx,vy; ! SDL_Rect rec; ! float x,y; !! ! } RECT; ! ! ‘C’ runtime And off ! ! ! public class Rectangle { ! ! ! int red,green,blue; ! float vx,xy; ! heap SDLRect rec; ! float x,y; ! ! ! } ! ! Java heap
  • 35.
    Part 2 Under thecovers http://www.flickr.com/photos/mwichary/
  • 36.
    Under the covers ! publicclass Rectangle { Let’s look at these classes from a JVM point of view.. ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; ! } public class SDLRect { short x,y int width,height }
  • 37.
    Under the covers ! ! ! ! ! ! ! ! ! ! ! intred int green int blue float vx float vy SLDRect ptr float x float y Java heap ! public class Rectangle { ! short x short y int width int height int red,green,blue; float vx,xy; SDLRect rec; float x,y; ! } public class SDLRect { short x,y int width,height } Java structure !37 J
  • 38.
    ! ! ! ! ! ! ! ! ! ! ! Questions ! int red int green intblue float vx float vy SLDRect ptr float x float y Java heap !38 1 - How does a JVM ‘know’ the class of these objects? ! ! short x short y int width int height 2 - What are the data format rules for these types? ! ! 3 - When synchonizing on a object - where is the monitor stored?
  • 39.
    ! ! ! ! ! ! ! ! ! ! ! int red int green intblue float vx float vy SLDRect ptr float x float y Java heap !39 Answers class ptr monitor ! class ptr monitor short x short y int width int height 1 - How does a JVM ‘know’ the class of these objects? Additional internal ptr ! 2 - What are the data format rules for these types? JVM impl specific (including ordering) 3 - When synchonizing on a object - where is the monitor stored? Additional internal field
  • 40.
    How to addthe metadata ! ! ! ! ! ! ! ! ! ! ! class ptr monitor int red int green int blue float vx float vy SLDRect ptr float x float y Java heap !40 class ptr monitor short x short y int width int height ! ! ! ! ! ! ! ! ! ! ! [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime No space No space for the extra for the extra Java fields -Java fields what do we what do we do? do?
  • 41.
    Under the covers ! ! ! ! ! ! ! ! ! ! ! Javaheap !41 ! ! ! ! ! ! ! ! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height }
  • 42.
    Under the covers ! ! ! ! ! ! ! ! ! ! ! Javaheap ! ! ! ! ! ! ! ! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height } Rectangle r=PackedObject.newNativePackedObject(Rectangle.class,0x******); !42
  • 43.
    Under the covers ! ! ! ! ! ! ! ! ! ! ! classptr monitor data ptr “r” Java heap !43 ! ! ! ! ! ! Constructor ! was not ! called! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height }
  • 44.
    Rectangle r=PackedObject.newNativePackedObject(Rectangle.class,0x******); Under thecovers ! ! ! ! ! ! ! ! ! ! ! class ptr monitor data ptr “r” Java heap SDLRect s=r.rect; ! !44 ! ! ! ! ! ! ! ! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height }
  • 45.
    Rectangle r=PackedObject.newNativePackedObject(Rectangle.class,0x******); Under thecovers ! ! ! ! ! ! ! ! ! ! ! class ptr monitor data ptr “r” “s” class ptr monitor data ptr Java heap SDLRect s=r.rect; ! !45 ! ! ! ! ! ! ! ! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height }
  • 46.
    Rectangle r=PackedObject.newNativePackedObject(Rectangle.class,0x******); Under thecovers ! ! ! ! ! ! ! ! ! ! ! class ptr monitor data ptr “r” “s” class ptr monitor data ptr Java heap SDLRect s=r.rect; SDLRect t=r.rect; !46 ! ! ! ! ! ! ! ! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height }
  • 47.
    Rectangle r=PackedObject.newNativePackedObject(Rectangle.class,0x******); Under thecovers ! ! ! ! ! ! ! ! ! ! ! class ptr monitor data ptr “r” “s” class ptr monitor data ptr “t” class ptr monitor data ptr Java heap SDLRect s=r.rect; SDLRect t=r.rect; !47 ! ! ! ! ! ! ! ! ! ! ! public class Rectangle { [4] red [4] green [4] blue [4] vx [4] vy [2] rect.x [2] rect.y [4] rect.width [4] rect.height [4] x [4] y ‘C’ runtime ! int red,green,blue; float vx,xy; SDLRect rec; float x,y; } public class SDLRect { short x,y int width,height }
  • 48.
    Part 3 Truth andConsequences
  • 49.
    Design considerations • Offheap Packed Objects are considered to already exist so constructors are not called. • Since there is limited opportunity to store the vital metadata it is constructed when needed. • The assumption is that creating new objects when accessing embedded data is confusing and dangerous. • How does ‘==‘ work? • What about synchronization? • The idea of ‘identityless’ objects is being discussed. • Something that PackedObjects has in common with ValueTypes • Could you handle Objects of this style?
  • 50.
    The way forward? •This approach offers Java a way forward in the multi environment world • Almost zero cost data interop will benefit Java when exploiting new processors and memory systems. • There are additional use cases that ‘fall out’ from this design. • Low cost r/w of files • Instant application startup • Basic unmanaged memory capabilities • Under the covers heap usage benefits through better control for ‘locality of reference’
  • 51.
    Is this theright or only way? • IBM and Oracle have been discussing these sorts of concepts for some time • We need your input. How important are these use cases to you? What’s missing, not needed? What do you hate? • We are trying to keep clear of syntax discussions at this point - it’s too early and just distracting.
  • 52.
    You too canuse Packed Objects • Google for “IBM Java 8 Beta”
  • 53.
    Hard hats mustbe worn… The current prototype implementation surfaces a lot of the internals that will eventually just disappear This approach makes it easier for us to quickly revise the design but means users of the prototype have to work harder. ! AND ! it avoids syntax wars :-) picture courtesy http://www.flickr.com/people/karen_od/
  • 54.
    Wrap up -hopefullyyou now: “Compact Off-Heap Structures in the Java Language” 1. Have a basic understanding of this technology 2. Know why we need your input and support 3. Know how to get started with using this technology Thank You