Beyond JVM - YOW! Sydney 2013
-
Upload
charles-nutter -
Category
Technology
-
view
1.368 -
download
1
description
Transcript of Beyond JVM - YOW! Sydney 2013
![Page 1: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/1.jpg)
Beyond JVMor, How to Boil the Ocean in Seven Years
![Page 2: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/2.jpg)
![Page 3: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/3.jpg)
![Page 4: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/4.jpg)
+
![Page 5: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/5.jpg)
We Like the JVM
![Page 6: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/6.jpg)
No platform-specific compilation needed.
![Page 7: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/7.jpg)
No native library dependencies
![Page 8: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/8.jpg)
Optimizing JIT compiler
![Page 9: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/9.jpg)
Magical black box that runs our code
![Page 10: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/10.jpg)
Things We Like About JVM
• Bytecode intermediate form
• Freedom from native libraries
• Optimizing JIT
• It just works (usually)
![Page 11: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/11.jpg)
Things That Make JRuby Difficult
• Bytecode intermediate form
• Optimizing JIT
• Freedom from native libraries
• It just works (usually)
![Page 12: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/12.jpg)
Things That Make JRuby Difficult
• Startup time sucks
• JNI is a massive pain to use
• Hard to get unusual languages to optimize
• Core is in C++ that we can’t touch
![Page 13: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/13.jpg)
![Page 14: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/14.jpg)
![Page 15: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/15.jpg)
![Page 16: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/16.jpg)
![Page 17: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/17.jpg)
![Page 18: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/18.jpg)
There must be a way!
![Page 19: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/19.jpg)
Startup Time
![Page 20: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/20.jpg)
![Page 21: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/21.jpg)
Java-Heavy JDK
• + Less native code to maintain
• + Easier portability
• + Easier to swap out native side
• – Takes longer to warm up
![Page 22: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/22.jpg)
JVM Bytecode
JVM Language
Bytecode Interpreter
Bytecode JIT
Native Code
Time
![Page 23: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/23.jpg)
JVM Bytecode
JVM Language
Bytecode Interpreter
Bytecode JIT
Native Code
![Page 24: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/24.jpg)
Save JITed Code?
• Code will change across runs
• Often has specific memory addresses
• May optimize object layout differently
• Which JIT output?
• Client, Server, Tiered (1-4)
![Page 25: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/25.jpg)
JRuby Startup
-e 1
gem --help
rake -T
0 2.5 5 7.5 10
C Ruby JRuby
![Page 26: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/26.jpg)
Tweaking Flags
• -client mode
• -XX:+TieredCompilation -XX:TieredStopAtLevel=1
• -X-C to disable JRuby’s compiler
• Heap sizes, code verification, etc etc
![Page 27: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/27.jpg)
JRuby Startup
-e 1
gem --help
rake -T
0 2.5 5 7.5 10
C Ruby JRuby JRuby (best)
![Page 28: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/28.jpg)
Nailgun?
• Keep a single JVM running in background
• Toss commands over to it
• It stays hot, so code starts faster
• Hard to clean up all state (e.g. threads)
• Can’t get access to user’s terminal
![Page 29: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/29.jpg)
Drip
• Start a new JVM after each command
• Pre-boot JVM plus optional code
• Analyze command line for differences
• Age out unused instances
• https://github.com/flatland/drip
![Page 30: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/30.jpg)
$ export JAVACMD=`which drip`!$ time jruby -e 1!real 0m1.655s user 0m4.486s sys0m0.231s!$ time jruby -e 1!real 0m0.577s user 0m0.052s sys0m0.065s
![Page 31: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/31.jpg)
JRuby Startup
-e 1
gem --help
rake -T
0 2.5 5 7.5 10
C Ruby JRuby JRuby (best) JRuby (drip)
![Page 32: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/32.jpg)
$ export DRIP_INIT_CLASS=org.jruby.main.DripMain!$ export DRIP_INIT=""!$ time jruby -e 1!real 0m0.580s user 0m0.052s sys0m0.063s!$ time jruby -e 1!real 0m0.155s user 0m0.049s sys0m0.058s
![Page 33: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/33.jpg)
public class DripMain {!
public static RubyInstanceConfig DRIP_CONFIG;!
public static Ruby DRIP_RUNTIME;!! public static final String JRUBY_DRIP_WARMUP_ENV = "JRUBY_DRIP_WARMUP";!
public static final String JRUBY_DRIP_WARMUP_DEFAULT = "1 + 1";!
public static final String JRUBY_DRIP_PREBOOT_FILE = "./dripmain.rb";!! public static void main(String[] args) throws IOException {!
// warmup JVM first!
Ruby ruby = Ruby.newInstance();!! String envWarmup = System.getenv(JRUBY_DRIP_WARMUP_ENV);!
if (envWarmup != null && envWarmup.length() > 0) {!
ruby.evalScriptlet(envWarmup);!
} else {!
ruby.evalScriptlet(JRUBY_DRIP_WARMUP_DEFAULT);!
}!! // preboot actual runtime!
Ruby.clearGlobalRuntime();!
File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);!! RubyInstanceConfig config = new RubyInstanceConfig();!
ruby = Ruby.newInstance(config);!! if (dripMain.exists()) {!
FileInputStream fis = new FileInputStream(dripMain);!
try {!
ruby.getLoadService().load(dripMain.getAbsolutePath(), false);!
} finally {!
fis.close();!
}!
}!! // use config and runtime from preboot process!
DRIP_CONFIG = config;!
DRIP_RUNTIME = ruby;!
}!
}!
![Page 34: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/34.jpg)
! public static final String JRUBY_DRIP_WARMUP_ENV = "JRUBY_DRIP_WARMUP";! public static final String JRUBY_DRIP_WARMUP_DEFAULT = "1 + 1";! public static final String JRUBY_DRIP_PREBOOT_FILE = "./dripmain.rb";!! public static void main(String[] args) throws IOException {! // warmup JVM first! Ruby ruby = Ruby.newInstance();!! String envWarmup = System.getenv(JRUBY_DRIP_WARMUP_ENV);! if (envWarmup != null && envWarmup.length() > 0) {! ruby.evalScriptlet(envWarmup);! } else {! ruby.evalScriptlet(JRUBY_DRIP_WARMUP_DEFAULT);! }!! // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);!! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);!! if (dripMain.exists()) {!
![Page 35: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/35.jpg)
! public static final String JRUBY_DRIP_WARMUP_ENV = "JRUBY_DRIP_WARMUP";! public static final String JRUBY_DRIP_WARMUP_DEFAULT = "1 + 1";! public static final String JRUBY_DRIP_PREBOOT_FILE = "./dripmain.rb";!! public static void main(String[] args) throws IOException {! // warmup JVM first! Ruby ruby = Ruby.newInstance();!! String envWarmup = System.getenv(JRUBY_DRIP_WARMUP_ENV);! if (envWarmup != null && envWarmup.length() > 0) {! ruby.evalScriptlet(envWarmup);! } else {! ruby.evalScriptlet(JRUBY_DRIP_WARMUP_DEFAULT);! }!! // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);!! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);!! if (dripMain.exists()) {!
![Page 36: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/36.jpg)
! public static final String JRUBY_DRIP_WARMUP_ENV = "JRUBY_DRIP_WARMUP";! public static final String JRUBY_DRIP_WARMUP_DEFAULT = "1 + 1";! public static final String JRUBY_DRIP_PREBOOT_FILE = "./dripmain.rb";!! public static void main(String[] args) throws IOException {! // warmup JVM first! Ruby ruby = Ruby.newInstance();!! String envWarmup = System.getenv(JRUBY_DRIP_WARMUP_ENV);! if (envWarmup != null && envWarmup.length() > 0) {! ruby.evalScriptlet(envWarmup);! } else {! ruby.evalScriptlet(JRUBY_DRIP_WARMUP_DEFAULT);! }!! // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);!! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);!! if (dripMain.exists()) {!
![Page 37: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/37.jpg)
}!! // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);!! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);!! if (dripMain.exists()) {! FileInputStream fis = new FileInputStream(dripMain);! try {! ruby.getLoadService().load(dripMain.getAbsolutePath(), false);! } finally {! fis.close();! }! }!! // use config and runtime from preboot process! DRIP_CONFIG = config;! DRIP_RUNTIME = ruby;! }!}!
![Page 38: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/38.jpg)
}!! // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);!! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);!! if (dripMain.exists()) {! FileInputStream fis = new FileInputStream(dripMain);! try {! ruby.getLoadService().load(dripMain.getAbsolutePath(), false);! } finally {! fis.close();! }! }!! // use config and runtime from preboot process! DRIP_CONFIG = config;! DRIP_RUNTIME = ruby;! }!}!
![Page 39: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/39.jpg)
}!! // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);!! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);!! if (dripMain.exists()) {! FileInputStream fis = new FileInputStream(dripMain);! try {! ruby.getLoadService().load(dripMain.getAbsolutePath(), false);! } finally {! fis.close();! }! }!! // use config and runtime from preboot process! DRIP_CONFIG = config;! DRIP_RUNTIME = ruby;! }!}!
![Page 40: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/40.jpg)
}!! // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);!! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);!! if (dripMain.exists()) {! FileInputStream fis = new FileInputStream(dripMain);! try {! ruby.getLoadService().load(dripMain.getAbsolutePath(), false);! } finally {! fis.close();! }! }!! // use config and runtime from preboot process! DRIP_CONFIG = config;! DRIP_RUNTIME = ruby;! }!}!
![Page 41: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/41.jpg)
}!! // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);!! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);!! if (dripMain.exists()) {! FileInputStream fis = new FileInputStream(dripMain);! try {! ruby.getLoadService().load(dripMain.getAbsolutePath(), false);! } finally {! fis.close();! }! }!! // use config and runtime from preboot process! DRIP_CONFIG = config;! DRIP_RUNTIME = ruby;! }!}!
![Page 42: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/42.jpg)
JRuby Startup
-e 1
gem --help
rake -T
0 2.5 5 7.5 10
C Ruby JRuby JRuby (best) JRuby (drip)JRuby (drip init)
![Page 43: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/43.jpg)
$ cat dripmain.rb# Preload some code Rails always needsrequire File.expand_path('../config/application', __FILE__)
![Page 44: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/44.jpg)
JRuby Startup
rake -T
0 2.5 5 7.5 10
C Ruby JRuby JRuby (best)JRuby (drip) JRuby (drip init) JRuby (dripmain)
![Page 45: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/45.jpg)
JRuby Startup
rake -T
0 0.275 0.55 0.825 1.1
C Ruby JRuby (dripmain)
![Page 46: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/46.jpg)
Native Interop
![Page 47: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/47.jpg)
????
JVM World
Native World
![Page 48: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/48.jpg)
![Page 49: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/49.jpg)
![Page 50: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/50.jpg)
JNI
![Page 51: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/51.jpg)
User Code
JNI call
JNI impl
Target Library
Java
C/native
![Page 52: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/52.jpg)
public class GetPidJNI {! public static native long getpid();! ! public static void main( String[] args ) {! getpid();! }! ! static {! System.load(! System.getProperty("user.dir") +! "/getpidjni.dylib");! }!}
JNI
![Page 53: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/53.jpg)
/* DO NOT EDIT THIS FILE - it is machine generated */!#include <jni.h>!/* Header for class com_headius_jnr_presentation_GetPidJNI */! !#ifndef _Included_com_headius_jnr_presentation_GetPidJNI!#define _Included_com_headius_jnr_presentation_GetPidJNI!#ifdef __cplusplus!extern "C" {!#endif!/*! * Class: com_headius_jnr_presentation_GetPidJNI! * Method: getpid! * Signature: ()J! */!JNIEXPORT jlong JNICALL Java_com_headius_jnr_1presentation_GetPidJNI_getpid! (JNIEnv *, jclass);! !#ifdef __cplusplus!}!#endif!#endif
JNI
![Page 54: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/54.jpg)
#include "com_headius_jnr_presentation_GetPidJNI.h"! !jlong JNICALL Java_com_headius_jnr_1presentation_GetPidJNI_getpid! (JNIEnv *env, jclass c) {! ! return getpid();!}
JNI
![Page 55: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/55.jpg)
$ gcc -I $JAVA_HOME/include -I $JAVA_HOME/include/darwin -L $JAVA_HOME/jre/lib/ -dynamiclib -ljava -o getpidjni.dylib com_headius_jnr_presentation_GetPidJNI.c!!$ java -Djava.library.path=`pwd` -cp target/jnr_presentation-1.0-SNAPSHOT.jar com.headius.jnr_presentation.GetPidJNI
JNI
![Page 56: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/56.jpg)
There Must Be A Better Way
![Page 57: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/57.jpg)
User Code
JNI call
JNI impl
Target Library
Java
C/native
![Page 58: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/58.jpg)
User Code
JNI call
JNI impl
Target Library
Java
C/native
![Page 59: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/59.jpg)
Java Native Runtime
• Java API
• for calling Native code
• supported by a rich Runtime library
• You may be familiar with JNA
• Foreign Function Interface (FFI)
• https://github.com/jnr
![Page 60: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/60.jpg)
User Code
JNR stub
JNI call
JNI impl
libffi
Target Library
Java
C/native
![Page 61: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/61.jpg)
import jnr.ffi.LibraryLoader;!import jnr.ffi.annotations.IgnoreError;! !public class GetPidJNRExample {! public interface GetPid {! long getpid();! }! ! public static void main( String[] args ) {! GetPid getpid = LibraryLoader! .create(GetPid.class)! .load("c");! ! getpid.getpid();! }!}
JNR
![Page 62: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/62.jpg)
Layered Runtime
jffi
jnr-ffi
libffi
jnr-posix
jnr-constants
!
jnr-enxio jnr-x86asmjnr-unixsocket
etc etc
![Page 63: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/63.jpg)
jffi Platforms• Darwin (OS X): universal (+ppc?)
• Linux: i386, x86_64, arm, ppc, ppc64, s390x
• Windows: i386, x86_64
• FreeBSD, OpenBSD: i386, x86_64
• SunOS: i386, x86_64, sparc, sparcv9
• AIX: ppc
• OpenVMS, AS/400: builds out there somewhere
• If your platform isn't here, contribute a build
![Page 64: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/64.jpg)
jnr-ffi
• User-oriented API
• Roughly equivalent to what JNA gives you
• Functions, structs, callbacks, memory
• https://github.com/jnr/jnr-ffi
![Page 65: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/65.jpg)
jnr-posix
• Pre-bound set of POSIX functions
• Mostly driven by what JRuby, Jython use
• Goal: 100% of POSIX bound to Java
![Page 66: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/66.jpg)
public int chmod(String string, int i);!public int chown(String string, int i, int i1);!public int execv(String string, String[] strings);!public int execve(String string, String[] strings, String[] strings1);!public int fork();!public int seteuid(int i);!public int getgid();!public String getlogin();!public int getpgid();!public int getpgid(int i);!public int getpgrp();!public int getpid();!public int getppid();!public Passwd getpwent();!public Passwd getpwuid(int i);!public Passwd getpwnam(String string);!public Group getgrgid(int i);!public Group getgrnam(String string);!public int getuid();!public boolean isatty(FileDescriptor fd);!public int kill(int i, int i1);!public int symlink(String string, String string1);!public int link(String string, String string1);!public String readlink(String string) throws IOException;!public String getenv(String string);!public int setenv(String string, String string1, int i);!public int unsetenv(String string);!public int getpriority(int i, int i1);!public int setpriority(int i, int i1, int i2);!public int setuid(int i);!public FileStat stat(String string);!public int stat(String string, FileStat fs);!public int umask(int i);!public Times times();!public int utimes(String string, long[] longs, long[] longs1);!public int waitpid(int i, int[] ints, int i1);!public int wait(int[] ints);!public int errno();!public void errno(int i);!public int posix_spawnp(String string, List<? extends SpawnFileAction> list, List<? extends CharSequence> list1, List<? extends CharSequence> list2);
![Page 67: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/67.jpg)
POSIX posix = POSIXFactory.getPOSIX(! new MyPOSIXHandler(this),! isNativeEnabled);
![Page 68: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/68.jpg)
public interface POSIXHandler {! public void error(Errno errno, String string);! public void unimplementedError(String string);! public void warn(WARNING_ID wrngd, String string, Object[] os);! public boolean isVerbose();! public File getCurrentWorkingDirectory();! public String[] getEnv();! public InputStream getInputStream();! public PrintStream getOutputStream();! public int getPID();! public PrintStream getErrorStream();!}
![Page 69: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/69.jpg)
public int chmod(String string, int i);!public int chown(String string, int i, int i1);!public int kill(int i, int i1);!public int getpriority(int i, int i1);!public int setpriority(int i, int i1, int i2);!public int waitpid(int i, int[] ints, int i1);!public int wait(int[] ints);!public int errno();!public void errno(int i);
![Page 70: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/70.jpg)
jnr-constants
• C/preprocessor constants in enum form
• Generator code to run on each platform
• Several pregenerated sets for jnr-posix
![Page 71: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/71.jpg)
public int open(String string, int flags, int mode);!public int socket(int i, int i1);
![Page 72: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/72.jpg)
jnr-enxio
• Extended Native X-platform IO
• NIO-compatible JNR-backed IO library
• Read, write, select (kqueue, epoll, etc)
• Low-level fcntl control
• https://github.com/jnr/jnr-enxio
![Page 73: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/73.jpg)
public class NativeSocketChannel! extends AbstractSelectableChannel! implements ByteChannel, NativeSelectableChannel {! public NativeSocketChannel(int fd);! public NativeSocketChannel(int fd, int ops);! public final int validOps();! public final int getFD();! public int read(ByteBuffer dst) throws IOException;! public int write(ByteBuffer src) throws IOException! public void shutdownInput() throws IOException;! public void shutdownOutput() throws IOException;!}
![Page 74: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/74.jpg)
jnr-unixsocket
• UNIX sockets for NIO
• Built atop jnr-enxio
• Fully selectable, etc
• https://github.com/jnr/jnr-unixsocket
![Page 75: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/75.jpg)
What Else?
• NIO, NIO.2
• Native IO, symlinks, FS-walking,
• Unmanaged memory
• Selectable stdio, process IO
• Low-level or other sockets (UNIX, ICMP, ...)
• New APIs (graphics, crypto, OS, ...)
![Page 76: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/76.jpg)
How Does It Perform?
![Page 77: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/77.jpg)
Performance
• Generated code leading to JNI call
• Generated assembly version of native part
• jnr-x86asm: Generate and link ASM
• Used internally by jnr
• https://github.com/jnr/jnr-x86asm
![Page 78: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/78.jpg)
getpid calls, 100M times
1ms
10ms
100ms
1000ms
10000ms
100000ms
JNA getpid JNR getpid
![Page 79: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/79.jpg)
import jnr.ffi.LibraryLoader;!import jnr.ffi.annotations.IgnoreError;! !public class GetPidJNRExample {! public interface GetPid {! @IgnoreError! long getpid();! }! ! public static void main( String[] args ) {! GetPid getpid = LibraryLoader! .create(GetPid.class)! .load("c");! ! getpid.getpid();! }!}
@IgnoreError
![Page 80: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/80.jpg)
getpid calls, 100M times
0ms
500ms
1000ms
1500ms
2000ms
JNR getpid JNR getpid @IgnoreError
![Page 81: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/81.jpg)
getpid calls, 100M times
0ms
500ms
1000ms
1500ms
2000ms
JNR getpid JNI JNR @IgnoreError GCC -O3
But There's More to Do
![Page 82: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/82.jpg)
JVM Help is Coming
• Standard FFI API in JDK
• JIT intelligence
• Drop JNI overhead where possible
• Bind native call directly at call site
• Security policies, segv protection, etc
• Time for an FFI JSR
![Page 83: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/83.jpg)
Language Performance
![Page 84: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/84.jpg)
History
• JVM authors mentioned non-Java languages
• Language authors have targeted JVM
• Hundreds of JVM languages now
• But JVM was a mismatch for many of them
• Usually required tricks that defeated JVM optimizations
• Or required features JDK could not provide
![Page 85: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/85.jpg)
JVM Opcodes
Invocation invokevirtual!
invokeinterface!invokestatic!invokespecial
Field Access getfield!setfield!getstatic!setstatic
Array Access *aload!*astore!
b,s,c,i,l,d,f,a
Stack Local VarsFlow Control
AllocationBoolean and Numeric
![Page 86: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/86.jpg)
Goals of JSR 292
• A user-definable bytecode
• Full freedom to define VM behavior
• Fast method pointers + adapters
• Optimizable like normal Java code
• Avoid future modifications
![Page 87: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/87.jpg)
Invoke// Static!System.currentTimeMillis()!Math.log(1.0)
![Page 88: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/88.jpg)
Invoke// Static!System.currentTimeMillis()!Math.log(1.0)! !// Virtual!"hello".toUpperCase()!System.out.println()
![Page 89: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/89.jpg)
Invoke// Static!System.currentTimeMillis()!Math.log(1.0)! !// Virtual!"hello".toUpperCase()!System.out.println()! !// Interface!myList.add("happy happy")!myRunnable.run()
![Page 90: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/90.jpg)
Invoke// Static!System.currentTimeMillis()!Math.log(1.0)! !// Virtual!"hello".toUpperCase()!System.out.println()! !// Interface!myList.add("happy happy")!myRunnable.run()! !// Constructor and super!new ArrayList()!super.equals(other)
![Page 91: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/91.jpg)
// Static!invokestatic java/lang/System.currentTimeMillis:()J!invokestatic java/lang/Math.log:(D)D!!// Virtual!invokevirtual java/lang/String.toUpperCase:()Ljava/lang/String;!invokevirtual java/io/PrintStream.println:()V!!// Interface!invokeinterface java/util/List.add:(Ljava/lang/Object;)Z!invokeinterface java/lang/Runnable.add:()V!!// Special!invokespecial java/util/ArrayList.<init>:()V!invokespecial java/lang/Object.equals:(java/lang/Object)Z
invokestatic
invokevirtual
invokeinterface
invokespecial
![Page 92: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/92.jpg)
invokestatic!1. Confirm arguments are of correct type 2. Look up method on Java class 3. Cache method 4. Invoke method
invokevirtual!1. Confirm object is of correct type 2. Confirm arguments are of correct type 3. Look up method on Java class 4. Cache method 5. Invoke method
invokeinterface!1. Confirm object’s type implements interface 2. Confirm arguments are of correct type 3. Look up method on Java class 4. Cache method 5. Invoke method
invokespecial!1. Confirm object is of correct type 2. Confirm arguments are of correct type 3. Confirm target method is visible 4. Look up method on Java class 5. Cache method 6. Invoke method
invokestatic
invokevirtual
invokeinterface
invokespecialinvokedynamic!1. Call your bootstrap code 2. Bootstrap wires up a target function 3. Target function invoked directly until you change it
![Page 93: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/93.jpg)
method handles
invokedynamic bytecode
bootstrap method
target method
![Page 94: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/94.jpg)
Does It Work?
![Page 95: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/95.jpg)
Indy Languages
• New language impls
• JavaScript: Dyn.js and Nashorn
• Redline Smalltalk
• Improved language performance
• JRuby, Groovy, Jython
• Java features too!
![Page 96: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/96.jpg)
Times Faster than Ruby 1.9.3
0
1.25
2.5
3.75
5
base64 richards neural redblack
4.32
3.663.44
2.658
1.565
1.914
1.5381.346
JRuby/Java 6 JRuby/Java 7
![Page 97: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/97.jpg)
red/black tree, pure Ruby versus native
ruby-2.0.0 + Ruby
ruby-2.0.0 + C ext
jruby + Ruby
Runtime per iteration
0 0.75 1.5 2.25 3
0.29s
0.51s
2.48s
![Page 98: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/98.jpg)
Caveat Emptor
• Indy was really slow in first Java 7 release
• Got fast in 7u2...and turned out broken
• Rewritten for 7u40
• Slow to warm up
• Still some issues (memory use, etc)
• Java 8 due in March…
![Page 99: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/99.jpg)
All That C++
![Page 100: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/100.jpg)
Out of our control Written in C++
JVM Bytecode
JVM Language
Bytecode Interpreter
Bytecode JIT
Native Code
![Page 101: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/101.jpg)
What If…
• The JVM’s JIT optimizer were written in Java
• You could customize how the JIT works for your language or library
• JITed code could directly make native calls
![Page 102: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/102.jpg)
Graal
• A 100% Java-based JIT framework
• Grew out of the 100% Java “Maxine” JVM
• Backends to assembly or HotSpot IR
• Directly control code generation
• Build a language without using JVM bytecode
• http://openjdk.java.net/projects/graal/
![Page 103: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/103.jpg)
Plain Java APIs
Under your control
Graal Intermediate
Representation
JVM Language
Graal Optimizer
Native Code
Your Optimizations
![Page 104: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/104.jpg)
However…
• Not everyone is a compiler writer
• Graal’s IR is low-level and nontrivial
• Need to understand JVM internals
• Need some understanding of CPU
![Page 105: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/105.jpg)
The Dream
• Design your language
• ???
• PROFIT
![Page 106: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/106.jpg)
What We Want
• Design your language
• Write an interpreter
• PROFIT
![Page 107: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/107.jpg)
Truffle
• Language framework built on Graal
• Designed to fulfill the dream
• Implement interpreter
• Truffle feeds that to backend
• No compiler expertise needed
• https://wiki.openjdk.java.net/display/Graal/Truffle+FAQ+and+Guidelines
![Page 108: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/108.jpg)
Truffle AST
JVM Language
Graal Intermediate
Representation
Graal Optimizer
Native Code
All we need
![Page 109: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/109.jpg)
![Page 110: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/110.jpg)
![Page 111: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/111.jpg)
What Have We Learned?
![Page 112: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/112.jpg)
The JVM has its problems, but we can
fix them.
![Page 113: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/113.jpg)
OpenJDK and all these solutions are really, truly, open source.
![Page 114: Beyond JVM - YOW! Sydney 2013](https://reader033.fdocuments.net/reader033/viewer/2022060108/554fbabab4c9053d018b4711/html5/thumbnails/114.jpg)
Nothing is impossible.