Beyond JVM - YOW Melbourne 2013
-
Upload
charles-nutter -
Category
Technology
-
view
1.963 -
download
3
description
Transcript of Beyond JVM - YOW Melbourne 2013
![Page 1: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/1.jpg)
Beyond JVMA tour of upcoming technologies
![Page 2: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/2.jpg)
Reminders
• Green/yellow/red rating system after talk
• Extended Q/A by blue chairs at 12:15
• If not green…stop by and tell me why
![Page 3: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/3.jpg)
Me
• Charles Oliver Nutter
• Red Hat (yes, I have one; no, I don’t wear it)
• JRuby and JVM languages
• JVM hacking and spelunking
• @headius
![Page 4: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/4.jpg)
Goals
• Get you excited about the future of JVM
• Show you there are very few unsolvables
• Convince you to get involved
![Page 5: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/5.jpg)
What is “JVM”?
• The JVM is software that runs JVM bytecode
• Java, Scala, Groovy, JRuby, Clojure, …
• OpenJDK contains Sun’s JVM “HotSpot”
• Oracle’s JDK is based on OpenJDK
• Many other JVMs exist for many platforms
• Some just replace HotSpot
![Page 6: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/6.jpg)
OSS JVMs• Avian
• Azul Zulu
• CACAO
• Dalvik
• GCJ
• HaikuVM
• HotSpot
• IcedTea
• IKVM.NET
• Jamiga
• JamVM
• Jaos
• Jato VM
• Jelatine JVM
• JESSICA
• Jikes RVM (Jikes Research Virtual Machine)
• JOP
• Juice
• Jupiter
• JwiK
• Kaffe
• leDos
• MateVM
• Maxine
• Mika VM
• miniMV
• Mysaifu
• NanoVM
• RoboVM
• SableVM
• Squawk virtual machine
• SuperWaba
• TakaTuka
• TinyVM.
• VM02
![Page 7: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/7.jpg)
Why JVM?
![Page 8: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/8.jpg)
Why Not JVM?
![Page 9: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/9.jpg)
![Page 10: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/10.jpg)
![Page 11: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/11.jpg)
![Page 12: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/12.jpg)
OpenJDK
![Page 13: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/13.jpg)
OpenJDK Timeline
• For years, Sun’s JDK is closed source
• Sun Microsystems starts OSS process in 2005
• Official announcement at JavaOne 2006
• HotSpot OSSed 12 Nov 2006
• JDK OSSed 8 May 2007
![Page 14: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/14.jpg)
A 2006 report prepared for the EU by UNU-MERIT stated that Sun was the largest corporate contributor to open source movements in the world.
![Page 15: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/15.jpg)
According to this report, Sun's open source contributions exceed the combined total of the next five largest commercial contributors.
![Page 16: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/16.jpg)
Unfortunately…
![Page 17: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/17.jpg)
Sun Becomes Oracle
• Sun broke open the OSS piñata
• Java, Solaris, OpenOffice, NetBeans, VirtualBox, ZFS, Dtrace, and more
• Unable to capitalize on OSS
• Hardware can’t make up the difference
• Oracle takes over Sun…oh no!!!
![Page 18: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/18.jpg)
![Page 19: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/19.jpg)
![Page 20: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/20.jpg)
![Page 21: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/21.jpg)
![Page 22: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/22.jpg)
![Page 23: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/23.jpg)
Java SE 7 Updates
0
22.5
45
67.5
90
7u1
7u2
7u3
7u4
7u5
7u6
7u7
7u97u107u117u137u157u177u217u257u407u45
Time since last release
Flurry of exploits
New numbering
9mo of security releases
![Page 24: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/24.jpg)
The OpenJDK landscape looks different this year. Oracle's complete grip on OpenJDK is slowly loosening. They're still the dominant player and perhaps always will be, but things are more level than they were.!!
- Andrew Haley of Red Hat!!
Upon nomination to the OpenJDK governing board for 2013
![Page 25: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/25.jpg)
Truths of OpenJDK
• It is really truly OSS, under GPL+CPE
• You can fork it
• You can distribute builds of it
• You can contribute to it
• Oracle is learning how to do OSS
![Page 26: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/26.jpg)
![Page 27: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/27.jpg)
Java 5 was released September 30, 2004
![Page 28: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/28.jpg)
Java 6 was released December 11, 2006
![Page 29: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/29.jpg)
Java 7 was released July 28, 2011
![Page 30: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/30.jpg)
Java 7 Features
• Strings in switch statements
• More numeric literal forms
• Type inference for generic instances
• try-with-resources statement
• Multiple-catch
![Page 31: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/31.jpg)
static String chooseGreeting(String language) {" switch (language) {" case "Java": return "I love to hate you!";" case "Scala": return "I love you, I think!";" case "Clojure": return "(love I you)";" case "Groovy": return "I love ?: you";" case "Ruby": return "I.love? you # => true";" default: return "Who are you?";" }" }
![Page 32: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/32.jpg)
Java 8 Features
• Lambda expressions
• Type annotations
![Page 33: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/33.jpg)
Java 8 Features
• Lambda expressions • Type annotations
![Page 34: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/34.jpg)
public static void doSort(List<String> input) {" Collections.sort(input,! (a,b)->Integer.compare(a.length(), b.length()));" }" " public static String getInitials(List<String> input) {" return input.stream()" .map(x->x.substring(0,1))" .collect(Collectors.joining());" }
![Page 35: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/35.jpg)
Java 9 Features?
• Modularization?
• Dynamic invocation?
• Value types?
• Reified generics?
• Coroutines? (working patch available!)
• Tail calls? (working patch available!)
![Page 36: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/36.jpg)
Alternative Languages
![Page 37: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/37.jpg)
High-Profile Languages
• Clojure
• Groovy
• Scala
• JRuby
![Page 38: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/38.jpg)
Newcomers
• Kotlin
• Ceylon
• Xtend
• Mirah
![Page 39: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/39.jpg)
Classics
• Jython
• Rhino
• BeanShell
![Page 40: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/40.jpg)
Ported Languages• Ada
• AWK
• BASIC
• BBx
• Boo
• C
• COBOL
• ColdFusion
• Railo
• Open BlueDragon
• Common Lisp
• Component Pascal
• Erlang
• Forth
• Go
• Haxe
• JavaScript
• Logo
• Lua
• Yeti ML
• Oberon-2
• OCaml
• Object Pascal
• PHP
• Prolog
• Python
• R
• REXX
• Ruby
• Scheme
• Smalltalk
• Tcl
![Page 41: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/41.jpg)
New Languages• Alef++
• Ateji PX
• BBj
• BeanShell
• Ceylon
• CAL
• E
• Fantom
• Flow Java.
• Fortress
• Frege
• Frink
• Golo
• Gosu
• Hecl
• Ioke
• KBML
• Kotlin
• Jabaco
• Jaskell
• Jelly
• Join Java
• Joy
• Judoscript
• Libretto.
• Mirah
• N.A.M.E. Basic.
• NetLogo
• Nice
• Noop
• ObjectScript
• PHP.reboot
• Pizza
• Pnuts
• Processing
• Stab
• Sleep
• V
• X10
• Xtend
• Zest
![Page 42: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/42.jpg)
JVM is not just Java
![Page 43: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/43.jpg)
![Page 44: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/44.jpg)
Native Interop
![Page 45: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/45.jpg)
![Page 46: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/46.jpg)
![Page 47: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/47.jpg)
User Code
JNI call
JNI impl
Target Library
Java
C/native
![Page 48: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/48.jpg)
public class GetPidJNI {" public static native long getpid();" " public static void main( String[] args ) {" getpid();" }" " static {" System.load(! System.getProperty("user.dir") +! "/getpidjni.dylib");" }"}
JNI
![Page 49: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/49.jpg)
/* DO NOT EDIT THIS FILE - it is machine generated */"#include <jni.h>"/* Header for class com_headius_jnr_presentation_GetPidJNI */" "#ifndef _Included_com_headius_jnr_presentation_GetPidJNI"#define _Included_com_headius_jnr_presentation_GetPidJNI"#ifdef __cplusplus"extern "C" {"#endif"/*" * Class: com_headius_jnr_presentation_GetPidJNI" * Method: getpid" * Signature: ()J" */"JNIEXPORT jlong JNICALL Java_com_headius_jnr_1presentation_GetPidJNI_getpid" (JNIEnv *, jclass);" "#ifdef __cplusplus"}"#endif"#endif
JNI
![Page 50: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/50.jpg)
#include "com_headius_jnr_presentation_GetPidJNI.h"" "jlong JNICALL Java_com_headius_jnr_1presentation_GetPidJNI_getpid" (JNIEnv *env, jclass c) {" " return getpid();"}
JNI
![Page 51: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/51.jpg)
$ gcc -I $JAVA_HOME/include -I $JAVA_HOME/include/darwin -L $JAVA_HOME/jre/lib/ -dynamiclib -ljava -o getpidjni.dylib com_headius_jnr_presentation_GetPidJNI.c"!$ java -Djava.library.path=`pwd` -cp target/jnr_presentation-1.0-SNAPSHOT.jar com.headius.jnr_presentation.GetPidJNI
JNI
![Page 52: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/52.jpg)
Nobody enjoys calling native libraries...
![Page 53: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/53.jpg)
...but if you have to call native libraries, you
might as well enjoy it.
![Page 54: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/54.jpg)
Java Native Runtime
• Java API
• for calling Native code
• supported by a rich Runtime library
• You may be familiar with JNA
• Foreign Function Interface (FFI)
• https://github.com/jnr
• Maven artifacts for everything
![Page 55: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/55.jpg)
A Java API for binding native libraries and
native memory
![Page 56: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/56.jpg)
Justifications
• NIO, NIO.2
• Native IO, symlinks, FS-walking,
• Unmanaged memory
• Selectable stdio, process IO
• Low-level or other sockets (UNIX, ICMP, ...)
• New APIs (graphics, crypto, OS, ...)
![Page 57: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/57.jpg)
User Code
JNI call
JNI impl
Target Library
Java
C/native
![Page 58: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/58.jpg)
User Code
JNI call
JNI impl
Target Library
Java
C/native
![Page 59: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/59.jpg)
User Code
JNR stub
JNI call
JNI impl
libffi
Target Library
Java
C/native
![Page 60: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/60.jpg)
import jnr.ffi.LibraryLoader;"import jnr.ffi.annotations.IgnoreError;" "public class GetPidJNRExample {" public interface GetPid {" long getpid();" }" " public static void main( String[] args ) {" GetPid getpid = LibraryLoader" .create(GetPid.class)! .load("c");" " getpid.getpid();" }"}
JNR
![Page 61: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/61.jpg)
Layered Runtime
jffi
jnr-ffi
libffi
jnr-posix
jnr-constants
!
jnr-enxio jnr-x86asmjnr-unixsocket
etc etc
![Page 62: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/62.jpg)
JNR Platforms• Darwin (OS X): universal (+ppc?)
• Linux: i386, x86_64, arm, ppc, ppc64, s390x
• Windows: i386, x86_64
• FreeBSD, OpenBSD: i386, x86_64
• SunOS: i386, x86_64, sparc, sparcv9
• AIX: ppc
• OpenVMS, AS/400: builds out there somewhere
• If your platform isn't here, contribute a build
![Page 63: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/63.jpg)
jnr-ffi
• User-oriented API
• Roughly equivalent to what JNA gives you
• Functions, structs, callbacks, memory
• https://github.com/jnr/jnr-ffi
![Page 64: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/64.jpg)
import jnr.ffi.LibraryLoader;"import jnr.ffi.annotations.IgnoreError;" "public class GetPidJNRExample {" public interface GetPid {" long getpid();" }" " public static void main( String[] args ) {" GetPid getpid = LibraryLoader" .create(GetPid.class)! .load("c");" " getpid.getpid();" }"}
jnr-ffi
![Page 65: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/65.jpg)
jnr-posix
• Pre-bound set of POSIX functions
• Mostly driven by what JRuby, Jython use
• Goal: 100% of POSIX bound to Java
![Page 66: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/66.jpg)
public int chmod(String string, int i);"public int chown(String string, int i, int i1);"public int execv(String string, String[] strings);"public int execve(String string, String[] strings, String[] strings1);"public int fork();"public int seteuid(int i);"public int getgid();"public String getlogin();"public int getpgid();"public int getpgid(int i);"public int getpgrp();"public int getpid();"public int getppid();"public Passwd getpwent();!public Passwd getpwuid(int i);!public Passwd getpwnam(String string);"public Group getgrgid(int i);!public Group getgrnam(String string);"public int getuid();!public boolean isatty(FileDescriptor fd);"public int kill(int i, int i1);!public int symlink(String string, String string1);"public int link(String string, String string1);"public String readlink(String string) throws IOException;"public String getenv(String string);"public int setenv(String string, String string1, int i);"public int unsetenv(String string);"public int getpriority(int i, int i1);"public int setpriority(int i, int i1, int i2);"public int setuid(int i);"public FileStat stat(String string);"public int stat(String string, FileStat fs);"public int umask(int i);"public Times times();"public int utimes(String string, long[] longs, long[] longs1);"public int waitpid(int i, int[] ints, int i1);"public int wait(int[] ints);"public int errno();"public void errno(int i);"public int posix_spawnp(String string, List<? extends SpawnFileAction> list, List<? extends CharSequence> list1, List<? extends CharSequence> list2);
![Page 67: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/67.jpg)
POSIX posix = POSIXFactory.getPOSIX(! new MyPOSIXHandler(this)," isNativeEnabled);
![Page 68: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/68.jpg)
public interface POSIXHandler {! public void error(Errno errno, String string);" public void unimplementedError(String string);! public void warn(WARNING_ID wrngd, String string, Object[] os);" public boolean isVerbose();! public File getCurrentWorkingDirectory();! public String[] getEnv();! public InputStream getInputStream();! public PrintStream getOutputStream();! public int getPID();! public PrintStream getErrorStream();"}
![Page 69: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/69.jpg)
jnr-enxio
• Extended Native X-platform IO
• NIO-compatible JNR-backed IO library
• Read, write, select (kqueue, epoll, etc)
• Low-level fcntl control
• https://github.com/jnr/jnr-enxio
![Page 70: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/70.jpg)
public class NativeSocketChannel" extends AbstractSelectableChannel" implements ByteChannel, NativeSelectableChannel {" public NativeSocketChannel(int fd);! public NativeSocketChannel(int fd, int ops);! public final int validOps();! public final int getFD();! public int read(ByteBuffer dst) throws IOException;" public int write(ByteBuffer src) throws IOException" public void shutdownInput() throws IOException;" public void shutdownOutput() throws IOException;!}
![Page 71: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/71.jpg)
jnr-unixsocket
• UNIX sockets for NIO
• Built atop jnr-enxio
• Fully selectable, etc
• https://github.com/jnr/jnr-unixsocket
![Page 72: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/72.jpg)
How Does It Perform?
![Page 73: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/73.jpg)
getpid calls, 100M times
1ms
10ms
100ms
1000ms
10000ms
100000ms
JNA getpid JNR getpid
![Page 74: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/74.jpg)
import jnr.ffi.LibraryLoader;"import jnr.ffi.annotations.IgnoreError;" "public class GetPidJNRExample {" public interface GetPid {" @IgnoreError" long getpid();" }" " public static void main( String[] args ) {" GetPid getpid = LibraryLoader" .create(GetPid.class)! .load("c");" " getpid.getpid();" }"}
@IgnoreError
![Page 75: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/75.jpg)
getpid calls, 100M times
0ms
500ms
1000ms
1500ms
2000ms
JNR getpid JNR getpid @IgnoreError
![Page 76: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/76.jpg)
getpid calls, 100M times
0ms
500ms
1000ms
1500ms
2000ms
JNR getpid JNI JNR @IgnoreError GCC -O3
But There's More to Do
![Page 77: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/77.jpg)
JVM Help is Coming
• Standard FFI API in JDK
• JIT intelligence
• Drop JNI overhead where possible
• Bind native call directly at call site
• Security policies, segv protection, etc
• Time for an FFI JSR
![Page 78: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/78.jpg)
Recap
• OpenJDK is awesome
• Java is evolving
• JVM languages are everywhere
• Even native code is accessible
![Page 79: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/79.jpg)
27 April, 2011
![Page 80: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/80.jpg)
History
• JVM authors mentioned non-Java languages
• Language authors have targeted JVM
• Hundreds of JVM languages now
• But JVM was a mismatch for many of them
• Usually required tricks that defeated JVM optimizations
• Or required features JDK could not provide
![Page 81: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/81.jpg)
What is invokedynamic
![Page 82: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/82.jpg)
JVM Opcodes
Invocation invokevirtual"
invokeinterface"invokestatic"invokespecial
Field Access getfield"setfield"getstatic"setstatic
Array Access *aload"*astore"
b,s,c,i,l,d,f,a
Stack Local VarsFlow Control
AllocationBoolean and Numeric
![Page 83: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/83.jpg)
![Page 84: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/84.jpg)
Goals of JSR 292
• A user-definable bytecode
• Full freedom to define VM behavior
• Fast method pointers + adapters
• Optimizable like normal Java code
• Avoid future modifications
![Page 85: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/85.jpg)
+ Method Pointers
and AdaptersFaster than reflection, with user-defined argument, flow, and exception handling
A User-definable Bytecode
You decide how the JVM implements it
![Page 86: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/86.jpg)
invokedynamicuser-def’d bytecodeinvokedynamic opcode method pointersMethodHandles
![Page 87: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/87.jpg)
VM Operations Method Lookup Type Checking
Branch Method Cache
Method Invocation
Target Object
Object’s Classvoid foo()
static void bar()
instanceof
obj.foo() JVM
void foo()
Call Site
![Page 88: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/88.jpg)
// Static"System.currentTimeMillis()"Math.log(1.0)" "// Virtual""hello".toUpperCase()"System.out.println()" "// Interface"myList.add("happy happy")"myRunnable.run()" "// Special"new ArrayList()"super.equals(other)
![Page 89: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/89.jpg)
// Static"invokestatic java/lang/System.currentTimeMillis:()J"invokestatic java/lang/Math.log:(D)D"!// Virtual"invokevirtual java/lang/String.toUpperCase:()Ljava/lang/String;"invokevirtual java/io/PrintStream.println:()V"!// Interface"invokeinterface java/util/List.add:(Ljava/lang/Object;)Z"invokeinterface java/lang/Runnable.add:()V"!// Special"invokespecial java/util/ArrayList.<init>:()V"invokespecial java/lang/Object.equals:(java/lang/Object)Z
invokestatic
invokevirtual
invokeinterface
invokespecial
![Page 90: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/90.jpg)
invokestatic"1. Confirm arguments are of correct type 2. Look up method on Java class 3. Cache method 4. Invoke method
invokevirtual"1. Confirm object is of correct type 2. Confirm arguments are of correct type 3. Look up method on Java class 4. Cache method 5. Invoke method
invokeinterface"1. Confirm object’s type implements interface 2. Confirm arguments are of correct type 3. Look up method on Java class 4. Cache method 5. Invoke method
invokespecial"1. Confirm object is of correct type 2. Confirm arguments are of correct type 3. Confirm target method is visible 4. Look up method on Java class 5. Cache method 6. Invoke method
invokestatic
invokevirtual
invokeinterface
invokespecialinvokedynamic!1. Call bootstrap handle (your code) 2. Bootstrap prepares CallSite + MethodHandle 3. MethodHandle invoked now and future (until CallSite changes)
![Page 91: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/91.jpg)
method handles
invokedynamic bytecode
bootstrap method
target method
![Page 92: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/92.jpg)
How Do You Benefit?
![Page 93: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/93.jpg)
Indy Languages
• New language impls
• JavaScript: Dyn.js and Nashorn
• Redline Smalltalk
• Improved language performance
• JRuby, Groovy, Jython
• Java features too!
![Page 94: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/94.jpg)
Times Faster than Ruby 1.9.3
0
1.25
2.5
3.75
5
base64 richards neural redblack
4.32
3.663.44
2.658
1.565
1.914
1.5381.346
JRuby/Java 6 JRuby/Java 7
![Page 95: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/95.jpg)
red/black tree, pure Ruby versus native
ruby-2.0.0 + Ruby
ruby-2.0.0 + C ext
jruby + Ruby
Runtime per iteration
0 0.75 1.5 2.25 3
0.29s
0.51s
2.48s
![Page 96: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/96.jpg)
Caveat Emptor
• Indy was really slow in first Java 7 release
• Got fast in 7u2...and turned out broken
• Rewritten for 7u40
• Slow to warm up
• Still some issues (memory use, etc)
• Java 8 due in March…
![Page 97: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/97.jpg)
Feeling Helpless?
![Page 98: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/98.jpg)
Out of our control Written in C++
JVM Bytecode
JVM Language
Bytecode Interpreter
Bytecode JIT
Native Code
![Page 99: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/99.jpg)
What If…
• The JVM’s JIT optimizer were written in Java
• You could customize how the JIT works for your language or library
• JITed code could directly make native calls
![Page 100: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/100.jpg)
Graal
• A 100% Java-based JIT framework
• Grew out of the 100% Java “Maxine” JVM
• Backends to assembly or HotSpot IR
• Directly control code generation
• Build a language without using JVM bytecode
• http://openjdk.java.net/projects/graal/
![Page 101: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/101.jpg)
Graal Intermediate
Representation
JVM Language
Graal Optimizer
Native Code
Your Transformations
Your Optimizations
Plain Java APIs
Under your control
![Page 102: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/102.jpg)
However…
• Not everyone is a compiler writer
• Graal’s IR is low-level and nontrivial
• Need to understand JVM internals
• Need some understanding of CPU
![Page 103: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/103.jpg)
The Dream
• Design your language
• ???
• PROFIT
![Page 104: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/104.jpg)
Without JVM
• Design your language
• Work out memory model
• Create an optimizing compiler
• Spend ten years debugging it
• PROFIT
![Page 105: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/105.jpg)
With JVM
• Design your language
• Maybe write an interpreter
• Compile to JVM bytecode
• Pray that the JVM optimizes it right
• PROFIT
![Page 106: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/106.jpg)
What We Want
• Design your language
• ???
• PROFIT
![Page 107: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/107.jpg)
What We Want
• Design your language
• Write an interpreter
• PROFIT
![Page 108: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/108.jpg)
Truffle
• Language framework built on Graal
• Designed to fulfill the dream
• Implement interpreter
• Truffle feeds that to backend
• No compiler expertise needed
• https://wiki.openjdk.java.net/display/Graal/Truffle+FAQ+and+Guidelines
![Page 109: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/109.jpg)
Traditional Approach
Any JVM
Custom made bytecode compiler
Guest Language
AST interpreter in pure Java
Bytecode emitted by guest language
![Page 110: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/110.jpg)
Truffle Atop JVM
Any JVM
Truffle
Guest Language
AST interpreter in pure Java
Bytecode based on interpreter flow
![Page 111: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/111.jpg)
Truffle Atop Graal
Graal JVM
Truffle
Guest Language
AST interpreter in pure Java
Direct access to compiler internals, IR, machine code cache, on stack replacement, etc etc
![Page 112: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/112.jpg)
![Page 113: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/113.jpg)
![Page 114: Beyond JVM - YOW Melbourne 2013](https://reader033.fdocuments.net/reader033/viewer/2022052522/554fb967b4c9050e7d8b4790/html5/thumbnails/114.jpg)
The Final Word
• JVM is a powerful platform
• Java and other languages are evolving
• The JVM is adapting to our needs
• New tools breaking JVM’s boundaries