H igh Performance Machine Learning Using Java
description
Transcript of H igh Performance Machine Learning Using Java
High Performance Machine Learning Using JavaH
1x1x
1
1x1x
2
1x2x
1
1x1x
4
1x4x
1
1x1x
8
1x2x
4
1x4x
20
5
10
15
20
25
30
C# MPI.NETJava OpenMPI
TxPxN
Tim
e (
hours
)
MPI Allreduce (top) and Ping-Pong (bottom) Benchmarks with Infiniband
1 2 4 81
1.5
2
2.5
3
3.5
4
4.5
5
5.5
C# MPI.NET
Parallelism
Speedup
1 2 4 8 16 32 64128
2560
0.5
1
1.5
2
2.5
3
3.5
4
4.5
Parallelism
Tim
e (h
ours
)
1 2 4 8 16 32 64 1282561
21
41
61
81
101 Java OpenMPI
Parallelism
Spee
dup
Java OpenMPI
Deterministic Annealing Pairwise Clustering Performance
4B
16
B
64
B
25
6B
1K
B
4K
B
16
KB
64
KB
25
6K
B
1M
B
4M
B
5
50
500
5000
50000C# MPI.NET
Java FastMPJ
Message size (bytes)
Tim
e (u
s)0
B
2B
8B
32
B
12
8B
51
2B
2K
B
8K
B
32
KB
12
8K
B
51
2K
B
1
10
100
1000
10000
C# MPI.NET
Java FastMPJ
Message size (bytes)
Tim
e (u
s)
1x1x
1
1x1x
2
1x2x
1
1x1x
4
1x4x
1
1x1x
8
1x2x
4
1x4x
2
1x8x
10
0.2
0.4
0.6
0.8
1
1.2
C# MPI.NETJava OpenMPI
TxPxN
Tim
e (
hours
)
1 2 4 81
1.5
2
2.5
3
3.5
4
4.5
5
5.5
6
C# MPI.NET
Parallelism
Speedup
Deterministic Annealing Vector Sponge Charge5 (left) and Charge2 (right) Performance