WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes...

13
WITH INTEL TECHNOLOGIES

Transcript of WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes...

Page 1: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);

WITH INTEL TECHNOLOGIES

Page 2: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);

Commitment Is to Enable The Best

Democratizetechnologies

Advancesolutions

Unleashinnovations

Page 3: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);

Intel Xeon® Scalable Processor Family Delivers Ideal Enterprise Solutions

NEW Intel Xeon Scalable

Processor Family provides the ideal foundation for hybrid cloud.

NEW Intel Xeon Scalable

Processor Family runs more complex data analytics & AI faster and supports more customers and users.

NEW Intel Xeon Scalable

Processor Family integrates and extends Intel Run Sure mission-critical reliability features for the enterprise

Page 4: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);

Software Optimization

Up to4.3X

Software optimization

Up to5.6X

Intel® Xeon ® Scalable processor

Up to2.7X

Democratizing Technologies fordata Analytics

+BIG DATA DECISION

SUPPORT WORKLOADHBASE OFF-HEAP READ MLLIB* THRU INTEL MATH

KERNEL LIBRARY

*Other names and brands may be claimed as the property of othersSee optimization notice & configurations on legal notices in the backup slides

Page 5: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);

libraries Intel® MKL MKL-DNN Intel® MLSL

toolkits

Frameworks

Intel® DAAL

hardwareMemory/Storage NetworkingCompute

Intel DistributionIntel® Nervana™ Graph*

experiences

Intel® Nervana™ DL Software &

Cloud

Computer Vision*Future

Intel® DL Training &

Deployment

Intel® Computer Vision SDK

Movidius Fathom

Intel® GO™ Automotive

SDK

*

Mllib BigDL

AI ON INTEL: UNLEASHING THE NEXT WAVE

Democratizing Technologies for AI

Page 6: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);

Distributed data

Lower TCO

High Performance

ADVANCE Solutions for New NEEDS(DEEP LEARNING)

Efficient Scalability

Page 7: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);

BigDLANSWERING THE NEW NEEDS

Working with Xeon clusters

Feature Parity with Caffe* and Torch*

Drives Spark/Hadoop as Unified Data Analytics Platform, Giving Easy Experience and Lower TCO

Deep Learning on Big Data Platform, Enabling Efficient Scale-Out

High Performance at Single-Node

Data Frame

SQL SparkR Streaming

ML Pipeline

MLlib GraphX BigDL

Spark Core

*Other names and brands may be claimed as the property of others

Page 8: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);

FEATURES RELEASED EOQ1:

Python Support

Notebook Integration

Tensorboard Support

Better RNN Support

Improved Robustness

Bigdl: What’s New?COMING OUT EOQ2:

3D Convolutions

Tensorflow Model Read/Write

Recursive Net Support

Spark 2.1 Support

Python 3.5 Support

Functional API support

Developer Centric Zone: software.intel.com/bigdl

Page 9: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);

UNLEASH Innovation for New Use cases

MANUFACTURING

DEFECT RECOGNITION

FINANCIAL SERVICES

FRAUD DETECTION

Page 10: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);

BigDL READY FOR WIDE ADOPTION

Page 11: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);

Software.intel.com/BigDL

Software.intel.com/AIINTEL BOOTH: 11

We know the future Because We’re building it

Page 12: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);
Page 13: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);

Legal notices & Disclaimers• Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Learn

more at intel.com, or from the OEM or retailer.

• No computer system can be absolutely secure.

• Tests document performance of components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. Consult other sources of information to evaluate performance as you consider your purchase. For more complete information about performance and benchmark results, visit http://www.intel.com/performance.

Configurations: • Up to 4.3X for Spark MLlib thru Intel Math Kernel Library (MKL)

• Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads); 256 GB ; 10x SSDs; 10Gbps NIC

• Up to 5.6x for HBase off heaping read in micro workload (PE) • same for before and after: Intel® Xeon® Processor X5670 @ 2.93Hz *2 (6 cores, 12 threads); RAM: 150 GB; 1Gbps NIC

• Up to 2.7x in Big Data Decision Support Workload• Before: Intel® Xeon® Processor E5-2699 v4 @ 2.20Hz *2 (22 cores, 44 threads); 384 GB; 8x SSDs; 10Gbps NIC; Apahce Hive 2.0.0; Apache

Spark 1.6.3; Apache Hadoop 2.7.3• After: : Intel® Xeon® Platinum 8160 @ 2.10Hz *2 (24 cores, 48 threads); 384 GB; 8x SSDs; 10Gbps NIC; Apahce Hive 3.0.0-SNAPSHOT

commit id 3330403a7dea206c85828dfd5319a7ae0d9bcef5; Apache Spark 2.0.2; Apache Hadoop 2.7.3

Intel, the Intel logo, Xeon, Xeon phi, Atom, Core, Nervana, Iris, RealSense, GO, etc. are trademarks of Intel Corporation in the U.S. and/or other countries. *Other names and brands may be claimed as the property of others.© 2017 Intel Corporation