WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes...
Transcript of WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes...
![Page 1: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);](https://reader030.fdocuments.net/reader030/viewer/2022040608/5ec5e8b058b9785858481d5c/html5/thumbnails/1.jpg)
WITH INTEL TECHNOLOGIES
![Page 2: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);](https://reader030.fdocuments.net/reader030/viewer/2022040608/5ec5e8b058b9785858481d5c/html5/thumbnails/2.jpg)
Commitment Is to Enable The Best
Democratizetechnologies
Advancesolutions
Unleashinnovations
![Page 3: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);](https://reader030.fdocuments.net/reader030/viewer/2022040608/5ec5e8b058b9785858481d5c/html5/thumbnails/3.jpg)
Intel Xeon® Scalable Processor Family Delivers Ideal Enterprise Solutions
NEW Intel Xeon Scalable
Processor Family provides the ideal foundation for hybrid cloud.
NEW Intel Xeon Scalable
Processor Family runs more complex data analytics & AI faster and supports more customers and users.
NEW Intel Xeon Scalable
Processor Family integrates and extends Intel Run Sure mission-critical reliability features for the enterprise
![Page 4: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);](https://reader030.fdocuments.net/reader030/viewer/2022040608/5ec5e8b058b9785858481d5c/html5/thumbnails/4.jpg)
Software Optimization
Up to4.3X
Software optimization
Up to5.6X
Intel® Xeon ® Scalable processor
Up to2.7X
Democratizing Technologies fordata Analytics
+BIG DATA DECISION
SUPPORT WORKLOADHBASE OFF-HEAP READ MLLIB* THRU INTEL MATH
KERNEL LIBRARY
*Other names and brands may be claimed as the property of othersSee optimization notice & configurations on legal notices in the backup slides
![Page 5: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);](https://reader030.fdocuments.net/reader030/viewer/2022040608/5ec5e8b058b9785858481d5c/html5/thumbnails/5.jpg)
libraries Intel® MKL MKL-DNN Intel® MLSL
toolkits
Frameworks
Intel® DAAL
hardwareMemory/Storage NetworkingCompute
Intel DistributionIntel® Nervana™ Graph*
experiences
Intel® Nervana™ DL Software &
Cloud
Computer Vision*Future
Intel® DL Training &
Deployment
Intel® Computer Vision SDK
Movidius Fathom
Intel® GO™ Automotive
SDK
*
Mllib BigDL
AI ON INTEL: UNLEASHING THE NEXT WAVE
Democratizing Technologies for AI
![Page 6: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);](https://reader030.fdocuments.net/reader030/viewer/2022040608/5ec5e8b058b9785858481d5c/html5/thumbnails/6.jpg)
Distributed data
Lower TCO
High Performance
ADVANCE Solutions for New NEEDS(DEEP LEARNING)
Efficient Scalability
![Page 7: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);](https://reader030.fdocuments.net/reader030/viewer/2022040608/5ec5e8b058b9785858481d5c/html5/thumbnails/7.jpg)
BigDLANSWERING THE NEW NEEDS
Working with Xeon clusters
Feature Parity with Caffe* and Torch*
Drives Spark/Hadoop as Unified Data Analytics Platform, Giving Easy Experience and Lower TCO
Deep Learning on Big Data Platform, Enabling Efficient Scale-Out
High Performance at Single-Node
Data Frame
SQL SparkR Streaming
ML Pipeline
MLlib GraphX BigDL
Spark Core
*Other names and brands may be claimed as the property of others
![Page 8: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);](https://reader030.fdocuments.net/reader030/viewer/2022040608/5ec5e8b058b9785858481d5c/html5/thumbnails/8.jpg)
FEATURES RELEASED EOQ1:
Python Support
Notebook Integration
Tensorboard Support
Better RNN Support
Improved Robustness
Bigdl: What’s New?COMING OUT EOQ2:
3D Convolutions
Tensorflow Model Read/Write
Recursive Net Support
Spark 2.1 Support
Python 3.5 Support
Functional API support
Developer Centric Zone: software.intel.com/bigdl
![Page 9: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);](https://reader030.fdocuments.net/reader030/viewer/2022040608/5ec5e8b058b9785858481d5c/html5/thumbnails/9.jpg)
UNLEASH Innovation for New Use cases
MANUFACTURING
DEFECT RECOGNITION
FINANCIAL SERVICES
FRAUD DETECTION
![Page 10: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);](https://reader030.fdocuments.net/reader030/viewer/2022040608/5ec5e8b058b9785858481d5c/html5/thumbnails/10.jpg)
BigDL READY FOR WIDE ADOPTION
![Page 11: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);](https://reader030.fdocuments.net/reader030/viewer/2022040608/5ec5e8b058b9785858481d5c/html5/thumbnails/11.jpg)
Software.intel.com/BigDL
Software.intel.com/AIINTEL BOOTH: 11
We know the future Because We’re building it
![Page 12: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);](https://reader030.fdocuments.net/reader030/viewer/2022040608/5ec5e8b058b9785858481d5c/html5/thumbnails/12.jpg)
![Page 13: WITH INTEL TECHNOLOGIES - Huodongjia.com · • Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads);](https://reader030.fdocuments.net/reader030/viewer/2022040608/5ec5e8b058b9785858481d5c/html5/thumbnails/13.jpg)
Legal notices & Disclaimers• Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Learn
more at intel.com, or from the OEM or retailer.
• No computer system can be absolutely secure.
• Tests document performance of components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. Consult other sources of information to evaluate performance as you consider your purchase. For more complete information about performance and benchmark results, visit http://www.intel.com/performance.
Configurations: • Up to 4.3X for Spark MLlib thru Intel Math Kernel Library (MKL)
• Spark-Perf (same for before and after): 9 nodes each with Intel® Xeon® processor E5-2697A v4 @ 2.60GHz * 2 (16 cores, 32 threads); 256 GB ; 10x SSDs; 10Gbps NIC
• Up to 5.6x for HBase off heaping read in micro workload (PE) • same for before and after: Intel® Xeon® Processor X5670 @ 2.93Hz *2 (6 cores, 12 threads); RAM: 150 GB; 1Gbps NIC
• Up to 2.7x in Big Data Decision Support Workload• Before: Intel® Xeon® Processor E5-2699 v4 @ 2.20Hz *2 (22 cores, 44 threads); 384 GB; 8x SSDs; 10Gbps NIC; Apahce Hive 2.0.0; Apache
Spark 1.6.3; Apache Hadoop 2.7.3• After: : Intel® Xeon® Platinum 8160 @ 2.10Hz *2 (24 cores, 48 threads); 384 GB; 8x SSDs; 10Gbps NIC; Apahce Hive 3.0.0-SNAPSHOT
commit id 3330403a7dea206c85828dfd5319a7ae0d9bcef5; Apache Spark 2.0.2; Apache Hadoop 2.7.3
Intel, the Intel logo, Xeon, Xeon phi, Atom, Core, Nervana, Iris, RealSense, GO, etc. are trademarks of Intel Corporation in the U.S. and/or other countries. *Other names and brands may be claimed as the property of others.© 2017 Intel Corporation