¯ƒ‘‚ 14th LT Spark¨MLlib¨‚—

download ¯ƒ‘‚ 14th LT Spark¨MLlib¨‚—

of 11

  • date post

    25-Jun-2015
  • Category

    Technology

  • view

    939
  • download

    3

Embed Size (px)

description

第14回はじめてのパターン認識勉強会 LT 2014/3/18

Transcript of ¯ƒ‘‚ 14th LT Spark¨MLlib¨‚—

  • 1. Spark MLlib SP 14th LT 2014.3.18

2. Who are Yamakatu ? yamakatu() : gihyo.jp 3. Whats Spark ? 2014/2/27 ApacheTop Level Project Hadoop 4. Whats Hadoop ? MapReduce HDFS Hadoop HDFS MapReduce HDFS MapReduce HDFS MapReduce 5. MapReduce Map1 Map2 Map3 Reduce1 Reduce2 HDFSHDFS Shuffle 6. Weak point of Hadoop 3. 4. K-Means 1 HDFSMapShuffleReduceHDFS Disk I/O HDFS 7. Spark Spark Disk I/O K-Means Disk Read1 Disk Write1 RDD(Resillient Distributed Datasets) 8. Hadoop vs. Spark + Mllib Hadoop () :150 ADMM15 9. Whats MLlib SparkMachine Learning library Linear SVM Linear Regression Ridge Regression K-Means ALS 10. Spark EC2 spot instance Blog 11.