©¢°­¦ç’ƒ©‚¤ƒ•‚™ƒ©ƒ€ŒSpark...

download ©¢°­¦ç’ƒ©‚¤ƒ•‚™ƒ©ƒ€ŒSpark MLlib€¦‚™½œ‚‹ ‚¢ƒ‹ƒƒ¬‚³ƒƒ³ƒˆ‚™‚·‚¹ƒ†ƒ 

of 19

Embed Size (px)

Transcript of ©¢°­¦ç’ƒ©‚¤ƒ•‚™ƒ©ƒ€ŒSpark...

Spark MLlibIT

IT IT

11

C897

GMO

ITAPI

IT()

ITAI

http://tv-anime.biz/

tippy

Anime API

Wikipedia

Anime API

Anime API

HadoopMapReduce(DAG)HadoopHadoopAPIScala, Java, Python

Spark

SparkAssociation RuleSpark

Spark MLlib

TwitterStreamingAPI43CSV1G1500status.getId() status.getUser().getScreenName()status.getText()status.getSource()status.getRetweetCount()status.getFavoriteCount()status.getCreatedAt()Twitter

UserNameTweettanakamikatanakadakenmika

UserIDProductRate112221231321

BigQuery(AmazonMLAzureMLSparkMLlibUserIDIntTwitterID

80Twitter x 43 (2015)3440MySQLMLlibUserIDProductIDRate3547962421.8322849817902473354796243-2.56664376726443783547962440.3851255542967643547962450.9550722901486512

IT