データサイエンティストスキルチェックシート（抜粋版）

108-0071 3-2-10

Tel03-6721-9001 Fax050-3153-1219

www.datasc ient ist .or . jp

2015 11 20

12

2015

IoT

2013

12

108-0071 3-2-10

Tel03-6721-9001 Fax050-3153-1219


Div. Div.

108-0071 3-2-10

Tel03-6721-9001 Fax050-3153-1219


2015

//

4 1

Senior Data Scientist

Full Data Scientist

Associate Data Scientist

Assistant Data Scientist

108-0071 3-2-10

Tel03-6721-9001 Fax050-3153-1219


Full Data Scientist 50%Associate

Data Scientist 60%Assistant Data Scientist 70%

2014 12 10

http://www.datascientist.or.jp/news/2014/pdf/1210.pdf

business problem

solvingdata science

data engineering

business problem solving

data science

data engineering

http://www.datascientist.or.jp/news/2014/pdf/1210.pdf

108-0071 3-2-10

Tel03-6721-9001 Fax050-3153-1219


Source: The Japan Data Scientist Society discussios

(business problem

solving)

(data science)

(data engineering)

Source: The Japan Data Scientist Society discussios

108-0071 3-2-10

Tel03-6721-9001 Fax050-3153-1219


108-0071 3-2-10

Tel03-6721-9001 Fax050-3153-1219


2015 11

CSO

ALBERT

SAS Institute Japan

108-0071 3-2-10

Tel03-6721-9001 Fax050-3153-1219


http://www.datascientist.or.jp/

IT

2015 1150 6

3,050

2013 5

TEL: 03-6721-9001 e-mail: [email protected]

TEL: 03-6721-9001 e-mail: [email protected]

http://www.datascientist.or.jp/mailto:[email protected]:[email protected]

business problem solving data science data engineering

Senior

Data Scientist

-

-

-

-

-

-

-

-

Full

Data Scientist


///IT


Associate

Data Scientist

-

-

-

Full Data Scientist


-

-

-2t

-

-

-

-

-

Full

Data Scientist


-

-

-Hadoop

-SQL

-

Assistant

Data Scientist

-

-

-

-

-

-

-

-

-

-

-

-

-

-/

-ER

-SDKAPI

-

-SQLSELECT

-

-

-

(3)

DS

ExcelAccess

ver 1.00 (as of 11/13/2015) Copyright 2015 The Japan DataScientist Society. All Rights Reserved

1 14 1 19

180 2 16 119 2 12

3 / 11 3 11

4 13 4 16

5 11 5 13

6 4 6 13

7 8 7 20

8 Data visualization 36 8 IT 15

9 19 1 11

10 7 123 2 18

11 10 3 20

12 6 4 26

13 5 5 6

14 3 6 10

16 3 7 4

17 4 8 8

18 / 3 9 20

19 7 422

Associate Data Scientist 60%

Assistant Data Scientist 70%

Full Data Scientist 50%

Assistant Data Scientist~ Full Data

Scientist

Senior Data Scientist

ver 1.00 (as of 11/13/2015) Copyright 2015 The Japan DataScientist Society. All Rights Reserved.

Total 180

54

68

58

NoSub

No

1 1 1+4+9+16+25+36

2 2 logax

3 3 PCn

4 4

5 5

6 6 3,4,5,5,7,8

7 7

8 8

9 9

10 10

11 11

12 12 5

13 13

14 1

15 2

16 3

17 4

18 5

19 6 CHAIDC5.0

20 7

21 8

22 9

23 10

24 11

25 12

26 13

2

27 14

28 15

29 16

30 1 / /

1/20


NoSub

No

31 2 / /

32 3 / / 12p

33 4 / /

34 5 / /

35 6 / /

36 7 / / t2

37 8 / /

38 9 / /U

2

39 10 / /

40 11 / /

41 1

42 2

43 3 -

44 4

45 5

46 6

Ward

47 7 cos

48 8

49 9 k-means

50 10 1-cos

51 11 k-meansx-meansk-means++k-means

52 12

k-meansk-means

53 13

SOMAffinity Propagation

54 1

55 2

56 3 2

57 4

58 5

59 6

60 7

61 8

62 9 3

2/20


NoSub

No

63 10

64 11

65 1

66 2

67 3

68 4

69 1

70 2

71 3

72 4

73 5

74 6

75 7

76 8

77 1 Data visualization









86 10 Data visualization PCA

13



13






3/20


NoSub

No


Y0


96 20 Data visualization 13



99 23 Data visualization 13


101 25 Data visualization GPS

102 26 Data visualization Eye tracking








110 34 Data visualization DM


112 36 Data visualization /

113 1 Random Forest3

114 2

115 3

116 4 RandomForest

117 5 ROC

118 6

119 7

120 8

121 9

Random Forest

122 10

123 11

124 12

125 13

Random Forest

4/20


NoSub

No

126 14 Deep Learning

127 15

128 16

129 17

130 18

131 19

132 1

133 2

134 3

ARIMASARIMA

135 4

136 5

137 6

138 7 Fast Fourier Transform

139 1

140 2

141 3 TF-IDFcos

142 4 PrecisionRecallF

143 5

144 6 N-gram

145 7

146 8 TrieSuffix Array

147 9 LSA

148 10

149 1

150 2

151 3

152 4

153 5

154 6

155 1

156 2

157 3

158 4

5/20


NoSub

No

159 5

160 1 XY

161 2

162 3

163 1

164 2

165 3 SEM

166 1

167 2

168 3

169 4

170 5

171 1/

/

Agent

172 2/

/

173 3/

/

174 1

175 2

176 3

Brute-force searchgreedy algorithm

GATSSA

177 4

178 5

179 6

180 7 A/B

6/20


Total 119

39

43

37

NoSub

No

1 1 110

2 2

3 3

4 4

5 5

6 6

7 7

8 8 Excel

9 9 Excel

10 10 HTTPAPI

11 11 RDBMSNoSQLETLVisualization

12 12

13 13

HiveImpalaSpark

14 14

CRMweb

15 15

16 16 KVS

17 17

18 18

19 19

20 1 SDKAPI

21 2 iOSAndroidHEMS

22 3 iOSAndroid

HEMS

23 4

24 5

25 6

26 7 HTTPFTPSSH

27 8

28 9

29 10

30 11

7/20ver 1.00 (as of 11/13/2015)

Copyright 2015 The Japan DataScientist Society. All Rights Reserved.

NoSub

No

31 12

32 1

33 2 ER

34 3

35 4

DWH

36 5

37 6

ER

38 7

ID

39 8 SQL

40 9

41 10 DWHDB

42 11

43 1 DWHDWHOracle ExadataIBM Pure Data/Netezza

Teradata

44 2 DWHDWHOracle ExadataIBM Pure Data/Netezza

Teradata

45 3 HadoopMapReducePigHive

Hadoop

46 4 HadoopHadoop

47 5 KVS

KVS

48 6 RDBMSOracle RACIBM Pure Scale

49 7 Hadoop

50 8

NoSQLHBaseCassandraAmazon DynamoDBC

oudantAzure DocumentDBAPI

51 9 Amazon S3Google Cloud Storage

Softlayer Obect Storage

52 10 DWHAmazon RedshiftGoogle BigQuery

53 11

54 12 memcached

55 13

CEP

56 14

Storm

57 15

SparkTez

58 16 DB

DBDB

59 1

60 2

61 3

8/20ver 1.00 (as of 11/13/2015)


NoSub

No

62 4

UNION

63 5 NULL

64 6

65 7

66 8

67 9

68 10

69 11

70 12

71 13

72 1 CSVXMLExcel

73 2 DB

74 3 Web APIRESTWebSOAP

75 4 PDFPostScript

76 5 BITableauQlikViewPowerBICognosSAS

DB

77 6

Web

78 7 RSSRDF

79 8 Web APIRESTWebSOAP

80 9 FTP

Excel

81 10 BITableauQlikViewPowerBICognosSAS

82 11 BI

83 12 ETL

84 13 ESBEAI

85 1 CSVRDB

86 2 JSONXMLAPI

87 3

88 4

89 5

C

Python

90 6 GPUGPGPU

91 7

luigi

92 8 iOSAndroidHEMS

9/20ver 1.00 (as of 11/13/2015)


NoSub

No

93 9 SNS

94 10

95 11

96 12 CEP

97 13 SQLSQLSELECT2

WHERESELECT

98 14 SQL

SQLDMLDDL

JOINGROUP BYCASE

EXISTS

99 15 SQLRDB

100 16 SQL

NN

SQL

101 17 SQL

SQLSQL

102 18 Pig/Hive Hive

103 19 Pig/HivePig

104 20 Pig/Hive HivePigUDF

105 1 IT 3

106 2 IT k-

107 3 IT

108 4 IT

109 5 IT DoS

110 6 IT

111 7 IT SQL

112 8 IT

113 9 IT IDS)

114 10 IT

115 11 IT

116 12 IT

117 13 IT

118 14 IT SSHSSL/TLS

119 15 IT DESAESRC4Kerberos

10/20ver 1.00 (as of 11/13/2015)


Total 123

30

49

44

NoSub

No

1 1

2 2

3 3

4 4

5 5

6 6

7 7

8 8

9 9

10 10

11 11

12 1 MECE

13 2 MECE

14 3 MECE

15 4

16 5

17 6

18 7

19 8

20 9

21 10

22 11

So What?Why So?

23 12

24 13 1

25 14 1020&5

26 15 3050&10

27 16

28 17

29 18

30 1

11/20ver 1.00 (as of 11/13/2015)


NoSub

No

31 2

32 3 KPI

KPI

33 4 KPI

KPI

34 5 KPI KPIKPI

35 6

36 7

37 8

38 9

5CRMRFM

39 10

40 11

41 12

42 13

43 14

44 15

45 16

46 17

47 18

48 19

49 20

50 1

51 2

0

52 3

53 4

54 5

55 6

56 7

57 8

58 9

59 10

60 11

61 12

62 13

12/20ver 1.00 (as of 11/13/2015)


NoSub

No

63 14

64 15

65 16

66 17

67 18

68 19

69 20

70 21

ER

71 22

72 23

73 24

74 25

75 26

76 1

77 2

78 3

79 4

80 5

81 6

IoT

82 1

83 2

84 3

85 4

86 5

87 6

88 7

89 8

90 9

91 10

92 1

13/20ver 1.00 (as of 11/13/2015)


NoSub

No

93 2

94 3

95 4

96 1

97 2

98 3

99 4

100 5

101 6

102 7 PDCA

103 8

104 1

DDoS

CSIRT

105 2

106 3

107 4

108 5 5

109 6

110 7

111 8

112 9

113 10

114 11

115 12 /

116 13 /

117 14 /

118 15 /

119 16 /

120 17

121 18

122 19

14/20ver 1.00 (as of 11/13/2015)


NoSub

No

123 20

15/20ver 1.00 (as of 11/13/2015)


NO

(PCA)13

ALBERT WEB

http://www.albert2005.co.jp/analyst_blog/?p=1214

NII Today66 26126

http://www.nii.ac.jp/userdata/results/pr_data/NII_Today/66/all.pdf

()

solutions-2WEB

http://www.solutions2.be/Books.aspx

Data visualization

19

13

10

16/20


NO

Data visualization

13()

Amit Agarwal Digital InspirationWEB

http://www.labnol.org/software/find-right-chart-type-for-your-data/6523/

()

WEB

http://www.census.gov/dataviz/visualizations/055/

13()

Data-Driven DocumentsWEBhttp://mbostock.github.io/d3/talk/20111116/iris-splom.html

WEB

http://user.keio.ac.jp/~yun/projects/cpc/index-j.html

20

21

23

17/20


NO

Data visualization

ALBERT WEB

http://www.albert2005.co.jp/technology/images/tech_mining_img106.jpg

Cytoscape.js WEBWine & cheese

http://cytoscape.github.io/cytoscape.js/demos/cde4db55e581d10405f5/

GPS

A WORLD OF TWEETSWEB

http://aworldoftweets.frogdesign.com/

24

24

25

Wine

Cheese

18/20


NO

Data visualization

(Eye tracking)

Imperial College London WEB

https://www1.imperial.ac.uk/cpssq/ms/m/

James YoderStuff in SpaceWEB

http://stuffin.space/

()

Kaspersky Lab CYBERTHREAT REAL-TIME MAPWEB

https://cybermap.kaspersky.com/

29

26

28

19/20


NO

Data visualization

()

Cameron BeccarioearthWEB

http://earth.nullschool.net/jp/#2015/09/09/1200Z/wind/surface/level/overlay=total_precipitable_water/ortho

graphic=-224.70,38.05,3000/grid=on

29

20/20


1120_v2__3_20151118_21__3_20151118_1

_v2

データサイエンティストスキルチェックシート（抜粋版）

Data & Analytics

Transcript of データサイエンティストスキルチェックシート（抜粋版）

データサイエンティスト スキルチェックシート（抜粋版）

Data & Analytics

Transcript of データサイエンティスト スキルチェックシート（抜粋版）

データサイエンティストスキルチェックシート（抜粋版）

Transcript of データサイエンティストスキルチェックシート（抜粋版）