Tokyo webmining 2017-10-28
-
Upload
kimikazu-kato -
Category
Technology
-
view
2.540 -
download
0
Transcript of Tokyo webmining 2017-10-28
![Page 1: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/1.jpg)
2017 10 28 Web
![Page 2: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/2.jpg)
![Page 3: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/3.jpg)
Twitter: @hamukazu
Python 5
![Page 4: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/4.jpg)
EC ASP
![Page 5: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/5.jpg)
• Scipy/Numpy
•
•
•
•
![Page 6: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/6.jpg)
•
•
•
![Page 7: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/7.jpg)
scikit-learn TensorFlow
•
•
•
•
•
![Page 8: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/8.jpg)
Python
•Numpy
• Cython
![Page 9: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/9.jpg)
s = 0 for i in range(1, 100000001):
s += i print(s)
1 1
![Page 10: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/10.jpg)
s = sum(range(1, 100000001)) print(s)
![Page 11: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/11.jpg)
import numpy as np a = np.arange(1, 100000001, dtype=np.int64) print(a.sum())
![Page 12: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/12.jpg)
s = 0 for i in range(1, 100000001):
s += i print(s)
s = sum(range(1, 100000001)) print(s)
import numpy as np a = np.arange(1, 100000001, dtype=np.int64) print(a.sum())
30.21
12.33
0.38
![Page 13: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/13.jpg)
Numpy
• Numpy
• Numpy
•
![Page 14: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/14.jpg)
Cython
• Python C
•
• Numpy
![Page 15: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/15.jpg)
Cythondef prime(n): p = [True] * (n + 1) m = 2 while m < n + 1: if p[m]: i = m * 2 while i < n + 1: p[i] = False i += m m += 1 i = n while not p[i]: i -= 1 return i
n
p(10000000)
Python 4.75 Cython 3.04
![Page 16: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/16.jpg)
def prime(n): p = [True] * (n + 1) m = 2 while m < n + 1: if p[m]: i = m * 2 while i < n + 1: p[i] = False i += m m += 1 i = n while not p[i]: i -= 1 return i
def prime(int n): cdef int i, m p = [True] * (n + 1) m = 2 while m < n + 1: if p[m]: i = m * 2 while i < n + 1: p[i] = False i += m m += 1 i = n while not p[i]: i -= 1 return i
3.04 3.04
![Page 17: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/17.jpg)
def prime(int n): cdef int m, i cdef int * p = <int * >malloc((n + 1) * sizeof(int)) for i in range(n + 1): p[i] = 1 m = 2 while m < n + 1: if p[m]: i = m * 2 while i < n + 1: p[i] = 0 i += m m += 1 i = n while not p[i]: i -= 1 free(p) return i
3.04 0.17
C
![Page 18: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/18.jpg)
Cython
•
•
•
![Page 19: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/19.jpg)
http://bit.ly/kimikazu20140913 http://bit.ly/kimikazu20160204
Python
PyCon JP 2014 2016
![Page 20: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/20.jpg)
…
•
•
![Page 21: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/21.jpg)
![Page 22: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/22.jpg)
Premature optimization is the root of all evil.— Donald Knuth
![Page 23: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/23.jpg)
![Page 24: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/24.jpg)
•
•
•
• XP
•
![Page 25: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/25.jpg)
•
•
•
![Page 26: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/26.jpg)
•
•
•
![Page 27: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/27.jpg)
XP
•
• ☓ ○
•
•
•
![Page 28: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/28.jpg)
•
•
•
•
•
•
![Page 29: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/29.jpg)
Scikit-learn
SpectralClustering
![Page 30: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/30.jpg)
•
•
•
•
![Page 31: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/31.jpg)
XTX
![Page 32: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/32.jpg)
•
•
•
•
•
•
•
•
![Page 33: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/33.jpg)
x
Softplus f(x) = log(1 + e
x
)
f(x) ⇡ x
f(1000)
![Page 34: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/34.jpg)
•
•
•
•
•
![Page 35: Tokyo webmining 2017-10-28](https://reader033.fdocuments.net/reader033/viewer/2022050613/5a6479307f8b9a4c568b4635/html5/thumbnails/35.jpg)
• Python
•
•
•
•
•