DeepLearning4J: Open Source Neural Net Platform

13
& DL4J

Transcript of DeepLearning4J: Open Source Neural Net Platform

Page 1: DeepLearning4J: Open Source Neural Net Platform

& DL4J

Page 2: DeepLearning4J: Open Source Neural Net Platform

@nyghtowl

Artificial Neural Networks● Machine Learning Algorithm

● Classification & prediction

@nyghtowl

Page 3: DeepLearning4J: Open Source Neural Net Platform

@nyghtowl

Real World ...

- Natural Language Processing

- Computer Vision

- Recommender Engines & Ad Placement

Page 4: DeepLearning4J: Open Source Neural Net Platform

@nyghtowl

Personalization

Page 5: DeepLearning4J: Open Source Neural Net Platform

@nyghtowl

Neural Net Structure

Input OutputHidden

Run until error stops improving = converge

Loss Function

Outputk jXM kjWy

Page 6: DeepLearning4J: Open Source Neural Net Platform

@nyghtowl

NN Example

Who is it?

Pixels Edges Object PartsObject Models

Layer 2 Layer 3 Layer 4Input

Page 7: DeepLearning4J: Open Source Neural Net Platform

@nyghtowl

GPUs & Parallel Processing

Page 8: DeepLearning4J: Open Source Neural Net Platform

@nyghtowl

Why NNs Matter

- Feature Engineering

- NLP & Image Analysis

- Unsupervised Modeling

Page 9: DeepLearning4J: Open Source Neural Net Platform

@nyghtowl

Skymind

- Neural Network Platform (DL4J)

- Java & Scala

- Supporting Packages (Canova, ND4J)

Page 10: DeepLearning4J: Open Source Neural Net Platform

@nyghtowl

HadoopSpark AWS

Skymind Packages

ND4J

DL4J

JBlas JCublas NetlibJava

Word2Vec, CNN, DBN, RNN, RNTN...

CanovaData

Neural Nets

Linear Algebra

X86

Page 11: DeepLearning4J: Open Source Neural Net Platform

@nyghtowl

DeepLearning4J (DL4J)

- Open source

- Variety of NNs & Flexibility

- Cross-platform & Scale

Page 13: DeepLearning4J: Open Source Neural Net Platform

@nyghtowl

References: Images● http://code-spot.co.za/2009/10/08/15-steps-to-implemented-a-neural-net/● http://www.texample.net/tikz/examples/neural-network/● http://onlinestatbook.com/2/regression/intro.html

● http://jaoying-google.blogspot.com/2012_12_01_archive.html● https://www.kaggle.com/forums/f/15/kaggle-forum/t/10878/feature-representation-in-deep-learning● http://maggieholmes.typepad.com/my_weblog/2011/07/scrapbooking.html● http://www.teds.com.au/photolounge/why-print-photos● http://users.clas.ufl.edu/glue/longman/1/einstein.html● https://en.wikipedia.org/wiki/File:Feed_forward_neural_net.gif● http://www.scienzagiovane.unibo.it/English/artint/8-neural-networks.html● http://www.clarifai.com/technology● http://www.nvidia.com/object/what-is-gpu-computing.html● https://www.classes.cs.uchicago.edu/archive/2013/spring/12300-1/pa/pa1/● http://yann.lecun.com/exdb/lenet/● http://www.huffingtonpost.com/meia-chitategmark/terminator-robots-and-ai-risk_b_6788918.html● http://engage.synecoretech.com/marketing-technology-for-growth/bid/204670/Content-Personalization-What-it-is-and-Why-

it-Matters