SKIL - Dl4j in the wild meetup

14
skymind.io | deeplearning.org | gitter.im/deeplearning4j SKIL - Skymind Intelligence Layer

Transcript of SKIL - Dl4j in the wild meetup

Page 1: SKIL - Dl4j in the wild meetup

skymind.io | deeplearning.org | gitter.im/deeplearning4j

SKIL - Skymind Intelligence Layer

Page 2: SKIL - Dl4j in the wild meetup

● Exploratory Data Analysis (EDA)● Training Model● Deploy Model● Monitor model over time (maintenance)● Scale model as it gets more usage

Enterprise Deep Learning workflows

Page 3: SKIL - Dl4j in the wild meetup

● Infrastructure for USING Deep Learning● “Serving” models to end users● Visualization● Auditing of data flow (Where did that come from?)● Bundled hardware acceleration

Training

Page 4: SKIL - Dl4j in the wild meetup

● Need to visualize● Neural nets aren’t interpretable● DL has its own vocabulary in addition to “Machine learning”● Hard to track research from practical● Not much emphasis on “apps”

Why is training “hard”?

Page 5: SKIL - Dl4j in the wild meetup

Training UI

Page 6: SKIL - Dl4j in the wild meetup

Flow

Page 7: SKIL - Dl4j in the wild meetup

Feature Extraction

Page 8: SKIL - Dl4j in the wild meetup

Histograms

Page 9: SKIL - Dl4j in the wild meetup

● Infrastructure for USING Deep Learning● “Serving” models to end users● Visualization● Auditing of data flow (Where did that come from?)● Bundled hardware acceleration

Deployment

Page 10: SKIL - Dl4j in the wild meetup

DC/OS

Page 11: SKIL - Dl4j in the wild meetup

● Self contained dependencies● Run on prem or cloud● Scale independent of cpu or gpu● “Develop same as production”

Docker

Page 12: SKIL - Dl4j in the wild meetup

● Docker-compose up● Dcos install “package”

Usage

Page 13: SKIL - Dl4j in the wild meetup

After Installation (Monitoring!)

Page 14: SKIL - Dl4j in the wild meetup

Production Monitoring as well (Conductr)