Jochen.Schroeer@microsoft - IT-Pro Night...To empower data science and development teams Powerful...
Transcript of Jochen.Schroeer@microsoft - IT-Pro Night...To empower data science and development teams Powerful...
Agent Applications Services Infrastructure
Microsoft AI Portfolio
Cortana Office 365
Dynamics 365
Customer Service
and Support
Skype
Calendar.help
Cortana Intelligence
Cognitive Services
Bot Framework
Cortana Devices SDK
Azure Machine
Learning
Azure N Series
FPGA
Azure Databricks
People
AI must maximize efficiencies without destroying the dignity of people1
AI must guard against bias2
AI needs accountability so humans can undo unintended harm3
AI must be transparent4
AI must be designed for intelligent privacy5
AI must be designed to assist humanity6
AI for Good
Project Seeing AI – people, text and objects for the low vision community
Apps + insightsSocial
LOB
Graph
IoT
Image
CRM
Azure Cloud
On-premises Edge
A I B U I LT - I N FA S T & A G I L E E N T E R P R I S E P R O V E N
Intelligent Cloud & Intelligent EDGE
Cultural Fit
• We do not compete in the business of
our customers
Enterprise Grade
• Compliance and Trust Audit, GDPR, Certifications, Security...
• Hybrid IaaS & PaaSIoT Cloud & Edge
• Open Source CertifiedPreferred Vendor
• 1st Party Support by MicrosoftOperate Cloud Environments
• Data & AIDemocratization of AI for every developer and
organization
54+Azure regions world wide
million miles offiber in our DCs
Data AI
PREP & TRAIN
Collect and prepare data Train and evaluate model
A
B
C
Operationalize and manage
Azure AI Services
Azure Infrastructure
Tools
Domain specific pretrained modelsTo simplify solution development
Azure Databricks
Machine Learning VMs
Popular frameworksTo build advanced deep learning solutions
TensorFlowPyTorch ONNX
Azure Machine Learning
LanguageSpeech
…
SearchVision
Productive servicesTo empower data science and development teams
Powerful infrastructureTo accelerate deep learning
Scikit-Learn
Familiar Data Science toolsTo simplify model development
CPU GPU FPGA
From the Intelligent Cloud to the Intelligent Edge
Azure Notebooks JupyterVisual Studio Code Command line
Infuse apps with powerful, pre-trained AI models
Customize easily and tailor to your needs
Vision
Speech
Language
Bing
Search /
Azure Search
…
Computer Vision | Video Indexer | Face | Content Moderator
Speech to Text | Text to Speech | Speech Translation | Speaker Recognition
Text Analytics | Spell Check | Language Understanding | Text Translation | QnA Maker
Big Web Search | Video Search | Image Search | Visual Search | Entity Search |
News Search | Autosuggest
Domain specific pretrained modelsTo simplify solution development
Azure Databricks
Machine Learning VMs
Popular frameworksTo build advanced deep learning solutions
TensorFlowPyTorch ONNX
Azure Machine Learning
LanguageSpeech
…
SearchVision
Productive servicesTo empower data science and development teams
Powerful infrastructureTo accelerate deep learning
Scikit-Learn
Familiar Data Science toolsTo simplify model development
CPU GPU FPGA
From the Intelligent Cloud to the Intelligent Edge
Azure Notebooks JupyterVisual Studio Code Command line
Choose any python development environment
And improve data science productivity
PyCharmAzure NotebooksVisual Studio Code Command lineZeppelin
Interactive widgets for Jupyter Notebooks Azure Machine Learning for Visual Studio Code extension
Jupyter
Get started with AML on Azure Notebooks: http://aka.ms/aznotebooks-aml
Domain specific pretrained modelsTo simplify solution development
Popular frameworksTo build advanced deep learning solutions
Productive servicesTo empower data science and development teams
Powerful infrastructureTo accelerate deep learning
Familiar Data Science toolsTo simplify model development
From the Intelligent Cloud to the Intelligent Edge
Azure Databricks
Machine Learning VMs
TensorFlowPyTorch ONNX
Azure Machine Learning
LanguageSpeech
…
SearchVision
Scikit-Learn
Azure Notebooks JupyterVisual Studio Code Command line
CPU GPU FPGA
Frameworks Azure
Create Deploy
Services
Devices
Azure Machine Learning services
Ubuntu VM
Windows Server 2019 VM
Azure Custom Vision Service
ONNX Model
Windows devices
Other devices (iOS, etc.)
Domain specific pretrained modelsTo simplify solution development
Popular frameworksTo build advanced deep learning solutions
Productive servicesTo empower data science and development teams
Powerful infrastructureTo accelerate deep learning
Familiar Data Science toolsTo simplify model development
From the Intelligent Cloud to the Intelligent Edge
Azure Databricks
Machine Learning VMs
TensorFlowPyTorch ONNX
Azure Machine Learning
LanguageSpeech
…
SearchVision
Scikit-Learn
Azure Notebooks JupyterVisual Studio Code Command line
CPU GPU FPGA
Leverage your favorite deep learning frameworks
AZURE ML SERVICE
Increase your rate of experimentation
Bring AI to the edge
Deploy and manage your models everywhere
TensorFlow MS Cognitive Toolkit PyTorch Scikit-Learn ONNX Caffe2 MXNet Chainer
AZURE DATABRICKS
Accelerate processing with the fastest Apache Spark engine
Prepare data clean data at massive scale
Access enterprise-grade security
+
Deploy Azure ML at scale
Cloud Service / AKS
Light EdgeModel Deployment
MS Cognitive
Toolkit
Keras
TensorFlow
PyTorch
Azure ML
service SDK
Azure Databricks
Domain specific pretrained modelsTo simplify solution development
Popular frameworksTo build advanced deep learning solutions
Productive servicesTo empower data science and development teams
Powerful infrastructureTo accelerate deep learning
Familiar Data Science toolsTo simplify model development
From the Intelligent Cloud to the Intelligent Edge
Azure Databricks
Machine Learning VMs
TensorFlowPyTorch ONNX
Azure Machine Learning
LanguageSpeech
…
SearchVision
Scikit-Learn
Azure Notebooks JupyterVisual Studio Code Command line
CPU GPU FPGA
Accelerate deep learning
General purpose
machine learning
D, F, L, M, H Series
CPUs
Optimized for flexibility Optimized for performance
GPUs FPGAs
Deep learning
N Series
Specialized hardware
accelerated deep learning
AML hardware accelerated
models (Project Brainwave)
Register and
Manage Model
Build Image
Build model
(your favorite IDE)
Deploy Service
Monitor Model
Train &
Test Model
ServeStore Prep and trainIngest
Batch data
Streaming data
Azure Kubernetes
service
Power BI
Azure analysis
servicesAzure SQL data
warehouse
Cosmos DB, SQL DB
Azure Data Lake StorageAzure Data Factory
Azure Event
Hubs
Azure Databricks Azure Machine Learning service
Apps
Model Serving
Ad-hoc Analysis
Operational
Databases
22 Nov 1963, Dallas, TX
55 Years Later…
Another Two Weeks Later… With the Help of Microsoft Azure and Cognitive Services Everyone Can Investigate…
Architecture
Got it, how can i start?
https://github.com/Microsoft/AzureSearch_JFK_Files
https://azure.microsoft.com/de-de/
https://www.visualstudio.com/de/
© Microsoft Corporation
Further Use Cases and Architectures
Conversational Agents Architecture
Conversational agents
Transform your engagements with
customers and employees
The average size of a single cart has
decreased
Provide personalized digital content to
shoppers
Increase cart size
Unplanned downtime results in cost
overruns
Predict when maintenance should be
performed
Minimize downtime
Solar energy production is inconsistent
Align energy supply with the optimal
markets
Maximize revenue
Product recommendation Predictive maintenance Demand forecasting
Visual Studio Code
Flammable equipment near heat source
Missing equipment
No hardhat
RPN RoIP R-CNN
Azure Machine Learning service and
Machine Learning Compute
Azure Storage
Visual Studio Code
Model Deploymenton AKS or Edge
© Microsoft Corporation
What‘s next?
AI SCHOOLHTTPS://AISCHOOL.MICROSOFT.COM
AI GALLERY HTTPS://GALLERY.AZURE.AI/SOLUTIONS
AZURE AI CERTIFICATION HTTPS://WWW.MICROSOFT.COM/EN-
US/LEARNING/AZURE-AI-ENGINEER.ASPX
© Microsoft Corporation
Questions?!
Microsoft
