Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS,...

34
Vishesh Oberoi Technical Evangelist, Microsoft [email protected] @ovishesh

Transcript of Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS,...

Page 1: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

Vishesh OberoiTechnical Evangelist, Microsoft

[email protected]@ovishesh

Page 2: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

Vishesh OberoiTechnical Evangelist, Microsoft

[email protected]@ovishesh

Page 3: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 4: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 5: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 6: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 7: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 8: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

Simply put, a bot is an application that performs an automated task.

That’s it.

Page 9: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 10: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 11: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 12: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 13: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 14: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 15: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 16: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

“Sure, do you want it with nuts and chocolate sauce in a waffle cone like last time from the Awesome store on Queen St?”

Page 17: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 18: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

Demo - Bot

Page 19: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

Web service

Natural Language Processing

Conversational Skills

Speech Processing

Vision

SMS/Chat Audio/VideoMMS/Image

Your bot

Page 20: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

Determine intent and

detects entities

Seamless integration with

Speech Recognition

Learns over time

Use pre-built, world class

models from Bing and Cortana

Models work across devices

Intent: TextToSpeechContent: headlines

Read me the headlines

Play yesterday’sDaily Show

Intent: PauseDeviceDateTime.duration: 5 Minutes

Pause for5 minutes

Intent: PlayEpisodeContent: Daily ShowDateTime.date: T-1 Day

Page 21: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

{“entities”: [

{“entity”: “seattle”,“type”: “City”

}],“intents”: [

{“intent”: “FindHotel”,“score”: 0.99853384

},{

“intent”: “None”,“score”: 0.07289317

},{

“intent”: “BookHotel”,“score”: 0.0167122427

},{

“intent”: “FindCheckoutTime”,“score”: 1.0919299E-06

}]

}

“Find a hotel in Seattle”

Language Understanding Models

Page 22: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

Reduce labeling effort with interactive featuring

Deploy using just a few examples with active learning

Supports 5 languages (English, Chinese, Italian, French, Spanish)

Language Understanding Models

Page 23: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 24: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

Demo - LUIS

Page 25: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

Cognitive ServicesGive your solutions a human side

Page 26: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

Microsoft

Cognitive

Services

From faces to feelings, allow your apps to understand images and video

Hear and speak to your users by filtering noise, identifying speakers, and understanding intent

Process text and learn how to recognize what users want

Tap into rich knowledge amassed from the web, academia, or your own data

Access billions of web pages, images, videos, and news with the power of Bing APIs

Page 27: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

microsoft.com/cognitive

Page 28: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 29: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

30

Page 30: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 31: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

Developer Resources

Documentation

https://www.microsoft.com/cognitive-services/en-us/documentation

Client SDKs

https://www.microsoft.com/cognitive-services/en-us/sdk-sample

Example Code

https://text-analytics-demo.azurewebsites.net/Home/SampleCode

(On all API References as well)

Page 32: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

Additional Resources

Demos and Featured Apps

https://www.microsoft.com/cognitive-services/en-us/applications

https://www.captionbot.ai/

https://www.microsoft.com/cognitive-services/en-us/speech-api

https://www.microsoft.com/cognitive-services/en-us/speaker-recognition-api

https://www.microsoft.com/cognitive-services/en-us/bing-spell-check-ap

https://github.com/Microsoft/Cognitive-Samples-IntelligentKiosk/i

(and many more)

Join Our Community

https://stackoverflow.com/questions/tagged/microsoft-cognitive

https://social.msdn.microsoft.com/forums/azure/en-US/home?forum=mlapi

https://cognitive.uservoice.com/

Pricing

https://www.microsoft.com/cognitive-services/en-us/pricing

Page 33: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech
Page 34: Vishesh Oberoi - files.meetup.comfiles.meetup.com/11165352/Conversations as a Platform - LUIS, Cognitive... · Determine intent and detects entities Seamless integration with Speech

Thank you

Vishesh OberoiTechnical Evangelist, Microsoft

[email protected]@ovishesh