The Vision of Computer Vision: The bold promise of teaching computers to understand the visual world...
-
Upload
itcamp -
Category
Technology
-
view
350 -
download
4
Transcript of The Vision of Computer Vision: The bold promise of teaching computers to understand the visual world...
@ITCAMPRO #ITCAMP17Community Conference for IT Professionals
The Vision of Computer Vision: The bold
promise of teaching computers to understand the visual world
Tim Huckaby
InterKnowlogy, Founder / Chairman
VSBLTY Founder / CTO
Microsoft Worldwide RD
Microsoft MVP, Artificial Intelligence
A lap around the
Microsoft Cognitive Services Vision API
@ITCAMPRO #ITCAMP17Community Conference for IT Professionals
Many thanks to our sponsors & partners!
GOLD
SILVER
PARTNERS
PLATINUM
POWERED BY
User Interface Innovation: What’s on the Horizon?Delivering the Art of Software
A Little Bit About Me and Why We I am Here…
https://binged.it/2qpYCvF
A THINK TANK OF MAKERS WHO CREATE FOR ALL DIGITAL SURFACES
Who we work for...that we are allowed to talk about...
Delivering the Art of Softwareinterknowlogy.com1525 Faraday Ave, Suite 250, Carlsbad CA [email protected]
User Interface Innovation: What’s on the Horizon?Delivering the Art of Software
Computer Vision in Cognitive Services, Machine Learning and Artificial Intelligence
With Computer Vision, comes responsibility…
Objectives And Agenda
Using Machine Learning without being an expert
Where We have Been in Compuer Vision and Where We are Going
How to get started
Demos, Demos, Demos...
Bing Image
API
Face API
Emotion API
Computer Vision API
Custom Vision
Cognitive Toolkit
U-SQL Gesture Reco
Video Indexer
Content Moderator
Microsoft Cognitive ServicesGive your apps a human side
Microsoft Cognitive ServicesGive your apps a human side
Microsoft Cognitive ServicesGive your apps a human side
Roll your own with REST APIs
Simple to add: just a few lines
of code required
Make the same API code call on iOS,
Android, and Windows
Integrate into the language and
platform of your choice
Bring your own data for your custom
experience
Built by experts in their field from
Microsoft Research, Bing, and Azure
Machine Learning
Quality documentation, sample code,
and community support
Easy Flexible Tested
Why Microsoft Cognitive Services ?
Why?The Seeing AI App
Computer Vision, Image, Speech Recognition, NLP,
and ML from Microsoft Cognitive Services
Watch Video HereRead Blog Here
Bing Image
API
Face API
Emotion API
Computer Vision API
Custom Vision
Cognitive Toolkit
U-SQL Gesture Reco
Video Indexer
Content Moderator
Bing Image
API
Face API
Emotion API
Computer Vision API
Custom Vision
Cognitive Toolkit
U-SQL Gesture Reco
Video Indexer
Content Moderator
Bing Image
API
Face API
Emotion API
Computer Vision API
Custom Vision
Cognitive Toolkit
U-SQL Gesture Reco
Video Indexer
Content Moderator
Face API
Tim Huckaby• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI
Bing Image
API
Face API
Emotion API
Computer Vision API
Custom Vision
Cognitive Toolkit
U-SQL Gesture Reco
Video Indexer
Content Moderator
Tim Huckaby• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI
VisionCaptor™
VisionCaptor™ marries high impact, engaging motion graphics
and interactive brand messaging on glass display at point-of-
sale in retail environments including supermarkets and c-store.
VSBLTY’s “first of its kind”, built-in facial recognition and data
capture technology delivers real time demographic analytics,
emotion detection, and other important KPI’s. Applications range
from informational display to dynamic video and advertising to
dynamic way finding.
DataCaptor™
DataCaptor™ soley uses the optics and analytics technology
and can be embedded into an end cap display in retail,
traditional out of home applications, and existing POS screens to
capture analytics and provide campaign measurement.
The engine behind the VSBLTY: “GoldenTrout”
Tim Huckaby• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI
Intelligent Kiosk: Real Time Crowd Insights
Tim Huckaby• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI
Bing Image
API
Face API
Emotion API
Computer Vision API
Custom Vision
Cognitive Toolkit
U-SQL Gesture Reco
Video Indexer
Content Moderator
Computer Vision API
Content of Image:
Categories v0: [{ “name”: “animal”, “score”: 0.9765625 }]
V1: [{ "name": "grass", "confidence": 0.9999992847442627 },
{ "name": "outdoor", "confidence": 0.9999072551727295 },
{ "name": "cow", "confidence": 0.99954754114151 },
{ "name": "field", "confidence": 0.9976195693016052 },
{ "name": "brown", "confidence": 0.988935649394989 },
{ "name": "animal", "confidence": 0.97904372215271 },
{ "name": "standing", "confidence": 0.9632768630981445 },
{ "name": "mammal", "confidence": 0.9366017580032349, "hint": "animal" },
{ "name": "wire", "confidence": 0.8946959376335144 },
{ "name": "green", "confidence": 0.8844101428985596 },
{ "name": "pasture", "confidence": 0.8332059383392334 },
{ "name": "bovine", "confidence": 0.5618471503257751, "hint": "animal" },
{ "name": "grassy", "confidence": 0.48627158999443054 },
{ "name": "lush", "confidence": 0.1874018907546997 },
{ "name": "staring", "confidence": 0.165890634059906 }]
Describe0.975 "a brown cow standing on top of a lush green field“
0.974 “a cow standing on top of a lush green field”
0.965 “a large brown cow standing on top of a lush green field”
Intelligent Kiosk – Vision API Explorer
Tim Huckaby• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI
Bing Image
API
Face API
Emotion API
Computer Vision API
Custom Vision
Cognitive Toolkit
U-SQL Gesture Reco
Video Indexer
Content Moderator
U-SQL
Tim Huckaby• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI
Bing Image
API
Face API
Emotion API
Computer Vision API
Custom Vision
Cognitive Toolkit
U-SQL Gesture Reco
Video Indexer
Content Moderator
Custom Vision Portal (IRIS)
Tim Huckaby• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI
Object Recognition: “RoosterFish”
Tim Huckaby• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI
Bing Image
API
Face API
Emotion API
Computer Vision API
Custom Vision
Cognitive Toolkit
U-SQL Gesture Reco
Video Indexer
Content Moderator
Microsoft
Cognitive
Toolkit
https://github.com/Microsoft/CNTK
Microsoft Cognitive Toolkit, CNTK
Bing Image
API
Face API
Emotion API
Computer Vision API
Custom Vision
Cognitive Toolkit
U-SQL Gesture Reco
Video Indexer
Content Moderator
Video Indexer: vi.microsoft.com
Tim Huckaby• InterKnowlogy, Chairman/Founder
• VSBLTY, CTO
• Microsoft Worldwide RD
• Microsoft MVP, AI
Samples and Documentation:https://azure.microsoft.com/en-us/services/cognitive-services/
How to Sign Up:https://azure.microsoft.com/en-us/try/cognitive-services/
SDK:https://github.com/Microsoft/ProjectOxford-ClientSDK
Samples in Github:https://github.com/search?o=desc&p=1&q=org%3AMicrosoft+cognitive&s=updated&type=Repositories(from Github search on: org:Microsoft cognitive)
The Engaging User Experience & the Natural User InterfaceDelivering the Art of Software
More info on InterKnowlogy:
◦www.InterKnowlogy.com ◦http://ikeurope.com/◦www.vimeo.com/InterKnowlogy
More info on VSBLTY:
◦www.VSBLTY.netAbout Tim Huckaby…
• Founder/Chairman, InterKnowlogy, Actus Software, VSBLTY• Microsoft® Global Regional Director • Microsoft® AppDev Partner Advisory Council Founder /
Member• Microsoft® MVP – Emerging Experiences• Accomplished Author & Speaker• Board Member: Facial Networks, Crespi Carmelite, San
Diego Fly Fishers
www.TimHuckaby.com
Contact Tim:E-mail: [email protected]
Office: 760-683-9650 Mobile:: 619 990 9200
Blog:http://team.interknowlogy.com/blogs/timhuckaby
FaceBook:http://www.facebook.com/Tim.Huckaby.Carlsbad
LinkedIn:http://www.linkedin.com/in/timhuckaby
Twitter: @TimHuckaby
Tim Huckaby