Building cognitive applications with IBM Watson - QCon...
Transcript of Building cognitive applications with IBM Watson - QCon...
Building cognitive applications with IBM Watson
Flavio Bergamaschi Agustin Casamayor
Data, the new frontier:
August 27th, 2015
Solutions Track #2
© 2015 International Business Machines Corporation 2
»Data, data, data »What is Watson? »Watson Developer Cloud »Demo
Agenda
© 2015 International Business Machines Corporation 3
© 2015 International Business Machines Corporation 4
New era of computing
TabulatingSystems Era
ProgrammableSystems Era
CognitiveSystems Era
1900 1950 2011
© 2015 International Business Machines Corporation 5
© 2015 International Business Machines Corporation 6
Watson is creating a new partnership between people and computers
that enhances, scales and accelerates human expertise.
© 2015 International Business Machines Corporation 7
Watson Developer Cloud is a cognitive platform that provides developers easy access to expertise via a collection of REST APIs & SDKs
Alchemy API
Language Detection
Feed Detection
Keyword Extraction
Concept Tagging
Linked Data Support
Author ExtractionRelationship
Extraction
Entity Extraction
Text Extraction Mircoformats Parsing
Sentiment Analysis
Taxonomy Classification
Watson gets smarter with Alchemy Deep Learning and Knowledge Graph
9
Bluemix is an open-standards, cloud-based platform for building, running, and managing applications.
Build your apps, your wayUse the most prominent compute technologies to power your app: Cloud Foundry, Docker, OpenStack.
Scale more than just instancesDevelopment, monitoring, deployment, and logging tools allow the developer to run and manage the entire application.
Layered SecurityIBM secures the platform and infrastructure and provides you with the tools to secure your apps.
Deploy and manage hybrid apps seamlesslyGet a seamless dev and management experience across a number of hybrid implementations options.
Coming Summer 2015
Where are Watson Services: IBM Bluemix
Launched in 4Q14 and Expanded in 2015, a new way to interact with IBM Watson technology
10
© 2015 International Business Machines Corporation 11
» Text Analysis for Content Discovery » Sophisticated natural language processing » Add high-level semantic information » 12+ APIs
Alchemy Language
» Entity Extraction » Sentiment Analysis » Keyword Extraction » Concept Tagging » Relation Extraction » Taxonomy Classification
» Author Extraction » Language Detection » Text Extraction » Microformats Parsing » Feed Detection » Linked Data Support
© 2015 International Business Machines Corporation 12
» Identify the people, companies, organizations, locations, etc. in your content and match that up with articles about those same entities.
» Features: » Sentiment Analysis » Coreference Resolution » Entity Types » Disambiguation » Linked Data » Quotation Extraction » Language Support » Multiple Response Formats
Alchemy Language: Entity Extraction
© 2015 International Business Machines Corporation 13
» Extract the important, relevant keywords from your content, and then find other content that has the same or a similar mix of keywords
» Features » Sentiment Analysis » Ranked Relevance » Language Support » Multiple Response Formats
Alchemy Language: Keyword Extraction
© 2015 International Business Machines Corporation 14
» Employs deep learning to understand a picture’s content and context » Analyse complex visual scenes in their entirety (without textual clues) » Holistic approach to understanding the multiple objects and
surroundings in common smartphone photos and online images
» APIs » Image Link Extraction » Image Tagging » Face Detection/Recognition
Alchemy Vision
© 2015 International Business Machines Corporation 15
» Given any URL, this API will scan the designated page to find the most prominent image and directly retrieve the URL for that image. It can then be appropriately classified and tagged
» Features: » Primary Image Recognition » Understands Industry Markup Protocol
Alchemy Vision: Image Link Extraction
© 2015 International Business Machines Corporation 16
» Quickly categorize and organize image libraries at a massive scale. » Understand complex visual scenes in their broader context » Automatically extract knowledge from images and act upon
» Features: » Contextual Recognition » Image Tagging at Scale » Confidence Scores » Security
Alchemy Vision: Image Tagging
© 2015 International Business Machines Corporation 17
» Given an image URL or an uploaded one, this API returns the position, age, gender, and the identities of the people in the photo (60K+ celebrities)
» Features: » Position » Age » Gender » Identity
Alchemy Vision: Face Detection/Recognition
© 2015 International Business Machines Corporation 18
Personality Insights
Infers people’s personality portrait Improves understanding of their preferences Helps engage users on their own terms
© 2015 International Business Machines Corporation 19
PI: How does it work?
• Linguistic analytics to extract cognitive and social characteristics
• Big Five, Values, and Needs • From available sources!!
• email, text messages, tweets… • Understand, connect to, and communicate with other people on a more personalized level.
Studies across a wide variety of fields show that individuals have intrinsic traits that can be recognized and used to predict future behavior
[Ford’05, O’Brien ‘96, Neuman ‘99, Gosling ‘03, Wholan ’06]
© 2015 International Business Machines Corporation 20
Analysis Platform
Personality Insights API Architecture
Text data
Generic Text Ingest
Linguistic Algorithms
Big-5 Personality
Basic Human Values
Fundamental Needs
Interac(ve**Visualiza(ons*
SPSS,*Unica,*Cognos, Kenexa*
Data Model (JSON)
Portrait'API'Implementa/on'(runs*in*Java EE Web Profile containers)*
Applica/ons'
Mobile*Web*
Watson*Ecosystem*
Input'Parameters*
JSON output
Hybrid**Mobile*App*
CSV output
Social media, emails, etc.
Formats: JSON, Text, HTML
In*3rd*party*applica(ons**
© 2015 International Business Machines Corporation 21
Personality Insights models
© 2015 International Business Machines Corporation 22
Tone Analyzer
Helps individuals understand the linguistic tones of their writing.
The service uses linguistic analysis to detect and interpret emotional, social, and writing cues that are located within the text.
The service also offers rhetorical suggestions for an author to improve the intended tone of their message.
Demo
23
© 2015 International Business Machines Corporation 24
» Alchemy API » Alchemy Language » Alchemy Vision
» Personality Insights » Tone Analyzer » App Gallery » Let’s build and deploy a sample app
Demo