Building cognitive applications with IBM Watson - QCon...

24
Building cognitive applications with IBM Watson Flavio Bergamaschi Agustin Casamayor Data, the new frontier: August 27th, 2015 Solutions Track #2

Transcript of Building cognitive applications with IBM Watson - QCon...

Page 1: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

Building cognitive applications with IBM Watson

Flavio Bergamaschi Agustin Casamayor

Data, the new frontier:

August 27th, 2015

Solutions Track #2

Page 2: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 2

»Data, data, data »What is Watson? »Watson Developer Cloud »Demo

Agenda

Page 3: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 3

Page 4: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 4

New era of computing

TabulatingSystems Era

ProgrammableSystems Era

CognitiveSystems Era

1900 1950 2011

Page 5: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 5

Page 6: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 6

Watson is creating a new partnership between people and computers

that enhances, scales and accelerates human expertise.

Page 7: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 7

Watson Developer Cloud is a cognitive platform that provides developers easy access to expertise via a collection of REST APIs & SDKs

Page 8: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

Alchemy API

Language Detection

Feed Detection

Keyword Extraction

Concept Tagging

Linked Data Support

Author ExtractionRelationship

Extraction

Entity Extraction

Text Extraction Mircoformats Parsing

Sentiment Analysis

Taxonomy Classification

Watson gets smarter with Alchemy Deep Learning and Knowledge Graph

Page 9: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

9

Bluemix is an open-standards, cloud-based platform for building, running, and managing applications.

Build your apps, your wayUse the most prominent compute technologies to power your app: Cloud Foundry, Docker, OpenStack.

Scale more than just instancesDevelopment, monitoring, deployment, and logging tools allow the developer to run and manage the entire application.

Layered SecurityIBM secures the platform and infrastructure and provides you with the tools to secure your apps.

Deploy and manage hybrid apps seamlesslyGet a seamless dev and management experience across a number of hybrid implementations options.

Coming Summer 2015

Where are Watson Services: IBM Bluemix

Page 10: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

Launched in 4Q14 and Expanded in 2015, a new way to interact with IBM Watson technology

10

Page 11: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 11

» Text Analysis for Content Discovery » Sophisticated natural language processing » Add high-level semantic information » 12+ APIs

Alchemy Language

» Entity Extraction » Sentiment Analysis » Keyword Extraction » Concept Tagging » Relation Extraction » Taxonomy Classification

» Author Extraction » Language Detection » Text Extraction » Microformats Parsing » Feed Detection » Linked Data Support

Page 12: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 12

» Identify the people, companies, organizations, locations, etc. in your content and match that up with articles about those same entities.

» Features: » Sentiment Analysis » Coreference Resolution » Entity Types » Disambiguation » Linked Data » Quotation Extraction » Language Support » Multiple Response Formats

Alchemy Language: Entity Extraction

Page 13: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 13

» Extract the important, relevant keywords from your content, and then find other content that has the same or a similar mix of keywords

» Features » Sentiment Analysis » Ranked Relevance » Language Support » Multiple Response Formats

Alchemy Language: Keyword Extraction

Page 14: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 14

» Employs deep learning to understand a picture’s content and context » Analyse complex visual scenes in their entirety (without textual clues) » Holistic approach to understanding the multiple objects and

surroundings in common smartphone photos and online images

» APIs » Image Link Extraction » Image Tagging » Face Detection/Recognition

Alchemy Vision

Page 15: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 15

» Given any URL, this API will scan the designated page to find the most prominent image and directly retrieve the URL for that image. It can then be appropriately classified and tagged

» Features: » Primary Image Recognition » Understands Industry Markup Protocol

Alchemy Vision: Image Link Extraction

Page 16: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 16

» Quickly categorize and organize image libraries at a massive scale. » Understand complex visual scenes in their broader context » Automatically extract knowledge from images and act upon

» Features: » Contextual Recognition » Image Tagging at Scale » Confidence Scores » Security

Alchemy Vision: Image Tagging

Page 17: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 17

» Given an image URL or an uploaded one, this API returns the position, age, gender, and the identities of the people in the photo (60K+ celebrities)

» Features: » Position » Age » Gender » Identity

Alchemy Vision: Face Detection/Recognition

Page 18: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 18

Personality Insights

Infers  people’s  personality  portrait  Improves  understanding  of  their  preferences  Helps  engage  users  on  their  own  terms  

Page 19: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 19

PI: How does it work?

• Linguistic  analytics  to  extract  cognitive  and  social  characteristics  

• Big  Five,  Values,  and  Needs  • From  available  sources!!  

• email,  text  messages,  tweets…  • Understand,  connect  to,  and  communicate  with  other  people  on  a  more  personalized  level.

Studies across a wide variety of fields show that individuals have intrinsic traits that can be recognized and used to predict future behavior

[Ford’05, O’Brien ‘96, Neuman ‘99, Gosling ‘03, Wholan ’06]

Page 20: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 20

Analysis Platform

Personality Insights API Architecture

Text data

Generic Text Ingest

Linguistic Algorithms

Big-5 Personality

Basic Human Values

Fundamental Needs

Interac(ve**Visualiza(ons*

SPSS,*Unica,*Cognos, Kenexa*

Data Model (JSON)

Portrait'API'Implementa/on'(runs*in*Java EE Web Profile containers)*

Applica/ons'

Mobile*Web*

Watson*Ecosystem*

Input'Parameters*

JSON output

Hybrid**Mobile*App*

CSV output

Social media, emails, etc.

Formats: JSON, Text, HTML

In*3rd*party*applica(ons**

Page 21: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 21

Personality Insights models

Page 22: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 22

Tone Analyzer

Helps individuals understand the linguistic tones of their writing.

The service uses linguistic analysis to detect and interpret emotional, social, and writing cues that are located within the text.

The service also offers rhetorical suggestions for an author to improve the intended tone of their message.

Page 23: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

Demo

23

Page 24: Building cognitive applications with IBM Watson - QCon Rioqconrio.com/rio2015/system/files/presentation-slides/watson_qcon-ri… · Bluemix is an open-standards, cloud-based platform

© 2015 International Business Machines Corporation 24

» Alchemy API » Alchemy Language » Alchemy Vision

» Personality Insights » Tone Analyzer » App Gallery » Let’s build and deploy a sample app

Demo