Spotting diamonds in the rough: Mining for top performers with psychological assessments
Diamonds in the Rough (Sentiment(al) Analysis
-
Upload
scott-k-wilder -
Category
Technology
-
view
2.117 -
download
5
description
Transcript of Diamonds in the Rough (Sentiment(al) Analysis
![Page 1: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/1.jpg)
Gary Angel and Scott K. Wilder
![Page 2: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/2.jpg)
![Page 3: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/3.jpg)
3
Gary Angel, President of SemphonicCo-Founder and President of Semphonic, the leading independent web analytics consultancy in the United States. Semphonic provides full-service web analytics consulting and advanced online measurement to digital media, financial services, health&pharma, B2B, technology, and the public sector. Gary blogs at http://semphonic.blogs.com/semangel
Introductions
Scott K. Wilder, Digital Strategist, WilderVoicesRecently was SVP/Social Media Architect at Edelman – Digital. Founded and managed Intuit’s Small Business Online Community and Social Programs. Before Intuit, Scott was the VP of Marketing and Product Development at Kbtoys / eToys, the founder and director of Borders.com, and held senior positions at Apple, AOL, and American Express. Scott is also a founding Board member of the Word of Mouth Marketing Association. He received graduate degrees from New York University, The Johns Hopkins University and Georgetown University. Scott just jump started his own business, “WilderVoices” and blog @ www.wildervoices.com
![Page 4: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/4.jpg)
4
This will be a good webinar if….you come away with a sense of how to do sentiment analysis,
And how to make it work for your organization!!
This will be a good webinar if….you come away with a sense of how to do sentiment analysis,
And how to make it work for your organization!!
![Page 5: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/5.jpg)
5
![Page 6: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/6.jpg)
6
![Page 7: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/7.jpg)
7
Sentiment Analysis – Complex Definition
Sentiment analysis or opinion mining refers to a broad (definitionally challenged) area of natural language processing, computational linguistics and text mining. General speaking, it aims to determine the attitude of the speaker or writer with some respect to some topic. The attitude maybe their judgment or evaluation, their affective state – that is to say, the emotional state of the author when writing – or the intended emotional communication – that is to say, the emotional affect the author wants to have on the reader
![Page 8: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/8.jpg)
8
Sentiment Analysis – Simple Definition
The simplest algorithms work by scanning keywords to categorize a statement as positive or negative, based on a simple binary analysis:
-“love” is good,
-“hate” is bad,
-“I don’t know,” which means there probably will not be a second date
![Page 9: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/9.jpg)
9
Why Brands and Agencies Like Sentiment Analysis
• Takes time to read and review every verbatim
• Numbers look sexy
• Can observe changes in issues / topics over time
![Page 10: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/10.jpg)
10
![Page 11: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/11.jpg)
11
How most agencies present Sentiment Analysis
![Page 12: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/12.jpg)
12
Or they just show you this..
![Page 13: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/13.jpg)
13
Sentiment Analysis and Market Research
![Page 14: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/14.jpg)
14
Anecdotal Research
![Page 15: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/15.jpg)
15
Behavioral Research
![Page 16: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/16.jpg)
16
Primary Research
![Page 17: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/17.jpg)
17
Usage of Sentiment Analysis
• Sentiment Analysis is Anecdotal
• Sentiment Analysis is Behavioral
• Sentiment Analysis IS NOT Primary Research
• NOTE: YOU CAN NOT AND SHOULD NOT ASSUME THAT FINDINGS FROM SENTIMENT ANALYSIS ARE REPRESENTATIVE OF YOUR ENTIRE AUDIENCE.
![Page 18: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/18.jpg)
18
Usage of Sentiment Analysis
![Page 19: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/19.jpg)
19
Sentiment Analysis for Anecdotal Research
![Page 20: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/20.jpg)
20
Sentiment Analysis for Behavioral Research
![Page 21: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/21.jpg)
21
Listening Platforms
• Buzz Metrics
• Radian6
• ScoutLabs
• Sysomos
• Techrigy’s
![Page 22: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/22.jpg)
22
Text Mining Systems
• SAS
• Endeca
• Autonomy
• Lexalytics
• OpenAmplify
• You can get direct feeds to many social systems and mine text directly using solutions that are more powerful and tunable than those contained in most listening tools.
![Page 23: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/23.jpg)
23
The Right Tool Depends on the Data
• If your analyzing tweets, you need a tool that understands acronyms and emoticons.
• Sentence analysis is different that article analysis. Twitter is more like sentence analysis.
• Topical classification, Objective v. Subjective, and Sentiment (polarity) are fundamentally different types of analysis.
![Page 24: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/24.jpg)
24
An example of the Problem:
• Major software company looked at their major brand
• 80% of the comments were neutral
• 61% of the posts marked with a positive or negative sentiment came from microblogs.
• They were data oriented, general information
• But brands look at ‘Neutral’ and now what??
![Page 25: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/25.jpg)
25
Issues
• Unreliable – not as good as pure human primary research
• Not sure what to do with Neutral
• No tool consistently identifies positive and neutral
• Inconsistency across tools
• Power of one or a small group of influencers
• Lack of Accuracy
![Page 26: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/26.jpg)
26
Issues
• Inconsistent across social networks (Twitter is usually 60% neutral)
• Difficult to determine target
• Overlook actual verbatim
• No standards
![Page 27: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/27.jpg)
27
Now What?So…Now What?
![Page 28: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/28.jpg)
28
![Page 29: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/29.jpg)
29
10 Steps to find the Diamond1 Decide on internal customer - which business unit, group will use data
2 Identify and use one tool (standardize on governance and set up)
3 Combine with other metrics/KPIs
4 Determine how broad you will go, but only look at one platform, community at a time
5 Identify emerging, trending topics
6 Take % of positive, neutral and negative
7 Take random sample of a 100 quotes from positive, neutral, negative, groups
8 Read verbatim
9 Categorize issues (For Intuit: Set up software vs. invoices vs. install vs. customer service)
10 Compare with other biggest competitors
![Page 30: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/30.jpg)
30
![Page 31: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/31.jpg)
31
Old School
• More skin in the game
• More engaged leads to greater satisfaction and places you closer to users/people
• More confidence in results
• Don’t drink and drive (I mean, don’t mix platforms)
![Page 32: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/32.jpg)
32
Note: It’s Never accurateNote: It’s never totally accurate
![Page 33: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/33.jpg)
33
• This presentation will be posted @> http://www.semphonic.com>www.slideshare.net/skwilder>www.wildervoices.com
Thank you for your time
![Page 34: Diamonds in the Rough (Sentiment(al) Analysis](https://reader036.fdocuments.net/reader036/viewer/2022062418/554ad2a2b4c90542708b552d/html5/thumbnails/34.jpg)
34
For more information
Gary Angel:[email protected]: http://semphonic.blogs.com/semangel/@garyangelScott K. [email protected] blog: http://www.wildervoices.com@skwilderFor other presentations: http://www.slideshare.net/skwilder