Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan
-
Upload
conul-conference -
Category
Education
-
view
306 -
download
0
Transcript of Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan
![Page 1: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/1.jpg)
Evaluating Automated Sentiment Analysis of LibQUAL+
Peter Corrigan
![Page 2: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/2.jpg)
<Sentiment Analysis - Goals>
• Maximize the value from LibQUAL+ Comments e.g. track the efficacy of initiatives to address issues at granularity
• Develop a simple to execute, repeatable process, with visualizations of results
• Get this project done quickly.
![Page 3: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/3.jpg)
<Caveats>
• Not a clinical trial of Sentiment Analysis
• There’s no substitute for someone reading the comments
• Purists may question Methodology
• Proceed with caution
![Page 4: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/4.jpg)
<Sentiment Analysis = Opinion Mining>
![Page 5: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/5.jpg)
<The API>
• AlchemyAPI
• Hybrid: Linguistics/(Grammar) + Statistics/(idiom, slang, misspelling)
• Large-scale deep-learning technology trained on massive data from a variety of domains.
![Page 6: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/6.jpg)
<LibQUAL+ * 5>
• Year No. of Comments
• 2010 1383
• 2012 705
• 2013 927
• 2014 1133
• 2015 791
![Page 7: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/7.jpg)
<LibQUAL+ Comment>
textbox11: 714 of 1323id: 6015515SubmitDate: 4/13/2015 8:52:39 AMUserGroup: Postgraduate: Doctoral Research degreeDiscipline: Arts, Humanities and Celtic Studies Age: 31 - 45Sex: FemaleIsComplete: TruetextResponse: I've always found library staff really pleasant and helpful. Remote access to library resources is excellent, though I could benefit from some guidance on how to search more effectively.
![Page 8: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/8.jpg)
<Document Level Results>
I've always found library staff really pleasant and helpful. Remote access to library resources is excellent, though I could benefit from some guidance on how to search more effectively.<?xml version="1.0" encoding="UTF-8"?><results> <status>OK</status><totalTransactions>1</totalTransactions> <language>english</language> <docSentiment> <score>0.901543</score> <type>positive</type> </docSentiment></results>
![Page 9: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/9.jpg)
<Keyword Level Results>
I've always found library staff really pleasant and helpful. Remote access to library resources is excellent, though I could benefit from some guidance on how to search more effectively.
![Page 10: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/10.jpg)
<Keyword>
I've always found library staff really pleasant and helpful. Remote access to library resources is excellent, though I could benefit from some guidance on how to search more effectively.
![Page 11: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/11.jpg)
<Comment Table>
![Page 12: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/12.jpg)
<Comment Table>
![Page 13: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/13.jpg)
<Keyword Table>
![Page 14: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/14.jpg)
Best comments ever!
The most important thing that makes the library a brilliant place to study is the kind and courteous staff who go out of their way to help you.0.989229
![Page 15: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/15.jpg)
Best comments ever!
Overall I find the library services to be excellent and I would like to say that the staff are superb, very friendly and always willing to above and beyond their duties to help students. 0.988592
![Page 16: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/16.jpg)
Best comments ever!
The Hardiman library is an invaluable resource for my research - an excellent range of services, modern, user-friendly facilities and very friendly and helpful staff.0.995445
![Page 17: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/17.jpg)
Correlated strongly with Adequacy Gap
r = 0.9827The p-value is 0.002724. The result is significant at p < 0.05
![Page 18: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/18.jpg)
WiFi
![Page 19: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/19.jpg)
Noise
![Page 20: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/20.jpg)
Staff
![Page 21: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/21.jpg)
Plugs and Sockets
![Page 22: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/22.jpg)
<Keyword Term Frequency>
![Page 23: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/23.jpg)
Hapex terms - significant
![Page 24: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/24.jpg)
Kolmogorov-Smirnov test
![Page 25: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/25.jpg)
Project Costs
• €0.00
• API free for academic use < 30,000 calls per day
![Page 26: Evaluating Automated Sentiment Analysis of Library Survey Respondent feedback - Peter Corrigan](https://reader030.fdocuments.net/reader030/viewer/2022032506/55c9be6dbb61ebce5a8b4713/html5/thumbnails/26.jpg)
Source Code:
• https://github.com/pcorrigan