Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal...
Transcript of Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal...
![Page 1: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/1.jpg)
Sentiment-based spatial-temporal event detection in social media data
24/09/20191
Lin Che
Supervisors: Juliane Cron, Ruoxin ZhuReviewer: Dr. Eva Hauthal
![Page 2: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/2.jpg)
Outline
• Introduction
• Sentiment analysis
• Spatial-temporal analysis-based event detection
• Spatial-temporal analysis-based event interpretation
• Conclusion and outlook
2
![Page 3: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/3.jpg)
3
Introduction: Social media
![Page 4: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/4.jpg)
Introduction: Hypothesis
4
The hypothesis guiding this research is that social
events change population sentiment orientation (PSO)
in the dimension of time and space.
![Page 5: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/5.jpg)
5
• Find a suitable sentiment indicator to represent the population sentiment orientation.
• Develop a methodology for spatial-temporal analysis of the population sentiment to detect sentiment fluctuation and abnormalities.
• Find suitable methods to identify and interpret the event in the spatial-temporal dimensions.
Introduction: Research objectives
![Page 6: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/6.jpg)
Introduction: Research questions
6
• Which sentiment analysis method for the given social media is most suitable one for the PSO indicator?
• How should the spatial-temporal analysis be designed for population sentiments? Which specific methods or algorithms can be applied?
• How can events be extracted and identified based on spatial-temporal analysis? What method(s) is (are) suitable to interpret the event?
![Page 7: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/7.jpg)
Workflow
7
![Page 8: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/8.jpg)
Data description
8
![Page 9: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/9.jpg)
Case study data set
9
Attributes Values
Source Michael Jendryke(WHU)
Time 01.2014 – 05.2015
Region Shanghai, China
Size 4GB
Format CSV
Columns 28
Rows 11794009
Sina Weibo
![Page 10: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/10.jpg)
Workflow
10
![Page 11: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/11.jpg)
1. Sentiment analysis
11
![Page 12: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/12.jpg)
Sentiment analysis:Population sentiment orientation indicator
PSO =𝑃
𝑁
Ground truth data set:
100k (50k positive, 50k negative)
12
P = number of positive records N = number of negative records
![Page 13: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/13.jpg)
Sentiment analysis: Workflow
13
![Page 14: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/14.jpg)
Sentiment analysis: Data preprocessing
Data selection
• Data attributes selection
• Data range selection
14
![Page 15: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/15.jpg)
Sentiment analysis: Data preprocessing
Data cleaning
• Integrity check
• Deduplication check
15
![Page 16: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/16.jpg)
Sentiment analysis:Lexicon-based method flow
• Text segmentation
"Jieba" (Chinese for "to stutter") Chinese text segmentation
• Stop word filtering
Stop words are those words which are unlikely to assist further semantic understanding of computer algorithms. Such as the, is, at, which, and on.
16
![Page 17: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/17.jpg)
17
Score = (2*1) + (-1*1) = 1
Sentiment analysis:Lexicon-based method flow
![Page 18: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/18.jpg)
Lexicons description
18
Sentiment analysis:Lexicon-based method flow
![Page 19: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/19.jpg)
Algorithm evaluation
19
Sentiment analysis:Lexicon-based method flow
![Page 20: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/20.jpg)
Sentiment analysis: Machine-learning-based method
• Vectorization
• Classification
20
![Page 21: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/21.jpg)
Vectorization
Word2Vec Model (Word embedding Model)– Google 2013
21
Sentiment analysis: Machine-learning-based method
![Page 22: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/22.jpg)
Algorithms and results
22
Sentiment analysis: Machine-learning-based method
![Page 23: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/23.jpg)
Classification result - LG
23
Sentiment analysis: Machine-learning-based method
![Page 24: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/24.jpg)
Workflow
24
![Page 25: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/25.jpg)
2. Spatial-temporal analysis-based event detection
25
![Page 26: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/26.jpg)
Spatial-temporal analysis: Time series analysis
26
30.01.2014
18.02.2015
08.09.2014
![Page 27: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/27.jpg)
Spatial-temporal analysis: Event extraction
27
Word Cloud
![Page 28: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/28.jpg)
Spatial-temporal Analysis:Small temporal scale event detection
28
![Page 29: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/29.jpg)
Spatial-temporal analysis:Small spatial scale local event detection
29
![Page 30: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/30.jpg)
Spatial-temporal Analysis:Small spatial scale local event detection
30
11.01.201424.05.2014
21.02.2014
11.05.2014
![Page 31: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/31.jpg)
Spatial-temporal analysis:Small spatial scale local event detection
31
![Page 32: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/32.jpg)
32
Spatial-temporal analysis:Small spatial scale local event detection
![Page 33: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/33.jpg)
Workflow
33
![Page 34: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/34.jpg)
3. Spatial-temporal analysis-based event interpretation
34
![Page 35: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/35.jpg)
Spatial-temporal analysis:Event interpretation
35
![Page 36: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/36.jpg)
Spatial-temporal analysis:Event interpretation
36
Working
Going back home
NotGirl/Boyfriend
![Page 37: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/37.jpg)
37
Airport
Airplane
Subway Station
Spatial-temporal analysis:Event interpretation
![Page 38: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/38.jpg)
Spatial-temporal analysis:Spatial clustering analysis
38
![Page 39: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/39.jpg)
Spatial-temporal analysis:Spatial clustering analysis
39
![Page 40: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/40.jpg)
Spatial-temporal analysis:Spatial clustering analysis
40
![Page 41: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/41.jpg)
41
Spatial-temporal analysis:Spatial clustering analysis
![Page 42: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/42.jpg)
42
Spatial-temporal analysis:Spatial clustering analysis
![Page 43: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/43.jpg)
43
Spatial-temporal analysis:Spatial clustering analysis
![Page 44: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/44.jpg)
Conclusion
• Sentiment analysis
• Population sentiment orientation (PSO)
• Multi-scale
• Event interpretation
• Wider range
44
![Page 45: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/45.jpg)
Outlook
• Sentiment analysis
• An interactive web event analysis system
• Event Monitoring and Early Warning System
• Multi-source data fusion
45
![Page 46: Sentiment-based spatial-temporal event detection in social ... · Sentiment-based spatial-temporal event detection in social media data 1 24/09/2019 Lin Che Supervisors: Juliane Cron,](https://reader033.fdocuments.net/reader033/viewer/2022042419/5f36ae90b1d4156fc532883b/html5/thumbnails/46.jpg)
“Part of the journey is the end”
and thank you all
Lin CheMunich, 24.09.2019