Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your...

42
Social Network Mining An Introduction Jiawei Zhang Assistant Professor Florida State University Big Data

Transcript of Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your...

Page 1: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Network MiningAn Introduction

Jiawei ZhangAssistant Professor

Florida State University

BigData

Page 2: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

A Questionnaire

Please raise your hands, if you(1) use Facebook(2) use Instagram(3) use Snapchat(4) use LinkedIn

(5) don’t use any online social networks

Page 3: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Background Knowledge

BigData

Page 4: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Online Social Networks & Web 2.0

• Web 1.0 vs Web 2.0• Web 1.0: users take information• Web 2.0: users create information

• Online Social Networks & Web 2.0• OSNs use Web 2.0 technology

to share a user-focused approach for communication

• User actively participate in content creation and editing through open collaboration between members of communities of practice

Page 5: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Online Social Networks

Online social media is the use of electronic and Internet technology for the purpose of sharing and discussing information and experiences with other

human beings in more effective and efficient ways.

Page 6: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

New Social Networks Emerge Every Year

2010200920082007200620052004 2011launch year

http://en.wikipedia.org/wiki/List_of_social_networking_websites

……

Page 7: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Media Landscape In Recent Years

Page 8: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Network Statistics and Functions

Page 9: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Networks are Very BIG (Statistical Data 2017)

14

(in millions)

Page 10: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Networks are Very BIG (2010-2021)

(in billions)

Page 11: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Media Types

http://dmml.asu.edu/smm/slide/SMM-Slides-ch1.pdf

Page 12: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Online Social Networks

http://dmml.asu.edu/smm/slide/SMM-Slides-ch1.pdf

Page 13: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Blogging

http://dmml.asu.edu/smm/slide/SMM-Slides-ch1.pdf

Page 14: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Microblogging

http://dmml.asu.edu/smm/slide/SMM-Slides-ch1.pdf

Page 15: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Wiki

http://dmml.asu.edu/smm/slide/SMM-Slides-ch1.pdf

Page 16: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Media Sharing

http://dmml.asu.edu/smm/slide/SMM-Slides-ch1.pdf

Page 17: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Opinion, Review, and Rating Websites

http://dmml.asu.edu/smm/slide/SMM-Slides-ch1.pdf

Page 18: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Question & Answer Sites

http://dmml.asu.edu/smm/slide/SMM-Slides-ch1.pdf

Page 19: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

An Observation: People are using multiple online social networks simultaneously

[1] Duggan et al. Social media update, 2013.

93% 53% 83%

Page 20: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Network Structure Representation

BigData

Page 21: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Concept Definition: Homogeneous Social Networks

Page 22: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

• Representation: Homogeneous Social Networks

Where V is the sets of various kinds of nodes in the network and set E denotes the various types of links in the network

Concept Definition: Heterogeneous Social Networks

Page 23: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Links

Contents: Tweets

Locations

8 AM 12 PM 4 PM 8 PM 11 PM

Temporal ActivitiesWho, Where, When, What

Social Network Structures are Very Complex

Page 24: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

• Representation: Heterogeneous Social Networks

where is the sets of various kinds of nodes in the network and is the set of various types of links in the network

E =S

j Ej

V =S

i Vi

Concept Definition: Heterogeneous Social Networks

...

...

writewrite

write

write

write

contain contain contain contain

contain contain contain contain

attach

attach

attachattach

attach

timestamps posts words locations V = {user node set, post node set, word node set, time node set, location node set}

E = {user-user link set, user-post link set, post-word link set, post-time link set, post-location link set}

Page 25: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

User Accounts

Locationslocate

locate

Tweets

8 AM 12 PM 4 PM 8 PM 11 PM

Temporal Activities

Social Networks Belong to Different Varieties

anchor links

Locations

Tips

8 AM 12 PM 4 PM 8 PM 11 PM

User Accounts

Temporal Activities

Page 26: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

• Representation: Multiple Aligned Heterogeneous Social Networks

G =�(G(1), G(2)), (A(1,2))

G(1)

G(2)

: Foursquare

: Twitter

Heterogeneous Social Networks

Anchor LinksA(1,2): Anchor links

between Foursquare and Twitter

Concept Definition: Multiple Aligned Heterogeneous Social Networks

Page 27: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Network Mining Problems(An Overview)

BigData

Page 28: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Network Mining Problems: An Overview

User-Centric Content-Centric Interdisciplinary

Role Analysis

Social Spammer Detection

Social Ties

Negative Links

Information Diffusion

Network Alignment

Network Summarization

Network Embedding

Misinformation

Event Detection

Content Quality and Popularity

Sentiment Analysis

Social Tags

Social Summarization

Social Recommendations

Social Media Q&A

Personality Analysis

Crisis Informatics

Social Media Healthcare

Social Media Privacy and Security

Social Media Education

Computational Social Science

Social Media Marketing

Social Media Visualization

Page 29: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Spammer Detection

Collective Spammer Detection in Evolving Multi-Relational Social Networks

Page 30: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Ties Prediction

Page 31: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Supervised Link Prediction Setting

u1u2

u3

u4link features label

(u1, u2) +1

u5

(u3, u5) +1… … …

(u3, u4) -1

… … …

(u4, u2) -1

information used to extract feature vectors for these links

(u5, u4) supervised learning model

network structure

link to be predictedlabel/score

existinglinks

non-existinglinks

Page 32: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Information Diffusion

Page 33: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Locations

User Accounts

Locations

Tips

locate

locate

Tweets

anchor links8 AM 12 PM 4 PM 8 PM 11 PM

User Accounts

Temporal Activities

8 AM 12 PM 4 PM 8 PM 11 PM

Temporal Activities

?

?

?

Social Network Alignment

Page 34: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Network Embedding

Page 35: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Network Embedding

……

Network 1 Network 2

NetworkFusion

Component

………

……

……… …

……

……… … …

…… …

…………

z(1)iz(2)j

y(2),o+1j

y(2),o+1j

x

(2)j,�0

y(2),oj,�0

y(2),oj,�0

x

(2)j,�0

x

(2)j,�1

x

(2)j,�7

x

(2)j,�7

x

(2)j,�1x

(1)i,�1

x

(1)i,�0

x

(1)i,�7

x

(1)i,�7x

(1)i,�1

x

(1)i,�0

y(1),1i,�7

y(1),oi,�7

y(1),oi,�7

y(1),1i,�7

y(2),1j,�0

y(2),1j,�0

y(1),o+1i

y(1),o+1i

… …

… …

… …

… …

Page 36: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Recommendation

Page 37: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Event Detection

2015 Twitter Channels for Rossano Flood

Page 38: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Social Network Mining Problems: An Overview

User-Centric Content-Centric Interdisciplinary

Role Analysis

Social Spammer Detection

Social Ties

Negative Links

Information Diffusion

Network Alignment

Network Summarization

Network Embedding

Misinformation

Event Detection

Content Quality and Popularity

Sentiment Analysis

Social Tags

Social Summarization

Social Recommendations

Social Media Q&A

Personality Analysis

Crisis Informatics

Social Media Healthcare

Social Media Privacy and Security

Social Media Education

Computational Social Science

Social Media Marketing

Social Media Visualization

Page 39: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

An Advertisement: CIS5930-04 Social Network MiningCall for Enrollment

BigData

Page 40: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

CIS5930-04 Call for Enrollment http://www.ifmlab.org/recent_news.html

Page 41: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

CIS5930-04 Course Page: http://www.ifmlab.org/courses.html

Page 42: Social Network Mining An Introductionburmeste/Jiawei_Zhang.pdf · A Questionnaire Please raise your hands, if you (1) use Facebook (2) use Instagram (3) use Snapchat (4) use LinkedIn

Jiawei [email protected] State University

BigData

Thank You!Social Network Mining: An Introduction