Confluence: Conformity Influence in Large Social...

35
1 Confluence: Conformity Influence in Large Social Networks Jie Tang * , Sen Wu * , and Jimeng Sun + * Tsinghua University + IBM TJ Watson Research Center

Transcript of Confluence: Conformity Influence in Large Social...

Page 1: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

1

Confluence: Conformity Influence in Large Social Networks

Jie Tang*, Sen Wu*, and Jimeng Sun+

*Tsinghua University +IBM TJ Watson Research Center

Page 2: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

2

Conformity •  Conformity is the act of matching attitudes,

opinions, and behaviors to group norms.[1]

•  Kelman identified three major types of conformity[2]

–  Compliance is public conformity, while possibly keeping one's own original beliefs for yourself.

–  Identification is conforming to someone who is liked and respected, such as a celebrity or a favorite uncle.

–  Internalization is accepting the belief or behavior, if the source is credible. It is the deepest influence on people and it will affect them for a long time.

[1] R.B. Cialdini, & N.J. Goldstein. Social influence: Compliance and conformity. Annual Review of Psych., 2004, 55, 591–621. [2] H.C. Kelman. Compliance, Identification, and Internalization: Three Processes of Attitude Change. Journal of Conflict Resolution, 1958, 2 (1): 51–60.

Page 3: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

3

“Love Obama”

I love Obama

Obama is great!

Obama is fantastic

I hate Obama, the worst president ever

He cannot be the next president!

No Obama in 2012!

Positive Negative

Page 4: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

4

Conformity Influence Analysis

I love Obama

Obama is great!

Obama is fantastic

Positive Negative

1. Peer conformity

2. Individual conformity

3. Group conformity

D

B C

A

Page 5: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

5

Related Work—Conformity •  Conformity theory

–  Compliance, identification, and internalization [Kelman 1958]

–  A theory of conformity based on game theory [Bernheim 1994]

•  Influence and conformity –  Conformity-aware influence

analysis [Li-Bhowmick-Sun 2011]

•  Applications –  Social influence in social

advertising [Bakshy-el-al 2012]

Page 6: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

6

Related Work—social influence

•  Influence test and quantification –  Influence and correlation [Anagnostopoulos-et-al 2008]

Distinguish influence and homophily [Aral-et-al 2009, La Fond-Nevill 2010] –  Topic-based influence measure [Tang-Sun-Wang-Yang 2009, Liu-et-al 2012]

Learning influence probability [Goyal-Bonchi-Lakshmanan 2010] •  Influence diffusion model

–  Linear threshold and cascaded model [Kempe-Kleinberg-Tardos 2003] –  Efficient algorithm [Chen-Wang-Yang 2009]

Ada

Frank

Eve David

Carol

Bob

George

Input: coauthor network

Ada

Frank

Eve David

Carol

George

Social influence anlaysis

θi1=.5θi2=.5

Topic distribution g(v1,y1,z)θi1

θi2

Topic distribution

Node factor function

f (yi,yj, z)Edge factor function

rz

az

Output: topic-based social influences

Topic 1: Data mining

Topic 2: Database

Topics:

Bob

Output

Ada

Frank

Eve

BobGeorge

Topic 1: Data mining

Ada

Frank

Eve David

George

Topic 2: Database

. . .

2

1

14

2

2 33

Page 7: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

7

Challenges

•  How to formally define and differentiate different types of conformities?

•  How to construct a computational model to learn the different conformity factors?

•  How to validate the proposed model in real large networks?

Page 8: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

8

Problem Formulation and Methodologies

Page 9: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

9

Four Datasets

Network #Nodes #Edges Behavior #Actions

Weibo 1,776,950 308,489,739 Tweet on popular topics 6,761,186

Flickr 1,991,509 208,118,719 Comment on a popular photo 3,531,801

Gowalla 196,591 950,327 Check-in some location 6,442,890

ArnetMiner 737,690 2,416,472 Publish in a specific domain 1,974,466

All the datasets are publicly available for research.

Page 10: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

10

A concrete example in Gowalla

1’ �

1’ �

1’ �

1’ �

Alice’s friend� Other users�Alice �Legend �

If Alice’s friends check in this location at time t�

Will Alice also check in nearby?�

Page 11: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

11

Notations�

G =(V, E, C, X) �

Attributes: xi - location, gender, age, etc.

Action/Status: yi - e.g., “Love Obama”

Time t�

Time t-1, t-2… �

Node/user: vi User Group: cij

A = {(a,vi ,t)}a,i,t— each (a, vi, t) represents user vi performed action a at time t

Page 12: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

12

Conformity Definition

•  Three levels of conformities –  Individual conformity – Peer conformity – Group conformity

Page 13: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

13

Individual Conformity •  The individual conformity represents how easily user v’s

behavior conforms to her friends

All actions by user v �

A specific action performed by user v at time t�

Exists a friend v′ who performed the same action at time t’′�

Page 14: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

14

Peer Conformity •  The peer conformity represents how likely the user v’s

behavior is influenced by one particular friend v′

All actions by user v′�

A specific action performed by user v′ at time t′�

User v follows v′ to perform the action a at time t �

Page 15: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

15

Group Conformity •  The group conformity represents the conformity of user v’s

behavior to groups that the user belongs to.

All τ-group actions performed by users in the group Ck

A specific τ-group action�User v conforms to the group to perform the action a at time t �

τ-group action: an action performed by more than a percentage τ of all users in the group Ck �

Page 16: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

16

For an example

0

0.0005

0.001

0.0015

0.002

0.0025

0.003

2000 2005 2010

Peer Conformity

Peer Random

0

0.0005

0.001

0.0015

0.002

0.0025

Clustering Influence Recommendation Topic Model

Group Conformity

KDD ICDM CIKM

0

0.005

0.01

0.015

0.02

0.025

KDD ICDM CIKM

Individual Conformity

KDD

Conformity in the Co-Author Network

Page 17: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

17

Now our problem becomes

•  How to incorporate the different types of conformities into a unified model?

Input: G=(V, E, C, X), A

Output: F: f(G, A) ->Y(t+1) �

Page 18: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

18

Confluence —A conformity-aware factor graph model

g(v1, icf (v1))

Users

Confluence model

v2

v3 y1=a

Input Network

v4 v5

v7

Group 1: C1

Group 2: C2

y3y1

y2y4

y7y5

y6

v3v1

v2v4

v7v5

v6

g(y1, y’3, pcf (v1, v3))

g(y1, gcf (v1, C1))

v6

v1

Group 3: C3

Group conformity factor function�

Peer conformity factor function�

Random variable y: Action�

Individual conformity factor function�

Page 19: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

19

Model Instantiation

Individual conformity factor function �

Group conformity factor function �

Peer conformity factor function �

Page 20: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

20

General Social Features •  Opinion leader[1]

–  Whether the user is an opinion leader or not

•  Structural hole[2] –  Whether the user is a structural hole spanner

•  Social ties[3] –  Whether a tie between two users is a strong or weak tie

•  Social balance[4] –  People in a social network tend to form balanced (triad)

structures (like “my friend’s friend is also my friend”).

[1] X. Song, Y. Chi, K. Hino, and B. L. Tseng. Identifying opinion leaders in the blogosphere. In CIKM’06, pages 971–974, 2007. [2] T. Lou and J Tang. Mining Structural Hole Spanners Through Information Diffusion in Social Networks. In WWW'13. pp. 837-848. [3] M. Granovetter. The strength of weak ties. American Journal of Sociology, 78(6):1360–1380, 1973. [4] D. Easley and J. Kleinberg. Networks, Crowds, and Markets: Reasoning about a Highly Connected World. Cambridge University Press, 2010.

Page 21: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

21

Distributed Model Learning

(1) Master

(3) Master

(2) Slave

Unknown parameters to estimate �

Page 22: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

22

Distributed Learning Slave

Compute local gradient via random sampling�

Master Global update�

Graph Partition by Metis Master-Slave Computing

Inevitable loss of correlation factors!

Page 23: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

23

Experiments

Page 24: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

24

•  Baselines -  Support Vector Machine (SVM) -  Logistic Regression (LR) -  Naive Bayes (NB) -  Gaussian Radial Basis Function Neural Network (RBF) -  Conditional Random Field (CRF)

•  Evaluation metrics -  Precision, Recall, F1, and Area Under Curve (AUC)

Data Set and Baselines Network #Nodes #Edges Behavior #Actions

Weibo 1,776,950 308,489,739 Post a tweet 6,761,186

Flickr 1,991,509 208,118,719 Add comment 3,531,801

Gowalla 196,591 950,327 Check-in 6,442,890

ArnetMiner 737,690 2,416,472 Publish paper 1,974,466

Page 25: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

25

Prediction Accuracy

t-test, p<<0.01

Page 26: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

26

Effect of Conformity

Confluencebase stands for the Confluence method without any social based features Confluencebase+I stands for the Confluencebase method plus only individual conformity features Confluencebase+P stands for the Confluencebase method plus only peer conformity features Confluencebase+G stands for the Confluencebase method plus only group conformity

Page 27: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

27

Scalability performance

Achieve ∼ 9×speedup with 16 cores

Page 28: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

28

Conclusion •  Study a novel problem of conformity influence

analysis in large social networks

•  Formally define three conformity functions to capture the different levels of conformities

•  Propose a Confluence model to model users’ actions and conformity

•  Our experiments on four datasets verify the effectiveness and efficiency of the proposed model

Page 29: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

29

Future work

•  Connect the conformity phenomena with other social theories – e.g., social balance, status, and structural hole

•  Study the interplay between conformity and reactance

•  Better model the conformity phenomena with other methodologies (e.g., causality)

Page 30: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

30

Confluence: Conformity Influence in Large Social Networks

Jie Tang*, Sen Wu*, and Jimeng Sun+

*Tsinghua University +IBM TJ Watson Research Center

Data and codes are available at: http://arnetminer.org/conformity/

Page 31: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

31

Qualitative Case Study

Page 32: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

32

I love Obama Positive Negative

1 1. Peer

Conformity 2. Individual Conformity

Page 33: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

33

I love Obama

Obama is great!

Positive Negative

1. Peer conformity 2 2. Individual

Conformity

Page 34: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

34

I love Obama

Obama is great!

Positive Negative

2. Individual conformity

1. Peer conformity 3

Page 35: Confluence: Conformity Influence in Large Social Networkskeg.cs.tsinghua.edu.cn/.../KDD13...influence.pdf · General Social Features • Opinion leader[1] – Whether the user is

35

I love Obama

Obama is great!

Obama is fantastic

Positive Negative

2. Individual conformity

3. Group conformity

1. Peer conformity 4