Groups of vertices and Core-periphery...
Transcript of Groups of vertices and Core-periphery...
![Page 1: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/1.jpg)
Groups of verticesand
Core-periphery structure
By: Ralucca Gera, NPS
![Page 2: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/2.jpg)
Why?
• Mostly observed real networks have:– Heavy tail (powerlaw most probably, exponential)– High clustering (high number of triangles
especially in social networks, lower count otherwise)
– Small average path (usually small diameter)– Communities/periphery/hierarchy– Homophily and assortative mixing (similar nodes
tend to be adjacent)• Where does the structure come from? How do
we model it? 2
![Page 3: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/3.jpg)
Macro and Meso Scale properties
• Macro Scale properties (using all the interactions):– Small world (small average path, high clustering)– Powerlaw degree distr. (generally pref. attachment)
• Meso Scale properties applying to groups (using k-clique, k-core, k-plex):– Community structure– Core-periphery structure
• Micro Scale properties applying to small units:– Edge properties (such as who it connects, being a
bridge)– Node properties (such as degree, cut-vertex) 3
![Page 4: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/4.jpg)
Some local and global metrics pertaining to structure of networks
4
Structure they capture Local Metrics Global metrics
Direct influenceGeneral feel for the distribution of the edges
Vertex degree, in and out degree
Degree distribution
Closeness, distance between nodes Geodesic (path)Distance (numerical value)
Diameter, radius, average path length
Connectedness of the networkHow critical are vertices to the connectedness of the graph?How much damage can a network take before disconnecting?
Existence of a bridgeExistence of a cut vertex
Cut setsDegree distribution
Tight node/edge neighborhoods Clique, plex, core,community,k-dense (for edges)
Community detection
Centrality and influence Degree centrality Betweenness, eigenvector, PageRank, hub and authorities
![Page 5: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/5.jpg)
Source: Guido Caldarelli, Communities and Clustering in Some social NetworksNetSci 2007 New York, May 20th 2007
0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
1 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
1 1 0 1 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0
0 1 1 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0
0 1 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0
0 0 1 1 1 0 1 1 0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 1 0 0 1 1 1 1 0 0 0 0 0 0 0
0 0 0 0 0 0 0 1 0 1 1 1 0 0 0 0 0 0 0
0 0 0 0 0 0 0 1 1 0 1 0 1 1 0 0 0 0 0
0 0 0 0 0 0 0 1 1 1 0 1 1 0 0 0 0 0 0
0 0 0 0 0 0 0 1 1 0 1 0 1 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 1 1 1 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 1 0 0 0 0 1 0 1 0 1
0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 1 1 1 0
0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 1 1 0
0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 1 1
0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 1
0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 1 1 0
In a very clustered graph,the adjacency matrix can beput in a block form.
Clusters and matrices
![Page 6: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/6.jpg)
Definitions
• Newman’s book uses k-component, k-cliques, k-plexes and k-cores to refer to a set of vertices with some properties.
• In graph theory (and research papers) we use a clique to be the set of vertices and edges, so a clique is actually a graph (or subgraph)
• Either way it works, the graph captures more information.
![Page 7: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/7.jpg)
Groups and subgroups identifications
Some common approaches to subgroup identification and analysis:• Cliques• Cores• Plexes• Denseness• Components (and k-components)• Community detection
![Page 8: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/8.jpg)
COMPONENTS AND K-COMPONENTS
Section 7.8.2
8
![Page 9: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/9.jpg)
Components
• Recall that a graph is k-connected/k-component if it can be disconnected by removal of k vertices, and no k-1 vertices can disconnect it.
• Component is a maximal size connected subgraph• A k-component (k-connected component) is a
connected maximal subgraph that can be disconnected (or we’re left with a ) by removal of k vertices, and no k-1 vertices can disconnect it.
• Alternatively: A k-component is a connected maximal subgraph such that there are k-vertex-independent paths between any two vertices
9
![Page 10: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/10.jpg)
In class exercise
• The k-component tells how robust a graph or subgraph is.
• Identify a subgraphthat is either a:– 1-connected– 2-connected– 3-connected– 4-connected
10
![Page 11: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/11.jpg)
K-CLIQUE, K-PLEX AND K-CORE
Section 7.8.1
11
![Page 12: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/12.jpg)
k-cliques
• A clique of size : a subset of nodes, with every node adjacent to every other member of the subset (all one of them)
• We usually search for the maximum clique• Hard to find (decision problem for the clique number is
NP-Complete)• Why is it hard to use this concept on real networks?
– Because one might not infer/know all the edges of the true network, so clique may exist but it may not be captured in the data to be analyzed
– A relaxed version of a clique might be just as useful in large networks.
12
![Page 13: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/13.jpg)
In class exercise
• A clique of size : a subset of nodes, with every node connected to every other member of the subset.
• Identify a:– 1-clique– 2-clique– 3-clique– 4-clique
13
![Page 14: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/14.jpg)
k-plex
• A -plex : maximal subset of nodes, with , where is the subgraph
induced by S. • What is a 1-plex?
: clique: “approximate clique”
• Idea: missing a few edges to be a cliqueor fewer edges per vertex are allowed to be
missing– Useful in identifying subgroups with small diameter,
(possible cliques in the ground truth network). 14
![Page 15: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/15.jpg)
k-plex
• A -plex : maximal subset of nodes, with , where is the
subgraph induced by S, and .
• For what values of is the subgraph
a -plex?
15
![Page 16: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/16.jpg)
In class exercise
• A -plex : maximal subset of nodes, with , where is the
subgraph induced by S, and . • Identify a:
– 1-plex– 2-plex– 3-plex– 4-plex
16
![Page 17: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/17.jpg)
k-core
-core: maximal subset of nodes, , with , where is the subgraph
induced by S.• Idea: enough edges are present to make a
group strong, not worrying about diameter of .
• What is the relation between and if S is a -core and -plex?
– If S is a -core, then S is a )-plex
17
![Page 18: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/18.jpg)
k-core
• A -core of size n: maximal subset of nodes with , where is the subgraph induced by .
• Approach: eliminate lower-order cores until relatively dense subgroups are identified. 18
![Page 19: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/19.jpg)
In class exercise
• A -core of size n: maximal subset of nodes with , where is the subgraph induced by .
• Identify a:– 1-core– 2-core– 3-core– 4-core
19
![Page 20: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/20.jpg)
k-dense
• A k- dense sub-graph is a group of vertices, in which each pair of vertices {i, j} has at least
-2 common neighbors.
Idea: pairwise friends ( –dense looks at edges rather than vertices in making them part of the group)
20
![Page 21: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/21.jpg)
k-dense
• A k- dense sub-graph is a group of vertices, in which each pair of vertices {i, j} has at least
-2 common neighbors.
21
![Page 22: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/22.jpg)
In class exercise
• A k- dense sub-graph is a group of vertices, in which each pair of vertices {i, j} has at least k-2 common neighbors.
• Identify a:– 1-dense– 2-dense– 3-dense– 4-dense
22
![Page 23: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/23.jpg)
Connections between them
• k - clique k - dense k – core
(Source: Saito et. Al -2008)
Most networks have only one core.23
![Page 24: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/24.jpg)
Other extensions• https://academic.oup.com/comnet/article/doi/10.1093/comnet/cnt016/2392115/Structure-and-dynamics-of-core-periphery-networks
24
![Page 25: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/25.jpg)
Using them globally
![Page 26: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/26.jpg)
Cliques, plexes and cores
• clique of size : maximal subset of nodes, with every node adjacent to every other member of the subset
-plex of size : maximal subset of nodes, with every node adjacent to at least other members of the subset
: clique: “approximate clique”
-core: maximal subset of nodes, with every node adjacent to at least others in the subset
• A - dense sub-graph is a group of vertices, in which each pair of vertices {i, j} has at least common neighbors.
![Page 27: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/27.jpg)
Communities vs. core/dense/clique
• K-core/plex/dense/clique: look inside the group of nodes
• Communities look both at internal and external ties(high internal and low external ties)
• Core-peripherydecomposition also looking atinternal and ext.to the core (doesn’thave to be a clique)
27
![Page 28: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/28.jpg)
K-core (k-shell) decomposition
http://3.bp.blogspot.com/-TIjz3nstWD0/ToGwUGivEjI/AAAAAAAAsWw/etkwklnPNw4/s1600/k-cores.png
Generally, but not well defined: the core of the network (the -core for the largest ) and the periphery (everything else).
There are modifications where several top values of make the core.
![Page 29: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/29.jpg)
Core-periphery adjacency matrix
29
dark blue = 1 (adjacent)white = 0 (nonadjacent)
![Page 30: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/30.jpg)
Deciding on core-periphery
30
How to decide if a network has core-periphery structure? • Not well defined either, but generally the
density of the -core must be high:• Checked by the high correlation,
,where is the (i,j) adjacency matrix entry, and
http://www.sciencedirect.com/science/article/pii/S0378873399000192
![Page 31: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/31.jpg)
Extensions of core-periphery?!
31
Limitation: • There are just two classes of nodes: core
and periphery. • Is a three-class partition consisting of
core, semiperiphery, and periphery more realistic?
• Or even partitioning with more classes?• The problem becomes more difficult as
the number of classes is increased, and good justification is needed.
http://www.sciencedirect.com/science/article/pii/S0378873399000192
![Page 32: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/32.jpg)
Possible structures
32
From Aaron Clauset and Mason Porter
dark shade = 0 (nonadjacent)light shade = 1 (adjacent)
![Page 33: Groups of vertices and Core-periphery structurefaculty.nps.edu/rgera/MA4404/Winter2017/09-CorePeriphery.pdf · structures“ Social networks 21.4 (2000): 375-395. • Csermely, Peter,](https://reader034.fdocuments.net/reader034/viewer/2022042314/5f02c5447e708231d405ed45/html5/thumbnails/33.jpg)
References
• M. E. Newman, Analysis of weighted networks Physical Review E, vol. 70, no. 5, 2004.
• Borgatti, Stephen P., and Martin G. Everett. "Models of core/periphery structures“ Social networks 21.4 (2000): 375-395.
• Csermely, Peter, et al. "Structure and dynamics of core/periphery networks.“ Journal of Complex Networks 1.2 (2013): 93-123.
• Kitsak, Maksim, et al. "Identification of influential spreaders in complex networks." Nature Physics 6.11 (2010): 888-893
• S. B. Seidman, Network structure and minimum degree, Social networks, vol. 5, no. 3, pp. 269287, 1983
• Borgatti, Stephen P., and Martin G. Everett. "Models of core/periphery structures." Social networks 21.4 (2000): 375-395.
33