Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING
-
Upload
ieee-cist -
Category
Data & Analytics
-
view
354 -
download
1
description
Transcript of Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING
![Page 1: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/1.jpg)
Dino Pedreschi
KDD LABUniversità di Pisa e ISTI-CNR
http://kdd.isti.cnr.it
Forum PA – Roma 27 maggio 2014
BIG DATA ANALYTICS & SOCIAL MINING
![Page 2: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/2.jpg)
SIAMO TUTTI POLLICINI DIGITALI
La Vita Nova, e-magazine de Il Sole 24 OreFosca Giannotti, Dino Pedreschi
![Page 3: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/3.jpg)
Shopping patterns & lifestyle
Desires, opinions, sentiments
Relationships & social ties
Movements
Big data “proxies” of social life
![Page 4: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/4.jpg)
![Page 5: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/5.jpg)
![Page 6: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/6.jpg)
![Page 7: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/7.jpg)
![Page 8: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/8.jpg)
27 ottobre 2014Analisi di Reti Sociali. Aprile-Maggio 20118
![Page 9: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/9.jpg)
![Page 10: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/10.jpg)
![Page 11: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/11.jpg)
![Page 12: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/12.jpg)
UNDERSTANDINGHUMAN MOBILITYPartner: Octo Telematics, PA
![Page 13: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/13.jpg)
A12 SudCascina
Marina di Pisa/TirreniaLucca
![Page 14: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/14.jpg)
Individual Routines
Work‐Home
Home‐Work
![Page 15: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/15.jpg)
Collective systematic patterns
![Page 16: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/16.jpg)
http://kdd.isti.cnr.it/uma Urban Mobility Atlas
![Page 17: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/17.jpg)
PROACTIVE CARPOOLINGPartner: Octo Telematics, PA
![Page 18: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/18.jpg)
Car Pooling
Carpooling Network
Carpooling Communities
Trajectory matching
![Page 19: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/19.jpg)
Carpooling potentialPISA
16467 users, 357137 trips
20% systematic trips
40% matching trips
142.740.060 saved Kms
FLORENCE
34864 users, 1040872 trips
9% systematic trips
58% matching trips
220.802.240 saved Kms
![Page 20: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/20.jpg)
ELECTRIFIABILITY
Partner: Octo, PA
![Page 21: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/21.jpg)
Electrifiability
90.5% of daily trips are electrifiable
In Tuscany 66% of users have a dailymobility 100% covered by an electrical vehicle(home to home)
![Page 22: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/22.jpg)
Electrifiability index
90%
10%
Pisa
Yes No
85%
15%
Livorno
Yes No
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
dim. 1
mar. 3
jeu. 5
sam. 7
lun. 9
mer. 11
ven. 13
dim. 15
mar. 17
jeu. 19
sam. 21
lun. 23
mer. 25
ven. 27
dim. 29
mar. 31
Firenze
Yes No
![Page 23: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/23.jpg)
CITY USERS’ SOCIOMETER
Partner: Telecomunicazioni, PA, ISTAT
![Page 24: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/24.jpg)
Dimmi come chiami…ti dirò chi sei!
A
Residente
B
Pendolare
A
A
B
Visitore
![Page 25: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/25.jpg)
Anonimizzazione
City User Sociometer
Chiamate
Mappa dei profili
Analisi di data mining
Pendolari
Visitatori/Turisti
ResidentiProfilo aggregato
userIDCellSta
rtIDCellEn
dIDTimestampStart TimestampEnd
109259401503
PI010U2
PI010U2
2012-01-19 18:37:15+01
2012-01-19 18:38:07+01
109259401503
PI002U2
PI002U2
2012-01-19 18:46:33+01
2012-01-19 18:46:44+01
109259401503
PI002U2
PI002U2
2012-01-19 18:53:10+01
2012-01-19 18:53:33+01
109263991410
PI034U1
PI034U1
2012-01-18 13:59:20+01
2012-01-18 14:02:33+01
109269325201
PI023U1
PI023U1
2012-01-24 11:03:21+01
2012-01-24 11:04:56+01
![Page 26: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/26.jpg)
Urban Sociometer: the city user meter
Pisa january 2012
![Page 27: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/27.jpg)
ISTAT – Commissione Big Data
Measuring urban population and inter-city mobility using big data in an integratedapproach
Barbara Furletti, Lorenzo Gabrielli, Giuseppe Garofalo, Fosca Giannotti, Letizia Milli, Mirco Nanni, Dino Pedreschi, Roberta Vivio
KDD LAB – Univ. Pisa & ISTI CNR, ISTAT SIS 2014 – 47° Simposio Italiano di Statistica
![Page 28: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/28.jpg)
MP4-A Project: Mobility Planning For Africa
A joint work of &
kdd.isti.cnr.it www.goudappel.nl
![Page 29: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/29.jpg)
Mirco Nanni, Roberto Trasarti, et al.: MP4-A Project: Mobility Planning for Africa. “Data for Development” Orange challenge, 2013
![Page 30: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/30.jpg)
Mirco Nanni, Roberto Trasarti, et al.: MP4-A Project: Mobility Planning for Africa. “Data for Development” Orange challenge, 2013
![Page 31: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/31.jpg)
Measuring exceptional events
0
0,01
0,02
0,03
0,04
0,05
0,06
0,07
0,08
Giovedi Venerdi Sabato Domenica
Presenze
Presence of Visitors GSM - Pisa - Historical Center
Presenze Internet Festival Presenza media settimanale
00,050,1
0,150,2
0,250,3
0,350,4
0,45
Giovedi Venerdi Sabato Domenica
Presenze
Presence of Visitors GSM - Lucca Comics 2012
Presenze Comics 2012 Presenza media settimanale
![Page 32: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/32.jpg)
Extraordinary events
![Page 33: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/33.jpg)
DIVERSITY & WELL‐BEING
Partner: Octo, WIND, Orange Telecom
![Page 34: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/34.jpg)
![Page 35: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/35.jpg)
![Page 36: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/36.jpg)
![Page 37: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/37.jpg)
![Page 38: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/38.jpg)
![Page 39: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/39.jpg)
MOBILITY BORDERS
![Page 40: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/40.jpg)
![Page 41: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/41.jpg)
big data | public good
![Page 42: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/42.jpg)
![Page 43: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/43.jpg)
![Page 44: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/44.jpg)
“Personal data is the new oil of the Internet and the new currency of the digital world”Maglena Kuneva, former European
Commissioner of Consumer Protection
![Page 45: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/45.jpg)
Who’s got the big benefits so far?
A few latifundists of data GAFA
Profiling for behavioral advertising and target marketing
NSA
Profiling for discovering potential terroristsMass surveillance … STASI_2.0
![Page 46: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/46.jpg)
EUROPEAN WAY TO BIG DATA
PRIVACY-BY-DESIGN
NEW DEAL ON DATA
![Page 47: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/47.jpg)
Privacy-by-Design in Data Analytics
Anonymization
Service ProviderMining and
Analytical Engine
Anonymization is not trivial
De‐identification is not enough
![Page 48: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/48.jpg)
Anonimizzazione
City User Sociometer with Privacy-by-design
Chiamate
Mappa dei profili
Analisi di data mining
Pendolari
Visitatori/Turisti
ResidentiProfilo aggregato
userIDCellSta
rtIDCellEn
dIDTimestampStart TimestampEnd
109259401503
PI010U2
PI010U2
2012-01-19 18:37:15+01
2012-01-19 18:38:07+01
109259401503
PI002U2
PI002U2
2012-01-19 18:46:33+01
2012-01-19 18:46:44+01
109259401503
PI002U2
PI002U2
2012-01-19 18:53:10+01
2012-01-19 18:53:33+01
109263991410
PI034U1
PI034U1
2012-01-18 13:59:20+01
2012-01-18 14:02:33+01
109269325201
PI023U1
PI023U1
2012-01-24 11:03:21+01
2012-01-24 11:04:56+01
![Page 49: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/49.jpg)
A NEW DEAL ON PERSONAL DATA
DEMOCRATIZING BIG DATA
![Page 50: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/50.jpg)
A user-centric ecosystem for Big Data
Engage people in the creation and use of big data and knowledge, by empowering individuals with self-knowledge
Incentivize individual to participate, to align ownself-interest with broader societal goals
Based on transparency, trust & privacy
![Page 51: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/51.jpg)
Collective KnowledgeCollective
Knowledge
Personal data store
for self knowledge
Personal data store
for self knowledge
Individual profiles
Collective patterns
Conoscenzadi seSelf‐awarenessNovel
Indicators
Conoscenza individuale e conoscenza collettiva
Social mining of individual histories
Mobility DataMobility Data
Mobility DataMobility Data
Mobility DataMobility Data
Mobility DataTraditional DB
sources
Social mining of many individuals
![Page 52: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/52.jpg)
Key publications F Giannotti, M Nanni, F Pinelli, D Pedreschi. Trajectory pattern mining. ACM SIGKDD
2007 F Giannotti, D Pedreschi. Mobility, data mining and privacy: Geographic knowledge
discovery. Springer, 2008 A Monreale, F Pinelli, R Trasarti, F Giannotti. WhereNext: a location predictor on
trajectory pattern mining. ACM SIGKDD 2009 S Rinzivillo, D Pedreschi, M Nanni, F Giannotti, N Andrienko, G Andrienko. Visually
driven analysis of movement data by progressive clustering. Information Visualization7 (3-4), 225-239. 2008
D Wang, D Pedreschi, C Song, F Giannotti, AL Barabasi. Human mobility, social ties, and link prediction. ACM SIGKDD 2011
F Giannotti, M Nanni, D Pedreschi, F Pinelli, C Renso, S Rinzivillo, R Trasarti. Unveilingthe complexity of human mobility by querying and mining massive trajectory data. The VLDB 20(5) 2011
R Trasarti, F Pinelli, M Nanni, F Giannotti. Mining mobility user profiles for car pooling. ACM SIGKDD 2011
![Page 53: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/53.jpg)
Key publications M Coscia, G Rossetti, F Giannotti, D Pedreschi. Demon: a local-first
discovery method for overlapping communities. ACM SIGKDD 2012 S Rinzivillo, S Mainardi, F Pezzoni, M Coscia, D Pedreschi, F
Giannotti. Discovering the geographical borders of human mobility. KI-Künstliche Intelligenz 26 (3) 2012
D Pennacchioli, M Coscia, S Rinzivillo, D Pedreschi, F Giannotti. Explaining the Product Range Effect in Purchase Data. IEEE BIGDATA 2013
B Furletti, L Gabrielli, C Renso, S Rinzivillo. Analysis of GSM Calls Data for Understanding User Mobility Behavior. IEEE BIG DATA 2013
L Milli, A Monreale, G Rossetti, D Pedreschi, F Giannotti, F Sebastiani. Quantification trees. IEEE ICDM 2013
![Page 54: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/54.jpg)
Vision papers
F Giannotti, D Pedreschi, A Pentland, P Lukowicz, D Kossmann, J Crowley, D Helbing. A planetary nervous system for social mining and collective awareness. The European Physical Journal Special Topics 214 (1), 49‐75, 2012
J van den Hoven, D Helbing, D Pedreschi, J Domingo‐Ferrer, F Giannotti . FuturICT—The road towards ethical ICT. The European Physical Journal Special Topics 214 (1), 153‐181, 2012
M Batty, KW Axhausen, F Giannotti, A Pozdnoukhov, A Bazzani, M Wachowicz. Smart cities of the future. The European Physical Journal Special Topics 214 (1), 481‐518, 2012
![Page 55: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/55.jpg)
Special thanks to …
Fosca Giannotti, co‐lead of KDD LAB [email protected]
Salvo Rinzivillo, Mirco Nanni, Roberto Trasarti, Salvatore Ruggieri, Chiara Renso, Anna Monreale, Franco Turini
all the fantastic folks at KDD LAB Pisa many international collaborators
![Page 56: Dino pedreschi keynote ieee cist 2014 BIG DATA ANALYTICS & SOCIAL MINING](https://reader036.fdocuments.net/reader036/viewer/2022062308/559c076b1a28abaa188b489c/html5/thumbnails/56.jpg)
Knowledge Discovery & Data Mining Laboratory | kdd.isti.cnr.it