Urban*: Crowdsourcing for the good of London

@danielequerciaYahoo! Labs, Barcelona

daniele quercia

offline & online

offline & online

Facebook+

census deprivation + data

So what?

Situation

(Its already 75% in the USA)

Situation

By 2025 another 1.2 billion living in urban areas

Situation

Cities in developing countries: 5M new inhabitants each month

Problem

Inequality! Timely allocation of scarce resources

census deprivation + londoners on twitter

1 census deprivation + sentiment

[CSCW’12] Tracking Gross Community Happiness from Tweets

3 match sentiment with (census) deprivation

2 classify sentiment of profiles

1 collect profiles & geo-reference them

250K profiles in London (31.5M tweets)

3 seeds: newspaper accounts

1 collect profiles & geo-reference them

1,323 in London neighborhoods 573 in 51 neighborhoods

social media language personality

r=.350 word count r=.365 MaxEnt

predicting socioeconomic well-being with twitter

2 census deprivation + topics

social media environment sports health Royal wedding

Spanish/Portuguesecelebrity gossips

Talk of the City [ICWSM’12]

read profiles & define topics

create virtual bins (latent topics)assign words to a bin (@ random)for each bin: select pair of words if co-occur more than chance: keep them in the bin else: put them into another bin (@ random)

Facebook Twitter

read profiles & define topics

create virtual bins (latent topics)assign words to a bin (@ random)for each bin: select pair of words if co-occur more than chance: keep them in the bin else: put them into another bin (@ random)

Facebook Twitter

social

econometrics

read profiles & define topics

create virtual bins (latent topics)assign words to a bin (@ random)for each bin: select pair of words if co-occur more than chance: keep them in the bin else: put them into another bin (@ random)

Facebook Twitter

social

econometrics

Latent Dirichlet Allocation (LDA)

Latent Dirichlet Allocation (LDA)

Analyze geo-referenced tweets(not only residents but also visitors)

Linear Regression R2=.49 (49% of IMD variability explained)

3 census deprivation + tube trips

4 census deprivation + “mental maps”

Psychological Maps 2.0 [WWW’13]

draw a map

WEIRD trap!Few hundreds of WEIRDosWhite,Educated,Industrialized,Rich, and Democratic undergraduates

WWW

launched few months ago > 2K players

Regions

Regions

Boroughs

Boroughs

Londoners vs. UK vs. World

Vibility vs. Exposure

Visibility & Social Deprivation

5 Beyond visibility… UrbanGems.org To quantify “fuzzy” concepts

Research?

This work is at intersection of two emerging fields: a) computational aesthetic b) computational geo-cultural modeling

unleashing the potential of mobile datavs0

@danielequercia