Civic CrowdAnalytics: Making sense of crowdsourced civic input with big data tools
24
Civic CrowdAnalytics: Making sense of crowdsourced civic input with big data tools Tanja Aitamurto Kaiping Chen Ahmed Cherif Jorge Saldivar Galli Luis Santana 1
-
Upload
mindtrek -
Category
Technology
-
view
61 -
download
1
Transcript of Civic CrowdAnalytics: Making sense of crowdsourced civic input with big data tools
Civic CrowdAnalytics:Making sense of crowdsourced civic input
with big data tools !!
Tanja Aitamurto Kaiping Chen Ahmed Cherif
Jorge Saldivar Galli Luis Santana
1!
2!
3!
Vote
Crowdsourcing ideas and solutions
for policy
4!
Crowdsourced urban planning strategy
5!
Hillary Gitelman, Urban planner, City of Palo Alto 6!
Piles of unstructured data
7!
Civic data overload
8!
Bottleneck in participatory channel
Citizens’ input
Policy
Lack of data analytics tools 9!
x!What if our votes were not counted?
10!
Civic CrowdAnalytics Web application for analyzing civic data with Natural Language Processing and machine
learning
Sentiment analysis; Find related concepts
Categorization
11!
12!
Dashboard
13!
Categorization
14!
Dig deeper
15!
Sentiment analysis
16!
Crowd’s impact on policy
Key findings
• The more (categorization) and the stronger (sentiment analysis) the crowd’s demands are, the more likely to make it to the policy
• CAC’ agenda reflects less the crowd’s suggestions than the policy
• High frequency terms (concept occurrences) reflect the level of expertise in policymaking
17!
18!
Top key terms and occurrences(Subcategory: Big picture infrastructure)
Crowd’s input Cars (19), driving (16), road (12)
CAC input Development (16), traffic congestion(15), traffic safety (10)
Policy!
Traffic (22), improvement (14), safety (12)
From piles of unstructured data to structured results
19!
NLP for civic use !• 80% accuracy rate at best
• Disproportionally laborious training for small datasets
• Larger datasets for improved accuracy
• Using the best of NLP for civic purposes
• Training algorithms across cases à “Cross-training” crowdsourced policymaking efforts in several countries
20!
Open Government Partnership countries
Commitment for civic engagement and transparency
21!
Crowdsourced constitution in Chile
Over 30,000 submissions
23!
24!
