Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track...
Transcript of Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track...
![Page 1: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/1.jpg)
Managing Big Data with privacy in mind
Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017
![Page 2: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/2.jpg)
Two related projects
Two research projects:
BDE, 2015‒2017: general platform for big dataSPECIAL, 2017‒2019: privacy for big data
By W3C and ERCIM (European host of W3C),in cooperation with a number of partners.
![Page 3: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/3.jpg)
Big Data Europe: Consortium
![Page 4: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/4.jpg)
Big Data Europe: Funding
![Page 5: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/5.jpg)
What is Big Data?
‘Data too big to process with a single computer.’
![Page 6: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/6.jpg)
The three V’s
Source: Gesellschaft für Informatik
VelocityVolume
Variety… but Variety is often neglected.
![Page 7: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/7.jpg)
Handling ‘Volume’ & ‘Velocity’
Use specialised softwareo HFDS, Spark, Flume, etc.Use parallel computing
BDE provides these and other software as Docker containers → easy to deploy on a ‘swarm’ of machines → scalable to many nodes.
![Page 8: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/8.jpg)
’Variety’
Generic Big Data Enabling Technologies
Data Value Chain
Data Generation
& Acquisition
Data Analysis &
Processing
Data Storage &
Curation
Data
Visualization &
Usage
Data-driven
Services
Socie
tal C
halle
nges
Dom
ain
Specific
Data
Assets
& T
echnolo
gy
Healthcare
Food Security
Energy
Intelligent Transport
Climate & Environment
Inclusive & Reflective Societies
Secure Societies
![Page 9: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/9.jpg)
Handling ‘Variety’
How to handle different kinds of data,and even correlate them.
Answer: metadata
(a.k.a., Semantic Web, RDF, LD, LOD… Did you expect a different answer in the W3C Track? ☺)
![Page 10: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/10.jpg)
RDF and SPARQL
Metadata tells how to process the dataAllows to view the data as RDF→ allows SPARQL queries
But:
Most data isn’t actually converted to RDFInstead, the query is translated
![Page 11: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/11.jpg)
Who owns the data?
Addition under consideration:
Metadata about permissible actions on data
Could be ODRL.
(ODRL should be a W3C Recommendation by the end of the year.)
![Page 12: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/12.jpg)
On to SPECIAL
And that brings us to privacy…
… and SPECIAL
![Page 13: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/13.jpg)
SPECIAL: Consortium
![Page 14: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/14.jpg)
SPECIAL: Funding
![Page 15: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/15.jpg)
Metadata (again)
Builds on Big Data EuropePrivacy added by means of metadataIn particular: a model of the EU General Data Protection Regulation
(consent, anonymisation, erasure, etc.)o (It’s a European project, after all)o which should come into force in 2018o But likely useful outside EU
![Page 16: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/16.jpg)
Additional modules
Also:
Tools to import privacy policies in different formatsTools to anonymise dataTools to visualise & explain policiesVersioning of policies
![Page 17: Managing Big Data with privacy in mind...Managing Big Data with privacy in mind Bert Bos W3C Track at WWW 2017, Perth (Australia), 6 April 2017 Two related projects Two research projects:](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f7243e65c20043c89544268/html5/thumbnails/17.jpg)
The end
SPECIAL https://www.specialprivacy.eu/Big Data Europe https://www.big-data-europe.eu/
Bert Bos <[email protected]> GPG fingerprint: 7744 0204 52A5 14D9 147D
2A13 2D7A E420 184B 5BA4
https://www.w3.org/Talks/2017/0406-BDE-SPECIAL-WWW2017