Data Deluge and Data Sharing Platform
-
Upload
vincenzo-patruno -
Category
Technology
-
view
1.553 -
download
1
Transcript of Data Deluge and Data Sharing Platform
![Page 1: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/1.jpg)
Data Deluge and Data Sharing Platform
Vincenzo PatrunoISTAT
Michelangelo, the deluge
IMAODBC 2011Óbidos 19-23 Sept
![Page 2: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/2.jpg)
data deluge
“the sheer volume of new data being generated is overwhelming the capacity of institutions to manage it and researchers to make use of it”.
IMAODBC 2011Óbidos 19-23 Sept
![Page 3: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/3.jpg)
data dissemination
Data Producers Data Consumers
IMAODBC 2011Óbidos 19-23 Sept
![Page 4: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/4.jpg)
who are data producers?
National Statistical Offices
IMAODBC 2011Óbidos 19-23 Sept
![Page 5: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/5.jpg)
who are data producers?
National Statistical Offices
Government Agencies
IMAODBC 2011Óbidos 19-23 Sept
![Page 6: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/6.jpg)
who are data producers?
National Statistical Offices
Government Agencies
Regions
IMAODBC 2011Óbidos 19-23 Sept
![Page 7: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/7.jpg)
who are data producers?
National Statistical Offices
Government Agencies
Regions
Municipalities
IMAODBC 2011Óbidos 19-23 Sept
![Page 8: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/8.jpg)
who are data producers?
National Statistical Offices
Government Agencies
Regions
Municipalities………………
IMAODBC 2011Óbidos 19-23 Sept
![Page 9: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/9.jpg)
opendata and datagov initiatives
Datagov initiatives are rising all over in the world
IMAODBC 2011Óbidos 19-23 Sept
![Page 10: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/10.jpg)
set the data free
Open data initiatives drive Public Sector to set the data free
IMAODBC 2011Óbidos 19-23 Sept
![Page 11: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/11.jpg)
the risk is to put data in jailIMAODBC 2011
Óbidos 19-23 Sept
![Page 12: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/12.jpg)
the data huntingIMAODBC 2011
Óbidos 19-23 Sept
![Page 13: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/13.jpg)
time consuming
=
IMAODBC 2011Óbidos 19-23 Sept
![Page 14: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/14.jpg)
open data and datagov initiatives
Data Catalogs
IMAODBC 2011Óbidos 19-23 Sept
![Page 15: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/15.jpg)
open data and datagov initiativesIMAODBC 2011
Óbidos 19-23 Sept
![Page 16: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/16.jpg)
datamarket platforms
…
IMAODBC 2011Óbidos 19-23 Sept
![Page 17: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/17.jpg)
unstructured data
the growth of data deluge
the growth of unstructured data
IMAODBC 2011Óbidos 19-23 Sept
![Page 18: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/18.jpg)
structured dataIMAODBC 2011
Óbidos 19-23 Sept
![Page 19: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/19.jpg)
structured dataIMAODBC 2011
Óbidos 19-23 Sept
![Page 20: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/20.jpg)
metadataIMAODBC 2011
Óbidos 19-23 Sept
![Page 21: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/21.jpg)
metadataIMAODBC 2011
Óbidos 19-23 Sept
![Page 22: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/22.jpg)
The data Sharing PlatformIMAODBC 2011
Óbidos 19-23 Sept
![Page 23: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/23.jpg)
Upload dataset
+unstructured
metadata(descriptions)
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
![Page 24: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/24.jpg)
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
![Page 25: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/25.jpg)
country area time value
US Wyoming Year 2008
1065336
US Wisconsin Year 2008 11255934
US West Virginia
Year2008
3628936
Resident population
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
![Page 26: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/26.jpg)
data metadata
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
![Page 27: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/27.jpg)
country area time value
US Wyoming Year 2008
1065336
US Wisconsin Year 2008 11255934
US West Virginia
Year2008
3628936
Resident population
001 US 001 Wyoming 001 Year 2008
metadatabase
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
![Page 28: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/28.jpg)
country area time value
US Wyoming Year 2008
1065336
US Wisconsin Year 2008 11255934
US West Virginia
Year2008
3628936
Resident population
001 US 001 Wyoming 001 Year 2008
metadatabase
… Level of detail
Time from
Time to Area code
Category Dataset
… Regional 2008 2008 US Population Resident Population
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
![Page 29: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/29.jpg)
Upload dataset data
metadataMatching1
2
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
![Page 30: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/30.jpg)
Public matadata Private metadata
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
![Page 31: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/31.jpg)
public matadata
private metadata
data
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
![Page 32: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/32.jpg)
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
![Page 33: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/33.jpg)
Upload dataset dati
metadatiMatching
Json
Web GUI
SPARQL
SDMX Query Builder
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
![Page 34: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/34.jpg)
the vision
data on the web
data in the Web
IMAODBC 2011Óbidos 19-23 Sept
![Page 35: Data Deluge and Data Sharing Platform](https://reader036.fdocuments.net/reader036/viewer/2022081516/554994adb4c90583678b5a28/html5/thumbnails/35.jpg)
the end of data deluge
Thank [email protected]
http://www.vincenzopatruno.orghttp://www.segnalazionit.org
IMAODBC 2011Óbidos 19-23 Sept