Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the...
Transcript of Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the...
![Page 1: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/1.jpg)
Italian National Digital Data PlatformThe Data & Analytics Framework for Public Administration & Citizens
ANDREA CARLINI
Chief Data Product Manager
SIMONE PIUNNO
Chief Technical Officer
![Page 2: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/2.jpg)
Team of ExpertsTeam of Experts
DataGovernance
DataGovernance
Tech Platform
Tech Platform
Cloud Infrastructure
Data Engineers
Ontologies & Controlled VocsOrganizations & Access Groups
Data Protection
Officer
CyberSecurity
Officer
Data Scientist
Analytics as a Service
Data Applications
Web API
Big Data Lake
Common Data Warehouse
GDPR Compliancy
Regulations
DCAT – AP_IT
![Page 3: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/3.jpg)
Problem Addressed - Milestones
• Compliance
Models and Tools to simplify the
pubblication and sharing of Data in
Compliance with Security and Data
Protection Regulations ( GDPR )
• Interoperability
Central data collection and distribution,
breaking data silos
• Democratization
Easy self service access to open data for
everyone
• Standardization
Catalogs, Ontologies, Metadata and Data
quality and validation
• Valorization
Provide Policy makers with data driven
decision tools and models
• Engagement
Communities of Developers and Citizens,
civic tech, Data Journalism
![Page 4: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/4.jpg)
CAD ( Code for Digital Administration ) article 50-ter
Introduces the Piattaforma Digitale Nazionale Dati ( National Digital Data Platform )
and the mandatory provisioning for trategic data sets.
Regulations in support to PDND
![Page 5: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/5.jpg)
History and Roadmap
DAF included in
the ICT PA Three
Year Plan
Art 50 Ter
from DAF to
PDND
First
Prototype
Start testing with
Public
Administrations
2017 2018 2019
Start of the
Consolidation and
Rollout Phase
Go Live &
Continuous
Development
2019 +
![Page 6: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/6.jpg)
PDND e SaaS : PDND as a Service
PDND adopts the application software distribution model as a Service ( SaaS ). The Digital Transformation Team is responsible for its maintenance, support and development. This simplify the duties a Public Administration must follow, in the management and sharing of Public Data , to make them “good” and “valuable” Data.
![Page 7: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/7.jpg)
PDND e SaaS : PDND as a Service
Data Lake & Data Hub
Open Source Forum - Slack Linked dataDocs
CKANPrivate front-end Public front-end
Developers, Designers, Docs CommunitiesDevelopers, Designers, Docs Communities
Technology & ServicesTechnology & Services
TechnologyTechnology
![Page 8: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/8.jpg)
Case Studies
![Page 9: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/9.jpg)
PDND as Data Hub
Problem Addressed
Complexity in the acquisition and redistribution of Data,
in conformity with Data Protection and Security
Regulations (GDPR)
PDND is a secure and standardized framework for the
acquisition, control and redistribution of data. It uses a
Catalog and Onthology Service, and segregates Data
into Organizations, Roles and Access Groups
Example
The Anti-Corruption Authority ( ANAC ) must collect
data related to tenders from many public
administrations. After normalizing and filtering them, it
must share the results with many other public
administrations
![Page 10: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/10.jpg)
OpenData as-a-service
Problem Addressed
Open Data platform as a service
Branded version of the PDND
DCAT_AP-IT by default
Example
The Municipality of Turin has configured the
PDND DataPortal to appear as their “Open Data
Portal”, where all searches retrieves only results
from their DataSets
![Page 11: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/11.jpg)
Analytics as-a-service
Problem Addressed
PAs needs to aggregate and analyze their data and
create Dashboards to support their decision making
processes.
it is provided as a simple but effective set of software
for data aggregation and exploration
Example
City of Milan: through the creation of a data
application showing geographical maps with various
key performance indicators, aimed to support the
planning of investments in the territory
SuperSet Dashboards & Data Applications
![Page 12: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/12.jpg)
Data stories / Storytelling
Problem Addressed
Pubblic Administrations needs to
communicate with citizens using data.
PDND is a Data Storytelling service
Example
From the data of the Inventory of National
Enterprise Incentives we created a Data Story
telling where founding has been distributed.
Graphs are taken from the PDND superset
widgets and are dynamically updated as soon
as new data comes into the platform.
![Page 13: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/13.jpg)
OpenAPI & 3rd Party Tools for DataViz, BI, Analytics
Example
Public Administrations that already have commercial
tools for Data Viz, BI or Data Science, can connect
directly to the PDND DataSets using our Web APIs
![Page 14: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/14.jpg)
Ongoing
Developments
![Page 15: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/15.jpg)
Personal Data Protection Rules / Privacy by Design
Problem Addressed
Support the Public Administration in the
compliancy with GDPR
How
Implementation of Data Protection Impact
Assessment Forms in the Ingestion and Data
Sharing processes
Link impact assessments to every DataSet that
contains personal data
Ingestion
Sharing
Publish data
![Page 16: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/16.jpg)
Data Governance Enhancement
Data Quality Services
Problem Addressed
Data Quality
How
Implementation of an integrated Data Governance
Framework that takes advantages of Standard
Catalogs and Onthologies to create data quality
control services to seamlessly identify personal or
sensitive information
Cleaned
Good
Clean
Integrate
![Page 17: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/17.jpg)
Follow us:
teamdigitale.governo.it
pianotriennale-ict.italia.it
io.italia.it
@ITdigitalteam
@team-per-la-trasformazione-digitale
@company/teamdigitale
![Page 18: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/18.jpg)
PDND Team
Piattaforma Digitale Nazionale Dati
![Page 19: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/19.jpg)
Architettura modulare e open source
Data Lake & Data Hub Platform
![Page 20: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/20.jpg)
https://dataportal.daf.teamdigitale.itPrivate DataPortal
https://dataportal.daf.teamdigitale.it/#/private
![Page 21: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/21.jpg)
https://dataportal.daf.teamdigitale.itPublic DataPortal
https://dataportal.daf.teamdigitale.it
![Page 22: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/22.jpg)
OpenData Portal ( CKAN )https://ckan-geo.daf.teamdigitale.it
![Page 23: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/23.jpg)
Open Source Code ( GitHub )https://github.com/italia/daf
![Page 24: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/24.jpg)
Docs, Processes, Procedureshttps://docs.italia.it/
![Page 25: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/25.jpg)
Slack : developersitalia.slack.com
Communication
![Page 26: Italian National Digital Data Platform€¦ · PDND as Data Hub ProblemAddressed Complexity in the acquisition and redistribution of Data, in conformity with Data Protection and Security](https://reader034.fdocuments.net/reader034/viewer/2022042308/5ed503f7ad38025d974e44cc/html5/thumbnails/26.jpg)
Semantica ed Ontologie : OntoPiAhttps://ontopia.daf.teamdigitale.it/webvowl/