On Data quality

8
AMSTERDAM ON DATA QUALITY Marco Fossati [email protected] 30TH JANUARY 2014

Transcript of On Data quality

Page 1: On Data quality

AMSTERDAM

ON DATA QUALITYMarco Fossati [email protected]

30TH JANUARY 2014

Page 2: On Data quality

MAPPING PARADIGM

A. TEMPLATE-DEPENDENT ERROR-PRONE HETEROGENEOUS USAGE

!

B. FULLY MANUAL COSTLY

�2

SolutionMACHINE LEARNING-BASED METHODS

TYPE INFERENCE CONFIDENCE SCORE MAPPING ASSISTANT

Problem

Page 3: On Data quality

ONTOLOGY

COMMUNITY-BASED SHALLOW SEMANTICS LACK OF COVERAGE UNBALANCED • TOO GENERIC • REDUNDANT

�3

SolutionA. CONSISTENCY CHECK

CLASS USAGE B. DATA-DRIVEN SCHEMA

WIKIPEDIA CATEGORIES

Problem

Page 4: On Data quality

LINKING MULTIMEDIA DATA SOURCESPHOTO AUDIO VIDEO

�4

Page 5: On Data quality

PHOTO !

FLICKR WRAPPERMAINTENANCE? UPDATES?

�5

Page 6: On Data quality

AUDIOBANDCAMP GROOVESHARK RDIO SOUNDCLOUD

�6

Page 7: On Data quality

VIDEOIMDB ROTTEN TOMATOES VIMEO YOUTUBE

�7

Page 8: On Data quality

THANKS FOR YOUR ATTENTION!

Marco Fossati [email protected]


Effects of various on data collection techniques on quality and reliability of data.

Effects of various on data collection techniques on quality and reliability of data.

Effects of Data Quality on Predictive Hotspot Mapping

Effects of Data Quality on Predictive Hotspot Mapping

Hearing on Ensuring the Quality of Quality Data Friday, November 30, 2012

Hearing on Ensuring the Quality of Quality Data Friday, November 30, 2012

Effects of mobile devices on data quality in web-based surveys · GOR 2018 | Effects of mobile devices on data quality in web-based surveys Data Quality Closed Questions (Average

Effects of mobile devices on data quality in web-based surveys · GOR 2018 | Effects of mobile devices on data quality in web-based surveys Data Quality Closed Questions (Average

NASA Perspectives on Data Quality

NASA Perspectives on Data Quality

Validation of Highway Engineering Data Quality on ... 31, 2010 · Validation of Highway Engineering Data Quality on Wisconsin Crash Reports Andrea Bill

Validation of Highway Engineering Data Quality on ... 31, 2010 · Validation of Highway Engineering Data Quality on Wisconsin Crash Reports Andrea Bill

control data based on validation and quality BSI Standards ... · Water quality — Estimation of measurement uncertainty based on validation and quality control data This is a preview

control data based on validation and quality BSI Standards ... · Water quality — Estimation of measurement uncertainty based on validation and quality control data This is a preview

Handbook on Data Quality Assessment Methods and Tools

Handbook on Data Quality Assessment Methods and Tools

D5.3 Report on validation of data quality management ...

D5.3 Report on validation of data quality management ...

Improving wildlife data quality: guidance on data ...

Improving wildlife data quality: guidance on data ...

Cern -April 24, 2007Atlas Data Quality Workshop M. Primavera1 Muon EF Data Quality Muon EF Data Quality M. Primavera - I.N.F.N. Lecce on behalf of Muon.

Cern -April 24, 2007Atlas Data Quality Workshop M. Primavera1 Muon EF Data Quality Muon EF Data Quality M. Primavera - I.N.F.N. Lecce on behalf of Muon.

Update on the progress of the TRANSPARENCY … › public...Update on the progress in data completeness and quality Page 8 Data quality • A data quality proposal would also imply

Update on the progress of the TRANSPARENCY … › public...Update on the progress in data completeness and quality Page 8 Data quality • A data quality proposal would also imply

DMTM Data Exploration and Preprocessing · Why Is Data Preprocessing 37 Important? No quality data, no quality mining results! Quality decisions must be based on quality data E.g.,

DMTM Data Exploration and Preprocessing · Why Is Data Preprocessing 37 Important? No quality data, no quality mining results! Quality decisions must be based on quality data E.g.,

Webinar on Environmental Footprint data quality

Webinar on Environmental Footprint data quality

Laboratory Quality Assurance and Quality Control Data Quality Assessment and Data ... · LABORATORY QUALITY ASSURANCE AND QUALITY CONTROL GUIDANCE DATA QUALITY ASSESSMENT AND DATA

Laboratory Quality Assurance and Quality Control Data Quality Assessment and Data ... · LABORATORY QUALITY ASSURANCE AND QUALITY CONTROL GUIDANCE DATA QUALITY ASSESSMENT AND DATA

Report on the Quality of 2016 Census Data

Report on the Quality of 2016 Census Data

Best Practices in Ensuring Data Quality in Quality Rating ... · PDF fileBest Practices in Ensuring Data Quality in ... on-site data collection methods. Collect data about all ...

Best Practices in Ensuring Data Quality in Quality Rating ... · PDF fileBest Practices in Ensuring Data Quality in ... on-site data collection methods. Collect data about all ...

Overview on Project and Data Quality

Overview on Project and Data Quality

Handbook on Data Quality Assessment Methods and Tools ON... · Handbook on Data Quality Assessment Methods and Tools ... 13 2.2 Measurement of Process Variables ... This Handbook

Handbook on Data Quality Assessment Methods and Tools ON... · Handbook on Data Quality Assessment Methods and Tools ... 13 2.2 Measurement of Process Variables ... This Handbook

Guidance on systematic planning using data quality process

Guidance on systematic planning using data quality process