BID CE workshop 1 session 08 - Biodiversity Data Cleaning
-
Upload
alberto-gonzalez-talavan -
Category
Education
-
view
383 -
download
0
Transcript of BID CE workshop 1 session 08 - Biodiversity Data Cleaning
![Page 1: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/1.jpg)
24 AUGUST 2016THE BID PROGRAMME IS FUNDED BY THE EUROPEAN UNION
Data CleaningNestor Beltran
![Page 2: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/2.jpg)
DATA CURATION, FORMATTING & TRANSFORMATION
Basic concepts of data cleaning
![Page 3: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/3.jpg)
MANIPULATION, FORMATAGE ET TRANSFORMATION DE DONNÉES
Concepts de base sur le nettoyage des données
![Page 4: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/4.jpg)
What is data cleaning?A process used to improve the
quality through correction of detected errors and omissions
• Define and determine error types
• Search and identify error instances
• Correct the errors
• Document error instances and error types
• Modify data entry procedures to reduce future errors
![Page 5: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/5.jpg)
• Définir et déterminer les erreurs types
• Chercher et identifier les occurrences d’erreurs
• Corriger les erreurs
• Documenter les cas d’erreurs et d’erreurs types
• Modifier le procédé d’entrée de données afin de réduire les erreurs futures
Qu'est-ce que c'est le nettoyage de données ?Un procédé utilisé pour
améliorer la qualité en corrigeant les erreurs détectées et les oublis
![Page 6: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/6.jpg)
The need for Data Cleaning
Is centred around improving the quality of data to make them
“fit for use”
![Page 7: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/7.jpg)
La nécessité du Nettoyage des Données
Englobe l’amélioration de la qualité des données afin de les rendre
“adaptées à l’emploi”
![Page 8: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/8.jpg)
DATA CURATION, FORMATTING & TRANSFORMATION
Principles of Data Cleaning
![Page 9: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/9.jpg)
MANIPULATION, FORMATAGE ET TRANSFORMATION DE DONNÉES
Principes du Nettoyage des Données
![Page 10: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/10.jpg)
Principles
●Planning
![Page 11: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/11.jpg)
Principes
●Préparation
![Page 12: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/12.jpg)
Principles
●Planning●Organizing
![Page 13: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/13.jpg)
Principes
●Préparation●Organisation
![Page 14: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/14.jpg)
Principles
●Planning●Organizing●Prevention
![Page 15: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/15.jpg)
Principes
●Préparation●Organisation●Prévention
![Page 16: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/16.jpg)
Principles
●Planning●Organizing●Prevention●Responsibility
![Page 17: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/17.jpg)
Principes
●Préparation●Organisation●Prévention●Responsabilité
![Page 18: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/18.jpg)
Principles
●Planning●Organizing●Prevention●Responsibility●Partnership
![Page 19: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/19.jpg)
Principes
●Préparation●Organisation●Prévention●Responsabilité●Partenariat
![Page 20: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/20.jpg)
Principles
●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation
![Page 21: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/21.jpg)
Principes
●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser
![Page 22: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/22.jpg)
Principles
●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation●Performance measures
![Page 23: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/23.jpg)
Principes
●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser●Mesures de
Performance
![Page 24: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/24.jpg)
Principles
●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation●Performance measures●Optimization●Feedback●Training●Transparency●Documentation
![Page 25: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/25.jpg)
Principes
●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser●Mesures de
Performance●Optimisation●Feedback●Formation●Transparence●Documentation
![Page 26: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/26.jpg)
Principles
●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation●Performance measures●Optimization●Feedback●Training●Transparency●Documentation
![Page 27: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/27.jpg)
Principes
●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser●Mesures de
Performance●Optimisation●Feedback●Formation●Transparence●Documentation
![Page 28: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/28.jpg)
Principles
●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation●Performance measures●Optimization●Feedback●Training●Transparency●Documentation
![Page 29: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/29.jpg)
Principes
●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser●Mesures de
Performance●Optimisation●Feedback●Formation●Transparence●Documentation
![Page 30: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/30.jpg)
Principles
●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation●Performance measures●Optimization●Feedback●Training●Transparency●Documentation
![Page 31: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/31.jpg)
Principes
●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser●Mesures de
Performance●Optimisation●Feedback●Formation●Transparence●Documentation
![Page 32: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/32.jpg)
Principles
●Planning●Organizing●Prevention●Responsibility●Partnership●Prioritisation●Performance measures●Optimization●Feedback●Training●Transparency●Documentation
![Page 33: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/33.jpg)
Principes
●Préparation●Organisation●Prévention●Responsabilité●Partenariat●Priorétiser●Mesures de
Performance●Optimisation●Feedback●Formation●Transparence●Documentation
![Page 34: BID CE workshop 1 session 08 - Biodiversity Data Cleaning](https://reader035.fdocuments.net/reader035/viewer/2022081604/58a96cd91a28abfd648b64e9/html5/thumbnails/34.jpg)
24 AUGUST 2016THE BID PROGRAMME IS FUNDED BY THE EUROPEAN UNION
Data CleaningNéstor Beltrán