Automated Quality Controls with FME
-
Upload
safe-software -
Category
Technology
-
view
595 -
download
1
description
Transcript of Automated Quality Controls with FME
![Page 1: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/1.jpg)
CONNECT. TRANSFORM. AUTOMATE.
Automated quality controls with FME Anna Halvarsson and Johan Esko Metria
![Page 2: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/2.jpg)
. How do I
know if the data meet my quality
demands?
![Page 3: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/3.jpg)
Definition of quality
“The degree to which a set of inherent characteristics fulfills requirements”
ISO 9000:2000
![Page 4: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/4.jpg)
Best quality?
![Page 5: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/5.jpg)
Swedish Technology Journal
“Short wheelbase and minimal overhang at the front and
rear, combined with high ground clearance makes it extremely well suited to continue the drive where the road ends. Indeed the Niva outperform the Porsche Cayenne, which in comparison is clumsy as an elephant with a backpack in a supermarket”.
(Teknikens värld, 2006)
Comment: “If it is the terrain capabilities that is evaluated, the Niva
fulfils the quality requirements better than the Porsche.”
![Page 6: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/6.jpg)
Best quality?
Which one of these view services delivers data with the highest positional accuracy?
![Page 7: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/7.jpg)
How to manage quality in my SDI?
![Page 8: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/8.jpg)
![Page 9: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/9.jpg)
![Page 10: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/10.jpg)
![Page 11: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/11.jpg)
![Page 12: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/12.jpg)
![Page 13: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/13.jpg)
Data QC service - Pilot project
Objectives:
1. The QC service shall in a standardized and traceable way describe the quality of data
2. The QC service shall automatically perform the controls
3. The QC process shall be the link between the EPA:s manuals and the result published by the data host.
![Page 14: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/14.jpg)
Applies to both cars and bikes
Choose the right track for the solution
![Page 15: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/15.jpg)
![Page 16: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/16.jpg)
![Page 17: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/17.jpg)
![Page 18: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/18.jpg)
![Page 19: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/19.jpg)
Excelfile
Shapefile
Excelfile
SchemaMapper
SchemaMapper
SchemaMapper
XMLTemplater
XMLTemplater
XMLValidator
File for QC Harmonise data Create XML/GML (applicationschema)
Test 1 DQ _Logical consistency
Counter
Test 2 DQ_Completeness
Tester
DQ X DQ_ Element
Transformer
Transformer
Metadata (XML)
XMLTemplater
Readable QC report
ISO 19156 O&M
ISO 19131 Data Product specifcation ISO 19157 Data Quality
ISO 19157 DQ
ISO 19157 DQ ISO 19115 Metadata
XSD-file
Air quality reports
Environmental monitoring type 2
![Page 20: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/20.jpg)
Result files
Quality control of Air data
Quality control of Sediment data
Quality control of Biota data
Validate and deliver environmental monitoring data
Select file for quality control:
![Page 21: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/21.jpg)
Metadata XML ISO 19139
QC report HTML
![Page 22: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/22.jpg)
Finally
• During 2014 the validation service will be launched in version 1.0.
• In Sweden a number of agencies have started to work with Product specifications and quality controls according to ISO standards.
• Private companies are also showing much more interest in data quality issues than they did a couple of years ago.
![Page 23: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/23.jpg)
Thank you!
Johan Esko [email protected]
+46 10 121 81 29
Anna Halvarsson [email protected]
+46 10 121 81 49
![Page 24: Automated Quality Controls with FME](https://reader034.fdocuments.net/reader034/viewer/2022052504/5478ac925806b5a3048b4590/html5/thumbnails/24.jpg)
Thank You!
Questions?
For more information:
Anna Halvarsson, [email protected]
Johan Esko, [email protected]
Metria AB, Sweden
www.metria.se
CONNECT. TRANSFORM. AUTOMATE.