GI2010 symposium-kliment (inspire-md-tests)

14.05.2010 10. Sächsisches GIS-Forum 1

Discovery service testing according to INSPIRE implementing rules

Tomas KlimentTomas Kliment

GI2010 GI2010 –– SymposiumSymposiumDresden Dresden –– 14. May 201014. May 2010

This presentation has been transmitted remotely as TELE lecture This presentation has been transmitted remotely as TELE lecture from ISPRA (IT) using „BizBizfrom ISPRA (IT) using „BizBiz--Tool“ via University of RIGA (LV)Tool“ via University of RIGA (LV)

14.05.2010 210. Sächsisches GIS-Forum

Objectives of this presentation Objectives of this presentation

INSPIRE requirements for discovery service INSPIRE requirements for discovery service -- DSDSProposals for DS testing procedures against Proposals for DS testing procedures against INSPIRE rules INSPIRE rules Practical testing of DS from Slovak Environmental Practical testing of DS from Slovak Environmental Agency Agency –– SEASEA –– testing environmenttesting environmentTesting outcome and future work Testing outcome and future work


INSPIRE requirementsINSPIRE requirementsMain documents related to DSMain documents related to DS

Directive 2007/2/ECDirective 2007/2/EC establishing an INSPIREestablishing an INSPIRELegal framework Legal framework –– define WHAT and not the HOWdefine WHAT and not the HOW

Commission regulation 976/2009 regarding Network ServicesCommission regulation 976/2009 regarding Network ServicesLegal framework Legal framework –– implementing rules implementing rules -- WHATWHAT

Technical guidance for INSPIRE discovery serviceTechnical guidance for INSPIRE discovery serviceSupport document Support document –– define HOW DS should be implemented define HOW DS should be implemented

RequirementsRequirementsSearch criteria Search criteria –– Article 11(2), Article 11(2), Annex II Part A,Annex II Part A, Paragraph 2.4Paragraph 2.4Operations Operations -- Article 11(1),12,Article 11(1),12, Annex II Part B,Annex II Part B, Paragraph 2.3Paragraph 2.3Quality of DS Quality of DS -- Annex IAnnex IMultilingual aspects Multilingual aspects –– at service/content level at service/content level -- Paragraph 2.5Paragraph 2.5


DS Testing procedure proposalsDS Testing procedure proposalsDS EndDS End--point Aquiringpoint Aquiring

GetCapabilitiesGetCapabilitiesPOST, SOAP endpointsPOST, SOAP endpoints

Testing procedure launchingTesting procedure launchingGetDiscoveryServiceMetadataGetDiscoveryServiceMetadata

Response validatingResponse validatingDiscoverMetadataDiscoverMetadata

All metadata recordsAll metadata recordsEach QueryableEach QueryableLanguage Language queryablequeryable

Metadata qualityMetadata qualityValidation Validation –– gmd, INSPIREgmd, INSPIRE

Metadata quantity Metadata quantity


Testing procedure performanceTesting procedure performanceGetCapabilitiesGetCapabilities request request –– HTTP GET KVPHTTP GET KVP

http://http://globusglobus..sazpsazp..sksk:8080/:8080/soapservicessoapservices//CSWStartupCSWStartup?Service=CSW&request=?Service=CSW&request=GetCapabilitiesGetCapabilities

POST SOAP Capabilities URL

POST XML Capabilities URL


Testing procedure performanceTesting procedure performanceOperations + Operations + queryablesqueryables testing testing –– POST SOAPPOST SOAP

deegreedeegree Generic OGC Generic OGC WebServiceWebService ClientClient

ERROR ERROR -- Unexpected failure: HTTP/1.1 500 Internal Server Unexpected failure: HTTP/1.1 500 Internal Server ErrorErrorService side error Service side error –– NO NO -- BUT BUT -- client side error client side error -- YES YES


Testing procedure performanceTesting procedure performanceProblems with SOAP REQ from Problems with SOAP REQ from deegreedeegree clientclient

SoapFaultSoapFaultNo No SOAPActionSOAPActionheaderheader

value=URIvalue=URIwithin WSDL docswithin WSDL docs

Client MUST use itClient MUST use itdeegreedeegree does notdoes not

SOAPActionSOAPAction addedaddedOKOK


Testing procedure performanceTesting procedure performanceGetDiscoveryServiceMetadataGetDiscoveryServiceMetadata responseresponse

Validated against OGC schema with XML SpyValidated against OGC schema with XML Spyhttp://schemas.opengis.net/csw/2.0.2/CSWhttp://schemas.opengis.net/csw/2.0.2/CSW--discovery.xsddiscovery.xsd -- VALIDVALID

Discovery service metadataDiscovery service metadataMissing values for elements: Fees, Missing values for elements: Fees, AccessConstraintsAccessConstraints,,

Additional Additional queryablesqueryables advertised advertised –– YESYESFederated Catalogues advertise Federated Catalogues advertise –– YESYES

Currently no federated cataloguesCurrently no federated cataloguesLanguage mutation of Language mutation of GetCapabilitiesGetCapabilities

Currently no links to language specific capabilities doc. Currently no links to language specific capabilities doc.


Testing procedure performanceTesting procedure performanceDiscoverMetadataDiscoverMetadata requestrequest

LanguageQueryParameterLanguageQueryParameter added to each requestadded to each request

DiscoverMetadataDiscoverMetadata responseresponseAll All queryablesqueryables supportedsupportedContent cached = 942 recordsContent cached = 942 recordsMultilingual aspect at content level Multilingual aspect at content level –– supportedsupported

Only “Only “sloslo” metadata” metadata

942 records discovered 0 records discovered


Testing procedure performanceTesting procedure performanceMetadata quality Metadata quality –– validation against validation against gmdgmd

http://schemas.http://schemas.opengisopengis.net/.net/isoiso/19139/20060504//19139/20060504/gmdgmd//gmdgmd..xsdxsd

940 records valid940 records valid2 not valid 2 not valid


Testing procedure performanceTesting procedure performanceMetadata quality Metadata quality –– validating against INSPIREvalidating against INSPIRE

Sample MD sets validated via online INSPIRE Sample MD sets validated via online INSPIRE metadata metadata validatorvalidator

Development of “simple” Java program for MD Development of “simple” Java program for MD validating using INSPIRE validating using INSPIRE ValidatorValidator ServiceService

Automatic reading XML metadata records from folderAutomatic reading XML metadata records from folderValidating using INSPIRE Validating using INSPIRE ValidatorValidator Service and creating Validation reportService and creating Validation report


Testing procedure performanceTesting procedure performancePilot quality testingPilot quality testing

Performance Performance –– GetRecordByIDGetRecordByID GET KVP requestGET KVP requestTest case runs: 100xTest case runs: 100xAverage response time: 0.952sAverage response time: 0.952sMax response time: 3.770sMax response time: 3.770sMin response time: 0.573s Min response time: 0.573s

Performance graph

0,0000

0,5000

1,0000

1,5000

2,0000

2,5000

3,0000

3,5000

4,0000

23:06

:4623

:06:48

23:06

:5123

:06:53

23:06

:5523

:07:00

23:07

:0423

:07:08

23:07

:1223

:07:15

23:07

:1823

:07:21

23:07

:2423

:07:26

23:07

:3123

:07:33

23:07

:3523

:07:40

23:07

:4323

:07:47

23:07

:4923

:07:55

23:07

:5923

:08:01

23:08

:0423

:08:06

23:08

:0823

:08:11

23:08

:1323

:08:19

23:08

:2123

:08:25

23:08

:2823

:08:31

Request time [hod:min:s]

Res

pons

e du

ratio

n [s

]


Testing outcomeTesting outcome


Future workFuture workExtension of testing model by rest of operationsExtension of testing model by rest of operations

Publish Metadata(Push/Pull), Link Discovery Service Publish Metadata(Push/Pull), Link Discovery Service

Automation of testing performanceAutomation of testing performanceDevelopment of new tool Development of new tool Existing tools as base Existing tools as base –– WebInjectWebInject,,

Service quality testingService quality testingPerformance, Capacity Performance, Capacity –– POST XML/SOAPPOST XML/SOAPAvailability Availability –– LongLong--term monitoringterm monitoring


ReferencesReferenceshttp://inspire.http://inspire.jrcjrc..ecec..europaeuropa..eueu//http://www.inspirehttp://www.inspire--geoportalgeoportal..eueu//http://http://globusglobus..sazpsazp..sksk//http://http://deegreedeegree.org/.org/https://https://tcpmontcpmon.dev.java.net/.dev.java.net/http://www.http://www.webinjectwebinject.org/.org/http://www.http://www.altovaaltova.com/.com/

14.05.2010 10. Sächsisches GIS-Forum 16

Thank you for your attentionThank you for your attention

tomastomas..klimentkliment@@stubastuba..sksk

GI2010 symposium-kliment (inspire-md-tests)

Business

Transcript of GI2010 symposium-kliment (inspire-md-tests)