Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS...
Transcript of Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS...
![Page 1: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/1.jpg)
Compliance Testing of Open Source Software for Web Processing Services
Theodor FoersterInstitute for Geoinformatics (ifgi)
Foss4G 20109th September 2010
![Page 2: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/2.jpg)
No Shootout!
![Page 3: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/3.jpg)
Compliance!
![Page 4: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/4.jpg)
History Class
WPS 0.4.0 Candidate(09/2005)
WPS 1.0.0(06/2007)
Deegree WPS (deegree 2.2)
(12/08)
Deegree WPS (deegree 2.3)
(04/10)
2005 2007
PyWPS 1.0.0(11/06)
PyWPS 2.0.0(09/07)
52N WPS 0.x
(05/06)
PyWPS 3.0.0(09/08)
PyWPS 3.1.0(01/09)
52N WPS 2.0(01/09)
52N WPS 1.0
(12/07)
2008 2009 2010
It‘s time for compliance!
![Page 5: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/5.jpg)
Compliance is crucial
• Open Source products• Transparency• Flexibility for the users• Supports the community!• THE argument over proprietary
standards
![Page 6: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/6.jpg)
Compliance a prerequisite
![Page 7: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/7.jpg)
WPS 101
• Data Information• HTTP / XML
GetCapabilities
DescribeProcess
Execute
WPS
Process 1
Process 2
Process n
![Page 8: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/8.jpg)
Interoperability
• OGC WPS Compliance– Compliant WPS responses– Full support of the specification• Store, asynchronous, synchronous
• Product interoperability– Real-world problem
![Page 9: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/9.jpg)
SETUP
![Page 10: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/10.jpg)
Test environment
• Intel Dual core CPU @ 1.66 GHz on a Dell laptop
• Ubuntu 10.4• Tomcat 6.0.26/Apache2• Java 6
![Page 11: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/11.jpg)
Candidate Services
![Page 12: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/12.jpg)
Service facts
Environment Java/Tomcat
Python/Apache
Java/tomcat C/Apache
Tested version 2.0.0 rc 5 3.2 rc: 3.0 1.0
Stated compliance Full Full – with limitations
Full Full
Installation successful
yes yes yes - Requires tomcat 6
Internal Server error: cannot find libjavaplugin_jni.so
Remote endpoint yes yes yes yes
![Page 13: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/13.jpg)
Remote endpoints
http://deegree3-testing.deegree.org/deegree-wps-demo/services
http://apps.esdi-humboldt.cz/cgi-bin/wps/wps
http://giv-wps.uni-muenster.de:8080/wps/WebProcessingService
http://zoo-project.org/zoosoo/
![Page 14: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/14.jpg)
Not tested... Sorry!
![Page 15: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/15.jpg)
Candidate Clients
Version Results
XML Clients n/a yes
uDig 1.3 yes
52N OpenLayers
1.0 yes
QGIS 1.5.0 no
gvSIG 1.10 no
JUMP 1.3.2 w/ 2.0 rc1
yes
![Page 16: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/16.jpg)
Client Test procedure
• Server Login
• Process selection
• Process Execution– Buffer
• Applied data– LineString Features from WFS (Tasmanian
roads)– No raster data
![Page 17: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/17.jpg)
OGC Compliance
• Validated with XMLSpy• GetCapabilities (HTTP-GET)• DescribeProcess (HTTP-GET)• Execute (HTTP-POST)– Store– Synchronous– Asynchronous
![Page 18: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/18.jpg)
RESULTSProduct Compliance
![Page 19: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/19.jpg)
XML Clients
![Page 20: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/20.jpg)
XML Clients - results
Deegree Client
52°North test client
![Page 21: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/21.jpg)
uDig
Input/Output not supported
Metadata not compliant
Metadata not compliant
![Page 22: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/22.jpg)
OpenLayers
ProcessID not found
Dummy/literal data process work
No processes found
![Page 23: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/23.jpg)
JUMP
Input/Output not supported
Metadata not compliant
Metadata not compliant
![Page 24: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/24.jpg)
RESULTSOGC Compliance
![Page 25: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/25.jpg)
GetCapabilities
• HTTP-GET Query REQUEST=GetCapabilities&SERVICE=WPS&version=1.0.0
processVersion="1.0.0“ missing
<ows:Metadata xlink:Test="Demo"/> invalid
![Page 26: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/26.jpg)
DescribeProcess
• HTTP-GET QueryREQUEST=DescribeProcess&Service=WPS&version=1.0.0&identifier=XXX
• Example process buffer
MimeType wrong namespace
wrong element dataType in Format
![Page 27: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/27.jpg)
Execute
• HTTP-POST• Example process buffer
Sync Store
async
![Page 28: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/28.jpg)
CONCLUSION
![Page 29: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/29.jpg)
Conclusion
• Compliance a prerequisite for successful Open Source software− Compliance between products – pair-wise–Client-Server
– Spec compliance• Results are not OGC certified!• Standardized test suite required• Output/Input problem• Validate your schemas!
![Page 30: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/30.jpg)
Conclusion (contd.)
OGC Compliance
Caps
Desc
store
sync
async
Client-Server interoperability
XML uDig
OL
![Page 31: Compliance Testing of Open Source Software for Web ...2010.foss4g.org/presentations/3604.pdfPyWPS 3.1.0 (01/09) 52N WPS 2.0 (01/09) 52N WPS 1.0 (12/07) 2008 2009 2010 It‘s time for](https://reader035.fdocuments.net/reader035/viewer/2022081600/60571223c2e1364f6a574c3a/html5/thumbnails/31.jpg)
Invitation…
• Compliance testing with volunteers• Stand up with demo servers• Join the team–Mailing list–Wiki