Sharing Environmental Data, Our Experiences at EPA
-
Upload
dub-linked -
Category
Environment
-
view
151 -
download
2
description
Transcript of Sharing Environmental Data, Our Experiences at EPA
![Page 1: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/1.jpg)
Sharing Environmental Data
Our experiences at EPA
Dr. Peter Mooney
EPA Research FellowDept of Computer Science, NUIM
![Page 2: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/2.jpg)
As of .. May 26th 2014
![Page 3: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/3.jpg)
The EPA and Environmental Data and Information
Generator and Collector(monitoring, position as legal entity, etc)
Facilitator and enabler (through R&D programmes)
Manager and distributor(Water Framework Directive....)
![Page 4: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/4.jpg)
Providing ‘open-data’ as PDF reports: knowledge distribution - but not actionable
“like funding James Cameron to make Avatar, and then releasing it in a black and white flip book. We are missing all the good stuff”
http://www.theguardian.com/global-development-professionals-network/2013/oct/21/development-open-data-action
![Page 5: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/5.jpg)
The EPA have committed significant resources to making
GIS data available
![Page 6: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/6.jpg)
![Page 7: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/7.jpg)
![Page 8: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/8.jpg)
![Page 9: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/9.jpg)
![Page 10: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/10.jpg)
Envision
![Page 11: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/11.jpg)
Pre-packaged data downloads
![Page 12: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/12.jpg)
Service-based access to geospatial data
![Page 13: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/13.jpg)
![Page 14: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/14.jpg)
WFS, WMS and REST Services
![Page 15: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/15.jpg)
Envision Download Services
![Page 16: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/16.jpg)
EPA Research
![Page 17: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/17.jpg)
Over 700 funded Over 700 funded projects (> €10K)projects (> €10K)
since 2002since 2002
https://www.flickr.com/photos/33280166@N02/5354725682
![Page 18: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/18.jpg)
EPA Research Programme has been operating an open access approach over the last 6 years
All EPA funded research projects must provide “significant outputs”
(datasets, info resources, etc) for public access via SAFER
Crucially and innovatively, this couples the final reports/papers with the actual data/information used to generate the findings/recommendations
![Page 19: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/19.jpg)
SAFER -Secure Archive for Environmental Research Data
![Page 20: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/20.jpg)
High rates of download
![Page 21: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/21.jpg)
SAFER has driven excellent resource efficiencies in EPA Research
● AQ PM10 Data ArchiveOpen Access
● 2300 downloads (May 2013)● 2300 X 6 minutes per request = 13,800 minutes
● 13,800 / 60 = 230 hours
● 8 hour working day
● TOTAL 28.75 days SAVED
Example
![Page 22: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/22.jpg)
Several key EPA dataset archives are available on SAFER
http://erc.epa.ie/safer/resourcelisting.jsp?oID=10206&username=EPA%20Drinking%20Water
![Page 23: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/23.jpg)
SAFER is beginning to offer some web-service access
![Page 24: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/24.jpg)
![Page 25: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/25.jpg)
The open nature of the Catalogue has exceeded our expecations
![Page 26: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/26.jpg)
EPA Air Quality
![Page 27: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/27.jpg)
The Air Quality Index for Health
(AQIH) Launched May 2013
The AQIH was developed through collaboration between EPA, HSE, Met Eireann, and other public bodies and experts
![Page 28: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/28.jpg)
The AQIH is true real-time open data from the EPA
Monitoring Network
Ongoing Sampling
EPA Servers andDatabases
Processing and Analysis
Delivery to the public and
stakeholders
Example
Sampling between09:00 and 10:00
Receive from monitoring stations (09:00 – 10:00)
Storage in Databases
Processing and analysis
10:00 – 11:00
Data from the periods including 09:00 – 10:00 is now available for access
![Page 29: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/29.jpg)
AQIH Map Access
Screenshot taken at 14:33 on 26-May-2014
![Page 30: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/30.jpg)
AQIH Twitter
Automated tweets @ 08:00 and 17:00 each day – hourly if AQIH becomes poor in one or more regions
![Page 31: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/31.jpg)
AQIH Web Pages for Stations
![Page 32: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/32.jpg)
AQIH as JSON Open Data
![Page 33: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/33.jpg)
AQIH JSON (wget call)
![Page 34: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/34.jpg)
We get lots of request for the raw hourly data from individual
monitoring stations
This type of data requires expert interpretation – so the AQIH is made available openly instead
![Page 35: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/35.jpg)
![Page 36: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/36.jpg)
![Page 37: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/37.jpg)
SAFER contains the entire archive of validated AQ data from EPA
http://erc.epa.ie/safer/resourcelisting.jsp?oID=10136&username=EPA%20Air%20Quality
![Page 38: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/38.jpg)
Summary of thoughts
![Page 39: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/39.jpg)
Our advice is to L.E.A.R.N
ListenEngage
Activity/ActionsResearch
New/Innovatehttps://www.flickr.com/photos/arichards-gallery/8358810783
![Page 40: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/40.jpg)
The unbounded evolution of Internet The unbounded evolution of Internet technologies has completely changed the technologies has completely changed the data playing field and rules of engagementdata playing field and rules of engagement
10 Years Ago
“Fear of being open”
Today
“Fear of not being open”
DRIVERS CHANGE
INSPIRE,SEIS,PSI Directive,Open Data, Initiatives, etc
Open Internet,Social Media,User-generated content,“The Internet Generation”, etc
![Page 41: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/41.jpg)
Open Data is high on the EPA agenda for future work
● AQIH: Make historical archive available (JSON)● Up-to-date AQ data: AQ Directive changes are
being implemented – potential to make INSPIRE-compliant AQ UTD available
● Explore potential linkages to DUBLINKED: Are there datasets/services which can be shared?
● Upgrading tools such as SAFER: Investigate adding more web-services (pull of information)
![Page 42: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/42.jpg)
Emphasis on delivery of mobile-focused applications
![Page 43: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/43.jpg)
The EPA must carefully consider open-data on a case-by-case basis
Concerns about data misuse or misinterpretation
The resource costs – making open data available isn't free
Working with stakeholders – when data has been generated or owned by several parties
Privacy and security issues – particularly in point-based geospatial datasets
![Page 44: Sharing Environmental Data, Our Experiences at EPA](https://reader033.fdocuments.net/reader033/viewer/2022051514/54b3b50e4a795958348b45e3/html5/thumbnails/44.jpg)
Dr. Peter Mooney email [email protected] and