Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data...
Transcript of Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data...
![Page 1: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/1.jpg)
Implementing an Open Data Strategy
Courtney Claessens, Product Engineer
R&D Center, Washington, DC
![Page 2: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/2.jpg)
Open data within the ArcGIS Platform
A little context
![Page 3: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/3.jpg)
Historic Sharing Practices
• Physical Media and FTP Sites
- Static snapshots over time
- Quarterly release
- Manual process to produce
• Data typically had terms of use
- Used by academia & neighboring governments for analysis
- Possibly aggregated into commercial datasets
- Mindset was to sell data
![Page 4: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/4.jpg)
Modern Expectations of Sharing
• Open Data is now an EVERYDAY THING
- International movement to provide transparency and enable economic development
- Formalized process to license and share data to the public
- Often supported by governing legislation
• Solutions connected to Enterprise Architecture
- Leveraging Servers to share out and ingest data
- Minimal impact on the information workers
![Page 5: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/5.jpg)
YOULOCATION STRATEGY
An INNOVATION
OPEN DATA
Community Leaders
Start-UpsAcademia
Citizens
Agency Staff
ECOSYSTEM
![Page 6: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/6.jpg)
Part of the ArcGIS Platform
Open Data Site
Providing open access to your published data
Simple
Integrated
Open
Desktop Web Device
Server Online Content and Services
ArcGIS Online
![Page 7: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/7.jpg)
Open Data Principles
Accessible Discoverable
Explorable Collaborative
![Page 8: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/8.jpg)
Current State of Open Data
• Complete open data solution for operational tables and spatial data
- 7,600+ Organizations around the world
- 70,000 Datasets shared into Open Data
- 20,000,000+ Downloads in 2016
• Provide custom sites you control
- Unlimited Bandwidth and API Usage
- No restriction on the number of datasets
- Auto-generated downloads
- Suite of applications to provide context
- ArcGIS sharing model
![Page 9: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/9.jpg)
What does a successful open data program look like?
![Page 10: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/10.jpg)
1. Uses minimal resources and has a minimal impact on information workers
2. Successfully communicates meaning via data and information
3. Engages end users in a sustainable manner
![Page 11: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/11.jpg)
> Uses minimal resources and has a minimal impact on information workers
Integrated workflows
![Page 12: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/12.jpg)
Leverages existing services and familiar workflows
ArcGIS for Server
Cloud Storage Content and Services ArcGIS Open DataArcGIS Online Groups
External APIs
![Page 13: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/13.jpg)
Open Data WorkflowsAuto ETL and Custom Search
MetadataSearchShapefile KML GeoJSONCSV
• Tax Parcels• Sales• Foreclosures• Street Centerlines• Address Points• Points of Interest• Building Footprints• Subdivision Boundary
▪ Purchase Card Transactions▪ Use of Force Events▪ Calls for Service▪ Tax Districts▪ Park Locations▪ School Zones▪ Public Buildings▪ Parking Ticket Locations
Site InteractDownload
Preview
![Page 14: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/14.jpg)
Federating groups into open data sites
Open Data Site
Your Organization Other Organization's
![Page 15: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/15.jpg)
![Page 16: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/16.jpg)
![Page 17: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/17.jpg)
Open Data - No Wrong DoorDCAT
/data.json
CKAN
![Page 18: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/18.jpg)
![Page 19: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/19.jpg)
Scripts for automation
https://github.com/ecaldwell/portal-admin-examples
![Page 20: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/20.jpg)
Scripts for automation
esriurl.com/cachescript
![Page 21: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/21.jpg)
The people
• Programs of all sizes succeed when you have an open data champion
• Executive buy-in helps sustainability and resource allocation
• Depends on your team and the size of your city/organization
![Page 22: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/22.jpg)
Creating new workflows to integrate across your org
• Policies!
![Page 23: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/23.jpg)
> Successfully communicates meaning via data and information
High quality, highly informative
![Page 24: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/24.jpg)
If you’re just starting out…
• Look at documentation and examples to help decide which datasets to focus on first
• http://us-city.census.okfn.org/
![Page 25: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/25.jpg)
Creating high quality data
• Starting from desktop:
- Add attribute aliases
![Page 26: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/26.jpg)
![Page 27: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/27.jpg)
Creating high quality data
• Starting from desktop:
- Add attribute aliases
- Enable editor tracking
![Page 28: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/28.jpg)
Creating high quality data
• Registering datasets and editing metadata
• Title, description, access and use constraints (license), tags
• Licenses
- Creative Commons (CC0, CC BY, CC BY-SA), Open Data Commons license
- https://creativecommons.org/choose/
- If you have a terms of use, add it in your footer
• Add structured metadata on ArcGIS Online
- Accessible from dataset page and included in shapefile downloads
![Page 29: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/29.jpg)
More than just pre-packaged ETL –Getting those sweet sweet fgdbs
• For hosted services: check “Export Data” in the Online settings
• File geodatabases are automatically created by ArcGIS Online
![Page 30: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/30.jpg)
Adding additional download types
• Add additional resources to your datasets using distributions in metadata
- Add file geodatabases to your on-premises services
- Add more metadata files
- Add raw imagery data
- Anything else!
![Page 31: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/31.jpg)
In the metadata of the ArcGIS Online itemDataset in open data
![Page 32: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/32.jpg)
Adding other kinds of items
• Go beyond the feature service
- Web maps
- Web mapping applications
- PDFs, word docs
- External links
![Page 33: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/33.jpg)
![Page 34: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/34.jpg)
Adding other kinds of items
• Go beyond the feature service
- Web maps
- Web mapping applications
- PDFs, word docs
- External links
• Connected content
- Add web maps that use your open data – they’ll show up on the dataset page!
![Page 35: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/35.jpg)
![Page 36: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/36.jpg)
More than just data altogether
Consider the questions…
• What stories do the data tell?
• How can we generate insights?
• How is the data being used?
• What questions can we answer more simply?
Consider the solutions…
• Story Maps
• Operations dashboards
• Locator applications
• Pages
Turning data into information
![Page 37: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/37.jpg)
![Page 38: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/38.jpg)
![Page 39: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/39.jpg)
> Engages end users in a sustainable manner
Two-way conversations
![Page 40: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/40.jpg)
Helping your users use the data
![Page 41: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/41.jpg)
![Page 42: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/42.jpg)
Communication Channels
• Think about how you want to converse with your community
- Meeting people where they are
- How are they currently contacting you?
- Twitter, Facebook
• Let people know when you publish new data or make any breaking changes
![Page 43: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/43.jpg)
![Page 44: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/44.jpg)
Communication channels – FOIA-lite
![Page 45: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/45.jpg)
Surveys & Data Collection
• Data gathering by the public community or team members
• Integrated with Pages, mobile apps, and embed into external advocacy groups
• Supports data requests, internal performance metrics
![Page 46: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/46.jpg)
Communication channels – what have your users been working on?
• Use pages and leverage surveys to give users an entry to present their work
• Add a community spotlight section on your site for others’ to leverage the knowledge of their neighbours
![Page 47: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/47.jpg)
Demo of ArcGIS Hub’s Open Data Initiative
![Page 48: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/48.jpg)
> A successful open data strategy…
In summary
![Page 49: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/49.jpg)
1. Uses minimal resources and has a minimal impact on information workers- leveraging ArcGIS for Server and ArcGIS Online- scripts for automation- people are important
2. Successfully communicates meaning via data and information - data quality is critical- allow as many uses as you can- data tells stories – bring them to the forefront
3. Engages end users in a sustainable manner- create a communication space- leverage surveys for data requests and data collection- community spotlight
![Page 50: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/50.jpg)
Please Take Our Survey on the Esri Events App!
Select the session you attended
Scroll down to find the survey
Complete Answersand Select “Submit”
Download the Esri Events app and find
your event
![Page 51: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/51.jpg)
![Page 52: Implementing an Open Data Strategy - Esri...Current State of Open Data •Complete open data solution for operational tables and spatial data -7,600+ Organizations around the world-70,000](https://reader031.fdocuments.net/reader031/viewer/2022012001/607c0de9e39cf5204016f71b/html5/thumbnails/52.jpg)
Public Engagement Hub“Open Data 2.0”--Maps, Data & Apps
Engage
City’s Hub and Mapping PlatformFind, Use, Create, and Collaborate
Share & Collaborate
Bureau of Eng. Bureau of Street Services LA County
Information & Engagement
Products“Open data in action”
Create & Innovate
L.A. GeoHub
Ecosystem
Apps & Maps
App Challenge, Coming Soon
GIS InfrastructureHosted Services
Departmental Servers or ArcGIS Online
Serve & Power
Curated Policy Map Gallery
The Public
City Employees
Initiative PagesFocused Collaboration
Rally