All Pipes Portal: A Collaborative InitiativeJennifer ChungAndrew TurveyNeil Hellas

About Us

York RegionGIS Technologist

York RegionGIS Technologist

Spatial DNAEnterprise Solutions

Architect

Jennifer Chung Andrew Turvey Neil Hellas

All Pipes ProgramAll Pipes is a collaborative initiative between York Region and its nine Area Municipalities to maintain a single common schema and water/wastewater utility dataset among partners.

Connecting our World: One pipe at a time!

All Pipes Structure

Continuous Improvement

In September 2015 York Region decided to enhance their current FME portal architecture.

Solution

Project Objectives• Removed ESRI Data Reviewer services– Replaced QA/QC checks with FME tools

• Increased email notifications• Integrate loading & viewer capabilities• Increased reporting functionalities• Reduce number of workspaces

Solution

The goal was to create a custom workflow to allow Geocortex to upload data to FME Server, and for FME Server to generate reports visible on Geocortex

Old ProcessNew

Process

Timeline2

weeks

8 weeks

6 weeks

Technical Approach

• Integrate with Geocortex

• QA/QC Data• Transform to

common schema• Limit workspace

editing• Increase

communications to user

Integration of data and components

User

User interface• Form items are

FME service parameters

• Active Directory permissions

• Leverage fmedataupload service

Data Exchange Portal

Old process – lots to maintain

New process – less to maintain

Configuration separated from functionality

Master WorkspaceStep 1:

Transform the feature class and attribute names

Do some “sanity” QC

Step 2:

Business rules QC

Conform attribute values

Step 3:

Write the data to the common database

Step 4:

Topology checks

Launched by web interface

Calls other FME services to complete process

Status table updates and email notification to user/admin

Step 1 - Schema Mappers

Feature class names Attribute names

Step 2 – QC - Business Rules

Should we test?Check configuration

Test! Record error Check results

Step 2 – QC – Business Rules

Configure which errors can be ignored

Step 3 and 4 – Upload

A User perspective!

All Pipes Portal FME Configuration

• Each Municipality has checks tailored to its unique data

• Changes and enhancements are easy to manage without recreating the entire workflow

CSV GISFME

Configuration and Efficient management

• Standardizes Data into All Pipes Schema• Value mapping is done in CSV files; no external

software Concrete Pipe = CP

Lessons Learned

• Guest token user

• Strict data rules• Happier users • Objectives met

Future Application

Thank you!All Pipes allpipes@york.ca

Spatial DNAneil.hellas@spatialdna.com