Mastering your Databasesdataflow.center/assets/pdf/wt16/WT16S_05_Brian_Pont_Mastering_y… ·...

Post on 18-Aug-2020

15 views 0 download

Transcript of Mastering your Databasesdataflow.center/assets/pdf/wt16/WT16S_05_Brian_Pont_Mastering_y… ·...

Mastering your Databases

Agenda

●Your Databases in FME

– New in FME 2016.1

●How to extract

differences between

databases/snapshots

– Demo: ArcSDE

Geodatabase versions

Your Databases in FME

Top DB Formats

1. Esri Geodatabase

2. PostGIS

3. Oracle

4. Microsoft Access

5. Microsoft SQL Server

6. PostgreSQL

7. Autodesk MapGuide SDF

8. Esri Legacy ArcSDE

9. SpatiaLiteDid you know?

Esri Geodatabase is the

6th most-used format

in FME.

safe.com/transformers

New in FME 2016.1

More Formats

● Portal for ArcGIS

● AWS Aurora

● Elasticsearch

● MongoDB

● IBM Cloudant

● Geocouch (i.e. CouchDB spatial)

● Microsoft Azure DocumentDB

Tableau Writer

New Cross-Platform

Formats● SAP HANA

● SAP Sybase ASE

● Denodo

● Microsoft Azure

● Microsoft Access

● Microsoft SQL Server

● IBM DB2 Non-spatial

● IBM Informix Non-spatial

Consistent Parameters

Saved Database Connections

SQL Made Easy

SQL Made Easy

Right-click to

automatically

generate scripts.

Quickly see

the table.

Click ‘Run…’ to

execute SQL

immediately.

Tree Navigation

Extracting differences

between ArcSDE geodatabases

What kinds of differences?

Version Differences

• A version is a snapshot

of the ArcSDE

geodatabase.

• This enables multiple

users to work on a

geodatabase without

conflict.

Historical Archives

• A historical version is a

saved moment in time.

• There is always a

DEFAULT historical

marker.

• Historical markers are

based on date/time.

Versions in FME

1. Open reader parameters.

2. Pick the version type and the

version you want to read.

3. Check ‘Read Version Differences’.

4. Pick the version to compare

against.

You can also access parameters

from the FME Workbench

Navigator Pane once the reader

is already in your workflow.

Transactional version to read

Creates a new version

when you do the read

Baseline, i.e. SDE.DEFAULT

Read Version Differences: Yes|No

Which versions do I compare?

Find differences to the common ancestor.

sde.DEFAULT

WaterUpdates1

WaterUpdates2

WaterUpdates3

Incremental Updates

● The fme_db_operation

attribute will specify

INSERT/UPDATE/DELETE.

● Tell the output database

to use this attribute.

● FME is now set up for

incremental updates.

● Set Child Version Name to create a

snapshot, which will be used as the

baseline next time.

● Your approach will depend on

your replication scheme.

QAQC

WaterUpdates1

WaterUpdates2

WaterUpdates3

sde.DEFAULT

Automated Synchronization

Demo: Extract Geodatabase differences

Demo configuration

Demo: Extract Geodatabase differences

● FME 2016.1 enables a range of

database functionality, including

easier SQL editing.

● Use FME to extract differences

between Geodatabase versions or

snapshots.

Resources

knowledge.safe.com

safe.com/webinar● Tips for PostGIS, Oracle, and SQL Server

● Become a Geodatabase Power User

Thank you!

Questions?

Resources: DatabasesDatabase Ranking: http://db-engines.com/en/ranking

Knowledge Center:On Esri

FME Compatibility for Retired Esri Software ReleasesNotes on FME and Esri Versions and Compatibility

Database updatesIncremental Database Updates using the FME format attribute fme_db_operation

Webinars:7 Spatial Database Tips for PostGIS, Oracle, and SQL Server5 Tips to Become an Esri Geodatabase Power User