Top Banner
Mastering your Databases
27

Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Jul 14, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Mastering your Databases

Page 2: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Agenda

●Your Databases in FME

– New in FME 2016.1

●How to extract

differences between

databases/snapshots

– Demo: ArcSDE

Geodatabase versions

Page 3: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Your Databases in FME

Page 4: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Top DB Formats

1. Esri Geodatabase

2. PostGIS

3. Oracle

4. Microsoft Access

5. Microsoft SQL Server

6. PostgreSQL

7. Autodesk MapGuide SDF

8. Esri Legacy ArcSDE

9. SpatiaLiteDid you know?

Esri Geodatabase is the

6th most-used format

in FME.

Page 5: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

safe.com/transformers

Page 6: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

New in FME 2016.1

Page 7: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

More Formats

● Portal for ArcGIS

● AWS Aurora

● Elasticsearch

● MongoDB

● IBM Cloudant

● Geocouch (i.e. CouchDB spatial)

● Microsoft Azure DocumentDB

Page 8: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Tableau Writer

Page 9: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

New Cross-Platform

Formats● SAP HANA

● SAP Sybase ASE

● Denodo

● Microsoft Azure

● Microsoft Access

● Microsoft SQL Server

● IBM DB2 Non-spatial

● IBM Informix Non-spatial

Page 10: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Consistent Parameters

Page 11: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Saved Database Connections

Page 12: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

SQL Made Easy

Page 13: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

SQL Made Easy

Right-click to

automatically

generate scripts.

Quickly see

the table.

Click ‘Run…’ to

execute SQL

immediately.

Page 14: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Tree Navigation

Page 15: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Extracting differences

between ArcSDE geodatabases

Page 16: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

What kinds of differences?

Version Differences

• A version is a snapshot

of the ArcSDE

geodatabase.

• This enables multiple

users to work on a

geodatabase without

conflict.

Historical Archives

• A historical version is a

saved moment in time.

• There is always a

DEFAULT historical

marker.

• Historical markers are

based on date/time.

Page 17: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Versions in FME

1. Open reader parameters.

2. Pick the version type and the

version you want to read.

3. Check ‘Read Version Differences’.

4. Pick the version to compare

against.

Page 18: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

You can also access parameters

from the FME Workbench

Navigator Pane once the reader

is already in your workflow.

Transactional version to read

Creates a new version

when you do the read

Baseline, i.e. SDE.DEFAULT

Read Version Differences: Yes|No

Page 19: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Which versions do I compare?

Find differences to the common ancestor.

sde.DEFAULT

WaterUpdates1

WaterUpdates2

WaterUpdates3

Page 20: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Incremental Updates

● The fme_db_operation

attribute will specify

INSERT/UPDATE/DELETE.

● Tell the output database

to use this attribute.

● FME is now set up for

incremental updates.

Page 21: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

● Set Child Version Name to create a

snapshot, which will be used as the

baseline next time.

● Your approach will depend on

your replication scheme.

QAQC

WaterUpdates1

WaterUpdates2

WaterUpdates3

sde.DEFAULT

Automated Synchronization

Page 22: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Demo: Extract Geodatabase differences

Demo configuration

Page 23: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Demo: Extract Geodatabase differences

Page 24: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

● FME 2016.1 enables a range of

database functionality, including

easier SQL editing.

● Use FME to extract differences

between Geodatabase versions or

snapshots.

Page 25: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Resources

knowledge.safe.com

safe.com/webinar● Tips for PostGIS, Oracle, and SQL Server

● Become a Geodatabase Power User

Page 26: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Thank you!

Questions?

Page 27: Mastering your Databases - Excellence Center for FME...New in FME 2016.1 More Formats Portal for ArcGIS AWS Aurora Elasticsearch MongoDB IBM Cloudant Geocouch (i.e. CouchDB spatial)

Resources: DatabasesDatabase Ranking: http://db-engines.com/en/ranking

Knowledge Center:On Esri

FME Compatibility for Retired Esri Software ReleasesNotes on FME and Esri Versions and Compatibility

Database updatesIncremental Database Updates using the FME format attribute fme_db_operation

Webinars:7 Spatial Database Tips for PostGIS, Oracle, and SQL Server5 Tips to Become an Esri Geodatabase Power User