FME for ESRI Geodatabase Replication to Amazon RDS

FME & AWS RDSMichael Kieser Senior Systems Engineer

Amazon Web Services

corporate data center

RMWB - GIS Portal

RMWB - Municipal Viewer

RMWB - Architecture

Problem - Enderman

Solution - FME & AWS

FME Geodatabase R/W

▪ ESRI Geodatabase (GEODATABASE_SDE): ▪ support for Feature Dataset/Feature Class

hierarchy ▪ ArcObjects-based writer

▪ ESRI ArcSDE (SDE30): ▪ no support for FD/FC hierarchy ▪ increase performance

Benchmarking - FME Replication - ESRI Geodatabase Writer

▪ 1 Feature Class of ~100 ▪ 40k Features: 20 minutes

▪ 1 Feature Dataset of ~10 ▪ ~8 hours to replicate

▪ Entire Geodatabase ▪ estimated 20 hours to replicate ▪ Feature Dataset / Feature Class hierarchy

Benchmarking - FME Replication - ESRI SDE Writer

▪ 1 Feature Class of ~100 ▪ 40k Features: 4 minutes

▪ 1 Feature Dataset of ~10 ▪ 12 minutes to replicate

▪ Entire Geodatabase ▪ 30 minutes to replicate ▪ No FD/FC hierarchy

Combined ESRI Geodatabase & SDE Writers - Runner WB

1.2.

3.

Benchmarking - FME Replication - Combined Writers

▪ 1 Feature Class of ~100 ▪ 40k Features: 10 minutes

▪ 1 Feature Dataset of ~10 ▪ 20 minutes to replicate

▪ Entire Geodatabase ▪ 3 hours to replicate ▪ Feature Dataset / Feature Class hierarchy

Benchmarking - ESRI Replication

▪ 1 Feature Class of ~100 ▪ 40k Features: 40 minutes

▪ 1 Feature Dataset of ~10 ▪ ~60 hours to replicate

▪ Entire Geodatabase ▪ estimated >100 hours to replicate

Conclusion

▪ Local/AWS Architecture: 3 levels of security ▪ separate environments (optional VPN) ▪ AWS Identity and Access Management ▪ Proxy node

▪ FME: ▪ universal tool in our toolbox ▪ combining readers/writers for flexibility

▪ Amazon RDS: SQL Server, MySQL, PostgreSQL, Oracle ▪ resource level permissions ▪ maintenance free ▪ easily scaled, replication

1

2

3VPN

Go Flames!

Thank You!

▪ Questions?

▪ For more information: ▪ Michael Kieser ▪ [email protected] ▪ @geoengis ▪ Tesera Systems, Calgary