Workflow Management for Multiple Workspaces

CONNECT. TRANSFORM. AUTOMATE.

Workflow Management for Multiple Workspaces

Workflow ManagementWhat are we talking about?

Workflow ManagementWhat are we talking about?

Using the power of FME Workbench to design workflows Moving and Copying Files Data Transformation Quality Control Database Updates Notification (Emails, Mobile Alerts) Etc.

Workflow ManagementWhy do we care?

Because many of you are doing this already! Users have noticed that FME Workbench is a

powerful process control tool Many of you running complex workflows with

multiple workspace already

FME Server Survey 2012 #1 Enhancement Request was “Automated Workflows”

Workflow Management: 2 Case Studies

1. “Call Before you Dig” Client (FME Desktop based)

2. Norwegian Environment Agency (thanks to VAR Norkart)

Please note: Demos are very loosely based on these real projects

Workflow Management - Key Tools

Directory and File Pathnames Reader File Copy Writer

WorkspaceRunner FMEServerJobSubmitter

FMEServerNotifier Notification Service

Case Study #1 “Call Before You Dig”

Customers (ie Utilities) submit DGN Files – 1000s of them!Need to: Find out which territory each file belongs to Update database with files names and territory Copy file into directory by territory

Case Study #1 “Call Before You Dig”

Demo 1 – FME Desktop

Reading a directory – Directory Reader Processing files with WorkspaceRunner Copying Files with File Copy Writer

Case Study #2 Norwegian EA

Goal: automatically add valid data from the SOSI-format to the ArcSDE operational database• geometry must be validated and inside the database before

running any other database updates• split between geometryhandling, attributehandling,

databasehandling• easily add other procedures. Currently working new one to take

attributes from the features and stores these in another database.

View the Application here:http://innsyn.naturbase.no/

Case Study #2 Norwegian EA

SOSI-file

ArcSDE Operational

DB

MSSQL Logging etc

SOSI-file, PDF-report, text-report

1 2 3 4

Verfiy Data and Database updates

Generate paths/published parameters based on attributes in SOSI-file

To Do all checks:- Geometry- SOSI- Attributename/values- Exisiting Ids

Create logfiles (in SOSI, txt, 2D / 3D PDF) and add geometry to ArcSDE

All data verified and all logs updated

To Do:- Wrap-up files from previous FMW-

files into one package and send by e-mail to supplier

Case Study #2 Norwegian EA

Demo 2 – FME Server

Controller Workspace Running two consecutive tasks

1. Quality Control Workspace2. Database Update Workspace

Notification at all stages (Success and Failure)

Thank You!

Questions?

For more information: [email protected] www.safe.com