Atom Feed for Distributing Data (Lightning Talk)

CONNECT TRANSFORM AUTOMATE

Atom feed and data distribution in GST

Peter LaulundCand scient Specialkonsulent

Background

Feeds are mandatory in relation to INSPIRE Most of our data are now free We want to supply an up to date cadastral

dataset We also want to give access to the rest of our

data by placing them on our ftp server

CONNECT TRANSFORM AUTOMATE

Atom feed

An Atom feed is a xml file with lsquonewsrsquo In this context it is an index to data files The contend is metadata about the dataset

Time area name bounding box link to data We can view it in a browser We can use it in a machine to machine scenario FME reads and write the feed as well as the data

Cadastral dataset

24 million parcels 45 million features in 30 feature types 9033 districts Changes in 20 to 100 districts per day Data are free Available in 10 formats

As feed in GML MapInfo and ESRI Shape

View in a browser

Demo

Entry

ltentrygt ltidgtftpftpkhellip-EUREF89zipltidgt lttitlegtDet digitale Matrikelkort Trelde Fredericia Jorderlttitlegt ltupdatedgt2014-04-25T121756+0100ltupdatedgt ltpublishedgt2014-04-26T012629+0100ltpublishedgt ltlink href=ftpftpkortf2-EUREF89zip hellip ltlinkgt ltcategory term=Projektionldquo gtltcategorygt ltcategory term=Formatldquo label=GML 311gtltcategorygt ltcategory term=Admkode label=2006758gtltcategorygt ltsummary type=text xmllang=dagt Ejerlav Trelde ltsummarygt ltgeorsswheregt hellip ltgmlposListgt547811 6161357 547811 6161357ltgmlposListgt hellip ltgeorsswheregtltentrygt

System architecture

job db

matrikel

log

atom

AAjourfme

matrikelfmw

Atomfmw

Log2Htmlfmw

ltformatgtzip

Atomxml

Log2dayhtml

FMEServerOracle Data repository ftphellip

Aajourfmw

SELECT SEQ_JOBIDNEXTVAL JobId A FROM JOB_ATOM A

JOB View ndash Pseudo sql

create view JOB_ATOM as Select unique ejerlav from ( select ejerlav max(cadastraltid) as cad_from_time nvl(max(logtid) lsquo17530501rsquo) as log_from_time from cadastral left join log (on cadastralejerlav = logejerlav ))where cad_from_time gt log_from_time

Atom database and workspace

Metadata in tables Url text contact information etc

Atom view ndash metadata and log database AtomEntry view ndash metadata and log database Atom Workspace

Reads the two views with sql Writes and format with xml templates

Atomfmw

FME as Infrastructure

FME reads the feed GEORss and XML reader

FME writes the feed GEORss writer xml writer xml template

FME read and writes the data We can automate the process with FMEServer

Thank You

Questions

For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency

Kortforsyningen FMEPedia

CONNECT TRANSFORM AUTOMATE