CONNECT TRANSFORM AUTOMATE
Atom feed and data distribution in GST
Peter LaulundCand scient Specialkonsulent
Background
Feeds are mandatory in relation to INSPIRE Most of our data are now free We want to supply an up to date cadastral
dataset We also want to give access to the rest of our
data by placing them on our ftp server
CONNECT TRANSFORM AUTOMATE
Atom feed
An Atom feed is a xml file with lsquonewsrsquo In this context it is an index to data files The contend is metadata about the dataset
Time area name bounding box link to data We can view it in a browser We can use it in a machine to machine scenario FME reads and write the feed as well as the data
Cadastral dataset
24 million parcels 45 million features in 30 feature types 9033 districts Changes in 20 to 100 districts per day Data are free Available in 10 formats
As feed in GML MapInfo and ESRI Shape
View in a browser
Demo
Entry
ltentrygt ltidgtftpftpkhellip-EUREF89zipltidgt lttitlegtDet digitale Matrikelkort Trelde Fredericia Jorderlttitlegt ltupdatedgt2014-04-25T121756+0100ltupdatedgt ltpublishedgt2014-04-26T012629+0100ltpublishedgt ltlink href=ftpftpkortf2-EUREF89zip hellip ltlinkgt ltcategory term=Projektionldquo gtltcategorygt ltcategory term=Formatldquo label=GML 311gtltcategorygt ltcategory term=Admkode label=2006758gtltcategorygt ltsummary type=text xmllang=dagt Ejerlav Trelde ltsummarygt ltgeorsswheregt hellip ltgmlposListgt547811 6161357 547811 6161357ltgmlposListgt hellip ltgeorsswheregtltentrygt
System architecture
job db
matrikel
log
atom
AAjourfme
matrikelfmw
Atomfmw
Log2Htmlfmw
ltformatgtzip
Atomxml
Log2dayhtml
FMEServerOracle Data repository ftphellip
Aajourfmw
SELECT SEQ_JOBIDNEXTVAL JobId A FROM JOB_ATOM A
JOB View ndash Pseudo sql
create view JOB_ATOM as Select unique ejerlav from ( select ejerlav max(cadastraltid) as cad_from_time nvl(max(logtid) lsquo17530501rsquo) as log_from_time from cadastral left join log (on cadastralejerlav = logejerlav ))where cad_from_time gt log_from_time
Atom database and workspace
Metadata in tables Url text contact information etc
Atom view ndash metadata and log database AtomEntry view ndash metadata and log database Atom Workspace
Reads the two views with sql Writes and format with xml templates
Atomfmw
FME as Infrastructure
FME reads the feed GEORss and XML reader
FME writes the feed GEORss writer xml writer xml template
FME read and writes the data We can automate the process with FMEServer
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE
Background
Feeds are mandatory in relation to INSPIRE Most of our data are now free We want to supply an up to date cadastral
dataset We also want to give access to the rest of our
data by placing them on our ftp server
CONNECT TRANSFORM AUTOMATE
Atom feed
An Atom feed is a xml file with lsquonewsrsquo In this context it is an index to data files The contend is metadata about the dataset
Time area name bounding box link to data We can view it in a browser We can use it in a machine to machine scenario FME reads and write the feed as well as the data
Cadastral dataset
24 million parcels 45 million features in 30 feature types 9033 districts Changes in 20 to 100 districts per day Data are free Available in 10 formats
As feed in GML MapInfo and ESRI Shape
View in a browser
Demo
Entry
ltentrygt ltidgtftpftpkhellip-EUREF89zipltidgt lttitlegtDet digitale Matrikelkort Trelde Fredericia Jorderlttitlegt ltupdatedgt2014-04-25T121756+0100ltupdatedgt ltpublishedgt2014-04-26T012629+0100ltpublishedgt ltlink href=ftpftpkortf2-EUREF89zip hellip ltlinkgt ltcategory term=Projektionldquo gtltcategorygt ltcategory term=Formatldquo label=GML 311gtltcategorygt ltcategory term=Admkode label=2006758gtltcategorygt ltsummary type=text xmllang=dagt Ejerlav Trelde ltsummarygt ltgeorsswheregt hellip ltgmlposListgt547811 6161357 547811 6161357ltgmlposListgt hellip ltgeorsswheregtltentrygt
System architecture
job db
matrikel
log
atom
AAjourfme
matrikelfmw
Atomfmw
Log2Htmlfmw
ltformatgtzip
Atomxml
Log2dayhtml
FMEServerOracle Data repository ftphellip
Aajourfmw
SELECT SEQ_JOBIDNEXTVAL JobId A FROM JOB_ATOM A
JOB View ndash Pseudo sql
create view JOB_ATOM as Select unique ejerlav from ( select ejerlav max(cadastraltid) as cad_from_time nvl(max(logtid) lsquo17530501rsquo) as log_from_time from cadastral left join log (on cadastralejerlav = logejerlav ))where cad_from_time gt log_from_time
Atom database and workspace
Metadata in tables Url text contact information etc
Atom view ndash metadata and log database AtomEntry view ndash metadata and log database Atom Workspace
Reads the two views with sql Writes and format with xml templates
Atomfmw
FME as Infrastructure
FME reads the feed GEORss and XML reader
FME writes the feed GEORss writer xml writer xml template
FME read and writes the data We can automate the process with FMEServer
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE
Atom feed
An Atom feed is a xml file with lsquonewsrsquo In this context it is an index to data files The contend is metadata about the dataset
Time area name bounding box link to data We can view it in a browser We can use it in a machine to machine scenario FME reads and write the feed as well as the data
Cadastral dataset
24 million parcels 45 million features in 30 feature types 9033 districts Changes in 20 to 100 districts per day Data are free Available in 10 formats
As feed in GML MapInfo and ESRI Shape
View in a browser
Demo
Entry
ltentrygt ltidgtftpftpkhellip-EUREF89zipltidgt lttitlegtDet digitale Matrikelkort Trelde Fredericia Jorderlttitlegt ltupdatedgt2014-04-25T121756+0100ltupdatedgt ltpublishedgt2014-04-26T012629+0100ltpublishedgt ltlink href=ftpftpkortf2-EUREF89zip hellip ltlinkgt ltcategory term=Projektionldquo gtltcategorygt ltcategory term=Formatldquo label=GML 311gtltcategorygt ltcategory term=Admkode label=2006758gtltcategorygt ltsummary type=text xmllang=dagt Ejerlav Trelde ltsummarygt ltgeorsswheregt hellip ltgmlposListgt547811 6161357 547811 6161357ltgmlposListgt hellip ltgeorsswheregtltentrygt
System architecture
job db
matrikel
log
atom
AAjourfme
matrikelfmw
Atomfmw
Log2Htmlfmw
ltformatgtzip
Atomxml
Log2dayhtml
FMEServerOracle Data repository ftphellip
Aajourfmw
SELECT SEQ_JOBIDNEXTVAL JobId A FROM JOB_ATOM A
JOB View ndash Pseudo sql
create view JOB_ATOM as Select unique ejerlav from ( select ejerlav max(cadastraltid) as cad_from_time nvl(max(logtid) lsquo17530501rsquo) as log_from_time from cadastral left join log (on cadastralejerlav = logejerlav ))where cad_from_time gt log_from_time
Atom database and workspace
Metadata in tables Url text contact information etc
Atom view ndash metadata and log database AtomEntry view ndash metadata and log database Atom Workspace
Reads the two views with sql Writes and format with xml templates
Atomfmw
FME as Infrastructure
FME reads the feed GEORss and XML reader
FME writes the feed GEORss writer xml writer xml template
FME read and writes the data We can automate the process with FMEServer
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE
Cadastral dataset
24 million parcels 45 million features in 30 feature types 9033 districts Changes in 20 to 100 districts per day Data are free Available in 10 formats
As feed in GML MapInfo and ESRI Shape
View in a browser
Demo
Entry
ltentrygt ltidgtftpftpkhellip-EUREF89zipltidgt lttitlegtDet digitale Matrikelkort Trelde Fredericia Jorderlttitlegt ltupdatedgt2014-04-25T121756+0100ltupdatedgt ltpublishedgt2014-04-26T012629+0100ltpublishedgt ltlink href=ftpftpkortf2-EUREF89zip hellip ltlinkgt ltcategory term=Projektionldquo gtltcategorygt ltcategory term=Formatldquo label=GML 311gtltcategorygt ltcategory term=Admkode label=2006758gtltcategorygt ltsummary type=text xmllang=dagt Ejerlav Trelde ltsummarygt ltgeorsswheregt hellip ltgmlposListgt547811 6161357 547811 6161357ltgmlposListgt hellip ltgeorsswheregtltentrygt
System architecture
job db
matrikel
log
atom
AAjourfme
matrikelfmw
Atomfmw
Log2Htmlfmw
ltformatgtzip
Atomxml
Log2dayhtml
FMEServerOracle Data repository ftphellip
Aajourfmw
SELECT SEQ_JOBIDNEXTVAL JobId A FROM JOB_ATOM A
JOB View ndash Pseudo sql
create view JOB_ATOM as Select unique ejerlav from ( select ejerlav max(cadastraltid) as cad_from_time nvl(max(logtid) lsquo17530501rsquo) as log_from_time from cadastral left join log (on cadastralejerlav = logejerlav ))where cad_from_time gt log_from_time
Atom database and workspace
Metadata in tables Url text contact information etc
Atom view ndash metadata and log database AtomEntry view ndash metadata and log database Atom Workspace
Reads the two views with sql Writes and format with xml templates
Atomfmw
FME as Infrastructure
FME reads the feed GEORss and XML reader
FME writes the feed GEORss writer xml writer xml template
FME read and writes the data We can automate the process with FMEServer
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE
View in a browser
Demo
Entry
ltentrygt ltidgtftpftpkhellip-EUREF89zipltidgt lttitlegtDet digitale Matrikelkort Trelde Fredericia Jorderlttitlegt ltupdatedgt2014-04-25T121756+0100ltupdatedgt ltpublishedgt2014-04-26T012629+0100ltpublishedgt ltlink href=ftpftpkortf2-EUREF89zip hellip ltlinkgt ltcategory term=Projektionldquo gtltcategorygt ltcategory term=Formatldquo label=GML 311gtltcategorygt ltcategory term=Admkode label=2006758gtltcategorygt ltsummary type=text xmllang=dagt Ejerlav Trelde ltsummarygt ltgeorsswheregt hellip ltgmlposListgt547811 6161357 547811 6161357ltgmlposListgt hellip ltgeorsswheregtltentrygt
System architecture
job db
matrikel
log
atom
AAjourfme
matrikelfmw
Atomfmw
Log2Htmlfmw
ltformatgtzip
Atomxml
Log2dayhtml
FMEServerOracle Data repository ftphellip
Aajourfmw
SELECT SEQ_JOBIDNEXTVAL JobId A FROM JOB_ATOM A
JOB View ndash Pseudo sql
create view JOB_ATOM as Select unique ejerlav from ( select ejerlav max(cadastraltid) as cad_from_time nvl(max(logtid) lsquo17530501rsquo) as log_from_time from cadastral left join log (on cadastralejerlav = logejerlav ))where cad_from_time gt log_from_time
Atom database and workspace
Metadata in tables Url text contact information etc
Atom view ndash metadata and log database AtomEntry view ndash metadata and log database Atom Workspace
Reads the two views with sql Writes and format with xml templates
Atomfmw
FME as Infrastructure
FME reads the feed GEORss and XML reader
FME writes the feed GEORss writer xml writer xml template
FME read and writes the data We can automate the process with FMEServer
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE
Demo
Entry
ltentrygt ltidgtftpftpkhellip-EUREF89zipltidgt lttitlegtDet digitale Matrikelkort Trelde Fredericia Jorderlttitlegt ltupdatedgt2014-04-25T121756+0100ltupdatedgt ltpublishedgt2014-04-26T012629+0100ltpublishedgt ltlink href=ftpftpkortf2-EUREF89zip hellip ltlinkgt ltcategory term=Projektionldquo gtltcategorygt ltcategory term=Formatldquo label=GML 311gtltcategorygt ltcategory term=Admkode label=2006758gtltcategorygt ltsummary type=text xmllang=dagt Ejerlav Trelde ltsummarygt ltgeorsswheregt hellip ltgmlposListgt547811 6161357 547811 6161357ltgmlposListgt hellip ltgeorsswheregtltentrygt
System architecture
job db
matrikel
log
atom
AAjourfme
matrikelfmw
Atomfmw
Log2Htmlfmw
ltformatgtzip
Atomxml
Log2dayhtml
FMEServerOracle Data repository ftphellip
Aajourfmw
SELECT SEQ_JOBIDNEXTVAL JobId A FROM JOB_ATOM A
JOB View ndash Pseudo sql
create view JOB_ATOM as Select unique ejerlav from ( select ejerlav max(cadastraltid) as cad_from_time nvl(max(logtid) lsquo17530501rsquo) as log_from_time from cadastral left join log (on cadastralejerlav = logejerlav ))where cad_from_time gt log_from_time
Atom database and workspace
Metadata in tables Url text contact information etc
Atom view ndash metadata and log database AtomEntry view ndash metadata and log database Atom Workspace
Reads the two views with sql Writes and format with xml templates
Atomfmw
FME as Infrastructure
FME reads the feed GEORss and XML reader
FME writes the feed GEORss writer xml writer xml template
FME read and writes the data We can automate the process with FMEServer
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE
Entry
ltentrygt ltidgtftpftpkhellip-EUREF89zipltidgt lttitlegtDet digitale Matrikelkort Trelde Fredericia Jorderlttitlegt ltupdatedgt2014-04-25T121756+0100ltupdatedgt ltpublishedgt2014-04-26T012629+0100ltpublishedgt ltlink href=ftpftpkortf2-EUREF89zip hellip ltlinkgt ltcategory term=Projektionldquo gtltcategorygt ltcategory term=Formatldquo label=GML 311gtltcategorygt ltcategory term=Admkode label=2006758gtltcategorygt ltsummary type=text xmllang=dagt Ejerlav Trelde ltsummarygt ltgeorsswheregt hellip ltgmlposListgt547811 6161357 547811 6161357ltgmlposListgt hellip ltgeorsswheregtltentrygt
System architecture
job db
matrikel
log
atom
AAjourfme
matrikelfmw
Atomfmw
Log2Htmlfmw
ltformatgtzip
Atomxml
Log2dayhtml
FMEServerOracle Data repository ftphellip
Aajourfmw
SELECT SEQ_JOBIDNEXTVAL JobId A FROM JOB_ATOM A
JOB View ndash Pseudo sql
create view JOB_ATOM as Select unique ejerlav from ( select ejerlav max(cadastraltid) as cad_from_time nvl(max(logtid) lsquo17530501rsquo) as log_from_time from cadastral left join log (on cadastralejerlav = logejerlav ))where cad_from_time gt log_from_time
Atom database and workspace
Metadata in tables Url text contact information etc
Atom view ndash metadata and log database AtomEntry view ndash metadata and log database Atom Workspace
Reads the two views with sql Writes and format with xml templates
Atomfmw
FME as Infrastructure
FME reads the feed GEORss and XML reader
FME writes the feed GEORss writer xml writer xml template
FME read and writes the data We can automate the process with FMEServer
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE
System architecture
job db
matrikel
log
atom
AAjourfme
matrikelfmw
Atomfmw
Log2Htmlfmw
ltformatgtzip
Atomxml
Log2dayhtml
FMEServerOracle Data repository ftphellip
Aajourfmw
SELECT SEQ_JOBIDNEXTVAL JobId A FROM JOB_ATOM A
JOB View ndash Pseudo sql
create view JOB_ATOM as Select unique ejerlav from ( select ejerlav max(cadastraltid) as cad_from_time nvl(max(logtid) lsquo17530501rsquo) as log_from_time from cadastral left join log (on cadastralejerlav = logejerlav ))where cad_from_time gt log_from_time
Atom database and workspace
Metadata in tables Url text contact information etc
Atom view ndash metadata and log database AtomEntry view ndash metadata and log database Atom Workspace
Reads the two views with sql Writes and format with xml templates
Atomfmw
FME as Infrastructure
FME reads the feed GEORss and XML reader
FME writes the feed GEORss writer xml writer xml template
FME read and writes the data We can automate the process with FMEServer
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE
Aajourfmw
SELECT SEQ_JOBIDNEXTVAL JobId A FROM JOB_ATOM A
JOB View ndash Pseudo sql
create view JOB_ATOM as Select unique ejerlav from ( select ejerlav max(cadastraltid) as cad_from_time nvl(max(logtid) lsquo17530501rsquo) as log_from_time from cadastral left join log (on cadastralejerlav = logejerlav ))where cad_from_time gt log_from_time
Atom database and workspace
Metadata in tables Url text contact information etc
Atom view ndash metadata and log database AtomEntry view ndash metadata and log database Atom Workspace
Reads the two views with sql Writes and format with xml templates
Atomfmw
FME as Infrastructure
FME reads the feed GEORss and XML reader
FME writes the feed GEORss writer xml writer xml template
FME read and writes the data We can automate the process with FMEServer
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE
JOB View ndash Pseudo sql
create view JOB_ATOM as Select unique ejerlav from ( select ejerlav max(cadastraltid) as cad_from_time nvl(max(logtid) lsquo17530501rsquo) as log_from_time from cadastral left join log (on cadastralejerlav = logejerlav ))where cad_from_time gt log_from_time
Atom database and workspace
Metadata in tables Url text contact information etc
Atom view ndash metadata and log database AtomEntry view ndash metadata and log database Atom Workspace
Reads the two views with sql Writes and format with xml templates
Atomfmw
FME as Infrastructure
FME reads the feed GEORss and XML reader
FME writes the feed GEORss writer xml writer xml template
FME read and writes the data We can automate the process with FMEServer
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE
Atom database and workspace
Metadata in tables Url text contact information etc
Atom view ndash metadata and log database AtomEntry view ndash metadata and log database Atom Workspace
Reads the two views with sql Writes and format with xml templates
Atomfmw
FME as Infrastructure
FME reads the feed GEORss and XML reader
FME writes the feed GEORss writer xml writer xml template
FME read and writes the data We can automate the process with FMEServer
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE
Atomfmw
FME as Infrastructure
FME reads the feed GEORss and XML reader
FME writes the feed GEORss writer xml writer xml template
FME read and writes the data We can automate the process with FMEServer
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE
FME as Infrastructure
FME reads the feed GEORss and XML reader
FME writes the feed GEORss writer xml writer xml template
FME read and writes the data We can automate the process with FMEServer
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE
Thank You
Questions
For more information Peter Laulund pelaugstdk Geodatastyrelsen - The Danish Geodata Agency
Kortforsyningen FMEPedia
CONNECT TRANSFORM AUTOMATE