GML Data Models and GML Data Models and Web Services for GPS Web Services for GPS and Earthquake and Earthquake Catalogs Catalogs Marlon Pierce, Galip Aydin Marlon Pierce, Galip Aydin Community Grids Lab, Community Grids Lab, Indiana University Indiana University [email protected][email protected]
24
Embed
GML Data Models and Web Services for GPS and Earthquake Catalogs Marlon Pierce, Galip Aydin Community Grids Lab, Indiana University [email protected].
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
GML Data Models and Web GML Data Models and Web Services for GPS and Services for GPS and Earthquake CatalogsEarthquake Catalogs
QuakeSim ApplicationsQuakeSim Applications Several QuakeSim codes work directly with Several QuakeSim codes work directly with
observational data. observational data. Examples discussed at ACES includeExamples discussed at ACES include
• GeoFEST, VirtualCalifornia, Simplex, and Disloc all depend GeoFEST, VirtualCalifornia, Simplex, and Disloc all depend upon fault models.upon fault models.
• RDAHMM and Pattern Informatics codes use seismic RDAHMM and Pattern Informatics codes use seismic catalogs.catalogs.
• RDAHMM primarily used with GPS dataRDAHMM primarily used with GPS data ProblemProblem: We need to provide a way to integrate : We need to provide a way to integrate
these codes with the online data repositories.these codes with the online data repositories.• QuakeTables Fault Database was developed QuakeTables Fault Database was developed • What about GPS and Earthquake Catalogs? What about GPS and Earthquake Catalogs? • Many formats, data available in tars or files, not searchable, Many formats, data available in tars or files, not searchable,
not easy to integrate with applicaitonsnot easy to integrate with applicaitons SolutionSolution: use databases to store catalog data; use : use databases to store catalog data; use
XML (XML (GMLGML) as exchange data format; use ) as exchange data format; use WebWeb ServicesServices for data exchanges, invoking queries, and for data exchanges, invoking queries, and filtering data.filtering data.
What Are Web Services?What Are Web Services? Web Services are not web Web Services are not web
pages, CGI, or Servletspages, CGI, or Servlets Web Services framework is Web Services framework is
a way for doing distributed a way for doing distributed computing with XML.computing with XML.• WSDLWSDL: Defines interfaces : Defines interfaces
to functions of remote to functions of remote components.components.
• SOAPSOAP: Defines the : Defines the message format that you message format that you exchange between exchange between components.components.
XML provides cross-XML provides cross-language supportlanguage support
Suitable for both human Suitable for both human and application clientsand application clients
WebServer
DB
JDBC
Browser
WebServer
SOAP
Appl
SOAPWSDL
WSDL
WSD
LWSD
L
Geographical Information Service Geographical Information Service (GIS) Data Formats and Services(GIS) Data Formats and Services
OpenGIS Consortium is an international group for defining OpenGIS Consortium is an international group for defining GIS data formats and services.GIS data formats and services.
Main data format language is the XML-based Main data format language is the XML-based GMLGML..• Subdivided into schemas for drawing maps, representing Subdivided into schemas for drawing maps, representing
features, observations, …features, observations, … First StepFirst Step: design GML schemas and build specialized Web : design GML schemas and build specialized Web
Services for GPS and Earthquake data.Services for GPS and Earthquake data. OGC also defines services.OGC also defines services.
• Services include Web Features Services, Web Map Services, Services include Web Features Services, Web Map Services, and similar.and similar.
• These are currently pre-Web Service, based on HTTP Post, but These are currently pre-Web Service, based on HTTP Post, but they are being revised to comply with WS standards.they are being revised to comply with WS standards.
Next StepNext Step: Implement OGC compatible Web Services for : Implement OGC compatible Web Services for this problem.this problem.• Also build services to interact with QuakeTables Fault DB.Also build services to interact with QuakeTables Fault DB.
GML and Existing Data FormatsGML and Existing Data Formats GPS or seismic data used in this project GPS or seismic data used in this project
are retrieved from different URLs and are retrieved from different URLs and have different text formats.have different text formats.
Seismic data formatsSeismic data formats• SCSN, SCEDC, Dinger-Shearer, Haukkson SCSN, SCEDC, Dinger-Shearer, Haukkson
GPS data formatsGPS data formats• JPL, SOPAC, USGS JPL, SOPAC, USGS
We defined 2 GML Schemas to unify We defined 2 GML Schemas to unify thesethese• http://http://grids.ucs.indiana.edu/~gaydin/servogrids.ucs.indiana.edu/~gaydin/servo
A summary of all supported formats and A summary of all supported formats and data sources can also be found there.data sources can also be found there.
So We Built ItSo We Built It First version of the First version of the
system availablesystem available• Tried XML databases Tried XML databases
but performance was but performance was awfulawful
• Currently database uses Currently database uses MySQLMySQL
Download results are Download results are in GML, but we can in GML, but we can convert to appropriate convert to appropriate text formats.text formats.
Search DB For Earthquake Search DB For Earthquake CatalogsCatalogs
Results
Search XML DB For GPS CatalogsSearch XML DB For GPS Catalogs
1
Use Ours or Set Up Your OwnUse Ours or Set Up Your Own
URL to access our browser interface:URL to access our browser interface:• http://gf3.ucs.indiana.edu:6060/cce/sql/http://gf3.ucs.indiana.edu:6060/cce/sql/
URL to download and set up your URL to download and set up your ownown• http://complexity.ucs.indiana.edu/~gaydin/cce/http://complexity.ucs.indiana.edu/~gaydin/cce/
install/install.htmlinstall/install.html
Fault Quest: QuakeTables+OGC Fault Quest: QuakeTables+OGC Web Map Service DemoWeb Map Service Demo
http://rio.ucs.indiana.edu:8080/wmsClient/
ConclusionsConclusions
This is a little discussion with a big This is a little discussion with a big conclusion--conclusion--
If you want to build iSERVO or If you want to build iSERVO or something like it, data access something like it, data access services are an important foundation.services are an important foundation.
GML Schemas as Data Models for GML Schemas as Data Models for ServicesServices
Fault and GPS Schemas are based on GML-Fault and GPS Schemas are based on GML-Feature object.Feature object.
Seismicity Schema is based on GML-Observation Seismicity Schema is based on GML-Observation object.object.
Working schema available from Working schema available from http://http://grids.ucs.indiana.edu/~gaydin/schemasgrids.ucs.indiana.edu/~gaydin/schemas//
JSP + Client Stubs
DB Service 1
JDBC
DB
Job Sub/Mon And FileServices
Operating andQueuing Systems
Browser Interface
Viz Service
Host 1 Host 2 Host 3
RIVA
QuakeSim Portal ShotsQuakeSim Portal Shots
Other IssuesOther Issues We want to abstract the data storage system to allow We want to abstract the data storage system to allow
simple federation of relational and XML databasessimple federation of relational and XML databases• UK e-Science’s UK e-Science’s OGSA-DAIOGSA-DAI project is an interesting but project is an interesting but
complicated example.complicated example. We’d like to simplify this approachWe’d like to simplify this approach
MetadataMetadata is also important is also important• Useful for capturing Useful for capturing datadata pedigreepedigree and and validationvalidation..
““This fault data generated with Simplex by Jay Parker using the This fault data generated with Simplex by Jay Parker using the parameters….”parameters….”
““Those 1935 Fault measurements aren’t so good.”Those 1935 Fault measurements aren’t so good.” We have developed some general applications for We have developed some general applications for
metadata managementmetadata management• Newsgroups, citations, references, glossaries as examples.Newsgroups, citations, references, glossaries as examples.• Would like to apply to scientific metadataWould like to apply to scientific metadata
Future DirectionsFuture Directions We are interested in We are interested in SemanticSemantic WebWeb markups (particularly markups (particularly
RDFS) to provide metadata descriptions of RDFS) to provide metadata descriptions of • InstrumentsInstruments• Data setsData sets• Computing hardwareComputing hardware• Applications/codesApplications/codes
We want this to form the basis for building composite We want this to form the basis for building composite services.services.
Infrastructure improvements: reliable, Infrastructure improvements: reliable, fault tolerantfault tolerant grid grid infrastructure needed as grid components come and go.infrastructure needed as grid components come and go.
Component based portalsComponent based portals: reuse portal interfaces between : reuse portal interfaces between projects.projects.
ISERVOISERVO: International collaborations with Australia, Japan, : International collaborations with Australia, Japan, and possibly other countries and possibly other countries • Through ACES: APEC Cooperation for Earthquake SimulationThrough ACES: APEC Cooperation for Earthquake Simulation
NASANASA JPLJPL: Andrea Donnellan (PI), Jay : Andrea Donnellan (PI), Jay Parker, Peggy Li, Robert GranatParker, Peggy Li, Robert Granat
UC-DavisUC-Davis: John Rundle: John Rundle UC-IrvineUC-Irvine: Lisa Grant: Lisa Grant USCUSC: Dennis Mcleod : Dennis Mcleod BrownBrown: Terry Tullis: Terry Tullis
Problems: Data Access and Problems: Data Access and Sharing, Code IntegrationSharing, Code Integration
Codes all use custom text formats for Codes all use custom text formats for describing input and output.describing input and output.
Input and output data often combined Input and output data often combined with code-specific information.with code-specific information.• Number of iterations, array sizes, etc.Number of iterations, array sizes, etc.
Data files often created by hand from Data files often created by hand from journals, online repositoriesjournals, online repositories• Online repositories themselves use differing Online repositories themselves use differing
formatsformats Challenges are to develop common data Challenges are to develop common data
formats, access services, and client query formats, access services, and client query tools.tools.
Web Services for Data Access and Web Services for Data Access and Computing Service InvocationComputing Service Invocation
Web services: Web services: • WSDLWSDL: Interface definition language, describes your : Interface definition language, describes your
service service ““GeoFEST may be invoked with these input types”GeoFEST may be invoked with these input types”
• SOAPSOAP: Transport envelope for remote procedure : Transport envelope for remote procedure calls/messagescalls/messages
““Invoke GeoFEST with this set of input”Invoke GeoFEST with this set of input” Together, WSDL and SOAP are useful for Together, WSDL and SOAP are useful for
manipulating, returning XML data valuesmanipulating, returning XML data values• So GML schemas act as our data models and return valuesSo GML schemas act as our data models and return values
Status: built several general purpose services Status: built several general purpose services • Remotely executing codes, monitoring queuing systems, Remotely executing codes, monitoring queuing systems,
manipulating/moving files around, describing applications, manipulating/moving files around, describing applications, storing portal session values, accessing data bases of storing portal session values, accessing data bases of faults,…faults,…
Work underway to build data servicesWork underway to build data services
QuakeSim BasicsQuakeSim Basics
Under development in collaboration with Under development in collaboration with researchers at researchers at JPLJPL, , UC-DavisUC-Davis, , USC, USC, and and BrownBrown University. University.
Geoscientists develop Geoscientists develop simulationsimulation codescodes, , analysisanalysis and and visualizationvisualization toolstools..
We need a way to bind distributed codes, We need a way to bind distributed codes, tools, and data sets.tools, and data sets.
We need a way to deliver it to a larger We need a way to deliver it to a larger audienceaudience• Instead of downloading and installing the code, Instead of downloading and installing the code,
use it as a use it as a remoteremote serviceservice. .
What’s the Problem?What’s the Problem? Data sources typically were provided in single downloadsData sources typically were provided in single downloads
• Tar bundles or textTar bundles or text• This has changed for SCEC catalogs since we developed this This has changed for SCEC catalogs since we developed this
project.project.• SCIGN is adopting a Web Services approach for GPS data.SCIGN is adopting a Web Services approach for GPS data.
Formats defined but presented as textFormats defined but presented as text• Use XML to re-format the data.Use XML to re-format the data.• Buys us investment in many XML manipulation, validation, and Buys us investment in many XML manipulation, validation, and
messaging tools.messaging tools. We wanted to use databases to store and manage the We wanted to use databases to store and manage the
information.information. This makes the data queryableThis makes the data queryable
• Retrieve all entries > 1970Retrieve all entries > 1970• Retrieve all entries with M>3.0Retrieve all entries with M>3.0
Data Sources SummaryData Sources Summary A summary of all supported A summary of all supported
formats can be found here formats can be found here • http://http://
grids.ucs.indiana.edu/~gaydin/servogrids.ucs.indiana.edu/~gaydin/servo Information about supported Information about supported
Earthquake catalog formats can be Earthquake catalog formats can be found in found in http://www.data.scec.org/http://www.data.scec.org/
Information about supported GPS Information about supported GPS data formats can be found in data formats can be found in http://www.scign.orghttp://www.scign.org
What Are Web Services?What Are Web Services? Web services framework is Web services framework is
a way for doing distributed a way for doing distributed computing with XML.computing with XML.• WSDLWSDL: Defines interfaces : Defines interfaces
to functions of remote to functions of remote components.components.
• SOAPSOAP: Defines the : Defines the message format that you message format that you exchange between exchange between components.components.
XML provides cross-XML provides cross-language supportlanguage support
Suitable for both human Suitable for both human and application clientsand application clients
WebServer
DB
JDBC
Browser
WebServer
SOAP
Appl
SOAPWSDL
WSDL
WSD
LWSD
L
Delivering Data for Human and Delivering Data for Human and Application ConsumptionApplication Consumption
We still have to get the results to the We still have to get the results to the (remote) client.(remote) client.
The client may be a user or an application.The client may be a user or an application. Web Services provide a way to do this.Web Services provide a way to do this. Note Web Services are NOTNote Web Services are NOT
• Web pagesWeb pages• ServletsServlets• CGI scriptsCGI scripts