WQ-WET STORET Water Quality Data Web Entry Tool James M. Porter / Hafiz M. Munir / Louise E. Hotka / Jennifer Oknich, MPCA Akira Matoba, URS Corporation.

WQ-WETSTORET Water Quality Data Web Entry Tool

James M. Porter / Hafiz M. Munir / Louise E. Hotka / Jennifer Oknich, MPCAAkira Matoba, URS Corporation

Minnesota Pollution Control Agency

WQ-WET: Need For Flexibility

The Minnesota Pollution Control Agency (MPCA) consolidates lake and stream data from dozens of local projects into a single statewide STORET database using SIM software.

Projects receiving certain funding must submit data in a STORET-ready format.

Past attempts to standardize across sources have not been successful.

WQ-WET: Need For Flexibility

Barriers to standardization:

SIM result-row format. Projects overwhelmingly prefer sample-row format spreadsheets.

STORET allowable values

Periodic updates to allowable values and STORET / SIM features create moving targets.

WQ-WET: Need For Flexibility

MPCA’s solution is WQ-WET.

Uploads a formatted spreadsheet and facilitates transformation to a SIM import file

Upload, not entry as the name implies. WQ-WUT?

Web-based application allows centralized updates to allowable values, fields, and features

Places more responsibility for STORET-readiness on the data provider

WQ-WET: Process Overview

The user looks up allowable STORET values or requests new values while preparing result files.

Upon upload, WQ-WET validates the file and facilitates aliasing of unrecognized field names and result values. This iterative process may require multiple uploads.

When the user has correctly configured the result file and aliases, WQ-WET loads the data and can export a SIM-ready file.

WQ-WET: Process Overview

WQ-WET: File Preparation

Download template from WQ-WET and format data accordingly

Format is flexible, to a point

WQ-WET: File Preparation

Look up allowable fields and values

Provide these wherever possible in upload file

Aliasing step will allow translation of unclear field names and values

WQ-WET: File Preparation

Example: Station search

Search by name, description, or coordinates

Coordinate search returns lists of stations by proximity

Map links to MapQuest and TopoZone

WQ-WET: File Preparation

Example: Analytical procedure search results for “mass”

WQ-WET: File Preparation

When the spreadsheet is ready, the user logs into WQ-WET and accesses the relevant project.

WQ-WET: Process Overview

WQ-WET: Field Checker

Upload spreadsheet to WQ-WET Field Checker Attempts to identify provided field names Checks for presence of required fieldsReturns errors and their locations in the upload file

WQ-WET: Field Checker

Translates field names which match pre-set or previously assigned aliases

Invites user to set up an alias for each unrecognized field

Aliases may be deleted and reassigned

WQ-WET: Field Checker

Example: Set up alias for imported field “Comment”

WQ-WET: Field Checker

When aliasing is complete, reload the file

Make additional file changes or set up aliases as necessary

Repeat until successful

WQ-WET will export a new file with correct field names

WQ-WET: Process Overview

WQ-WET: Validator

Upload Field Checked file to WQ-WET Validator

Checks validity of values for each field

Checks for activity duplication within file and versus previously loaded results

Returns errors and their locations in the Field Checked file

WQ-WET: Validator

Stations

Translates station IDs which match pre-set or previously assigned aliases

Invites user to set up an alias for each unrecognized station

Search and mapping tools are available when aliasing

Aliases may be deleted and reassigned

WQ-WET: Validator

Metadata/Result Values

Translates other values which match pre-set or previously assigned aliases

Invites user to set up an alias for each unrecognized value

Allowable-value search tools are available when aliasing

Aliases may be deleted and reassigned

WQ-WET: Validator

When aliasing is complete, reload the Field Checked file

Make additional file changes or set up aliases as necessary

Repeat until successful

WQ-WET will load the results into its internal database (not STORET)

WQ-WET: Process Overview

WQ-WET: Extract

Success! WQ-WET exports a SIM-ready file.

WQ-WET: More Information

Established values, aliases, and results remain until the next import unless deleted by the user.

User accounts are password-protected and restricted to assigned projects only. Multiple users may access one project if desired.

WQ-WET does not directly access STORET for security reasons. The allowable value tables are rewritten nightly in a separate database. MPCA staff will establish new values and load SIM import files independently from WQ-WET.

WQ-WET uses ColdFusion MX™, Java™, and MySQL™. TopoZone is a trademark of Maps a la carte, Inc. MapQuest is a trademark of MapQuest.com, Inc. ColdFusion MX is a trademark of Macromedia, Inc. Java is a trademark of Sun Microsystems, Inc. MySQL is a trademark of MySQL AB.

WQ-WET: Status

URS developed the prototype for a now-completed contract. MPCA manages development now.

Basically ready for internal agency use. The application will save substantial staff time even in its current, somewhat unrefined form.

Output is currently STORET 1.x compatible and needs to be brought up to STORET 2.x standards.

MPCA web developers want it to meet agency web standards before releasing to local projects.

MPCA data managers want it to be user-friendly so we do not overwhelm, discourage, and lose data providers.

WQ-WETSTORET Water Quality Data Web Entry Tool

James M. Porter / Hafiz M. Munir / Louise E. Hotka / Jennifer Oknich, MPCAAkira Matoba, URS Corporation

Minnesota Pollution Control Agency