JAG/ODAA Fall 2010 COPC Co-Chairs: Mr. James Vermeulen, FNMOC Dr. Bradley Ballish, NCEP Presented by: Mr. James Vermeulen Exec. Secretary: Mr. Anthony.

JAG/ODAAJAG/ODAA Fall 2010 COPCFall 2010 COPC

Co-Chairs:Co-Chairs:Mr. James Vermeulen, FNMOCMr. James Vermeulen, FNMOCDr. Bradley Ballish, NCEPDr. Bradley Ballish, NCEP Presented by: Mr. James VermeulenPresented by: Mr. James Vermeulen

Exec. Secretary: Exec. Secretary: Mr. Anthony Ramirez, Mr. Anthony Ramirez,

OFCMOFCM

2

OverviewOverview JAG/ODAA Roster JAG/ODAA Roster Significant Accomplishments and Significant Accomplishments and On-going ActivitiesOn-going Activities New IssuesNew Issues National Operational Processing National Operational Processing

Center Observational Data WorkshopCenter Observational Data Workshop

3

ODAAODAA RosterRoster

Sub-GroupsSub-Groups Conventional DataConventional Data Satellite Data/Assimilation Satellite Data/Assimilation

4

JAG/ODAA RosterJAG/ODAA Roster

Satellite Data/Assimilation Conventional

FNMOC Mr James Vermeulen (Co-chair)

   Ms. Leslie BaranMr. Russell Schwanz

NCEP Dr. Bradley Ballish (Co-chair)

AFWA Mr. Eric Wise

  Mr. Dennis Hobson Vacant Mr. Al Zamiska

14th WS  Mr. Jonathan

Whiteside

NOAA/NESDIS Mr. Vincent Tabor  

Mr. Norman Johansen Vacant

5

JAG/ODAA RosterJAG/ODAA Roster

 Satellite Data/Assimilation Conventional

JCSDA Dr. James Yoe  

NAVO Mr. Bruce McKenzie Mr. Kyle Rushing

NWS   Mr. Walter Smith

NOAA/NDBC   Mr. Rex Hervey

NOAA/OAR  Dr. Steven Piotrowicz

NOAA/NCDC  Mr. Daniel Manns

JPSS/DWSS/DPD

Mr Richard Ullman (NASA)? Mr. Al Powell (NOAA STAR)  

JPSS/DWSS/GSD

Ms. Marge Ripley (NOAA)? Mr. Joe Mulligan (JPSS Customer Liaison)  

OFCM Mr. Anthony Ramirez (Exec. Secretary)

6

Accomplishments and Ongoing ActivitiesAccomplishments and Ongoing Activities Satellite data requestsSatellite data requests

Pull AMSR-E TPW data products via DDS Pull AMSR-E TPW data products via DDS Requestor: FNMOC Provider: NESDIS Status: ClosedRequestor: FNMOC Provider: NESDIS Status: Closed Transmit DMSP F-18 data products Transmit DMSP F-18 data products Requestor: NESDIS Provider: FNMOC Status: ClosedRequestor: NESDIS Provider: FNMOC Status: Closed Transmit 4 km Snow Cover Files to AFWATransmit 4 km Snow Cover Files to AFWA

Requestor: AFWA/2WXG Provider: NESDIS Status: ClosedRequestor: AFWA/2WXG Provider: NESDIS Status: Closed Transmit Ozone SBUV/2 TOAST data products Transmit Ozone SBUV/2 TOAST data products Requestor: AFWA Provider: NESDIS Status: Closed Requestor: AFWA Provider: NESDIS Status: Closed Transmit MODIS 1/2km data productsTransmit MODIS 1/2km data products Requestor: AFWA Provider: NESDIS Status: Closed Requestor: AFWA Provider: NESDIS Status: Closed Transmit LIS data productsTransmit LIS data products Requestor: FNMOC Provider: AFWA Status: ClosedRequestor: FNMOC Provider: AFWA Status: Closed Transmit MLS AIRS Ozone data productsTransmit MLS AIRS Ozone data products Requestor: FNMOC Provider: NESDIS Status: ClosedRequestor: FNMOC Provider: NESDIS Status: Closed

7

Satellite Data Product Exchange Satellite Data Product Exchange Request (SDPER) Form RevisionRequest (SDPER) Form Revision The SDPER Form was revised to meet recently The SDPER Form was revised to meet recently

adopted NESDIS data access policy and to adopted NESDIS data access policy and to streamline the processing of OPC data product streamline the processing of OPC data product requests.requests.

8

Accomplishments and Ongoing ActivitiesAccomplishments and Ongoing Activities Satellite data requestsSatellite data requests

Transmit GOME-2 Ozone data productsTransmit GOME-2 Ozone data products Requestor: FNMOC Provider: NESDIS Requestor: FNMOC Provider: NESDIS

Status: OpenStatus: Open Transmit SSMIS UPP CP data products Transmit SSMIS UPP CP data products Requestor: NESDIS Provider: FNMOC Requestor: NESDIS Provider: FNMOC

Status: OpenStatus: Open Transmit AVHRR FRAC 1k data products Transmit AVHRR FRAC 1k data products Requestor: FNMOC Provider: NESDIS Requestor: FNMOC Provider: NESDIS

Status: OpenStatus: Open Transmit MODIS ¼ and ½ and 1k data products Transmit MODIS ¼ and ½ and 1k data products Requestor: FNMOC Provider: NESDIS Requestor: FNMOC Provider: NESDIS

Status: OpenStatus: Open

9

JAG/ODAA Action ItemsJAG/ODAA Action Items

Subsurface Oceanographic BUFR Data GTS Subsurface Oceanographic BUFR Data GTS disseminationdissemination NAVOCEANO has transitioned profiling float NAVOCEANO has transitioned profiling float

data into BUFR patterned after the ARGO data into BUFR patterned after the ARGO profiling float templateprofiling float template

NWS/TOC created collective for data NWS/TOC created collective for data disseminationdissemination

NAVO has confirmed that the collective of data NAVO has confirmed that the collective of data in BUFR is now being disseminated over the in BUFR is now being disseminated over the GTS GTS

10

Comparison of Fixed Weather Site Comparison of Fixed Weather Site DictionariesDictionaries

Various dictionaries helped with METAR and SYNOPTIC Various dictionaries helped with METAR and SYNOPTIC site locations and elevations.site locations and elevations.

Little GFS impact found from surface dictionary fixes at Little GFS impact found from surface dictionary fixes at NCEP. More impact is expected from AIREPs at wrong NCEP. More impact is expected from AIREPs at wrong locations due to errors from waypoint locations.locations due to errors from waypoint locations.

Waypoint dictionaries from AFWA, NCEP, NWSTG have Waypoint dictionaries from AFWA, NCEP, NWSTG have been compared, all have some errors.been compared, all have some errors.

AIREP data has also been studied to find location errors.  AIREP data has also been studied to find location errors.  FAA waypoint dictionary looks ideal for NWSTG -- will be FAA waypoint dictionary looks ideal for NWSTG -- will be

updated soon. updated soon.  AIREP location errors from Fiji have been fixed. AIREP location errors from Fiji have been fixed. NCEP will be working with AFWA for possibly modifying NCEP will be working with AFWA for possibly modifying

AFWA software for processing AIREPS at waypoint names. AFWA software for processing AIREPS at waypoint names. There will be ongoing work on dictionary updatesThere will be ongoing work on dictionary updates

11

Group email address for notification of Group email address for notification of conventional data problems and significant conventional data problems and significant data issuesdata issues Group email list has been implemented and has Group email list has been implemented and has

been used successfully. been used successfully. Procedures and group listing have been posted Procedures and group listing have been posted

to the JAG/ODAA web page for easy reference. to the JAG/ODAA web page for easy reference. Members are encouraged to routinely use this Members are encouraged to routinely use this

capability.capability. Status:Status: Closed Closed

12

Evaluate the format and protocol of Evaluate the format and protocol of the RRS product delivered to NCDCthe RRS product delivered to NCDC Mr. Dan Manns provided NCDC POCs for Mr. Dan Manns provided NCDC POCs for

members to access and evaluate RRS product members to access and evaluate RRS product

Collaborate with NWS on Collaborate with NWS on development of new RRS data development of new RRS data protocolprotocol

Action item subgroup will explore next stepsAction item subgroup will explore next steps with Mr. Joe Facundo, NWS, Chief Observing with Mr. Joe Facundo, NWS, Chief Observing Systems BranchSystems Branch

13

Obtain and review WMO’s BUFR sequence Obtain and review WMO’s BUFR sequence format for NWP (RRS data)format for NWP (RRS data)

This is how WMO is planning to model high-resolution This is how WMO is planning to model high-resolution systems for international exchange of BUFR data for systems for international exchange of BUFR data for NWP. NWP.

WMO-sanctioned templates and guides for how to WMO-sanctioned templates and guides for how to report high-resolution radiosonde data in BUFR are report high-resolution radiosonde data in BUFR are under review by NRL, JCSDA, AFWAunder review by NRL, JCSDA, AFWA

Proposal to create an NWSTG-based process to collect Proposal to create an NWSTG-based process to collect and convert the current RRS BUFR messages (once and convert the current RRS BUFR messages (once they become available) into these template formats for they become available) into these template formats for global disseminationglobal dissemination

Agencies need to plan work for future use of very high Agencies need to plan work for future use of very high resolution bufr radiosonde data resolution bufr radiosonde data

14

BUFR/TAC Dual Observations – differing BUFR/TAC Dual Observations – differing location information.location information. Some synoptic obs flow in both TAC (alphanumeric) Some synoptic obs flow in both TAC (alphanumeric)

and BUFR formatsand BUFR formats Some BUFR obs have significantly different location Some BUFR obs have significantly different location

information than indicated in the catalog for the same information than indicated in the catalog for the same site. site.

BUFR obs includes location. TAC requires dictionary BUFR obs includes location. TAC requires dictionary lookup. lookup.

AFWA and FNMOC request a coordinated effort to AFWA and FNMOC request a coordinated effort to resolve this issueresolve this issue

AFWA and FNMOC studying to determine and report AFWA and FNMOC studying to determine and report the current extent of dual observation discrepancies the current extent of dual observation discrepancies and operational impact and operational impact

15

Obtain proxy NPOESS HD5 data Obtain proxy NPOESS HD5 data created from level 1b MODIS and created from level 1b MODIS and IASI data for testingIASI data for testing The data is available to OPCs for use on

the GRAVITE/CasaNOSA server. Currently being accessed by FNMOC,

NRL, and NAVOCEANO

Satellite Satellite DataData

16

GOES Experimental/Routine Hourly GOES Experimental/Routine Hourly Atmospheric Motion Vectors (AMVs) Atmospheric Motion Vectors (AMVs) ProductProduct NESDIS produces an experimental hourly NESDIS produces an experimental hourly

GOES wind product -- data available to PartnersGOES wind product -- data available to Partners Now being generated every hour on a routine, but

experimental, basis for the GOES-E and GOES-W imagers within the NESDIS Center for Satellite Applications and Research (STAR).

Geographic coverage of these products is the same as the current operational products.

These wind products are being made available in BUFR format and can be accessed via the experimental STAR external ftp server

17

Acquisition of Korean COMS-1 Satellite data Acquisition of Korean COMS-1 Satellite data Korean Communication, Ocean and Meteorological Korean Communication, Ocean and Meteorological

Satellite-1 (COMS-1) Geostationary Ocean Color Satellite-1 (COMS-1) Geostationary Ocean Color Imager (GOCI) and Meteorological Imager (MI) Imager (GOCI) and Meteorological Imager (MI) datadata

Launched 26 June 2010, in test now, planned Launched 26 June 2010, in test now, planned ops in Jan 11ops in Jan 11

Positioned at 128 deg East (MTSAT-2 at 145 Positioned at 128 deg East (MTSAT-2 at 145 deg East)deg East)

AFWA working necessary Mark IVB modifications AFWA working necessary Mark IVB modifications to enable MI data receiptto enable MI data receipt

NAVO requesting NESDIS acquire this dataNAVO requesting NESDIS acquire this data FNMOC discussing requirements with FNMOC discussing requirements with

NESDIS/AFWANESDIS/AFWA

18

Establish a formal process for routine Establish a formal process for routine access to calibration/validation access to calibration/validation

informationinformation Mechanism needed among OPC partners for collaborative cal/val

activities and in the exchange and sharing cal/val information. Scientists need routine access to calibration/validation (cal/val)

information and to be more involved (for example as observers) in OPC cal/val reviews and activities.

There are established OPC processes for sharing the data files but not for sharing cal/val information.

Having access to what went on to produce the content of data files is critical. Cal/val reviews should include (systematically) OPCs key scientists (or key POC) who use the satellite data.

JCSDA, AFWA, FNMOC, and NAVO should become part of the STAR and DWSS teams for collaborative cal/val and sharing of information.

19

Delivery of NAVO SST data to NCEP in Delivery of NAVO SST data to NCEP in BUFRBUFR Arrange continued delivery of NAVO SST data to the

NCEP Environmental Modeling Center. The current system used to deliver NAVO SST data to EMC will be discontinued within a year

NCEP has requested the data in BUFR format. They have provided the BUFR tables and an encoder for NAVO to evaluate

NAVO is determining the level of effort required to provide the SST data in BUFR.

20

ESDA TR-1 For Official Use Only (FOUO) ESDA TR-1 For Official Use Only (FOUO) Designation Review and RevalidationDesignation Review and Revalidation

ESDA TR-1 replaced the Shared Processing Program (SPP) Operations Manual (POM) in 2009  POM was restricted to FOUO limited distribution by 2002 agreement FOUO exempted from Freedom of Information Act due to environmental satellite data and space related operational information TR-1 undergoing Partner Agency FOUO review/revalidation

21

New IssuesNew Issues

US plan for migration from ASCII to BUFR US plan for migration from ASCII to BUFR Trip Report: WMO Data Representation and Codes, Brazil Aug 31 – Trip Report: WMO Data Representation and Codes, Brazil Aug 31 –

Sep 3 2010, Mr. Jeff Ator, NCEP Sep 3 2010, Mr. Jeff Ator, NCEP WMO target date for migration of Category 1 TAC codes is WMO target date for migration of Category 1 TAC codes is

November 2010 -- 80% of WMO members (including the U.S) November 2010 -- 80% of WMO members (including the U.S) will not meet this datewill not meet this date

Consensus: target dates should not be revised -- stresses Consensus: target dates should not be revised -- stresses urgency/provides recognition of 20% who will meet target urgency/provides recognition of 20% who will meet target

Target dates do not imply ceasing dissemination of TAC code Target dates do not imply ceasing dissemination of TAC code forms; could continue if needed between respective producers forms; could continue if needed between respective producers and users. and users.

NWS/TOC has been tasked to lead the U.S. implementation of the NWS/TOC has been tasked to lead the U.S. implementation of the U.S. BUFR migration (data conversion to BUFR). U.S. BUFR migration (data conversion to BUFR).

22

New IssuesNew Issues WMO Weather Information System New activities within the NWS/TOC to support the WMO New activities within the NWS/TOC to support the WMO

Weather Information System (WIS)Weather Information System (WIS) WIS is the single coordinated global infrastructure WIS is the single coordinated global infrastructure

responsible for the telecommunications and data responsible for the telecommunications and data management functions. management functions.

The group requested NWS/TOC provide or arrange a briefing The group requested NWS/TOC provide or arrange a briefing to the group on the GTS and WMO/WIS related activities as to the group on the GTS and WMO/WIS related activities as

they relate to the NWS/TOC and OPCs.they relate to the NWS/TOC and OPCs. Mr. Smith, NWS/TOC is developing a presentation on the Mr. Smith, NWS/TOC is developing a presentation on the

WMO/WIS and agreed to present at the next meeting.WMO/WIS and agreed to present at the next meeting.

23

Administrative ItemsAdministrative Items Terms of Reference update and revisionTerms of Reference update and revision Conventional Data Plan/Annex DiscussionsConventional Data Plan/Annex Discussions

24

National Operational Processing Center National Operational Processing Center Observational Data WorkshopObservational Data Workshop

Background:Background: March 2010 JAG/ODAA face to face meeting, members March 2010 JAG/ODAA face to face meeting, members were asked for recommendations for JAG/ODAA were asked for recommendations for JAG/ODAA activities/priorities/focus areas for 2010. AFWA proposed that activities/priorities/focus areas for 2010. AFWA proposed that JAG/ODAA convene a data summit (outlined below). JAG/ODAA convene a data summit (outlined below).

AFWA Proposal:AFWA Proposal: JAG/ODAA serve as a forum to host a F2F Data JAG/ODAA serve as a forum to host a F2F Data Summit meeting to:Summit meeting to: Discuss/exchange info on new data sources, quality issues, Discuss/exchange info on new data sources, quality issues,

station metadata standards and consistency, etc. station metadata standards and consistency, etc. Invite non-JAG/ODAA participants (labs, universities, other Invite non-JAG/ODAA participants (labs, universities, other

agencies (broader OFCM member participation)) agencies (broader OFCM member participation)) Get “outside” views which may influence/ improve JAG/ODAA Get “outside” views which may influence/ improve JAG/ODAA

collaboration opportunities collaboration opportunities

25

Recommend both an unclassified and classified session Recommend both an unclassified and classified session Discuss making this an annual or bi-annual meetingDiscuss making this an annual or bi-annual meeting

Name Recommendation:Name Recommendation: Following discussion (OFCM Chief Scientist and senior staff) Following discussion (OFCM Chief Scientist and senior staff)

regarding the initial scope, it was recommended that this regarding the initial scope, it was recommended that this meeting be called a workshopmeeting be called a workshop

Similar to other OFCM workshops with similar purpose Similar to other OFCM workshops with similar purpose

26

Draft FrameworkDraft Framework

Workshop Name:Workshop Name: National Operational Processing National Operational Processing Center Observational Data WorkshopCenter Observational Data Workshop

Target Time Frame:Target Time Frame: Spring 2011 (priority and Spring 2011 (priority and workload dependent)workload dependent)

Theme:Theme: Improving the acquisition, quality control, Improving the acquisition, quality control, processing, and exchange of weather (atmospheric) processing, and exchange of weather (atmospheric) and water (ocean) data for assimilation into models and water (ocean) data for assimilation into models and products. and products.

Purpose:Purpose: Discuss data issues in general to facilitate Discuss data issues in general to facilitate discovery, exchange and assimilation of data by discovery, exchange and assimilation of data by data users and providers across the National data users and providers across the National Operational Processing Center (OPC) community. Operational Processing Center (OPC) community.

27

Location Options:Location Options: DC area. Classified data discussions require secure DC area. Classified data discussions require secure

facilitiesfacilities One of the Operational Processing Centers One of the Operational Processing Centers AFWA (has facilities that can accommodate secure)AFWA (has facilities that can accommodate secure) FNMOC has conflict with COPC meeting and 50 yr FNMOC has conflict with COPC meeting and 50 yr

celebrations. celebrations. Assess home location of majority of participants, need Assess home location of majority of participants, need

secure facilities for classified discussions. secure facilities for classified discussions.

Expected Outcomes:Expected Outcomes: Discovery of opportunities to expand future collaborative Discovery of opportunities to expand future collaborative

OPC operational data activities and leverage capabilities OPC operational data activities and leverage capabilities Assist in defining and prioritizing the work we are doing Assist in defining and prioritizing the work we are doing

in COPC-JAG/ODAA and the other JAGs, WGs and in COPC-JAG/ODAA and the other JAGs, WGs and CommitteesCommittees

28

Workshop Structure/Focus Areas:Workshop Structure/Focus Areas: New and Emerging Data Programs, Projects, Initiatives New and Emerging Data Programs, Projects, Initiatives Data Sources, Needs and Capabilities Data Sources, Needs and Capabilities Quality Control Quality Control Metadata (formats, common catalog)Metadata (formats, common catalog) Data Acquisition for AssimilationData Acquisition for Assimilation Classified DataClassified Data Data Bias CorrectionData Bias Correction

Status:Status: Draft framework is circulating among JAG/ODAA members for Draft framework is circulating among JAG/ODAA members for

agency review andagency review and comment comment Lead agency representatives were asked to informally Lead agency representatives were asked to informally

circulate to subject matter experts for comments and circulate to subject matter experts for comments and recommendations recommendations

Recommendation:Recommendation: Request COPC confirm validation of Request COPC confirm validation of agency resource commitmentsagency resource commitments to conduct workshop to conduct workshop

29

Questions?Questions?