(A)ATSR archive at the NERC Earth Observation Data Centre Matt Pritchard, Jack Abolins, Brian Maddison & Chris Mutlow NEODC / CCLRC Rutherford Appleton.

(A)ATSR archive(A)ATSR archiveat theat the

NERC Earth Observation Data CentreNERC Earth Observation Data Centre

Matt Pritchard, Jack Abolins, Brian Maddison & Chris Matt Pritchard, Jack Abolins, Brian Maddison & Chris MutlowMutlow

NEODC / CCLRC Rutherford Appleton LaboratoryNEODC / CCLRC Rutherford Appleton Laboratory

(A)ATSR Archive at the NEODC

What is the NEODC?

• NERC Data NERC Data CentresCentres– Data Data

managementmanagement– CurationCuration– Support for UK Support for UK

EO communityEO community


NEODC Datasets

• Commercial satellite imageryCommercial satellite imagery– LANDSAT, SPOT, …LANDSAT, SPOT, …

• NERC ARSFNERC ARSF– ATM, CASI, LiDAR, Digital ATM, CASI, LiDAR, Digital

Aerial PhotographyAerial Photography

• NEXTMap BritainNEXTMap Britain– IfSAR 5m terrain model of GBIfSAR 5m terrain model of GB

• ATSR UBT archiveATSR UBT archive– ATSR-1, ATSR-2ATSR-1, ATSR-2

• NEODC interfaceNEODC interface• ESA SSEESA SSE

services.eoportal.orgservices.eoportal.org

• (A)ATSR Archive(A)ATSR Archive– 3 missions, 1 format3 missions, 1 format

(ENVISAT)(ENVISAT)


NEODC Datasets









(ENVISAT)(ENVISAT)


NEODC Datasets









(ENVISAT)(ENVISAT)


NEODC Datasets









(ENVISAT)(ENVISAT)


(A)ATSR Archive - background

• Project backgroundProject background– Hadley Centre Climate Prediction Hadley Centre Climate Prediction

ProgrammeProgramme•Requirement for common-format set of Requirement for common-format set of

products covering 15 yearsproducts covering 15 years• Inputs to climate change researchInputs to climate change research

– NERC / UK EO communityNERC / UK EO community•Dedicated (A)ATSR Archive for researchDedicated (A)ATSR Archive for research

– RAL involvement with (A)ATSRRAL involvement with (A)ATSR•Design / build / consultation / operations / Design / build / consultation / operations /

calibration / validation / data management / calibration / validation / data management / community supportcommunity support


(A)ATSR Archive - overview

UBT Level 2archive

Level 1barchive

Archive Product

Processor

AATSRL2

ATSR-2 L1b

ATSR-1 L1b

ATSR-2 UBT

ATSR-1 UBT ATSR-

1 L2

ATSR-2 L2

ATSR-1

METEO

ATSR-2

METEO

AATSR L1b

AATSR L2

AATSR METE

O

Archive Product

Processor

ingest

AATSRL1b

ingest


Products from (A)ATSR

• Products from (A)ATSRProducts from (A)ATSRProductProduct DescriptionDescription ATSR-1ATSR-1 ATSR-2ATSR-2 AATSRAATSR

ATS_TOA_1ATS_TOA_1PP

GBTR at full resolutionGBTR at full resolution **ATS_NR__2ATS_NR__2PP

GST at full resolutionGST at full resolution **ATS_AR__2PATS_AR__2P AST at 0.5AST at 0.5° & 10 arcmin resolution° & 10 arcmin resolution **ATS_MET_2ATS_MET_2PP

METEO product: AST & ABT, 10 arc minMETEO product: AST & ABT, 10 arc min ATS_AST_BATS_AST_BPP

Browse product 4 x 4 km resolutionBrowse product 4 x 4 km resolution jpegjpeg Preview imagePreview image

*already online*already online


Delivery mechanism

• Storage structureStorage structure– 80 Terabyte archive80 Terabyte archive– 1 file structure:1 file structure:

• mission/YY/MM/DD/productmission/YY/MM/DD/product

• Methods (self-service access)Methods (self-service access)– FTPFTP– HTTP (Data browser)HTTP (Data browser)

• Searchable metadata catalogueSearchable metadata catalogue– map interfacemap interface– Metadata inspectionMetadata inspection– Preview imagesPreview images


Delivery mechanism




• Searchable metadata catalogueSearchable metadata catalogue– map interfacemap interface– Metadata inspectionMetadata inspection– Preview imagesPreview images


Data browser


Data browser


Data browser


Data browser


Data browser


Data browser


Data browser


Data browser


Data browser


Delivery mechanism




• Searchable metadata catalogueSearchable metadata catalogue– Example from existing ATSR-1/2 UBT archive Example from existing ATSR-1/2 UBT archive

interfaceinterface– Map interfaceMap interface– Metadata inspectionMetadata inspection– Preview imagesPreview images


ATSR-1 & 2 UBT Archive

• Online accessOnline access– SearchSearch


























Archive availability

•NEODC (A)ATSR archiveNEODC (A)ATSR archive–Dedicated facility for UK usersDedicated facility for UK users

(NERC & Cat-1)(NERC & Cat-1)– [email protected]@rl.ac.uk

•ESAESA–Non-UK usersNon-UK users

– [email protected]@esa.int


AATSR Products

AATSRAATSR

Level 1b Level 1b (ATS_TOA_1P)(ATS_TOA_1P)


AATSR Products

Level 2 averaged (ATS_AR__2P)Level 2 averaged (ATS_AR__2P)


Online archive

• Current coverage: Level 1b productsCurrent coverage: Level 1b products


Online archive

• Current coverage: Level 2 full-resolution productsCurrent coverage: Level 2 full-resolution products


Online archive

• Current Coverage: Level 2 averaged productsCurrent Coverage: Level 2 averaged products


Archive Product Processor

The Archive Product Processor

(APP)

CfE STEP

ERS Mission Orbit & Phase Information

Set of sequential SADIST-2 UBTs from the NEODC Archive

Ungridded Orbit ProductATS_TOA_UP.En

ATSR-2 Reflectance Calibration Tables

State-Vector &Time-correlation

Envisat-Style ATSR Auxiliary Data

Envisat-styleATSR-1/ATSR-2 L1B

ATS_TOA_1P.En

Consolidate for Envisat::

· Stitches together SADIST-2 frames· Removes tape-to-tape overlaps· Prepares Envisat MPH contents· Generates Orbit/Time data· Generates min/max sensor temps· Removes blanking-pulse negation· Preserves blanking-pulse info· Generates processing/QA log

SADIST-2 To Envisat ProcessorAATSR Prototype Processor modules for:

· Geolocation (Courtesy ESA/GMV)· Gridding (Courtesy ESA/GMV)· Cosmetic Filling· Land/Sea Flagging· Cloud-flagging

and also must:· Switch between ATSR-1 and ATSR-2 Aux

data· Transfer ungridded data into PP

structures · Use the PP's "Output_GBTR" module with

ATSR-1 and ATSR-2 switches

Orbit Min/Max Temperatures


First outputs

ATSR-2ATSR-2

Level 1b Level 1b (ATS_TOA_1P)(ATS_TOA_1P)


Archive benefits

• Processing facilityProcessing facility– Generation of product extractsGeneration of product extracts– Processing against entire archiveProcessing against entire archive

•Projects e.g. Projects e.g. ATSR-ClimateATSR-Climate•Reprocessing / evaluation datasetsReprocessing / evaluation datasets

• Supply of validation dataSupply of validation data• Delivery methodsDelivery methods

– OGC WMS / WCS ?OGC WMS / WCS ?

• Replacement of current products with Replacement of current products with outputs of ESA AATSR reprocessingoutputs of ESA AATSR reprocessing


http://www.neodc.rl.ac.ukhttp://www.neodc.rl.ac.uk

[email protected]@rl.ac.uk

(A)ATSR archive at the NERC Earth Observation Data Centre Matt Pritchard, Jack Abolins, Brian Maddison & Chris Mutlow NEODC / CCLRC Rutherford Appleton.

Documents

aatsr archive aatsr

aatsr products

ubt atsr

archive level

aatsr productdescriptionatsr

l1b atsr

meteo atsr

neodc products