MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.

MASSACHUSETTS INSTITUTE OF TECHNOLOGY • NASA GODDARD SPACE FLIGHT CENTER • ORBITAL SCIENCES CORPORATION • NASA AMES RESEARCH CENTER •

SPACE TELESCOPE SCIENCE INSTITUTE • SMITHSONIAN ASTROPHYSICAL OBSERVATORY

MAST

Daryl SwadeSTScl

G O D D A R D S P A C E F L I G H T C E N T E R22

Agenda

• Changes Since CSR• Requirements Flow down• MAST Overview• MAST Requirements• Interfaces• Schedule• Risks / Open Issues

G O D D A R D S P A C E F L I G H T C E N T E R33

Changes since CSR

• Full Frame Image (FFI) cadence change from 2 hours to 30 minutes will impact archive data volume.

G O D D A R D S P A C E F L I G H T C E N T E R44

Requirements Flow Down

• Show the requirements flow down and where the MAST fits into the flow.

G O D D A R D S P A C E F L I G H T C E N T E R55

MAST Overview

• 278 TB – Holdings size as of November 1, 2013.• 3 TB – Average Ingest Rate per month.• 19 TB – average data distribution rate per month.• 1,5000,000 – Average number of searches per month.

G O D D A R D S P A C E F L I G H T C E N T E R66

TESS Data Archive Context

G O D D A R D S P A C E F L I G H T C E N T E R77

TESS Archive Data Flow

Archive system monitoring and control

query results

queries

Ingest Archive Catalog

Distribution

Archive User Interface

data files

data files

catalog updates

queriesquery results

data request

quer

ies

quer

y re

sults

Archive user

catalog updates

Archive Catalog (replicated)

data

base

repl

icati

on

data files

Storage Broker

Data Receiptmanifest

Primary data store

Safe store

On-line cache

data files

data files

data request

science metadata

file informationdata files

G O D D A R D S P A C E F L I G H T C E N T E R88

Archive Functional Overview

• Data Receipt– Accept data and generate archive manifest

• Ingest– Store and catalog all data

• Archive Catalog– Provide an on-line science catalog of TESS metadata for searches, data

mining, and data retrieval• Implemented on relational DBMS

– Stage TESS Target Catalog for archival use

• Storage Broker– Maintain all data files on primary archive– Optionally, maintain data files on safe store and on-line cache

G O D D A R D S P A C E F L I G H T C E N T E R99

Archive Functional Overview (cont.)

• Archive User Interface– Make TESS data available to the astronomical community though the MAST

interface at STScI• Web-based query/preview/retrieval interface

– Create and maintain software tools required to search the TESS archive catalog

• This includes user access to target lists.– Create and maintain software tools required to access data

• Data Distribution– Retrieve requested data from storage broker– Ensure proper proprietary access to TESS data in the archive based on the

Science Office defined TESS Data Policy

• Archive Operator Interface– Operator interface for monitoring and control of the system

G O D D A R D S P A C E F L I G H T C E N T E R1010

TESS Science Data Archive Functions from CSR

• Storage of raw, reduced, and calibrated pixel and light curve data, including centroids, for all stars and planet candidates, to be transferred to MAST for public access on a trimester basis. With the ~22 day timeline for data passage through the pipeline, this implies that data will be 2-4 months old at time of public release.

• Storage of image data: raw, reduced, calibrated.• Storage of full-frame images acquired by TESS for validation of instrument

performance.• Storage of some TESS engineering data, as needed, to update science header

keywords.• Lists of Threshold Crossing Events from TPS in XML format will be exported to

MAST (and to the Exoplanet Archive).• Data Validation reports for each target with TCEs processed by DV will be exported

to the MAST as PDFs and with numerical results in XML files. • High Level Science Products provided to STScI from the TESS Science Operations

Center. These include light curves and any compiled catalog data including a TESS Object of Interest catalog (TOI).

• A simple interface based on the Mission supplied FITS files for data search and retrieval.

G O D D A R D S P A C E F L I G H T C E N T E R1111

MAST Requirements

• Discuss the Level 3 requirements

G O D D A R D S P A C E F L I G H T C E N T E R1212

Driving Requirements

• Discuss the driving requirements for MAST development

Data Receipt

The TESS Data Archive shall receive to be specified data from the SPOC.

The TESS Data Archive shall receive to be specified data from the TESS Science Office.

Data Receipt shall generate a manifest for all data received.

Ingest

Ingest shall store all TESS data in the TESS Data Archive.

Ingest shall catalog all TESS data in the TESS Data Archive.

Storage Broker

The Storage Broker shall store all TESS data in the primary archive.

The Storage Broker shall store to be selected TESS data on safe store media.

The Storage Broker shall store to be selected TESS data in the on-line cache.

G O D D A R D S P A C E F L I G H T C E N T E R1313

Driving Requirements (cont.)

• Discuss the driving requirements for MAST development

Archive Catalog

The TESS Data Archive shall provide an on-line science catalog of metadata for searches, data mining, and data retrieval.

The TESS science catalog shall contain metadata extracted from the science dataset keyword values.

The TESS archive database shall track each data set with a field indicating the proprietary status of the corresponding data files.

Data Distribution

TESS data shall be made available to the astronomical community through the MAST interface at STScI under the proprietary rights restrictions defined by the TESS Data Policy.

The TESS Data Archive shall be able to distribute data to archive users via electronic mechanisms or removable media with a user specified preference, but at the discretion of the Archive Operator.

G O D D A R D S P A C E F L I G H T C E N T E R1414

Driving Requirements (cont.)

• Discuss the driving requirements for MAST development

Archive User Interfaces

MAST shall create and maintain software tools required to access data in the TESS Data Archive for at least 10 years after the end of the mission.

Data Security

MAST shall protect all TESS data against unauthorized access per requirements established by NPR 2810.1, Security of Information Technology.

G O D D A R D S P A C E F L I G H T C E N T E R1515

MAST Interfaces

• Discuss the interfaces between the POC, SPOC and MAST.– Talk about the interface including the network and protocols– Talk about the data flow and the latency.

G O D D A R D S P A C E F L I G H T C E N T E R1616

TSO data to MAST

Data product Delivery frequency

Data volume Delivery mechanism

TESS Input Catalog

Targets of Interest List

Archive follow up data

G O D D A R D S P A C E F L I G H T C E N T E R1717

SPOC Data to MAST

Data Product Generation Frequency

Delivery frequency

Data volume Delivery mechanism

Telemetry data

Science pixels - uncalibrated

Collateral pixels - uncalibrated

Science pixels - calibrated

Collateral pixels - calibrated

Calibration reference files

Focal plane geometry model

Calibrated light curves

Centroid time-series

Full frame images - uncalibrated

Full frame images - calibrated

Pixel mapping reference files

Optimal aperture definitions

Pointing profiles

Data validation products

G O D D A R D S P A C E F L I G H T C E N T E R1818

Archive User Interface

G O D D A R D S P A C E F L I G H T C E N T E R1919

Schedule

• Show the MAST Schedule– Include status and path to PDR

G O D D A R D S P A C E F L I G H T C E N T E R2020

Risks / Open Issues

• Failing to involve MAST staff closely and early in Ground Segment activities risks delayed optimization of TESS science archive usage and increased software development costs in phases D and E.