NASA SNPP Cross Track Infrared Sounder (CrIS) Level 1B Delta Algorithm Theoretical Basis Document (ATBD) University of Wisconsin-Madison Space Science and Engineering Center University of Maryland Baltimore County Atmospheric Spectroscopy Laboratory Version 1.0 May 2017 This research was conducted with funding provided by the National Aeronautics and Space Administration.
56
Embed
NASA SNPP Cross Track Infrared Sounder (CrIS) … · (CrIS) Level 1B Delta Algorithm Theoretical Basis Document (ATBD) University of Wisconsin-Madison Space Science and Engineering
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
5
AbstractThis document describes the theoretical basis of the NASA CrIS Level 1B (L1B) algorithmsoftware and resulting product. Because the theoretical basis is very similar to that of theoperational Joint Polar Satellite System (JPSS) Sensor Data Record (SDR) algorithm, it wasdecidedtoimplementthisdocumentasa"delta"ATBDdescribingthedifferencesbetweenthetwo approaches, rather than implementing a full ATBDwith duplicate information. Thus thisdelta ATBD togetherwith the CrIS SDRATBD form a complete description of the theoreticalbasisoftheNASACrISL1Bsoftware.
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
Figure 2.2.2-4 CrIS shortwave band undecimated signal (DM) overlaid with FFT ofcorrespondingFIRfilter(FIR).Eachcurveisnormalizedtounity..................................................19
The software was developed by the CrIS L1B Science and Software Team, located at theUniversity ofWisconsin-MadisonSpace Science andEngineeringCenter and theUniversity ofMarylandBaltimoreCountyAtmosphericSpectroscopyLaboratory.The productwas generated by the SNPP Sounder Science Investigator-led Processing System(SIPS), locatedat theNASA JetPropulsionLaboratory (JPL)andGoddardEarthSciencesDataInformationServicesCenter(GESDISC).
1.3 DocumentOverview Because the theoretical basis is very similar to that of the operational Joint Polar SatelliteSystem(JPSS)SensorDataRecord(SDR)algorithm,itwasdecidedtoimplementthisdocumentas a "delta" ATBD describing the differences between the two approaches, rather thanimplementinga fullATBDwithduplicate information.ThusthisdeltaATBDtogetherwiththeCrIS SDR ATBD forms a complete description of the theoretical basis of the NASA CrIS L1Bsoftware.TheCrISSDRATBDthatisacompaniontothisdocumentwasreleasedDecember23,2014bytheJPSSGroundProject,andiscalled“JointPolarSatelliteSystem(JPSS)CrossTrackInfraredSounder(CrIS)SensorDataRecords(SDR)AlgorithmTheoreticalBasisDocument(ATBD),RevC,Code474,474-00032”.The layoutof thisdocumentcorresponds to the layoutof theCrISSDRATBD.Eachsectionofthis document describes the changes relative to the corresponding section in the CrIS SDRATBD,orthewords“Nochange”indicatingtherearenochangestobeapplied.
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
15
2. Joint Polar Satellite System (JPSS) Visible Infrared Imaging Radiometer Suite (VIIRS)SensorDataRecord(SDR)GeolocationAlgorithmTheoreticalBasisDocument(ATBD),E/RA-00004,Rev.A
3. Interface Control Document between Earth Observing System (EOS) Data and
Operations System (EDOS) and Science Investigator-led Processing Systems for theSuomi National Polar-Orbiting Partnership (SNPP) Science Data Segment (SDS), 423-ICD-010,Original,EarthScienceDataInformationSystems(ESDIS),Code423
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
17
2 SDRALGORITHMSPRINCIPLESTheprimaryinputtotheL1BsoftwareisL0data,whichiscomposedofrawCCSDSpacketsasreceived from the spacecraft, together with added metadata. L0 data is produced anddistributedbyEDOS,andisequivalenttoRDRdataintheoperationalJPSSprocessingsystem.The L1B software generates L1A and L1B product files. The L1A product contains unpackedspacecrafttelemetrydatathathasbeengranulatedandgeolocated,aswellasqualityflagsandmetadata. There is no equivalent to the CrIS L1A product in the current operational JPSSprocessing system. The L1B product contains calibrated spectra, together with geolocationinformation,qualityflags,diagnosticinformationandmetadata.L1BisequivalenttoSDRsinthecurrent operational processing system. The L1B product is used as input to L2 processing(equivalenttoEDRsinthecurrentoperationalprocessingsystem).
2.5.2 CrISSpectralBandsTable2andFigure14correctlystatethespectralsamplingusedintheoriginallowresolutioninstrument data collectionmode. The CrIS signal processor on Suomi-NPP was reconfiguredduring themission to collect at full spectral resolution in the MW and SW bands. After thischange the full spectral resolution data can be produced at a uniform spectral resolution of0.625cm-1(0.8cmMOPD)foralldetectorbands(LW,MW,andSW).TheNASAL1Bsoftwarecurrently truncates the full spectral resolution CrIS data to match the original spectralresolutionshowninTable2.
2.5.3 CrISFieldofRegard Nochange.
2.5.4 CrISMeasurementSequenceNochange.
2.5.5 CrISSignalProcessing Nochange.
2.6 SignalRepresentation Nochange.
2.6.1 ArrayDimensions Nochange.
2.6.2 DataOrderingNochange.
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
22
3 SPECIALCONSIDERATIONS
3.1 Non-linearityCorrection Nochange.
3.2 ScanMirrorPolarizationCompensation Nochange.
3.3 FringeCountErrorHandlingNofringecounterrordetectionorcorrectioniscurrentlyincludedintheNASAL1Bprocessing.The correctionalgorithmdescribed in theATBDwasnot included, as it isnotneeded for theSuomi-NPPCrISdataprocessingsincetherearenofringecounterrors.
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
23
3.4.1 LunarIntrusionDetection “Onrareinstances,thespacelookmeasurementusedtocalibratetheCrISsensorbackgroundmayencounteraviewofthemoon.Typically, thismayonlyoccurononeortwoFOVssimultaneouslyandpossiblyon2to3successivespacelooksasthespacecraftorbitprogressespasttheviewofthemoon. When this happens, then it is necessary to detect this condition and exclude use of thiscontaminatedspacelookdataintheCrIScalibration.”[CrISSDRATBD].
Lunar intrusiondetection is completedby comparing the uncalibrated spectrum for anynewDeep Space scene versus a reference Deep Spacemean that is ideally free of lunar intrusioneffects.Thisiscompletedindependentlyforall27CrISdetectors(9FOVsin3detectorbands)andinterferometersweepdirection.
Thefollowingstepsaretakentodetectalunarintrusion.DeepSpaceandICTspectrafromthecontextgranulesareincludedintheprocesswhencontextgranuleshavebeenprovidedtotheprocessing. The use of context granules is expected to providemore robust lunar intrusiondetection. 1. Iterative detection of Deep Space spectra outliers with respect to the mean Deep Space
b. CalculatetheICTuncalibratedspectralaverage(nooutlierdetection), .
c. Subtract the Deep Space uncalibrated (complex) spectral average with outliersremoved(1.a)fromtheindividualDeepSpaceuncalibrated(complex)spectra:
[3.4.1]
d. Subtract the Deep Space uncalibrated (complex) spectral average with outliersremoved(1.a)fromtheICTuncalibratedspectralaverage(1.b):
[3.4.2]
e. Computethemagnitudeofthecomplexratioof[3.4.1]to[3.4.2],averagedoverthespectralchannels limitedby thespectralchannel indicesprovided inTable3.4.1-1( and define thewavenumber bins corresponding to the lower and upperlimitsofthespectralbandaverage,respectively):
Cb,p,d
ds k[ ] =
!Rb,p,dds n,k[ ]!Rb,p,dict n[ ]n=nmin
nmax
∑nmax − nmin
[3.4.3]
f. Compare[3.4.3]toitsmean.Indexvaluesthatexceeda3-σdeviationfromthemean.Deep Space views corresponding to these indices are considered outliers, and areremovedfromsubsequentmeanDeepSpacereferencecalculationswithinthelunardetectionalgorithm.
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
24
2. Calculate Deep Space uncalibrated (complex) spectral average (in band “b”, FOV “p”, andsweepdirection“d”),withoutliersidentifiedinStep1removed.
3. CalculatetheICTuncalibratedspectralaverage(nooutlierdetection).4. Subtract the Deep Space uncalibrated (complex) spectral average with outliers removed
fromtheindividualDeepSpaceuncalibrated(complex)spectra(Eq.[3.4.1]).5. Subtract the Deep Space uncalibrated (complex) spectral average with outliers removed
Table 3.4.1-1 Lower and upper channel limits for the averages over spectral channel used in the lunarintrusiondetectionalgorithm.
DetectorBand LowerLimit
(channelindex)
LowerLimit
(cm-1)
UpperLimit
(channelindex)
UpperLimit
(cm-1)
LW 201 750 593 950
MW 144 1310 422 1650
SW 64 2255 142 2450
!Rb,p,dds
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
25
Table3.4.1-2Thresholdvaluesusedforlunardetection.
DetectorBand LunarIntrusionThreshold(%)
LW 0.9
MW 1.2
SW 1.8
3.4.2 LunarIntrusionProcessing Ifequation[3.4.5]istrueforanyspecificband,FOV,andsweepdirection,thentheDeepSpacespectrum ismarked as invalid only for that band, FOV, and sweep direction. Any deep spacemeasurements marked invalid from this process are excluded from the Moving Windowaverage and the lunar intrusion flag is also set. Earth scenes calibrated using a Deep SpaceMoving Window average for which Deep Space views have been removed due to a lunarintrusiondetectionarealsomarkedwithalunarintrusionqualityflag.
σ s, ′k isthewavenumberforthebin ′k onthesensorgridσ s ,
σ u ,k isthewavenumberforthebin k ontheuserspectralgridσ u ,and
NO is the undecimated number of interferogram samples truncated to NSR MOPD ( NO =20736fortheLW, NO =10560fortheMW,and NO =5200fortheSW).
ThebanddependenceoftheF-operator,Δσ s ,andΔσ u isnotexplicitlynotedinequation[3.5.1].TheF-matrix operator is computed separately for each granuleusingNeondata contained inthemostcoincidentengineeringpacket.
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
26
Wavenumbers assigned to each spectral bin prior to resampling are based on the lasermetrologysamplingwavelength(seeSection4.1oftheATBD).Thelaser λL
b valueinband“b”iscomputed by the spectral calibration module and used to recompute the F-matrix operator(basedonthecalibrationneoncount).ThelaserwavelengthisstabilizedontheCrISinstrument( λL
The process utilizes knowledge of the FOV size, shape, geometry and off-axis angles for eachFOV obtained from instrument design and instrument characterization (conductedTVAC andon-orbit).
b , p ,and d denoteband,fieldofview,andsweepdirectiondependence,respectively.
Forreference, theCrISspecificcalibrationEq.72presented in theCrISSDRATBDis includedhere:
LS = FINT−1 ⋅
!SS − !SC
!SH − !SC⎡
⎣⎢⎢
⎤
⎦⎥⎥⋅FINT L
H + FINT−1 ⋅
!SH − !SS
!SH − !SC⎡
⎣⎢⎢
⎤
⎦⎥⎥⋅FINT L
C [5.3.4]
Asnoted intheCrISSDRATBD,duringnormalon-orbitoperationthecoldreferenceradianceLC = 0 so that the second term in equation [5.3.4] can be ignored resulting in a furthersimplification:
LS = FINT−1 ⋅
!SS − !SC
!SH − !SC⎡
⎣⎢⎢
⎤
⎦⎥⎥⋅FINT L
H [5.3.5]
In theCrIS SDRATBD implementation, the FINT−1 term in equation [5.3.4] is combined into the
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
34
5.4.1 RadiometricError Nochange.
5.4.2 RadiometricModelFormulation The ICT radiometric model is calculated on the user wavenumber grid. Accordingly, thespectrallyresolvedparametersinTable14areontheuserwavenumbergrid.
TheEarthScene(ES)viewsineachscanlinearecalibratedusingreferenceDeepSpace(DS)andInternal Calibration Target (ICT) views from the current and adjacent scan lines if they areavailable.Intheoptimalsituation,referenceviewsfromthe14precedingscanlinesandthe14followingscanlineswillbeused,inadditiontothereferenceviewsfromthecurrentscanline.However,thecalibrationwillstillbeperformedifasfewasonereferenceviewofeachtypeisavailable.Ifacalibrationisperformedwithfewerthantheoptimalnumberofreferenceviews,for example due to a data drop-out or an instrument change, the noise in the calibrated ESspectrawillbeelevated.Iftherearefewerthan24viewsinthemovingaverage,theradiometriccalibrationqualityflagwillbesettodegraded(value=1).
5.6.2 ImpactofTemperatureDrift Nochange.
5.6.3 ThroughputDelay Nochange.
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
35
6 GEOMETRICCALIBRATION
The NASA L1B software includes a new geolocation implementation based on the approachoutlined in the CrIS SDR ATBD. Digital elevation model (DEM) based terrain statistics andsurfacelocationcorrectionhavebeenincludedaswell.TheCrISSDRATBDonlydescribesthesensor-dependentportionofthegeolocationalgorithm(line of sight vector calculation from instrument telemetry). The sensor-independent part(earthlocationcomputationfromsensorline-of-sight)isdescribedseparatelyintheJPSSVIIRSSDR Geolocation ATBD. Both the sensor-independent algorithm and the approach to terraincorrectionforVIIRSoutlinedinthatdocumenthavebeenfollowedintheNASAL1Bsoftware.
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
36
6.1.7 SpacecraftBodyFrame(SBF) No change.
6.1.8 OrbitalCoordinateSystem(OCS) No change.
6.1.9 EarthCenteredInertial(ECI) No change.
6.1.10 EarthCenteredEarthFixed(ECEF)orEarthCenteredRotating(ECR) No change.
6.1.11 WorldGeodeticSystem1984(WGS84) No change.
6.1.12 Topocentric-HorizonCoordinateSystem(THCS) No change.
6.2 CoordinateSystemTransformations No change.
6.3 AlgorithmPartitioning No change.
6.4 SensorSpecificAlgorithm No change.
6.4.1 CrISFOVLOSinSSMFCoordinateSystem No change.
6.4.2 SSMFtoSBFTransformationOperator No change.
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
37
6.4.3 CrISFOVLOSinSBFCoordinateSystem No change.
6.5 SpacecraftLevelAlgorithm No change.
6.6 TimingConventions No change.
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
38
7 MODULESDEFINITIONThis section summarizes the key processing steps necessary to transform L1A into L1B. Theoverallprocessingchaincanbepartitionedintomoduleslistedbelow.
5. RadiometricCalibration• ICTradiancecalculation• Complexcalibration(removesinstrumentinducedoffsetandphase)• Polarizationcorrection(notincludedinv1.0,willbeincludedinafuturerelease)• Spectrum correction (correct for ILS, calibration filter, and resample to a fixed
The overall processing chain required to transform raw interferograms into spectrally andradiometricallycalibratedandcorrectedspectraisshowninFigure7-2.ThisreplacesFigure59intheCrISSDRATBD.
Data
Processing Module orOperation
Data Flow
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
41
7.1 Initialization TheILScurvefitparametersinthereferenceCrISSDRATBD(Table17),whichareintendedforcorrection of modulation efficiency variation with OPD, are not applicable to the NASA L1Bprocessing.
Theconfigurationoptions in theCrISSDRATBD(Table18: TunableParametersProvidedviaConfigurationFiles) thatmodify theprocessingperformedby theCrIS SDRalgorithmarenotapplicabletotheNASAL1Bprocessing.TheinstrumentparametersthatareconfiguredwithintheL1BprocessingarelistedinTable7.1-1.
7.2 InputDataHandling TheimplementationofdatahandlingisconsistentwiththeCrISSDRATBD.Itisnotablethattheconversionof CCSDSpacket data to “raw” interferogramobservations, aswell as science andengineeringcoefficientsandmeasurements,isseparatedintoa“CrISL1A”telemetryconversionstage. That initial processing stage is not responsible for triggering science data processingactivities,i.e.itisasimplifiedmodelfromthe“operational”implementationmodeldescribedintheATBD.L0 telemetryequivalent toRDRs isconverted toL1Agranulesrepresentedas files;groupsofL1Agranule filesare thenused forscienceSDR-equivalentL1Bproductgeneration.GranulationofCrISdataisprincipallydoneintheL1Astageofprocessing.
7.3.1 InterferogramtoSpectrumTransformation Thismodulehandles themovingaverageofcalibration targetmeasurements (DS, ICT).29DSand ICT measurements (14 anterior scans, the current scan, and 14 posterior scans;temperatures and spectra) are averaged per the default setting. The moving average iscalculated for each scan line, and the FIFO method described in the CrIS SDR ATBD is notused. Themovingwindowaverages for theDSand ICTare calculatedusing theuncalibratedspectrapriortonon-linearitycorrection.TheNASACrISL1BprocessingdoesnotcurrentlysupportFCEdetectionandcorrection.
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
7.3.2 MovingAverageHandling Thismodulehandles themovingaverageofcalibration targetmeasurements (DS, ICT).29DSand ICT measurements (14 anterior scans, the current scan, and 14 posterior scans;temperatures and spectra) are averaged per the default setting. The moving average iscalculatedforeachscanline,andtheFIFOmethoddescribedinthereferenceATBDisnotused.Themovingwindowaverages for theDSand ICTaremaintainedon theuncalibrated spectrapriortonon-linearitycorrection.
AgeneraldescriptionofthemovingwindowaverageprocessisgiveninSection5.6.1. 7.3.2.1 ExceptionHandling If any ICTorDS spectrum isdeclared invalidbyCrIS sensor, lunar intrusion testorotherQCmeasure,thenthecorrespondingmeasurementsareexcludedfromthemovingwindowaverage.
If thenumberofvalidspectra inthemovingwindowdropsbelowathresholdvalue(setsuchthat thenoise increaseduetodecreasedaveragesize in thereferenceviewis less than10%),then the “Degraded Radiometric Calibration” flag is set. If there are no valid spectra in themovingaveragewindow,thenthe“InvalidRadiometricCalibration”flagisset.
7.4.1 LaserWavelengthCalibrationfromNeonLampData Anupdateofmetrologylaserwavelengthisperformedforeachgranulebasedonthecalibrationneoncount. TheF-matrixresamplingoperator iscomputedseparately foreachgranuleusingNeon data contained in the most coincident engineering packet. The spectral operators(calibrationfilter,spectralresampling,self-apodizationremoval)arenotcombinedintoasingleCMOmatrix.
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
7.4.1.2 ExceptionHandlingTheaveragedmetrologylaserwavelengthiscomputedfrommanyneoncalibrationsweeps(30is the default). Outliers are removed before the average is re-computed and reported. Seesection4.1.3ofthisdocumentandthereferenceCrISSDRATBD,andtheNASAL1BQualityFlagDescriptionDocumentformoreinformationonoutlierdefinitionandQFassertion.
7.4.3 SpectralAxisLabelingandAliasUnfoldingThe spectral calibrationmoduledefines theon-axis sensor spectral grid associatedwith eachrawspectrum(banddependent),andtheoutputspectralgrid(banddependent).Basedonthelatestlaserdiodewavelengthestimate,thespectralgridspacingandtheminimumwavenumberof thebandarecomputed.Therawspectrum is thenrotated thedesirednumberofpoints tounfold the spectral alias that was introduced by filtering and decimation on-board the CrISsensor. Spectral foldpointshavebeenderivedforeachband. Thespectralunfoldingyieldsacontinuousspectrumfreeofaliasfoldpointsandwithchannelcentersdefinedbythemetrologysampling interval λs
b ,decimation factorDFb and thenumberofcomplex interferogrampointsprocessed Nb .
NASA SNPP Cross Track Infrared Sounder Level 1B Delta ATBD
7.5.1 RadiometricComplexCalibration Radiometric calibration transforms the digital count signal into radiance units. The complexcalibrationmethod isused for theradiometriccalibrationprocess. Thismethodalsocorrectsfortheinstrumentphase.PolarizationcorrectionisnotincludedintheNASAL1Bprocessingatthistime.RefertoSection7.5forthecompleteCrISspecificcalibrationequation.
7.5.1.1 DefinitionofVariables RefertoSection7.5forthedefinitionofvariables. 7.5.1.2 ExceptionHandlingThe sweep direction “d” of the ICT and DS spectra must be selected to match the sweepdirection“d”oftheEarthscenewhenperformingradiometriccomplexcalibration.
7.5.2 ICTRadianceCalculation Section 7.5.2 is theoretically consistent with the reference CrIS SDR ATBD. However, in theNASAL1Bsoftware,thePlanckradianceiscomputedontheon-axissensorgrid.
7.5.3 SpectrumCorrection Spectrumcorrectionincludesapplicationoftheband-guardfilter,theself-apodizationremovalmatrixoperator,andthespectralresamplingmatrixoperator.Theband-guardfilterisappliedbefore and after the self-apodization removalmatrix operator. All operations are applied toboththenumeratoranddenominatorofthecalibrationequation.
The calibrated ICTmeasurementsprovideability to calculate anNEdNestimatebasedon thestableICTtargettemperature.PrinciplecomponentfilteringisemployedtospectrallysmooththeNEdNestimate.TheNEdNestimateiscalculatedonthesensorwavenumbergrid,usingonlyradiometric complex calibration (no spectral correction) and then interpolated to the outputSDRwavenumbergrid.
The NEdN calculation uses ICT spectra in place of Earth scene spectra in the radiometriccomplexcalibrationandthespectraarenotcorrectedfornonlinearity.
Figure7.6.1-1NEdNEstimationFlowchart
Cal.
Laser Diode Wavelength Calibration
Ancil.Work
NEdN EstimationRaw ICT SPC[d.u.]
Calibrated complexEarth scene spectrain radiance units on
7.6.5 DataQualityIndicators The NASA L1B software produces Quality Flag (QF) variables describing the quality of theprimary data products. The individual flags in the QF variables are specific to the CrIS L1BalgorithmandthereforearedifferentfromtheflagsintheSDRproduct.ForguidanceonusingQFs,refertothe“NASASNPPCrossTrackInfraredSounder(CrIS)Level1BProductUsers’Guide,Version1.0”.FordetailedinformationregardingthederivationandmeaningoftheindividualflagsthatmakeuptheCrISL1BQFvariable,refertothe“NASASNPPCross-trackInfraredSounder(CrIS)Level1BQualityFlagsDescriptionDocument,Version1.0”.ThisdocumentincludesamappingoftheindividualCrISSDRqualityflagstoCrISL1Bqualityflagswhereapplicable.