DailySplit_KSK [daily task 00:02] T:\Cr5000_outdata\slowHourly\ KSK_RFYYDOY.dat DailySplit_KSS [daily task 00:03] T:\Cr5000_outdata\slowHourly\ KSS_RFYYDOY.dat OTAGO I:\YYYY\London\$site and NetCDF to dataBridge01: A:\data\YYYY\London\$level\ $site\DAY\$DOY GAS-LAS-WXT-Ceil [hh:11] • grab hourly WXT data from both roofs to \WXT510\RAW\MM\WXTYYYYDOY_HH_raw.txt • translate hourly WXT data formatted raw data \WXT510\FORMAT_L0\WXTYYYYDOY_HH.txt \WXT510\FORMAT_L1\WXTYYYYDOY_HH.txt • write hourly WXT 5s data to databridge01 • grab Rad & RG data to \CR5000\KSK_RFYYDOY.dat \CR5000\KSS_RFYYDOY.dat LoggerNet KSK Mast 10_09_10.CR5 Q:\CR5000\Fast\ CR5000_Slow.dat ROOF8 COMCAP4 Q:\WXT510\wxt-YYYYMMDD- HH00.txt CR3000 Data Logger KSK-Mast Instruments w i r e s CNR4 K up , K dn, L up , L dn , T CNR1 WXT510 T, U, p, RH, RR ARG100 [RR] LoggerNet KSS tower 01_09_10.CR5 C:\CR5000\CR5000_slow.dat ROOF13 (C is T on Otago) C:\WXT510\ bin\WXT510.pyc stores data to data\WXT-YYYYMMDD-HH00.txt CR5000 Data Logger KSS-Mast Instruments w i r e s CNR1 K up , K dn, L up , L dn , T CNR1 WXT510 T, U, p, RH, RR SKU420/5 [UVA] SKU430 [UVB] SKL2620/5 [PAR] Troubleshoot LoggerNet KSS Tower 19_11_09.CR5 S:\CR5000\CR5000_slow.dat ROOF12 CR5000 Data Logger KSS45W Instruments w i r e s PIR [Ldown] ARG [RR ] SKU420/5 [UVA] SKU430 [UVB] SKL2620/5 [PAR] PSP [Kdown] LHRdat [half hourly task, hh:28, hh:58] Grab LHR data and save to daily file I:\YYYY\London\ALL\LHR_EGLL\ EGLLYYYYDOY.txt DATA COLLECTION
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
GAS-LAS-WXT-Ceil [hh:11]• grab hourly WXT data from both roofs to\WXT510\RAW\MM\WXTYYYYDOY_HH_raw.txt• translate hourly WXT data formatted raw data\WXT510\FORMAT_L0\WXTYYYYDOY_HH.txt\WXT510\FORMAT_L1\WXTYYYYDOY_HH.txt• write hourly WXT 5s data to databridge01• grab Rad & RG data to\CR5000\KSK_RFYYDOY.dat\CR5000\KSS_RFYYDOY.dat
LHRdat [half hourly task, hh:28, hh:58]Grab LHR data and save to daily file
I:\YYYY\London\ALL\LHR_EGLL\EGLLYYYYDOY.txt
DATA COLLECTION
WXTDataPro_V2.R [01:20]/home/micromet/Roofprograms/WXT/WXTDataPro_V2.R• L0: convert KSK, KSS and NDT WXT data into netcdf• L1: check data on physically reasonable thresholds and correct wind direction to BNG north• with temporal resolutions 5sec, 1min, 5min, 10 min, 30min• Output saved to respective DAY directory on dataBridge01
DATA POCESSINGData02Scripts in /home/micromet/RoofprogramsdataBridge01 on /media/micromet/data
RadRainNcdf.m [02:00~]/D drive on Otago:/Roof/Rad_Rain/RadRainNcdf.m (mergeARG.sh and mergeRAD.sh on Data02/home/micromet/script/cronJobs/)• L0: converts radiation (CNR4 KSK, CNR1/Skye KSS, SPN1 & Eppleys/Skye KSS45W) and ARG100 data into netcdf• Higher Levels: Please refer to the KUMA Manual
PlotMetObs.sh [03:55]/home/micromet/Roofprograms/WXT/PlotMertObs.sh• Use Matlab program PlotMetObs.m to generate eps plots for WXT data and radiation, combining all instruments
from all sites• Convert to png via gnuplot and save to /media/micromet/works/$YEAR/London/Level_1/MetObs• ftp png plots MetObs.png and RadObs.png to web
WXTgapFill.R [run on demand...]/home/micromet/Roofprograms/WXT/WXTgapFill.R• L2: gap fill WXT data from KSK and KSS by
a) Linear interpolation b) readings from alternative site c) predicted value
ARG100• Tipping bucket:precipitation [mm]
WXT510• 2D-sonic: horizontal wind speed [m/s], wind direction [ °]• RAINCAP (counts hits by raindrops): precipitation [mm]• BAROCAP (capacitive silicon sensor ): barometric pressure [hPa]• THERMOCAP (capacitive ceramic sensor): air temperature [°C]• HUMICAP (capacitive thin film polymer): relative humidity [%]
Net Radiation: NetR=(CM3Up-CM3Dn)+(CG3Up-CG3Dn)Precipitation PulseCount(RainTips,1,2,2,0,1,0)
back
WXT 510 Mean Data File ConventionWho: Duick Young 22/7/07File convention for data files stored in W:\KCLroof\YYYY\WXT510\MM\File name structure WXTYYYYDDD_15.txt.File Convention started 16th July 2007 (DOY 2197) Flags added 6th August 2007 (DOY 218)Generated by: MATLAB using WXTmeanplot#.m Column Variable Units1 Day of Year (DOY)2 Decimal Time3 Hour4 Minute5 Number of Samples6 Wind Speed Minimum m s-1
7 Wind Speed Mean m s-1
8 Wind Speed Maximum m s-1
9 Air Temperature °C10 Relative Humidity %11 Air Pressure hPa12 U (Wind Component) m s-1
13 V (Wind Component) m s-1
14 Wind Direction °15 Total Rain Accumulation mm16 Total Rain Duration s17 Total Hail Accumulation hits cm-2
18 Total Hail Duration s19 Standard Deviation – Wind Speed Minimum m s-1
20 Standard Deviation – Wind Speed Mean m s-1
21 Standard Deviation – Wind Speed Maximum m s-1
22 Standard Deviation – Air Temperature °C23 Standard Deviation – Relative Humidity %24 Standard Deviation – Air Pressure hPa25 Standard Deviation – U m s-1
26 Standard Deviation – V m s-1
27 Flag Flags1 Data fine5 Less than 90 data lines in 15 minute averaging period6 No data present during 15 minute averaging period
CNR1 Mean Data File ConventionWho: Duick Young 23 March 2009File convention for data files stored in ...\KCLroof\YYYY\CR5000\File name structure RFYYDDD.datFile convention started: 18th August 2008 (DOY 231)Generated by: Simple Tower Program _V1.1.CR3
Column Variable Units1 Year2 Month3 Day4 Hour5 Minute6 Kdn- Average W m-2
7 Kdn-- Standard Deviation W m-2
8 Kup - Average W m-2
9 Kup - Standard Deviation W m-2
10 Ldn-- Average W m-2
11 Ldn-- Standard Deviation W m-2
12 Lup - Average W m-2
13 Lup - Standard Deviation W m-2
14 CNR1 Temperature - Average °C15 CNR1 Temperature – StDev ° C16 CNR1 Temperature – Average K17 CNR1 Temperature – StDev K18 Net Radiation – Average W m-2
19 Net Radiation – StDev W m-2
20 UVA – Average μmol m-2 s-1
21 UVB – Average μmol m-2 s-1
22 Quantum (PAR) – Average μmol m-2 s-1
23 UVA – Average W m-2
24 UVB – Average W m-2
25 Quantum (PAR) – Average W m-2
26 UVA - Standard Deviation μmol m-2 s-1
27 UVB - Standard Deviation μmol m-2 s-1
28 Quantum (PAR) – StDev μmol m-2 s-1
29 Quantum (PAR) – StDev μmol m-2 s-1
30 Tipping Bucket Rain Gauge mm
back
WXT 510/CNR1 Mean Data File Convention Who: Duick Young 6 Aug 2007File convention for data files stored in W:\KCLroof\YYYY\WXT510\MM\File name structure LRYYYYDDD_15.txt.File Convention started 25th July 2007 (DOY 206) Flag (Column 27) added 3rd August 2007 (DOY 214) Tipping Bucket Raingauge added 18 August 2008 (DOY 231)Generated by: MATLAB using WXTmeanplot#.m Column Variable Units1 Day of Year (DOY)2 Decimal Time 3 Hour 4 Minute 5 Number of Samples6 Wind Speed Minimum m s-1
7 Wind Speed Mean m s-1
8 Wind Speed Maximum m s-1
9 Air Temperature °C10 Relative Humidity%11 Air Pressure hPa12 U (Wind Component) m s-1
13 V (Wind Component) m s-1
14 Wind Direction°15 Total Rain Accumulation mm16 Total Rain Durations17 Total Hail Accumulation hits cm-2
18 Total Hail Durations19 StDev – Wind Speed Minimum m s-1
20 StDev– Wind Speed Mean m s-1
21 StDev– Wind Speed Maximum m s-1
22 StDev– Air Temperature °C23 StDev– Relative Humidity %24 StDev– Air Pressure hPa
Column Variable Units
25 StDev– U m s-1
26 StDev– V m s-1
27 Flag 28 K¯ - Average W m-2
29 K¯- Standard Deviation W m-2
30 K↑ - Average W m-2
31 K↑- Standard Deviation W m-2
32 L¯- Average W m-2
33 L¯- Standard Deviation W m-2
34 L↑ - Average W m-2
35 L↑ - Standard Deviation W m-2
36 CNR1 Temperature – Average °C37 CNR1 Temperature - Standard Deviation °C38 CNR1 Temperature – Average K39 CNR1 Temperature - Standard Deviation K40 Net Radiation – Average W m-2
41 Net Radiation - Standard Deviation W m-2
42 UVA – Average μmol m-2 s-1
43 UVB – Average μmol m-2 s-1
44 Quantum (PAR) – Average μmol m-2 s-1
45 UVA – Average W m-2
46 UVB – Average W m-2
47 Quantum (PAR) – Average W m-2
48 UVA - Standard Deviation μmol m-2 s-1
49 UVB - Standard Deviation μmol m-2 s-1
50 Quantum (PAR) - Standard Deviation μmol m-2 s-1
51 Surface Albedo 52 Rain (Tipping Bucket) mm
Flags1Data fine5Less than 90 data lines in 15 minute averaging period6No data present during 15 minute averaging period
back
TROUBLESHOOT
• In case data have been collected by Roof8 or Roof3 but are missing on Otago,grab data with: D:\roof\co2\wxtGasGrabCeilAB_GetMissingData.m (latest version)
1. Adjust time settings in the code• Year• Month• Day• hour_orig (the first hour to be moved)• Nperiods (number of hourly periods in one day – run program separately for each day)
2. check file sizes are correct in I:\YYYY\London\$site\WXT510\FORMAT_L0\WXTYYYYDOY_HH.txt
3. Rerun scripts on data01: /home/micromet/Roofprograms1) WXT/WXTDataPro.R2) WXT/PlotMetObs.sh
4. For radiation (CNR’s, SPN1, Eppleys, Skye) and ARG100 dataset1) Rerun matlab program on Otago D drive:/Roof/Rad_Rain/RadRainNncdf.m2) Rerun script at data02:/home/micromet/script/cronJobs/ -> mergeARG.sh and