MERRA2 InputData: Difference between revisions

(10 intermediate revisions by the same user not shown)

Line 26:

* Atlantic anomaly in 79-80 -the same issue in MERRA ([http://merra-reanalysis.blogspot.com/2008/10/known-issue-1-east-atlantic-anomaly.html]) ???? Steve Bloom identified anomalies associated with two stations - 99012 (~ weather ship Lima) in Atlantic off Portugal, and 99018 (~ weather ship Quebec) in the Pacific.

* Fix for blacklisted observations from Singapore station (ID 48698), ADUPA files were processed using code delivered by Meta for original MERRA input (~/Applications/NCEP_Paqc/modify_bufr);formerly blacklisted data were from 7/22/1998 - 02/23/2000 ([https://progress.nccs.nasa.gov/trac/esma/ticket/72])

* The prepbufr files received from NCEP after 12/29/2020 00z had already been processed through their PREVENTS step and thus had the temperatures for surface marine and surface land observations converted to virtual temperature. The MERRA2 preprocessing carried out the VIRTMP conversion a second time. A program to scan the input file to determine if the VIRTMP processing had already been done was added to the preprocessing QC, and the MERRA2 run was wound back to 1 June 2021. Note that between 12/29/2020 and 5/31/2021 the screening program would need to be disabled and virtual temperature calculated a second time if one wished to reproduce the MERRA2 results. Or, just use the already processed prepbufr file from after the prepQC archived from MERRA2 as input instead of redoing the preprocessing.

===ASCAT (20080301-recent)===

Line 45:

Line 46:

** (Jul10-recent): ftp://stratus.ssec.wisc.edu/pub/winds/archive

** need to add real-time preprocessing!

* additional source: NESDIS via NCEP

** operational AVHRR in gdas satwnd files from 20150115 06z onward, from time of GOES hourly wind introduction

** operational AVHRR was intended to be removed from time-windowed satwind BUFR files, but that version of the time-windowing software somehow didn't make it into ops

** operational AVHRR no longer in time-windowed files after 20150520 00z (ops time-windowing software updated to take out EUMETSAT WV winds to reduce data count)

===SATWINDS (Atmospheric Motion Vectors)===

Line 107:

Line 112:

* 19980101-present

* Separate streams for land and ocean

* TRMM TMI Level 2A Hydrometeor Profile Product 2A12

* version 6 prior to 2011-07-01, version 7 afterward

* data is superobed on a one-degree lat/lon grid

===GPS Radio Occultation===

Line 137:

Line 145:

*** Note: GOES-15 replaces GOES-11 as operational 12/6/2011 15z

*** Need to check when these data start in the 'goesfv' dumps & when/if we want to turn these on in the database.

** 29Oct2013 Todling/(per Sienkiewicz) - turn ~~GEOS~~-13 back on from 20090101 on.

** 29Oct2013 Todling/(per Sienkiewicz) - turn GOES-13 back on from 20090101 on.

** 20Nov2015 GOES-13 Sounder anomaly - end of GOES-13 Sounder data

** 3Mar2020 GOES-15 Sounder data ends in operational stream. No sounder on GOES-R (GOES-16, GOES-17 satellites)

**

* g08

** 19940413 000000 20030401 240000 sndr 11 1 2 3 4 5 6 7 8 10 11 12

Line 224:

Line 235:

** 19990101 120000 20001029 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #

** 20001030 000000 20020331 240000 amsua 10 4 5 6 7 8 9 10 11 12 13 # amsua: bad ch14 (ch11?)

** 20020401 000000 ~~21001231~~ 240000 amsua 9 4 5 6 7 8 9 10 12 13 # amsua: bad ch11 & ch14

** 20020401 000000 20151008 240000 amsua 9 4 5 6 7 8 9 10 12 13 # amsua: bad ch11 & ch14

** 20151009 000000 21001231 240000 amsua 6 7 8 9 10 12 13 # amsua: bad ch 6, ch4 & ch5 disabled; QC is a function of Ch6

* NOAA-16 (ncep amsua ch9-14 turned off (currently))

** 20010101 000000 20010110 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #

Line 248:

Line 260:

** 20091215 120000 20091221 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #

** 20091222 000000 20140128 240000 amsua 10 4 5 6 7 9 10 11 12 13 14 # ch8 noisy (noise started on 12/21/2009)

** 20140129 000000 ~~21001231~~ 240000 amsua 9 4 5 6 9 10 11 12 13 14 # per NCEP r35918

** 20140129 000000 20200926 240000 amsua 9 4 5 6 9 10 11 12 13 14 # per NCEP r35918

** 20200927 000000 21001231 240000 amsua 8 4 5 6 9 10 12 13 14 # Channel 11 calibration issues

*Aqua

** 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond - off chn 1-5;14-15 amsua-aqua

Line 411:

Line 424:

** 20090414 120000 21001231 240000 mhs 0

* METOP-A

** 20070521 000000 ~~21001231~~ 240000 mhs 5 1 2 3 4 5 #

** 20070521 000000 20191101 240000 mhs 5 1 2 3 4 5 #

** 20191102 000000 21001231 240000 mhs 0 # ch 2 noisy, turn off instrument

* METOP-B

** 20130213 000000 21001231 240000 mhs 5 1 2 3 4 5 # active for e512a_rt-parallel testing

Line 452:

Line 466:

* 17Jun2011 Sienkiewicz Remove IASI channels sensitive to o3 as suggested by Will McCarty

**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/iasi-a-channels.png IASI active channels]

* 11Sep2021 Sienkiewicz IASI MetOp-A turned off due to instrument instability (due to tests carried out at end of mission)

* METOP-B

* 200130213_00z-present

Line 473:

Line 488:

===CrIS===

* 20120406-~~present~~

* 20120406-20190618 turned off after midband failure.

* 02Nov2012 Todling/McCarty - turned off channels 1-5 of ATMS/CrIS for consistency w/ AMSUA deal

**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/cris-channels.png CrIS active channels]

**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/cris-channels.png CrIS active channels to 20120731]

* A number of channels were turned off on 20120801 - note that in reanalysis these channels should be turned off at the start

**[https://gmao.gsfc.nasa.gov/intranmet/personnel/msienkiewicz/M2cris-channels20120801.png CrIS active channels after 20120801]

===SSMI===

@@ Line 26: / Line 26: @@
 * Atlantic anomaly in 79-80 -the same issue in MERRA ([http://merra-reanalysis.blogspot.com/2008/10/known-issue-1-east-atlantic-anomaly.html]) ????  Steve Bloom identified anomalies associated with two stations - 99012 (~ weather ship Lima) in Atlantic off Portugal, and 99018 (~ weather ship Quebec) in the Pacific.
 * Fix for blacklisted observations from Singapore station (ID 48698), ADUPA files were processed using code delivered by Meta for original MERRA input (~/Applications/NCEP_Paqc/modify_bufr);formerly blacklisted data were from 7/22/1998 - 02/23/2000 ([https://progress.nccs.nasa.gov/trac/esma/ticket/72])
+* The prepbufr files received from NCEP after 12/29/2020 00z had already been processed through their PREVENTS step and thus had the temperatures for surface marine and surface land observations converted to virtual temperature.  The MERRA2 preprocessing carried out the VIRTMP conversion a second time.  A program to scan the input file to determine if the VIRTMP processing had already been done was added to the preprocessing QC, and the MERRA2 run was wound back to 1 June 2021. Note that between 12/29/2020 and 5/31/2021 the screening program would need to be disabled and virtual temperature calculated a second time if one wished to reproduce the MERRA2 results.  Or, just use the already processed prepbufr file from after the prepQC archived from MERRA2 as input instead of redoing the preprocessing.
 ===ASCAT (20080301-recent)===
@@ Line 45: / Line 46: @@
 ** (Jul10-recent): ftp://stratus.ssec.wisc.edu/pub/winds/archive
 ** need to add real-time preprocessing!
+* additional source: NESDIS via NCEP
+** operational AVHRR in gdas satwnd files from 20150115 06z onward, from time of GOES hourly wind introduction
+** operational AVHRR was intended to be removed from time-windowed satwind BUFR files, but that version of the time-windowing software somehow didn't make it into ops
+** operational AVHRR no longer in time-windowed files after 20150520 00z (ops time-windowing software updated to take out EUMETSAT WV winds to reduce data count)
 ===SATWINDS (Atmospheric Motion Vectors)===
@@ Line 107: / Line 112: @@
 * 19980101-present
 * Separate streams for land and ocean
+* TRMM TMI Level 2A Hydrometeor Profile Product 2A12
+* version 6  prior to 2011-07-01, version 7 afterward
+* data is superobed on a one-degree lat/lon grid
 ===GPS Radio Occultation===
@@ Line 137: / Line 145: @@
 ***                 Note: GOES-15 replaces GOES-11 as operational 12/6/2011 15z
 ***                    Need to check when these data start in the 'goesfv' dumps & when/if we want to turn these on in the database.
-** 29Oct2013 Todling/(per Sienkiewicz) - turn GEOS-13 back on from 20090101 on.
+** 29Oct2013 Todling/(per Sienkiewicz) - turn GOES-13 back on from 20090101 on.
+** 20Nov2015 GOES-13 Sounder anomaly - end of GOES-13 Sounder data
+**  3Mar2020 GOES-15 Sounder data ends in operational stream.  No sounder on GOES-R (GOES-16, GOES-17 satellites)
+**
 * g08
 **  19940413 000000  20030401 240000  sndr  11  1 2 3 4 5 6 7 8   10 11 12
@@ Line 224: / Line 235: @@
 **  19990101 120000  20001029 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14               #
 **  20001030 000000  20020331 240000  amsua 10        4 5 6 7 8 9 10 11 12 13                  # amsua: bad ch14 (ch11?)
-**  20020401 000000  21001231 240000  amsua  9        4 5 6 7 8 9 10    12 13                  # amsua: bad ch11 & ch14
+**  20020401 000000  20151008 240000  amsua  9        4 5 6 7 8 9 10    12 13                  # amsua: bad ch11 & ch14
+**  20151009 000000  21001231 240000  amsua  6              7 8 9 10    12 13                  # amsua: bad ch 6, ch4 & ch5 disabled; QC is a function of Ch6
 * NOAA-16 (ncep amsua ch9-14 turned off (currently))
 **  20010101 000000  20010110 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14               #
@@ Line 248: / Line 260: @@
 **  20091215 120000  20091221 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14               #
 **  20091222 000000  20140128 240000  amsua 10        4 5 6 7   9 10 11 12 13 14               #  ch8 noisy (noise started on 12/21/2009)
-**  20140129 000000  21001231 240000  amsua  9        4 5 6     9 10 11 12 13 14               #  per NCEP r35918
+**  20140129 000000  20200926 240000  amsua  9        4 5 6     9 10 11 12 13 14               #  per NCEP r35918
+**  20200927 000000  21001231 240000  amsua  8        4 5 6     9 10    12 13 14               #  Channel 11 calibration issues
 *Aqua
 ** 31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond - off chn 1-5;14-15 amsua-aqua
@@ Line 411: / Line 424: @@
 **  20090414 120000  21001231 240000  mhs    0
 * METOP-A
-** 20070521 000000  21001231 240000  mhs    5  1 2 3 4 5              #
+** 20070521 000000  20191101 240000  mhs    5  1 2 3 4 5              #
+** 20191102 000000  21001231 240000  mhs    0                         # ch 2 noisy, turn off instrument
 * METOP-B
 ** 20130213 000000  21001231 240000  mhs    5  1 2 3 4 5                              # active for e512a_rt-parallel testing
@@ Line 452: / Line 466: @@
 * 17Jun2011 Sienkiewicz  Remove IASI channels sensitive to o3 as suggested by Will McCarty
 **[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/iasi-a-channels.png  IASI active channels]
+* 11Sep2021 Sienkiewicz IASI MetOp-A turned off due to instrument instability (due to tests carried out at end of mission)
 * METOP-B
 * 200130213_00z-present
@@ Line 473: / Line 488: @@
 ===CrIS===
-* 20120406-present
+* 20120406-20190618  turned off after midband failure.
 * 02Nov2012 Todling/McCarty - turned off channels 1-5 of ATMS/CrIS for consistency w/ AMSUA deal
-**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/cris-channels.png  CrIS active channels]
+**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/cris-channels.png  CrIS active channels to 20120731]
+* A number of channels were turned off on 20120801 - note that in reanalysis these channels should be turned off at the start
+**[https://gmao.gsfc.nasa.gov/intranmet/personnel/msienkiewicz/M2cris-channels20120801.png CrIS active channels after 20120801]
 ===SSMI===