MERRA2 InputData: Difference between revisions

From GEOS-5
Jump to navigation Jump to search
Msienkie (talk | contribs)
Msienkie (talk | contribs)
 
(41 intermediate revisions by 2 users not shown)
Line 25: Line 25:
** counts in fixed data seems lower then in operational run, probably due to different processing (NCEP ops & in house fix for reanalysis input TAMDAR data)
** counts in fixed data seems lower then in operational run, probably due to different processing (NCEP ops & in house fix for reanalysis input TAMDAR data)
* Atlantic anomaly in 79-80 -the same issue in MERRA ([http://merra-reanalysis.blogspot.com/2008/10/known-issue-1-east-atlantic-anomaly.html]) ????  Steve Bloom identified anomalies associated with two stations - 99012 (~ weather ship Lima) in Atlantic off Portugal, and 99018 (~ weather ship Quebec) in the Pacific.
* Atlantic anomaly in 79-80 -the same issue in MERRA ([http://merra-reanalysis.blogspot.com/2008/10/known-issue-1-east-atlantic-anomaly.html]) ????  Steve Bloom identified anomalies associated with two stations - 99012 (~ weather ship Lima) in Atlantic off Portugal, and 99018 (~ weather ship Quebec) in the Pacific.
* Fix for blacklisted observations from Singapore station (ID 48698), ADUPA files were processed using code delivered by Meta for original MERRA input (~/Applications/NCEP_Paqc/modify_bufr);formerly blacklisted data were from 7/22/1998 - 02/23/2000 ([https://progress.nccs.nasa.gov/trac/esma/ticket/72])
* The prepbufr files received from NCEP after 12/29/2020 00z had already been processed through their PREVENTS step and thus had the temperatures for surface marine and surface land observations converted to virtual temperature.  The MERRA2 preprocessing carried out the VIRTMP conversion a second time.  A program to scan the input file to determine if the VIRTMP processing had already been done was added to the preprocessing QC, and the MERRA2 run was wound back to 1 June 2021. Note that between 12/29/2020 and 5/31/2021 the screening program would need to be disabled and virtual temperature calculated a second time if one wished to reproduce the MERRA2 results.  Or, just use the already processed prepbufr file from after the prepQC archived from MERRA2 as input instead of redoing the preprocessing.


===ASCAT (20090301-recent)===
===ASCAT (20080301-recent)===
* from ASCATW (bufr files needs to be processed (~msienkie/ascat/prepdata; historical data were processed by DM, realtime-it will be part of preprocessing)
* from ASCATW (bufr files needs to be processed (~msienkie/ascat/prepdata; historical data were processed by DM (from 20090301), realtime-it will be part of preprocessing)
* gap in September 2010 was originally filled from ASCATT format by MS)
* gap in September 2010 was originally filled from ASCATT format by MS)
* adding data from prior 2009? (WM??)
* adding data prior 2009 (WM)
* need to add real-time preprocessing!
* real-time preprocessing (YK)




Line 44: Line 46:
** (Jul10-recent): ftp://stratus.ssec.wisc.edu/pub/winds/archive
** (Jul10-recent): ftp://stratus.ssec.wisc.edu/pub/winds/archive
** need to add real-time preprocessing!
** need to add real-time preprocessing!
* additional source: NESDIS via NCEP
** operational AVHRR in gdas satwnd files from 20150115 06z onward, from time of GOES hourly wind introduction
** operational AVHRR was intended to be removed from time-windowed satwind BUFR files, but that version of the time-windowing software somehow didn't make it into ops
** operational AVHRR no longer in time-windowed files after 20150520 00z (ops time-windowing software updated to take out EUMETSAT WV winds to reduce data count)


===SATWINDS (Atmospheric Motion Vectors)===
===SATWINDS (Atmospheric Motion Vectors)===
Line 53: Line 59:
*ERS1 (19910805-19960525) lots of short gaps
*ERS1 (19910805-19960525) lots of short gaps
** exclude 06z Aug 24, 1992 (hurricane Andrew); in original MERRA this set of winds had negative impact
** exclude 06z Aug 24, 1992 (hurricane Andrew); in original MERRA this set of winds had negative impact
*ERS2 (20030813-20110329) new version of data
*The re-processing of ERS-2 data from 1997-2003.
**The re-processing of ers-2 runs from from 1997-2003.  The three available formats of the re-processed data are:
** 19970520_00z-20030217_18z
** The three available formats of the re-processed data are:
*** ERS.ASPS.UWI  (re-processed data in UWI format for compatability with the real-time product)
*** ERS.ASPS.UWI  (re-processed data in UWI format for compatability with the real-time product)
*** ERS.ASPS20.N  (re-processed data in ASPS format: nominal resolution 50km)
*** ERS.ASPS20.N  (re-processed data in ASPS format: nominal resolution 50km)
*** ERS.ASPS20.H  (re-processed data in ASPS format: high resolution 25km)
*** ERS.ASPS20.H  (re-processed data in ASPS format: high resolution 25km)
** We are processing ERS.ASPS20.N.  For this data, lets give a filename like:  ers2_asps20n.YYYYMMDD.tHHz.bufr
** We are processing ERS.ASPS20.N.  For this data, lets give a filename like:  ers2_asps20n.YYYYMMDD.tHHz.bufr
*ERS2 (20030813-20110329) new version of data
** For the period from 2003 through the end, we have the fast delivery product (WSC.UWI).
** For the period from 2003 through the end, we have the fast delivery product (WSC.UWI).


Line 75: Line 83:
**F17 SSMIS Dec 2006 present
**F17 SSMIS Dec 2006 present
**F18 SSMIS Oct 2009 present
**F18 SSMIS Oct 2009 present


===Modis===
===Modis===
Line 81: Line 88:
*20020701-20040708
*20020701-20040708
*20040709-20040930
*20040709-20040930


===NPN Profiler===
===NPN Profiler===
Line 87: Line 93:
*data after 20080731 from NCEP
*data after 20080731 from NCEP
*(19920510-20080731)(excluded from cdas and cdas0)
*(19920510-20080731)(excluded from cdas and cdas0)
 
* Funding for NPN was  eliminated (2014) within the continental United States and data will cease, [http://www.nws.noaa.gov/om/notification/scn14-36wind_profilers.htm more] ...


==NO-preQC data==
==NO-preQC data==
===tcvitals===
===tcvitals===
* (1980-present)
* (19790101-present)
* data prior 2006 from Jack Woolen (added Nov2013)
* data prior 2006 from Jack Woolen (added Nov2013)


===SSMI Rain Rates===  
===SSMI Rain Rates===  
Line 107: Line 112:
* 19980101-present
* 19980101-present
* Separate streams for land and ocean
* Separate streams for land and ocean
 
* TRMM TMI Level 2A Hydrometeor Profile Product 2A12
* version 6  prior to 2011-07-01, version 7 afterward
* data is superobed on a one-degree lat/lon grid


===GPS Radio Occultation===
===GPS Radio Occultation===
*20010501-20071214 (from Jack Woollen:gps data starting in 2002 is from the CHAMP instrument, reprocessed by the Boulder folks. Reprocessed COSMIC starts in around 2006)
*20010501-20071214 (from Jack Woollen:gps data starting in 2002 is from the CHAMP instrument, reprocessed by the Boulder folks. Reprocessed COSMIC starts in around 2006)
*20071215-present
*20071215-present
 
* Noting end dates of some GPS data types:  C/NOFS ~2013/06/05  SAC-C ~2011/08/02


==Radiances==
==Radiances==
* 0 after the name of instrument (6th column) - data not used
===GOES Sounder===
===GOES Sounder===
*20010424-20071204
* data available from 20010424-20071204
** 5x5 averaged in goesnd.* files
** 5x5 averaged in goesnd.* files
*** old prepbufr file - but the input is no longer through prep stream
*** old prepbufr file - but the input is no longer through prep stream
*20070222-present
*high resolution stream 20070222-present
** 1x1 single FOVs in *goesfv* files
** 1x1 single FOVs in *goesfv* files
* Control of usage set in satinfo_db
* Control of usage set in satinfo_db
**  Switch occurs on 20070401_00z in MERRA2
**  Switch occurs on 20070401_00z in MERRA2
* notes from satinfo:
* notes from satinfo database:
**  31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond
**  31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond
***                    - off chn all sndr-g12
***                    - off chn all sndr-g12
Line 137: Line 145:
***                Note: GOES-15 replaces GOES-11 as operational 12/6/2011 15z
***                Note: GOES-15 replaces GOES-11 as operational 12/6/2011 15z
***                    Need to check when these data start in the 'goesfv' dumps & when/if we want to turn these on in the database.
***                    Need to check when these data start in the 'goesfv' dumps & when/if we want to turn these on in the database.
** 29Oct2013 Todling/(per Sienkiewicz) - turn GEOS-13 back on from 20090101 on.
** 29Oct2013 Todling/(per Sienkiewicz) - turn GOES-13 back on from 20090101 on.
** 20Nov2015 GOES-13 Sounder anomaly - end of GOES-13 Sounder data
**  3Mar2020 GOES-15 Sounder data ends in operational stream.  No sounder on GOES-R (GOES-16, GOES-17 satellites)
**
* g08
* g08
**  19940413 000000  20030401 240000  sndr  11  1 2 3 4 5 6 7 8  10 11 12
**  19940413 000000  20030401 240000  sndr  11  1 2 3 4 5 6 7 8  10 11 12
Line 210: Line 221:
*  
*  
**m09  20120213 000000  29991231 240000  seviri 0
**m09  20120213 000000  29991231 240000  seviri 0
**m09  20120213 000000  29991231 240000  seviri 2   2 3
**m09  20120213 000000  29991231 240000  seviri 2     2 3
**m10  20130121 120000  29991231 240000  seviri 2   2 3
**m10  20130121 120000  29991231 240000  seviri 2     2 3


===TOVS/ATOVS data===
===AMSU-A===
====AMSU-A====
* 19981101-present
* 19981101-present
* 31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond  
* 31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond  
Line 225: Line 235:
**  19990101 120000  20001029 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14              #  
**  19990101 120000  20001029 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14              #  
**  20001030 000000  20020331 240000  amsua 10        4 5 6 7 8 9 10 11 12 13                  # amsua: bad ch14 (ch11?)
**  20001030 000000  20020331 240000  amsua 10        4 5 6 7 8 9 10 11 12 13                  # amsua: bad ch14 (ch11?)
**  20020401 000000  21001231 240000  amsua  9        4 5 6 7 8 9 10    12 13                  # amsua: bad ch11 & ch14  
**  20020401 000000  20151008 240000  amsua  9        4 5 6 7 8 9 10    12 13                  # amsua: bad ch11 & ch14  
**  20151009 000000  21001231 240000  amsua  6              7 8 9 10    12 13                  # amsua: bad ch 6, ch4 & ch5 disabled; QC is a function of Ch6
* NOAA-16 (ncep amsua ch9-14 turned off (currently))
* NOAA-16 (ncep amsua ch9-14 turned off (currently))
**  20010101 000000  20010110 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14              #
**  20010101 000000  20010110 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14              #
Line 248: Line 259:
** n19  20090414 000000  20091215 060000  amsua 11        4 5 6 7 8 9 10 11 12 13 14              # M2: redundant entry intentional.  Observations exist prior to MERRA(1) start date.  Will attempt to assimilate.  This should be set to inactive should an issue arise (wm)
** n19  20090414 000000  20091215 060000  amsua 11        4 5 6 7 8 9 10 11 12 13 14              # M2: redundant entry intentional.  Observations exist prior to MERRA(1) start date.  Will attempt to assimilate.  This should be set to inactive should an issue arise (wm)
**  20091215 120000  20091221 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14              #
**  20091215 120000  20091221 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14              #
**  20091222 000000  21001231 240000  amsua 10        4 5 6 7  9 10 11 12 13 14              #  ch8 noisy (noise started on 12/21/2009)  
**  20091222 000000  20140128 240000  amsua 10        4 5 6 7  9 10 11 12 13 14              #  ch8 noisy (noise started on 12/21/2009)  
* METOP-A
**  20140129 000000  20200926 240000  amsua  9        4 5 6    9 10 11 12 13 14              #  per NCEP r35918
**  20200927 000000  21001231 240000  amsua  8        4 5 6    9 10    12 13 14              #  Channel 11 calibration issues
*Aqua
** 31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond - off chn 1-5;14-15 amsua-aqua
**  20021012 000000  20071102 120000  amsua  10        4 5 6  8 9 10 11 12 13 14
**  20071102 180000  21001231 240000  amsua  8            6  8 9 10 11 12 13 14              # ch4 noisy; QC affected ; turn off ch1-5
* METOP-A  
** 20070521 000000  20090115 060000  amsua 11        4 5 6 7 8 9 10 11 12 13 14            #
** 20070521 000000  20090115 060000  amsua 11        4 5 6 7 8 9 10 11 12 13 14            #
** 20090115 120000  21001231 240000  amsua 10        4 5 6  8 9 10 11 12 13 14            # ch7 noisy
** 20090115 120000  21001231 240000  amsua 10        4 5 6  8 9 10 11 12 13 14            # ch7 noisy
* METOP-B
* METOP-B
** # 20130213 000000  21001231 240000  amsua  0                                              # Currently on @ NCEP, commented out pending
** 20130213 000000  21001231 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14            # active for e512a_rt-parallel testing
** # 20130213 000000  21001231 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14            # pending testing (20 Nov 13)


====AMSU-B====
===AMSU-B===
* 19981101-present
* 19981101-present
* 31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond - off chn 4  amsub-n15
* 31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond - off chn 4  amsub-n15
* NOAA-15
* NOAA-15
**  19981101 000000  20060216 000000  amsub  5  1 2 3 4 5                                      #  
**  19981101 000000  20060216 000000  amsub  5  1 2 3 4 5                                      #  
**  20060216 060000  20110328 060000  amsub  4  1 2 3  5                                      # ch4 noisy
**  20060216 060000  20110328 060000  amsub  0                                                # ch4 noisy, all ch off
**  20110328 120000  20110328 240000  amsub  0                                                # amsub: scan motor failed
**  20110328 120000  20110328 240000  amsub  0                                                # amsub: scan motor failed
* NOAA-16
* NOAA-16
**  20001105 000000  20001231 240000  amsub  5  1 2 3 4 5                                      # M2: redundant entry intentional.  Observations exist prior to MERRA(1) start date.  Will attempt to assimilate.  This should be set to inactive should an issue arise (wm)
**  20001105 000000  20001231 240000  amsub  5  1 2 3 4 5                                      # M2: redundant entry intentional.  Observations exist prior to MERRA(1) start date.  Will attempt to assimilate.  This should be set to inactive should an issue arise (wm)
**  20010101 000000  20100514 240000  amsub  5  1 2 3 4 5                                      #  
**  20010101 000000  20090416 240000  amsub  5  1 2 3 4 5                                      #  
**  20100515 000000  21001231 240000  amsub  0                                                # amsub: noisy since 20100316
**  20090416 000000  21001231 240000  amsub  0                                                # amsub: noisy since 20090416 (end date moved back to corresp. to Keyser's history)
 
* NOAA-17
* NOAA-17
**  20020715 000000  20091222 120000  amsub  5  1 2 3 4 5                                      #  
**  20020715 000000  20091222 120000  amsub  5  1 2 3 4 5                                      #  
**  20091222 180000  20130420 240000  amsub  0                                                # amsub: ch3-5 noisy; turn off all
**  20091222 180000  20130420 240000  amsub  0                                                # amsub: ch3-5 noisy; turn off all


====HIRS2====
===HIRS2===
* 19781101-20060930
* 19781101-20060930
* turned off HIRS2 chns 13 & 14 (for consistency w/ what was done w/ HIRS3/4)  
* turned off HIRS2 chns 13 & 14 (for consistency w/ what was done w/ HIRS3/4)  
Line 283: Line 300:
**  19790702 000000  19790712 240000  hirs2  0                                        # hirs2: unstable     
**  19790702 000000  19790712 240000  hirs2  0                                        # hirs2: unstable     
** 19790713 000000  19830417 060000  hirs2 10    2 3 4 5 6 7 8  10 11 12            #
** 19790713 000000  19830417 060000  hirs2 10    2 3 4 5 6 7 8  10 11 12            #
** 19850408 000000  19861117 240000  hirs2  0                                        # hirs2: none
* NOAA-07
* NOAA-07
** 19810711 000000  19850204 240000  hirs2 10    2 3 4 5 6 7 8  10 11 12            #
** 19810711 000000  19850204 240000  hirs2 10    2 3 4 5 6 7 8  10 11 12            #
Line 289: Line 305:
* NOAA-08
* NOAA-08
**  19830426 000000  19840620 240000  hirs2 10    2 3 4 5 6 7 8  10 11 12            #
**  19830426 000000  19840620 240000  hirs2 10    2 3 4 5 6 7 8  10 11 12            #
**  19850701 000000  19851014 240000 hirs2  0                                        # hirs2: none
**  19850701 000000  19851014 240000 hirs2  0                                        # hirs2: none
* NOAA-09
* NOAA-09
**  19850101 000000  19850202 240000  hirs2  0                                        # hirs2: calibration problems (ch7 bad)
**  19850101 000000  19850202 240000  hirs2  0                                        # hirs2: calibration problems (ch7 bad)
Line 310: Line 326:
**  20060930 000000  20070523 240000  hirs2  0                                        # end of record
**  20060930 000000  20070523 240000  hirs2  0                                        # end of record


====HIRS3====
===HIRS3===
* 19980721-present
* 19980721-present
* 19Jul2012 Todling - turned off channel 9 from HIRS3 and 4 (per Pawson's)
* 19Jul2012 Todling - turned off channel 9 from HIRS3 and 4 (per Pawson's)
Line 335: Line 351:
**  20111204 000000  20120828 240000  hirs3  0                                                # hirs: noise jump ch1-5,12
**  20111204 000000  20120828 240000  hirs3  0                                                # hirs: noise jump ch1-5,12


====HIRS4====
===HIRS4===
* 20090401-present
* 20090401-present
* 07Sep2013 Todling  - turned off HIRS3/4 chs 13 and 14 (Joa>Job)
* 07Sep2013 Todling  - turned off HIRS3/4 chs 13 and 14 (Joa>Job)
Line 350: Line 366:
** metop-b 20130213 000000  21001231 240000  hirs4  0    # not currently assimilated @ NCEP (20 Nov 13) for all channels will be impared, so disable all
** metop-b 20130213 000000  21001231 240000  hirs4  0    # not currently assimilated @ NCEP (20 Nov 13) for all channels will be impared, so disable all


====MSU====
===MSU===
* 19781101-20061010
* 19781101-20061010
* 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond - off chn all msu-n14
* 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond - off chn all msu-n14
Line 380: Line 396:
**  19871012 120000  19871012 120000  msu    0                                        # msu: all channels noisy     
**  19871012 120000  19871012 120000  msu    0                                        # msu: all channels noisy     
**  19871012 180000  19910901 240000  msu    3    2 3 4                                #  
**  19871012 180000  19910901 240000  msu    3    2 3 4                                #  
* NOAA-11
**  19881108 000000  19890315 240000  msu    3    2 3 4                # 
**  19890316 000000  19890416 240000  msu    2    2  4                # msu: ch3 noisy   
**  19890417 000000  19930707 000000  msu    3    2 3 4                # 
**  19930707 060000  19930707 060000  msu    0                    # msu: all channels noisy 
**  19930707 120000  19950410 240000  msu    3    2 3 4                # 
**  19970715 000000  19990225 240000  msu    3    2 3 4                                # 
**  19990226 000000  19990227 240000  msu    0 
* NOAA-12
* NOAA-12
**  19910818 000000  19930707 240000  msu    3    2 3 4                                #  
**  19910818 000000  19930707 240000  msu    3    2 3 4                                #  
Line 393: Line 417:
**  19950501 000000  20061010 240000  msu    3    2 3 4                                #
**  19950501 000000  20061010 240000  msu    3    2 3 4                                #


====MHS====
===MHS===
* 20051101-present
* 20051101-present
* NOAA-18
* NOAA-18
**  20051101 000000  21001231 240000  mhs    5  1 2 3 4 5                                      #  
**  20051101 000000  21001231 240000  mhs    5  1 2 3 4 5                                      #  
* NOAA-19
* NOAA-19
*n19 20090414 120000  21001231 240000  mhs    0
** 20090414 120000  21001231 240000  mhs    0
* METOP-A
* METOP-A
** 20070521 000000  21001231 240000  mhs    5  1 2 3 4 5              #
** 20070521 000000  20191101 240000  mhs    5  1 2 3 4 5              #
** 20191102 000000  21001231 240000  mhs    0                        # ch 2 noisy, turn off instrument
* METOP-B
* METOP-B
**metop-b 20130213 000000  21001231 240000  mhs    0                                              # Currently on @ NCEP, commented out pending testing (20 Nov 13, ch 1 2 3 4 5)
** 20130213 000000  21001231 240000  mhs    1 2 3 4 5                             # active for e512a_rt-parallel testing


====SSU====
===SSU===
* 19781101-20060505
* 19781101-20060505
* 24Nov2013 McCarty  - adjust startdate of n06_ssu to correspond w/ reference date within CRTM coefficents and avoid mass error messages prior to 02 July 1979
* 24Nov2013 McCarty  - adjust startdate of n06_ssu to correspond w/ reference date within CRTM coefficents and avoid mass error messages prior to 02 July 1979
Line 410: Line 435:
**  19781201 000000  19810204 240000  ssu    2  1 2                                # ssu: ch3 unusable
**  19781201 000000  19810204 240000  ssu    2  1 2                                # ssu: ch3 unusable
**  19810205 000000  19810227 240000  ssu    0                                      # ssu: all channels noisy, unknown reason   
**  19810205 000000  19810227 240000  ssu    0                                      # ssu: all channels noisy, unknown reason   
* NOAA-06  
* NOAA-06
**  no data between 19810327-19810407 >> no radiance data at all during this period
**  19790702 000000  19830417 240000  ssu    3  1 2 3                                  #
**  19790702 000000  19830417 240000  ssu    3  1 2 3                                  #
**  19850408 000000  19861117 240000  ssu    3  1 2 3                                  #  
**  19850408 000000  19861117 240000  ssu    3  1 2 3                                  #  
Line 422: Line 448:
**  19830914 000000  19840620 240000  ssu    2  1 2                                    # ssu: ch3 failure (instrument malfunction)     
**  19830914 000000  19840620 240000  ssu    2  1 2                                    # ssu: ch3 failure (instrument malfunction)     
**  19850701 000000  19851014 240000 ssu    0                                        # ssu: ch1 malfunction & ch3 failure
**  19850701 000000  19851014 240000 ssu    0                                        # ssu: ch1 malfunction & ch3 failure
* NOAA-09
* NOAA-09
**  19850101 000000  19850323 240000  ssu    2  1 2                                    # ssu: ch3 unusable     
**  19850101 000000  19850323 240000  ssu    2  1 2                                    # ssu: ch3 unusable     
Line 437: Line 462:


===IASI===
===IASI===
* 20080916_18z-present
* METOP-A
* 20080801_00z-present
* 17Jun2011 Sienkiewicz  Remove IASI channels sensitive to o3 as suggested by Will McCarty
* 17Jun2011 Sienkiewicz  Remove IASI channels sensitive to o3 as suggested by Will McCarty
* METOP-A
**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/iasi-a-channels.png  IASI active channels]
 
* 11Sep2021 Sienkiewicz IASI MetOp-A turned off due to instrument instability (due to tests carried out at end of mission)
===Metop-AMSU-A===
* METOP-B
* 20080916_18z-present
* 200130213_00z-present
*
**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/iasi-b-channels.png  IASI active channels]


===AIRS===
===AIRS===
Line 451: Line 477:
* The original record is shown here:
* The original record is shown here:
* aqa 124 20021012 000000  21001231 240000  airs  152  3 6 9:11 13:14 18 21 29 31 44:47 49 50 52:53 55:57 59:68 70 72:73 75:78 80:81 83:130 166:223 225:229   
* aqa 124 20021012 000000  21001231 240000  airs  152  3 6 9:11 13:14 18 21 29 31 44:47 49 50 52:53 55:57 59:68 70 72:73 75:78 80:81 83:130 166:223 225:229   
* Without offending moisture, and a few temp, channels (per NCEP)
* Without offending moisture, and a few temp, channels (per NCEP)
* aqa 124 20021012 000000  21001231 240000  airs  121  3 6 9:11 13:14 18 21 29 31 44:47 49 50 52:53 55:57 59:68 70 72:73 75:78 80:81 83:107 109:117 119:126 128:130 166:174 176:178 180:182 186 190 193 202 208 212 215:223 225:229
* aqa 124 20021012 000000  21001231 240000  airs  121  3 6 9:11 13:14 18 21 29 31 44:47 49 50 52:53 55:57 59:68 70 72:73 75:78 80:81 83:107 109:117 119:126 128:130 166:174 176:178 180:182 186 190 193 202 208 212 215:223 225:229
 
**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/airs-channels.png AIRS active channels]
===Aqua-AMSU-A===
* 20021012_00z-present
* 31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond - off chn 1-5;14-15 amsua-aqua
 
**  20021012 000000 20071102 120000  amsua  10        4 5 6  8 9 10 11 12 13 14
**  20071102 180000  21001231 240000  amsua  8            6  8 9 10 11 12 13 14                          # ch4 noisy; QC affected ; turn off ch1-5


===ATMS===
===ATMS===
Line 469: Line 488:


===CrIS===
===CrIS===
* 20120406-present
* 20120406-20190618  turned off after midband failure.
* 02Nov2012 Todling/McCarty - turned off channels 1-5 of ATMS/CrIS for consistency w/ AMSUA deal
* 02Nov2012 Todling/McCarty - turned off channels 1-5 of ATMS/CrIS for consistency w/ AMSUA deal
**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/cris-channels.png  CrIS active channels to 20120731]
* A number of channels were turned off on 20120801 - note that in reanalysis these channels should be turned off at the start
**[https://gmao.gsfc.nasa.gov/intranmet/personnel/msienkiewicz/M2cris-channels20120801.png CrIS active channels after 20120801]


===SSMI===
===SSMI===
Line 489: Line 511:
===SSMI/S===
===SSMI/S===
* 20110228_00z-present
* 20110228_00z-present


==Ozone data==
==Ozone data==
Line 503: Line 524:


== Additional information==
== Additional information==
A.C.(internal link) [https://gmao.gsfc.nasa.gov/intranet/science/gms/all_about_obs/]
A.C. (Austin Conaty) (internal link) [https://gmao.gsfc.nasa.gov/intranet/science/gms/all_about_obs/]
DM Dagmar Merkova
MS Meta Sienkiewicz
YK Yelena Kondratyeva
WM Will McCarty
JW Jack Woolen

Latest revision as of 15:13, 28 January 2022

Input Data Information This is a page to keep information about input data (source, processing, gaps and known issues).


Conventional data pre-QC

PREPBUFR

  • RADCOR=HAIMB_HRAD
  • cdas0 (1979-2000)
    • data from Jack Woolen; recieved 2013 (1979-1997 reprocessed data, 1997-1998 pulled additional files from CFSRR)
      • updates to METEOSAT AMV (early reprocessed 82-87) JW
      • updates to ADPSFC (data types 181 and 183 separated before 1998) JW
      • 1982-2000 added Vaisala correction (from original files processed by Chris Redder, adpupa_fixvai)(DM)
      • exclusion of NPN profiles data (we have separate files for npn profiler from UCAR) (DM)
  • cdas (2001-present)
    • data from Jack Woolen for original MERRA
      • Vaisala correction (Chris Redder)
      • NPN profiler excluded until 20080731 (profiler obs file) (except station in Pacific and Europe that have the same kx 223)
  • PAOB data 19790101-20100817
  • SATWND data in prepbufr until 20100701 (after in bufr format file)
  • GMS WV satwinds (KX=250) in prepbufr files are passive (missing obs. error). This is necessary because GMS WV satwinds in prepbufr format do not have information needed to distinguish between cloud-top and deep layer WV winds, and we are not able to turn on only cloud-top winds as we do for the winds from the satwind dump bufr format file.
  • TAMDAR data - passive (quality issues: missing tail numbers, bias) correction of KX
    • in sweeper b5122_m2swp_jan10 run Meta found that few of the aircraft data had missing staion ID: "in our current configuration we can not do anything different for these winds, because they have been misidentified as other aircraft types (kx=130/230 AIREP/PIREP and kx=131/231 AMDAR)"
    • fix code: NCEP_Paqc/modify_bufr/fix_tamdar.f (correction of kx and screen them out)
    • counts in fixed data seems lower then in operational run, probably due to different processing (NCEP ops & in house fix for reanalysis input TAMDAR data)
  • Atlantic anomaly in 79-80 -the same issue in MERRA ([1]) ???? Steve Bloom identified anomalies associated with two stations - 99012 (~ weather ship Lima) in Atlantic off Portugal, and 99018 (~ weather ship Quebec) in the Pacific.
  • Fix for blacklisted observations from Singapore station (ID 48698), ADUPA files were processed using code delivered by Meta for original MERRA input (~/Applications/NCEP_Paqc/modify_bufr);formerly blacklisted data were from 7/22/1998 - 02/23/2000 ([2])
  • The prepbufr files received from NCEP after 12/29/2020 00z had already been processed through their PREVENTS step and thus had the temperatures for surface marine and surface land observations converted to virtual temperature. The MERRA2 preprocessing carried out the VIRTMP conversion a second time. A program to scan the input file to determine if the VIRTMP processing had already been done was added to the preprocessing QC, and the MERRA2 run was wound back to 1 June 2021. Note that between 12/29/2020 and 5/31/2021 the screening program would need to be disabled and virtual temperature calculated a second time if one wished to reproduce the MERRA2 results. Or, just use the already processed prepbufr file from after the prepQC archived from MERRA2 as input instead of redoing the preprocessing.

ASCAT (20080301-recent)

  • from ASCATW (bufr files needs to be processed (~msienkie/ascat/prepdata; historical data were processed by DM (from 20090301), realtime-it will be part of preprocessing)
  • gap in September 2010 was originally filled from ASCATT format by MS)
  • adding data prior 2009 (WM)
  • real-time preprocessing (YK)


AVHRR polar winds (1982-recent)

  • source: CIMSS
  • obs. errors table in prepobs_errtable.global added (copy of modis ir amv's obs errors)
  • ascii to prepbufr (code YK,processed DM)
  • no observation for 12z and 18z between 20091223-10100103
  • bufr format (code WC, processed DM)
  • additional source: NESDIS via NCEP
    • operational AVHRR in gdas satwnd files from 20150115 06z onward, from time of GOES hourly wind introduction
    • operational AVHRR was intended to be removed from time-windowed satwind BUFR files, but that version of the time-windowing software somehow didn't make it into ops
    • operational AVHRR no longer in time-windowed files after 20150520 00z (ops time-windowing software updated to take out EUMETSAT WV winds to reduce data count)

SATWINDS (Atmospheric Motion Vectors)

  • switch from prepbufr to bufr format on Jul1, 2010
  • 1979 GOES - additional AMV from FGGE (First GARP Global Experiment), which ran from Dec. 1978 to Nov. 1979. There should be AMVs from GOES East and West, Meteosat-1, GMS-1, and GOES Indian Ocean. The winds were produced here at UW-Madison, using manually tracking (from Dave Santek,CIMSS).
  • 20130121 - METEOSAT AMV's (kx=243) switch to METEOSAT 10 (id=57)

ERS scatterometer

  • ERS1 (19910805-19960525) lots of short gaps
    • exclude 06z Aug 24, 1992 (hurricane Andrew); in original MERRA this set of winds had negative impact
  • The re-processing of ERS-2 data from 1997-2003.
    • 19970520_00z-20030217_18z
    • The three available formats of the re-processed data are:
      • ERS.ASPS.UWI (re-processed data in UWI format for compatability with the real-time product)
      • ERS.ASPS20.N (re-processed data in ASPS format: nominal resolution 50km)
      • ERS.ASPS20.H (re-processed data in ASPS format: high resolution 25km)
    • We are processing ERS.ASPS20.N. For this data, lets give a filename like: ers2_asps20n.YYYYMMDD.tHHz.bufr
  • ERS2 (20030813-20110329) new version of data
    • For the period from 2003 through the end, we have the fast delivery product (WSC.UWI).

QuikSCAT Data

  • data from JPL (19990719-20091122; MS added 2003,2004)

SSMI Wind Speed

  • updated to Wentz Version 7 (19870709_00z-present)
    • F08 SSM/I Jul 1987 Dec 1991
    • F10 SSM/I Dec 1990 Nov 1997
    • F11 SSM/I Dec 1991 May 2000
    • F13 SSM/I May 1995 Nov 2009
    • F14 SSM/I May 1997 Aug 2008
    • F15 SSM/I Dec 1999 present (do not use after Aug 2006 for climate study)
    • F16 SSMIS Oct 2003 present
    • F17 SSMIS Dec 2006 present
    • F18 SSMIS Oct 2009 present

Modis

  • data processed from CIMSS (YK); experimental data before NESDIS was processing data and they were part of SATWIND prepbufr
  • 20020701-20040708
  • 20040709-20040930

NPN Profiler

  • data 19920510-20080731 from UCAR, gaps filled from original Jack Woolen's cdas files in period 20060101-20080731
  • data after 20080731 from NCEP
  • (19920510-20080731)(excluded from cdas and cdas0)
  • Funding for NPN was eliminated (2014) within the continental United States and data will cease, more ...

NO-preQC data

tcvitals

  • (19790101-present)
  • data prior 2006 from Jack Woolen (added Nov2013)

SSMI Rain Rates

  • GPROF data
  • F08 - 19870709_00z-19900226_18z
  • F10 - 19910105_00z-19971115_18z
  • F11 - 19920101_00z-19961130_18z
  • F13 - 19950503_00z-20090916_18z
  • F14 - 19970508_00z-20080824_18z


TRMM TMI Rain Rates

  • 19980101-present
  • Separate streams for land and ocean
  • TRMM TMI Level 2A Hydrometeor Profile Product 2A12
  • version 6 prior to 2011-07-01, version 7 afterward
  • data is superobed on a one-degree lat/lon grid

GPS Radio Occultation

  • 20010501-20071214 (from Jack Woollen:gps data starting in 2002 is from the CHAMP instrument, reprocessed by the Boulder folks. Reprocessed COSMIC starts in around 2006)
  • 20071215-present
  • Noting end dates of some GPS data types: C/NOFS ~2013/06/05 SAC-C ~2011/08/02

Radiances

  • 0 after the name of instrument (6th column) - data not used

GOES Sounder

  • data available from 20010424-20071204
    • 5x5 averaged in goesnd.* files
      • old prepbufr file - but the input is no longer through prep stream
  • high resolution stream 20070222-present
    • 1x1 single FOVs in *goesfv* files
  • Control of usage set in satinfo_db
    • Switch occurs on 20070401_00z in MERRA2
  • notes from satinfo database:
    • 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond
      • - off chn all sndr-g12
      • - off chn all sndrD1/D2/D3/D4-g13 (?)
    • 03Aug2013 Todling - add GOES-15 as active
    • 10Sep2013 Sienkiewicz - some updates for GOES sounder
      • 5x5 prepbufr ends 12/4/2007 12z. (Overlaps 1x1 data)
      • turn off sndrdX in early Dec 2007, problem with SAID (see Keyser's Satellite_Historical_Documentation.htm)
      • NCEP dump of 1x1 starts ~2/22/07 00z. g11 mislabeled as g10 until 2007/03/20 18z ; satID values OK in 5x5 data though - so do not use 1x1 prior to 2007/03/20 18z!
      • GOES-10 to GOES-11 transition: 5x5 prepbufr has all 3 types (10,11,12) at 20060621.t18z with g10 before and g11 afterward.
      • GOES-8 to GOES-12 transition: 5x5 prepbufr has all 3 types (8,10,12) at 20030401.t18z with g08 before and g12 afterward.
      • Note: GOES-13 replaces GOES-12 as operational 4/14/2010 18z
      • Note: GOES-15 replaces GOES-11 as operational 12/6/2011 15z
      • Need to check when these data start in the 'goesfv' dumps & when/if we want to turn these on in the database.
    • 29Oct2013 Todling/(per Sienkiewicz) - turn GOES-13 back on from 20090101 on.
    • 20Nov2015 GOES-13 Sounder anomaly - end of GOES-13 Sounder data
    • 3Mar2020 GOES-15 Sounder data ends in operational stream. No sounder on GOES-R (GOES-16, GOES-17 satellites)
  • g08
    • 19940413 000000 20030401 240000 sndr 11 1 2 3 4 5 6 7 8 10 11 12
  • g10
    • 19970425 000000 20060621 240000 sndr 11 1 2 3 4 5 6 7 8 10 11 12
  • g11
    • 20060622 000000 20070331 240000 sndr 11 1 2 3 4 5 6 7 8 10 11 12
    • 20070401 000000 20071203 240000 sndr 0 # switch to single fov/indiv. detectors on 1 Apr 2007
  • g12
    • 20030402 000000 20070331 240000 sndr 11 1 2 3 4 5 6 7 8 10 11 12
    • 20070401 000000 21001231 240000 sndr 0 # switch to single fov/indiv. detectors on 1 Apr 2007
  • g11
    • 20070320 180000 20070331 240000 sndrD1 0 # g11 mislabeled as g10 in 1x1 files until 20070320/18z
    • 20070320 180000 20070331 240000 sndrD2 0 # Kept passive till 1 Apr transition
    • 20070320 180000 20070331 240000 sndrD3 0
    • 20070320 180000 20070331 240000 sndrD4 0
    • 20070401 000000 20071204 240000 sndrD1 11 1 2 3 4 5 6 7 8 10 11 12 # g11 mislabeled as g10 in 1x1 files until 20070320/18z
    • 20070401 000000 20071204 240000 sndrD2 11 1 2 3 4 5 6 7 8 10 11 12 # becomes active on 1 Apr
    • 20070401 000000 20071204 240000 sndrD3 11 1 2 3 4 5 6 7 8 10 11 12
    • 20070401 000000 20071204 240000 sndrD4 11 1 2 3 4 5 6 7 8 10 11 12
    • 20071205 000000 20071210 240000 sndrD1 0 # error with g10 labeled with g11 sat id
    • 20071205 000000 20071210 240000 sndrD2 0 # turn off g11 until fixed @ NESDIS 2007/12/11 00z
    • 20071205 000000 20071210 240000 sndrD3 0
    • 20071205 000000 20071210 240000 sndrD4 0
    • 20071211 000000 20111205 240000 sndrD1 11 1 2 3 4 5 6 7 8 10 11 12 # 5 Dec 2011 -> GOES-15 became ops GOES-West
    • 20071211 000000 20111205 240000 sndrD2 11 1 2 3 4 5 6 7 8 10 11 12
    • 20071211 000000 20111205 240000 sndrD3 11 1 2 3 4 5 6 7 8 10 11 12
    • 20071211 000000 20111205 240000 sndrD4 11 1 2 3 4 5 6 7 8 10 11 12
  • g12
    • 20030402 000000 20070331 240000 sndrD1 0 # passive till 5x5 to 1x1 transition on 1 Apr 2007
    • 20030402 000000 20070331 240000 sndrD2 0
    • 20030402 000000 20070331 240000 sndrD3 0
    • 20030402 000000 20070331 240000 sndrD4 0
    • 20070401 000000 20071204 240000 sndrD1 11 1 2 3 4 5 6 7 8 10 11 12 # becomes active on 5x5 to 1x1 transition on 1 Apr 2007
    • 20070401 000000 20071204 240000 sndrD2 11 1 2 3 4 5 6 7 8 10 11 12
    • 20070401 000000 20071204 240000 sndrD3 11 1 2 3 4 5 6 7 8 10 11 12
    • 20070401 000000 20071204 240000 sndrD4 11 1 2 3 4 5 6 7 8 10 11 12
    • 20071205 000000 20071217 240000 sndrD1 0
    • 20071205 000000 20071217 240000 sndrD2 0
    • 20071205 000000 20071217 240000 sndrD3 0
    • 20071205 000000 20071217 240000 sndrD4 0
    • 20071218 000000 20100413 240000 sndrD1 11 1 2 3 4 5 6 7 8 10 11 12 # 14 Apr 2010 -> GOES-13 became ops GOES-East
    • 20071218 000000 20100413 240000 sndrD2 11 1 2 3 4 5 6 7 8 10 11 12
    • 20071218 000000 20100413 240000 sndrD3 11 1 2 3 4 5 6 7 8 10 11 12
    • 20071218 000000 20100413 240000 sndrD4 11 1 2 3 4 5 6 7 8 10 11 12
  • g13
    • 20060630 000000 20100414 240000 sndrD1 0 # Passive till Operational GOES-East
    • 20060630 000000 20100414 240000 sndrD2 0
    • 20060630 000000 20100414 240000 sndrD3 0
    • 20060630 000000 20100414 240000 sndrD4 0
    • 20100415 000000 21001231 240000 sndrD1 11 1 2 3 4 5 6 7 8 10 11 12 # GOES-13 became ops GOES-East on 14 Apr 2010
    • 20100415 000000 21001231 240000 sndrD2 11 1 2 3 4 5 6 7 8 10 11 12 # start a day later....
    • 20100415 000000 21001231 240000 sndrD3 11 1 2 3 4 5 6 7 8 10 11 12
    • 20100415 000000 21001231 240000 sndrD4 11 1 2 3 4 5 6 7 8 10 11 12
  • g14
    • 20121001 000000 29991231 240000 sndrD1 0 # on-orbit spare, keep channels as passive if
    • 20121001 000000 29991231 240000 sndrD2 0 # data starts flowing
    • 20121001 000000 29991231 240000 sndrD3 0
    • 20121001 000000 29991231 240000 sndrD4 0
  • g15
    • 20100304 000000 20111206 240000 sndrD1 0 # Passive till Operational GOES-West
    • 20100304 000000 20111206 240000 sndrD2 0 #
    • 20100304 000000 20111206 240000 sndrD3 0
    • 20100304 000000 20111206 240000 sndrD4 0
    • 20111207 000000 21001231 240000 sndrD1 11 1 2 3 4 5 6 7 8 10 11 12 # GOES-15 became ops GOES-West on 5 Dec 2011
    • 20111207 000000 21001231 240000 sndrD2 11 1 2 3 4 5 6 7 8 10 11 12
    • 20111207 000000 21001231 240000 sndrD3 11 1 2 3 4 5 6 7 8 10 11 12
    • 20111207 000000 21001231 240000 sndrD4 11 1 2 3 4 5 6 7 8 10 11 12

SEVIRI

  • 20120215-present
    • m09 20120213 000000 29991231 240000 seviri 0
    • m09 20120213 000000 29991231 240000 seviri 2 2 3
    • m10 20130121 120000 29991231 240000 seviri 2 2 3

AMSU-A

  • 19981101-present
  • 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond
    • - off chn all amsua-n16
    • - off chn 9/14 amsua-n18
  • 10Dec2010 Todling Remove all window channels from AMSUA (1,2,3,and 15)
  • NOAA-15
    • 19981101 000000 19990101 000000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #
    • 19990101 060000 19990101 060000 amsua 0 # amsua: all noisy
    • 19990101 120000 20001029 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #
    • 20001030 000000 20020331 240000 amsua 10 4 5 6 7 8 9 10 11 12 13 # amsua: bad ch14 (ch11?)
    • 20020401 000000 20151008 240000 amsua 9 4 5 6 7 8 9 10 12 13 # amsua: bad ch11 & ch14
    • 20151009 000000 21001231 240000 amsua 6 7 8 9 10 12 13 # amsua: bad ch 6, ch4 & ch5 disabled; QC is a function of Ch6
  • NOAA-16 (ncep amsua ch9-14 turned off (currently))
    • 20010101 000000 20010110 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #
    • 20010111 000000 20010111 240000 amsua 0 # amsua: all noisy
    • 20010112 000000 20020906 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #
    • 20020907 000000 20020907 240000 amsua 5 4 5 6 7 8 # amsua: ch9-14 noisy
    • 20020908 000000 20021120 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #
    • 20021121 000000 20021127 240000 amsua 0 # amsua: all channels on ecmwf blacklist
    • 20021128 000000 20030512 060000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #
    • 20030512 120000 20040616 240000 amsua 10 4 5 6 7 8 10 11 12 13 14 # amsua: ch9 noisy
    • 20040617 000000 20050114 240000 amsua 8 4 5 6 7 8 12 13 14 # amsua: ch9 & ch10-11 noisy
    • 20050115 000000 20070129 120000 amsua 5 4 5 6 7 8 # amsua: ch 9-14 noisy
    • 20070129 180000 21001231 240000 amsua 0 # amsua: ch4 noisy; QC affected; turn off all
  • NOAA-17
    • 20020715 000000 20031027 240000 amsua 10 4 5 6 8 9 10 11 12 13 14 # ncep does not use amsua ch7
    • 20031028 000000 20031030 240000 amsua 0 # amsua: antenna anomaly
  • NOAA-18
    • 20051001 000000 20071116 120000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 # M2: redundant entry intentional. Observations exist prior to MERRA(1) start date. Will attempt to assimilate. This should be set to inactive should an issue arise (wm)
    • 20051101 000000 20071116 120000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 # (old note)added all 14 back (see iuse-4.tbl)
    • 20071116 180000 21001231 240000 amsua 10 4 5 6 7 8 10 11 12 13 14 # amsua: 9 bad, added all 14 back
  • NOAA-19
    • n19 20090414 000000 20091215 060000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 # M2: redundant entry intentional. Observations exist prior to MERRA(1) start date. Will attempt to assimilate. This should be set to inactive should an issue arise (wm)
    • 20091215 120000 20091221 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #
    • 20091222 000000 20140128 240000 amsua 10 4 5 6 7 9 10 11 12 13 14 # ch8 noisy (noise started on 12/21/2009)
    • 20140129 000000 20200926 240000 amsua 9 4 5 6 9 10 11 12 13 14 # per NCEP r35918
    • 20200927 000000 21001231 240000 amsua 8 4 5 6 9 10 12 13 14 # Channel 11 calibration issues
  • Aqua
    • 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond - off chn 1-5;14-15 amsua-aqua
    • 20021012 000000 20071102 120000 amsua 10 4 5 6 8 9 10 11 12 13 14
    • 20071102 180000 21001231 240000 amsua 8 6 8 9 10 11 12 13 14 # ch4 noisy; QC affected ; turn off ch1-5
  • METOP-A
    • 20070521 000000 20090115 060000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #
    • 20090115 120000 21001231 240000 amsua 10 4 5 6 8 9 10 11 12 13 14 # ch7 noisy
  • METOP-B
    • 20130213 000000 21001231 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 # active for e512a_rt-parallel testing

AMSU-B

  • 19981101-present
  • 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond - off chn 4 amsub-n15
  • NOAA-15
    • 19981101 000000 20060216 000000 amsub 5 1 2 3 4 5 #
    • 20060216 060000 20110328 060000 amsub 0 # ch4 noisy, all ch off
    • 20110328 120000 20110328 240000 amsub 0 # amsub: scan motor failed
  • NOAA-16
    • 20001105 000000 20001231 240000 amsub 5 1 2 3 4 5 # M2: redundant entry intentional. Observations exist prior to MERRA(1) start date. Will attempt to assimilate. This should be set to inactive should an issue arise (wm)
    • 20010101 000000 20090416 240000 amsub 5 1 2 3 4 5 #
    • 20090416 000000 21001231 240000 amsub 0 # amsub: noisy since 20090416 (end date moved back to corresp. to Keyser's history)
  • NOAA-17
    • 20020715 000000 20091222 120000 amsub 5 1 2 3 4 5 #
    • 20091222 180000 20130420 240000 amsub 0 # amsub: ch3-5 noisy; turn off all

HIRS2

  • 19781101-20060930
  • turned off HIRS2 chns 13 & 14 (for consistency w/ what was done w/ HIRS3/4)
  • turned off HIRS2/3/4 chn 9 (oz-sensitive); and 15 from L. Coy studies
  • TIROS-N
    • 19781021 000000 19781231 240000 hirs2 0 # hirs2: unreliable for the first few months
    • 19790101 000000 19800120 240000 hirs2 8 2 3 6 7 8 10 11 12 # hirs2: ch4 & ch5 unstable
    • 19800121 000000 19810227 240000 hirs2 0 # hirs2: all channels from 19800127 -change behavior after data gap
  • NOAA-06
    • 19790702 000000 19790712 240000 hirs2 0 # hirs2: unstable
    • 19790713 000000 19830417 060000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • NOAA-07
    • 19810711 000000 19850204 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 19850205 000000 19850206 240000 hirs2 0 # hirs2: instrument failure
  • NOAA-08
    • 19830426 000000 19840620 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 19850701 000000 19851014 240000 hirs2 0 # hirs2: none
  • NOAA-09
    • 19850101 000000 19850202 240000 hirs2 0 # hirs2: calibration problems (ch7 bad)
    • 19850203 000000 19860930 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 19861001 000000 19881107 240000 hirs2 8 4 5 6 7 8 10 11 12 # hirs2: ch1 & ch2 & ch3 stripping
  • NOAA-10
    • 19861125 000000 19910901 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • NOAA-11
    • 19881012 000000 19941204 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 19970715 000000 19990228 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • NOAA-12
    • 19910818 000000 19911224 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 19911125 000000 19920307 240000 hirs2 0 # hirs2: instrumental problems
    • 19920308 000000 19930609 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 19930610 000000 19930618 240000 hirs2 0 # hirs2: all channels noisy
    • 19930619 000000 19970714 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • NOAA-14
    • 19950119 000000 19950430 240000 hirs2 0 # hirs2: unstable
    • 19950501 000000 20060930 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 20060930 000000 20070523 240000 hirs2 0 # end of record

HIRS3

  • 19980721-present
  • 19Jul2012 Todling - turned off channel 9 from HIRS3 and 4 (per Pawson's)
  • 07Sep2013 Todling - turned off HIRS3/4 chs 13 and 14 (Joa>Job)
  • 20Sep2013 Todling - turned off HIRS2 chns 13 & 14 (for consistency w/ what was done w/ HIRS3/4)
  • 7May2013 Sienkiewicz - no reference to n16 HIRS before 20010216 00 - don't even process as passive so as to avoid lots of error messages
  • NOAA-15
    • 19980702 000000 19981006 000000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 19981006 060000 19981006 060000 hirs3 0 # hirs3: noisy
    • 19981006 120000 19990302 000000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 19990302 060000 19990302 060000 hirs3 0 # hirs3: all noisy
    • 19990302 120000 20000218 240000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 20000219 000000 20000220 240000 hirs3 0 # hirs3: all noisy
    • 20000221 000000 20000606 240000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 20000607 000000 20090602 240000 hirs3 0 # hirs3: all noisy due to filter wheel problems
  • NOAA-16
    • 20001105 000000 20010215 240000 hirs3 0
    • 20010216 000000 20020405 060000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 20020405 120000 20020405 120000 hirs3 0 # hirs3: all noisy
    • 20020405 180000 20040520 240000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 20040521 000000 21001231 240000 hirs3 0 # hirs3: most channels noisy
  • NOAA-17
    • 20020625 000000 20111203 240000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 20111204 000000 20120828 240000 hirs3 0 # hirs: noise jump ch1-5,12

HIRS4

  • 20090401-present
  • 07Sep2013 Todling - turned off HIRS3/4 chs 13 and 14 (Joa>Job)
  • 20Sep2013 Todling - turned off HIRS2/3/4 chn 9 (oz-sensitive); and 15 from L. Coy studies
  • NOAA-18
    • 20051101 000000 21001231 240000 hirs4 0 # hirs4: most IR channels erratic quality
  • NOAA-19
    • 20090414 000000 20091215 060000 hirs4 10 2 3 4 5 6 7 8 10 11 12 # M2: redundant entry intentional. Observations exist prior to MERRA(1) start date. Will attempt to assimilate. This should be set to inactive should an issue arise (wm)
    • 20091215 120000 20130705 240000 hirs4 10 2 3 4 5 6 7 8 10 11 12 #
    • 20130706 000000 21001231 240000 hirs4 0 # sounding channels noise increase - cloud screening
  • METOP-A
    • 20070521 000000 21001231 240000 hirs4 10 2 3 4 5 6 7 8 10 11 12 #
  • METOP-B
    • metop-b 20130213 000000 21001231 240000 hirs4 0 # not currently assimilated @ NCEP (20 Nov 13) for all channels will be impared, so disable all

MSU

  • 19781101-20061010
  • 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond - off chn all msu-n14
  • 15Nov2013 McCarty - removed MSU ch1 (for consistency w/ AMSUA)
  • TIROS-N
    • 19781021 000000 19790625 240000 msu 3 2 3 4 #
    • 19790626 000000 19810227 240000 msu 0 # msu: all msu channels from 19790626 -change behavior
  • NOAA-06
    • 19790630 000000 19790906 060000 msu 3 2 3 4 #
    • 19790906 120000 19790906 120000 msu 0 # msu: all channels noisy, unknown reason
    • 19790906 180000 19830417 240000 msu 3 2 3 4 #
    • 19850408 000000 19851031 240000 msu 3 2 3 4 #
    • 19851101 000000 19861117 240000 msu 2 2 4 # msu: ch3 failure
  • NOAA-07
    • 19810628 000000 19840721 060000 msu 3 2 3 4 #
    • 19840721 120000 19840721 120000 msu 0 # msu: all noisy
    • 19840721 180000 19850207 240000 msu 3 2 3 4 #
    • 19850208 000000 19850208 060000 msu 0 # msu: instrument failure
    • 19850208 120000 19850218 240000 msu 3 2 3 4 #
  • NOAA-08
    • 19830426 000000 19840620 240000 msu 3 2 3 4 #
    • 19850701 000000 19851014 240000 msu 0 # data not in original MERRA, will monitor and potentially turn on. Notes say satellite has an attitude problem.
  • NOAA-09
    • 19850101 000000 19861024 240000 msu 3 2 3 4 #
    • 19861025 000000 19870307 240000 msu 2 2 4 # msu: ch3 failure
    • 19870308 000000 19881107 240000 msu 0 # msu: all failure
  • NOAA-10
    • 19861125 000000 19871012 060000 msu 3 2 3 4 #
    • 19871012 120000 19871012 120000 msu 0 # msu: all channels noisy
    • 19871012 180000 19910901 240000 msu 3 2 3 4 #
  • NOAA-11
    • 19881108 000000 19890315 240000 msu 3 2 3 4 #
    • 19890316 000000 19890416 240000 msu 2 2 4 # msu: ch3 noisy
    • 19890417 000000 19930707 000000 msu 3 2 3 4 #
    • 19930707 060000 19930707 060000 msu 0 # msu: all channels noisy
    • 19930707 120000 19950410 240000 msu 3 2 3 4 #
    • 19970715 000000 19990225 240000 msu 3 2 3 4 #
    • 19990226 000000 19990227 240000 msu 0
  • NOAA-12
    • 19910818 000000 19930707 240000 msu 3 2 3 4 #
    • 19930708 000000 19930709 240000 msu 0 # msu: all channels noisy
    • 19930710 000000 19950228 240000 msu 3 2 3 4 #
    • 19950301 000000 19950301 240000 msu 0 # msu: all channels noisy
    • 19950302 000000 19970324 000000 msu 3 2 3 4 #
    • 19970324 060000 19970324 060000 msu 0 # msu: all channels noisy
    • 19970324 120000 19970523 240000 msu 3 2 3 4 #
    • 19970524 000000 19981214 240000 msu 0 # msu: unreliable
  • NOAA-14
    • 19950119 000000 19950430 240000 msu 0 # msu: unstable
    • 19950501 000000 20061010 240000 msu 3 2 3 4 #

MHS

  • 20051101-present
  • NOAA-18
    • 20051101 000000 21001231 240000 mhs 5 1 2 3 4 5 #
  • NOAA-19
    • 20090414 120000 21001231 240000 mhs 0
  • METOP-A
    • 20070521 000000 20191101 240000 mhs 5 1 2 3 4 5 #
    • 20191102 000000 21001231 240000 mhs 0 # ch 2 noisy, turn off instrument
  • METOP-B
    • 20130213 000000 21001231 240000 mhs 5 1 2 3 4 5 # active for e512a_rt-parallel testing

SSU

  • 19781101-20060505
  • 24Nov2013 McCarty - adjust startdate of n06_ssu to correspond w/ reference date within CRTM coefficents and avoid mass error messages prior to 02 July 1979
  • TIROS-N
    • 19781201 000000 19810204 240000 ssu 2 1 2 # ssu: ch3 unusable
    • 19810205 000000 19810227 240000 ssu 0 # ssu: all channels noisy, unknown reason
  • NOAA-06
    • no data between 19810327-19810407 >> no radiance data at all during this period
    • 19790702 000000 19830417 240000 ssu 3 1 2 3 #
    • 19850408 000000 19861117 240000 ssu 3 1 2 3 #
  • NOAA-07
    • 19810711 000000 19830630 240000 ssu 3 1 2 3 #
    • 19830701 000000 19850204 000000 ssu 2 1 3 # ssu: ch2 calibration invalid
    • 19850204 060000 19850204 060000 ssu 0 # ssu: ch2 calibration invalid; all channels noisy
    • 19850204 120000 19850218 240000 ssu 2 1 3 # ssu: ch2 calibration invalid
  • NOAA-08
    • 19830426 000000 19830913 240000 ssu 3 1 2 3 #
    • 19830914 000000 19840620 240000 ssu 2 1 2 # ssu: ch3 failure (instrument malfunction)
    • 19850701 000000 19851014 240000 ssu 0 # ssu: ch1 malfunction & ch3 failure
  • NOAA-09
    • 19850101 000000 19850323 240000 ssu 2 1 2 # ssu: ch3 unusable
    • 19850324 000000 19881107 240000 ssu 3 1 2 3 # ssu: ch3 ok
  • NOAA-11
    • 19880928 000000 19941231 240000 ssu 3 1 2 3 #
    • 19970715 000000 19981031 240000 ssu 3 1 2 3 #
    • 19981101 000000 19990225 240000 ssu 3 1 2 # Ch. 3 disabled to be consistent w/ N14 change below. Disable Ch3 at start of AMSU-A record
    • 19990226 000000 20040615 240000 ssu 0 # SSU data held passive. This may be worth reevaluating in M2 scout run.
  • NOAA-14
    • 19950119 000000 19981031 240000 ssu 3 1 2 3 #
    • 19981101 000000 20060504 240000 ssu 2 1 2 # ssu: ch3 inconsistent with noaa-15 amsu-a ^^^ - original comment from db. Implemented on19990703 in MERRA. Due to lack of info and no clear signature, this change was extended to start of AMSU-A period.
    • 20060505 000000 20060505 240000 ssu 0 # ssu: turned off due to low battery voltages

IASI

  • METOP-A
  • 20080801_00z-present
  • 17Jun2011 Sienkiewicz Remove IASI channels sensitive to o3 as suggested by Will McCarty
  • 11Sep2021 Sienkiewicz IASI MetOp-A turned off due to instrument instability (due to tests carried out at end of mission)
  • METOP-B
  • 200130213_00z-present

AIRS

  • 20021012_00z-present
  • 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond -off chn 1545 airs-aqua
  • airs active channel total = 152 01 02 03 04 05 06 07 08 09 10
  • The original record is shown here:
  • aqa 124 20021012 000000 21001231 240000 airs 152 3 6 9:11 13:14 18 21 29 31 44:47 49 50 52:53 55:57 59:68 70 72:73 75:78 80:81 83:130 166:223 225:229
  • Without offending moisture, and a few temp, channels (per NCEP)
  • aqa 124 20021012 000000 21001231 240000 airs 121 3 6 9:11 13:14 18 21 29 31 44:47 49 50 52:53 55:57 59:68 70 72:73 75:78 80:81 83:107 109:117 119:126 128:130 166:174 176:178 180:182 186 190 193 202 208 212 215:223 225:229

ATMS

  • 20111116-present
  • 02Nov2012 Todling/McCarty - turned off channels 1-5 of ATMS/CrIS for consistency w/ AMSUA deal
  • NPP
    • 20111116 000000 21001231 240000 atms 17 5 6 7 8 9 10 11 12 13 14 15 17 18 19 20 21 22

CrIS

  • 20120406-20190618 turned off after midband failure.
  • 02Nov2012 Todling/McCarty - turned off channels 1-5 of ATMS/CrIS for consistency w/ AMSUA deal
  • A number of channels were turned off on 20120801 - note that in reanalysis these channels should be turned off at the start

SSMI

  • Wentz version 7(processing YK)
  • f08 85V channel (7) getting very bad mid 1988, unusable after 1/1989
  • f08 85H channel (6) going bad Mar-Nov 1990, unusable after 1/1991
    • f08 19870710 000000 19880207 240000 ssmi 7 1 2 3 4 5 6 7
    • f08 19880208 000000 19901231 240000 ssmi 6 1 2 3 4 5 7 # 85V bad
    • f08 19910101 000000 19911204 240000 ssmi 5 1 2 3 4 5 # 85V,H bad
    • f10 19901209 000000 19971113 240000 ssmi 7 1 2 3 4 5 6 7
    • f11 19911205 000000 19991218 240000 ssmi 7 1 2 3 4 5 6 7
    • f13 19950503 000000 20081231 240000 ssmi 7 1 2 3 4 5 6 7
    • f13 20090101 000000 21000531 240000 ssmi 0 # all off per NCEP
    • f14 19970508 000000 20080823 240000 ssmi 7 1 2 3 4 5 6 7
    • f15 19991218 000000 20060814 240000 ssmi 7 1 2 3 4 5 6 7

SSMI/S

  • 20110228_00z-present

Ozone data

SBUV

  • 19781031_00z-20040930_18z (Intentionally not needed (used) past 20040930)

MLS

  • 20041001_00z-present

EOSMLSt

  • 20040813_00z-present


Additional information

A.C. (Austin Conaty) (internal link) [3] DM Dagmar Merkova MS Meta Sienkiewicz YK Yelena Kondratyeva WM Will McCarty JW Jack Woolen