MERRA2 InputData: Difference between revisions

(39 intermediate revisions by 2 users not shown)

Line 25:

** counts in fixed data seems lower then in operational run, probably due to different processing (NCEP ops & in house fix for reanalysis input TAMDAR data)

* Atlantic anomaly in 79-80 -the same issue in MERRA ([http://merra-reanalysis.blogspot.com/2008/10/known-issue-1-east-atlantic-anomaly.html]) ???? Steve Bloom identified anomalies associated with two stations - 99012 (~ weather ship Lima) in Atlantic off Portugal, and 99018 (~ weather ship Quebec) in the Pacific.

* ~~fix~~ for blacklisted observations from ~~Singapour~~ station (ID 48698), ADUPA files were processed using code delivered by Meta for original MERRA input (~/Applications/NCEP_Paqc/modify_bufr);formerly blacklisted data were from 7/22/1998 - 02/23/2000 ([https://progress.nccs.nasa.gov/trac/esma/ticket/72])

* Fix for blacklisted observations from Singapore station (ID 48698), ADUPA files were processed using code delivered by Meta for original MERRA input (~/Applications/NCEP_Paqc/modify_bufr);formerly blacklisted data were from 7/22/1998 - 02/23/2000 ([https://progress.nccs.nasa.gov/trac/esma/ticket/72])

* The prepbufr files received from NCEP after 12/29/2020 00z had already been processed through their PREVENTS step and thus had the temperatures for surface marine and surface land observations converted to virtual temperature. The MERRA2 preprocessing carried out the VIRTMP conversion a second time. A program to scan the input file to determine if the VIRTMP processing had already been done was added to the preprocessing QC, and the MERRA2 run was wound back to 1 June 2021. Note that between 12/29/2020 and 5/31/2021 the screening program would need to be disabled and virtual temperature calculated a second time if one wished to reproduce the MERRA2 results. Or, just use the already processed prepbufr file from after the prepQC archived from MERRA2 as input instead of redoing the preprocessing.

===ASCAT (~~20090301~~-recent)===

===ASCAT (20080301-recent)===

* from ASCATW (bufr files needs to be processed (~msienkie/ascat/prepdata; historical data were processed by DM, realtime-it will be part of preprocessing)

* from ASCATW (bufr files needs to be processed (~msienkie/ascat/prepdata; historical data were processed by DM (from 20090301), realtime-it will be part of preprocessing)

* gap in September 2010 was originally filled from ASCATT format by MS)

* adding data ~~from~~ prior 2009? (WM??)

* adding data prior 2009 (WM)

* ~~need to add~~ real-time preprocessing!

* real-time preprocessing (YK)

Line 45:

Line 46:

** (Jul10-recent): ftp://stratus.ssec.wisc.edu/pub/winds/archive

** need to add real-time preprocessing!

* additional source: NESDIS via NCEP

** operational AVHRR in gdas satwnd files from 20150115 06z onward, from time of GOES hourly wind introduction

** operational AVHRR was intended to be removed from time-windowed satwind BUFR files, but that version of the time-windowing software somehow didn't make it into ops

** operational AVHRR no longer in time-windowed files after 20150520 00z (ops time-windowing software updated to take out EUMETSAT WV winds to reduce data count)

===SATWINDS (Atmospheric Motion Vectors)===

Line 54:

Line 59:

*ERS1 (19910805-19960525) lots of short gaps

** exclude 06z Aug 24, 1992 (hurricane Andrew); in original MERRA this set of winds had negative impact

*ERS2 (20030813-20110329) new version of data

*The re-processing of ERS-2 data from 1997-2003.

**The re-processing of ~~ers~~-2 ~~runs from~~ from 1997-2003. The three available formats of the re-processed data are:

** 19970520_00z-20030217_18z

** The three available formats of the re-processed data are:

*** ERS.ASPS.UWI (re-processed data in UWI format for compatability with the real-time product)

*** ERS.ASPS20.N (re-processed data in ASPS format: nominal resolution 50km)

*** ERS.ASPS20.H (re-processed data in ASPS format: high resolution 25km)

** We are processing ERS.ASPS20.N. For this data, lets give a filename like: ers2_asps20n.YYYYMMDD.tHHz.bufr

*ERS2 (20030813-20110329) new version of data

** For the period from 2003 through the end, we have the fast delivery product (WSC.UWI).

Line 86:

Line 93:

*data after 20080731 from NCEP

*(19920510-20080731)(excluded from cdas and cdas0)

* Funding for NPN was eliminated (2014) within the continental United States and data will cease, [http://www.nws.noaa.gov/om/notification/scn14-36wind_profilers.htm more] ...

==NO-preQC data==

===tcvitals===

* (~~1980~~-present)

* (19790101-present)

* data prior 2006 from Jack Woolen (added Nov2013)

Line 105:

Line 112:

* 19980101-present

* Separate streams for land and ocean

* TRMM TMI Level 2A Hydrometeor Profile Product 2A12

* version 6 prior to 2011-07-01, version 7 afterward

* data is superobed on a one-degree lat/lon grid

===GPS Radio Occultation===

*20010501-20071214 (from Jack Woollen:gps data starting in 2002 is from the CHAMP instrument, reprocessed by the Boulder folks. Reprocessed COSMIC starts in around 2006)

*20071215-present

* Noting end dates of some GPS data types: C/NOFS ~2013/06/05 SAC-C ~2011/08/02

==Radiances==

* 0 after the name of instrument (6th column) - data not used

===GOES Sounder===

*20010424-20071204

* data available from 20010424-20071204

** 5x5 averaged in goesnd.* files

*** old prepbufr file - but the input is no longer through prep stream

*20070222-present

*high resolution stream 20070222-present

** 1x1 single FOVs in *goesfv* files

* Control of usage set in satinfo_db

** Switch occurs on 20070401_00z in MERRA2

* notes from satinfo:

* notes from satinfo database:

** 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond

*** - off chn all sndr-g12

Line 133:

Line 145:

*** Note: GOES-15 replaces GOES-11 as operational 12/6/2011 15z

*** Need to check when these data start in the 'goesfv' dumps & when/if we want to turn these on in the database.

** 29Oct2013 Todling/(per Sienkiewicz) - turn ~~GEOS~~-13 back on from 20090101 on.

** 29Oct2013 Todling/(per Sienkiewicz) - turn GOES-13 back on from 20090101 on.

** 20Nov2015 GOES-13 Sounder anomaly - end of GOES-13 Sounder data

** 3Mar2020 GOES-15 Sounder data ends in operational stream. No sounder on GOES-R (GOES-16, GOES-17 satellites)

**

* g08

** 19940413 000000 20030401 240000 sndr 11 1 2 3 4 5 6 7 8 10 11 12

Line 206:

Line 221:

*

**m09 20120213 000000 29991231 240000 seviri 0

**m09 20120213 000000 29991231 240000 seviri 2 2 3

**m10 20130121 120000 29991231 240000 seviri 2 2 3

~~===TOVS/ATOVS data===~~

===AMSU-A===

====AMSU-A====

* 19981101-present

* 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond

Line 221:

Line 235:

** 19990101 120000 20001029 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #

** 20001030 000000 20020331 240000 amsua 10 4 5 6 7 8 9 10 11 12 13 # amsua: bad ch14 (ch11?)

** 20020401 000000 ~~21001231~~ 240000 amsua 9 4 5 6 7 8 9 10 12 13 # amsua: bad ch11 & ch14

** 20020401 000000 20151008 240000 amsua 9 4 5 6 7 8 9 10 12 13 # amsua: bad ch11 & ch14

** 20151009 000000 21001231 240000 amsua 6 7 8 9 10 12 13 # amsua: bad ch 6, ch4 & ch5 disabled; QC is a function of Ch6

* NOAA-16 (ncep amsua ch9-14 turned off (currently))

** 20010101 000000 20010110 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #

Line 244:

Line 259:

** n19 20090414 000000 20091215 060000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 # M2: redundant entry intentional. Observations exist prior to MERRA(1) start date. Will attempt to assimilate. This should be set to inactive should an issue arise (wm)

** 20091215 120000 20091221 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #

** 20091222 000000 ~~21001231~~ 240000 amsua 10 4 5 6 7 9 10 11 12 13 14 # ch8 noisy (noise started on 12/21/2009)

** 20091222 000000 20140128 240000 amsua 10 4 5 6 7 9 10 11 12 13 14 # ch8 noisy (noise started on 12/21/2009)

* METOP-A

** 20140129 000000 20200926 240000 amsua 9 4 5 6 9 10 11 12 13 14 # per NCEP r35918

** 20200927 000000 21001231 240000 amsua 8 4 5 6 9 10 12 13 14 # Channel 11 calibration issues

*Aqua

** 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond - off chn 1-5;14-15 amsua-aqua

** 20021012 000000 20071102 120000 amsua 10 4 5 6 8 9 10 11 12 13 14

** 20071102 180000 21001231 240000 amsua 8 6 8 9 10 11 12 13 14 # ch4 noisy; QC affected ; turn off ch1-5

* METOP-A

** 20070521 000000 20090115 060000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 #

** 20090115 120000 21001231 240000 amsua 10 4 5 6 8 9 10 11 12 13 14 # ch7 noisy

* METOP-B

** ~~# 20130213 000000 21001231 240000 amsua 0 # Currently on @ NCEP, commented out pending~~

** 20130213 000000 21001231 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 # active for e512a_rt-parallel testing

** # 20130213 000000 21001231 240000 amsua 11 4 5 6 7 8 9 10 11 12 13 14 # ~~pending~~ testing ~~(20 Nov 13)~~

====AMSU-B====

===AMSU-B===

* 19981101-present

* 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond - off chn 4 amsub-n15

* NOAA-15

** 19981101 000000 20060216 000000 amsub 5 1 2 3 4 5 #

** 20060216 060000 20110328 060000 amsub ~~4 1 2 3 5~~ # ch4 noisy

** 20060216 060000 20110328 060000 amsub 0 # ch4 noisy, all ch off

** 20110328 120000 20110328 240000 amsub 0 # amsub: scan motor failed

* NOAA-16

** 20001105 000000 20001231 240000 amsub 5 1 2 3 4 5 # M2: redundant entry intentional. Observations exist prior to MERRA(1) start date. Will attempt to assimilate. This should be set to inactive should an issue arise (wm)

** 20010101 000000 ~~20100514~~ 240000 amsub 5 1 2 3 4 5 #

** 20010101 000000 20090416 240000 amsub 5 1 2 3 4 5 #

** ~~20100515~~ 000000 21001231 240000 amsub 0 # amsub: noisy since ~~20100316~~

** 20090416 000000 21001231 240000 amsub 0 # amsub: noisy since 20090416 (end date moved back to corresp. to Keyser's history)

* NOAA-17

** 20020715 000000 20091222 120000 amsub 5 1 2 3 4 5 #

** 20091222 180000 20130420 240000 amsub 0 # amsub: ch3-5 noisy; turn off all

====HIRS2====

===HIRS2===

* 19781101-20060930

* turned off HIRS2 chns 13 & 14 (for consistency w/ what was done w/ HIRS3/4)

Line 279:

Line 300:

** 19790702 000000 19790712 240000 hirs2 0 # hirs2: unstable

** 19790713 000000 19830417 060000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #

** 19850408 000000 19861117 240000 hirs2 0 # hirs2: none

* NOAA-07

** 19810711 000000 19850204 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #

Line 285:

Line 305:

* NOAA-08

** 19830426 000000 19840620 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #

** 19850701 000000 19851014 240000 hirs2 0 # hirs2: none

* NOAA-09

** 19850101 000000 19850202 240000 hirs2 0 # hirs2: calibration problems (ch7 bad)

Line 306:

Line 326:

** 20060930 000000 20070523 240000 hirs2 0 # end of record

====HIRS3====

===HIRS3===

* 19980721-present

* 19Jul2012 Todling - turned off channel 9 from HIRS3 and 4 (per Pawson's)

Line 331:

Line 351:

** 20111204 000000 20120828 240000 hirs3 0 # hirs: noise jump ch1-5,12

====HIRS4====

===HIRS4===

* 20090401-present

* 07Sep2013 Todling - turned off HIRS3/4 chs 13 and 14 (Joa>Job)

Line 346:

Line 366:

** metop-b 20130213 000000 21001231 240000 hirs4 0 # not currently assimilated @ NCEP (20 Nov 13) for all channels will be impared, so disable all

====MSU====

===MSU===

* 19781101-20061010

* 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond - off chn all msu-n14

Line 376:

Line 396:

** 19871012 120000 19871012 120000 msu 0 # msu: all channels noisy

** 19871012 180000 19910901 240000 msu 3 2 3 4 #

* NOAA-11

** 19881108 000000 19890315 240000 msu 3 2 3 4 #

** 19890316 000000 19890416 240000 msu 2 2 4 # msu: ch3 noisy

** 19890417 000000 19930707 000000 msu 3 2 3 4 #

** 19930707 060000 19930707 060000 msu 0 # msu: all channels noisy

** 19930707 120000 19950410 240000 msu 3 2 3 4 #

** 19970715 000000 19990225 240000 msu 3 2 3 4 #

** 19990226 000000 19990227 240000 msu 0

* NOAA-12

** 19910818 000000 19930707 240000 msu 3 2 3 4 #

Line 389:

Line 417:

** 19950501 000000 20061010 240000 msu 3 2 3 4 #

====MHS====

===MHS===

* 20051101-present

* NOAA-18

** 20051101 000000 21001231 240000 mhs 5 1 2 3 4 5 #

* NOAA-19

*~~n19~~ 20090414 120000 21001231 240000 mhs 0

** 20090414 120000 21001231 240000 mhs 0

* METOP-A

** 20070521 000000 ~~21001231~~ 240000 mhs 5 1 2 3 4 5 #

** 20070521 000000 20191101 240000 mhs 5 1 2 3 4 5 #

** 20191102 000000 21001231 240000 mhs 0 # ch 2 noisy, turn off instrument

* METOP-B

**~~metop-b~~ 20130213 000000 21001231 240000 mhs ~~0 # Currently on @ NCEP, commented out pending testing (20 Nov 13, ch~~ 1 2 3 4 5)

** 20130213 000000 21001231 240000 mhs 5 1 2 3 4 5 # active for e512a_rt-parallel testing

====SSU====

===SSU===

* 19781101-20060505

* 24Nov2013 McCarty - adjust startdate of n06_ssu to correspond w/ reference date within CRTM coefficents and avoid mass error messages prior to 02 July 1979

Line 406:

Line 435:

** 19781201 000000 19810204 240000 ssu 2 1 2 # ssu: ch3 unusable

** 19810205 000000 19810227 240000 ssu 0 # ssu: all channels noisy, unknown reason

* NOAA-06

** no data between 19810327-19810407 >> no radiance data at all during this period

** 19790702 000000 19830417 240000 ssu 3 1 2 3 #

** 19850408 000000 19861117 240000 ssu 3 1 2 3 #

Line 418:

Line 448:

** 19830914 000000 19840620 240000 ssu 2 1 2 # ssu: ch3 failure (instrument malfunction)

** 19850701 000000 19851014 240000 ssu 0 # ssu: ch1 malfunction & ch3 failure

* NOAA-09

** 19850101 000000 19850323 240000 ssu 2 1 2 # ssu: ch3 unusable

Line 433:

Line 462:

===IASI===

* ~~20080916_18z~~-present

* METOP-A

* 20080801_00z-present

* 17Jun2011 Sienkiewicz Remove IASI channels sensitive to o3 as suggested by Will McCarty

* ~~METOP~~-A

**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/iasi-a-channels.png IASI active channels]

* 11Sep2021 Sienkiewicz IASI MetOp-A turned off due to instrument instability (due to tests carried out at end of mission)

~~===Metop-AMSU~~-~~A===~~

* METOP-B

* ~~20080916_18z~~-present

* 200130213_00z-present

*

**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/iasi-b-channels.png IASI active channels]

===AIRS===

Line 447:

Line 477:

* The original record is shown here:

* aqa 124 20021012 000000 21001231 240000 airs 152 3 6 9:11 13:14 18 21 29 31 44:47 49 50 52:53 55:57 59:68 70 72:73 75:78 80:81 83:130 166:223 225:229

* Without offending moisture, and a few temp, channels (per NCEP)

* aqa 124 20021012 000000 21001231 240000 airs 121 3 6 9:11 13:14 18 21 29 31 44:47 49 50 52:53 55:57 59:68 70 72:73 75:78 80:81 83:107 109:117 119:126 128:130 166:174 176:178 180:182 186 190 193 202 208 212 215:223 225:229

**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/airs-channels.png AIRS active channels]

~~===Aqua-AMSU-A===~~

* ~~20021012_00z-present~~

* ~~31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond~~ - ~~off chn 1-5;14-15 amsua-aqua~~

** 20021012 000000 ~~20071102 120000 amsua 10 4 5 6 8 9 10 11 12 13 14~~

** 20071102 180000 21001231 240000 amsua 8 6 8 9 10 11 12 13 14 # ch4 noisy; QC affected ; turn off ch1-5

===ATMS===

Line 465:

Line 488:

===CrIS===

* 20120406-~~present~~

* 20120406-20190618 turned off after midband failure.

* 02Nov2012 Todling/McCarty - turned off channels 1-5 of ATMS/CrIS for consistency w/ AMSUA deal

**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/cris-channels.png CrIS active channels to 20120731]

* A number of channels were turned off on 20120801 - note that in reanalysis these channels should be turned off at the start

**[https://gmao.gsfc.nasa.gov/intranmet/personnel/msienkiewicz/M2cris-channels20120801.png CrIS active channels after 20120801]

===SSMI===

Line 485:

Line 511:

===SSMI/S===

* 20110228_00z-present

==Ozone data==

Line 499:

Line 524:

== Additional information==

A.C.(internal link) [https://gmao.gsfc.nasa.gov/intranet/science/gms/all_about_obs/]

A.C. (Austin Conaty) (internal link) [https://gmao.gsfc.nasa.gov/intranet/science/gms/all_about_obs/]

DM Dagmar Merkova

MS Meta Sienkiewicz

YK Yelena Kondratyeva

WM Will McCarty

JW Jack Woolen

@@ Line 25: / Line 25: @@
 ** counts in fixed data seems lower then in operational run, probably due to different processing (NCEP ops & in house fix for reanalysis input TAMDAR data)
 * Atlantic anomaly in 79-80 -the same issue in MERRA ([http://merra-reanalysis.blogspot.com/2008/10/known-issue-1-east-atlantic-anomaly.html]) ????  Steve Bloom identified anomalies associated with two stations - 99012 (~ weather ship Lima) in Atlantic off Portugal, and 99018 (~ weather ship Quebec) in the Pacific.
-* fix for blacklisted observations from Singapour station (ID 48698), ADUPA files were processed using code delivered by Meta for original MERRA input (~/Applications/NCEP_Paqc/modify_bufr);formerly blacklisted data were from 7/22/1998 - 02/23/2000 ([https://progress.nccs.nasa.gov/trac/esma/ticket/72])
+* Fix for blacklisted observations from Singapore station (ID 48698), ADUPA files were processed using code delivered by Meta for original MERRA input (~/Applications/NCEP_Paqc/modify_bufr);formerly blacklisted data were from 7/22/1998 - 02/23/2000 ([https://progress.nccs.nasa.gov/trac/esma/ticket/72])
+* The prepbufr files received from NCEP after 12/29/2020 00z had already been processed through their PREVENTS step and thus had the temperatures for surface marine and surface land observations converted to virtual temperature.  The MERRA2 preprocessing carried out the VIRTMP conversion a second time.  A program to scan the input file to determine if the VIRTMP processing had already been done was added to the preprocessing QC, and the MERRA2 run was wound back to 1 June 2021. Note that between 12/29/2020 and 5/31/2021 the screening program would need to be disabled and virtual temperature calculated a second time if one wished to reproduce the MERRA2 results.  Or, just use the already processed prepbufr file from after the prepQC archived from MERRA2 as input instead of redoing the preprocessing.
-===ASCAT (20090301-recent)===
+===ASCAT (20080301-recent)===
-* from ASCATW (bufr files needs to be processed (~msienkie/ascat/prepdata; historical data were processed by DM, realtime-it will be part of preprocessing)
+* from ASCATW (bufr files needs to be processed (~msienkie/ascat/prepdata; historical data were processed by DM (from 20090301), realtime-it will be part of preprocessing)
 * gap in September 2010 was originally filled from ASCATT format by MS)
-* adding data from prior 2009? (WM??)
+* adding data prior 2009 (WM)
-* need to add real-time preprocessing!
+* real-time preprocessing (YK)
@@ Line 45: / Line 46: @@
 ** (Jul10-recent): ftp://stratus.ssec.wisc.edu/pub/winds/archive
 ** need to add real-time preprocessing!
+* additional source: NESDIS via NCEP
+** operational AVHRR in gdas satwnd files from 20150115 06z onward, from time of GOES hourly wind introduction
+** operational AVHRR was intended to be removed from time-windowed satwind BUFR files, but that version of the time-windowing software somehow didn't make it into ops
+** operational AVHRR no longer in time-windowed files after 20150520 00z (ops time-windowing software updated to take out EUMETSAT WV winds to reduce data count)
 ===SATWINDS (Atmospheric Motion Vectors)===
@@ Line 54: / Line 59: @@
 *ERS1 (19910805-19960525) lots of short gaps
 ** exclude 06z Aug 24, 1992 (hurricane Andrew); in original MERRA this set of winds had negative impact
-*ERS2 (20030813-20110329) new version of data
+*The re-processing of ERS-2 data from 1997-2003.
-**The re-processing of ers-2 runs from from 1997-2003.  The three available formats of the re-processed data are:
+** 19970520_00z-20030217_18z
+**  The three available formats of the re-processed data are:
 *** ERS.ASPS.UWI  (re-processed data in UWI format for compatability with the real-time product)
 *** ERS.ASPS20.N  (re-processed data in ASPS format: nominal resolution 50km)
 *** ERS.ASPS20.H  (re-processed data in ASPS format: high resolution 25km)
 ** We are processing ERS.ASPS20.N.  For this data, lets give a filename like:   ers2_asps20n.YYYYMMDD.tHHz.bufr
+*ERS2 (20030813-20110329) new version of data
 ** For the period from 2003 through the end, we have the fast delivery product (WSC.UWI).
@@ Line 86: / Line 93: @@
 *data after 20080731 from NCEP
 *(19920510-20080731)(excluded from cdas and cdas0)
+* Funding for NPN was  eliminated (2014) within the continental United States and data will cease, [http://www.nws.noaa.gov/om/notification/scn14-36wind_profilers.htm more] ...
 ==NO-preQC data==
 ===tcvitals===
-* (1980-present)
+* (19790101-present)
 * data prior 2006 from Jack Woolen (added Nov2013)
@@ Line 105: / Line 112: @@
 * 19980101-present
 * Separate streams for land and ocean
+* TRMM TMI Level 2A Hydrometeor Profile Product 2A12
+* version 6  prior to 2011-07-01, version 7 afterward
+* data is superobed on a one-degree lat/lon grid
 ===GPS Radio Occultation===
 *20010501-20071214 (from Jack Woollen:gps data starting in 2002 is from the CHAMP instrument, reprocessed by the Boulder folks. Reprocessed COSMIC starts in around 2006)
 *20071215-present
+* Noting end dates of some GPS data types:  C/NOFS ~2013/06/05  SAC-C ~2011/08/02
 ==Radiances==
+* 0 after the name of instrument (6th column) - data not used
 ===GOES Sounder===
-*20010424-20071204
+* data available from 20010424-20071204
 ** 5x5 averaged in goesnd.* files
 *** old prepbufr file - but the input is no longer through prep stream
-*20070222-present
+*high resolution stream 20070222-present
 ** 1x1 single FOVs in *goesfv* files
 * Control of usage set in satinfo_db
 **   Switch occurs on 20070401_00z in MERRA2
-* notes from satinfo:
+* notes from satinfo database:
 **  31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond
 ***                     - off chn all sndr-g12
@@ Line 133: / Line 145: @@
 ***                 Note: GOES-15 replaces GOES-11 as operational 12/6/2011 15z
 ***                    Need to check when these data start in the 'goesfv' dumps & when/if we want to turn these on in the database.
-** 29Oct2013 Todling/(per Sienkiewicz) - turn GEOS-13 back on from 20090101 on.
+** 29Oct2013 Todling/(per Sienkiewicz) - turn GOES-13 back on from 20090101 on.
+** 20Nov2015 GOES-13 Sounder anomaly - end of GOES-13 Sounder data
+**  3Mar2020 GOES-15 Sounder data ends in operational stream.  No sounder on GOES-R (GOES-16, GOES-17 satellites)
+**
 * g08
 **  19940413 000000  20030401 240000  sndr  11  1 2 3 4 5 6 7 8   10 11 12
@@ Line 206: / Line 221: @@
 *
 **m09  20120213 000000  29991231 240000  seviri 0
-**m09  20120213 000000  29991231 240000  seviri 2    2 3
+**m09  20120213 000000  29991231 240000  seviri 2     2 3
-**m10  20130121 120000  29991231 240000  seviri 2    2 3
+**m10  20130121 120000  29991231 240000  seviri 2     2 3
-===TOVS/ATOVS data===
+===AMSU-A===
-====AMSU-A====
 * 19981101-present
 * 31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond
@@ Line 221: / Line 235: @@
 **  19990101 120000  20001029 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14               #
 **  20001030 000000  20020331 240000  amsua 10        4 5 6 7 8 9 10 11 12 13                  # amsua: bad ch14 (ch11?)
-**  20020401 000000  21001231 240000  amsua  9        4 5 6 7 8 9 10    12 13                  # amsua: bad ch11 & ch14
+**  20020401 000000  20151008 240000  amsua  9        4 5 6 7 8 9 10    12 13                  # amsua: bad ch11 & ch14
+**  20151009 000000  21001231 240000  amsua  6              7 8 9 10    12 13                  # amsua: bad ch 6, ch4 & ch5 disabled; QC is a function of Ch6
 * NOAA-16 (ncep amsua ch9-14 turned off (currently))
 **  20010101 000000  20010110 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14               #
@@ Line 244: / Line 259: @@
 ** n19  20090414 000000  20091215 060000  amsua 11        4 5 6 7 8 9 10 11 12 13 14               # M2: redundant entry intentional.  Observations exist prior to MERRA(1) start date.  Will attempt to assimilate.  This should be set to inactive should an issue arise (wm)
 **  20091215 120000  20091221 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14               #
-**  20091222 000000  21001231 240000  amsua 10        4 5 6 7   9 10 11 12 13 14               #  ch8 noisy (noise started on 12/21/2009)
+**  20091222 000000  20140128 240000  amsua 10        4 5 6 7   9 10 11 12 13 14               #  ch8 noisy (noise started on 12/21/2009)
-* METOP-A
+**  20140129 000000  20200926 240000  amsua  9        4 5 6     9 10 11 12 13 14               #  per NCEP r35918
+**  20200927 000000  21001231 240000  amsua  8        4 5 6     9 10    12 13 14               #  Channel 11 calibration issues
+*Aqua
+** 31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond - off chn 1-5;14-15 amsua-aqua
+**  20021012 000000  20071102 120000  amsua  10        4 5 6   8 9 10 11 12 13 14
+**  20071102 180000  21001231 240000  amsua   8            6   8 9 10 11 12 13 14               # ch4 noisy; QC affected ; turn off ch1-5
+* METOP-A
 ** 20070521 000000  20090115 060000  amsua 11        4 5 6 7 8 9 10 11 12 13 14            #
 ** 20090115 120000  21001231 240000  amsua 10        4 5 6   8 9 10 11 12 13 14            # ch7 noisy
 * METOP-B
-** # 20130213 000000  21001231 240000  amsua  0                                              # Currently on @ NCEP, commented out pending
+** 20130213 000000  21001231 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14            # active for e512a_rt-parallel testing
-** # 20130213 000000  21001231 240000  amsua 11        4 5 6 7 8 9 10 11 12 13 14            # pending testing (20 Nov 13)
-====AMSU-B====
+===AMSU-B===
 * 19981101-present
 * 31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond - off chn 4   amsub-n15
 * NOAA-15
 **  19981101 000000  20060216 000000  amsub  5  1 2 3 4 5                                      #
-**  20060216 060000  20110328 060000  amsub  4  1 2 3   5                                      # ch4 noisy
+**  20060216 060000  20110328 060000  amsub  0                                                 # ch4 noisy, all ch off
 **  20110328 120000  20110328 240000  amsub  0                                                 # amsub: scan motor failed
 * NOAA-16
 **  20001105 000000  20001231 240000  amsub  5  1 2 3 4 5                                      # M2: redundant entry intentional.  Observations exist prior to MERRA(1) start date.  Will attempt to assimilate.  This should be set to inactive should an issue arise (wm)
-**  20010101 000000  20100514 240000  amsub  5  1 2 3 4 5                                      #
+**  20010101 000000  20090416 240000  amsub  5  1 2 3 4 5                                      #
-**  20100515 000000  21001231 240000  amsub  0                                                 # amsub: noisy since 20100316
+**  20090416 000000  21001231 240000  amsub  0                                                 # amsub: noisy since 20090416 (end date moved back to corresp. to Keyser's history)
 * NOAA-17
 **  20020715 000000  20091222 120000  amsub  5  1 2 3 4 5                                      #
 **  20091222 180000  20130420 240000  amsub  0                                                 # amsub: ch3-5 noisy; turn off all
-====HIRS2====
+===HIRS2===
 * 19781101-20060930
 * turned off HIRS2 chns 13 & 14 (for consistency w/ what was done w/ HIRS3/4)
@@ Line 279: / Line 300: @@
 **  19790702 000000  19790712 240000  hirs2  0                                        # hirs2: unstable
 ** 19790713 000000  19830417 060000  hirs2 10    2 3 4 5 6 7 8   10 11 12             #
-** 19850408 000000  19861117 240000  hirs2  0                                         # hirs2: none
 * NOAA-07
 ** 19810711 000000  19850204 240000  hirs2 10    2 3 4 5 6 7 8   10 11 12             #
@@ Line 285: / Line 305: @@
 * NOAA-08
 **  19830426 000000  19840620 240000  hirs2 10    2 3 4 5 6 7 8   10 11 12             #
-**  19850701 000000  19851014 240000 hirs2   0                                         # hirs2: none
+**  19850701 000000  19851014 240000  hirs2   0                                         # hirs2: none
 * NOAA-09
 **  19850101 000000  19850202 240000  hirs2  0                                         # hirs2: calibration problems (ch7 bad)
@@ Line 306: / Line 326: @@
 **  20060930 000000  20070523 240000  hirs2  0                                         # end of record
-====HIRS3====
+===HIRS3===
 * 19980721-present
 * 19Jul2012 Todling - turned off channel 9 from HIRS3 and 4 (per Pawson's)
@@ Line 331: / Line 351: @@
 **  20111204 000000  20120828 240000  hirs3  0                                                 # hirs: noise jump ch1-5,12
-====HIRS4====
+===HIRS4===
 * 20090401-present
 * 07Sep2013 Todling  - turned off HIRS3/4 chs 13 and 14 (Joa>Job)
@@ Line 346: / Line 366: @@
 ** metop-b 20130213 000000  21001231 240000  hirs4  0     # not currently assimilated @ NCEP (20 Nov 13) for all channels will be impared, so disable all
-====MSU====
+===MSU===
 * 19781101-20061010
 * 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond - off chn all msu-n14
@@ Line 376: / Line 396: @@
 **  19871012 120000  19871012 120000  msu    0                                         # msu: all channels noisy
 **  19871012 180000  19910901 240000  msu    3    2 3 4                                #
+* NOAA-11
+**  19881108 000000  19890315 240000  msu    3    2 3 4                #
+**  19890316 000000  19890416 240000  msu    2    2   4                # msu: ch3 noisy
+**  19890417 000000  19930707 000000  msu    3    2 3 4                #
+**  19930707 060000  19930707 060000  msu    0                     # msu: all channels noisy
+**  19930707 120000  19950410 240000  msu    3    2 3 4                #
+**  19970715 000000  19990225 240000  msu    3    2 3 4                                #
+**  19990226 000000  19990227 240000  msu    0
 * NOAA-12
 **  19910818 000000  19930707 240000  msu    3    2 3 4                                #
@@ Line 389: / Line 417: @@
 **  19950501 000000  20061010 240000  msu    3    2 3 4                                #
-====MHS====
+===MHS===
 * 20051101-present
 * NOAA-18
 **  20051101 000000  21001231 240000  mhs    5  1 2 3 4 5                                      #
 * NOAA-19
-*n19  20090414 120000  21001231 240000  mhs    0
+**  20090414 120000  21001231 240000  mhs    0
 * METOP-A
-** 20070521 000000  21001231 240000  mhs    5  1 2 3 4 5              #
+** 20070521 000000  20191101 240000  mhs    5  1 2 3 4 5              #
+** 20191102 000000  21001231 240000  mhs    0                         # ch 2 noisy, turn off instrument
 * METOP-B
-**metop-b 20130213 000000  21001231 240000  mhs    0                                              # Currently on @ NCEP, commented out pending testing (20 Nov 13, ch 1 2 3 4 5)
+** 20130213 000000  21001231 240000  mhs    5  1 2 3 4 5                              # active for e512a_rt-parallel testing
-====SSU====
+===SSU===
 * 19781101-20060505
 * 24Nov2013 McCarty  - adjust startdate of n06_ssu to correspond w/ reference date within CRTM coefficents and avoid mass error messages prior to 02 July 1979
@@ Line 406: / Line 435: @@
 **  19781201 000000  19810204 240000  ssu    2  1 2                                 # ssu: ch3 unusable
 **  19810205 000000  19810227 240000  ssu    0                                      # ssu: all channels noisy, unknown reason
 * NOAA-06
+**  no data between 19810327-19810407 >> no radiance data at all during this period
 **  19790702 000000  19830417 240000  ssu    3  1 2 3                                  #
 **  19850408 000000  19861117 240000  ssu    3  1 2 3                                  #
@@ Line 418: / Line 448: @@
 **  19830914 000000  19840620 240000  ssu    2  1 2                                    # ssu: ch3 failure (instrument malfunction)
 **  19850701 000000  19851014 240000 ssu     0                                         # ssu: ch1 malfunction & ch3 failure
 * NOAA-09
 **  19850101 000000  19850323 240000  ssu    2  1 2                                    # ssu: ch3 unusable
@@ Line 433: / Line 462: @@
 ===IASI===
-* 20080916_18z-present
+* METOP-A
+* 20080801_00z-present
 * 17Jun2011 Sienkiewicz  Remove IASI channels sensitive to o3 as suggested by Will McCarty
-* METOP-A
+**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/iasi-a-channels.png  IASI active channels]
+* 11Sep2021 Sienkiewicz IASI MetOp-A turned off due to instrument instability (due to tests carried out at end of mission)
-===Metop-AMSU-A===
+* METOP-B
-* 20080916_18z-present
+* 200130213_00z-present
-*
+**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/iasi-b-channels.png  IASI active channels]
 ===AIRS===
@@ Line 447: / Line 477: @@
 * The original record is shown here:
 * aqa 124 20021012 000000  21001231 240000  airs  152  3 6 9:11 13:14 18 21 29 31 44:47 49 50 52:53 55:57 59:68 70 72:73 75:78 80:81 83:130 166:223 225:229
 * Without offending moisture, and a few temp, channels (per NCEP)
 * aqa 124 20021012 000000  21001231 240000  airs  121  3 6 9:11 13:14 18 21 29 31 44:47 49 50 52:53 55:57 59:68 70 72:73 75:78 80:81 83:107 109:117 119:126 128:130 166:174 176:178 180:182 186 190 193 202 208 212 215:223 225:229
+**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/airs-channels.png  AIRS active channels]
-===Aqua-AMSU-A===
-* 20021012_00z-present
-* 31Mar2009 Todling  The following changes made to mimic NCEP choices for 200901 and beyond - off chn 1-5;14-15 amsua-aqua
-**  20021012 000000  20071102 120000  amsua  10        4 5 6   8 9 10 11 12 13 14
-**  20071102 180000  21001231 240000  amsua   8            6   8 9 10 11 12 13 14                          # ch4 noisy; QC affected ; turn off ch1-5
 ===ATMS===
@@ Line 465: / Line 488: @@
 ===CrIS===
-* 20120406-present
+* 20120406-20190618  turned off after midband failure.
 * 02Nov2012 Todling/McCarty - turned off channels 1-5 of ATMS/CrIS for consistency w/ AMSUA deal
+**[https://gmao.gsfc.nasa.gov/intranet/personnel/dmerkova/misc/cris-channels.png  CrIS active channels to 20120731]
+* A number of channels were turned off on 20120801 - note that in reanalysis these channels should be turned off at the start
+**[https://gmao.gsfc.nasa.gov/intranmet/personnel/msienkiewicz/M2cris-channels20120801.png CrIS active channels after 20120801]
 ===SSMI===
@@ Line 485: / Line 511: @@
 ===SSMI/S===
 * 20110228_00z-present
 ==Ozone data==
@@ Line 499: / Line 524: @@
 == Additional information==
-A.C.(internal link) [https://gmao.gsfc.nasa.gov/intranet/science/gms/all_about_obs/]
+A.C. (Austin Conaty) (internal link) [https://gmao.gsfc.nasa.gov/intranet/science/gms/all_about_obs/]
+DM Dagmar Merkova
+MS Meta Sienkiewicz
+YK Yelena Kondratyeva
+WM Will McCarty
+JW Jack Woolen