MERRA2 InputData

From GEOS-5
Revision as of 07:42, 16 January 2014 by Dmerkova (talk | contribs) (→SEVIRI)
Jump to navigation Jump to search

Input Data Information This is a page to keep information about input data (source, processing, gaps and known issues).


Conventional data pre-QC

PREPBUFR

  • RADCOR=HAIMB_HRAD
  • cdas0 (1979-2000)
    • data from Jack Woolen; recieved 2013 (1979-1997 reprocessed data, 1997-1998 pulled additional files from CFSRR)
      • updates to METEOSAT AMV (early reprocessed 82-87) JW
      • updates to ADPSFC (data types 181 and 183 separated before 1998) JW
      • 1982-2000 added Vaisala correction (from original files processed by Chris Redder, adpupa_fixvai)(DM)
      • exclusion of NPN profiles data (we have separate files for npn profiler from UCAR) (DM)
  • cdas (2001-present)
    • data from Jack Woolen for original MERRA
      • Vaisala correction (Chris Redder)
      • NPN profiler excluded until 20080731 (profiler obs file) (except station in Pacific and Europe that have the same kx 223)
  • PAOB data 19790101-20100817
  • SATWND data in prepbufr until 20100701 (after in bufr format file)
  • GMS WV satwinds (KX=250) in prepbufr files are passive (missing obs. error). This is necessary because GMS WV satwinds in prepbufr format do not have information needed to distinguish between cloud-top and deep layer WV winds, and we are not able to turn on only cloud-top winds as we do for the winds from the satwind dump bufr format file.
  • TAMDAR data - correction of KX
    • in sweeper b5122_m2swp_jan10 run Meta found that few of the aircraft data had missing staion ID: "in our current configuration we can not do anything different for these winds, because they have been misidentified as other aircraft types (kx=130/230 AIREP/PIREP and kx=131/231 AMDAR)"
    • fix code: NCEP_Paqc/modify_bufr/fix_tamdar.f (correction of kx and screen them out)
  • Atlantic anomaly in 79-80 -the same issue in MERRA ([1]) ????

ASCAT (20090301-recent)

  • from ASCATW (bufr files needs to be processed (~msienkie/ascat/prepdata; historical data were processed by DM, realtime-it will be part of preprocessing)
  • gap in September 2010 was originally filled from ASCATT format by MS)
  • adding data from prior 2009? (WM??)
  • need to add real-time preprocessing!


AVHRR polar winds (1982-recent)

SATWINDS (Atmospheric Motion Vectors)

  • switch from prepbufr to bufr format on Jul1, 2010
  • 1979 GOES - additional AMV from FGGE (First GARP Global Experiment), which ran from Dec. 1978 to Nov. 1979. There should be AMVs from GOES East and West, Meteosat-1, GMS-1, and GOES Indian Ocean. The winds were produced here at UW-Madison, using manually tracking (from Dave Santek,CIMSS).
  • 20130121 - METEOSAT AMV's (kx=243) switch to METEOSAT 10 (id=57)

ERS scatterometer

  • ERS1 (19910805-19960525) lots of short gaps
    • exclude 06z Aug 24, 1992 (hurricane Andrew); in original MERRA this set of winds had negative impact
  • ERS2 (20030813-20110329) new version of data
    • The re-processing of ers-2 runs from from 1997-2003. The three available formats of the re-processed data are:
      • ERS.ASPS.UWI (re-processed data in UWI format for compatability with the real-time product)
      • ERS.ASPS20.N (re-processed data in ASPS format: nominal resolution 50km)
      • ERS.ASPS20.H (re-processed data in ASPS format: high resolution 25km)
    • We are processing ERS.ASPS20.N. For this data, lets give a filename like: ers2_asps20n.YYYYMMDD.tHHz.bufr
    • For the period from 2003 through the end, we have the fast delivery product (WSC.UWI).

QuikSCAT Data

  • data from JPL (19990719-20091122; MS added 2003,2004)

SSMI Wind Speed

  • updated to Wentz Version 7 (19870709_00z-present)
    • F08 SSM/I Jul 1987 Dec 1991
    • F10 SSM/I Dec 1990 Nov 1997
    • F11 SSM/I Dec 1991 May 2000
    • F13 SSM/I May 1995 Nov 2009
    • F14 SSM/I May 1997 Aug 2008
    • F15 SSM/I Dec 1999 present (do not use after Aug 2006 for climate study)
    • F16 SSMIS Oct 2003 present
    • F17 SSMIS Dec 2006 present
    • F18 SSMIS Oct 2009 present


Modis

  • data processed from CIMSS (YK); experimental data before NESDIS was processing data and they were part of SATWIND prepbufr
  • 20020701-20040708
  • 20040709-20040930


NPN Profiler

  • data 19920510-20080731 from UCAR, gaps filled from original Jack Woolen's cdas files in period 20060101-20080731
  • data after 20080731 from NCEP
  • (19920510-20080731)(excluded from cdas and cdas0)


NO-preQC data

tcvitals

  • (1980-present)
  • data prior 2006 from Jack Woolen (added Nov2013)


SSMI Rain Rates

  • GPROF data
  • F08 - 19870709_00z-19900226_18z
  • F10 - 19910105_00z-19971115_18z
  • F11 - 19920101_00z-19961130_18z
  • F13 - 19950503_00z-20090916_18z
  • F14 - 19970508_00z-20080824_18z


TRMM TMI Rain Rates

  • 19980101-present
  • Separate streams for land and ocean


GPS Radio Occultation

  • 20010501-20071214 (from Jack Woollen:gps data starting in 2002 is from the CHAMP instrument, reprocessed by the Boulder folks. Reprocessed COSMIC starts in around 2006)
  • 20071215-present


Radiances

GOES Sounder

  • 20010424-20071204
    • 5x5 averaged in goesnd.* files
      • old prepbufr file - but the input is no longer through prep stream
  • 20070222-present
    • 1x1 single FOVs in *goesfv* files
  • Control of usage set in satinfo_db
    • Switch occurs on 20070401_00z in MERRA2


SEVIRI

  • 20120215-present
    • m09 20120213 000000 29991231 240000 seviri 0
    • m09 20120213 000000 29991231 240000 seviri 2 2 3
    • m10 20130121 120000 29991231 240000 seviri 2 2 3

TOVS/ATOVS data

AMSU-A

  • 19981101-present

AMSU-B

  • 19981101-present

HIRS2

  • 19781101-20060930
  • turned off HIRS2 chns 13 & 14 (for consistency w/ what was done w/ HIRS3/4)
  • turned off HIRS2/3/4 chn 9 (oz-sensitive); and 15 from L. Coy studies
  • TIROS-N
    • 19781021 000000 19781231 240000 hirs2 0 # hirs2: unreliable for the first few months
    • 19790101 000000 19800120 240000 hirs2 8 2 3 6 7 8 10 11 12 # hirs2: ch4 & ch5 unstable
    • 19800121 000000 19810227 240000 hirs2 0 # hirs2: all channels from 19800127 -change behavior after data gap
  • NOAA-06
    • 19790702 000000 19790712 240000 hirs2 0 # hirs2: unstable
    • 19790713 000000 19830417 060000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 19850408 000000 19861117 240000 hirs2 0 # hirs2: none
  • NOAA-07
    • 19810711 000000 19850204 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 19850205 000000 19850206 240000 hirs2 0 # hirs2: instrument failure
  • NOAA-08
    • 19830426 000000 19840620 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 19850701 000000 19851014 240000 hirs2 0 # hirs2: none
  • NOAA-09
    • 19850101 000000 19850202 240000 hirs2 0 # hirs2: calibration problems (ch7 bad)
    • 19850203 000000 19860930 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 19861001 000000 19881107 240000 hirs2 8 4 5 6 7 8 10 11 12 # hirs2: ch1 & ch2 & ch3 stripping
  • NOAA-10
    • 19861125 000000 19910901 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • NOAA-11
    • 19881012 000000 19941204 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 19970715 000000 19990228 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • NOAA-12
    • 19910818 000000 19911224 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 19911125 000000 19920307 240000 hirs2 0 # hirs2: instrumental problems
    • 19920308 000000 19930609 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 19930610 000000 19930618 240000 hirs2 0 # hirs2: all channels noisy
    • 19930619 000000 19970714 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • NOAA-14
    • 19950119 000000 19950430 240000 hirs2 0 # hirs2: unstable
    • 19950501 000000 20060930 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
    • 20060930 000000 20070523 240000 hirs2 0 # end of record

HIRS3

  • 19980721-present
  • 19Jul2012 Todling - turned off channel 9 from HIRS3 and 4 (per Pawson's)
  • 07Sep2013 Todling - turned off HIRS3/4 chs 13 and 14 (Joa>Job)
  • 20Sep2013 Todling - turned off HIRS2 chns 13 & 14 (for consistency w/ what was done w/ HIRS3/4)
  • 7May2013 Sienkiewicz - no reference to n16 HIRS before 20010216 00 - don't even process as passive so as to avoid lots of error messages
  • NOAA-15
    • 19980702 000000 19981006 000000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 19981006 060000 19981006 060000 hirs3 0 # hirs3: noisy
    • 19981006 120000 19990302 000000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 19990302 060000 19990302 060000 hirs3 0 # hirs3: all noisy
    • 19990302 120000 20000218 240000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 20000219 000000 20000220 240000 hirs3 0 # hirs3: all noisy
    • 20000221 000000 20000606 240000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 20000607 000000 20090602 240000 hirs3 0 # hirs3: all noisy due to filter wheel problems
  • NOAA-16
    • 20001105 000000 20010215 240000 hirs3 0
    • 20010216 000000 20020405 060000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 20020405 120000 20020405 120000 hirs3 0 # hirs3: all noisy
    • 20020405 180000 20040520 240000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 20040521 000000 21001231 240000 hirs3 0 # hirs3: most channels noisy
  • NOAA-17
    • 20020625 000000 20111203 240000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
    • 20111204 000000 20120828 240000 hirs3 0 # hirs: noise jump ch1-5,12

HIRS4

  • 20090401-present
  • 07Sep2013 Todling - turned off HIRS3/4 chs 13 and 14 (Joa>Job)
  • 20Sep2013 Todling - turned off HIRS2/3/4 chn 9 (oz-sensitive); and 15 from L. Coy studies
  • NOAA-18
    • 20051101 000000 21001231 240000 hirs4 0 # hirs4: most IR channels erratic quality
  • NOAA-19
    • 20090414 000000 20091215 060000 hirs4 10 2 3 4 5 6 7 8 10 11 12 # M2: redundant entry intentional. Observations exist prior to MERRA(1) start date. Will attempt to assimilate. This should be set to inactive should an issue arise (wm)
    • 20091215 120000 20130705 240000 hirs4 10 2 3 4 5 6 7 8 10 11 12 #
    • 20130706 000000 21001231 240000 hirs4 0 # sounding channels noise increase - cloud screening
  • METOP-A
    • 20070521 000000 21001231 240000 hirs4 10 2 3 4 5 6 7 8 10 11 12 #
  • METOP-B
    • metop-b 20130213 000000 21001231 240000 hirs4 0 # not currently assimilated @ NCEP (20 Nov 13) for all channels will be impared, so disable all

MSU

  • 19781101-20061010
  • 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond - off chn all msu-n14
  • 15Nov2013 McCarty - removed MSU ch1 (for consistency w/ AMSUA)
  • TIROS-N
    • 19781021 000000 19790625 240000 msu 3 2 3 4 #
    • 19790626 000000 19810227 240000 msu 0 # msu: all msu channels from 19790626 -change behavior
  • NOAA-06
    • 19790630 000000 19790906 060000 msu 3 2 3 4 #
    • 19790906 120000 19790906 120000 msu 0 # msu: all channels noisy, unknown reason
    • 19790906 180000 19830417 240000 msu 3 2 3 4 #
    • 19850408 000000 19851031 240000 msu 3 2 3 4 #
    • 19851101 000000 19861117 240000 msu 2 2 4 # msu: ch3 failure
  • NOAA-07
    • 19810628 000000 19840721 060000 msu 3 2 3 4 #
    • 19840721 120000 19840721 120000 msu 0 # msu: all noisy
    • 19840721 180000 19850207 240000 msu 3 2 3 4 #
    • 19850208 000000 19850208 060000 msu 0 # msu: instrument failure
    • 19850208 120000 19850218 240000 msu 3 2 3 4 #
  • NOAA-08
    • 19830426 000000 19840620 240000 msu 3 2 3 4 #
    • 19850701 000000 19851014 240000 msu 0 # data not in original MERRA, will monitor and potentially turn on. Notes say satellite has an attitude problem.
  • NOAA-09
    • 19850101 000000 19861024 240000 msu 3 2 3 4 #
    • 19861025 000000 19870307 240000 msu 2 2 4 # msu: ch3 failure
    • 19870308 000000 19881107 240000 msu 0 # msu: all failure
  • NOAA-10
    • 19861125 000000 19871012 060000 msu 3 2 3 4 #
    • 19871012 120000 19871012 120000 msu 0 # msu: all channels noisy
    • 19871012 180000 19910901 240000 msu 3 2 3 4 #
  • NOAA-12
    • 19910818 000000 19930707 240000 msu 3 2 3 4 #
    • 19930708 000000 19930709 240000 msu 0 # msu: all channels noisy
    • 19930710 000000 19950228 240000 msu 3 2 3 4 #
    • 19950301 000000 19950301 240000 msu 0 # msu: all channels noisy
    • 19950302 000000 19970324 000000 msu 3 2 3 4 #
    • 19970324 060000 19970324 060000 msu 0 # msu: all channels noisy
    • 19970324 120000 19970523 240000 msu 3 2 3 4 #
    • 19970524 000000 19981214 240000 msu 0 # msu: unreliable
  • NOAA-14
    • 19950119 000000 19950430 240000 msu 0 # msu: unstable
    • 19950501 000000 20061010 240000 msu 3 2 3 4 #

MHS

  • 20051101-present
  • NOAA-18
    • 20051101 000000 21001231 240000 mhs 5 1 2 3 4 5 #
  • NOAA-19
  • n19 20090414 120000 21001231 240000 mhs 0
  • METOP-A
    • 20070521 000000 21001231 240000 mhs 5 1 2 3 4 5 #
  • METOP-B
    • metop-b 20130213 000000 21001231 240000 mhs 0 # Currently on @ NCEP, commented out pending testing (20 Nov 13, ch 1 2 3 4 5)

SSU

  • 19781101-20060505
  • 24Nov2013 McCarty - adjust startdate of n06_ssu to correspond w/ reference date within CRTM coefficents and avoid mass error messages prior to 02 July 1979
  • TIROS-N
    • 19781201 000000 19810204 240000 ssu 2 1 2 # ssu: ch3 unusable
    • 19810205 000000 19810227 240000 ssu 0 # ssu: all channels noisy, unknown reason
  • NOAA-06
    • 19790702 000000 19830417 240000 ssu 3 1 2 3 #
    • 19850408 000000 19861117 240000 ssu 3 1 2 3 #
  • NOAA-07
    • 19810711 000000 19830630 240000 ssu 3 1 2 3 #
    • 19830701 000000 19850204 000000 ssu 2 1 3 # ssu: ch2 calibration invalid
    • 19850204 060000 19850204 060000 ssu 0 # ssu: ch2 calibration invalid; all channels noisy
    • 19850204 120000 19850218 240000 ssu 2 1 3 # ssu: ch2 calibration invalid
  • NOAA-08
    • 19830426 000000 19830913 240000 ssu 3 1 2 3 #
    • 19830914 000000 19840620 240000 ssu 2 1 2 # ssu: ch3 failure (instrument malfunction)
    • 19850701 000000 19851014 240000 ssu 0 # ssu: ch1 malfunction & ch3 failure
  • NOAA-09
    • 19850101 000000 19850323 240000 ssu 2 1 2 # ssu: ch3 unusable
    • 19850324 000000 19881107 240000 ssu 3 1 2 3 # ssu: ch3 ok
  • NOAA-11
    • 19880928 000000 19941231 240000 ssu 3 1 2 3 #
    • 19970715 000000 19981031 240000 ssu 3 1 2 3 #
    • 19981101 000000 19990225 240000 ssu 3 1 2 # Ch. 3 disabled to be consistent w/ N14 change below. Disable Ch3 at start of AMSU-A record
    • 19990226 000000 20040615 240000 ssu 0 # SSU data held passive. This may be worth reevaluating in M2 scout run.
  • NOAA-14
    • 19950119 000000 19981031 240000 ssu 3 1 2 3 #
    • 19981101 000000 20060504 240000 ssu 2 1 2 # ssu: ch3 inconsistent with noaa-15 amsu-a ^^^ - original comment from db. Implemented on19990703 in MERRA. Due to lack of info and no clear signature, this change was extended to start of AMSU-A period.
    • 20060505 000000 20060505 240000 ssu 0 # ssu: turned off due to low battery voltages

IASI

  • 20080916_18z-present
  • 17Jun2011 Sienkiewicz Remove IASI channels sensitive to o3 as suggested by Will McCarty
  • METOP-A

Metop-AMSU-A

  • 20080916_18z-present

AIRS

  • 20021012_00z-present
  • 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond -off chn 1545 airs-aqua
  • airs active channel total = 152 01 02 03 04 05 06 07 08 09 10
  • The original record is shown here:
  • aqa 124 20021012 000000 21001231 240000 airs 152 3 6 9:11 13:14 18 21 29 31 44:47 49 50 52:53 55:57 59:68 70 72:73 75:78 80:81 83:130 166:223 225:229
  • Without offending moisture, and a few temp, channels (per NCEP)
  • aqa 124 20021012 000000 21001231 240000 airs 121 3 6 9:11 13:14 18 21 29 31 44:47 49 50 52:53 55:57 59:68 70 72:73 75:78 80:81 83:107 109:117 119:126 128:130 166:174 176:178 180:182 186 190 193 202 208 212 215:223 225:229

Aqua-AMSU-A

  • 20021012_00z-present
  • 31Mar2009 Todling The following changes made to mimic NCEP choices for 200901 and beyond - off chn 1-5;14-15 amsua-aqua
    • 20021012 000000 20071102 120000 amsua 10 4 5 6 8 9 10 11 12 13 14
    • 20071102 180000 21001231 240000 amsua 8 6 8 9 10 11 12 13 14 # ch4 noisy; QC affected ; turn off ch1-5

ATMS

  • 20111116-present


CrIS

  • 20120406-present


SSMI

  • Wentz version 7(processing YK)
  • f08 85V channel (7) getting very bad mid 1988, unusable after 1/1989
  • f08 85H channel (6) going bad Mar-Nov 1990, unusable after 1/1991
    • f08 19870710 000000 19880207 240000 ssmi 7 1 2 3 4 5 6 7
    • f08 19880208 000000 19901231 240000 ssmi 6 1 2 3 4 5 7 # 85V bad
    • f08 19910101 000000 19911204 240000 ssmi 5 1 2 3 4 5 # 85V,H bad
    • f10 19901209 000000 19971113 240000 ssmi 7 1 2 3 4 5 6 7
    • f11 19911205 000000 19991218 240000 ssmi 7 1 2 3 4 5 6 7
    • f13 19950503 000000 20081231 240000 ssmi 7 1 2 3 4 5 6 7
    • f13 20090101 000000 21000531 240000 ssmi 0 # all off per NCEP
    • f14 19970508 000000 20080823 240000 ssmi 7 1 2 3 4 5 6 7
    • f15 19991218 000000 20060814 240000 ssmi 7 1 2 3 4 5 6 7

SSMI/S

  • 20110228_00z-present


Ozone data

SBUV

  • 19781031_00z-20040930_18z (Intentionally not needed (used) past 20040930)

MLS

  • 20041001_00z-present

EOSMLSt

  • 20040813_00z-present


Additional information

A.C.(internal link) [2]

Retrieved from "https://geos5.org/wiki/index.php?title=MERRA2_InputData&oldid=2328"