MERRA2 InputData

Input Data Information This is a page to keep information about input data (source, processing, gaps and known issues).

Conventional data pre-QC

PREPBUFR

• RADCOR=HAIMB_HRAD
• cdas0 (1979-2000)
  • data from Jack Woolen; recieved 2013 (1979-1997 reprocessed data, 1997-1998 pulled additional files from CFSRR)
    • updates to METEOSAT AMV (early reprocessed 82-87) JW
    • updates to ADPSFC (data types 181 and 183 separated before 1998) JW
    • 1982-2000 added Vaisala correction (from original files processed by Chris Redder, adpupa_fixvai)(DM)
    • exclusion of NPN profiles data (we have separate files for npn profiler from UCAR) (DM)
• cdas (2001-present)
  • data from Jack Woolen for original MERRA
    • Vaisala correction (Chris Redder)
    • NPN profiler excluded until 20080731 (profiler obs file) (except station in Pacific and Europe that have the same kx 223)
• PAOB data 19790101-20100817
• SATWND data in prepbufr until 20100701 (after in bufr format file)
• GMS WV satwinds (KX=250) in prepbufr files are passive (missing obs. error). This is necessary because GMS WV satwinds in prepbufr format do not have information needed to distinguish between cloud-top and deep layer WV winds, and we are not able to turn on only cloud-top winds as we do for the winds from the satwind dump bufr format file.
• TAMDAR data - correction of KX
  • in sweeper b5122_m2swp_jan10 run Meta found that few of the aircraft data had missing staion ID: "in our current configuration we can not do anything different for these winds, because they have been misidentified as other aircraft types (kx=130/230 AIREP/PIREP and kx=131/231 AMDAR)"
  • fix code: NCEP_Paqc/modify_bufr/fix_tamdar.f (correction of kx and screen them out)
• Atlantic anomaly in 79-80 -the same issue in MERRA ([1]) ????

ASCAT (20090301-recent)

• from ASCATW (bufr files needs to be processed (~msienkie/ascat/prepdata; historical data were processed by DM, realtime-it will be part of preprocessing)
• gap in September 2010 was originally filled from ASCATT format by MS)
• adding data from prior 2009? (WM??)
• need to add real-time preprocessing!

AVHRR polar winds (1982-recent)

• source: CIMSS
• obs. errors table in prepobs_errtable.global added (copy of modis ir amv's obs errors)
• ascii to prepbufr (code YK,processed DM)
  • (82-Sep09): ftp://stratus.ssec.wisc.edu/pub/winds/histavhrr/newversion
  • (Oct09-Jun10): ftp://stratus.ssec.wisc.edu/pub/winds/archive
• no observation for 12z and 18z between 20091223-10100103
• bufr format (code WC, processed DM)
  • 20100701 we switch to bufr format for all AMV
  • (Jul10-recent): ftp://stratus.ssec.wisc.edu/pub/winds/archive
  • need to add real-time preprocessing!

SATWINDS (Atmospheric Motion Vectors)

• switch from prepbufr to bufr format on Jul1, 2010
• 1979 GOES - additional AMV from FGGE (First GARP Global Experiment), which ran from Dec. 1978 to Nov. 1979. There should be AMVs from GOES East and West, Meteosat-1, GMS-1, and GOES Indian Ocean. The winds were produced here at UW-Madison, using manually tracking (from Dave Santek,CIMSS).
• 20130121 - METEOSAT AMV's (kx=243) switch to METEOSAT 10 (id=57)

ERS scatterometer

• ERS1 (19910805-19960525) lots of short gaps
  • exclude 06z Aug 24, 1992 (hurricane Andrew); in original MERRA this set of winds had negative impact
• ERS2 (20030813-20110329) new version of data
  • The re-processing of ers-2 runs from from 1997-2003. The three available formats of the re-processed data are:
    • ERS.ASPS.UWI (re-processed data in UWI format for compatability with the real-time product)
    • ERS.ASPS20.N (re-processed data in ASPS format: nominal resolution 50km)
    • ERS.ASPS20.H (re-processed data in ASPS format: high resolution 25km)
  • We are processing ERS.ASPS20.N. For this data, lets give a filename like: ers2_asps20n.YYYYMMDD.tHHz.bufr
  • For the period from 2003 through the end, we have the fast delivery product (WSC.UWI).

QuikSCAT Data

• data from JPL (19990719-20091122; MS added 2003,2004)

SSMI Wind Speed

• updated to Wentz Version 7 (19870709_00z-present)
  • F08 SSM/I Jul 1987 Dec 1991
  • F10 SSM/I Dec 1990 Nov 1997
  • F11 SSM/I Dec 1991 May 2000
  • F13 SSM/I May 1995 Nov 2009
  • F14 SSM/I May 1997 Aug 2008
  • F15 SSM/I Dec 1999 present (do not use after Aug 2006 for climate study)
  • F16 SSMIS Oct 2003 present
  • F17 SSMIS Dec 2006 present
  • F18 SSMIS Oct 2009 present

Modis

• data processed from CIMSS (YK); experimental data before NESDIS was processing data and they were part of SATWIND prepbufr
• 20020701-20040708
• 20040709-20040930

NPN Profiler

• data 19920510-20080731 from UCAR, gaps filled from original Jack Woolen's cdas files in period 20060101-20080731
• data after 20080731 from NCEP
• (19920510-20080731)(excluded from cdas and cdas0)

NO-preQC data

tcvitals

• (1980-present)
• data prior 2006 from Jack Woolen (added Nov2013)

SSMI Rain Rates

• GPROF data
• F08 - 19870709_00z-19900226_18z
• F10 - 19910105_00z-19971115_18z
• F11 - 19920101_00z-19961130_18z
• F13 - 19950503_00z-20090916_18z
• F14 - 19970508_00z-20080824_18z

TRMM TMI Rain Rates

• 19980101-present
• Separate streams for land and ocean

GPS Radio Occultation

• 20010501-20071214 (from Jack Woollen:gps data starting in 2002 is from the CHAMP instrument, reprocessed by the Boulder folks. Reprocessed COSMIC starts in around 2006)
• 20071215-present

Radiances

GOES Sounder

• 20010424-20071204
  • 5x5 averaged in goesnd.* files
    • old prepbufr file - but the input is no longer through prep stream
• 20070222-present
  • 1x1 single FOVs in *goesfv* files
• Control of usage set in satinfo_db
  • Switch occurs on 20070401_00z in MERRA2

SEVIRI

• 20120215-present

TOVS/ATOVS data

AMSU-A

• 19981101-present

AMSU-B

• 19981101-present

HIRS2

• 19781101-20060930
• turned off HIRS2 chns 13 & 14 (for consistency w/ what was done w/ HIRS3/4)
• turned off HIRS2/3/4 chn 9 (oz-sensitive); and 15 from L. Coy studies

• tiros-n
  • 19781021 000000 19781231 240000 hirs2 0 # hirs2: unreliable for the first few months
  • 19790101 000000 19800120 240000 hirs2 8 2 3 6 7 8 10 11 12 # hirs2: ch4 & ch5 unstable
  • 19800121 000000 19810227 240000 hirs2 0 # hirs2: all channels from 19800127 -change behavior after data gap
• noaa-06
  • 19790702 000000 19790712 240000 hirs2 0 # hirs2: unstable
  • 19790713 000000 19830417 060000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • 19850408 000000 19861117 240000 hirs2 0 # hirs2: none
• noaa-07
  • 19810711 000000 19850204 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • 19850205 000000 19850206 240000 hirs2 0 # hirs2: instrument failure
• noaa-08
  • 19830426 000000 19840620 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • 19850701 000000 19851014 240000 hirs2 0 # hirs2: none
• noaa-09
  • 19850101 000000 19850202 240000 hirs2 0 # hirs2: calibration problems (ch7 bad)
  • 19850203 000000 19860930 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • 19861001 000000 19881107 240000 hirs2 8 4 5 6 7 8 10 11 12 # hirs2: ch1 & ch2 & ch3 stripping
• noaa-10
  • 19861125 000000 19910901 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
• noaa-11
  • 19881012 000000 19941204 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • 19970715 000000 19990228 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
• moaa-12
  • 19910818 000000 19911224 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • 19911125 000000 19920307 240000 hirs2 0 # hirs2: instrumental problems
  • 19920308 000000 19930609 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • 19930610 000000 19930618 240000 hirs2 0 # hirs2: all channels noisy
  • 19930619 000000 19970714 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
• noaa-14
  • 19950119 000000 19950430 240000 hirs2 0 # hirs2: unstable
  • 19950501 000000 20060930 240000 hirs2 10 2 3 4 5 6 7 8 10 11 12 #
  • 20060930 000000 20070523 240000 hirs2 0 # end of record

HIRS3

• 19980721-present
• 19Jul2012 Todling - turned off channel 9 from HIRS3 and 4 (per Pawson's)
• 07Sep2013 Todling - turned off HIRS3/4 chs 13 and 14 (Joa>Job)
• 20Sep2013 Todling - turned off HIRS2 chns 13 & 14 (for consistency w/ what was done w/ HIRS3/4)
• noaa-15
  • 19980702 000000 19981006 000000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
  • 19981006 060000 19981006 060000 hirs3 0 # hirs3: noisy
  • 19981006 120000 19990302 000000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
  • 19990302 060000 19990302 060000 hirs3 0 # hirs3: all noisy
  • 19990302 120000 20000218 240000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
  • 20000219 000000 20000220 240000 hirs3 0 # hirs3: all noisy
  • 20000221 000000 20000606 240000 hirs3 10 2 3 4 5 6 7 8 10 11 12 #
  • 20000607 000000 20090602 240000 hirs3 0 # hirs3: all noisy due to filter wheel problems

HIRS4

• 20090401-present

MSU

• 19781101-20061010

MHS

• 20051101-present

SSU

• 19781101-20060505

IASI

• 20080916_18z-present

Metop-AMSU-A

• 20080916_18z-present

AIRS

• 20070401_00z-present

Aqua-AMSU-A

• 20070401_00z-present

ATMS

• 20111116-present

CrIS

• 20120406-present

SSMI

• Wentz version 7(processing YK)
• F08 - 19870709_00z-19911231_18z
• F10 - 19901208_00z-19971114_18z
• F11 - 19911203_00z-20000516_18z
• F13 - 19950503_00z-20091104_18z
• F14 - 19971218_00z-20080808_18z
• F15 - 19991218_00z-20060826_18z

SSMI/S

• 20110228_00z-present

Ozone data

SBUV

• 19781031_00z-20040930_18z (Intentionally not needed (used) past 20040930)

MLS

• 20041001_00z-present

EOSMLSt

• 20040813_00z-present

Additional information

A.C.(internal link) [2]