Regression tests: Difference between revisions
| (8 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
{{rightTOC}} | |||
'''For questions contact Purnendu at purnendu.chakraborty@nasa.gov''' | '''For questions contact Purnendu at purnendu.chakraborty@nasa.gov''' | ||
| Line 5: | Line 5: | ||
* checkout BASELINE version, run '1 day' and '1 step' experiments (one time operation) | * checkout BASELINE version, run '1 day' and '1 step' experiments (one time operation) | ||
* checkout CURRENT version, run '1 day' and '1 step' experiments (daily operation) | * checkout CURRENT version, run '1 day' and '1 step' experiments (daily operation) | ||
* compare outputs of BASELINE and CURRENT verions | * compare outputs of BASELINE and CURRENT verions of '1 day' runs - compare restart and NetCDF-4 files, (TOTAL) times taken by each GridComp and memory usages as reported by MAPL timers. If the restarts produce non-zero diff report the minimum and maximum of differences in fvcore_internal_rst for '1 step' run. | ||
The idea here is to checkout a "correct" version of the code, run an experiment and consider the resulting output to be the BASELINE version. Next, checkout the UNSTABLE tag, build it, run the experiment and compare the resulting | The idea here is to checkout a "correct" version of the code, run an experiment and consider the resulting output to be the BASELINE version. Next, checkout the UNSTABLE tag, build it, run the experiment and compare the resulting | ||
| Line 104: | Line 104: | ||
Next, an '1 step' experiment is run using the '''same build'''. Since this run is only for comparing outputs in case of non-zero diff, we do not time the run. | Next, an '1 step' experiment is run using the '''same build'''. Since this run is only for comparing outputs in case of non-zero diff, we do not time the run. | ||
$./GCM_Run.py --exp_typ AGCM --tag Ganymed-1_0_p1 --mod Ganymed | $./GCM_Run.py --exp_typ AGCM --tag Ganymed-1_0_p1 --mod Ganymed | ||
--home_dir HOME_DIR | --home_dir HOME_DIR | ||
--exstng_bld HOME_DIR/bld | --exstng_bld HOME_DIR/bld | ||
| Line 115: | Line 115: | ||
====One day & One step==== | ====One day & One step==== | ||
Repeat the BASELINE | Repeat the [[#BASELINE run (one time operation)]]. Checkout a copy of the UNSTABLE tag (Ganymed-2_0_UNSTABLE at the time of writing), build it, setup a 1day/1step experiment with the same options as for the BASELINE step and run the experiments. | ||
NOTE: Add flag --lt_test (1day run) for layout/transparency tests. | NOTE: Add flag --lt_test (1day run) for layout/transparency tests. | ||
| Line 182: | Line 182: | ||
# directory containing restarts | # directory containing restarts | ||
# ----------------------------- | # ----------------------------- | ||
set RST_HOM = /discover/nobackup/mathomp4/Restarts- | set RST_HOM = /discover/nobackup/mathomp4/Restarts-G20 | ||
| Line 274: | Line 274: | ||
==Non-zero diff== | ==Non-zero diff== | ||
In case of non-zero diff between the BASELINE and CURRENT versions and if the difference is explainable (e.g. there has been a science change), step 1 needs to be repeated - in BASELINE HOME_DIR delete directories bld, run and log (do '''NOT''' delete the file 'info', that way a log of BASELINE | In case of non-zero diff between the BASELINE and CURRENT versions and if the difference is explainable (e.g. there has been a science change), step 1 needs to be repeated - in BASELINE HOME_DIR delete directories bld, run and log (do '''NOT''' delete the file 'info', that way a log of BASELINE checkouts/runs is maintained) and repeat [[#BASELINE run (one time operation)]]. | ||
==Other utilities in systest== | ==Other utilities in systest== | ||
| Line 287: | Line 286: | ||
Cmp_NC4s.py: Compares NetCDF-4 files from two experiment directories. Syntax: | Cmp_NC4s.py: Compares NetCDF-4 files from two experiment directories. Syntax: | ||
$ ./Cmp_NC4s.py --bas /path/to/base/run/dir --cur /path/to/cur/run/dir | $ ./Cmp_NC4s.py --bas /path/to/base/run/dir --cur /path/to/cur/run/dir | ||
[[Category:SI Team]] | |||