Regression tests: Difference between revisions
No edit summary |
|||
| Line 5: | Line 5: | ||
* checkout BASELINE version, run '1 day' and '1 step' experiments (one time operation) | * checkout BASELINE version, run '1 day' and '1 step' experiments (one time operation) | ||
* checkout CURRENT version, run '1 day' and '1 step' experiments (daily operation) | * checkout CURRENT version, run '1 day' and '1 step' experiments (daily operation) | ||
* compare outputs of BASELINE and CURRENT verions | * compare outputs of BASELINE and CURRENT verions of '1 day' runs - compare restart and NetCDF-4 files, (TOTAL) times taken by each GridComp and memory usages as reported by MAPL timers. If the restarts produce non-zero diff report the minimum and maximum of differences in fvcore_internal_rst for '1 step' run. | ||
The idea here is to checkout a "correct" version of the code, run an experiment and consider the resulting output to be the BASELINE version. Next, checkout the UNSTABLE tag, build it, run the experiment and compare the resulting | The idea here is to checkout a "correct" version of the code, run an experiment and consider the resulting output to be the BASELINE version. Next, checkout the UNSTABLE tag, build it, run the experiment and compare the resulting | ||