Run GEOS-5 on NCCS Haswells: Difference between revisions
m Add some bits about building |
|||
(5 intermediate revisions by the same user not shown) | |||
Line 23: | Line 23: | ||
to the tag: | to the tag: | ||
mat- | mat-Intel15-forG41 | ||
The CVS command to run would be: | The CVS command to run would be: | ||
cvs upd -r mat- | cvs upd -r mat-Intel15-forG41 g5_modules Config/ESMA_arch.mk GMAO_Shared/GFDL_fms/FMS_arch.mk | ||
==== Heracles-1_0 ==== | ==== Heracles-1_0 ==== | ||
Line 37: | Line 37: | ||
should be updated to the tag: | should be updated to the tag: | ||
mat- | mat-Intel15-forH10U-2015Feb06 | ||
The CVS command to run would be: | The CVS command to run would be: | ||
cvs upd -r mat- | cvs upd -r mat-Intel15-forH10U-2015Feb06 g5_modules | ||
=== DAS === | === DAS === | ||
Line 58: | Line 58: | ||
to the tag: | to the tag: | ||
mat- | mat-Intel15-forDAS5D1U-2015Feb06 | ||
The CVS command to run would be: | The CVS command to run would be: | ||
cvs upd -r mat- | cvs upd -r mat-Intel15-forDAS5D1U-2015Feb06 g5_modules Config/ESMA_arch.mk GMAO_Shared/GFDL_fms/FMS_arch.mk \ | ||
Applications/GEOSgcm_App/GNUmakefile Applications/GSI_App/GNUmakefile Applications/NCEP_Paqc/oiqc/GNUmakefile \ | Applications/GEOSgcm_App/GNUmakefile Applications/GSI_App/GNUmakefile Applications/NCEP_Paqc/oiqc/GNUmakefile \ | ||
NCEP_Shared/NCEP_crtm/CRTM_MW_Water_SfcOptics.f90 NCEP_Shared/NCEP_crtm/CRTM_SfcOptics.f90 | NCEP_Shared/NCEP_crtm/CRTM_MW_Water_SfcOptics.f90 NCEP_Shared/NCEP_crtm/CRTM_SfcOptics.f90 | ||
Line 84: | Line 84: | ||
However, if you want to use all the cores, you'll need to change the layout. | However, if you want to use all the cores, you'll need to change the layout. | ||
=== Edits to AGCM.rc === | === AGCM === | ||
==== Edits to AGCM.rc ==== | |||
For the AGCM, you will want to edit the <tt>NX:</tt> and <tt>NY:</tt> entries such that they will fill the nodes and respect the cubed-sphere dynamics requirement that NY be divisible by 6. Some sample geometries that respect this are: | For the AGCM, you will want to edit the <tt>NX:</tt> and <tt>NY:</tt> entries such that they will fill the nodes and respect the cubed-sphere dynamics requirement that NY be divisible by 6. Some sample geometries that respect this are: | ||
Line 96: | Line 98: | ||
| c90 || 1° || 7 || 24 || 168 | | c90 || 1° || 7 || 24 || 168 | ||
|- | |- | ||
| | | c180 || ½° || 14 || 24 || 336 | ||
|- | |- | ||
| | | c360 || ¼° || 14 || 48 || 672 | ||
|} | |} | ||
Note that in future unstable tags--Heracles-1_0_UNSTABLE, say--changes will soon be in place in MAPL that will allow much more flexible core placement. When these changes are in, all geometries that respect the cubed-sphere restriction would work. | Note that in future unstable tags--Heracles-1_0_UNSTABLE, say--changes will soon be in place in MAPL that will allow much more flexible core placement. When these changes are in, all geometries that respect the cubed-sphere restriction would work. | ||
=== Edits to gcm_run.j === | ==== Edits to gcm_run.j ==== | ||
To use the Haswells, you'll need to change a few of the #SBATCH flags at the top of the script. First, make sure that the number of tasks you are requesting matches what ever you've used in AGCM.rc. For example, if you are running 7x12, be sure to use: | |||
#SBATCH --ntasks=84 | |||
Now, to submit to the Haswells, you need to add: | |||
#SBATCH --constraint=hasw |