Visualizing data in Cubed-Sphere grid: Difference between revisions

From GEOS-5
Jump to navigation Jump to search
← Older edit
No edit summary
 
(26 intermediate revisions by 2 users not shown)
Line 1: Line 1:
{{rightTOC}}
{{rightTOC}}
<span style="color: red; font-weight: bold; font-size: 24pt">IN PROGRESS</span>
 


== Cubed-Sphere grid  background ==
== Cubed-Sphere grid  background ==


The GEOS-5 now has products that are stored natively in cubed-sphere grid. The utilities listed here may help users visualize the data in cubed-sphere grid or map the data to lat-lon grid.
Several GEOS-5 products are now produced on the native cubed-sphere computational grid.   Although this format may be less familiar, this choice has several advantages for some user communities.  In particular, the Chemical Transport Modeling (CTM) community can use native mass-flux products to significantly improve conservation properties when running with GEOS-5. To minimize transition difficulties for GEOS-5 data consumers, this page provides instructions for visualizing cubed-sphere data products using a variety of common packages:  python, Matlab, IDL, and GRaDS, and Panoply. This page also provides instructions for downloading and building an executable that can regrid cubed-sphere products onto a traditional lat-lon grid.


== Fortran ==
== Fortran ==
Line 11: Line 11:


== Matlab ==
== Matlab ==
Users can find a “GridUtils” package in MATLAB ( R2015b and R2016a) at http://wiki.seas.harvard.edu/geos-chem/index.php/GEOS-Chem_HP_Output_Data#MATLAB_.28Cubed-sphere_and_regular_data.29 . The instructions are straight forward. Although it is intended for GCHP, it can be used for all the other outputs that use the same formats as that of GCHP. For the new format of the output, user can use the code here to transform the data to lat-lon grid and visualize it.
Users can find a “GridUtils” package in MATLAB ( R2015b and R2016a or above) at http://wiki.seas.harvard.edu/geos-chem/index.php/GEOS-Chem_HP_Output_Data#MATLAB_.28Cubed-sphere_and_regular_data.29 . The instructions are straight forward. Although it is intended for GCHP, it can be used for all the other outputs that use the same formats as that of GCHP. For the new format of the output, users can use the matlab codes here to transform the data to lat-lon grid and visualize the products.
 
<syntaxhighlight lang="matlabl" line>
close all;
clear all;
% user specify the file name, variables, the the lat-lon resolution, level and time.
% level is optional
 
fname='MAX_Discharge.geosgcm_prog.20141118_2130z.nc4';
varname='T';
Nlat=100;
Nlon=600;
level=1;
time=1;


[grid_data,X,Y]=CS2latlon(fname,varname,Nlat,Nlon,time,level);
#Download source codes and save them as driver.m, CSnative.m, extendFace1.m,extendFace3.m, extendFace4.m, extendFace6.m, and the example data file respectively to the same folder. The extendFace(1-6).m are used to fill the seam between cubed-sphere faces. Face2 and Face5 are not necessary to be  extended because they are redundant.
pcolor(Y',X',squeeze(grid_data)'),shading('flat'),colorbar
#Users should specify the time, level , variable’s name and file name in driver.m. The test data file can be downloaded [[Media:TEST7.geosgcm_prog.20000415_0000z.nc4]]
#Run with Matlab: % driver


function [grid_data,X,Y]=CS2ltlon(fname,varname,Nlat,Nlon,time,level)
==== [[Recipe: Matlab program  driver for visualization| driver.m]] ====
  ncid=netcdf.open(fname,'NOWRITE');
==== [[Recipe: Matlab program  converts cubed-sphere to latlon| CSnative.m]] ====
  vinfo=ncinfo(fname,'T')
==== [[Recipe: Matlab program  fills the seam| extendFace1.m]] ====
  S=size(vinfo.Size);
==== [[Recipe: Matlab program  fills the seam3| extendFace3.m]] ====
  ydim=vinfo.Size(1);
==== [[Recipe: Matlab program  fills the seam4| extendFace4.m]] ====
  xdim=vinfo.Size(2);
==== [[Recipe: Matlab program  fills the seam6| extendFace6.m]] ====
  nf=vinfo.Size(3);
  netcdf.close(ncid);


  lats=ncread(fname,'lats');
== Python ==
  lons=ncread(fname,'lons');
For the new format of the output, users can use the python codes here to transform the data to lat-lon grid and visualize the products:
  if( S(2)==5)
#Install python 3 (or above) and the modules numpy, netcdf4, matplotlib and mpl_toolkits  on your computer.
      T=ncread(fname,'T',[1 1 1 1 1],[ydim xdim nf level time]);
#Download source codes CSnative.py, example1.py, example2.py and the example data file  [[Media:TEST7.geosgcm_prog.20000415_0000z.nc4]] the same folder.
  else
#To show example 1, $python example1.py
      T=ncread(fname,'T',[1 1 1 1],[ydim xdim nf time]);
#To show example 2, $python example2.py
  end
  length = xdim*ydim*nf;


  lats=reshape(lats,1,length);
==== [[Recipe: python program  reads cubed-sphere data| CSnative.py]]====
  lons=reshape(lons,1,length);
==== [[Recipe: python program  example1 | example1.py]] ====
  T=reshape(T,1,length);
==== [[Recipe: python program  example2| example2.py]] ====
  lats=lats(~isnan(T));
  lons=lons(~isnan(T));
  T=T(~isnan(T));
 
  latlim=linspace(min(lats),max(lats),Nlat);
  lonlim=linspace(min(lons),max(lons),Nlon);
  [X,Y]=meshgrid(latlim,lonlim);
 
  grid_data=griddata(lats,lons,T,X,Y,'v4');
</syntaxhighlight>


== IDL ==
== IDL ==
To use IDL codes and the pbs scripts to visualize a large number of GEOS-5 cubed-sphere products:
#Download the codes and save them as cube_to_latlon.pro, winds_cube_to_latlon.pro, convert_latlon.j (pbs script) , idlstart ( environment ) and README.
#The README file explains all the scripts and the steps visualizing the data. Although all the examples and data are on discover, it is not difficult for users to make changes to run the programs on the other systems.


The script ''read_and_interpolate_cube.pro'' can read data in the cubed-sphere grid in NetCDF files, interpolate the data , map the data in lat-lon format and plot. The script ''cube_to_latlon.pro''  uses ''read_and_interpolate_cube.pro'' to convert the variables in cubed-sphere grid to lat-lon grid and write the variables to NetCDF files. It should be noted that the tile files, input and output files are hard-wired in the code. The users will need to provide those files and change the code accordingly.
==== [[Recipe: README| README]] ====
==== [[Recipe: environment | idlstart]]====
==== [[Recipe: pbs script | Ops12KM_R_to_latlon.j]]====


==== [[Recipe: IDL program to read cubed-sphere data| read_and_interpolate_cube.pro]] ====
==== [[Recipe: cube_lat_laon |cube_to_latlon.pro]]====
==== [[Recipe: IDL program to convert cubed-sphere data to lat-lon data | cube_to_latlon.pro]] ====
==== [[Recipe: winds | winds_cube_to_latlon.pro]]====


== GrADS ==
== GrADS ==
Line 79: Line 58:
# sdfopen file.nc4
# sdfopen file.nc4
# run command <tt>dc</tt> to plot the cube-sphere grid NetCDF file. Users can get help by just run dc without any argument.
# run command <tt>dc</tt> to plot the cube-sphere grid NetCDF file. Users can get help by just run dc without any argument.
==Panoply==
Now the Panoply after version 4.7.0 can view the native cubed-sphere products. This software can be downloaded from https://www.giss.nasa.gov/tools/panoply/
==Converting (interpolating) cubed-sphere data to Lat-Lon data==
For some purposes it will be impractical to adapt existing analysis tools to directly work with MERRA cubed-sphere products.  In such cases, users will need to build an executable that can interpolate cubed-sphere data to a set of predefined lat-lon resolutions.  (Note that special care must be taken for vector data, e.g., (u,v).)
The building requirements and instruction can be found here  https://geos5.org/wiki/index.php?title=Building_Baselibs . The executable program cube2laton can be used to convert (or interpolate) the data
Converting data:
%  cube2latlon <in-file> <out-file> <target-resolution>
E.g.,
% cube2latlon  merra.nc  latlon.nc  4x5

Latest revision as of 05:48, 29 March 2017


Cubed-Sphere grid background

Several GEOS-5 products are now produced on the native cubed-sphere computational grid. Although this format may be less familiar, this choice has several advantages for some user communities. In particular, the Chemical Transport Modeling (CTM) community can use native mass-flux products to significantly improve conservation properties when running with GEOS-5. To minimize transition difficulties for GEOS-5 data consumers, this page provides instructions for visualizing cubed-sphere data products using a variety of common packages: python, Matlab, IDL, and GRaDS, and Panoply. This page also provides instructions for downloading and building an executable that can regrid cubed-sphere products onto a traditional lat-lon grid.

Fortran

To map the cubed-sphere grid data to lat-lon gird data, the program c2l_CFIO_offline.x is built with AGCM at src/GEOSgcs_GridComp/GEOSgcm_GridComp/GEOSagcm_GridComp/GEOSsuperdyn_GridComp/FVdycoreCubed_GridComp. The example configure file c2l_CFIO_offline.rc is also generated. It should be run as mpirun –np 6 ./c2l_CFIO_offline.x. This will produce a lat-lon grid data file whose name is configured in c2l_CFIO_offline.rc. Users then can use their familiar tools to visualize the lat-lon grid data.

Matlab

Users can find a “GridUtils” package in MATLAB ( R2015b and R2016a or above) at http://wiki.seas.harvard.edu/geos-chem/index.php/GEOS-Chem_HP_Output_Data#MATLAB_.28Cubed-sphere_and_regular_data.29 . The instructions are straight forward. Although it is intended for GCHP, it can be used for all the other outputs that use the same formats as that of GCHP. For the new format of the output, users can use the matlab codes here to transform the data to lat-lon grid and visualize the products.

  1. Download source codes and save them as driver.m, CSnative.m, extendFace1.m,extendFace3.m, extendFace4.m, extendFace6.m, and the example data file respectively to the same folder. The extendFace(1-6).m are used to fill the seam between cubed-sphere faces. Face2 and Face5 are not necessary to be extended because they are redundant.
  2. Users should specify the time, level , variable’s name and file name in driver.m. The test data file can be downloaded Media:TEST7.geosgcm_prog.20000415_0000z.nc4
  3. Run with Matlab: % driver

driver.m

CSnative.m

extendFace1.m

extendFace3.m

extendFace4.m

extendFace6.m

Python

For the new format of the output, users can use the python codes here to transform the data to lat-lon grid and visualize the products:

  1. Install python 3 (or above) and the modules numpy, netcdf4, matplotlib and mpl_toolkits on your computer.
  2. Download source codes CSnative.py, example1.py, example2.py and the example data file Media:TEST7.geosgcm_prog.20000415_0000z.nc4 the same folder.
  3. To show example 1, $python example1.py
  4. To show example 2, $python example2.py

CSnative.py

example1.py

example2.py

IDL

To use IDL codes and the pbs scripts to visualize a large number of GEOS-5 cubed-sphere products:

  1. Download the codes and save them as cube_to_latlon.pro, winds_cube_to_latlon.pro, convert_latlon.j (pbs script) , idlstart ( environment ) and README.
  2. The README file explains all the scripts and the steps visualizing the data. Although all the examples and data are on discover, it is not difficult for users to make changes to run the programs on the other systems.

README

idlstart

Ops12KM_R_to_latlon.j

cube_to_latlon.pro

winds_cube_to_latlon.pro

GrADS

To use GrADS to display cube-sphere grid data in a NetCDF file, the path should be in the PATH environment: /discover/nobackup/projects/gmao/share/dasilva/opengrads/Contents/grads

Then the users can follow the steps. First, we assume a version of GEOS-5 is available.

  1. run $ESMADIR/src/GMAO_Shared/GEOS_Util/plots/configure. This will produce a .quickplotrc in that directory
  2. source $ESMADIR/src/GMAO_Shared/GEOS_Util/plots/.quickplotrc
  3. run grads
  4. sdfopen file.nc4
  5. run command dc to plot the cube-sphere grid NetCDF file. Users can get help by just run dc without any argument.

Panoply

Now the Panoply after version 4.7.0 can view the native cubed-sphere products. This software can be downloaded from https://www.giss.nasa.gov/tools/panoply/

Converting (interpolating) cubed-sphere data to Lat-Lon data

For some purposes it will be impractical to adapt existing analysis tools to directly work with MERRA cubed-sphere products. In such cases, users will need to build an executable that can interpolate cubed-sphere data to a set of predefined lat-lon resolutions. (Note that special care must be taken for vector data, e.g., (u,v).)

The building requirements and instruction can be found here https://geos5.org/wiki/index.php?title=Building_Baselibs . The executable program cube2laton can be used to convert (or interpolate) the data


Converting data:

% cube2latlon <in-file> <out-file> <target-resolution>

E.g.,

% cube2latlon merra.nc latlon.nc 4x5

Retrieved from "https://geos5.org/wiki/index.php?title=Visualizing_data_in_Cubed-Sphere_grid&oldid=3872"