GEOS-5

Recipe: Retrieve (global) data from HTTPS server: Difference between revisions

← Older edit
Pchakrab (talk | contribs)
1,048 edits
 
(21 intermediate revisions by 2 users not shown)
Line 3: Line 3:
== Problem ==
== Problem ==


We want to access G5NR data by downloading files from the <code>http</code> server using either a web browser or the command line tool <code>wget</code>.
We want to access G5NR data by downloading files from the <code>https</code> server using either a web browser or the command line tool <code>wget</code>.


== Solution ==
== Solution ==
'''NOTE:''' If you are bookmarking an <code>ftp</code> location you may need to manually add G5NR@ to the bookmarked url.


The base url for G5NR data is
The base url for G5NR data is
  ftp://G5NR@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA
  https://g5nr.nccs.nasa.gov/data/


At this location, the data is organized by resolution (0.5000_deg/0.0625_deg), type (const/inst/tavg/tdav), collection name, year, month and day as follows:
At this location, the data is organized by resolution (0.5000_deg/0.0625_deg), type (const/inst/tavg/tdav), collection name, year, month and day as follows:


  |-- resolution
DATA
  |  |-- type
  |---resolution
  |  |  |-- collection
  |  |---type
  |  |  |  |-- year
  |  |  |---collection
  |  |  |  |  |-- month
  |  |  |  |---year
  |  |  |  |  |  |-- day
  |  |  |  |  |---month
  |  |  |  |  |  |---day


[some details on what the types are etc.]
For a discussion about the available resolutions, types and collections, please see [[File:G5NR-Ganymed-7km FileSpec-ON6-V1.0.pdf]].


==== Download using a web browser ====
==== Download using a web browser ====


A web browser can be used to browse directories, read and retrieve files. To retrieve the collection <code>inst01hr_3d_T_Cv</code> for the day 2006-09-18, one needs to point to
A web browser can be used to browse directories, read and retrieve files. To retrieve the collection <code>inst01hr_3d_T_Cv</code> for the day 2006-09-18, one needs to point to
  ftp://G5NR@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18.
  https://g5nr.nccs.nasa.gov/data/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18.


At this location, a file may be downloaded by simply clicking on the file name.
At this location, a file may be downloaded by simply clicking on the file name.
Line 32: Line 31:
==== Download file(s) using the command line tool wget ====
==== Download file(s) using the command line tool wget ====


The command line tool <code>wget</code> can be used to retrieve the same files as
The command line tool <code>wget</code> can be used to retrieve the same files. To download a file for a specific time, say 0900z, we can use
wget ftp://G5NR:@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/*
  wget https://g5nr.nccs.nasa.gov/data/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/c1440_NR.inst01hr_3d_T_Cv.20060918_0900z.nc4
 
The <code>*</code> at the end would retrieve all (24) files for the given day.
 
To download a file for a specific time, say 0900z, we can use
  wget ftp://G5NR:@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/c1440_NR.inst01hr_3d_T_Cv.20060918_0900z.nc4


== Discussion ==
== Discussion ==
Retrieved from "https://geos5.org/wiki/index.php?title=Recipe:_Retrieve_(global)_data_from_HTTPS_server"