Recipe: Retrieve (global) data from HTTPS server: Difference between revisions

From GEOS-5
Jump to navigation Jump to search
Pchakrab (talk | contribs)
1,048 edits
Created page with "Back to G5NR Data Access Guide. == Problem == We want to access G5NR data by downloading files by ftp/wget. == Solution == '''NOTE:''' If you are bookmarking an <code>..."
 
 
(22 intermediate revisions by 2 users not shown)
Line 3: Line 3:
== Problem ==
== Problem ==


We want to access G5NR data by downloading files by ftp/wget.
We want to access G5NR data by downloading files from the <code>https</code> server using either a web browser or the command line tool <code>wget</code>.


== Solution ==
== Solution ==
'''NOTE:''' If you are bookmarking an <code>ftp</code> location you may need to manually add G5NR@ to the bookmarked url.


The base url for G5NR data is
The base url for G5NR data is
  ftp://G5NR@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA
  https://g5nr.nccs.nasa.gov/data/


At this location, the data is organized by resolution (0.5000_deg/0.0625_deg), type (const/inst/tavg/tdav), collection name, year, month and day as follows:
At this location, the data is organized by resolution (0.5000_deg/0.0625_deg), type (const/inst/tavg/tdav), collection name, year, month and day as follows:


  |-- resolution
DATA
  |  |-- type
  |---resolution
  |  |  |-- collection
  |  |---type
  |  |  |  |-- year
  |  |  |---collection
  |  |  |  |  |-- month
  |  |  |  |---year
  |  |  |  |  |  |-- day
  |  |  |  |  |---month
  |  |  |  |  |  |---day


[some details on what the types are etc.]
For a discussion about the available resolutions, types and collections, please see [[File:G5NR-Ganymed-7km FileSpec-ON6-V1.0.pdf]].


==== Download using a web browser ====
==== Download using a web browser ====


A web browser can be used to browse directories, read and retrieve files. To retrieve the collection <code>inst01hr_3d_T_Cv</code> for the day 2006-09-18, one needs to point to
A web browser can be used to browse directories, read and retrieve files. To retrieve the collection <code>inst01hr_3d_T_Cv</code> for the day 2006-09-18, one needs to point to
  ftp://G5NR@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18.
  https://g5nr.nccs.nasa.gov/data/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18.


At this location, a file may be downloaded by simply clicking on the file name.
At this location, a file may be downloaded by simply clicking on the file name.
Line 32: Line 31:
==== Download file(s) using the command line tool wget ====
==== Download file(s) using the command line tool wget ====


The command line tool <code>wget</code> can be used to retrieve the same files as
The command line tool <code>wget</code> can be used to retrieve the same files. To download a file for a specific time, say 0900z, we can use
wget ftp://G5NR:@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/*
  wget https://g5nr.nccs.nasa.gov/data/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/c1440_NR.inst01hr_3d_T_Cv.20060918_0900z.nc4
 
The <code>*</code> at the end would retrieve all (24) files for the given day.
 
To download a file for a specific time, say 0900z, we can use
  wget ftp://G5NR:@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/c1440_NR.inst01hr_3d_T_Cv.20060918_0900z.nc4


== Discussion ==
== Discussion ==

Latest revision as of 10:20, 9 April 2019

Back to G5NR Data Access Guide.

Problem

We want to access G5NR data by downloading files from the https server using either a web browser or the command line tool wget.

Solution

The base url for G5NR data is 

https://g5nr.nccs.nasa.gov/data/

At this location, the data is organized by resolution (0.5000_deg/0.0625_deg), type (const/inst/tavg/tdav), collection name, year, month and day as follows: 

DATA
|---resolution
|   |---type
|   |   |---collection
|   |   |   |---year
|   |   |   |   |---month
|   |   |   |   |   |---day

For a discussion about the available resolutions, types and collections, please see File:G5NR-Ganymed-7km FileSpec-ON6-V1.0.pdf.

Download using a web browser

A web browser can be used to browse directories, read and retrieve files. To retrieve the collection inst01hr_3d_T_Cv for the day 2006-09-18, one needs to point to 

https://g5nr.nccs.nasa.gov/data/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18.

At this location, a file may be downloaded by simply clicking on the file name.

Download file(s) using the command line tool wget

The command line tool wget can be used to retrieve the same files. To download a file for a specific time, say 0900z, we can use 

wget https://g5nr.nccs.nasa.gov/data/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/c1440_NR.inst01hr_3d_T_Cv.20060918_0900z.nc4

Discussion

See Also

  1. File Spec: File:G5NR-Ganymed-7km FileSpec-ON6-V1.0.pdf

No Warranty

Copyright

Retrieved from "https://geos5.org/wiki/index.php?title=Recipe:_Retrieve_(global)_data_from_HTTPS_server&oldid=4295"