Recipe: Retrieve (global) data from HTTPS server: Difference between revisions

From GEOS-5
Jump to navigation Jump to search
Pchakrab (talk | contribs)
 
(8 intermediate revisions by 2 users not shown)
Line 1: Line 1:
Back to [[G5NR Data Access Guide]].
Back to [[G5NR Data Access Guide]].
'''NOT  AVAILABLE  YET!'''


== Problem ==
== Problem ==


We want to access G5NR data by downloading files from the <code>http</code> server using either a web browser or the command line tool <code>wget</code>.
We want to access G5NR data by downloading files from the <code>https</code> server using either a web browser or the command line tool <code>wget</code>.


== Solution ==
== Solution ==


The base url for G5NR data is
The base url for G5NR data is
  http://g5nr.nccs.nasa.gov/data/Ganymed/7km/c1440_NR/
  https://g5nr.nccs.nasa.gov/data/


At this location, the data is organized by resolution (0.5000_deg/0.0625_deg), type (const/inst/tavg/tdav), collection name, year, month and day as follows:
At this location, the data is organized by resolution (0.5000_deg/0.0625_deg), type (const/inst/tavg/tdav), collection name, year, month and day as follows:
Line 32: Line 25:


A web browser can be used to browse directories, read and retrieve files. To retrieve the collection <code>inst01hr_3d_T_Cv</code> for the day 2006-09-18, one needs to point to
A web browser can be used to browse directories, read and retrieve files. To retrieve the collection <code>inst01hr_3d_T_Cv</code> for the day 2006-09-18, one needs to point to
  http://g5nr.nccs.nasa.gov/data/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18.
  https://g5nr.nccs.nasa.gov/data/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18.


At this location, a file may be downloaded by simply clicking on the file name.
At this location, a file may be downloaded by simply clicking on the file name.
Line 38: Line 31:
==== Download file(s) using the command line tool wget ====
==== Download file(s) using the command line tool wget ====


The command line tool <code>wget</code> can be used to retrieve the same files as
The command line tool <code>wget</code> can be used to retrieve the same files. To download a file for a specific time, say 0900z, we can use
wget http://g5nr.nccs.nasa.gov/data/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/*
  wget https://g5nr.nccs.nasa.gov/data/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/c1440_NR.inst01hr_3d_T_Cv.20060918_0900z.nc4
 
The <code>*</code> at the end would retrieve all (24) files for the given day.
 
To download a file for a specific time, say 0900z, we can use
  wget http://g5nr.nccs.nasa.gov/data/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/c1440_NR.inst01hr_3d_T_Cv.20060918_0900z.nc4


== Discussion ==
== Discussion ==

Latest revision as of 10:20, 9 April 2019

Back to G5NR Data Access Guide.

Problem

We want to access G5NR data by downloading files from the https server using either a web browser or the command line tool wget.

Solution

The base url for G5NR data is

https://g5nr.nccs.nasa.gov/data/

At this location, the data is organized by resolution (0.5000_deg/0.0625_deg), type (const/inst/tavg/tdav), collection name, year, month and day as follows:

DATA
|---resolution
|   |---type
|   |   |---collection
|   |   |   |---year
|   |   |   |   |---month
|   |   |   |   |   |---day

For a discussion about the available resolutions, types and collections, please see File:G5NR-Ganymed-7km FileSpec-ON6-V1.0.pdf.

Download using a web browser

A web browser can be used to browse directories, read and retrieve files. To retrieve the collection inst01hr_3d_T_Cv for the day 2006-09-18, one needs to point to

https://g5nr.nccs.nasa.gov/data/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18.

At this location, a file may be downloaded by simply clicking on the file name.

Download file(s) using the command line tool wget

The command line tool wget can be used to retrieve the same files. To download a file for a specific time, say 0900z, we can use

wget https://g5nr.nccs.nasa.gov/data/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/c1440_NR.inst01hr_3d_T_Cv.20060918_0900z.nc4

Discussion

See Also

  1. File Spec: File:G5NR-Ganymed-7km FileSpec-ON6-V1.0.pdf

No Warranty

Copyright