Recipe: Retrieve (global) data from FTP server: Difference between revisions

From GEOS-5
Jump to navigation Jump to search
Pchakrab (talk | contribs)
Add banner about FTP disabled.
 
(13 intermediate revisions by one other user not shown)
Line 1: Line 1:
<span style="color:red"><font size=40>NOTE: NCCS has disabled the FTP option. It no longer works!</font></span>
Back to [[G5NR Data Access Guide]].
== Problem ==
== Problem ==


We want to access G5NR data by downloading files by ftp/wget.
We want to access G5NR data by downloading files from the <code>ftp</code> server using either a web browser or the command line tool <code>wget</code>.


== Solution ==
== Solution ==
'''NOTE:''' If you are bookmarking an <code>ftp</code> location you may need to manually add G5NR@ to the bookmarked url.


The base url for G5NR data is
The base url for G5NR data is
  ftp://G5NR@ftp.nccs.nasa.gov/c1440_NR/DATA
  ftp://G5NR@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/


At this location, the data is organized by resolution (0.5000_deg/0.0625_deg), type (const/inst/tavg/tdav), collection name, year, month and day as follows:
At this location, the data is organized by resolution (0.5000_deg/0.0625_deg), type (const/inst/tavg/tdav), collection name, year, month and day as follows:


  |-- resolution
DATA
  |  |-- type
  |---resolution
  |  |  |-- collection
  |  |---type
  |  |  |  |-- year
  |  |  |---collection
  |  |  |  |  |-- month
  |  |  |  |---year
  |  |  |  |  |  |-- day
  |  |  |  |  |---month
  |  |  |  |  |  |---day


[some details on what the types are etc.]
[some details on what the types are etc.]
Line 22: Line 30:


A web browser can be used to browse directories, read and retrieve files. To retrieve the collection <code>inst01hr_3d_T_Cv</code> for the day 2006-09-18, one needs to point to
A web browser can be used to browse directories, read and retrieve files. To retrieve the collection <code>inst01hr_3d_T_Cv</code> for the day 2006-09-18, one needs to point to
  ftp://G5NR@ftp.nccs.nasa.gov/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18.
  ftp://G5NR@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18.


At this location, a file may be downloaded by simply clicking on the file name.
At this location, a file may be downloaded by simply clicking on the file name.
Line 29: Line 37:


The command line tool <code>wget</code> can be used to retrieve the same files as
The command line tool <code>wget</code> can be used to retrieve the same files as
  wget ftp://G5NR:@ftp.nccs.nasa.gov/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/*
  wget ftp://G5NR:@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/*


The <code>*</code> at the end would retrieve all (24) files for the given day.
The <code>*</code> at the end would retrieve all (24) files for the given day.


To download a file for a specific time, say 0900z, we can use
To download a file for a specific time, say 0900z, we can use
  wget ftp://G5NR@ftp.nccs.nasa.gov/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/c1440_NR.inst01hr_3d_T_Cv.20060918_0900z.nc4
  wget ftp://G5NR:@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/c1440_NR.inst01hr_3d_T_Cv.20060918_0900z.nc4


== Discussion ==
== Discussion ==
Line 40: Line 48:
== See Also ==
== See Also ==


[[Recipe: File naming conventions]]
# File Spec: [[File:G5NR-Ganymed-7km FileSpec-ON6-V1.0.pdf]]


== No Warranty ==
== No Warranty ==
== Copyright ==
== Copyright ==

Latest revision as of 11:23, 10 April 2019

NOTE: NCCS has disabled the FTP option. It no longer works!


Back to G5NR Data Access Guide.

Problem

We want to access G5NR data by downloading files from the ftp server using either a web browser or the command line tool wget.

Solution

NOTE: If you are bookmarking an ftp location you may need to manually add G5NR@ to the bookmarked url.

The base url for G5NR data is

ftp://G5NR@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/

At this location, the data is organized by resolution (0.5000_deg/0.0625_deg), type (const/inst/tavg/tdav), collection name, year, month and day as follows:

DATA
|---resolution
|   |---type
|   |   |---collection
|   |   |   |---year
|   |   |   |   |---month
|   |   |   |   |   |---day

[some details on what the types are etc.]

Download using a web browser

A web browser can be used to browse directories, read and retrieve files. To retrieve the collection inst01hr_3d_T_Cv for the day 2006-09-18, one needs to point to

ftp://G5NR@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18.

At this location, a file may be downloaded by simply clicking on the file name.

Download file(s) using the command line tool wget

The command line tool wget can be used to retrieve the same files as

wget ftp://G5NR:@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/*

The * at the end would retrieve all (24) files for the given day.

To download a file for a specific time, say 0900z, we can use

wget ftp://G5NR:@ftp.nccs.nasa.gov/Ganymed/7km/c1440_NR/DATA/0.5000_deg/inst/inst01hr_3d_T_Cv/Y2006/M09/D18/c1440_NR.inst01hr_3d_T_Cv.20060918_0900z.nc4

Discussion

See Also

  1. File Spec: File:G5NR-Ganymed-7km FileSpec-ON6-V1.0.pdf

No Warranty

Copyright