Earthscope hosted datasets mirror

Site Feedback
1

As part of the migration of GMT services from the University of Hawaii, a new dataset and gmt software server has been stood up on an EarthScope managed AWS S3 bucket and served via a temporary, prototype URL, https://d3ei3ebu1iflov.cloudfront.net/gmt-data/data/

The URL can be set in the GMT_DATA_SERVER variable.

Please check it out.

Static datasets input data for the tests can similarly be found at GMT Datasets and GMT Datasets

2

Can you give a command example?

I tried

$ gmt grdcut -RNO --GMT_DATA_SERVER='https://d3ei3ebu1iflov.cloudfront.net/gmt-data/data/' @earth_age_05m -Gtrash.nc
gmt [NOTICE]: Downloading dcw-countries.txt for the first time - be patient
gmt [ERROR]: Libcurl Error: HTTP response code said error
gmt [ERROR]: Probably means dcw-countries does not exist on the remote server
gmt [ERROR]: Unable to obtain remote file dcw-countries.txt
gmt [WARNING]: gmt_get_dataset_tiles: No earth_age_05m_g tiles available for your region.
grdcut [NOTICE]: Downloading dcw-countries.txt for the first time - be patient
grdcut [ERROR]: Libcurl Error: HTTP response code said error
grdcut [ERROR]: Probably means dcw-countries does not exist on the remote server
grdcut [ERROR]: Unable to obtain remote file dcw-countries.txt
grdcut [ERROR]: Grid y range <= 0.0
grdcut (gmtapi_init_grdheader): Please select compatible -R and -I values
grdcut [ERROR]: Requested subset is entirely below or above the current grid region

$ gmt grdcut -RNO --GMT_DATA_SERVER='d3ei3ebu1iflov.cloudfront.net/gmt-data/data/' @earth_age_05m -Gtrash.nc
gmt [NOTICE]: Downloading dcw-countries.txt for the first time - be patient
gmt [ERROR]: Libcurl Error: HTTP response code said error
gmt [ERROR]: Probably means dcw-countries does not exist on the remote server
gmt [ERROR]: Unable to obtain remote file dcw-countries.txt
gmt [WARNING]: gmt_get_dataset_tiles: No earth_age_05m_g tiles available for your region.
grdcut [NOTICE]: Downloading dcw-countries.txt for the first time - be patient
grdcut [ERROR]: Libcurl Error: HTTP response code said error
grdcut [ERROR]: Probably means dcw-countries does not exist on the remote server
grdcut [ERROR]: Unable to obtain remote file dcw-countries.txt
grdcut [ERROR]: Grid y range <= 0.0
grdcut (gmtapi_init_grdheader): Please select compatible -R and -I values
grdcut [ERROR]: Requested subset is entirely below or above the current grid region

I see that the URL you gave is HTTPS; the other mirrors use HTTP. Does that make a difference?

Edit: nevermind, HTTPS works as well, https://oceania.generic-mapping-tools.org/.

3

Your command also fails for me but works after removing the trailing slash, i.e., changing /gmt-data/data/ to /gmt-data/data.

4

The problem is that the subdirectory path to the dataset was being simply appended to the data server URL causing an extra ‘/’ to be added. It seams many servers ignore multiple '//'s but the AWS system does not.

With the help of Claude, I was able to add a function to the AWS CloudFront system to collapse multiple / characters into one (eg. gmt-data/data//server → gmt-data/data/server) which resolved the problem of the trailing slash in my trial.

5

Please, have a look at this as well

6

Great, now both of my original commands work.