Adding an Asia data mirror

[PaulWessel]

@seisman may be able to organize a china.generic-mapping-tools.org mirror. Can this be the Asia mirror or do we push on folks in Japan?

[seisman]

Quick question: how many subdomains can we have?

[PaulWessel]

Good question. Not sure, does @leouieda know?

[PaulWessel]

Per https://help.hover.com/hc/en-us/articles/115007582627-How-To-Create-Domain-Shortcuts-Custom-URLs- it seems like any number.

[leouieda]

Yep, there aren't any restrictions. And there is also no implicit restriction on the URL name for these mirrors as well. Theoretically, anyone could set something up and people can use the environment variable.

[seisman]

The USTC LUG guys prefer to use rsync to mirror a site, i.e.

rsync -av --delete rsync://oceania.generic-mapping-tools.org local-gmtserver

But it doesn't work for the gmtserver, and also doesn't work for the ftp server (GenericMappingTools/website#21).

[leouieda]

I wonder is this is some port that has to be made available on the UH side?

[seisman]

I think so, maybe port 22 or 873. See https://unix.stackexchange.com/questions/406832.

[PaulWessel]

IT here will be setting up a rsyncd daemon running on gmtserver so that potential mirrors can actually use rsync. It will be sweet and easy. Once it is set up we can make a page somewhere with instructions for now to sync and set up a mirror clone of the data server content.

[PaulWessel]

Revisiting this thread. Last I heard from Ross at RCF was this: To sync using rsync, the clients would need to run the following command.

rsync -rP gmtserver.soest.hawaii.edu::gmtdata/*

I seem to remember @joa-quim was messing with this. Not sure if @seisman was involved in this - October is a long time ago.

[PaulWessel]

Sorry, see #23 for the latest on this.

[seisman]

Great news! USTC LUG has helped us set up a mirror in China!

URL: https://mirrors.ustc.edu.cn/gmtdata/

[PaulWessel]

Very nice - lets add to the list and see GenericMappingTools/website#78

[seisman]

Perhaps we can add a domain alias, like china.generic-mapping-tools.org.

[PaulWessel]

Yes, will do now and let you know.

[PaulWessel]

Added china.generic-mapping-tools.org as a forward to https://mirrors.ustc.edu.cn/gmtdata/.
Please test and let me know.

[PaulWessel]

I have now sent reminder emails to UNAVCO and NOAA (Walter), plus asked the S. Africa FTP mirror folks if they would be able to serve data as well, and also Dietmar at U Sydney. Checking with @leouieda regarding S America - we have Eder doing the FTP mirror but not sure he has capacity. Once Leo responds I can send an inquiry that way as well. The main weakness today is North America but getting a unavco and noaa would go a long way (US east coast, US Mountain). Perhaps we can get Dave to host a us-west-coast mirror?

[seisman]

Added china.generic-mapping-tools.org as a forward to https://mirrors.ustc.edu.cn/gmtdata/.
Please test and let me know.

Yes it works

[PaulWessel]

Should the shields OK extend to the FTP sites? I.e., can it check an ftp://address?

[seisman]

Should the shields OK extend to the FTP sites?

It doesn't support ftp

[seisman]

@PaulWessel It seems china.generic-mapping-tools.org doesn't work as expected.

http://china.generic-mapping-tools.org/ is corrected forwarded to https://mirrors.ustc.edu.cn/gmtdata/, but http://china.generic-mapping-tools.org/gmt_data_server.txt is forwarded to https://mirrors.ustc.edu.cn/gmt_data_server.txt.

[seisman]

Europe mirror http://europe.generic-mapping-tools.org/ doesn't have the above issue.

[PaulWessel]

This is what I have:

Similar to the others except gmtdata vs data. Maybe the missing trailing slash? I just added it now - see if that makes any difference.

[seisman]

Yes, now it works. The trailing slash is necessary.

[seisman]

Closing the issue as the China mirror is running now. I've posted @PaulWessel's comment above in a separate issue #82.

[leouieda]

Regarding S America, I think USP is the best place to host it. They probably have better infrastructure than anywhere else. I'm sure Eder would be glad to host. If not, the seismology group are heavy GMT users as well and have plenty of technical expertise (they host data servers for seismology).

[PaulWessel]

I have asked Eder and he seems positive - will check with his IT people before he can promise.