Background
The download method of FENGYUN satellite is so inconvenient, especially for large datasets …
So, I decide to scrape the FTP links from the “Order” page and save them into one file.
Then, lftp
could speed up the download speed a lot!
Requirements
Python installed with three packages: logging, getpass and selenium
Usage
Script and example: https://github.com/zxdawn/weather_data/tree/master/FY
Order data on the FY website (all platforms) or using the FY Toolkit (Windows).
Run the script from the terminal
$ python fy.py
Input the requested infos ….
Check the bash script named
download_fy.sh
(You can change the name by
savename
in thefy,py
script)Run the bash script
$ chmod +x download_fy.sh $ ./download_fy.sh
Example of the bash script:
#!/bin/bash lftp -e "mget -c ftp://AO20200701000066936:Uo6O5__j@ftp.nsmc.org.cn/*" & lftp -e "mget -c ftp://AO20200701000065328:0lK_rxpW@ftp.nsmc.org.cn/AO202007010000653280001/*" & lftp -e "mget -c ftp://AO20200701000065328:0lK_rxpW@ftp.nsmc.org.cn/AO202007010000653280002/*" & lftp -e "mget -c ftp://AO20200701000065328:0lK_rxpW@ftp.nsmc.org.cn/AO202007010000653280003/*" &
Version control
Version | Action | Time |
---|---|---|
1.0 | Init | 2020-07-03 |
Say something
Thank you
Your comment has been submitted and will be published once it has been approved.
OOPS!
Your comment has not been submitted. Please go back and try again. Thank You!
If this error persists, please open an issue by clicking here.