Using wget to download data from web sites to CSC
Wget is a command for downloading files from WWW-sites and FTP servers. Once you have resolved the URL of the file, just give it as an argument to the
wget command to download the file to your current directory.
You can fine tune the behaviour of
wget command with several options.
You can see the full list of available command options with the command:
||URL||Read a file containing the URL:s to retrieve.|
||file name||Name of the output file.|
||file name||Name of the download log file.|
||directory||Defines the directory where the downloaded data will be saved to. The default is . (the current directory).
||Continue getting a partially-downloaded file.|
||username||Specify the user name for file retrieval|
||password||Specify the password for file retrieval.|
||Use time-stamping. Download the file only if it is newer that the file in the target directory.|
||Turn on options suitable for mirroring. This option turns on recursion and time-stamping, sets infinite recursion depth and keeps FTP directory listings.|
Last edited Tue Jan 21 2020