Download Webpage Files from the Command Line

Use the wget command to download any file if you have the URL.


Downloading Multiple Files

Place a list of URLs in a .txt file. No special symbols are required to seperate the URLs, just make sure there is a line between each.

Once you have a list of your file URLs, run the following command and your files will download one after the other.

wget -i yourlist.txt

Avoiding Duplicate Files

If you want to avoid downloading a file you already have, use the -N option. This will skip files already in your directory if they have the same modification date.

wget -i -N yourlist.txt