topic How to download the multiple files using wget in Operating System - Linux

How to download the multiple files using wget

Narendra Uttekar — Mon, 01 Dec 2014 11:32:07 GMT

Hi,

Is there any way we can download multiple files using wget for e.g. when i try to download wget http://url/test*

Warning: wildcards not supported in HTTP.

Basically we want to download the files starting with test-nnnnn (where nnnnn - can we any numbers) or *.XLS

Thanks,

Narendra

Re: How to download the multiple files using wget

Steven Schweda — Mon, 01 Dec 2014 12:50:47 GMT

> Is there any way we can download multiple files using wget [...]

   It depends. If you could use FTP instead of HTTP, then wildcards
could be used. If the Web server will return a list of files for a URL
like "http://url/", then you could do things with HTTP, too. A Wget
option like --accept-regex=REGEX could be useful, for example. Or, you
could first fetch the file list, then extract the names you want from
it, and finally use Wget to fetch the URLs which will get those named
files. (-i/--input-file=FILE could be useful here.)

   An FTP server naturally provides directory listings. This allows
Wget to get a directory listing, scan it for wildcard matches, and fetch
the resulting files.

   An HTTP server may or may not provide a directory listing, depending
on how the server is configured. Generally, with HTML, Wget can follow
HTML _links_, but that works only if the server provides a HTML document
which contains suitable links. Between my weak psychic powers and your
description, I don't how helpful your HTTP/FTP/whatever server will be.

Re: How to download the multiple files using wget

drayson — Mon, 08 Dec 2014 14:18:25 GMT

If you have the right filenames (or they can be generated),

you could use a bash script which could download it for you.