Search:

Hi all,

I am going to download a complete website for offline viewing. I am wondering what is your suggestion? What command is suitable for this?

Thank you for your help.

I am using Cygwin.

Hello,

I am using wget to download some pdf files. However, it seems that there is a problem. I am using the following code:


while read -r link
do
http_strip="${link##*/}"
...

Thank you for your reply. Could you please explain more?

I have the download link to pdf files, stored in links.txt

Some of the pdf files have same content (with different names, but same size). I do not want to download same content several times. That...

I have several pdf files and want to check whether they are downloaded properly or not. I want to check for any possible unfinished downloads.
I am using the following code, however the following...

Hint for people who are interested:
I increased the download speed to 100K and also increased the random wait time between downloads. Apparently, this solves the problem.

I am using the following code to download a list of pdf files:


wget -i list.txt -A .pdf

Some pdf files are downloaded properly. However, some pdf files are not downloaded properly. When I...

I am using wget to download some files. I am using the following code:


wget -i list.txt

and the list.txt is shown below:


list.txt:
www.amazon.com/1

Thank You very much papibe for your help.

Thank you papibe again for your help. However, it seems that I have a problem here. I am using the following code:


while read -r link
do
output="${link%%.pdf*}".pdf
wget -nc...

Thank you papibe for your great help.
The first code works perfect, however, the second one seems stay in the loop and not save the file. However, the first one solved my problem.


In the same...

I am using wget in Cygwin to download some files. The wget code and a sample url are shown below:


wget -i slist.txt -r -l1 -p

...

Thanks again. The second code works perfect!

Exactly! Great Help again schragge. I really appreciate that.

Thank You. Great help..
How to put each link in a separate line?
When I use the following code, it writes all links after each other and not in separate lines:


(awk -F'"' -vRS='<a[...

I have the following txt file:


source.txt:
<a href="/gp/product/bold.jsp?tp=&add=B007OZNZG0"><a...

I have grep installed on Cygwin. However, I want to retrieve each links inside "source.txt" and search through the html for"/gp/product" and store the links in "extracted.txt".
Any suggestions for...

Thank you. Yes, I have it installed on Cygwin.

I have a "source.txt" file which contains list of some URLs. For example:



source.txt: ...

Hi all,

Is it possible to download specific links with wget. Suppose I want to download all files of "www.example.com/page2", which start with "dl.example.com".
I can use the following code to...