moparisthebest
/
wget
mirror of https://github.com/moparisthebest/wget
1
0
Fork 0
Code Issues Releases Wiki Activity

[svn] After canonicalizing the URL, check for its existence among undesirable_urls. 

Published in <sxs7kyeohte.fsf@florida.arsdigita.de>.
This commit is contained in:
hniksic 2001-06-14 14:48:00 -07:00
parent 4f56fa7ead
commit 2255a89b24
2 changed files with 12 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
src/ChangeLog
View File

@ -1,3 +1,8 @@
2001-06-14 Hrvoje Niksic <hniksic@arsdigita.com>
* recur.c (recursive_retrieve): Also check undesirable_urls with
canonicalized URL.
2001-06-14 Hrvoje Niksic <hniksic@arsdigita.com>
* http.c (gethttp): Search `.netrc' with real host, not the proxy

8
src/recur.c
View File

@ -381,7 +381,13 @@ recursive_retrieve (const char *file, const char *this_url)
}
xfree (constr);
constr = xstrdup (u->url);
string_set_add (undesirable_urls, constr);
/* After we have canonicalized the URL, check if we have it
on the black list. */
if (string_set_contains (undesirable_urls, constr))
inl = 1;
/* This line is bogus. */
/*string_set_add (undesirable_urls, constr);*/
if (!inl && !((u->proto == URLFTP) && !this_url_ftp))
if (!opt.spanhost && this_url && !same_host (this_url, constr))
{