moparisthebest/wget
1
0
Fork 0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Code Issues Releases Wiki Activity
560 Commits 1 Branch 0 Tags 9.6 MiB
62a4ca3289
Commit Graph

283 Commits

Author SHA1 Message Date
hniksic
00773e7d15 [svn] Make `--cookies' respect its arg. 
Published in <sxs4rv8ht5e.fsf@florida.arsdigita.de>.
 2001-04-29 03:56:43 -07:00
hniksic
dfc1eb5766 [svn] Change default anonymous FTP password to "-wget@". 
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
 2001-04-29 03:53:55 -07:00
hniksic
b44f1701b0 [svn] Use alloca to allocate filename_plus_orig_suffix. 
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
 2001-04-28 09:36:46 -07:00
hniksic
d70101ea4e [svn] Commit various HTTP fixes. 
Published in <sxsy9slhu7g.fsf@florida.arsdigita.de>.

* http.c (gethttp): Return RETRUNNEEDED when the retrieval is
unneeded because the file is already there and fully downloaded,
and -c is specified.
(http_loop): Handle RETRUNNEEDED.

* wget.h (uerr_t): New value RETRUNNEEDED.

* http.c (http_loop): Set no_truncate for files that both exist
and are non-empty.
(gethttp): Consider the download finished when restval >= contlen,
not only when restval==contlen.
(gethttp): Handle redirection before giving up due to -c.
(gethttp): Clarify error message which explains that -c will not
truncate the file.
(gethttp): When returning CONTNOTSUPPORTED, don't forget to free
the stuff that needs freeing and release the socket.

* main.c (print_help): Wget booleans accept "off", not "no".
 2001-04-28 09:22:20 -07:00
hniksic
c6e565fd33 [svn] Send the no-cache directive when required regardless of whether we're 
going through a proxy.
Published in <sxsitjqncbx.fsf@florida.arsdigita.de>.
 2001-04-26 22:26:44 -07:00
hniksic
26ddb28a7c [svn] Improve documentation of mktime_from_utc. 
Rearrange http_atotm.
Published in <sxsoftjlyku.fsf@florida.arsdigita.de>.
 2001-04-26 22:11:38 -07:00
hniksic
07abfad1c2 [svn] Punish the *use* of ctype macros, rather than their mere presence. 
Published in <sxssnivlyut.fsf@florida.arsdigita.de>.
 2001-04-26 22:03:08 -07:00
hniksic
ae621c6770 [svn] Treat empty proxy environment vars as unset. 
Published in <sxssniwq8d6.fsf@florida.arsdigita.de>.
 2001-04-26 03:11:49 -07:00
hniksic
f0eb1fb758 [svn] Fix loading of cookies. 
Published in <sxslmopyao6.fsf@florida.arsdigita.de>.
 2001-04-24 19:29:54 -07:00
hniksic
425b5af0c9 [svn] Cosmetic change in DIGITS_* macros. 2001-04-24 18:55:13 -07:00
hniksic
9ae0328c3d [svn] Applied Roger Beeman's mktime_from_utc fix published in 
<Pine.HPX.4.02.10104181128180.6232-100000@mail1.cisco.com>.
Also, minor doc fixes.
 2001-04-24 17:50:22 -07:00
hniksic
d80f6cbe8c [svn] Reimplemented UNSAFE_CHAR and RESERVED_CHAR. 
Fixed snprintf.c to avoid ISDIGIT.
 2001-04-24 17:20:30 -07:00
hniksic
45eea7387f [svn] New timer functions. Published in <sxs8zkp28vk.fsf@florida.arsdigita.de>. 2001-04-24 16:09:45 -07:00
hniksic
5674776cad [svn] Rewritten long_to_string. The new version favors smaller numbers; 
much of the work is now done at compile-time.
Published in <sxsvgnv6oii.fsf@florida.arsdigita.de>.
 2001-04-23 19:06:34 -07:00
hniksic
6ba7711d6a [svn] Print download rate even when percentages are not available. 
Published in <sxs1yqjd4ct.fsf@florida.arsdigita.de>.
 2001-04-23 08:28:34 -07:00
hniksic
38120f75ef [svn] Write percentages when the length is authoritative. 
Published in <sxselujd8py.fsf@florida.arsdigita.de>.
 2001-04-23 06:53:29 -07:00
hniksic
ac7c8c1390 [svn] Improve performance of grow_hash_table. 
Published in <sxs66g8nd4c.fsf@florida.arsdigita.de>.
 2001-04-14 00:41:29 -07:00
hniksic
61bb00adc0 [svn] Various url.c-related changes. 
Published in <sxsvgo8nmub.fsf@florida.arsdigita.de>.

* retr.c (retrieve_url): Call uri_merge, not url_concat.
* html-url.c (collect_tags_mapper): Call uri_merge, not
url_concat.
* url.c (mkstruct): Use encode_string instead of xstrdup followed
by URL_CLEANSE.
(path_simplify_with_kludge): Deleted.
(contains_unsafe): Deleted.
(construct): Renamed to uri_merge_1.
(url_concat): Renamed to uri_merge.
* url.c (str_url): Use encode_string instead of the unnecessary
CLEANDUP.
(encode_string_maybe): New function, returns input string if no
encoding is needed.
(encode_string): Call encode_string_maybe to do the dirty work,
xstrdup if no work needed.
* wget.h (XDIGIT_TO_xchar): Define here.
* url.c (decode_string): Use new name.
(encode_string): Ditto.
* http.c (XDIGIT_TO_xchar): Rename HEXD2asc to XDIGIT_TO_xchar.
(dump_hash): Use new name.
* wget.h: Rename ASC2HEXD and HEXD2ASC to XCHAR_TO_XDIGIT and
XDIGIT_TO_XCHAR respectively.
 2001-04-13 21:11:35 -07:00
hniksic
8a0e9e765e [svn] Minor -Wall-induced fixes. Also, skip_url is removed. 
Published in <sxs8zl5v5cw.fsf@florida.arsdigita.de>.
 2001-04-12 20:39:23 -07:00
hniksic
eae28f142d [svn] Commit various hash table changes: 
* hash.c (hash_table_map): Allow deletion and change of the
element processed by MAPFUN.
(string_hash): Use the function from glib.
* hash.c (hash_table_remove): Rewrite to actually clear deleted
entries instead of just marking them as deleted.

Published in <sxsu23tvdur.fsf@florida.arsdigita.de>.
 2001-04-12 17:34:24 -07:00
hniksic
452c0bb9f7 [svn] Declare hash_table_get_pair and hash_table_count. 2001-04-12 12:45:18 -07:00
hniksic
cd1423a478 [svn] Declare http_atotm(). 2001-04-12 12:43:12 -07:00
hniksic
b4b33b5afc [svn] Use octal constants. 
Published in <sxsr8yy1dk6.fsf@florida.arsdigita.de>.
 2001-04-12 05:58:02 -07:00
hniksic
83fe8f3597 [svn] "Support DESTDIR when installing. 
Patch courtesy Karl Eichwalder.
Published in <sxs4rvu2tmu.fsf@florida.arsdigita.de>.
 2001-04-12 05:25:22 -07:00
hniksic
a98337f827 [svn] Make seconds optional in VMS time specification. 
Published in <sxs8zl62u9p.fsf@florida.arsdigita.de>.
 2001-04-12 05:22:50 -07:00
hniksic
963863113f [svn] Fix retrieval of directories when initial CWD is not `/'. 
Published in <sxsitkc709p.fsf@florida.arsdigita.de>.

* url.c (parseurl): Don't strip trailing slash when u->dir is "/"
because that strips the *leading* slash, thus forcing relative
FTP retrieval.
* ftp.c (getftp): Convert initial FTP directory from VMS to UNIX
notation for VMS servers.
(ftp_retrieve_dirs): Do not prepend '/' to f->name when
odir is an empty string.
 2001-04-10 17:24:59 -07:00
janp
90a26b7987 [svn] Make the AM/PM fix more efficient. 2001-04-10 10:09:42 -07:00
hniksic
5fa53b5a1d [svn] Implement better sorting and matching of cookies. 
Fix previously broken command-line options.
Published in <sxspuek9255.fsf@florida.arsdigita.de>.
 2001-04-10 09:04:18 -07:00
hniksic
579d051d57 [svn] Rewrite SSL #ifdef for better indentation. 2001-04-09 07:58:55 -07:00
hniksic
0c70c624f9 [svn] Fix recursive FTP retrieval so that 
`wget -r ftp://<username>:<password>@host/%2Fhome/hniksic/dir/'
works.
Published in <sxsk84ug8gt.fsf@florida.arsdigita.de>.
 2001-04-08 18:38:27 -07:00
hniksic
665a84b4a2 [svn] Implement tilde-expansion in file name arguments of 
`.wgetrc' commands.
Published in <sxsy9tbeyh3.fsf@florida.arsdigita.de>.
 2001-04-08 16:59:14 -07:00
hniksic
2cfb2d2ef6 [svn] Added support for cookies. 2001-04-08 15:25:24 -07:00
janp
7827420378 [svn] ftp-ls.c (ftp_parse_winnt_ls): The AM/PM change did assume 12:01PM == 
00:01, which was obviously wrong.
 2001-04-08 07:38:12 -07:00
janp
55587bdee2 [svn] ChangeLog: Removed an excess conflict marker. Reformatted the entry by 
Philipp Thomas from 2001-03-09.

ftp-ls.c (ftp_parse_winnt_ls): Ensure that adjusted PM hours lay
between 0 and 23. Elminate unused variable `sec'.
 2001-04-08 02:30:14 -07:00
hniksic
26547d3987 [svn] New function hash_table_count. 
Published in <sxsu2403zzw.fsf@florida.arsdigita.de>.
 2001-04-07 19:09:04 -07:00
hniksic
b5788b5eb7 [svn] Do the namespace tweaks only on systems we know about. 2001-04-05 21:44:04 -07:00
hniksic
3ecad253f2 [svn] Include string.h. 2001-04-05 20:43:35 -07:00
hniksic
4bc1d37ccf [svn] Specify "compilation environment" that works for Linux 
and Solaris.
Published in <sxs8zlezpsu.fsf@florida.arsdigita.de>.
 2001-04-05 20:41:59 -07:00
hniksic
31ea5aae27 [svn] Prepend literal newline with `\n\' inside quoted string. 2001-04-05 20:06:00 -07:00
hniksic
3c6093cf13 [svn] Remove VERY_LONG_FORMAT. Instead, define function very_long_to_string 
for printing VERY_LONG_TYPE numbers.
Published in <sxsd7aqzqr7.fsf@florida.arsdigita.de>.
 2001-04-05 19:51:41 -07:00
hniksic
c51015565a [svn] parse_uname() Would run past the end of the string if the 
username was present, but the URL did not contain a slash, e.g.
http://foo:bar@myhost.
Reported by Christian Fraenkel.
 2001-04-04 07:00:34 -07:00
hniksic
1d51748034 [svn] Fix support for rfc850 time recognition on systems where strptime 
format specs %a and %A are not the same.
Published in <49022.983849922@ideon.st.ryukoku.ac.jp>.
 2001-04-03 11:54:32 -07:00
hniksic
a3eea37c91 [svn] Small cleanup of mswindows.c by Paul Bludov. 
Published in <wget-patches@sunsite.auc.dk>.
 2001-04-03 11:22:04 -07:00
hniksic
d62d112aed [svn] Remove stray conflict marker. 2001-04-03 09:19:23 -07:00
hniksic
f1d534cd8c [svn] Make -c' and -O' work together. 
Published in <sxsitkmgokh.fsf@florida.arsdigita.de>.
 2001-04-03 05:24:49 -07:00
hniksic
1810f7a442 [svn] Handle trailing whitespace in .netrc. Published in 
<sxsitkofbfw.fsf@florida.arsdigita.de>.
 2001-04-01 16:28:25 -07:00
hniksic
cee04f2ef3 [svn] Fix memory allocation in cmd_address(). 
Published in <sxs66gogt0k.fsf@florida.arsdigita.de> under
the subject "Fix for opt.bind_address".
 2001-04-01 15:23:52 -07:00
hniksic
20a4341e1a [svn] Wget was ignoring an error when getting a directory failed. 
Fix courtesy Nicolas Lichtmaier.
 2001-04-01 14:34:40 -07:00
hniksic
4dbad3a894 [svn] Make sure -C is recognized. 2001-04-01 14:26:28 -07:00
hniksic
a52aaeb451 [svn] Make sure -c doesn't truncate the file. 
Published in <sxsofuhi4kc.fsf@florida.arsdigita.de>.
 2001-04-01 13:04:21 -07:00
hniksic
aa888ba8da [svn] Don't clear dl_file_url_map and dl_url_file_map in recursive_retrieve. 
Published in <sxsk856le2y.fsf@florida.arsdigita.de> under the subject
"Link conversion fix".
 2001-03-31 18:41:26 -08:00
hniksic
8c4cd805e2 [svn] Oops! Fix braino in recur.c -- clear the hash tables only when 
they are defined.
 2001-03-30 18:21:20 -08:00
hniksic
8f048b7be8 [svn] Committed my patch that makes HTTP code close its socket in premature 
returns (before the body was drained).  Published in
<sxsd7ayn0kt.fsf@florida.arsdigita.de>.
 2001-03-30 18:20:16 -08:00
hniksic
728584d072 [svn] Record downloaded files and downloaded HTML files in all cases. 
Published under the subject "Link conversion fix" in
<sxsn1a2n2zd.fsf@florida.arsdigita.de>.
 2001-03-30 18:05:54 -08:00
hniksic
e4d49f0b40 [svn] Published my patch "main.c tweaks" published in 
<sxspueyonjt.fsf@florida.arsdigita.de>.
 2001-03-30 15:17:59 -08:00
hniksic
1a6058b1ec [svn] Applied Philipp Thomas's safe-ctype patch. Published in 
<20010330025159.U21662@jeffreys.suse.de>.
 2001-03-30 14:36:59 -08:00
dan
f486b43c23 [svn] * {.,doc,src,util,windows}/Makefile.in: Moved top_builddir out of "User 
configuration section" of top Makefile and analogous spot in others.

* po/Makefile.in.in: Previous addition of top_builddir to
  po/Makefile.in was bogus -- it's generated from po/Makefile.in.in.
 2001-03-27 03:23:59 -08:00
dan
d41af5f52e [svn] Linking with OpenSSL previously required the user to set up all the 
appropriate -I, -L, and -R/-rpath flags in environment variables,
manually.  Automated everything, including bundling libtool so we can
successfully link with the OpenSSL shared libraries on just about any
platform.
 2001-03-17 06:21:19 -08:00
janp
5014d32c3a [svn] Skip `:port' in the host header if it is the DEFAULT_HTTPS_PORT when 
using SSL. Patch submitted by Hack Kampbjorn <hack@hackdata.com>.
 2001-03-08 15:11:03 -08:00
hniksic
71a53ffe25 [svn] Applied Jonas Jensen's patch to correctly calculate the number of bytes 
in the first line of the download that.
Published in <sxsu25hioxj.fsf@florida.arsdigita.de>.
 2001-03-01 14:25:20 -08:00
dan
b6febbc84b [svn] * po/*.po*: Updated after moving -nr to a different category. 
* wget.texi: Moved -nr from "Recursive Retrieval Options" to "FTP Options" and
  gave it a @cindex entry. Alphabetized FTP options by long option name.

* main.c (print_help): -nr belongs in "FTP options" section of --help output,
  not "Recursive retrieval" section.  Alphabetized FTP options by long option
  name.
 2001-02-23 13:31:54 -08:00
dan
2aa1d53fb2 [svn] * main.c (print_help): --help documentation for -N said it would re-download 
files if they had the _same_ timestamp on server.

* po/*.po*: Updated after changing --help's description of -N.
 2001-02-23 12:43:35 -08:00
dan
4fc318600e [svn] init.c (commands): Hack Kampbj?rn <hack@hackdata.com> discovered that 
"httpsproxy" had been inserted into commands[] out of alphabetical order,
causing "BUG: unknown command `httpuser'".
 2001-02-16 21:26:34 -08:00
janp
b3bb9b7ed9 [svn] Changes in FTP listing parser code - suport for VMS and MacOS, removed 
dependency on ftpparse as the copyright issue has not been resolved.
 2001-02-12 23:50:27 -08:00
hniksic
164ccc9e41 [svn] ChangeLog tweak; initialize con to appease the access checker. 2001-02-11 09:27:37 -08:00
hniksic
54811e2832 [svn] Applied Jan's patch to allow non-quoted @ character in 
passwords.  Published in <20010106173455.A9455@erwin.telekabel.at>.
 2001-02-10 16:28:22 -08:00
hniksic
b370dd1914 [svn] Applied Hack Kampbjorn's patch to print FTP type in debug output. 
Published in <3A7D94B5.D9B932FB@hackdata.com>.
 2001-02-10 16:06:59 -08:00
hniksic
366b832e3f [svn] Applied Jonas Jensen's download rate patch with my additions. 
Published in <015b01c09084$ce2d9330$0100000a@bob> and
<sxspugq3xai.fsf@florida.arsdigita.de>.
 2001-02-10 16:00:30 -08:00
hniksic
fdc20de365 [svn] Applied Tim Mooney's patch that fixes a build problem under Tru64. 
Published in
<Pine.OSF.4.33.0102072244450.2714-100000@dogbert.cc.ndsu.NoDak.edu>.
 2001-02-10 14:37:12 -08:00
hniksic
07f60f19a4 [svn] Applied Christian Fraenkel's patch "custom certificate patch for wget-1.7+dev; 
2nd try", published in <200102082132220160.00474E73@pop.gmx.net>.
It adds two options for custom certificates.
 2001-02-10 14:33:31 -08:00
hniksic
2f6cd9d698 [svn] Changes according to Herold Heiko's instructions how to make alloca() 
work under Windows: don't try to compile alloca.c, *and* don't forget
to include <malloc.h>.

Published in <sxsbssyibsu.fsf@florida.arsdigita.de>.
 2001-01-23 06:27:40 -08:00
dan
fa636eb71d [svn] url.c (str_url): Clarified this function's comment header after Hrvoje answered 
my question on the list as to when hide != 1.  Also Hrvoje pointed out I need to
use xstrdup() on the string literal.
 2001-01-10 22:16:46 -08:00
hniksic
3f91c7dfe1 [svn] Declare addrlen as int. Published in <sxsu27cbtzu.fsf@florida.arsdigita.de>. 2001-01-10 07:06:00 -08:00
dan
17e21ff7dd [svn] Jan did make a ChangeLog entry for his fix of the non-anonymous FTP recursion 
bug.  I just didn't use the right terms when searching for it.
 2001-01-10 00:53:42 -08:00
dan
f84a94e913 [svn] Made clarifications and corrections to --continue's --help output and wget.texi 
documentation.  Published in <200101100629.WAA09744@dilvish.speed.net>.
 2001-01-09 22:51:51 -08:00
dan
1993e140f2 [svn] url.c (str_url): Henrik van Ginhoven pointed out on the list that we shouldn't 
give away the number of characters in the password by replacing each character
with a 'x'.  Use "<password>" instead.
 2001-01-09 20:30:43 -08:00
dan
7140f393b2 [svn] When did the bug get fixed where recursive FTP would fail if logging in put 
you in a directory other than "/"?  I don't see a src/ChangeLog entry for
it.  In any case, my testing shows that it's fixed in 1.7-dev, but TODO and
a comment in src/ftp.c were not changed to reflect this.
 2001-01-09 20:17:06 -08:00
dan
040aae87b5 [svn] html-url.c: A bunch of fixup of `--page-requisites'-related comments to reflect 
Hrvoje's changes to my code when transplanting it into this new file, to fix
spelling mistakes, to clarify, etc.
 2001-01-09 18:54:52 -08:00
dan
bc5fd29baf [svn] 2001-01-09 Dan Harkless <wget@harkless.org> 
* html-url.c: Addition and clarification of comments related to -p.

	* url.c (write_backup_file): Clarified a comment.
	  [Committed this fix separately.]
 2001-01-09 18:28:24 -08:00
dan
cbe2ca1b80 [svn] Here're the changes we agreed to on the wget mailing list regarding the 
multiple-branches ChangeLog problem.  Note the new directories -- you'll need to
do a cvs update -d.
 2001-01-06 01:26:02 -08:00
hniksic
35325bd092 [svn] Include fragment identifiers in converted URLs. Published in 
<sxs8zorl90l.fsf@florida.arsdigita.de>.
 2001-01-04 05:53:53 -08:00
hniksic
f579cd1691 [svn] Csaba's Watcom changes. 2001-01-03 07:14:02 -08:00
dan
67bfa88fd8 [svn] ChangeLog: Since this flat file doesn't have multiple branches, 
looking at the dates would make you think that things went into
1.6 that actually just went into the 1.7-dev branch.  Added "[Not
in 1.6 branch.]" where appropriate to clarify.
 2000-12-31 04:45:42 -08:00
dan
86413b1d83 [svn] Need to say that stuff I did before releasing 1.6 happened on 12-30, not 12-31. 2000-12-31 04:10:59 -08:00
dan
e979053779 [svn] 2000-12-31 Dan Harkless <wget@harkless.org> 
* ftp.c, http.c:  Applied Hack Kampbj?rn <hack@hackdata.com>'s
        patch to deal with h_errno not being defined in netdb.h under Cygwin.

2000-12-30  Dan Harkless  <wget@harkless.org>

        * version.c: Released Wget version 1.6.  Note that on this branch we
        never actually had the version set to 1.6, but we still need the
        ChangeLog comment for posterity.
 2000-12-31 04:04:14 -08:00
dan
f105b3e43f [svn] Changed my address from dan-wget@dilvish.speed.net to wget@harkless.org 
everywhere -- dilvish will probably be going away soon.
 2000-12-31 03:18:37 -08:00
hniksic
23cbd15095 [svn] Igor Khristophorov's fix for check_end(). From 
<sxs4s027snq.fsf@florida.arsdigita.de>.
 2000-12-17 11:31:30 -08:00
hniksic
5099ec0306 [svn] Apply lint-expired fixes from <sxsn1du7ufa.fsf@florida.arsdigita.de>. 2000-12-17 10:52:52 -08:00
hniksic
f6a41b5669 [svn] Applied Csaba Raduly's patch from <802569B4.0043F7B1.00@Jagannath.uk.sophos>. 2000-12-17 10:18:14 -08:00
hniksic
2e8fc46b7b [svn] Include <netdb.h> where h_errno is used. Likewise for <errno.h> and errno. 
From <sxsvgsi7wcw.fsf@florida.arsdigita.de>.
 2000-12-17 10:12:02 -08:00
hniksic
b84f96df34 [svn] Use '"' rather than '\"' in assert. 2000-12-13 05:37:37 -08:00
hniksic
bdea0b3bf6 [svn] Made xfree alias to free if memory debugging is not used. 
From <sxsd7ezd7p2.fsf@florida.arsdigita.de>.
 2000-12-10 18:17:44 -08:00
hniksic
d5cd691b12 [svn] Fix -O timestamp bug. 
From <sxs7l57u6o6.fsf@florida.arsdigita.de>.
 2000-12-10 16:47:44 -08:00
hniksic
62b876401e [svn] Set the timestamp even when -O is used. 2000-12-10 16:31:14 -08:00
hniksic
afe131624b [svn] Add , before `int ssl'. 2000-12-06 09:22:27 -08:00
hniksic
b0e9dfd4e2 [svn] Fix opt.wait. 2000-12-05 16:24:40 -08:00
hniksic
47c6092ec4 [svn] Use a single version of RBUF_READCHAR. 2000-12-05 15:50:34 -08:00
hniksic
e754c99b46 [svn] Cosmetic cleanup of SSL stuff. 2000-12-05 15:35:56 -08:00
hniksic
7828e81c79 [svn] Committed C. Frankel's SSL patch. 2000-12-05 15:09:41 -08:00
hniksic
dc78acde56 [svn] Use the proper Jan's changelog entry. 2000-12-05 15:03:46 -08:00
hniksic
d1a855786c [svn] ChangeLog for Jan's last patch. 2000-12-05 14:44:46 -08:00
hniksic
7b5ad90acf [svn] Commit my url.c fix (space as unsafe character) and Jan's 
winnt directory listing parsing.
 2000-12-05 14:29:47 -08:00
hniksic
518fe8d06d [svn] Do away with line separator. 2000-11-29 08:19:46 -08:00
hniksic
7e900c50bf [svn] Undo Jan's typo fix. 2000-11-25 03:51:14 -08:00
hniksic
62994ffc8c [svn] Applied Karl Eichwalder's patch from 
<20001124044348.AF524DD15E@tux.gnu.franken.de>.
 2000-11-24 05:51:36 -08:00
hniksic
7c750db580 [svn] More memory debug tweaks. 
Published in <sxs4s0z2bwi.fsf@florida.arsdigita.de>.
 2000-11-23 13:44:56 -08:00
hniksic
1cddc05edb [svn] Committed memory debugging stuff. 
Published in <sxs1yw34pt4.fsf@florida.arsdigita.de>.
 2000-11-22 14:15:45 -08:00
hniksic
2ffb47eabf [svn] Committed <sxsbsv854j9.fsf@florida.arsdigita.de>. 2000-11-22 08:58:28 -08:00
hniksic
c3d636db03 [svn] Committed Jan's ftpparse patch with Hrvoje's modifications. 
<sxshf518e72.fsf@florida.arsdigita.de>.
 2000-11-21 08:48:39 -08:00
hniksic
d6a57bc2a6 [svn] Commit hash table bugfix. 
Published in <sxs8zqd9x1g.fsf@florida.arsdigita.de>.
 2000-11-21 08:42:29 -08:00
hniksic
6e598c81e3 [svn] Committed a bunch of different tweaks of mine. 
Published in <sxsr9463wrx.fsf@florida.arsdigita.de>.
 2000-11-20 18:06:36 -08:00
hniksic
fb42069e51 [svn] Constify check_end(). 2000-11-20 02:25:28 -08:00
hniksic
6f7fd37186 [svn] Auth tweaks. 
Published in <sxs3dgnz955.fsf@florida.arsdigita.de>.
 2000-11-19 18:10:54 -08:00
hniksic
ba3f5ce0a2 [svn] Bump version number. 2000-11-19 16:15:21 -08:00
hniksic
f2f77d87fd [svn] New option --no-http-keep-alive. 
Published in <sxsd7fr1pdf.fsf@florida.arsdigita.de>.
 2000-11-19 16:04:06 -08:00
hniksic
b27144fcce [svn] My patch "persistent connection tweaks". 
Published in <sxshf531qhj.fsf@florida.arsdigita.de>.

(Applied with the addition of correct calculation for the
length of the request.)
 2000-11-19 15:42:13 -08:00
hniksic
b0b1c815c1 [svn] A bunch of new features: 
- use mmap() to read whole files in core instead of allocating memory
  and read'ing it.

- use a new, more general, HTML parser (html-parse.c) and interface to
  it from Wget (html-url.c).

- respect <meta name=robots content=nofollow> (easy with the new HTML
  parser).

- use hash tables instead of linked lists in places where the lists
  were used to facilitate mappings.

- rewrite the code in host.c to be more readable and faster (hash
  tables instead of home-grown lists.)

- make convert_links properly convert partial URLs to complete ones
  for those URLs that have *not* been downloaded.

- use HTTP persistent connections where available.  very
  simple-minded, caches the last connection to the server.

Published in <sxshf533d5r.fsf@florida.arsdigita.de>.
 2000-11-19 12:50:10 -08:00
hniksic
ccf31643ab [svn] vsnprintf() fixup. 2000-11-16 08:37:49 -08:00
hniksic
cc3b6eb3e4 [svn] Do the _XOPEN_SOURCE/_SVID_SOURCE things only on Linux. 2000-11-15 10:10:01 -08:00
hniksic
6a70f04a5c [svn] Don't clutter the host list with duplicate hosts. 
Published in <sxsitpt56eh.fsf@florida.arsdigita.de>.
 2000-11-12 16:46:13 -08:00
hniksic
e1f1c1ff40 [svn] Better version of read_whole_line(). 
Published in <sxsr94jd7z4.fsf@florida.arsdigita.de>.
 2000-11-10 10:01:35 -08:00
hniksic
e18ca280fb [svn] Fix off-by-one error in comind(). 
Published in <sxsvgtvdcki.fsf@florida.arsdigita.de>.
 2000-11-10 08:20:55 -08:00
hniksic
f306ae9626 [svn] Changed last_slash[-1] to *(last_slash - 1). 2000-11-08 07:51:28 -08:00
hniksic
b72b6cf387 [svn] Correctly handle URLs where / does not follow the host name. 
Published in <sxsn1fag6zu.fsf@florida.arsdigita.de>.
 2000-11-08 01:15:40 -08:00
hniksic
34ea31bb01 [svn] Sort commands[]. 2000-11-07 03:43:36 -08:00
hniksic
0e2b74ce3b [svn] Commit "minor fixes". 2000-11-06 13:24:57 -08:00
hniksic
366ad1d6d9 [svn] Rewrote the logging code. 
Published at <sxs1ywrf300.fsf@florida.arsdigita.de>.
 2000-11-04 20:38:31 -08:00
hniksic
c2c821b3c9 [svn] snprintf.c addition. 2000-11-04 14:49:46 -08:00
hniksic
6e23da9254 [svn] Hide password from URL when non-verbose, too. 2000-11-01 17:41:20 -08:00
hniksic
6eb0870af0 [svn] Contributed fix. 2000-11-01 17:02:56 -08:00
hniksic
986c445029 [svn] Fixed minor memory leaks. 2000-11-01 16:18:27 -08:00
hniksic
b3758323ed [svn] Applied contributed fix. 2000-11-01 15:57:19 -08:00
hniksic
b7a8c6d3f5 [svn] Gracefully handle opt.downloaded overflowing. 
Published in <sxsd7gfnv17.fsf@florida.arsdigita.de>.
 2000-11-01 15:17:31 -08:00
hniksic
29cdc8da20 [svn] Updated long_to_string(); enhanced opt.downloaded to use 
64-bit types where available.
Published in <sxswvenqsmn.fsf@florida.arsdigita.de> and
<sxssnpbqshp.fsf@florida.arsdigita.de>.
 2000-11-01 13:51:25 -08:00
hniksic
b9eeb0c54c [svn] Fix "optimization" of query-strings in URLs. 
Published in <sxs3dhbwnmw.fsf@florida.arsdigita.de>.
 2000-11-01 10:31:53 -08:00
hniksic
6d13e17142 [svn] Detect redirection cycles. 
Published in <sxsd7ggtjac.fsf@florida.arsdigita.de>.
 2000-10-31 20:21:50 -08:00
hniksic
515d82fb95 [svn] Committed my patch from <sxsy9z4xz5m.fsf@florida.arsdigita.de> 
(recognize HTML entities.)
 2000-10-31 17:25:12 -08:00
hniksic
846b045a69 [svn] Applied my patch from <sxs3dhczfv5.fsf@florida.arsdigita.de>. 2000-10-31 16:38:57 -08:00
hniksic
f6715dd08d [svn] Committed my patch from <sxs7l6ozghz.fsf@florida.arsdigita.de>. 2000-10-31 16:26:33 -08:00
hniksic
0dd418242a [svn] Committed my patches from <sxsbsw16sbu.fsf@florida.arsdigita.de> 
and <sxsvgu824xk.fsf@florida.arsdigita.de>.
 2000-10-31 11:25:32 -08:00
hniksic
b095202cad [svn] Applied Adrian Aichner's patch from 
<20001029223711.28688.qmail@web10601.mail.yahoo.com>.
 2000-10-30 13:07:04 -08:00
dan
24c465b5ad [svn] retr.c (retrieve_url): Manually applied T. Bharath 
<TBharath@responsenetworks.com>'s patch to get wget to grok illegal relative URL
redirects.  Reformatted and re-commented it.
 2000-10-27 20:18:20 -07:00
dan
1396b30055 [svn] Manually applied Rob Mayoff <mayoff@dqd.com>'s patch (vs. 1.5.3, not 1.5.3+dev) 
to add --bind-address, making many necessary alphabetization, coding style,
comment, documentation, and naming fixes and additions.
 2000-10-23 23:19:17 -07:00
dan
2fbb4936a0 [svn] main.c (print_help): Clarified that --delete-after deletes local files. 2000-10-23 20:52:34 -07:00
dan
f4673bcdaf [svn] --delete-after wasn't implemented for files retrieved by FTP or corresponding to 
files specified on the commandline.  Made --convert-links be ignored when
--delete-after is specified.  Added note about this fact to --delete-after docs
and made general improvements to them, including the clarification that
--delete-after only deletes local files.
 2000-10-23 20:43:47 -07:00
dan
8a9be7627d [svn] ftp.c (getftp): Applied Piotr Sulecki <Piotr.Sulecki@ios.krakow.pl>'s 
patch to work around FTP servers that incorrectly respond to the
          	"REST" command with the remaining size rather than the total
          	file size.
 2000-10-20 00:28:57 -07:00
dan
8cf52e0dd3 [svn] Applied John Daily <jdaily@cyberdude.com>'s patch for his "quad" commands (which 
I renamed to "lockable_boolean") in the .wgetrc (currently just passive_ftp).
Wrote documentation for his changes and added the missing "referer" to the
.wgetrc section (making mention of the issue of "referrer" being the correct
spelling).
 2000-10-19 23:59:30 -07:00
dan
b3e2c0ff97 [svn] Implemented and documented new -E / --html-extension / html_extension option. 2000-10-19 22:55:46 -07:00
dan
cbf018d0c0 [svn] --retr-symlinks was not previously documented properly. Based on my newfound 
understanding of what its limitations are, added a TODO item.  Also made a minor
tweak in html.c to silence a warning.
 2000-10-09 15:43:11 -07:00
dan
7931200609 [svn] * *.{gmo,po,pot}: Regenerated after modifying wget --help output. 
* ftp.c (ftp_retrieve_list): Use new INFINITE_RECURSION #define.

* html.c: htmlfindurl() now takes final `dash_p_leaf_HTML' parameter.
Wrapped some > 80-column lines.  When -p is specified and we're at a
leaf node, do not traverse <A>, <AREA>, or <LINK> tags other than
<LINK REL="stylesheet">.

* html.h (htmlfindurl): Now takes final `dash_p_leaf_HTML' parameter.

* init.c: Added new -p / --page-requisites / page_requisites option.

* main.c (print_help): Clarified that -l inf and -l 0 both allow
infinite recursion.  Changed the unhelpful --mirrior description
to simply give the options it's equivalent to.  Added new -p option.
(main): Added some comments; handle new -p / --page-requisites.

* options.h (struct options): Added new page_requisites field.

* recur.c: Changed "URL-s" to "URLs" and "HTML-s" to "HTMLs".
Calculate and pass down new `dash_p_leaf_HTML' parameter to
get_urls_html().  Use new INFINITE_RECURSION #define.

* retr.c: Changed "URL-s" to "URLs".  get_urls_html() now takes
final `dash_p_leaf_HTML' parameter.

* url.c: get_urls_html() and htmlfindurl() now take final
`dash_p_leaf_HTML' parameter.

* url.h (get_urls_html): Now takes final `dash_p_leaf_HTML' parameter.

* wget.h: Added some comments and new INFINITE_RECURSION #define.

* wget.texi (Recursive Retrieval Options): Documented new -p option.
 2000-08-30 04:26:21 -07:00