Commit Graph

364 Commits

Author SHA1 Message Date
hniksic 105627124e [svn] Make sure hstat.no_truncate gets properly initialized.
Published in <sxspudk6pdl.fsf@florida.arsdigita.de>.
2001-05-08 04:47:05 -07:00
hniksic 50980de841 [svn] Avoid useless file_exists_p. Published in
<sxsr8y17zav.fsf@florida.arsdigita.de>.
2001-05-07 12:08:29 -07:00
janp 5ff5e936a5 [svn] Correct the conversion of month entries for NT and VMS. 2001-05-02 03:15:17 -07:00
hniksic 72b9bb6d92 [svn] Zero out SIN before using it.
Published in <sxs3daq8zdg.fsf@florida.arsdigita.de>.
2001-04-30 03:19:41 -07:00
hniksic 3973f20a45 [svn] Refuse to download files from scratch if `-c' is used and the server
doesn't support REST only for existing *and non-empty* files.
Published in <sxsae4zg4zc.fsf@florida.arsdigita.de>.
2001-04-29 07:24:45 -07:00
hniksic 00773e7d15 [svn] Make `--cookies' respect its arg.
Published in <sxs4rv8ht5e.fsf@florida.arsdigita.de>.
2001-04-29 03:56:43 -07:00
hniksic dfc1eb5766 [svn] Change default anonymous FTP password to "-wget@".
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
2001-04-29 03:53:55 -07:00
hniksic b44f1701b0 [svn] Use alloca to allocate filename_plus_orig_suffix.
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
2001-04-28 09:36:46 -07:00
hniksic d70101ea4e [svn] Commit various HTTP fixes.
Published in <sxsy9slhu7g.fsf@florida.arsdigita.de>.

* http.c (gethttp): Return RETRUNNEEDED when the retrieval is
unneeded because the file is already there and fully downloaded,
and -c is specified.
(http_loop): Handle RETRUNNEEDED.

* wget.h (uerr_t): New value RETRUNNEEDED.

* http.c (http_loop): Set no_truncate for files that both exist
and are non-empty.
(gethttp): Consider the download finished when restval >= contlen,
not only when restval==contlen.
(gethttp): Handle redirection before giving up due to -c.
(gethttp): Clarify error message which explains that -c will not
truncate the file.
(gethttp): When returning CONTNOTSUPPORTED, don't forget to free
the stuff that needs freeing and release the socket.

* main.c (print_help): Wget booleans accept "off", not "no".
2001-04-28 09:22:20 -07:00
hniksic c6e565fd33 [svn] Send the no-cache directive when required regardless of whether we're
going through a proxy.
Published in <sxsitjqncbx.fsf@florida.arsdigita.de>.
2001-04-26 22:26:44 -07:00
hniksic 26ddb28a7c [svn] Improve documentation of mktime_from_utc.
Rearrange http_atotm.
Published in <sxsoftjlyku.fsf@florida.arsdigita.de>.
2001-04-26 22:11:38 -07:00
hniksic 07abfad1c2 [svn] Punish the *use* of ctype macros, rather than their mere presence.
Published in <sxssnivlyut.fsf@florida.arsdigita.de>.
2001-04-26 22:03:08 -07:00
hniksic ae621c6770 [svn] Treat empty proxy environment vars as unset.
Published in <sxssniwq8d6.fsf@florida.arsdigita.de>.
2001-04-26 03:11:49 -07:00
hniksic f0eb1fb758 [svn] Fix loading of cookies.
Published in <sxslmopyao6.fsf@florida.arsdigita.de>.
2001-04-24 19:29:54 -07:00
hniksic 425b5af0c9 [svn] Cosmetic change in DIGITS_* macros. 2001-04-24 18:55:13 -07:00
hniksic e559249a48 [svn] Minor doc fix. 2001-04-24 17:59:39 -07:00
hniksic 9ae0328c3d [svn] Applied Roger Beeman's mktime_from_utc fix published in
<Pine.HPX.4.02.10104181128180.6232-100000@mail1.cisco.com>.
Also, minor doc fixes.
2001-04-24 17:50:22 -07:00
hniksic d80f6cbe8c [svn] Reimplemented UNSAFE_CHAR and RESERVED_CHAR.
Fixed snprintf.c to avoid ISDIGIT.
2001-04-24 17:20:30 -07:00
hniksic 45eea7387f [svn] New timer functions. Published in <sxs8zkp28vk.fsf@florida.arsdigita.de>. 2001-04-24 16:09:45 -07:00
hniksic 5674776cad [svn] Rewritten long_to_string. The new version favors smaller numbers;
much of the work is now done at compile-time.
Published in <sxsvgnv6oii.fsf@florida.arsdigita.de>.
2001-04-23 19:06:34 -07:00
hniksic 6ba7711d6a [svn] Print download rate even when percentages are not available.
Published in <sxs1yqjd4ct.fsf@florida.arsdigita.de>.
2001-04-23 08:28:34 -07:00
hniksic 38120f75ef [svn] Write percentages when the length is authoritative.
Published in <sxselujd8py.fsf@florida.arsdigita.de>.
2001-04-23 06:53:29 -07:00
hniksic ac7c8c1390 [svn] Improve performance of grow_hash_table.
Published in <sxs66g8nd4c.fsf@florida.arsdigita.de>.
2001-04-14 00:41:29 -07:00
hniksic 61bb00adc0 [svn] Various url.c-related changes.
Published in <sxsvgo8nmub.fsf@florida.arsdigita.de>.

* retr.c (retrieve_url): Call uri_merge, not url_concat.
* html-url.c (collect_tags_mapper): Call uri_merge, not
url_concat.
* url.c (mkstruct): Use encode_string instead of xstrdup followed
by URL_CLEANSE.
(path_simplify_with_kludge): Deleted.
(contains_unsafe): Deleted.
(construct): Renamed to uri_merge_1.
(url_concat): Renamed to uri_merge.
* url.c (str_url): Use encode_string instead of the unnecessary
CLEANDUP.
(encode_string_maybe): New function, returns input string if no
encoding is needed.
(encode_string): Call encode_string_maybe to do the dirty work,
xstrdup if no work needed.
* wget.h (XDIGIT_TO_xchar): Define here.
* url.c (decode_string): Use new name.
(encode_string): Ditto.
* http.c (XDIGIT_TO_xchar): Rename HEXD2asc to XDIGIT_TO_xchar.
(dump_hash): Use new name.
* wget.h: Rename ASC2HEXD and HEXD2ASC to XCHAR_TO_XDIGIT and
XDIGIT_TO_XCHAR respectively.
2001-04-13 21:11:35 -07:00
hniksic 8a0e9e765e [svn] Minor -Wall-induced fixes. Also, skip_url is removed.
Published in <sxs8zl5v5cw.fsf@florida.arsdigita.de>.
2001-04-12 20:39:23 -07:00
hniksic eae28f142d [svn] Commit various hash table changes:
* hash.c (hash_table_map): Allow deletion and change of the
element processed by MAPFUN.
(string_hash): Use the function from glib.
* hash.c (hash_table_remove): Rewrite to actually clear deleted
entries instead of just marking them as deleted.

Published in <sxsu23tvdur.fsf@florida.arsdigita.de>.
2001-04-12 17:34:24 -07:00
hniksic 452c0bb9f7 [svn] Declare hash_table_get_pair and hash_table_count. 2001-04-12 12:45:18 -07:00
hniksic cd1423a478 [svn] Declare http_atotm(). 2001-04-12 12:43:12 -07:00
hniksic b4b33b5afc [svn] Use octal constants.
Published in <sxsr8yy1dk6.fsf@florida.arsdigita.de>.
2001-04-12 05:58:02 -07:00
hniksic 83fe8f3597 [svn] "Support DESTDIR when installing.
Patch courtesy Karl Eichwalder.
Published in <sxs4rvu2tmu.fsf@florida.arsdigita.de>.
2001-04-12 05:25:22 -07:00
hniksic a98337f827 [svn] Make seconds optional in VMS time specification.
Published in <sxs8zl62u9p.fsf@florida.arsdigita.de>.
2001-04-12 05:22:50 -07:00
hniksic 963863113f [svn] Fix retrieval of directories when initial CWD is not `/'.
Published in <sxsitkc709p.fsf@florida.arsdigita.de>.

* url.c (parseurl): Don't strip trailing slash when u->dir is "/"
because that strips the *leading* slash, thus forcing relative
FTP retrieval.
* ftp.c (getftp): Convert initial FTP directory from VMS to UNIX
notation for VMS servers.
(ftp_retrieve_dirs): Do not prepend '/' to f->name when
odir is an empty string.
2001-04-10 17:24:59 -07:00
janp 90a26b7987 [svn] Make the AM/PM fix more efficient. 2001-04-10 10:09:42 -07:00
janp 568b584271 [svn] ftp_parse_winnt_ls(): Made the fix for AM/PM more effective. 2001-04-10 10:05:43 -07:00
hniksic 5fa53b5a1d [svn] Implement better sorting and matching of cookies.
Fix previously broken command-line options.
Published in <sxspuek9255.fsf@florida.arsdigita.de>.
2001-04-10 09:04:18 -07:00
hniksic 579d051d57 [svn] Rewrite SSL #ifdef for better indentation. 2001-04-09 07:58:55 -07:00
hniksic 0c70c624f9 [svn] Fix recursive FTP retrieval so that
`wget -r ftp://<username>:<password>@host/%2Fhome/hniksic/dir/'
works.
Published in <sxsk84ug8gt.fsf@florida.arsdigita.de>.
2001-04-08 18:38:27 -07:00
hniksic 665a84b4a2 [svn] Implement tilde-expansion in file name arguments of
`.wgetrc' commands.
Published in <sxsy9tbeyh3.fsf@florida.arsdigita.de>.
2001-04-08 16:59:14 -07:00
hniksic 2cfb2d2ef6 [svn] Added support for cookies. 2001-04-08 15:25:24 -07:00
janp 7827420378 [svn] ftp-ls.c (ftp_parse_winnt_ls): The AM/PM change did assume 12:01PM ==
00:01, which was obviously wrong.
2001-04-08 07:38:12 -07:00
janp 92b944bffe [svn] The AM/PM change did assume 12:01PM == 00:01, which was obviously
wrong. Taken care of this anomaly.
2001-04-08 07:36:58 -07:00
janp 55587bdee2 [svn] ChangeLog: Removed an excess conflict marker. Reformatted the entry by
Philipp Thomas from 2001-03-09.

ftp-ls.c (ftp_parse_winnt_ls): Ensure that adjusted PM hours lay
between 0 and 23. Elminate unused variable `sec'.
2001-04-08 02:30:14 -07:00
hniksic 26547d3987 [svn] New function hash_table_count.
Published in <sxsu2403zzw.fsf@florida.arsdigita.de>.
2001-04-07 19:09:04 -07:00
hniksic b5788b5eb7 [svn] Do the namespace tweaks only on systems we know about. 2001-04-05 21:44:04 -07:00
hniksic a37e71d3d6 [svn] Cast MMAP_FAILED to char *. 2001-04-05 21:43:13 -07:00
hniksic 3ecad253f2 [svn] Include string.h. 2001-04-05 20:43:35 -07:00
hniksic 4bc1d37ccf [svn] Specify "compilation environment" that works for Linux
and Solaris.
Published in <sxs8zlezpsu.fsf@florida.arsdigita.de>.
2001-04-05 20:41:59 -07:00
hniksic 31ea5aae27 [svn] Prepend literal newline with `\n\' inside quoted string. 2001-04-05 20:06:00 -07:00
hniksic 3c6093cf13 [svn] Remove VERY_LONG_FORMAT. Instead, define function very_long_to_string
for printing VERY_LONG_TYPE numbers.
Published in <sxsd7aqzqr7.fsf@florida.arsdigita.de>.
2001-04-05 19:51:41 -07:00
hniksic c51015565a [svn] parse_uname() Would run past the end of the string if the
username was present, but the URL did not contain a slash, e.g.
http://foo:bar@myhost.
Reported by Christian Fraenkel.
2001-04-04 07:00:34 -07:00
hniksic 1d51748034 [svn] Fix support for rfc850 time recognition on systems where strptime
format specs %a and %A are not the same.
Published in <49022.983849922@ideon.st.ryukoku.ac.jp>.
2001-04-03 11:54:32 -07:00
hniksic a3eea37c91 [svn] Small cleanup of mswindows.c by Paul Bludov.
Published in <wget-patches@sunsite.auc.dk>.
2001-04-03 11:22:04 -07:00
hniksic d62d112aed [svn] Remove stray conflict marker. 2001-04-03 09:19:23 -07:00
hniksic f1d534cd8c [svn] Make `-c' and `-O' work together.
Published in <sxsitkmgokh.fsf@florida.arsdigita.de>.
2001-04-03 05:24:49 -07:00
hniksic 66a0c39e22 [svn] Make sure opt.dfp is rewound only on the first retrieval.
(See the code comment for a more detailed explanation.)
Published in <sxsy9tkqizz.fsf@florida.arsdigita.de>.
2001-04-01 16:50:04 -07:00
hniksic 1810f7a442 [svn] Handle trailing whitespace in .netrc. Published in
<sxsitkofbfw.fsf@florida.arsdigita.de>.
2001-04-01 16:28:25 -07:00
hniksic cee04f2ef3 [svn] Fix memory allocation in cmd_address().
Published in <sxs66gogt0k.fsf@florida.arsdigita.de> under
the subject "Fix for opt.bind_address".
2001-04-01 15:23:52 -07:00
hniksic 20a4341e1a [svn] Wget was ignoring an error when getting a directory failed.
Fix courtesy Nicolas Lichtmaier.
2001-04-01 14:34:40 -07:00
hniksic 4dbad3a894 [svn] Make sure -C is recognized. 2001-04-01 14:26:28 -07:00
hniksic a52aaeb451 [svn] Make sure -c doesn't truncate the file.
Published in <sxsofuhi4kc.fsf@florida.arsdigita.de>.
2001-04-01 13:04:21 -07:00
hniksic aa888ba8da [svn] Don't clear dl_file_url_map and dl_url_file_map in recursive_retrieve.
Published in <sxsk856le2y.fsf@florida.arsdigita.de> under the subject
"Link conversion fix".
2001-03-31 18:41:26 -08:00
hniksic 22240955e6 [svn] Undef xmalloc and friends before redefining them when standalone. 2001-03-30 21:07:10 -08:00
hniksic 8c4cd805e2 [svn] Oops! Fix braino in recur.c -- clear the hash tables only when
they are defined.
2001-03-30 18:21:20 -08:00
hniksic 8f048b7be8 [svn] Committed my patch that makes HTTP code close its socket in premature
returns (before the body was drained).  Published in
<sxsd7ayn0kt.fsf@florida.arsdigita.de>.
2001-03-30 18:20:16 -08:00
hniksic 728584d072 [svn] Record downloaded files and downloaded HTML files in all cases.
Published under the subject "Link conversion fix" in
<sxsn1a2n2zd.fsf@florida.arsdigita.de>.
2001-03-30 18:05:54 -08:00
hniksic e4d49f0b40 [svn] Published my patch "main.c tweaks" published in
<sxspueyonjt.fsf@florida.arsdigita.de>.
2001-03-30 15:17:59 -08:00
hniksic 1a6058b1ec [svn] Applied Philipp Thomas's safe-ctype patch. Published in
<20010330025159.U21662@jeffreys.suse.de>.
2001-03-30 14:36:59 -08:00
dan f486b43c23 [svn] * {.,doc,src,util,windows}/Makefile.in: Moved top_builddir out of "User
configuration section" of top Makefile and analogous spot in others.

* po/Makefile.in.in: Previous addition of top_builddir to
  po/Makefile.in was bogus -- it's generated from po/Makefile.in.in.
2001-03-27 03:23:59 -08:00
dan d41af5f52e [svn] Linking with OpenSSL previously required the user to set up all the
appropriate -I, -L, and -R/-rpath flags in environment variables,
manually.  Automated everything, including bundling libtool so we can
successfully link with the OpenSSL shared libraries on just about any
platform.
2001-03-17 06:21:19 -08:00
janp 5014d32c3a [svn] Skip `:port' in the host header if it is the DEFAULT_HTTPS_PORT when
using SSL. Patch submitted by Hack Kampbjorn <hack@hackdata.com>.
2001-03-08 15:11:03 -08:00
hniksic 71a53ffe25 [svn] Applied Jonas Jensen's patch to correctly calculate the number of bytes
in the first line of the download that.
Published in <sxsu25hioxj.fsf@florida.arsdigita.de>.
2001-03-01 14:25:20 -08:00
dan b6febbc84b [svn] * po/*.po*: Updated after moving -nr to a different category.
* wget.texi: Moved -nr from "Recursive Retrieval Options" to "FTP Options" and
  gave it a @cindex entry. Alphabetized FTP options by long option name.

* main.c (print_help): -nr belongs in "FTP options" section of --help output,
  not "Recursive retrieval" section.  Alphabetized FTP options by long option
  name.
2001-02-23 13:31:54 -08:00
dan 2aa1d53fb2 [svn] * main.c (print_help): --help documentation for -N said it would re-download
files if they had the _same_ timestamp on server.

* po/*.po*: Updated after changing --help's description of -N.
2001-02-23 12:43:35 -08:00
dan 4fc318600e [svn] init.c (commands): Hack Kampbj?rn <hack@hackdata.com> discovered that
"httpsproxy" had been inserted into commands[] out of alphabetical order,
causing "BUG: unknown command `httpuser'".
2001-02-16 21:26:34 -08:00
janp b3bb9b7ed9 [svn] Changes in FTP listing parser code - suport for VMS and MacOS, removed
dependency on ftpparse as the copyright issue has not been resolved.
2001-02-12 23:50:27 -08:00
janp 004b339d2e [svn] Removed ftpparse dependencies. New parser for VMS listings. MacOS
NetPresenz FTP sevber is now supported.
2001-02-12 23:44:59 -08:00
janp ccfe785e9e [svn] Changes related to ftpparse removal. 2001-02-12 23:40:53 -08:00
janp ae23f01b07 [svn] Removed because of unclear copyright statement and unwillingess of
original author to resolve this.
2001-02-12 23:40:14 -08:00
hniksic 164ccc9e41 [svn] ChangeLog tweak; initialize con to appease the access checker. 2001-02-11 09:27:37 -08:00
hniksic 54811e2832 [svn] Applied Jan's patch to allow non-quoted @ character in
passwords.  Published in <20010106173455.A9455@erwin.telekabel.at>.
2001-02-10 16:28:22 -08:00
hniksic b370dd1914 [svn] Applied Hack Kampbjorn's patch to print FTP type in debug output.
Published in <3A7D94B5.D9B932FB@hackdata.com>.
2001-02-10 16:06:59 -08:00
hniksic 366b832e3f [svn] Applied Jonas Jensen's download rate patch with my additions.
Published in <015b01c09084$ce2d9330$0100000a@bob> and
<sxspugq3xai.fsf@florida.arsdigita.de>.
2001-02-10 16:00:30 -08:00
hniksic fdc20de365 [svn] Applied Tim Mooney's patch that fixes a build problem under Tru64.
Published in
<Pine.OSF.4.33.0102072244450.2714-100000@dogbert.cc.ndsu.NoDak.edu>.
2001-02-10 14:37:12 -08:00
hniksic 07f60f19a4 [svn] Applied Christian Fraenkel's patch "custom certificate patch for wget-1.7+dev;
2nd try", published in <200102082132220160.00474E73@pop.gmx.net>.
It adds two options for custom certificates.
2001-02-10 14:33:31 -08:00
hniksic 2f6cd9d698 [svn] Changes according to Herold Heiko's instructions how to make alloca()
work under Windows: don't try to compile alloca.c, *and* don't forget
to include <malloc.h>.

Published in <sxsbssyibsu.fsf@florida.arsdigita.de>.
2001-01-23 06:27:40 -08:00
dan fa636eb71d [svn] url.c (str_url): Clarified this function's comment header after Hrvoje answered
my question on the list as to when hide != 1.  Also Hrvoje pointed out I need to
use xstrdup() on the string literal.
2001-01-10 22:16:46 -08:00
hniksic 3f91c7dfe1 [svn] Declare addrlen as int. Published in <sxsu27cbtzu.fsf@florida.arsdigita.de>. 2001-01-10 07:06:00 -08:00
dan 17e21ff7dd [svn] Jan did make a ChangeLog entry for his fix of the non-anonymous FTP recursion
bug.  I just didn't use the right terms when searching for it.
2001-01-10 00:53:42 -08:00
dan f84a94e913 [svn] Made clarifications and corrections to --continue's --help output and wget.texi
documentation.  Published in <200101100629.WAA09744@dilvish.speed.net>.
2001-01-09 22:51:51 -08:00
dan 48cf02169d [svn] Just clarified a comment in the fix I just committed. 2001-01-09 20:32:29 -08:00
dan 1993e140f2 [svn] url.c (str_url): Henrik van Ginhoven pointed out on the list that we shouldn't
give away the number of characters in the password by replacing each character
with a 'x'.  Use "<password>" instead.
2001-01-09 20:30:43 -08:00
dan 7140f393b2 [svn] When did the bug get fixed where recursive FTP would fail if logging in put
you in a directory other than "/"?  I don't see a src/ChangeLog entry for
it.  In any case, my testing shows that it's fixed in 1.7-dev, but TODO and
a comment in src/ftp.c were not changed to reflect this.
2001-01-09 20:17:06 -08:00
dan 040aae87b5 [svn] html-url.c: A bunch of fixup of `--page-requisites'-related comments to reflect
Hrvoje's changes to my code when transplanting it into this new file, to fix
spelling mistakes, to clarify, etc.
2001-01-09 18:54:52 -08:00
dan bc5fd29baf [svn] 2001-01-09 Dan Harkless <wget@harkless.org>
* html-url.c: Addition and clarification of comments related to -p.

	* url.c (write_backup_file): Clarified a comment.
	  [Committed this fix separately.]
2001-01-09 18:28:24 -08:00
dan a77dc45c4d [svn] Hrvoje's response to my "wondering" comment in write_backup_file() read
extremely strangely without adding tags to show who was saying what.  Also, one
of his phrases was very misleading.
2001-01-09 18:10:16 -08:00
dan cbe2ca1b80 [svn] Here're the changes we agreed to on the wget mailing list regarding the
multiple-branches ChangeLog problem.  Note the new directories -- you'll need to
do a cvs update -d.
2001-01-06 01:26:02 -08:00
hniksic 35325bd092 [svn] Include fragment identifiers in converted URLs. Published in
<sxs8zorl90l.fsf@florida.arsdigita.de>.
2001-01-04 05:53:53 -08:00
hniksic f579cd1691 [svn] Csaba's Watcom changes. 2001-01-03 07:14:02 -08:00
dan 67bfa88fd8 [svn] ChangeLog: Since this flat file doesn't have multiple branches,
looking at the dates would make you think that things went into
1.6 that actually just went into the 1.7-dev branch.  Added "[Not
in 1.6 branch.]" where appropriate to clarify.
2000-12-31 04:45:42 -08:00
dan 86413b1d83 [svn] Need to say that stuff I did before releasing 1.6 happened on 12-30, not 12-31. 2000-12-31 04:10:59 -08:00
dan e979053779 [svn] 2000-12-31 Dan Harkless <wget@harkless.org>
* ftp.c, http.c:  Applied Hack Kampbj?rn <hack@hackdata.com>'s
        patch to deal with h_errno not being defined in netdb.h under Cygwin.

2000-12-30  Dan Harkless  <wget@harkless.org>

        * version.c: Released Wget version 1.6.  Note that on this branch we
        never actually had the version set to 1.6, but we still need the
        ChangeLog comment for posterity.
2000-12-31 04:04:14 -08:00
dan f105b3e43f [svn] Changed my address from dan-wget@dilvish.speed.net to wget@harkless.org
everywhere -- dilvish will probably be going away soon.
2000-12-31 03:18:37 -08:00
hniksic 23cbd15095 [svn] Igor Khristophorov's fix for check_end(). From
<sxs4s027snq.fsf@florida.arsdigita.de>.
2000-12-17 11:31:30 -08:00
hniksic 5099ec0306 [svn] Apply lint-expired fixes from <sxsn1du7ufa.fsf@florida.arsdigita.de>. 2000-12-17 10:52:52 -08:00
hniksic f6a41b5669 [svn] Applied Csaba Raduly's patch from <802569B4.0043F7B1.00@Jagannath.uk.sophos>. 2000-12-17 10:18:14 -08:00
hniksic 2e8fc46b7b [svn] Include <netdb.h> where h_errno is used. Likewise for <errno.h> and errno.
From <sxsvgsi7wcw.fsf@florida.arsdigita.de>.
2000-12-17 10:12:02 -08:00
hniksic b84f96df34 [svn] Use '"' rather than '\"' in assert. 2000-12-13 05:37:37 -08:00
hniksic 28b5cd706f [svn] Removed. 2000-12-10 18:53:02 -08:00
hniksic bdea0b3bf6 [svn] Made xfree alias to free if memory debugging is not used.
From <sxsd7ezd7p2.fsf@florida.arsdigita.de>.
2000-12-10 18:17:44 -08:00
hniksic d5cd691b12 [svn] Fix -O timestamp bug.
From <sxs7l57u6o6.fsf@florida.arsdigita.de>.
2000-12-10 16:47:44 -08:00
hniksic 62b876401e [svn] Set the timestamp even when -O is used. 2000-12-10 16:31:14 -08:00
hniksic 3665d73453 [svn] Removed. 2000-12-09 18:25:19 -08:00
hniksic afe131624b [svn] Add , before `int ssl'. 2000-12-06 09:22:27 -08:00
hniksic cab759659e [svn] Move inclusion of gen_ssl.h below Wget's headers. 2000-12-06 09:18:14 -08:00
hniksic b0e9dfd4e2 [svn] Fix opt.wait. 2000-12-05 16:24:40 -08:00
hniksic 47c6092ec4 [svn] Use a single version of RBUF_READCHAR. 2000-12-05 15:50:34 -08:00
hniksic e754c99b46 [svn] Cosmetic cleanup of SSL stuff. 2000-12-05 15:35:56 -08:00
hniksic ac5d0a9e4d [svn] New files. 2000-12-05 15:26:13 -08:00
hniksic 7828e81c79 [svn] Committed C. Frankel's SSL patch. 2000-12-05 15:09:41 -08:00
hniksic dc78acde56 [svn] Use the proper Jan's changelog entry. 2000-12-05 15:03:46 -08:00
hniksic d1a855786c [svn] ChangeLog for Jan's last patch. 2000-12-05 14:44:46 -08:00
hniksic 7b5ad90acf [svn] Commit my url.c fix (space as unsafe character) and Jan's
winnt directory listing parsing.
2000-12-05 14:29:47 -08:00
hniksic 518fe8d06d [svn] Do away with line separator. 2000-11-29 08:19:46 -08:00
hniksic 7e900c50bf [svn] Undo Jan's typo fix. 2000-11-25 03:51:14 -08:00
hniksic 62994ffc8c [svn] Applied Karl Eichwalder's patch from
<20001124044348.AF524DD15E@tux.gnu.franken.de>.
2000-11-24 05:51:36 -08:00
hniksic 7c750db580 [svn] More memory debug tweaks.
Published in <sxs4s0z2bwi.fsf@florida.arsdigita.de>.
2000-11-23 13:44:56 -08:00
hniksic 1cddc05edb [svn] Committed memory debugging stuff.
Published in <sxs1yw34pt4.fsf@florida.arsdigita.de>.
2000-11-22 14:15:45 -08:00
hniksic d8c9ce30aa [svn] Make sure xfree is #define'd in standalone mode in files that
support one.
2000-11-22 09:00:31 -08:00
hniksic 2ffb47eabf [svn] Committed <sxsbsv854j9.fsf@florida.arsdigita.de>. 2000-11-22 08:58:28 -08:00
hniksic 9439a6659b [svn] Fixup ftpparse dependencies. 2000-11-21 09:01:39 -08:00
hniksic c3d636db03 [svn] Committed Jan's ftpparse patch with Hrvoje's modifications.
<sxshf518e72.fsf@florida.arsdigita.de>.
2000-11-21 08:48:39 -08:00
hniksic d6a57bc2a6 [svn] Commit hash table bugfix.
Published in <sxs8zqd9x1g.fsf@florida.arsdigita.de>.
2000-11-21 08:42:29 -08:00
hniksic 45eee9e56c [svn] Remove stray debugging statement. 2000-11-20 19:08:41 -08:00
hniksic 6e598c81e3 [svn] Committed a bunch of different tweaks of mine.
Published in <sxsr9463wrx.fsf@florida.arsdigita.de>.
2000-11-20 18:06:36 -08:00
hniksic fb42069e51 [svn] Constify check_end(). 2000-11-20 02:25:28 -08:00
hniksic 7302e69dc2 [svn] Improved comments for the persistent connections feature. 2000-11-20 02:20:39 -08:00
hniksic 6f7fd37186 [svn] Auth tweaks.
Published in <sxs3dgnz955.fsf@florida.arsdigita.de>.
2000-11-19 18:10:54 -08:00
hniksic ba3f5ce0a2 [svn] Bump version number. 2000-11-19 16:15:21 -08:00
hniksic f2f77d87fd [svn] New option --no-http-keep-alive.
Published in <sxsd7fr1pdf.fsf@florida.arsdigita.de>.
2000-11-19 16:04:06 -08:00
hniksic b27144fcce [svn] My patch "persistent connection tweaks".
Published in <sxshf531qhj.fsf@florida.arsdigita.de>.

(Applied with the addition of correct calculation for the
length of the request.)
2000-11-19 15:42:13 -08:00
hniksic b0b1c815c1 [svn] A bunch of new features:
- use mmap() to read whole files in core instead of allocating memory
  and read'ing it.

- use a new, more general, HTML parser (html-parse.c) and interface to
  it from Wget (html-url.c).

- respect <meta name=robots content=nofollow> (easy with the new HTML
  parser).

- use hash tables instead of linked lists in places where the lists
  were used to facilitate mappings.

- rewrite the code in host.c to be more readable and faster (hash
  tables instead of home-grown lists.)

- make convert_links properly convert partial URLs to complete ones
  for those URLs that have *not* been downloaded.

- use HTTP persistent connections where available.  very
  simple-minded, caches the last connection to the server.

Published in <sxshf533d5r.fsf@florida.arsdigita.de>.
2000-11-19 12:50:10 -08:00
hniksic ccf31643ab [svn] vsnprintf() fixup. 2000-11-16 08:37:49 -08:00
hniksic cc3b6eb3e4 [svn] Do the _XOPEN_SOURCE/_SVID_SOURCE things only on Linux. 2000-11-15 10:10:01 -08:00
hniksic 6a70f04a5c [svn] Don't clutter the host list with duplicate hosts.
Published in <sxsitpt56eh.fsf@florida.arsdigita.de>.
2000-11-12 16:46:13 -08:00
hniksic e1f1c1ff40 [svn] Better version of read_whole_line().
Published in <sxsr94jd7z4.fsf@florida.arsdigita.de>.
2000-11-10 10:01:35 -08:00
hniksic e18ca280fb [svn] Fix off-by-one error in comind().
Published in <sxsvgtvdcki.fsf@florida.arsdigita.de>.
2000-11-10 08:20:55 -08:00
hniksic f306ae9626 [svn] Changed last_slash[-1] to *(last_slash - 1). 2000-11-08 07:51:28 -08:00
hniksic b72b6cf387 [svn] Correctly handle URLs where / does not follow the host name.
Published in <sxsn1fag6zu.fsf@florida.arsdigita.de>.
2000-11-08 01:15:40 -08:00
hniksic 34ea31bb01 [svn] Sort commands[]. 2000-11-07 03:43:36 -08:00
hniksic 0e2b74ce3b [svn] Commit "minor fixes". 2000-11-06 13:24:57 -08:00
hniksic 366ad1d6d9 [svn] Rewrote the logging code.
Published at <sxs1ywrf300.fsf@florida.arsdigita.de>.
2000-11-04 20:38:31 -08:00
hniksic c2c821b3c9 [svn] snprintf.c addition. 2000-11-04 14:49:46 -08:00
hniksic eef4a668b7 [svn] Update copyright blurbs with the year 2000. 2000-11-01 17:50:03 -08:00
hniksic 6e23da9254 [svn] Hide password from URL when non-verbose, too. 2000-11-01 17:41:20 -08:00
hniksic c6575c6382 [svn] Another contributed fix... 2000-11-01 17:06:57 -08:00
hniksic 6eb0870af0 [svn] Contributed fix. 2000-11-01 17:02:56 -08:00
hniksic 986c445029 [svn] Fixed minor memory leaks. 2000-11-01 16:18:27 -08:00
hniksic b3758323ed [svn] Applied contributed fix. 2000-11-01 15:57:19 -08:00
hniksic b7a8c6d3f5 [svn] Gracefully handle opt.downloaded overflowing.
Published in <sxsd7gfnv17.fsf@florida.arsdigita.de>.
2000-11-01 15:17:31 -08:00
hniksic 29cdc8da20 [svn] Updated long_to_string(); enhanced opt.downloaded to use
64-bit types where available.
Published in <sxswvenqsmn.fsf@florida.arsdigita.de> and
<sxssnpbqshp.fsf@florida.arsdigita.de>.
2000-11-01 13:51:25 -08:00
hniksic b9eeb0c54c [svn] Fix "optimization" of query-strings in URLs.
Published in <sxs3dhbwnmw.fsf@florida.arsdigita.de>.
2000-11-01 10:31:53 -08:00
hniksic 6d13e17142 [svn] Detect redirection cycles.
Published in <sxsd7ggtjac.fsf@florida.arsdigita.de>.
2000-10-31 20:21:50 -08:00
hniksic 515d82fb95 [svn] Committed my patch from <sxsy9z4xz5m.fsf@florida.arsdigita.de>
(recognize HTML entities.)
2000-10-31 17:25:12 -08:00
hniksic 846b045a69 [svn] Applied my patch from <sxs3dhczfv5.fsf@florida.arsdigita.de>. 2000-10-31 16:38:57 -08:00
hniksic f6715dd08d [svn] Committed my patch from <sxs7l6ozghz.fsf@florida.arsdigita.de>. 2000-10-31 16:26:33 -08:00
hniksic 0dd418242a [svn] Committed my patches from <sxsbsw16sbu.fsf@florida.arsdigita.de>
and <sxsvgu824xk.fsf@florida.arsdigita.de>.
2000-10-31 11:25:32 -08:00
hniksic b095202cad [svn] Applied Adrian Aichner's patch from
<20001029223711.28688.qmail@web10601.mail.yahoo.com>.
2000-10-30 13:07:04 -08:00
dan 24c465b5ad [svn] retr.c (retrieve_url): Manually applied T. Bharath
<TBharath@responsenetworks.com>'s patch to get wget to grok illegal relative URL
redirects.  Reformatted and re-commented it.
2000-10-27 20:18:20 -07:00
dan 1396b30055 [svn] Manually applied Rob Mayoff <mayoff@dqd.com>'s patch (vs. 1.5.3, not 1.5.3+dev)
to add --bind-address, making many necessary alphabetization, coding style,
comment, documentation, and naming fixes and additions.
2000-10-23 23:19:17 -07:00
dan 2fbb4936a0 [svn] main.c (print_help): Clarified that --delete-after deletes local files. 2000-10-23 20:52:34 -07:00
dan f4673bcdaf [svn] --delete-after wasn't implemented for files retrieved by FTP or corresponding to
files specified on the commandline.  Made --convert-links be ignored when
--delete-after is specified.  Added note about this fact to --delete-after docs
and made general improvements to them, including the clarification that
--delete-after only deletes local files.
2000-10-23 20:43:47 -07:00
hniksic 778160a155 [svn] hniksic@iskon.hr -> hniksic@arsdigita.com 2000-10-23 08:43:04 -07:00
dan 8a9be7627d [svn] ftp.c (getftp): Applied Piotr Sulecki <Piotr.Sulecki@ios.krakow.pl>'s
patch to work around FTP servers that incorrectly respond to the
          	"REST" command with the remaining size rather than the total
          	file size.
2000-10-20 00:28:57 -07:00
dan 8cf52e0dd3 [svn] Applied John Daily <jdaily@cyberdude.com>'s patch for his "quad" commands (which
I renamed to "lockable_boolean") in the .wgetrc (currently just passive_ftp).
Wrote documentation for his changes and added the missing "referer" to the
.wgetrc section (making mention of the issue of "referrer" being the correct
spelling).
2000-10-19 23:59:30 -07:00
dan b3e2c0ff97 [svn] Implemented and documented new -E / --html-extension / html_extension option. 2000-10-19 22:55:46 -07:00
dan cbf018d0c0 [svn] --retr-symlinks was not previously documented properly. Based on my newfound
understanding of what its limitations are, added a TODO item.  Also made a minor
tweak in html.c to silence a warning.
2000-10-09 15:43:11 -07:00
dan 570f12e437 [svn] Accidentally said "system.wgetrc" instead of "system wgetrc". 2000-08-30 14:08:06 -07:00
dan 7931200609 [svn] * *.{gmo,po,pot}: Regenerated after modifying wget --help output.
* ftp.c (ftp_retrieve_list): Use new INFINITE_RECURSION #define.

* html.c: htmlfindurl() now takes final `dash_p_leaf_HTML' parameter.
Wrapped some > 80-column lines.  When -p is specified and we're at a
leaf node, do not traverse <A>, <AREA>, or <LINK> tags other than
<LINK REL="stylesheet">.

* html.h (htmlfindurl): Now takes final `dash_p_leaf_HTML' parameter.

* init.c: Added new -p / --page-requisites / page_requisites option.

* main.c (print_help): Clarified that -l inf and -l 0 both allow
infinite recursion.  Changed the unhelpful --mirrior description
to simply give the options it's equivalent to.  Added new -p option.
(main): Added some comments; handle new -p / --page-requisites.

* options.h (struct options): Added new page_requisites field.

* recur.c: Changed "URL-s" to "URLs" and "HTML-s" to "HTMLs".
Calculate and pass down new `dash_p_leaf_HTML' parameter to
get_urls_html().  Use new INFINITE_RECURSION #define.

* retr.c: Changed "URL-s" to "URLs".  get_urls_html() now takes
final `dash_p_leaf_HTML' parameter.

* url.c: get_urls_html() and htmlfindurl() now take final
`dash_p_leaf_HTML' parameter.

* url.h (get_urls_html): Now takes final `dash_p_leaf_HTML' parameter.

* wget.h: Added some comments and new INFINITE_RECURSION #define.

* wget.texi (Recursive Retrieval Options): Documented new -p option.
2000-08-30 04:26:21 -07:00
dan 001392bf2b [svn] * main.c (print_help): -B / --base was not mentioned. 2000-08-23 15:40:20 -07:00
dan 1f0acebeb0 [svn] * main.c (print_help): Modified -nc description to mention that it also prevents
the creation of multiple versions of the same file with ".<number>" suffixes.
2000-08-22 20:11:55 -07:00
hniksic 7794db052c [svn] Committed Jan Prikryl's patch from
<20000709171425.A16267@launzatte.cg.tuwien.ac.at>.
2000-07-14 07:15:23 -07:00
dan ae77e4f08e [svn] Oops. Meant to check this change in with my last one, but the commit wouldn't
go through without doing an update first, and I forgot to make the change the
second time.  Just changed an erroneous main.c (main) to main.c (print_help).
2000-06-09 14:40:26 -07:00
dan eea2d24220 [svn] Heiko's --help output for --waitretry was over 80 columns. Shortened. It also
said that 0 seconds are waited after the first retry, which I believe is
incorrect and does not match what's written elsewhere (e.g. wget.texi).  Changed
to 1.
2000-06-09 13:59:56 -07:00
hniksic 1765080b2e [svn] Comment fix. 2000-06-09 01:03:19 -07:00
hniksic 2e806fb2f3 [svn] Don't try to chmod() symlinks. 2000-06-01 04:20:05 -07:00
hniksic 0eec6b9f30 [svn] Committed my patch <dpem6hln1k.fsf@mraz.iskon.hr>. 2000-06-01 03:47:03 -07:00
dan b05feb3ae2 [svn] Damir Dzeko <ddzeko@zesoi.fer.hr> did not document his new --referer option.
Did so (--help output and wget.texi).  Also tweaked --help output for --execute.
2000-05-22 19:29:38 -07:00
hniksic ee6065f581 [svn] Committed my patch from <dpd7mj3sap.fsf@mraz.iskon.hr>. 2000-05-19 00:37:22 -07:00
hniksic 80cebf2a76 [svn] hniksic@srce.hr -> hniksic@iskon.hr 2000-04-21 02:34:39 -07:00
hniksic 094481c386 [svn] Committed host.c patch from <dpk8i3za97.fsf_-_@mraz.iskon.hr>. 2000-04-14 02:31:21 -07:00
hniksic 6b4a85888e [svn] Commit several fixes. 2000-04-12 06:23:35 -07:00
dan 1ecfed1e10 [svn] * host.c (store_hostaddress): R. K. Owen's patch introduces a "left shift count
>= width of type" warning on 32-bit architectures.  Got rid of it by tricking
  the compiler w/ a variable.

* url.c (UNSAFE_CHAR): The macro didn't include all the illegal characters per
  RFC1738, namely everything above '~'.  It also generated a warning on OSes
  where char =~ unsigned char.  Fixed.
2000-04-04 20:08:10 -07:00
hniksic bc7060a81d [svn] More old fixes. 2000-03-31 06:14:58 -08:00
hniksic aeabb42714 [svn] Commit another old fix. 2000-03-31 06:08:57 -08:00
hniksic 858adf01cd [svn] Fix store_hostaddress() on big-endian 64-bit machines. 2000-03-31 06:07:07 -08:00
hniksic dee64b0b16 [svn] Fix indentation. 2000-03-31 06:05:53 -08:00
hniksic 0d42b49e30 [svn] Commit really old change. 2000-03-31 06:04:54 -08:00
hniksic 6b0aaebf33 [svn] Committed patch from <dp8zyzz1se.fsf@mraz.iskon.hr>. 2000-03-31 05:51:53 -08:00
hniksic c71f174ed6 [svn] Changes from <9t9pusol5a1.fsf@mraz.iskon.hr>. 2000-03-21 07:47:45 -08:00
dan 4454f6ce0a [svn] * TODO: Removed done item: we now have an option (-G) that makes it easy to
download a single HTML document and all its constituents.

* po/*.{gmo,po,pot}: Regenerated after adding new options.

* po/hr.po: Hrvoje forgot '\n's on his translations of my altered messages,
causing msgfmt to balk and `make install' to fail.


* wget.texi (Recursive Retrieval Options): In -K description, added a link to
the discussion of interaction with -N.
(Recursive Accept/Reject Options): Did some alphabetizing and added descriptions
of new --follow-tags and -G / --ignore-tags options.
(Following Links): Changed "the loads of" to "loads of".
(Wgetrc Commands): Added descriptions of new follow_tags and ignore_tags
commands.


* html.c (idmatch): Implemented checking of my new --follow-tags and
--ignore-tags options.

* init.c (commands): Added comment reminding people adding new entries doing
allocation to add corresponding freeing in cleanup().
(commands): Added new followtags and ignoretags commands.
(cleanup): Free storage for new followtags and ignoretags.

* main.c: Use of "comma-separated list" was random -- normalized it.  Did some
alphabetization.  Added comments pointing out "Options without arguments" and
"Options accepting an argument" sections of long_options[].  Added new options
--follow-tags and -G / --ignore-tags.  Added comment that Damir's --referer is
currently undocumented.  Added comment that Heiko's --waitretry is partially
undocumented (mentioned in --help but not in wget.texi).  Moved improperly
sorted 24, 129, and 'G' cases.

* options.h (struct options): Added new fields follow_tags and ignore_tags.

* wget.h: Added "#define EQ 0" so we can say "strcmp(a, b) == EQ".
2000-03-10 22:48:06 -08:00