moparisthebest/wget
1
0
Fork 0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Code Issues Releases Wiki Activity
1,698 Commits 1 Branch 0 Tags 9.6 MiB
2152b6bd70
Commit Graph

1071 Commits

Author SHA1 Message Date
hniksic
92b269acad [svn] Match hosts against domains per Netscape cookie "specification". 
Published in <sxszo53v8by.fsf@florida.arsdigita.de>.
 2001-11-30 21:08:03 -08:00
hniksic
f4d019a423 [svn] Correctly convert links in <meta http-equiv=Refresh content="...">. 
Published in <sxsadx3wp49.fsf@florida.arsdigita.de>.
 2001-11-30 20:18:51 -08:00
hniksic
4901488011 [svn] Bump version to 1.8-beta1+cvs. 2001-11-30 19:21:52 -08:00
hniksic
1f272be070 [svn] Bump version to 1.8-beta1. 2001-11-30 19:09:14 -08:00
hniksic
7ab7f93f8d [svn] Make -p work with framed pages. 
Published in <sxsu1vby71t.fsf@florida.arsdigita.de>.
 2001-11-30 19:06:41 -08:00
hniksic
406fb8bbef [svn] Don't allow more than 20 successive redirections. 2001-11-30 13:33:31 -08:00
hniksic
a4db28e20f [svn] Ignore -np when in -p mode. 
Published in <sxsg06w2c52.fsf@florida.arsdigita.de>.
 2001-11-30 13:17:53 -08:00
hniksic
ca5098a425 [svn] Update copyright statement. 2001-11-30 02:50:29 -08:00
hniksic
c828d1e8be [svn] Remove doc reference to non-extant ngethostbyname. 2001-11-30 02:44:17 -08:00
hniksic
5baed885db [svn] Fix netrc authorization in conjunction with HTTP. 
Submitted by Daniel BODEA in <011901c162ca$19779df0$25c0a8c0@GHOTIX>.
 2001-11-30 01:33:22 -08:00
hniksic
2c37aef2d8 [svn] Don't forget to shutdown the SSL structure if the socket times out. 
Submitted by T. Bharath in <3B3DEBC7.2537186A@responsenetworks.com>.
 2001-11-30 00:57:03 -08:00
hniksic
b4b0659e43 [svn] Fix preprocessor indentation. 2001-11-30 00:36:22 -08:00
hniksic
7674ecd97e [svn] Simplify display_image. 2001-11-30 00:02:33 -08:00
hniksic
ae3c268719 [svn] Implement EGD support. 
Submitted by Christian Fraenkel in <005501c17920$1312d440$4a05a8c0@isn>.
 2001-11-29 23:39:08 -08:00
hniksic
999388bfa0 [svn] Check for memmove and implement one if it's missing. 2001-11-29 11:43:29 -08:00
hniksic
b6bbc32e14 [svn] Guard against header files getting included twice. 2001-11-29 10:55:52 -08:00
hniksic
b65661a879 [svn] Remove char/unsigned char warnings emitted by Sun cc. 2001-11-29 10:48:43 -08:00
hniksic
fb98d1e4b0 [svn] Remove implicit declaration warnings. 2001-11-29 10:22:18 -08:00
hniksic
a3d3d452ab [svn] Make the MD5 references even more generic. 
Use OpenSSL's MD5 where available.
Published in <sxsg06x4f41.fsf@florida.arsdigita.de>.
 2001-11-29 10:17:54 -08:00
hniksic
39482df431 [svn] descend_url_p: When resolving no_parent, compare with the start url, 
not the parent url.
Published in <sxspu614ikm.fsf@florida.arsdigita.de>.
 2001-11-29 09:04:28 -08:00
hniksic
c99228cab2 [svn] Debugging function. 2001-11-29 06:57:30 -08:00
hniksic
9c1c7f27cd [svn] Windows fixes by Herold Heiko. 2001-11-29 06:15:11 -08:00
hniksic
bb8e524316 [svn] Initialize al->faulty. 
Published in <sxsvgft65an.fsf@florida.arsdigita.de>.
 2001-11-29 06:06:03 -08:00
hniksic
6218fbed2b [svn] Accept the broken Content-Range format emitted by Sun's server. 
Published in <sxsg06x7kld.fsf@florida.arsdigita.de>.
 2001-11-29 06:03:33 -08:00
hniksic
fb7fb36cb8 [svn] Resurrect opt.dot_style. 2001-11-27 18:44:18 -08:00
hniksic
f0dff25336 [svn] Fix typo. 2001-11-27 18:24:22 -08:00
hniksic
d4c6949a05 [svn] Use rand instead of random. 
Published in <sxsu1vgataq.fsf@florida.arsdigita.de>.
 2001-11-27 11:49:28 -08:00
hniksic
9b202ba261 [svn] * retr.c (retrieve_from_file): Initialize `new_file' to NULL to 
prevent seg fault.
Submitted by Ian Abbott in <3C03DE8A.845.D0E495@localhost>.
 2001-11-27 11:14:34 -08:00
hniksic
8196a09904 [svn] Don't reuse IP addresses proven to be faulty, unless only such ones remain. 
Published in <sxs8zcsfemf.fsf@florida.arsdigita.de>.
 2001-11-27 06:55:40 -08:00
hniksic
cca7541b10 [svn] Don't translate %d-%d. 2001-11-27 04:58:09 -08:00
hniksic
1c906e47d3 [svn] Remove stray HAVE_RANDOM check from main.c. 2001-11-27 04:54:31 -08:00
hniksic
9656223552 [svn] Fix FTP PASV output. 
Published in <sxslmgsfkgj.fsf@florida.arsdigita.de>.
 2001-11-27 04:49:13 -08:00
hniksic
baf8750197 [svn] Default the progress implementation to "bar". 
Published in <sxsu1vgfqx7.fsf@florida.arsdigita.de>.
 2001-11-27 02:29:45 -08:00
hniksic
69c78db55b [svn] Commence bar progress with two newlines. 2001-11-27 02:17:09 -08:00
hniksic
7175ea4a12 [svn] Check for random. 
Published in <sxs4rngh6t2.fsf@florida.arsdigita.de>.
 2001-11-27 02:11:13 -08:00
hniksic
bae3162c03 [svn] New option `--limit-rate'. 
Published in <sxsd725cn56.fsf@florida.arsdigita.de>.
 2001-11-26 12:07:13 -08:00
hniksic
278fb2412d [svn] Declare ERR in gethttp. 
Submitted by Ian Abbott in <3C022295.15135.464B54@localhost>.
 2001-11-26 04:51:25 -08:00
hniksic
84396de673 [svn] Allocate a timer directly in get_contents. 
Published in <sxsherhbsvl.fsf@florida.arsdigita.de>.
 2001-11-26 04:49:10 -08:00
hniksic
024cb5ed3a [svn] A lot of host name changes. 
Published in <sxs3d32856s.fsf@florida.arsdigita.de>.
 2001-11-25 21:36:33 -08:00
hniksic
f6921edc73 [svn] Be careful whether we want to descend into results of redirection. 
Published in <sxs7kse8hmq.fsf@florida.arsdigita.de>.
 2001-11-25 17:11:48 -08:00
hniksic
2c41d783c6 [svn] New option --random-wait. 
Submitted by Alan Eldridge in
<200111042106.fA4L63b75804@wwweasel.geeksrus.net>.
 2001-11-25 13:23:15 -08:00
hniksic
3afb9c659a [svn] Recursion and progress bar tweaks. 
Published in <sxsd727cvc0.fsf@florida.arsdigita.de>.
 2001-11-25 13:03:30 -08:00
hniksic
df05e7ff10 [svn] Handle <base href=...> when converting links. 
Published in <sxsadxaae3t.fsf@florida.arsdigita.de>.
 2001-11-25 10:40:55 -08:00
hniksic
2e6e3f21f8 [svn] Attempt to quote '?' as "%3F" when linking to local files. 
Given up on the attempt, as it breaks local browsing.
 2001-11-25 09:44:28 -08:00
hniksic
95631700f7 [svn] Remove host canonicalization code. 
Published in <sxsg072ai5v.fsf@florida.arsdigita.de>.
 2001-11-25 09:13:20 -08:00
hniksic
05463c7121 [svn] Commit progress bar tweaks. 
Published in <sxsd727cvc0.fsf@florida.arsdigita.de>.
 2001-11-24 20:46:26 -08:00
hniksic
222e9465b7 [svn] Implemented breadth-first retrieval. 
Published in <sxsherjczw2.fsf@florida.arsdigita.de>.
 2001-11-24 19:10:34 -08:00
hniksic
b88223f99d [svn] Don't modify bp->total_length if it equals zero. 2001-11-24 10:05:57 -08:00
hniksic
177b6ee8fd [svn] Print the actual error message when parsing of redirection URL fails. 2001-11-24 06:02:10 -08:00
hniksic
212eb1ddaf [svn] Fake a miniscule amount of download time when none is detected. 2001-11-23 18:38:47 -08:00
hniksic
1da2947d50 [svn] Fix typo that made us never use robots.txt. 2001-11-23 17:48:28 -08:00
hniksic
87ed8be305 [svn] Don't translate "%ld ". 2001-11-23 12:20:40 -08:00
hniksic
4f91014e3f [svn] Allow the user to force bar progress. 
Published in <sxs8zcxh2x5.fsf@florida.arsdigita.de>.
 2001-11-23 08:24:06 -08:00
hniksic
49b93249b1 [svn] Seed OpenSSL's RNG. 
Submitted by Lemble Gregory.
 2001-11-23 08:18:41 -08:00
hniksic
905472770e [svn] Minor progress bar fixes. 
Published in <sxsn11dh3fc.fsf@florida.arsdigita.de>.
 2001-11-23 08:12:53 -08:00
hniksic
eb9a02b828 [svn] Minor fix for the new progress bar. 2001-11-22 21:09:39 -08:00
hniksic
8e082d2558 [svn] Remove accidentally committed DEBUG_MALLOC. 2001-11-22 21:01:32 -08:00
hniksic
cdcf67a5bd [svn] Big progress bar update. 
Published in <sxsn11ehyn1.fsf@florida.arsdigita.de>.
 2001-11-22 20:59:52 -08:00
hniksic
4d352013ac [svn] Replace opt.no_flush with a function to disable/enable flushing. 
Published in <sxssnb6imyz.fsf@florida.arsdigita.de>.
 2001-11-22 12:13:13 -08:00
hniksic
d5be8ecca4 [svn] Rewrite parsing and handling of URLs. 
Published in <sxs4rnnlklo.fsf@florida.arsdigita.de>.
 2001-11-21 16:24:28 -08:00
hniksic
f4dcb55851 [svn] Split the copyright notice for easier translation. 2001-11-21 15:15:19 -08:00
hniksic
0296433553 [svn] Support the SIZE command. 
Originally by Dave Turner.  Modified by Ian Abbott and published
in <3BFAA33C.6236.6D42F6@localhost>.
 2001-11-20 13:01:27 -08:00
hniksic
a24b3d50f0 [svn] Don't use the now-obsolete TYPE variable. 
Published in <sxswv0ledyx.fsf@florida.arsdigita.de>.
 2001-11-20 08:03:41 -08:00
hniksic
94c5b23136 [svn] Handle shorthands in proxy URLs. 
Published in <sxs6686py1q.fsf@florida.arsdigita.de>.
 2001-11-19 08:15:42 -08:00
hniksic
de7f766f58 [svn] Remove --wait/--waitretry compatibility code. 
Published in <sxs6686py1q.fsf@florida.arsdigita.de>.
 2001-11-19 07:42:56 -08:00
hniksic
e8e8797873 [svn] Rewrite shorthand URLs in a step separate from parsing. 
Published in <sxspu6f7ecz.fsf@florida.arsdigita.de>.
 2001-11-18 17:14:14 -08:00
hniksic
f178e6c613 [svn] Clean up handling of schemes. 
Published in <sxswv0n7h7s.fsf@florida.arsdigita.de>.
 2001-11-18 16:12:05 -08:00
hniksic
303f406997 [svn] Don't list all the "known" (but unsupported) protocols. Instead, just 
skip the characters until the first ':'.
Published in <sxsitc8a848.fsf@florida.arsdigita.de>.
 2001-11-17 22:49:09 -08:00
hniksic
ee99e8998a [svn] Don't compile getopt.c on systems that already have getopt_long. 
Published in <sxshersbs0w.fsf@florida.arsdigita.de>.
 2001-11-17 20:52:18 -08:00
hniksic
d408dec0bd [svn] Use Solaris's libmd5 when available. 
Published in <sxsn11kbssm.fsf@florida.arsdigita.de>.
 2001-11-17 20:36:21 -08:00
hniksic
09b0fe29a8 [svn] Initialize vars to appease the compiler. 
Published in <sxszo5kbxs3.fsf@florida.arsdigita.de>.
 2001-11-17 20:14:12 -08:00
hniksic
6ef5baa07b [svn] Prettier printing of HTTP headers. 
Published in <sxs4rnsdcw1.fsf@florida.arsdigita.de>.
 2001-11-17 18:36:30 -08:00
hniksic
22bfc65534 [svn] Use 1.8-dev as version. 2001-11-17 18:19:45 -08:00
hniksic
05f90bb302 [svn] Plug in new implementation of RES. 
Published in <sxselmwddt0.fsf@florida.arsdigita.de>.
 2001-11-17 18:17:30 -08:00
hniksic
12c8ef1796 [svn] *** empty log message *** 2001-11-17 17:34:25 -08:00
hniksic
10269645bc [svn] Bumped version to 1.7.1. 2001-11-17 17:30:12 -08:00
hniksic
e798e61c06 [svn] Minor doc addition. 2001-11-17 10:03:57 -08:00
hniksic
2fe30df466 [svn] Bump version to 1.7.1-pre3. 2001-11-16 15:20:17 -08:00
hniksic
cbc468efed [svn] Bumped version to 1.7-pre2. 2001-11-16 13:41:51 -08:00
hniksic
1a96dcfcb8 [svn] Ignore trailing whitespace in header_extract_number. 
Published in <sxsheruo5gn.fsf@florida.arsdigita.de>.
 2001-11-16 11:57:43 -08:00
hniksic
3d9dda6485 [svn] Process attributes in order in which they appear in the tag. 
Submitted by Ian Abbott in <3B868388.6538.14A7848@localhost>
based on analysis by Edward Sabol.
 2001-11-16 11:44:42 -08:00
hniksic
fa6aeb869d [svn] Don't call rate() with bogus data. 
Submitted by Ian Abbott in <3B7A98A1.24985.9EF692@localhost>
 2001-11-16 11:38:03 -08:00
hniksic
90cdb82942 [svn] Use 0x22 instead of '"' or '\"'. 2001-11-16 09:26:42 -08:00
hniksic
ac74e16638 [svn] Applied Christian Fraenkel's patch from <3BAF5B30.189077D6@gmx.net>. 
Print SSL errors when connecting fails.
 2001-11-16 09:06:25 -08:00
hniksic
d60b54cba0 [svn] Applied Chris Seawood's patch for compilation under BEOS. 
Patch published in <3B5D4CEF.5090208@seawood.org>.
 2001-11-16 08:58:08 -08:00
hniksic
0c42479322 [svn] Applied Edward Sabol's patch from 
<200106131813.f5DIDss1294858@alderaan.gsfc.nasa.gov>.
It fixes a memory leak in url_equal, and comments it out,
as it's unused.
 2001-11-16 08:49:19 -08:00
hniksic
0ce7b6bffc [svn] Support XML-style empty tags. 2001-11-16 08:44:34 -08:00
hniksic
b4e6054de9 [svn] Check for do_realloc_newsize in loop condition because we're no longer 
setting SIZEVAR here.
 2001-06-26 02:48:51 -07:00
hniksic
d015d3cbd3 [svn] Fix access violation bug in DO_REALLOC_FROM_ALLOCA. 
Published in <sxspubriqay.fsf@florida.arsdigita.de>.
 2001-06-26 01:45:09 -07:00
hniksic
e98fca84a3 [svn] Allow more characters in attribute name. 
Published in <sxsr8wi9jeo.fsf@florida.arsdigita.de>.
 2001-06-18 11:49:33 -07:00
hniksic
e1f4cff68c [svn] Make sure that slashes don't sneak in as part of file name via 
query string.
Published in <sxsu21eb3te.fsf@florida.arsdigita.de>.
 2001-06-18 02:08:04 -07:00
hniksic
91ac958e45 [svn] Set version to 1.7.1-pre1. 2001-06-15 02:29:00 -07:00
hniksic
2255a89b24 [svn] After canonicalizing the URL, check for its existence among undesirable_urls. 
Published in <sxs7kyeohte.fsf@florida.arsdigita.de>.
 2001-06-14 14:48:00 -07:00
hniksic
f918e0ab51 [svn] Docfix. 2001-06-14 14:15:43 -07:00
hniksic
c77d880776 [svn] Search netrc with the proper host name, not the proxy one. 2001-06-14 13:55:02 -07:00
hniksic
8f6b4f5bbb [svn] Define MAP_FAILED if it's missing. 
Published in <sxshexirelo.fsf@florida.arsdigita.de>.
 2001-06-14 13:28:19 -07:00
janp
46550636fe [svn] Provide correct prototype for ftp_parse_ls(). Pointed out by Bernhard Simon 
<bs@bsws.zid.tuwien.ac.at> in <200106071409.QAA08208@bsws.zid.tuwien.ac.at>.
 2001-06-09 10:44:07 -07:00
hniksic
6b9ac2db84 [svn] Increase version to 1.7. 2001-06-04 03:45:20 -07:00
hniksic
e6742c2313 [svn] ftp-ls.c typo fix by Karl Eichwalder. 2001-06-03 06:26:41 -07:00
hniksic
0b056d1720 [svn] Update copyright notices. 2001-05-27 12:35:15 -07:00
hniksic
b94a5c0e37 [svn] Released 1.7-pre1. 2001-05-26 03:01:45 -07:00
hniksic
6b405f2b66 [svn] Commit administrative changes in preparation for the 1.7 
prerelease.
Published in <sxsd78wwiwj.fsf@florida.arsdigita.de>.
 2001-05-26 02:38:24 -07:00
hniksic
2f298afc47 [svn] Don't include <sys/time.h> here. 
Published in <sxsae4gvtnb.fsf@florida.arsdigita.de>.
 2001-05-14 08:27:56 -07:00
hniksic
36eba40905 [svn] Make sure cookie code works with the real URL data, not the proxy one. 
Published in <sxsg0e8z3bp.fsf@florida.arsdigita.de>.
 2001-05-14 02:32:11 -07:00
hniksic
72eca0976b [svn] Commit several minor changes: 
* main.c (print_help): Document `--no-http-keep-alive'.

* utils.c (numdigit): Handle negative numbers *correctly*.

* hash.c (make_nocase_string_hash_table): Use term "nocase" rather
than the confusing "unsigned".

* utils.c (string_set_contains): Renamed from string_set_exists.

* hash.c (hash_table_contains): Renamed from hash_table_exists.

* cookies.c: Move case-insensitive hash tables to hash.c.

Published in <sxsheyq9vvl.fsf@florida.arsdigita.de>.
 2001-05-12 13:06:41 -07:00
hniksic
9588e1af80 [svn] Before concluding that the file is already fully retrieved, make sure 
that the file existed and `Range' was actually requested.

Published in <sxseltwf4ks.fsf@florida.arsdigita.de>.
 2001-05-11 05:37:37 -07:00
hniksic
43ef870bd3 [svn] Minor cookie fixes. Published in <sxsheyu9yp6.fsf@florida.arsdigita.de>. 2001-05-09 11:15:22 -07:00
hniksic
105627124e [svn] Make sure hstat.no_truncate gets properly initialized. 
Published in <sxspudk6pdl.fsf@florida.arsdigita.de>.
 2001-05-08 04:47:05 -07:00
hniksic
50980de841 [svn] Avoid useless file_exists_p. Published in 
<sxsr8y17zav.fsf@florida.arsdigita.de>.
 2001-05-07 12:08:29 -07:00
janp
5ff5e936a5 [svn] Correct the conversion of month entries for NT and VMS. 2001-05-02 03:15:17 -07:00
hniksic
72b9bb6d92 [svn] Zero out SIN before using it. 
Published in <sxs3daq8zdg.fsf@florida.arsdigita.de>.
 2001-04-30 03:19:41 -07:00
hniksic
3973f20a45 [svn] Refuse to download files from scratch if `-c' is used and the server 
doesn't support REST only for existing *and non-empty* files.
Published in <sxsae4zg4zc.fsf@florida.arsdigita.de>.
 2001-04-29 07:24:45 -07:00
hniksic
00773e7d15 [svn] Make `--cookies' respect its arg. 
Published in <sxs4rv8ht5e.fsf@florida.arsdigita.de>.
 2001-04-29 03:56:43 -07:00
hniksic
dfc1eb5766 [svn] Change default anonymous FTP password to "-wget@". 
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
 2001-04-29 03:53:55 -07:00
hniksic
b44f1701b0 [svn] Use alloca to allocate filename_plus_orig_suffix. 
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
 2001-04-28 09:36:46 -07:00
hniksic
d70101ea4e [svn] Commit various HTTP fixes. 
Published in <sxsy9slhu7g.fsf@florida.arsdigita.de>.

* http.c (gethttp): Return RETRUNNEEDED when the retrieval is
unneeded because the file is already there and fully downloaded,
and -c is specified.
(http_loop): Handle RETRUNNEEDED.

* wget.h (uerr_t): New value RETRUNNEEDED.

* http.c (http_loop): Set no_truncate for files that both exist
and are non-empty.
(gethttp): Consider the download finished when restval >= contlen,
not only when restval==contlen.
(gethttp): Handle redirection before giving up due to -c.
(gethttp): Clarify error message which explains that -c will not
truncate the file.
(gethttp): When returning CONTNOTSUPPORTED, don't forget to free
the stuff that needs freeing and release the socket.

* main.c (print_help): Wget booleans accept "off", not "no".
 2001-04-28 09:22:20 -07:00
hniksic
c6e565fd33 [svn] Send the no-cache directive when required regardless of whether we're 
going through a proxy.
Published in <sxsitjqncbx.fsf@florida.arsdigita.de>.
 2001-04-26 22:26:44 -07:00
hniksic
26ddb28a7c [svn] Improve documentation of mktime_from_utc. 
Rearrange http_atotm.
Published in <sxsoftjlyku.fsf@florida.arsdigita.de>.
 2001-04-26 22:11:38 -07:00
hniksic
07abfad1c2 [svn] Punish the *use* of ctype macros, rather than their mere presence. 
Published in <sxssnivlyut.fsf@florida.arsdigita.de>.
 2001-04-26 22:03:08 -07:00
hniksic
ae621c6770 [svn] Treat empty proxy environment vars as unset. 
Published in <sxssniwq8d6.fsf@florida.arsdigita.de>.
 2001-04-26 03:11:49 -07:00
hniksic
f0eb1fb758 [svn] Fix loading of cookies. 
Published in <sxslmopyao6.fsf@florida.arsdigita.de>.
 2001-04-24 19:29:54 -07:00
hniksic
425b5af0c9 [svn] Cosmetic change in DIGITS_* macros. 2001-04-24 18:55:13 -07:00
hniksic
e559249a48 [svn] Minor doc fix. 2001-04-24 17:59:39 -07:00
hniksic
9ae0328c3d [svn] Applied Roger Beeman's mktime_from_utc fix published in 
<Pine.HPX.4.02.10104181128180.6232-100000@mail1.cisco.com>.
Also, minor doc fixes.
 2001-04-24 17:50:22 -07:00
hniksic
d80f6cbe8c [svn] Reimplemented UNSAFE_CHAR and RESERVED_CHAR. 
Fixed snprintf.c to avoid ISDIGIT.
 2001-04-24 17:20:30 -07:00
hniksic
45eea7387f [svn] New timer functions. Published in <sxs8zkp28vk.fsf@florida.arsdigita.de>. 2001-04-24 16:09:45 -07:00
hniksic
5674776cad [svn] Rewritten long_to_string. The new version favors smaller numbers; 
much of the work is now done at compile-time.
Published in <sxsvgnv6oii.fsf@florida.arsdigita.de>.
 2001-04-23 19:06:34 -07:00
hniksic
6ba7711d6a [svn] Print download rate even when percentages are not available. 
Published in <sxs1yqjd4ct.fsf@florida.arsdigita.de>.
 2001-04-23 08:28:34 -07:00
hniksic
38120f75ef [svn] Write percentages when the length is authoritative. 
Published in <sxselujd8py.fsf@florida.arsdigita.de>.
 2001-04-23 06:53:29 -07:00
hniksic
ac7c8c1390 [svn] Improve performance of grow_hash_table. 
Published in <sxs66g8nd4c.fsf@florida.arsdigita.de>.
 2001-04-14 00:41:29 -07:00
hniksic
61bb00adc0 [svn] Various url.c-related changes. 
Published in <sxsvgo8nmub.fsf@florida.arsdigita.de>.

* retr.c (retrieve_url): Call uri_merge, not url_concat.
* html-url.c (collect_tags_mapper): Call uri_merge, not
url_concat.
* url.c (mkstruct): Use encode_string instead of xstrdup followed
by URL_CLEANSE.
(path_simplify_with_kludge): Deleted.
(contains_unsafe): Deleted.
(construct): Renamed to uri_merge_1.
(url_concat): Renamed to uri_merge.
* url.c (str_url): Use encode_string instead of the unnecessary
CLEANDUP.
(encode_string_maybe): New function, returns input string if no
encoding is needed.
(encode_string): Call encode_string_maybe to do the dirty work,
xstrdup if no work needed.
* wget.h (XDIGIT_TO_xchar): Define here.
* url.c (decode_string): Use new name.
(encode_string): Ditto.
* http.c (XDIGIT_TO_xchar): Rename HEXD2asc to XDIGIT_TO_xchar.
(dump_hash): Use new name.
* wget.h: Rename ASC2HEXD and HEXD2ASC to XCHAR_TO_XDIGIT and
XDIGIT_TO_XCHAR respectively.
 2001-04-13 21:11:35 -07:00
hniksic
8a0e9e765e [svn] Minor -Wall-induced fixes. Also, skip_url is removed. 
Published in <sxs8zl5v5cw.fsf@florida.arsdigita.de>.
 2001-04-12 20:39:23 -07:00
hniksic
eae28f142d [svn] Commit various hash table changes: 
* hash.c (hash_table_map): Allow deletion and change of the
element processed by MAPFUN.
(string_hash): Use the function from glib.
* hash.c (hash_table_remove): Rewrite to actually clear deleted
entries instead of just marking them as deleted.

Published in <sxsu23tvdur.fsf@florida.arsdigita.de>.
 2001-04-12 17:34:24 -07:00
hniksic
452c0bb9f7 [svn] Declare hash_table_get_pair and hash_table_count. 2001-04-12 12:45:18 -07:00
hniksic
cd1423a478 [svn] Declare http_atotm(). 2001-04-12 12:43:12 -07:00
hniksic
b4b33b5afc [svn] Use octal constants. 
Published in <sxsr8yy1dk6.fsf@florida.arsdigita.de>.
 2001-04-12 05:58:02 -07:00
hniksic
83fe8f3597 [svn] "Support DESTDIR when installing. 
Patch courtesy Karl Eichwalder.
Published in <sxs4rvu2tmu.fsf@florida.arsdigita.de>.
 2001-04-12 05:25:22 -07:00
hniksic
a98337f827 [svn] Make seconds optional in VMS time specification. 
Published in <sxs8zl62u9p.fsf@florida.arsdigita.de>.
 2001-04-12 05:22:50 -07:00
hniksic
963863113f [svn] Fix retrieval of directories when initial CWD is not `/'. 
Published in <sxsitkc709p.fsf@florida.arsdigita.de>.

* url.c (parseurl): Don't strip trailing slash when u->dir is "/"
because that strips the *leading* slash, thus forcing relative
FTP retrieval.
* ftp.c (getftp): Convert initial FTP directory from VMS to UNIX
notation for VMS servers.
(ftp_retrieve_dirs): Do not prepend '/' to f->name when
odir is an empty string.
 2001-04-10 17:24:59 -07:00
janp
90a26b7987 [svn] Make the AM/PM fix more efficient. 2001-04-10 10:09:42 -07:00
janp
568b584271 [svn] ftp_parse_winnt_ls(): Made the fix for AM/PM more effective. 2001-04-10 10:05:43 -07:00
hniksic
5fa53b5a1d [svn] Implement better sorting and matching of cookies. 
Fix previously broken command-line options.
Published in <sxspuek9255.fsf@florida.arsdigita.de>.
 2001-04-10 09:04:18 -07:00
hniksic
579d051d57 [svn] Rewrite SSL #ifdef for better indentation. 2001-04-09 07:58:55 -07:00
hniksic
0c70c624f9 [svn] Fix recursive FTP retrieval so that 
`wget -r ftp://<username>:<password>@host/%2Fhome/hniksic/dir/'
works.
Published in <sxsk84ug8gt.fsf@florida.arsdigita.de>.
 2001-04-08 18:38:27 -07:00
hniksic
665a84b4a2 [svn] Implement tilde-expansion in file name arguments of 
`.wgetrc' commands.
Published in <sxsy9tbeyh3.fsf@florida.arsdigita.de>.
 2001-04-08 16:59:14 -07:00
hniksic
2cfb2d2ef6 [svn] Added support for cookies. 2001-04-08 15:25:24 -07:00
janp
7827420378 [svn] ftp-ls.c (ftp_parse_winnt_ls): The AM/PM change did assume 12:01PM == 
00:01, which was obviously wrong.
 2001-04-08 07:38:12 -07:00
janp
92b944bffe [svn] The AM/PM change did assume 12:01PM == 00:01, which was obviously 
wrong. Taken care of this anomaly.
 2001-04-08 07:36:58 -07:00
janp
55587bdee2 [svn] ChangeLog: Removed an excess conflict marker. Reformatted the entry by 
Philipp Thomas from 2001-03-09.

ftp-ls.c (ftp_parse_winnt_ls): Ensure that adjusted PM hours lay
between 0 and 23. Elminate unused variable `sec'.
 2001-04-08 02:30:14 -07:00
hniksic
26547d3987 [svn] New function hash_table_count. 
Published in <sxsu2403zzw.fsf@florida.arsdigita.de>.
 2001-04-07 19:09:04 -07:00
hniksic
b5788b5eb7 [svn] Do the namespace tweaks only on systems we know about. 2001-04-05 21:44:04 -07:00
hniksic
a37e71d3d6 [svn] Cast MMAP_FAILED to char *. 2001-04-05 21:43:13 -07:00
hniksic
3ecad253f2 [svn] Include string.h. 2001-04-05 20:43:35 -07:00
hniksic
4bc1d37ccf [svn] Specify "compilation environment" that works for Linux 
and Solaris.
Published in <sxs8zlezpsu.fsf@florida.arsdigita.de>.
 2001-04-05 20:41:59 -07:00
hniksic
31ea5aae27 [svn] Prepend literal newline with `\n\' inside quoted string. 2001-04-05 20:06:00 -07:00
hniksic
3c6093cf13 [svn] Remove VERY_LONG_FORMAT. Instead, define function very_long_to_string 
for printing VERY_LONG_TYPE numbers.
Published in <sxsd7aqzqr7.fsf@florida.arsdigita.de>.
 2001-04-05 19:51:41 -07:00
hniksic
c51015565a [svn] parse_uname() Would run past the end of the string if the 
username was present, but the URL did not contain a slash, e.g.
http://foo:bar@myhost.
Reported by Christian Fraenkel.
 2001-04-04 07:00:34 -07:00
hniksic
1d51748034 [svn] Fix support for rfc850 time recognition on systems where strptime 
format specs %a and %A are not the same.
Published in <49022.983849922@ideon.st.ryukoku.ac.jp>.
 2001-04-03 11:54:32 -07:00
hniksic
a3eea37c91 [svn] Small cleanup of mswindows.c by Paul Bludov. 
Published in <wget-patches@sunsite.auc.dk>.
 2001-04-03 11:22:04 -07:00
hniksic
d62d112aed [svn] Remove stray conflict marker. 2001-04-03 09:19:23 -07:00
hniksic
f1d534cd8c [svn] Make -c' and -O' work together. 
Published in <sxsitkmgokh.fsf@florida.arsdigita.de>.
 2001-04-03 05:24:49 -07:00
hniksic
66a0c39e22 [svn] Make sure opt.dfp is rewound only on the first retrieval. 
(See the code comment for a more detailed explanation.)
Published in <sxsy9tkqizz.fsf@florida.arsdigita.de>.
 2001-04-01 16:50:04 -07:00
hniksic
1810f7a442 [svn] Handle trailing whitespace in .netrc. Published in 
<sxsitkofbfw.fsf@florida.arsdigita.de>.
 2001-04-01 16:28:25 -07:00
hniksic
cee04f2ef3 [svn] Fix memory allocation in cmd_address(). 
Published in <sxs66gogt0k.fsf@florida.arsdigita.de> under
the subject "Fix for opt.bind_address".
 2001-04-01 15:23:52 -07:00
hniksic
20a4341e1a [svn] Wget was ignoring an error when getting a directory failed. 
Fix courtesy Nicolas Lichtmaier.
 2001-04-01 14:34:40 -07:00
hniksic
4dbad3a894 [svn] Make sure -C is recognized. 2001-04-01 14:26:28 -07:00
hniksic
a52aaeb451 [svn] Make sure -c doesn't truncate the file. 
Published in <sxsofuhi4kc.fsf@florida.arsdigita.de>.
 2001-04-01 13:04:21 -07:00
hniksic
aa888ba8da [svn] Don't clear dl_file_url_map and dl_url_file_map in recursive_retrieve. 
Published in <sxsk856le2y.fsf@florida.arsdigita.de> under the subject
"Link conversion fix".
 2001-03-31 18:41:26 -08:00
hniksic
22240955e6 [svn] Undef xmalloc and friends before redefining them when standalone. 2001-03-30 21:07:10 -08:00
hniksic
8c4cd805e2 [svn] Oops! Fix braino in recur.c -- clear the hash tables only when 
they are defined.
 2001-03-30 18:21:20 -08:00
hniksic
8f048b7be8 [svn] Committed my patch that makes HTTP code close its socket in premature 
returns (before the body was drained).  Published in
<sxsd7ayn0kt.fsf@florida.arsdigita.de>.
 2001-03-30 18:20:16 -08:00
hniksic
728584d072 [svn] Record downloaded files and downloaded HTML files in all cases. 
Published under the subject "Link conversion fix" in
<sxsn1a2n2zd.fsf@florida.arsdigita.de>.
 2001-03-30 18:05:54 -08:00
hniksic
e4d49f0b40 [svn] Published my patch "main.c tweaks" published in 
<sxspueyonjt.fsf@florida.arsdigita.de>.
 2001-03-30 15:17:59 -08:00
hniksic
1a6058b1ec [svn] Applied Philipp Thomas's safe-ctype patch. Published in 
<20010330025159.U21662@jeffreys.suse.de>.
 2001-03-30 14:36:59 -08:00
dan
f486b43c23 [svn] * {.,doc,src,util,windows}/Makefile.in: Moved top_builddir out of "User 
configuration section" of top Makefile and analogous spot in others.

* po/Makefile.in.in: Previous addition of top_builddir to
  po/Makefile.in was bogus -- it's generated from po/Makefile.in.in.
 2001-03-27 03:23:59 -08:00
dan
d41af5f52e [svn] Linking with OpenSSL previously required the user to set up all the 
appropriate -I, -L, and -R/-rpath flags in environment variables,
manually.  Automated everything, including bundling libtool so we can
successfully link with the OpenSSL shared libraries on just about any
platform.
 2001-03-17 06:21:19 -08:00
janp
5014d32c3a [svn] Skip `:port' in the host header if it is the DEFAULT_HTTPS_PORT when 
using SSL. Patch submitted by Hack Kampbjorn <hack@hackdata.com>.
 2001-03-08 15:11:03 -08:00
hniksic
71a53ffe25 [svn] Applied Jonas Jensen's patch to correctly calculate the number of bytes 
in the first line of the download that.
Published in <sxsu25hioxj.fsf@florida.arsdigita.de>.
 2001-03-01 14:25:20 -08:00
dan
b6febbc84b [svn] * po/*.po*: Updated after moving -nr to a different category. 
* wget.texi: Moved -nr from "Recursive Retrieval Options" to "FTP Options" and
  gave it a @cindex entry. Alphabetized FTP options by long option name.

* main.c (print_help): -nr belongs in "FTP options" section of --help output,
  not "Recursive retrieval" section.  Alphabetized FTP options by long option
  name.
 2001-02-23 13:31:54 -08:00
dan
2aa1d53fb2 [svn] * main.c (print_help): --help documentation for -N said it would re-download 
files if they had the _same_ timestamp on server.

* po/*.po*: Updated after changing --help's description of -N.
 2001-02-23 12:43:35 -08:00
dan
4fc318600e [svn] init.c (commands): Hack Kampbj?rn <hack@hackdata.com> discovered that 
"httpsproxy" had been inserted into commands[] out of alphabetical order,
causing "BUG: unknown command `httpuser'".
 2001-02-16 21:26:34 -08:00
janp
b3bb9b7ed9 [svn] Changes in FTP listing parser code - suport for VMS and MacOS, removed 
dependency on ftpparse as the copyright issue has not been resolved.
 2001-02-12 23:50:27 -08:00
janp
004b339d2e [svn] Removed ftpparse dependencies. New parser for VMS listings. MacOS 
NetPresenz FTP sevber is now supported.
 2001-02-12 23:44:59 -08:00
janp
ccfe785e9e [svn] Changes related to ftpparse removal. 2001-02-12 23:40:53 -08:00
janp
ae23f01b07 [svn] Removed because of unclear copyright statement and unwillingess of 
original author to resolve this.
 2001-02-12 23:40:14 -08:00
hniksic
164ccc9e41 [svn] ChangeLog tweak; initialize con to appease the access checker. 2001-02-11 09:27:37 -08:00
hniksic
54811e2832 [svn] Applied Jan's patch to allow non-quoted @ character in 
passwords.  Published in <20010106173455.A9455@erwin.telekabel.at>.
 2001-02-10 16:28:22 -08:00
hniksic
b370dd1914 [svn] Applied Hack Kampbjorn's patch to print FTP type in debug output. 
Published in <3A7D94B5.D9B932FB@hackdata.com>.
 2001-02-10 16:06:59 -08:00
hniksic
366b832e3f [svn] Applied Jonas Jensen's download rate patch with my additions. 
Published in <015b01c09084$ce2d9330$0100000a@bob> and
<sxspugq3xai.fsf@florida.arsdigita.de>.
 2001-02-10 16:00:30 -08:00
hniksic
fdc20de365 [svn] Applied Tim Mooney's patch that fixes a build problem under Tru64. 
Published in
<Pine.OSF.4.33.0102072244450.2714-100000@dogbert.cc.ndsu.NoDak.edu>.
 2001-02-10 14:37:12 -08:00
hniksic
07f60f19a4 [svn] Applied Christian Fraenkel's patch "custom certificate patch for wget-1.7+dev; 
2nd try", published in <200102082132220160.00474E73@pop.gmx.net>.
It adds two options for custom certificates.
 2001-02-10 14:33:31 -08:00
hniksic
2f6cd9d698 [svn] Changes according to Herold Heiko's instructions how to make alloca() 
work under Windows: don't try to compile alloca.c, *and* don't forget
to include <malloc.h>.

Published in <sxsbssyibsu.fsf@florida.arsdigita.de>.
 2001-01-23 06:27:40 -08:00
dan
fa636eb71d [svn] url.c (str_url): Clarified this function's comment header after Hrvoje answered 
my question on the list as to when hide != 1.  Also Hrvoje pointed out I need to
use xstrdup() on the string literal.
 2001-01-10 22:16:46 -08:00
hniksic
3f91c7dfe1 [svn] Declare addrlen as int. Published in <sxsu27cbtzu.fsf@florida.arsdigita.de>. 2001-01-10 07:06:00 -08:00
dan
17e21ff7dd [svn] Jan did make a ChangeLog entry for his fix of the non-anonymous FTP recursion 
bug.  I just didn't use the right terms when searching for it.
 2001-01-10 00:53:42 -08:00
dan
f84a94e913 [svn] Made clarifications and corrections to --continue's --help output and wget.texi 
documentation.  Published in <200101100629.WAA09744@dilvish.speed.net>.
 2001-01-09 22:51:51 -08:00
dan
48cf02169d [svn] Just clarified a comment in the fix I just committed. 2001-01-09 20:32:29 -08:00
dan
1993e140f2 [svn] url.c (str_url): Henrik van Ginhoven pointed out on the list that we shouldn't 
give away the number of characters in the password by replacing each character
with a 'x'.  Use "<password>" instead.
 2001-01-09 20:30:43 -08:00
dan
7140f393b2 [svn] When did the bug get fixed where recursive FTP would fail if logging in put 
you in a directory other than "/"?  I don't see a src/ChangeLog entry for
it.  In any case, my testing shows that it's fixed in 1.7-dev, but TODO and
a comment in src/ftp.c were not changed to reflect this.
 2001-01-09 20:17:06 -08:00
dan
040aae87b5 [svn] html-url.c: A bunch of fixup of `--page-requisites'-related comments to reflect 
Hrvoje's changes to my code when transplanting it into this new file, to fix
spelling mistakes, to clarify, etc.
 2001-01-09 18:54:52 -08:00
dan
bc5fd29baf [svn] 2001-01-09 Dan Harkless <wget@harkless.org> 
* html-url.c: Addition and clarification of comments related to -p.

	* url.c (write_backup_file): Clarified a comment.
	  [Committed this fix separately.]
 2001-01-09 18:28:24 -08:00
dan
a77dc45c4d [svn] Hrvoje's response to my "wondering" comment in write_backup_file() read 
extremely strangely without adding tags to show who was saying what.  Also, one
of his phrases was very misleading.
 2001-01-09 18:10:16 -08:00
dan
cbe2ca1b80 [svn] Here're the changes we agreed to on the wget mailing list regarding the 
multiple-branches ChangeLog problem.  Note the new directories -- you'll need to
do a cvs update -d.
 2001-01-06 01:26:02 -08:00
hniksic
35325bd092 [svn] Include fragment identifiers in converted URLs. Published in 
<sxs8zorl90l.fsf@florida.arsdigita.de>.
 2001-01-04 05:53:53 -08:00
hniksic
f579cd1691 [svn] Csaba's Watcom changes. 2001-01-03 07:14:02 -08:00
dan
67bfa88fd8 [svn] ChangeLog: Since this flat file doesn't have multiple branches, 
looking at the dates would make you think that things went into
1.6 that actually just went into the 1.7-dev branch.  Added "[Not
in 1.6 branch.]" where appropriate to clarify.
 2000-12-31 04:45:42 -08:00
dan
86413b1d83 [svn] Need to say that stuff I did before releasing 1.6 happened on 12-30, not 12-31. 2000-12-31 04:10:59 -08:00
dan
e979053779 [svn] 2000-12-31 Dan Harkless <wget@harkless.org> 
* ftp.c, http.c:  Applied Hack Kampbj?rn <hack@hackdata.com>'s
        patch to deal with h_errno not being defined in netdb.h under Cygwin.

2000-12-30  Dan Harkless  <wget@harkless.org>

        * version.c: Released Wget version 1.6.  Note that on this branch we
        never actually had the version set to 1.6, but we still need the
        ChangeLog comment for posterity.
 2000-12-31 04:04:14 -08:00
dan
f105b3e43f [svn] Changed my address from dan-wget@dilvish.speed.net to wget@harkless.org 
everywhere -- dilvish will probably be going away soon.
 2000-12-31 03:18:37 -08:00
hniksic
23cbd15095 [svn] Igor Khristophorov's fix for check_end(). From 
<sxs4s027snq.fsf@florida.arsdigita.de>.
 2000-12-17 11:31:30 -08:00
hniksic
5099ec0306 [svn] Apply lint-expired fixes from <sxsn1du7ufa.fsf@florida.arsdigita.de>. 2000-12-17 10:52:52 -08:00
hniksic
f6a41b5669 [svn] Applied Csaba Raduly's patch from <802569B4.0043F7B1.00@Jagannath.uk.sophos>. 2000-12-17 10:18:14 -08:00
hniksic
2e8fc46b7b [svn] Include <netdb.h> where h_errno is used. Likewise for <errno.h> and errno. 
From <sxsvgsi7wcw.fsf@florida.arsdigita.de>.
 2000-12-17 10:12:02 -08:00
hniksic
b84f96df34 [svn] Use '"' rather than '\"' in assert. 2000-12-13 05:37:37 -08:00
hniksic
28b5cd706f [svn] Removed. 2000-12-10 18:53:02 -08:00
hniksic
bdea0b3bf6 [svn] Made xfree alias to free if memory debugging is not used. 
From <sxsd7ezd7p2.fsf@florida.arsdigita.de>.
 2000-12-10 18:17:44 -08:00
hniksic
d5cd691b12 [svn] Fix -O timestamp bug. 
From <sxs7l57u6o6.fsf@florida.arsdigita.de>.
 2000-12-10 16:47:44 -08:00
hniksic
62b876401e [svn] Set the timestamp even when -O is used. 2000-12-10 16:31:14 -08:00
hniksic
3665d73453 [svn] Removed. 2000-12-09 18:25:19 -08:00
hniksic
afe131624b [svn] Add , before `int ssl'. 2000-12-06 09:22:27 -08:00
hniksic
cab759659e [svn] Move inclusion of gen_ssl.h below Wget's headers. 2000-12-06 09:18:14 -08:00
hniksic
b0e9dfd4e2 [svn] Fix opt.wait. 2000-12-05 16:24:40 -08:00
hniksic
47c6092ec4 [svn] Use a single version of RBUF_READCHAR. 2000-12-05 15:50:34 -08:00
hniksic
e754c99b46 [svn] Cosmetic cleanup of SSL stuff. 2000-12-05 15:35:56 -08:00
hniksic
ac5d0a9e4d [svn] New files. 2000-12-05 15:26:13 -08:00
hniksic
7828e81c79 [svn] Committed C. Frankel's SSL patch. 2000-12-05 15:09:41 -08:00
hniksic
dc78acde56 [svn] Use the proper Jan's changelog entry. 2000-12-05 15:03:46 -08:00
hniksic
d1a855786c [svn] ChangeLog for Jan's last patch. 2000-12-05 14:44:46 -08:00
hniksic
7b5ad90acf [svn] Commit my url.c fix (space as unsafe character) and Jan's 
winnt directory listing parsing.
 2000-12-05 14:29:47 -08:00
hniksic
518fe8d06d [svn] Do away with line separator. 2000-11-29 08:19:46 -08:00
hniksic
7e900c50bf [svn] Undo Jan's typo fix. 2000-11-25 03:51:14 -08:00
hniksic
62994ffc8c [svn] Applied Karl Eichwalder's patch from 
<20001124044348.AF524DD15E@tux.gnu.franken.de>.
 2000-11-24 05:51:36 -08:00
hniksic
7c750db580 [svn] More memory debug tweaks. 
Published in <sxs4s0z2bwi.fsf@florida.arsdigita.de>.
 2000-11-23 13:44:56 -08:00
hniksic
1cddc05edb [svn] Committed memory debugging stuff. 
Published in <sxs1yw34pt4.fsf@florida.arsdigita.de>.
 2000-11-22 14:15:45 -08:00
hniksic
d8c9ce30aa [svn] Make sure xfree is #define'd in standalone mode in files that 
support one.
 2000-11-22 09:00:31 -08:00
hniksic
2ffb47eabf [svn] Committed <sxsbsv854j9.fsf@florida.arsdigita.de>. 2000-11-22 08:58:28 -08:00
hniksic
9439a6659b [svn] Fixup ftpparse dependencies. 2000-11-21 09:01:39 -08:00
hniksic
c3d636db03 [svn] Committed Jan's ftpparse patch with Hrvoje's modifications. 
<sxshf518e72.fsf@florida.arsdigita.de>.
 2000-11-21 08:48:39 -08:00
hniksic
d6a57bc2a6 [svn] Commit hash table bugfix. 
Published in <sxs8zqd9x1g.fsf@florida.arsdigita.de>.
 2000-11-21 08:42:29 -08:00
hniksic
45eee9e56c [svn] Remove stray debugging statement. 2000-11-20 19:08:41 -08:00
hniksic
6e598c81e3 [svn] Committed a bunch of different tweaks of mine. 
Published in <sxsr9463wrx.fsf@florida.arsdigita.de>.
 2000-11-20 18:06:36 -08:00
hniksic
fb42069e51 [svn] Constify check_end(). 2000-11-20 02:25:28 -08:00
hniksic
7302e69dc2 [svn] Improved comments for the persistent connections feature. 2000-11-20 02:20:39 -08:00
hniksic
6f7fd37186 [svn] Auth tweaks. 
Published in <sxs3dgnz955.fsf@florida.arsdigita.de>.
 2000-11-19 18:10:54 -08:00
hniksic
ba3f5ce0a2 [svn] Bump version number. 2000-11-19 16:15:21 -08:00
hniksic
f2f77d87fd [svn] New option --no-http-keep-alive. 
Published in <sxsd7fr1pdf.fsf@florida.arsdigita.de>.
 2000-11-19 16:04:06 -08:00
hniksic
b27144fcce [svn] My patch "persistent connection tweaks". 
Published in <sxshf531qhj.fsf@florida.arsdigita.de>.

(Applied with the addition of correct calculation for the
length of the request.)
 2000-11-19 15:42:13 -08:00
hniksic
b0b1c815c1 [svn] A bunch of new features: 
- use mmap() to read whole files in core instead of allocating memory
  and read'ing it.

- use a new, more general, HTML parser (html-parse.c) and interface to
  it from Wget (html-url.c).

- respect <meta name=robots content=nofollow> (easy with the new HTML
  parser).

- use hash tables instead of linked lists in places where the lists
  were used to facilitate mappings.

- rewrite the code in host.c to be more readable and faster (hash
  tables instead of home-grown lists.)

- make convert_links properly convert partial URLs to complete ones
  for those URLs that have *not* been downloaded.

- use HTTP persistent connections where available.  very
  simple-minded, caches the last connection to the server.

Published in <sxshf533d5r.fsf@florida.arsdigita.de>.
 2000-11-19 12:50:10 -08:00
hniksic
ccf31643ab [svn] vsnprintf() fixup. 2000-11-16 08:37:49 -08:00
hniksic
cc3b6eb3e4 [svn] Do the _XOPEN_SOURCE/_SVID_SOURCE things only on Linux. 2000-11-15 10:10:01 -08:00
hniksic
6a70f04a5c [svn] Don't clutter the host list with duplicate hosts. 
Published in <sxsitpt56eh.fsf@florida.arsdigita.de>.
 2000-11-12 16:46:13 -08:00
hniksic
e1f1c1ff40 [svn] Better version of read_whole_line(). 
Published in <sxsr94jd7z4.fsf@florida.arsdigita.de>.
 2000-11-10 10:01:35 -08:00
hniksic
e18ca280fb [svn] Fix off-by-one error in comind(). 
Published in <sxsvgtvdcki.fsf@florida.arsdigita.de>.
 2000-11-10 08:20:55 -08:00
hniksic
f306ae9626 [svn] Changed last_slash[-1] to *(last_slash - 1). 2000-11-08 07:51:28 -08:00
hniksic
b72b6cf387 [svn] Correctly handle URLs where / does not follow the host name. 
Published in <sxsn1fag6zu.fsf@florida.arsdigita.de>.
 2000-11-08 01:15:40 -08:00
hniksic
34ea31bb01 [svn] Sort commands[]. 2000-11-07 03:43:36 -08:00
hniksic
0e2b74ce3b [svn] Commit "minor fixes". 2000-11-06 13:24:57 -08:00
hniksic
366ad1d6d9 [svn] Rewrote the logging code. 
Published at <sxs1ywrf300.fsf@florida.arsdigita.de>.
 2000-11-04 20:38:31 -08:00
hniksic
c2c821b3c9 [svn] snprintf.c addition. 2000-11-04 14:49:46 -08:00
hniksic
eef4a668b7 [svn] Update copyright blurbs with the year 2000. 2000-11-01 17:50:03 -08:00
hniksic
6e23da9254 [svn] Hide password from URL when non-verbose, too. 2000-11-01 17:41:20 -08:00
hniksic
c6575c6382 [svn] Another contributed fix... 2000-11-01 17:06:57 -08:00
hniksic
6eb0870af0 [svn] Contributed fix. 2000-11-01 17:02:56 -08:00
hniksic
986c445029 [svn] Fixed minor memory leaks. 2000-11-01 16:18:27 -08:00
hniksic
b3758323ed [svn] Applied contributed fix. 2000-11-01 15:57:19 -08:00
hniksic
b7a8c6d3f5 [svn] Gracefully handle opt.downloaded overflowing. 
Published in <sxsd7gfnv17.fsf@florida.arsdigita.de>.
 2000-11-01 15:17:31 -08:00
hniksic
29cdc8da20 [svn] Updated long_to_string(); enhanced opt.downloaded to use 
64-bit types where available.
Published in <sxswvenqsmn.fsf@florida.arsdigita.de> and
<sxssnpbqshp.fsf@florida.arsdigita.de>.
 2000-11-01 13:51:25 -08:00
hniksic
b9eeb0c54c [svn] Fix "optimization" of query-strings in URLs. 
Published in <sxs3dhbwnmw.fsf@florida.arsdigita.de>.
 2000-11-01 10:31:53 -08:00
hniksic
6d13e17142 [svn] Detect redirection cycles. 
Published in <sxsd7ggtjac.fsf@florida.arsdigita.de>.
 2000-10-31 20:21:50 -08:00
hniksic
515d82fb95 [svn] Committed my patch from <sxsy9z4xz5m.fsf@florida.arsdigita.de> 
(recognize HTML entities.)
 2000-10-31 17:25:12 -08:00
hniksic
846b045a69 [svn] Applied my patch from <sxs3dhczfv5.fsf@florida.arsdigita.de>. 2000-10-31 16:38:57 -08:00
hniksic
f6715dd08d [svn] Committed my patch from <sxs7l6ozghz.fsf@florida.arsdigita.de>. 2000-10-31 16:26:33 -08:00
hniksic
0dd418242a [svn] Committed my patches from <sxsbsw16sbu.fsf@florida.arsdigita.de> 
and <sxsvgu824xk.fsf@florida.arsdigita.de>.
 2000-10-31 11:25:32 -08:00
hniksic
b095202cad [svn] Applied Adrian Aichner's patch from 
<20001029223711.28688.qmail@web10601.mail.yahoo.com>.
 2000-10-30 13:07:04 -08:00
dan
24c465b5ad [svn] retr.c (retrieve_url): Manually applied T. Bharath 
<TBharath@responsenetworks.com>'s patch to get wget to grok illegal relative URL
redirects.  Reformatted and re-commented it.
 2000-10-27 20:18:20 -07:00
dan
1396b30055 [svn] Manually applied Rob Mayoff <mayoff@dqd.com>'s patch (vs. 1.5.3, not 1.5.3+dev) 
to add --bind-address, making many necessary alphabetization, coding style,
comment, documentation, and naming fixes and additions.
 2000-10-23 23:19:17 -07:00
dan
2fbb4936a0 [svn] main.c (print_help): Clarified that --delete-after deletes local files. 2000-10-23 20:52:34 -07:00
dan
f4673bcdaf [svn] --delete-after wasn't implemented for files retrieved by FTP or corresponding to 
files specified on the commandline.  Made --convert-links be ignored when
--delete-after is specified.  Added note about this fact to --delete-after docs
and made general improvements to them, including the clarification that
--delete-after only deletes local files.
 2000-10-23 20:43:47 -07:00
hniksic
778160a155 [svn] hniksic@iskon.hr -> hniksic@arsdigita.com 2000-10-23 08:43:04 -07:00
dan
8a9be7627d [svn] ftp.c (getftp): Applied Piotr Sulecki <Piotr.Sulecki@ios.krakow.pl>'s 
patch to work around FTP servers that incorrectly respond to the
          	"REST" command with the remaining size rather than the total
          	file size.
 2000-10-20 00:28:57 -07:00
dan
8cf52e0dd3 [svn] Applied John Daily <jdaily@cyberdude.com>'s patch for his "quad" commands (which 
I renamed to "lockable_boolean") in the .wgetrc (currently just passive_ftp).
Wrote documentation for his changes and added the missing "referer" to the
.wgetrc section (making mention of the issue of "referrer" being the correct
spelling).
 2000-10-19 23:59:30 -07:00
dan
b3e2c0ff97 [svn] Implemented and documented new -E / --html-extension / html_extension option. 2000-10-19 22:55:46 -07:00
dan
cbf018d0c0 [svn] --retr-symlinks was not previously documented properly. Based on my newfound 
understanding of what its limitations are, added a TODO item.  Also made a minor
tweak in html.c to silence a warning.
 2000-10-09 15:43:11 -07:00
dan
570f12e437 [svn] Accidentally said "system.wgetrc" instead of "system wgetrc". 2000-08-30 14:08:06 -07:00
dan
7931200609 [svn] * *.{gmo,po,pot}: Regenerated after modifying wget --help output. 
* ftp.c (ftp_retrieve_list): Use new INFINITE_RECURSION #define.

* html.c: htmlfindurl() now takes final `dash_p_leaf_HTML' parameter.
Wrapped some > 80-column lines.  When -p is specified and we're at a
leaf node, do not traverse <A>, <AREA>, or <LINK> tags other than
<LINK REL="stylesheet">.

* html.h (htmlfindurl): Now takes final `dash_p_leaf_HTML' parameter.

* init.c: Added new -p / --page-requisites / page_requisites option.

* main.c (print_help): Clarified that -l inf and -l 0 both allow
infinite recursion.  Changed the unhelpful --mirrior description
to simply give the options it's equivalent to.  Added new -p option.
(main): Added some comments; handle new -p / --page-requisites.

* options.h (struct options): Added new page_requisites field.

* recur.c: Changed "URL-s" to "URLs" and "HTML-s" to "HTMLs".
Calculate and pass down new `dash_p_leaf_HTML' parameter to
get_urls_html().  Use new INFINITE_RECURSION #define.

* retr.c: Changed "URL-s" to "URLs".  get_urls_html() now takes
final `dash_p_leaf_HTML' parameter.

* url.c: get_urls_html() and htmlfindurl() now take final
`dash_p_leaf_HTML' parameter.

* url.h (get_urls_html): Now takes final `dash_p_leaf_HTML' parameter.

* wget.h: Added some comments and new INFINITE_RECURSION #define.

* wget.texi (Recursive Retrieval Options): Documented new -p option.
 2000-08-30 04:26:21 -07:00
dan
001392bf2b [svn] * main.c (print_help): -B / --base was not mentioned. 2000-08-23 15:40:20 -07:00
dan
1f0acebeb0 [svn] * main.c (print_help): Modified -nc description to mention that it also prevents 
the creation of multiple versions of the same file with ".<number>" suffixes.
 2000-08-22 20:11:55 -07:00
hniksic
7794db052c [svn] Committed Jan Prikryl's patch from 
<20000709171425.A16267@launzatte.cg.tuwien.ac.at>.
 2000-07-14 07:15:23 -07:00
dan
ae77e4f08e [svn] Oops. Meant to check this change in with my last one, but the commit wouldn't 
go through without doing an update first, and I forgot to make the change the
second time.  Just changed an erroneous main.c (main) to main.c (print_help).
 2000-06-09 14:40:26 -07:00
dan
eea2d24220 [svn] Heiko's --help output for --waitretry was over 80 columns. Shortened. It also 
said that 0 seconds are waited after the first retry, which I believe is
incorrect and does not match what's written elsewhere (e.g. wget.texi).  Changed
to 1.
 2000-06-09 13:59:56 -07:00
hniksic
1765080b2e [svn] Comment fix. 2000-06-09 01:03:19 -07:00
hniksic
2e806fb2f3 [svn] Don't try to chmod() symlinks. 2000-06-01 04:20:05 -07:00
hniksic
0eec6b9f30 [svn] Committed my patch <dpem6hln1k.fsf@mraz.iskon.hr>. 2000-06-01 03:47:03 -07:00
dan
b05feb3ae2 [svn] Damir Dzeko <ddzeko@zesoi.fer.hr> did not document his new --referer option. 
Did so (--help output and wget.texi).  Also tweaked --help output for --execute.
 2000-05-22 19:29:38 -07:00
hniksic
ee6065f581 [svn] Committed my patch from <dpd7mj3sap.fsf@mraz.iskon.hr>. 2000-05-19 00:37:22 -07:00
hniksic
80cebf2a76 [svn] hniksic@srce.hr -> hniksic@iskon.hr 2000-04-21 02:34:39 -07:00
hniksic
094481c386 [svn] Committed host.c patch from <dpk8i3za97.fsf_-_@mraz.iskon.hr>. 2000-04-14 02:31:21 -07:00
hniksic
6b4a85888e [svn] Commit several fixes. 2000-04-12 06:23:35 -07:00
dan
1ecfed1e10 [svn] * host.c (store_hostaddress): R. K. Owen's patch introduces a "left shift count 
>= width of type" warning on 32-bit architectures.  Got rid of it by tricking
  the compiler w/ a variable.

* url.c (UNSAFE_CHAR): The macro didn't include all the illegal characters per
  RFC1738, namely everything above '~'.  It also generated a warning on OSes
  where char =~ unsigned char.  Fixed.
 2000-04-04 20:08:10 -07:00
hniksic
bc7060a81d [svn] More old fixes. 2000-03-31 06:14:58 -08:00
hniksic
aeabb42714 [svn] Commit another old fix. 2000-03-31 06:08:57 -08:00
hniksic
858adf01cd [svn] Fix store_hostaddress() on big-endian 64-bit machines. 2000-03-31 06:07:07 -08:00
hniksic
dee64b0b16 [svn] Fix indentation. 2000-03-31 06:05:53 -08:00
hniksic
0d42b49e30 [svn] Commit really old change. 2000-03-31 06:04:54 -08:00
hniksic
6b0aaebf33 [svn] Committed patch from <dp8zyzz1se.fsf@mraz.iskon.hr>. 2000-03-31 05:51:53 -08:00
hniksic
c71f174ed6 [svn] Changes from <9t9pusol5a1.fsf@mraz.iskon.hr>. 2000-03-21 07:47:45 -08:00
dan
4454f6ce0a [svn] * TODO: Removed done item: we now have an option (-G) that makes it easy to 
download a single HTML document and all its constituents.

* po/*.{gmo,po,pot}: Regenerated after adding new options.

* po/hr.po: Hrvoje forgot '\n's on his translations of my altered messages,
causing msgfmt to balk and `make install' to fail.


* wget.texi (Recursive Retrieval Options): In -K description, added a link to
the discussion of interaction with -N.
(Recursive Accept/Reject Options): Did some alphabetizing and added descriptions
of new --follow-tags and -G / --ignore-tags options.
(Following Links): Changed "the loads of" to "loads of".
(Wgetrc Commands): Added descriptions of new follow_tags and ignore_tags
commands.


* html.c (idmatch): Implemented checking of my new --follow-tags and
--ignore-tags options.

* init.c (commands): Added comment reminding people adding new entries doing
allocation to add corresponding freeing in cleanup().
(commands): Added new followtags and ignoretags commands.
(cleanup): Free storage for new followtags and ignoretags.

* main.c: Use of "comma-separated list" was random -- normalized it.  Did some
alphabetization.  Added comments pointing out "Options without arguments" and
"Options accepting an argument" sections of long_options[].  Added new options
--follow-tags and -G / --ignore-tags.  Added comment that Damir's --referer is
currently undocumented.  Added comment that Heiko's --waitretry is partially
undocumented (mentioned in --help but not in wget.texi).  Moved improperly
sorted 24, 129, and 'G' cases.

* options.h (struct options): Added new fields follow_tags and ignore_tags.

* wget.h: Added "#define EQ 0" so we can say "strcmp(a, b) == EQ".
 2000-03-10 22:48:06 -08:00
dan
66ced51104 [svn] Dan Berger responded to my email. Added his explanation of what his patch was 
coded for (downloading StarOffice from Sun's website).  He says he doesn't use
wget any more, so he won't be writing a patch that allows downloading that
without breaking anything (such a patch would apparently involve stopping
certain characters in the URL from being escaped).
 2000-03-02 15:49:37 -08:00
dan
3a8c75cac4 [svn] Dan Berger's query string patch is totally bogus. If you have two different 
URLs, gen_page.cgi?page1 and get_page.cgi?page2, they'll both be saved as
get_page.cgi and the second will overwrite the first.  Also, parameters to
implicit CGIs, like "http://www.host.com/db/?2000-03-02" cause the URLs to be
printed with trailing garbage characters, and could seg fault.  I'm not sure
what Dan had in mind with this patch (no explanatory comments), but I'm removing
it for now.  If he can rewrite it so it doesn't break stuff, okay.
 2000-03-02 14:48:07 -08:00
dan
03e5e4fe4d [svn] recur.c (parse_robots): Applied Edward J. Sabol's patch for Guan Yang's reported 
problem with "User-agent:<space>*<space>" lines.
 2000-03-02 13:28:59 -08:00
dan
d2e1d7fe9d [svn] Hrvoje didn't regenerate the .info files after changing wget.texi. 
Got rid of newly-introduced nested-if warnings in ftp.c and http.c.  Fixed
apparently completely untested code in main.c that was trying to provide --wait
/ --waitretry backwards compatibility, but had multiple fundamental bugs.
 2000-03-02 13:17:47 -08:00
hniksic
5d8cfbd904 [svn] Applied contributed patches (see ChangeLog for details.) 2000-03-02 06:45:37 -08:00
hniksic
1dc66a6cf6 [svn] *** empty log message *** 2000-03-02 06:23:22 -08:00
hniksic
33dbab7add [svn] Added contributed patch. 2000-03-02 06:18:53 -08:00
hniksic
2b2fd2924a [svn] Added user-contributed patches. 2000-03-02 06:16:12 -08:00
hniksic
cf35e2009d [svn] Applied contributed patch. 2000-03-02 05:34:05 -08:00
hniksic
f4f8e83327 [svn] Applied Edward Sabol's patch. 2000-03-02 05:28:31 -08:00
dan
4331c39c9a [svn] Implemented the item I formerly had in the TODO: When -K and -N are used 
together, we compare local file X.orig (if extant) against server file X.
Previously -k and -N were worthless in combination because the local converted
files always differed from the server versions.
 2000-03-01 22:33:48 -08:00
dan
e0a58713f7 [svn] Upped version number from 1.5.3. to 1.5.3+dev. Because the development source 
is available via anonymous CVS and desirable features are being added, it's
quite possible for end-users to be getting their hands on development versions.
They may report bugs, so if we don't change the version number, we'll have to
continually followup the statement "I'm using version 1.5.3" with the question
"The FTP archive or the CVS source?"  Better to just make this development
version have a unique number.  Once we're ready to actually release the next
version, we can up the version from 1.5.3+dev to 1.5.4, or 1.6, or whatever it
turns out to be (depending on how much development gets done).

Also made minor updates (dates, email addresses) to wget.texi.
 2000-02-29 16:50:52 -08:00
dan
e5408e7db8 [svn] Implemented new -K / --backup-converted / backup_converted = on option. 2000-02-29 16:17:23 -08:00
kwget
31d6616c48 [svn] Initial revision 1999-12-01 23:42:23 -08:00