Commit Graph

380 Commits

Author SHA1 Message Date
hniksic 75699d6213 [svn] Use the new function `random_number' that doesn't depend on RAND_MAX
being defined.
Published in <sxsheqqq6xb.fsf@florida.arsdigita.de>.
2001-12-17 06:05:08 -08:00
hniksic a3500d32d7 [svn] Move path_simplify to url.c. 2001-12-14 07:46:00 -08:00
hniksic 0f120eee66 [svn] Fix error message when $WGETRC not found.
Published in <sxswuzrylnm.fsf@florida.arsdigita.de>.
2001-12-13 11:19:03 -08:00
hniksic f031900662 [svn] Don't abort when one URL references more than one file.
Published in <sxs1yhz0w1m.fsf@florida.arsdigita.de>.
2001-12-13 11:18:31 -08:00
hniksic 5b575eef31 [svn] Check for conn->ssl before using ssl_iwrite. 2001-12-13 08:46:56 -08:00
hniksic 6821132a4d [svn] Bump version to 1.8.1-pre1. 2001-12-12 23:40:50 -08:00
hniksic 3b44ca73ab [svn] Fix the broken URLs that pointed to info.webcrawler.com to point to
the new www.robotstxt.org site.
2001-12-12 23:29:05 -08:00
hniksic 3ddcea34a4 [svn] Mark <embed href=...> as external. 2001-12-12 23:18:59 -08:00
hniksic b9f370004d [svn] Cosmetic changes to get_urls_html. 2001-12-12 11:06:10 -08:00
hniksic d425985c37 [svn] Minor doc update. 2001-12-12 09:01:26 -08:00
hniksic 8817f4c1a4 [svn] Break up collect_tags_mapper into several functions.
Published in <sxsg06gla1h.fsf@florida.arsdigita.de>.
2001-12-12 07:43:01 -08:00
hniksic 1dee527a56 [svn] Use a typedef for IPv4 address.
Published in <sxsn10qrwbj.fsf@florida.arsdigita.de>.
2001-12-11 00:32:58 -08:00
hniksic b8789d7798 [svn] Fix obvious memory leaks in the VMS directory parser.
Published in <sxsadwqpbo1.fsf@florida.arsdigita.de>.
2001-12-10 21:29:52 -08:00
hniksic 1365950c01 [svn] Logging system bugfixes and improvements.
Published in <sxsofl7vdyo.fsf@florida.arsdigita.de>.
2001-12-09 21:31:45 -08:00
hniksic fb9368e889 [svn] Restore sanity check in address_list_set_faulty. 2001-12-09 18:33:08 -08:00
hniksic 943f657aa7 [svn] Rename long_to_string to number_to_string, and make it return a useful
value.
2001-12-09 18:29:12 -08:00
hniksic 997a87548c [svn] Minor fix for path_simplify.
Submitted in <sxsheqzx1qv.fsf@florida.arsdigita.de>.
2001-12-09 18:12:17 -08:00
hniksic 0e72aa6e13 [svn] Rewrite path_simplify.
Published in <sxspu5nx2yi.fsf@florida.arsdigita.de>.
2001-12-09 17:58:37 -08:00
hniksic 233fcbc44d [svn] Would abort when given invalid progress type.
Published in <sxsg06kxc9g.fsf@florida.arsdigita.de>.
2001-12-09 14:25:34 -08:00
hniksic e521ee38ff [svn] Remove stray debugging message.
Published in <sxszo4sxjpw.fsf@florida.arsdigita.de>.
2001-12-09 11:44:20 -08:00
hniksic 0a89fc1a10 [svn] Fix a minor ETA padding glitch.
Published in <sxs667hyp19.fsf@florida.arsdigita.de>.
2001-12-08 20:51:40 -08:00
hniksic fdd51b8d46 [svn] Bump version to 1.8. 2001-12-08 17:37:17 -08:00
hniksic dd84231c6a [svn] Minor fixes prompted by `lint'.
Published in <sxsadwt2nkg.fsf@florida.arsdigita.de>.
2001-12-08 17:24:41 -08:00
hniksic 60680e27db [svn] Release 1.8-pre2. 2001-12-07 19:44:23 -08:00
hniksic 4e5bbd646b [svn] Various progress-bar related fixes.
Published in <sxspu5slja3.fsf@florida.arsdigita.de>.
2001-12-06 02:45:27 -08:00
hniksic 760e87d7a0 [svn] Bump version to 1.8-pre1. 2001-12-05 23:17:20 -08:00
hniksic 39b2248bde [svn] Fall back to dot progress when forced to background.
Published in <sxs1yi8n7lx.fsf@florida.arsdigita.de>.
2001-12-05 23:14:35 -08:00
hniksic f8e6feb6bc [svn] Fix varargs usage in logvprintf.
Published in <sxs667knbe1.fsf@florida.arsdigita.de>.
2001-12-05 21:53:21 -08:00
hniksic fcf68c0e9a [svn] `--sslegdsock' -> `--egd-file'
Published in <sxsadwwnc7h.fsf@florida.arsdigita.de>.
2001-12-05 21:35:17 -08:00
hniksic e16c0ba78e [svn] Add information about the beta releases. 2001-12-05 17:24:24 -08:00
hniksic f5d20aef32 [svn] Make the message printed in ssl_init_prng translatable. 2001-12-05 17:15:05 -08:00
hniksic 0620ada923 [svn] Fix OpenSSL PRNG seeding.
Published in <sxs7ks1noc4.fsf@florida.arsdigita.de>.
2001-12-05 17:13:31 -08:00
hniksic b248bfe395 [svn] Don't abort in read_whole_lines when a line begins with \0.
Published in <sxsu1v5nrtg.fsf@florida.arsdigita.de>.
2001-12-05 15:58:12 -08:00
hniksic 8a2ab60263 [svn] Fix overzealous URL-removal in register_download.
Published in <sxszo4yqq91.fsf@florida.arsdigita.de>.
2001-12-04 19:51:23 -08:00
hniksic eef4527c24 [svn] Doc fix. 2001-12-04 15:42:18 -08:00
hniksic 0fdc1bd8c0 [svn] Fix downloading of duplicate URLs.
Published in <sxsvgfmu2bj.fsf@florida.arsdigita.de>.
2001-12-04 13:03:35 -08:00
hniksic abf215c1e3 [svn] snprintf.c (dopr): Use `unsigned int' as the second argument to va_arg
when casting to `unsigned short' is intended.
Submitted by Ian Abbott in <3C0CB09F.21762.34A1F1@localhost>.
2001-12-04 04:44:58 -08:00
hniksic f70c9c6ede [svn] Windows update from Herold Heiko. 2001-12-04 02:33:18 -08:00
hniksic e986f7dad3 [svn] Quote '?' as '%3F' in local files when `--html-extension' is turned on.
Published in <sxszo4ztiwr.fsf@florida.arsdigita.de>.
2001-12-04 01:49:37 -08:00
hniksic 79f868cd0f [svn] Cast va_arg(..., int) to short if a short value is expected.
Published in <sxsbshgxfs5.fsf@florida.arsdigita.de>.
2001-12-03 11:31:17 -08:00
hniksic f58c338aea [svn] snprintf.c: Replace `short int' and `unsigned short int' with `int' when
using it as the second argument to `va_arg'.
Published in <sxsu1v8xisg.fsf@florida.arsdigita.de>.
2001-12-03 10:28:08 -08:00
hniksic 29a338cc58 [svn] Use address_list_new_one.
Published in <sxsbshgyz71.fsf@florida.arsdigita.de>.
2001-12-03 09:48:12 -08:00
hniksic 400201444f [svn] Don't initialize TMPSTORE directly.
Submitted by Andre Majorel.
2001-12-03 09:31:23 -08:00
hniksic 6d93a95e37 [svn] Declare h_errno in host.c, but not elsewhere. 2001-12-03 09:22:06 -08:00
hniksic f5799945b0 [svn] file_merge: if BASE doesn't contain a slash, just return a copy of FILE.
Published in <sxssnatmh6s.fsf@florida.arsdigita.de>.
2001-12-02 13:44:16 -08:00
hniksic acf2d79a8a [svn] When PWD fails, assume "/".
Published in <sxs667qr5a0.fsf@florida.arsdigita.de>.
2001-12-01 13:37:40 -08:00
hniksic 8b2a216c77 [svn] Make --base -i work.
Published in <sxsoflisqcf.fsf@florida.arsdigita.de>.
2001-12-01 11:17:19 -08:00
hniksic 07e6be3527 [svn] Don't document `-nh' in --help output.
Published in <sxs4rnau642.fsf@florida.arsdigita.de>.
2001-12-01 10:51:32 -08:00
hniksic 569fd61c95 [svn] Use the full path when building the authorization line.
Published in <sxsitbqu9iw.fsf@florida.arsdigita.de>.
2001-12-01 09:39:07 -08:00
hniksic 3ff0a9ad00 [svn] Minor tweak in path_matches in cookies.c. 2001-12-01 07:34:55 -08:00
hniksic 57dd93f915 [svn] Don't expect HTTP paths to begin with '/'.
Published in <sxsvgfrv7ky.fsf@florida.arsdigita.de>.
2001-11-30 21:22:17 -08:00
hniksic 92b269acad [svn] Match hosts against domains per Netscape cookie "specification".
Published in <sxszo53v8by.fsf@florida.arsdigita.de>.
2001-11-30 21:08:03 -08:00
hniksic f4d019a423 [svn] Correctly convert links in <meta http-equiv=Refresh content="...">.
Published in <sxsadx3wp49.fsf@florida.arsdigita.de>.
2001-11-30 20:18:51 -08:00
hniksic 7ab7f93f8d [svn] Make -p work with framed pages.
Published in <sxsu1vby71t.fsf@florida.arsdigita.de>.
2001-11-30 19:06:41 -08:00
hniksic 406fb8bbef [svn] Don't allow more than 20 successive redirections. 2001-11-30 13:33:31 -08:00
hniksic a4db28e20f [svn] Ignore -np when in -p mode.
Published in <sxsg06w2c52.fsf@florida.arsdigita.de>.
2001-11-30 13:17:53 -08:00
hniksic 5baed885db [svn] Fix netrc authorization in conjunction with HTTP.
Submitted by Daniel BODEA in <011901c162ca$19779df0$25c0a8c0@GHOTIX>.
2001-11-30 01:33:22 -08:00
hniksic 2c37aef2d8 [svn] Don't forget to shutdown the SSL structure if the socket times out.
Submitted by T. Bharath in <3B3DEBC7.2537186A@responsenetworks.com>.
2001-11-30 00:57:03 -08:00
hniksic 7674ecd97e [svn] Simplify display_image. 2001-11-30 00:02:33 -08:00
hniksic ae3c268719 [svn] Implement EGD support.
Submitted by Christian Fraenkel in <005501c17920$1312d440$4a05a8c0@isn>.
2001-11-29 23:39:08 -08:00
hniksic 999388bfa0 [svn] Check for memmove and implement one if it's missing. 2001-11-29 11:43:29 -08:00
hniksic b6bbc32e14 [svn] Guard against header files getting included twice. 2001-11-29 10:55:52 -08:00
hniksic b65661a879 [svn] Remove char/unsigned char warnings emitted by Sun cc. 2001-11-29 10:48:43 -08:00
hniksic fb98d1e4b0 [svn] Remove implicit declaration warnings. 2001-11-29 10:22:18 -08:00
hniksic 39482df431 [svn] descend_url_p: When resolving no_parent, compare with the start url,
not the parent url.
Published in <sxspu614ikm.fsf@florida.arsdigita.de>.
2001-11-29 09:04:28 -08:00
hniksic 9c1c7f27cd [svn] Windows fixes by Herold Heiko. 2001-11-29 06:15:11 -08:00
hniksic bb8e524316 [svn] Initialize al->faulty.
Published in <sxsvgft65an.fsf@florida.arsdigita.de>.
2001-11-29 06:06:03 -08:00
hniksic 6218fbed2b [svn] Accept the broken Content-Range format emitted by Sun's server.
Published in <sxsg06x7kld.fsf@florida.arsdigita.de>.
2001-11-29 06:03:33 -08:00
hniksic fb7fb36cb8 [svn] Resurrect opt.dot_style. 2001-11-27 18:44:18 -08:00
hniksic d4c6949a05 [svn] Use rand instead of random.
Published in <sxsu1vgataq.fsf@florida.arsdigita.de>.
2001-11-27 11:49:28 -08:00
hniksic 9b202ba261 [svn] * retr.c (retrieve_from_file): Initialize `new_file' to NULL to
prevent seg fault.
Submitted by Ian Abbott in <3C03DE8A.845.D0E495@localhost>.
2001-11-27 11:14:34 -08:00
hniksic 8196a09904 [svn] Don't reuse IP addresses proven to be faulty, unless only such ones remain.
Published in <sxs8zcsfemf.fsf@florida.arsdigita.de>.
2001-11-27 06:55:40 -08:00
hniksic cca7541b10 [svn] Don't translate %d-%d. 2001-11-27 04:58:09 -08:00
hniksic 1c906e47d3 [svn] Remove stray HAVE_RANDOM check from main.c. 2001-11-27 04:54:31 -08:00
hniksic 9656223552 [svn] Fix FTP PASV output.
Published in <sxslmgsfkgj.fsf@florida.arsdigita.de>.
2001-11-27 04:49:13 -08:00
hniksic baf8750197 [svn] Default the progress implementation to "bar".
Published in <sxsu1vgfqx7.fsf@florida.arsdigita.de>.
2001-11-27 02:29:45 -08:00
hniksic 69c78db55b [svn] Commence bar progress with two newlines. 2001-11-27 02:17:09 -08:00
hniksic 7175ea4a12 [svn] Check for random.
Published in <sxs4rngh6t2.fsf@florida.arsdigita.de>.
2001-11-27 02:11:13 -08:00
hniksic bae3162c03 [svn] New option `--limit-rate'.
Published in <sxsd725cn56.fsf@florida.arsdigita.de>.
2001-11-26 12:07:13 -08:00
hniksic 278fb2412d [svn] Declare ERR in gethttp.
Submitted by Ian Abbott in <3C022295.15135.464B54@localhost>.
2001-11-26 04:51:25 -08:00
hniksic 84396de673 [svn] Allocate a timer directly in get_contents.
Published in <sxsherhbsvl.fsf@florida.arsdigita.de>.
2001-11-26 04:49:10 -08:00
hniksic 024cb5ed3a [svn] A lot of host name changes.
Published in <sxs3d32856s.fsf@florida.arsdigita.de>.
2001-11-25 21:36:33 -08:00
hniksic f6921edc73 [svn] Be careful whether we want to descend into results of redirection.
Published in <sxs7kse8hmq.fsf@florida.arsdigita.de>.
2001-11-25 17:11:48 -08:00
hniksic 2c41d783c6 [svn] New option --random-wait.
Submitted by Alan Eldridge in
<200111042106.fA4L63b75804@wwweasel.geeksrus.net>.
2001-11-25 13:23:15 -08:00
hniksic 3afb9c659a [svn] Recursion and progress bar tweaks.
Published in <sxsd727cvc0.fsf@florida.arsdigita.de>.
2001-11-25 13:03:30 -08:00
hniksic df05e7ff10 [svn] Handle <base href=...> when converting links.
Published in <sxsadxaae3t.fsf@florida.arsdigita.de>.
2001-11-25 10:40:55 -08:00
hniksic 2e6e3f21f8 [svn] Attempt to quote '?' as "%3F" when linking to local files.
Given up on the attempt, as it breaks local browsing.
2001-11-25 09:44:28 -08:00
hniksic 95631700f7 [svn] Remove host canonicalization code.
Published in <sxsg072ai5v.fsf@florida.arsdigita.de>.
2001-11-25 09:13:20 -08:00
hniksic 05463c7121 [svn] Commit progress bar tweaks.
Published in <sxsd727cvc0.fsf@florida.arsdigita.de>.
2001-11-24 20:46:26 -08:00
hniksic 222e9465b7 [svn] Implemented breadth-first retrieval.
Published in <sxsherjczw2.fsf@florida.arsdigita.de>.
2001-11-24 19:10:34 -08:00
hniksic b88223f99d [svn] Don't modify bp->total_length if it equals zero. 2001-11-24 10:05:57 -08:00
hniksic 177b6ee8fd [svn] Print the actual error message when parsing of redirection URL fails. 2001-11-24 06:02:10 -08:00
hniksic 212eb1ddaf [svn] Fake a miniscule amount of download time when none is detected. 2001-11-23 18:38:47 -08:00
hniksic 1da2947d50 [svn] Fix typo that made us never use robots.txt. 2001-11-23 17:48:28 -08:00
hniksic 87ed8be305 [svn] Don't translate "%ld ". 2001-11-23 12:20:40 -08:00
hniksic 4f91014e3f [svn] Allow the user to force bar progress.
Published in <sxs8zcxh2x5.fsf@florida.arsdigita.de>.
2001-11-23 08:24:06 -08:00
hniksic 49b93249b1 [svn] Seed OpenSSL's RNG.
Submitted by Lemble Gregory.
2001-11-23 08:18:41 -08:00
hniksic 905472770e [svn] Minor progress bar fixes.
Published in <sxsn11dh3fc.fsf@florida.arsdigita.de>.
2001-11-23 08:12:53 -08:00
hniksic eb9a02b828 [svn] Minor fix for the new progress bar. 2001-11-22 21:09:39 -08:00
hniksic cdcf67a5bd [svn] Big progress bar update.
Published in <sxsn11ehyn1.fsf@florida.arsdigita.de>.
2001-11-22 20:59:52 -08:00