moparisthebest/wget
1
0
Fork 0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Code Issues Releases Wiki Activity
1,024 Commits 1 Branch 0 Tags 9.6 MiB
9af99f3b83
Commit Graph

633 Commits

Author SHA1 Message Date
hniksic
1600aaeaa6 [svn] Revert to calculating ETA based on average download speed. 
Published in <sxspu17sl10.fsf@florida.arsdigita.de>.
 2002-04-10 07:10:03 -07:00
hniksic
538307f151 [svn] Keep updating a subinterval until it reaches or exceeds a watermark. 
That way the measurement will be guaranteed to span a configurable
minimum of time.  The current default is 3s in 30 100ms intervals.

Published in <sxsu1qkszdb.fsf@florida.arsdigita.de>.
 2002-04-10 02:24:28 -07:00
hniksic
c292e8e153 [svn] Print the current download speed, rather than the average. 
Published in <sxs3cy4yacm.fsf@florida.arsdigita.de>.
 2002-04-09 15:10:01 -07:00
abbotti
c3c1c24f5c [svn] Fix for Borland's broken (on Win9X) `utime' function. 
Submitted by Ian Abbott in <3CB33A8E.15259.1E52AF@localhost>.
(Based on original patch by Chin-yuan Kuo in
<20020321015049.16722.qmail@web16202.mail.tpe.yahoo.com>.)
 2002-04-09 11:29:54 -07:00
hniksic
07d72c3cd3 [svn] Propagate the result of ftp_retrieve_glob to the caller of ftp_loop. 
Published in <sxssn663zwl.fsf@florida.arsdigita.de>.
 2002-04-08 09:43:36 -07:00
abbotti
80a90d6d2c [svn] Updated several dependencies for object files. 
Submitted by Ian Abbott in <3C9F8BA4.19135.14568BF@localhost>.
 2002-03-26 10:59:44 -08:00
abbotti
9f485af560 [svn] Dependcies update for src/mswindows.c. 
Submitted by Ian Abbott in <3C98D8C6.31335.36EB6F@localhost>.
 2002-03-20 10:56:45 -08:00
abbotti
47a8225eda [svn] Don't include netdb.h on windows. 
Submitted by Ian Abbott in <3C964B8C.18942.D3115@localhost>.
 2002-03-18 12:21:58 -08:00
hniksic
1fa3b90235 [svn] Handle starting URL of recursing download being non-parsable. 
Published in <sxszo26t33k.fsf@florida.arsdigita.de>.
 2002-02-18 22:09:57 -08:00
hniksic
562ab4ae8a [svn] (DO_REALLOC_FROM_ALLOCA): Multiply with sizeof(type) when calling 
xmalloc and memcpy.
Submitted by Andreas Damm in
<Pine.LNX.4.33.0202011632280.1281-200000@gate.rad-ab.u-net.com>.
 2002-02-18 21:32:59 -08:00
hniksic
667d494978 [svn] Only include Unix-specific includes #ifndef WINDOWS. 2002-02-18 21:25:42 -08:00
hniksic
75a080ad0d [svn] Follow https links from http. 
Submitted by Christian Lackas in <20020211202444.GA20371@lackas.desy.de>.
 2002-02-18 21:23:35 -08:00
hniksic
57f36f8a6a [svn] Add the necessary includes for compilation under FreeBSD. 
Submitted by Alan Eldridge in <200202130630.g1D6U3S07907@wwweasel.geeksrus.net>.
 2002-02-18 21:21:42 -08:00
hniksic
a9ff5853a9 [svn] when -c used, mark already fully retrieved file as successfully retrieved. 
Submitted by Ian Abbott in <3C6019F4.30803.FF43E9@localhost>.
 2002-02-18 21:18:43 -08:00
hniksic
b9e90c34b4 [svn] Don't treat '?' as a query string separator when parsing FTP URLs. 
Published in <sxslmdqxdmq.fsf@florida.arsdigita.de>.
 2002-02-18 21:09:14 -08:00
hniksic
0e40fc9a3c [svn] Don't crash on <meta http-equiv=refresh>. 
Published in <sxshep1q3je.fsf@florida.arsdigita.de>.
 2002-01-31 19:34:31 -08:00
hniksic
a861f718ed [svn] Enable compilation on Windows. 
Submitted by Herold Heiko in
<B11A7CEC1675D511A3890002A551AD7C37D8AE@srvnt08.previnet.it>.
 2002-01-30 18:23:04 -08:00
hniksic
6c4c785cc2 [svn] Remove redirection cycle detection. 
Published in <sxs7kpzhcwa.fsf@florida.arsdigita.de>.
 2002-01-30 11:12:20 -08:00
hniksic
f2bb99d102 [svn] Wrap numeric IPv6 addresses in square brackets when sending out HTTP 
`Host' header.
Published in <sxs7kq4vgzf.fsf@florida.arsdigita.de>.
 2002-01-26 15:19:10 -08:00
hniksic
1bea726393 [svn] Allow all hex digits in IPv6 IP addresses. 
Published in <sxsofjgvo72.fsf@florida.arsdigita.de>.
 2002-01-26 12:43:17 -08:00
hniksic
774c7c7461 [svn] *** empty log message *** 2002-01-26 11:01:39 -08:00
hniksic
ef1eda86c4 [svn] Allow IPv6 numeric addresses in URLs. 
Submitted in <sxsu1t9uedf.fsf@florida.arsdigita.de>.
 2002-01-26 11:00:38 -08:00
hniksic
a69cb0c3ad [svn] Various IPv6 fixes. 
Submitted in <sxsd6zz2jf7.fsf@florida.arsdigita.de>.
 2002-01-24 19:34:23 -08:00
hniksic
853a1c9e35 [svn] Fix some IPv6-related problems. 
Submitted in <sxsg04w6zl6.fsf@florida.arsdigita.de>.
 2002-01-23 22:19:35 -08:00
hniksic
cb40034035 [svn] Commit IPv6 support by Thomas Lussnig. 
Published in <sxsk7u8715e.fsf@florida.arsdigita.de>.
 2002-01-23 21:45:54 -08:00
hniksic
e59a7ee8ac [svn] Make -P work on Windows. 
Submitted by Ian Abbott in <3C447E8F.13424.16ED42@localhost>.
 2002-01-16 17:03:33 -08:00
hniksic
fb2ed23830 [svn] Skip initial whitespace before testing for EOL. 
Submitted in <sxsu1tl6bf2.fsf@florida.arsdigita.de>.
 2002-01-16 16:59:13 -08:00
hniksic
31d20e644c [svn] select the file descriptor only if no data is pending in SSL buffers. 
Submitted by tony@bluetail.com.
Published in <sxslmezocyp.fsf@florida.arsdigita.de>.
 2002-01-15 07:24:19 -08:00
hniksic
08c935bef2 [svn] Strip trailing whitespace in header_process(). 
Published in <sxsadvh0xpz.fsf@florida.arsdigita.de>.
 2002-01-14 07:17:34 -08:00
hniksic
46617228fa [svn] URL-decode user and password in URL. 
Published in <sxsita52hg6.fsf@florida.arsdigita.de>.
 2002-01-14 05:26:16 -08:00
hniksic
524a1f54dc [svn] Handle links to relative "net locations," e.g. <a href="//www.server.com/">. 2002-01-13 17:56:40 -08:00
hniksic
cafe798fec [svn] Invalidate socket if get_contents encountered an error. 
Published in <sxsita54sqy.fsf@florida.arsdigita.de>.
 2002-01-13 17:39:16 -08:00
hniksic
90afc592e4 [svn] Bumped version number to 1.8.1+cvs. 2001-12-29 02:15:55 -08:00
hniksic
11745f55bf [svn] Bump version to 1.8.1. 2001-12-24 13:02:25 -08:00
hniksic
a92b46f8ae [svn] Bump version. 2001-12-19 08:30:47 -08:00
hniksic
5c859be2d4 [svn] Bump version to 1.8.1-pre3. 2001-12-19 06:59:01 -08:00
hniksic
8db1264218 [svn] Enqueue start_url in the canonical form. 
Published in <sxsofkvi8zx.fsf@florida.arsdigita.de>.
 2001-12-19 06:27:29 -08:00
hniksic
001cac91a4 [svn] Check for requested verbosity in logputs. 
Published in <sxswuzjk0v6.fsf@florida.arsdigita.de>.
 2001-12-19 01:36:58 -08:00
hniksic
ca9319aaba [svn] Treat the "shortcut icon" link as inline. 
Published in <sxsadwgko2q.fsf@florida.arsdigita.de>.
 2001-12-18 17:15:34 -08:00
hniksic
2cf87bea8b [svn] Fix crash introduced by previous patch. 2001-12-18 14:20:14 -08:00
hniksic
40fd876c57 [svn] Descend into HTML files we've already downloaded. 2001-12-18 14:14:31 -08:00
hniksic
a45e8255cc [svn] Allow standalone compilation of html-parse.c. 2001-12-18 11:33:36 -08:00
hniksic
416671063a [svn] Propagate referrer information from retrieve_tree to retrieve_url. 
Submitted by Ian Abbott in <3C1F4BFE.17436.D2D7B2@localhost>.
 2001-12-18 07:22:03 -08:00
hniksic
daa2fd1afd [svn] Bump version. 2001-12-17 09:04:27 -08:00
hniksic
f03f033bf3 [svn] Bump version to 1.8.1-pre2. 2001-12-17 07:24:14 -08:00
hniksic
eb0f9de05d [svn] Simplify indentation in sleep_between_retrievals. 2001-12-17 07:00:25 -08:00
hniksic
75699d6213 [svn] Use the new function `random_number' that doesn't depend on RAND_MAX 
being defined.
Published in <sxsheqqq6xb.fsf@florida.arsdigita.de>.
 2001-12-17 06:05:08 -08:00
hniksic
a3500d32d7 [svn] Move path_simplify to url.c. 2001-12-14 07:46:00 -08:00
hniksic
0f120eee66 [svn] Fix error message when $WGETRC not found. 
Published in <sxswuzrylnm.fsf@florida.arsdigita.de>.
 2001-12-13 11:19:03 -08:00
hniksic
f031900662 [svn] Don't abort when one URL references more than one file. 
Published in <sxs1yhz0w1m.fsf@florida.arsdigita.de>.
 2001-12-13 11:18:31 -08:00
hniksic
5b575eef31 [svn] Check for conn->ssl before using ssl_iwrite. 2001-12-13 08:46:56 -08:00
hniksic
92676dafee [svn] Bump version. 2001-12-13 01:47:51 -08:00
hniksic
6821132a4d [svn] Bump version to 1.8.1-pre1. 2001-12-12 23:40:50 -08:00
hniksic
3b44ca73ab [svn] Fix the broken URLs that pointed to info.webcrawler.com to point to 
the new www.robotstxt.org site.
 2001-12-12 23:29:05 -08:00
hniksic
3ddcea34a4 [svn] Mark <embed href=...> as external. 2001-12-12 23:18:59 -08:00
hniksic
b9f370004d [svn] Cosmetic changes to get_urls_html. 2001-12-12 11:06:10 -08:00
hniksic
390adeea93 [svn] Use "incomplete" rather than "relative". 2001-12-12 10:32:17 -08:00
hniksic
d425985c37 [svn] Minor doc update. 2001-12-12 09:01:26 -08:00
hniksic
8817f4c1a4 [svn] Break up collect_tags_mapper into several functions. 
Published in <sxsg06gla1h.fsf@florida.arsdigita.de>.
 2001-12-12 07:43:01 -08:00
hniksic
1dee527a56 [svn] Use a typedef for IPv4 address. 
Published in <sxsn10qrwbj.fsf@florida.arsdigita.de>.
 2001-12-11 00:32:58 -08:00
hniksic
b8789d7798 [svn] Fix obvious memory leaks in the VMS directory parser. 
Published in <sxsadwqpbo1.fsf@florida.arsdigita.de>.
 2001-12-10 21:29:52 -08:00
hniksic
1365950c01 [svn] Logging system bugfixes and improvements. 
Published in <sxsofl7vdyo.fsf@florida.arsdigita.de>.
 2001-12-09 21:31:45 -08:00
hniksic
7d65f1b896 [svn] Doc update in read_whole_line. 2001-12-09 19:34:48 -08:00
hniksic
fb9368e889 [svn] Restore sanity check in address_list_set_faulty. 2001-12-09 18:33:08 -08:00
hniksic
943f657aa7 [svn] Rename long_to_string to number_to_string, and make it return a useful 
value.
 2001-12-09 18:29:12 -08:00
hniksic
997a87548c [svn] Minor fix for path_simplify. 
Submitted in <sxsheqzx1qv.fsf@florida.arsdigita.de>.
 2001-12-09 18:12:17 -08:00
hniksic
0e72aa6e13 [svn] Rewrite path_simplify. 
Published in <sxspu5nx2yi.fsf@florida.arsdigita.de>.
 2001-12-09 17:58:37 -08:00
hniksic
233fcbc44d [svn] Would abort when given invalid progress type. 
Published in <sxsg06kxc9g.fsf@florida.arsdigita.de>.
 2001-12-09 14:25:34 -08:00
hniksic
e521ee38ff [svn] Remove stray debugging message. 
Published in <sxszo4sxjpw.fsf@florida.arsdigita.de>.
 2001-12-09 11:44:20 -08:00
hniksic
0a89fc1a10 [svn] Fix a minor ETA padding glitch. 
Published in <sxs667hyp19.fsf@florida.arsdigita.de>.
 2001-12-08 20:51:40 -08:00
hniksic
cdc0cc0c1a [svn] Bump version. 2001-12-08 20:33:47 -08:00
hniksic
fdd51b8d46 [svn] Bump version to 1.8. 2001-12-08 17:37:17 -08:00
hniksic
dd84231c6a [svn] Minor fixes prompted by `lint'. 
Published in <sxsadwt2nkg.fsf@florida.arsdigita.de>.
 2001-12-08 17:24:41 -08:00
hniksic
171feaa3f2 [svn] Bump version. 2001-12-07 21:08:57 -08:00
hniksic
60680e27db [svn] Release 1.8-pre2. 2001-12-07 19:44:23 -08:00
hniksic
bfd017746b [svn] Doc fix. 2001-12-06 02:48:09 -08:00
hniksic
4e5bbd646b [svn] Various progress-bar related fixes. 
Published in <sxspu5slja3.fsf@florida.arsdigita.de>.
 2001-12-06 02:45:27 -08:00
hniksic
7c6f905f94 [svn] Bump version. 2001-12-05 23:23:55 -08:00
hniksic
760e87d7a0 [svn] Bump version to 1.8-pre1. 2001-12-05 23:17:20 -08:00
hniksic
39b2248bde [svn] Fall back to dot progress when forced to background. 
Published in <sxs1yi8n7lx.fsf@florida.arsdigita.de>.
 2001-12-05 23:14:35 -08:00
hniksic
00407b0762 [svn] Update copyright year. 2001-12-05 21:54:50 -08:00
hniksic
f8e6feb6bc [svn] Fix varargs usage in logvprintf. 
Published in <sxs667knbe1.fsf@florida.arsdigita.de>.
 2001-12-05 21:53:21 -08:00
hniksic
fcf68c0e9a [svn] --sslegdsock' -> --egd-file' 
Published in <sxsadwwnc7h.fsf@florida.arsdigita.de>.
 2001-12-05 21:35:17 -08:00
hniksic
e16c0ba78e [svn] Add information about the beta releases. 2001-12-05 17:24:24 -08:00
hniksic
f5d20aef32 [svn] Make the message printed in ssl_init_prng translatable. 2001-12-05 17:15:05 -08:00
hniksic
0620ada923 [svn] Fix OpenSSL PRNG seeding. 
Published in <sxs7ks1noc4.fsf@florida.arsdigita.de>.
 2001-12-05 17:13:31 -08:00
hniksic
b248bfe395 [svn] Don't abort in read_whole_lines when a line begins with \0. 
Published in <sxsu1v5nrtg.fsf@florida.arsdigita.de>.
 2001-12-05 15:58:12 -08:00
hniksic
8a2ab60263 [svn] Fix overzealous URL-removal in register_download. 
Published in <sxszo4yqq91.fsf@florida.arsdigita.de>.
 2001-12-04 19:51:23 -08:00
hniksic
936b074bd9 [svn] Doc fix. 2001-12-04 16:02:49 -08:00
hniksic
eef4527c24 [svn] Doc fix. 2001-12-04 15:42:18 -08:00
hniksic
c9dbaba251 [svn] Turn off debugging function. 2001-12-04 15:30:36 -08:00
hniksic
0fdc1bd8c0 [svn] Fix downloading of duplicate URLs. 
Published in <sxsvgfmu2bj.fsf@florida.arsdigita.de>.
 2001-12-04 13:03:35 -08:00
hniksic
abf215c1e3 [svn] snprintf.c (dopr): Use `unsigned int' as the second argument to va_arg 
when casting to `unsigned short' is intended.
Submitted by Ian Abbott in <3C0CB09F.21762.34A1F1@localhost>.
 2001-12-04 04:44:58 -08:00
hniksic
f70c9c6ede [svn] Windows update from Herold Heiko. 2001-12-04 02:33:18 -08:00
hniksic
b5b08b8110 [svn] Bump version. 2001-12-04 01:50:01 -08:00
hniksic
e986f7dad3 [svn] Quote '?' as '%3F' in local files when `--html-extension' is turned on. 
Published in <sxszo4ztiwr.fsf@florida.arsdigita.de>.
 2001-12-04 01:49:37 -08:00
hniksic
16b1387c7c [svn] Bump version. 2001-12-03 12:49:54 -08:00
hniksic
79f868cd0f [svn] Cast va_arg(..., int) to short if a short value is expected. 
Published in <sxsbshgxfs5.fsf@florida.arsdigita.de>.
 2001-12-03 11:31:17 -08:00
hniksic
f58c338aea [svn] snprintf.c: Replace short int' and unsigned short int' with `int' when 
using it as the second argument to `va_arg'.
Published in <sxsu1v8xisg.fsf@florida.arsdigita.de>.
 2001-12-03 10:28:08 -08:00
hniksic
29a338cc58 [svn] Use address_list_new_one. 
Published in <sxsbshgyz71.fsf@florida.arsdigita.de>.
 2001-12-03 09:48:12 -08:00
hniksic
400201444f [svn] Don't initialize TMPSTORE directly. 
Submitted by Andre Majorel.
 2001-12-03 09:31:23 -08:00
hniksic
6d93a95e37 [svn] Declare h_errno in host.c, but not elsewhere. 2001-12-03 09:22:06 -08:00
hniksic
f5799945b0 [svn] file_merge: if BASE doesn't contain a slash, just return a copy of FILE. 
Published in <sxssnatmh6s.fsf@florida.arsdigita.de>.
 2001-12-02 13:44:16 -08:00
hniksic
eb3cfe157a [svn] Bump version. 2001-12-02 08:40:37 -08:00
hniksic
d9d9bb2749 [svn] Bump version to 1.8-beta2. 2001-12-01 14:23:12 -08:00
hniksic
acf2d79a8a [svn] When PWD fails, assume "/". 
Published in <sxs667qr5a0.fsf@florida.arsdigita.de>.
 2001-12-01 13:37:40 -08:00
hniksic
8b2a216c77 [svn] Make --base -i work. 
Published in <sxsoflisqcf.fsf@florida.arsdigita.de>.
 2001-12-01 11:17:19 -08:00
hniksic
07e6be3527 [svn] Don't document `-nh' in --help output. 
Published in <sxs4rnau642.fsf@florida.arsdigita.de>.
 2001-12-01 10:51:32 -08:00
hniksic
d6064a4a94 [svn] Minor doc fix. 2001-12-01 09:48:34 -08:00
hniksic
569fd61c95 [svn] Use the full path when building the authorization line. 
Published in <sxsitbqu9iw.fsf@florida.arsdigita.de>.
 2001-12-01 09:39:07 -08:00
hniksic
3ff0a9ad00 [svn] Minor tweak in path_matches in cookies.c. 2001-12-01 07:34:55 -08:00
hniksic
57dd93f915 [svn] Don't expect HTTP paths to begin with '/'. 
Published in <sxsvgfrv7ky.fsf@florida.arsdigita.de>.
 2001-11-30 21:22:17 -08:00
hniksic
92b269acad [svn] Match hosts against domains per Netscape cookie "specification". 
Published in <sxszo53v8by.fsf@florida.arsdigita.de>.
 2001-11-30 21:08:03 -08:00
hniksic
f4d019a423 [svn] Correctly convert links in <meta http-equiv=Refresh content="...">. 
Published in <sxsadx3wp49.fsf@florida.arsdigita.de>.
 2001-11-30 20:18:51 -08:00
hniksic
4901488011 [svn] Bump version to 1.8-beta1+cvs. 2001-11-30 19:21:52 -08:00
hniksic
1f272be070 [svn] Bump version to 1.8-beta1. 2001-11-30 19:09:14 -08:00
hniksic
7ab7f93f8d [svn] Make -p work with framed pages. 
Published in <sxsu1vby71t.fsf@florida.arsdigita.de>.
 2001-11-30 19:06:41 -08:00
hniksic
406fb8bbef [svn] Don't allow more than 20 successive redirections. 2001-11-30 13:33:31 -08:00
hniksic
a4db28e20f [svn] Ignore -np when in -p mode. 
Published in <sxsg06w2c52.fsf@florida.arsdigita.de>.
 2001-11-30 13:17:53 -08:00
hniksic
ca5098a425 [svn] Update copyright statement. 2001-11-30 02:50:29 -08:00
hniksic
c828d1e8be [svn] Remove doc reference to non-extant ngethostbyname. 2001-11-30 02:44:17 -08:00
hniksic
5baed885db [svn] Fix netrc authorization in conjunction with HTTP. 
Submitted by Daniel BODEA in <011901c162ca$19779df0$25c0a8c0@GHOTIX>.
 2001-11-30 01:33:22 -08:00
hniksic
2c37aef2d8 [svn] Don't forget to shutdown the SSL structure if the socket times out. 
Submitted by T. Bharath in <3B3DEBC7.2537186A@responsenetworks.com>.
 2001-11-30 00:57:03 -08:00
hniksic
b4b0659e43 [svn] Fix preprocessor indentation. 2001-11-30 00:36:22 -08:00
hniksic
7674ecd97e [svn] Simplify display_image. 2001-11-30 00:02:33 -08:00
hniksic
ae3c268719 [svn] Implement EGD support. 
Submitted by Christian Fraenkel in <005501c17920$1312d440$4a05a8c0@isn>.
 2001-11-29 23:39:08 -08:00
hniksic
999388bfa0 [svn] Check for memmove and implement one if it's missing. 2001-11-29 11:43:29 -08:00
hniksic
b6bbc32e14 [svn] Guard against header files getting included twice. 2001-11-29 10:55:52 -08:00
hniksic
b65661a879 [svn] Remove char/unsigned char warnings emitted by Sun cc. 2001-11-29 10:48:43 -08:00
hniksic
fb98d1e4b0 [svn] Remove implicit declaration warnings. 2001-11-29 10:22:18 -08:00
hniksic
a3d3d452ab [svn] Make the MD5 references even more generic. 
Use OpenSSL's MD5 where available.
Published in <sxsg06x4f41.fsf@florida.arsdigita.de>.
 2001-11-29 10:17:54 -08:00
hniksic
39482df431 [svn] descend_url_p: When resolving no_parent, compare with the start url, 
not the parent url.
Published in <sxspu614ikm.fsf@florida.arsdigita.de>.
 2001-11-29 09:04:28 -08:00
hniksic
c99228cab2 [svn] Debugging function. 2001-11-29 06:57:30 -08:00
hniksic
9c1c7f27cd [svn] Windows fixes by Herold Heiko. 2001-11-29 06:15:11 -08:00
hniksic
bb8e524316 [svn] Initialize al->faulty. 
Published in <sxsvgft65an.fsf@florida.arsdigita.de>.
 2001-11-29 06:06:03 -08:00
hniksic
6218fbed2b [svn] Accept the broken Content-Range format emitted by Sun's server. 
Published in <sxsg06x7kld.fsf@florida.arsdigita.de>.
 2001-11-29 06:03:33 -08:00
hniksic
fb7fb36cb8 [svn] Resurrect opt.dot_style. 2001-11-27 18:44:18 -08:00
hniksic
f0dff25336 [svn] Fix typo. 2001-11-27 18:24:22 -08:00
hniksic
d4c6949a05 [svn] Use rand instead of random. 
Published in <sxsu1vgataq.fsf@florida.arsdigita.de>.
 2001-11-27 11:49:28 -08:00
hniksic
9b202ba261 [svn] * retr.c (retrieve_from_file): Initialize `new_file' to NULL to 
prevent seg fault.
Submitted by Ian Abbott in <3C03DE8A.845.D0E495@localhost>.
 2001-11-27 11:14:34 -08:00
hniksic
8196a09904 [svn] Don't reuse IP addresses proven to be faulty, unless only such ones remain. 
Published in <sxs8zcsfemf.fsf@florida.arsdigita.de>.
 2001-11-27 06:55:40 -08:00
hniksic
cca7541b10 [svn] Don't translate %d-%d. 2001-11-27 04:58:09 -08:00
hniksic
1c906e47d3 [svn] Remove stray HAVE_RANDOM check from main.c. 2001-11-27 04:54:31 -08:00
hniksic
9656223552 [svn] Fix FTP PASV output. 
Published in <sxslmgsfkgj.fsf@florida.arsdigita.de>.
 2001-11-27 04:49:13 -08:00
hniksic
baf8750197 [svn] Default the progress implementation to "bar". 
Published in <sxsu1vgfqx7.fsf@florida.arsdigita.de>.
 2001-11-27 02:29:45 -08:00
hniksic
69c78db55b [svn] Commence bar progress with two newlines. 2001-11-27 02:17:09 -08:00
hniksic
7175ea4a12 [svn] Check for random. 
Published in <sxs4rngh6t2.fsf@florida.arsdigita.de>.
 2001-11-27 02:11:13 -08:00
hniksic
bae3162c03 [svn] New option `--limit-rate'. 
Published in <sxsd725cn56.fsf@florida.arsdigita.de>.
 2001-11-26 12:07:13 -08:00
hniksic
278fb2412d [svn] Declare ERR in gethttp. 
Submitted by Ian Abbott in <3C022295.15135.464B54@localhost>.
 2001-11-26 04:51:25 -08:00
hniksic
84396de673 [svn] Allocate a timer directly in get_contents. 
Published in <sxsherhbsvl.fsf@florida.arsdigita.de>.
 2001-11-26 04:49:10 -08:00
hniksic
024cb5ed3a [svn] A lot of host name changes. 
Published in <sxs3d32856s.fsf@florida.arsdigita.de>.
 2001-11-25 21:36:33 -08:00
hniksic
f6921edc73 [svn] Be careful whether we want to descend into results of redirection. 
Published in <sxs7kse8hmq.fsf@florida.arsdigita.de>.
 2001-11-25 17:11:48 -08:00
hniksic
2c41d783c6 [svn] New option --random-wait. 
Submitted by Alan Eldridge in
<200111042106.fA4L63b75804@wwweasel.geeksrus.net>.
 2001-11-25 13:23:15 -08:00
hniksic
3afb9c659a [svn] Recursion and progress bar tweaks. 
Published in <sxsd727cvc0.fsf@florida.arsdigita.de>.
 2001-11-25 13:03:30 -08:00
hniksic
df05e7ff10 [svn] Handle <base href=...> when converting links. 
Published in <sxsadxaae3t.fsf@florida.arsdigita.de>.
 2001-11-25 10:40:55 -08:00
hniksic
2e6e3f21f8 [svn] Attempt to quote '?' as "%3F" when linking to local files. 
Given up on the attempt, as it breaks local browsing.
 2001-11-25 09:44:28 -08:00
hniksic
95631700f7 [svn] Remove host canonicalization code. 
Published in <sxsg072ai5v.fsf@florida.arsdigita.de>.
 2001-11-25 09:13:20 -08:00
hniksic
05463c7121 [svn] Commit progress bar tweaks. 
Published in <sxsd727cvc0.fsf@florida.arsdigita.de>.
 2001-11-24 20:46:26 -08:00
hniksic
222e9465b7 [svn] Implemented breadth-first retrieval. 
Published in <sxsherjczw2.fsf@florida.arsdigita.de>.
 2001-11-24 19:10:34 -08:00
hniksic
b88223f99d [svn] Don't modify bp->total_length if it equals zero. 2001-11-24 10:05:57 -08:00
hniksic
177b6ee8fd [svn] Print the actual error message when parsing of redirection URL fails. 2001-11-24 06:02:10 -08:00
hniksic
212eb1ddaf [svn] Fake a miniscule amount of download time when none is detected. 2001-11-23 18:38:47 -08:00
hniksic
1da2947d50 [svn] Fix typo that made us never use robots.txt. 2001-11-23 17:48:28 -08:00
hniksic
87ed8be305 [svn] Don't translate "%ld ". 2001-11-23 12:20:40 -08:00
hniksic
4f91014e3f [svn] Allow the user to force bar progress. 
Published in <sxs8zcxh2x5.fsf@florida.arsdigita.de>.
 2001-11-23 08:24:06 -08:00
hniksic
49b93249b1 [svn] Seed OpenSSL's RNG. 
Submitted by Lemble Gregory.
 2001-11-23 08:18:41 -08:00
hniksic
905472770e [svn] Minor progress bar fixes. 
Published in <sxsn11dh3fc.fsf@florida.arsdigita.de>.
 2001-11-23 08:12:53 -08:00
hniksic
eb9a02b828 [svn] Minor fix for the new progress bar. 2001-11-22 21:09:39 -08:00
hniksic
8e082d2558 [svn] Remove accidentally committed DEBUG_MALLOC. 2001-11-22 21:01:32 -08:00
hniksic
cdcf67a5bd [svn] Big progress bar update. 
Published in <sxsn11ehyn1.fsf@florida.arsdigita.de>.
 2001-11-22 20:59:52 -08:00
hniksic
4d352013ac [svn] Replace opt.no_flush with a function to disable/enable flushing. 
Published in <sxssnb6imyz.fsf@florida.arsdigita.de>.
 2001-11-22 12:13:13 -08:00
hniksic
d5be8ecca4 [svn] Rewrite parsing and handling of URLs. 
Published in <sxs4rnnlklo.fsf@florida.arsdigita.de>.
 2001-11-21 16:24:28 -08:00
hniksic
f4dcb55851 [svn] Split the copyright notice for easier translation. 2001-11-21 15:15:19 -08:00
hniksic
0296433553 [svn] Support the SIZE command. 
Originally by Dave Turner.  Modified by Ian Abbott and published
in <3BFAA33C.6236.6D42F6@localhost>.
 2001-11-20 13:01:27 -08:00
hniksic
a24b3d50f0 [svn] Don't use the now-obsolete TYPE variable. 
Published in <sxswv0ledyx.fsf@florida.arsdigita.de>.
 2001-11-20 08:03:41 -08:00
hniksic
94c5b23136 [svn] Handle shorthands in proxy URLs. 
Published in <sxs6686py1q.fsf@florida.arsdigita.de>.
 2001-11-19 08:15:42 -08:00
hniksic
de7f766f58 [svn] Remove --wait/--waitretry compatibility code. 
Published in <sxs6686py1q.fsf@florida.arsdigita.de>.
 2001-11-19 07:42:56 -08:00
hniksic
e8e8797873 [svn] Rewrite shorthand URLs in a step separate from parsing. 
Published in <sxspu6f7ecz.fsf@florida.arsdigita.de>.
 2001-11-18 17:14:14 -08:00
hniksic
f178e6c613 [svn] Clean up handling of schemes. 
Published in <sxswv0n7h7s.fsf@florida.arsdigita.de>.
 2001-11-18 16:12:05 -08:00
hniksic
303f406997 [svn] Don't list all the "known" (but unsupported) protocols. Instead, just 
skip the characters until the first ':'.
Published in <sxsitc8a848.fsf@florida.arsdigita.de>.
 2001-11-17 22:49:09 -08:00
hniksic
ee99e8998a [svn] Don't compile getopt.c on systems that already have getopt_long. 
Published in <sxshersbs0w.fsf@florida.arsdigita.de>.
 2001-11-17 20:52:18 -08:00
hniksic
d408dec0bd [svn] Use Solaris's libmd5 when available. 
Published in <sxsn11kbssm.fsf@florida.arsdigita.de>.
 2001-11-17 20:36:21 -08:00
hniksic
09b0fe29a8 [svn] Initialize vars to appease the compiler. 
Published in <sxszo5kbxs3.fsf@florida.arsdigita.de>.
 2001-11-17 20:14:12 -08:00
hniksic
6ef5baa07b [svn] Prettier printing of HTTP headers. 
Published in <sxs4rnsdcw1.fsf@florida.arsdigita.de>.
 2001-11-17 18:36:30 -08:00
hniksic
22bfc65534 [svn] Use 1.8-dev as version. 2001-11-17 18:19:45 -08:00
hniksic
05f90bb302 [svn] Plug in new implementation of RES. 
Published in <sxselmwddt0.fsf@florida.arsdigita.de>.
 2001-11-17 18:17:30 -08:00
hniksic
12c8ef1796 [svn] *** empty log message *** 2001-11-17 17:34:25 -08:00
hniksic
10269645bc [svn] Bumped version to 1.7.1. 2001-11-17 17:30:12 -08:00
hniksic
e798e61c06 [svn] Minor doc addition. 2001-11-17 10:03:57 -08:00
hniksic
2fe30df466 [svn] Bump version to 1.7.1-pre3. 2001-11-16 15:20:17 -08:00
hniksic
cbc468efed [svn] Bumped version to 1.7-pre2. 2001-11-16 13:41:51 -08:00
hniksic
1a96dcfcb8 [svn] Ignore trailing whitespace in header_extract_number. 
Published in <sxsheruo5gn.fsf@florida.arsdigita.de>.
 2001-11-16 11:57:43 -08:00
hniksic
3d9dda6485 [svn] Process attributes in order in which they appear in the tag. 
Submitted by Ian Abbott in <3B868388.6538.14A7848@localhost>
based on analysis by Edward Sabol.
 2001-11-16 11:44:42 -08:00
hniksic
fa6aeb869d [svn] Don't call rate() with bogus data. 
Submitted by Ian Abbott in <3B7A98A1.24985.9EF692@localhost>
 2001-11-16 11:38:03 -08:00
hniksic
90cdb82942 [svn] Use 0x22 instead of '"' or '\"'. 2001-11-16 09:26:42 -08:00
hniksic
ac74e16638 [svn] Applied Christian Fraenkel's patch from <3BAF5B30.189077D6@gmx.net>. 
Print SSL errors when connecting fails.
 2001-11-16 09:06:25 -08:00
hniksic
d60b54cba0 [svn] Applied Chris Seawood's patch for compilation under BEOS. 
Patch published in <3B5D4CEF.5090208@seawood.org>.
 2001-11-16 08:58:08 -08:00
hniksic
0c42479322 [svn] Applied Edward Sabol's patch from 
<200106131813.f5DIDss1294858@alderaan.gsfc.nasa.gov>.
It fixes a memory leak in url_equal, and comments it out,
as it's unused.
 2001-11-16 08:49:19 -08:00
hniksic
0ce7b6bffc [svn] Support XML-style empty tags. 2001-11-16 08:44:34 -08:00
hniksic
b4e6054de9 [svn] Check for do_realloc_newsize in loop condition because we're no longer 
setting SIZEVAR here.
 2001-06-26 02:48:51 -07:00
hniksic
d015d3cbd3 [svn] Fix access violation bug in DO_REALLOC_FROM_ALLOCA. 
Published in <sxspubriqay.fsf@florida.arsdigita.de>.
 2001-06-26 01:45:09 -07:00
hniksic
e98fca84a3 [svn] Allow more characters in attribute name. 
Published in <sxsr8wi9jeo.fsf@florida.arsdigita.de>.
 2001-06-18 11:49:33 -07:00
hniksic
e1f4cff68c [svn] Make sure that slashes don't sneak in as part of file name via 
query string.
Published in <sxsu21eb3te.fsf@florida.arsdigita.de>.
 2001-06-18 02:08:04 -07:00
hniksic
91ac958e45 [svn] Set version to 1.7.1-pre1. 2001-06-15 02:29:00 -07:00
hniksic
2255a89b24 [svn] After canonicalizing the URL, check for its existence among undesirable_urls. 
Published in <sxs7kyeohte.fsf@florida.arsdigita.de>.
 2001-06-14 14:48:00 -07:00
hniksic
f918e0ab51 [svn] Docfix. 2001-06-14 14:15:43 -07:00
hniksic
c77d880776 [svn] Search netrc with the proper host name, not the proxy one. 2001-06-14 13:55:02 -07:00
hniksic
8f6b4f5bbb [svn] Define MAP_FAILED if it's missing. 
Published in <sxshexirelo.fsf@florida.arsdigita.de>.
 2001-06-14 13:28:19 -07:00
janp
46550636fe [svn] Provide correct prototype for ftp_parse_ls(). Pointed out by Bernhard Simon 
<bs@bsws.zid.tuwien.ac.at> in <200106071409.QAA08208@bsws.zid.tuwien.ac.at>.
 2001-06-09 10:44:07 -07:00
hniksic
6b9ac2db84 [svn] Increase version to 1.7. 2001-06-04 03:45:20 -07:00
hniksic
e6742c2313 [svn] ftp-ls.c typo fix by Karl Eichwalder. 2001-06-03 06:26:41 -07:00
hniksic
0b056d1720 [svn] Update copyright notices. 2001-05-27 12:35:15 -07:00
hniksic
b94a5c0e37 [svn] Released 1.7-pre1. 2001-05-26 03:01:45 -07:00
hniksic
6b405f2b66 [svn] Commit administrative changes in preparation for the 1.7 
prerelease.
Published in <sxsd78wwiwj.fsf@florida.arsdigita.de>.
 2001-05-26 02:38:24 -07:00
hniksic
2f298afc47 [svn] Don't include <sys/time.h> here. 
Published in <sxsae4gvtnb.fsf@florida.arsdigita.de>.
 2001-05-14 08:27:56 -07:00
hniksic
36eba40905 [svn] Make sure cookie code works with the real URL data, not the proxy one. 
Published in <sxsg0e8z3bp.fsf@florida.arsdigita.de>.
 2001-05-14 02:32:11 -07:00
hniksic
72eca0976b [svn] Commit several minor changes: 
* main.c (print_help): Document `--no-http-keep-alive'.

* utils.c (numdigit): Handle negative numbers *correctly*.

* hash.c (make_nocase_string_hash_table): Use term "nocase" rather
than the confusing "unsigned".

* utils.c (string_set_contains): Renamed from string_set_exists.

* hash.c (hash_table_contains): Renamed from hash_table_exists.

* cookies.c: Move case-insensitive hash tables to hash.c.

Published in <sxsheyq9vvl.fsf@florida.arsdigita.de>.
 2001-05-12 13:06:41 -07:00
hniksic
9588e1af80 [svn] Before concluding that the file is already fully retrieved, make sure 
that the file existed and `Range' was actually requested.

Published in <sxseltwf4ks.fsf@florida.arsdigita.de>.
 2001-05-11 05:37:37 -07:00
hniksic
43ef870bd3 [svn] Minor cookie fixes. Published in <sxsheyu9yp6.fsf@florida.arsdigita.de>. 2001-05-09 11:15:22 -07:00
hniksic
105627124e [svn] Make sure hstat.no_truncate gets properly initialized. 
Published in <sxspudk6pdl.fsf@florida.arsdigita.de>.
 2001-05-08 04:47:05 -07:00
hniksic
50980de841 [svn] Avoid useless file_exists_p. Published in 
<sxsr8y17zav.fsf@florida.arsdigita.de>.
 2001-05-07 12:08:29 -07:00
janp
5ff5e936a5 [svn] Correct the conversion of month entries for NT and VMS. 2001-05-02 03:15:17 -07:00
hniksic
72b9bb6d92 [svn] Zero out SIN before using it. 
Published in <sxs3daq8zdg.fsf@florida.arsdigita.de>.
 2001-04-30 03:19:41 -07:00
hniksic
3973f20a45 [svn] Refuse to download files from scratch if `-c' is used and the server 
doesn't support REST only for existing *and non-empty* files.
Published in <sxsae4zg4zc.fsf@florida.arsdigita.de>.
 2001-04-29 07:24:45 -07:00
hniksic
00773e7d15 [svn] Make `--cookies' respect its arg. 
Published in <sxs4rv8ht5e.fsf@florida.arsdigita.de>.
 2001-04-29 03:56:43 -07:00
hniksic
dfc1eb5766 [svn] Change default anonymous FTP password to "-wget@". 
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
 2001-04-29 03:53:55 -07:00
hniksic
b44f1701b0 [svn] Use alloca to allocate filename_plus_orig_suffix. 
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
 2001-04-28 09:36:46 -07:00
hniksic
d70101ea4e [svn] Commit various HTTP fixes. 
Published in <sxsy9slhu7g.fsf@florida.arsdigita.de>.

* http.c (gethttp): Return RETRUNNEEDED when the retrieval is
unneeded because the file is already there and fully downloaded,
and -c is specified.
(http_loop): Handle RETRUNNEEDED.

* wget.h (uerr_t): New value RETRUNNEEDED.

* http.c (http_loop): Set no_truncate for files that both exist
and are non-empty.
(gethttp): Consider the download finished when restval >= contlen,
not only when restval==contlen.
(gethttp): Handle redirection before giving up due to -c.
(gethttp): Clarify error message which explains that -c will not
truncate the file.
(gethttp): When returning CONTNOTSUPPORTED, don't forget to free
the stuff that needs freeing and release the socket.

* main.c (print_help): Wget booleans accept "off", not "no".
 2001-04-28 09:22:20 -07:00
hniksic
c6e565fd33 [svn] Send the no-cache directive when required regardless of whether we're 
going through a proxy.
Published in <sxsitjqncbx.fsf@florida.arsdigita.de>.
 2001-04-26 22:26:44 -07:00
hniksic
26ddb28a7c [svn] Improve documentation of mktime_from_utc. 
Rearrange http_atotm.
Published in <sxsoftjlyku.fsf@florida.arsdigita.de>.
 2001-04-26 22:11:38 -07:00
hniksic
07abfad1c2 [svn] Punish the *use* of ctype macros, rather than their mere presence. 
Published in <sxssnivlyut.fsf@florida.arsdigita.de>.
 2001-04-26 22:03:08 -07:00
hniksic
ae621c6770 [svn] Treat empty proxy environment vars as unset. 
Published in <sxssniwq8d6.fsf@florida.arsdigita.de>.
 2001-04-26 03:11:49 -07:00
hniksic
f0eb1fb758 [svn] Fix loading of cookies. 
Published in <sxslmopyao6.fsf@florida.arsdigita.de>.
 2001-04-24 19:29:54 -07:00
hniksic
425b5af0c9 [svn] Cosmetic change in DIGITS_* macros. 2001-04-24 18:55:13 -07:00
hniksic
e559249a48 [svn] Minor doc fix. 2001-04-24 17:59:39 -07:00
hniksic
9ae0328c3d [svn] Applied Roger Beeman's mktime_from_utc fix published in 
<Pine.HPX.4.02.10104181128180.6232-100000@mail1.cisco.com>.
Also, minor doc fixes.
 2001-04-24 17:50:22 -07:00
hniksic
d80f6cbe8c [svn] Reimplemented UNSAFE_CHAR and RESERVED_CHAR. 
Fixed snprintf.c to avoid ISDIGIT.
 2001-04-24 17:20:30 -07:00
hniksic
45eea7387f [svn] New timer functions. Published in <sxs8zkp28vk.fsf@florida.arsdigita.de>. 2001-04-24 16:09:45 -07:00
hniksic
5674776cad [svn] Rewritten long_to_string. The new version favors smaller numbers; 
much of the work is now done at compile-time.
Published in <sxsvgnv6oii.fsf@florida.arsdigita.de>.
 2001-04-23 19:06:34 -07:00
hniksic
6ba7711d6a [svn] Print download rate even when percentages are not available. 
Published in <sxs1yqjd4ct.fsf@florida.arsdigita.de>.
 2001-04-23 08:28:34 -07:00
hniksic
38120f75ef [svn] Write percentages when the length is authoritative. 
Published in <sxselujd8py.fsf@florida.arsdigita.de>.
 2001-04-23 06:53:29 -07:00
hniksic
ac7c8c1390 [svn] Improve performance of grow_hash_table. 
Published in <sxs66g8nd4c.fsf@florida.arsdigita.de>.
 2001-04-14 00:41:29 -07:00
hniksic
61bb00adc0 [svn] Various url.c-related changes. 
Published in <sxsvgo8nmub.fsf@florida.arsdigita.de>.

* retr.c (retrieve_url): Call uri_merge, not url_concat.
* html-url.c (collect_tags_mapper): Call uri_merge, not
url_concat.
* url.c (mkstruct): Use encode_string instead of xstrdup followed
by URL_CLEANSE.
(path_simplify_with_kludge): Deleted.
(contains_unsafe): Deleted.
(construct): Renamed to uri_merge_1.
(url_concat): Renamed to uri_merge.
* url.c (str_url): Use encode_string instead of the unnecessary
CLEANDUP.
(encode_string_maybe): New function, returns input string if no
encoding is needed.
(encode_string): Call encode_string_maybe to do the dirty work,
xstrdup if no work needed.
* wget.h (XDIGIT_TO_xchar): Define here.
* url.c (decode_string): Use new name.
(encode_string): Ditto.
* http.c (XDIGIT_TO_xchar): Rename HEXD2asc to XDIGIT_TO_xchar.
(dump_hash): Use new name.
* wget.h: Rename ASC2HEXD and HEXD2ASC to XCHAR_TO_XDIGIT and
XDIGIT_TO_XCHAR respectively.
 2001-04-13 21:11:35 -07:00
hniksic
8a0e9e765e [svn] Minor -Wall-induced fixes. Also, skip_url is removed. 
Published in <sxs8zl5v5cw.fsf@florida.arsdigita.de>.
 2001-04-12 20:39:23 -07:00
hniksic
eae28f142d [svn] Commit various hash table changes: 
* hash.c (hash_table_map): Allow deletion and change of the
element processed by MAPFUN.
(string_hash): Use the function from glib.
* hash.c (hash_table_remove): Rewrite to actually clear deleted
entries instead of just marking them as deleted.

Published in <sxsu23tvdur.fsf@florida.arsdigita.de>.
 2001-04-12 17:34:24 -07:00
hniksic
452c0bb9f7 [svn] Declare hash_table_get_pair and hash_table_count. 2001-04-12 12:45:18 -07:00
hniksic
cd1423a478 [svn] Declare http_atotm(). 2001-04-12 12:43:12 -07:00
hniksic
b4b33b5afc [svn] Use octal constants. 
Published in <sxsr8yy1dk6.fsf@florida.arsdigita.de>.
 2001-04-12 05:58:02 -07:00
hniksic
83fe8f3597 [svn] "Support DESTDIR when installing. 
Patch courtesy Karl Eichwalder.
Published in <sxs4rvu2tmu.fsf@florida.arsdigita.de>.
 2001-04-12 05:25:22 -07:00
hniksic
a98337f827 [svn] Make seconds optional in VMS time specification. 
Published in <sxs8zl62u9p.fsf@florida.arsdigita.de>.
 2001-04-12 05:22:50 -07:00