1
0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Commit Graph

475 Commits

Author SHA1 Message Date
hniksic
ebea9e7e0b [svn] Fixed a long-standing bug in the timer code that would cause Wget to
crash when the system time was set back during a Wget run.
Message-ID: <m3znh8wag9.fsf@hniksic.iskon.hr>
2003-09-13 16:12:45 -07:00
hniksic
7e7ce3dc0e [svn] Print the result of DNS lookup. 2003-09-10 13:46:32 -07:00
hniksic
bda244f564 [svn] Allow --foo=yes/no in addition to --foo=on/off. 2003-09-10 13:21:21 -07:00
hniksic
10137bd186 [svn] New option --dns-cache. 2003-09-10 12:41:54 -07:00
hniksic
cd8b1259f1 [svn] IPv6 configure auto-detection. 2003-09-09 12:30:45 -07:00
hniksic
0e9b4de751 [svn] Return an error from url_parse if the IP address is IPv6 and we don't
handle IPv6.
2003-09-09 06:06:58 -07:00
hniksic
05715ed4d6 [svn] Add proper detection of numeric IPv6 addresses.
By Mauro Tortonesi.
2003-09-05 13:36:17 -07:00
hniksic
30ac043b0a [svn] New option --retry-connrefused from Ahmod Dancy. 2003-09-04 14:34:58 -07:00
abbotti
0410411939 [svn] Fix for FTP directory traversal vulnerability (at least for Unix).
Based on a patch by Red Hat.
Published in <85u02vg4hukbc2fltdd51uds5oq14rd92f@farscape.privy.mev.co.uk>.
2003-01-11 12:12:35 -08:00
hniksic
27483fd0f5 [svn] Fix off-by-one error in cmd_file.
Published in <sxsit2rfzqo.fsf@florida.munich.redhat.com>.
2002-08-03 13:34:58 -07:00
hniksic
d7673d398b [svn] Check whether downloaded_html_set is non-NULL before using it.
Posted in <sxsr8hsvnhh.fsf@florida.munich.redhat.com>.
2002-07-24 14:16:30 -07:00
hniksic
89b37c7eff [svn] Allow almost any character in attribute/tag names. 2002-05-27 08:03:35 -07:00
hniksic
d3a636f2a5 [svn] Fall back to dot progress if the terminal type is "emacs".
Published in <sxsd6vllhsi.fsf@florida.munich.redhat.com>.
2002-05-24 07:53:18 -07:00
hniksic
f97f3ef416 [svn] Don't #define __STDC__ against the compiler's will.
Published in <sxsptzr64ea.fsf@florida.munich.redhat.com>.
2002-05-19 17:38:14 -07:00
hniksic
a4abdda23d [svn] Minor optimization of prime_size.
Published in <sxswuu2p6pm.fsf@florida.munich.redhat.com>.
2002-05-17 18:48:39 -07:00
abbotti
83dc077b17 [svn] (download_child_p): Minor optimization to avoid unnecessary call to
schemes_are_similar_p function.
Published in <kvq7eu4okekh2ohb0rdvavt16nbgb02v00@farscape.privy.mev.co.uk>.
2002-05-16 10:38:30 -07:00
abbotti
e863a6323b [svn] New function schemes_are_similar_p to test enumerated scheme codes for
similarity (SCHEME_HTTP and SCHEME_HTTPS are similar).  Use it in recur.c
(download_child_p).  Fixes a bug that caused -H option to be ignored when
child scheme different to parent scheme.
Published in <agn4eu8apduek7magfu9bfe63gto8i7cdh@farscape.privy.mev.co.uk>.
2002-05-16 10:22:24 -07:00
abbotti
043d305fb1 [svn] Don't ftruncate standard output.
Submitted by Bill Richardson  <bill@riverstonenet.com>.
Final version of patch published in
<9vv1eus668tn7v3vn95e7l2lcjbbph8bi2@farscape.privy.mev.co.uk>.
2002-05-14 05:23:51 -07:00
abbotti
55f59d0022 [svn] Synched strptime with glibc 2.1.3. 2002-05-09 03:14:15 -07:00
hniksic
fd42ae1311 [svn] Allow match_tail to be case insensitive.
Published in <sxsznzabirr.fsf@florida.munich.redhat.com>.
2002-05-08 11:24:40 -07:00
abbotti
291693c3c2 [svn] Do not store discarded cookie after it is delected.
Submitted by Ian Abbott in
<2h2gdu0q04v94ltet2634888sh6imcrgnd@farscape.privy.mev.co.uk>.
2002-05-07 10:22:33 -07:00
hniksic
58ee1f008a [svn] Fix matching of cookie domains.
Published in <sxsy9fhu1bu.fsf@florida.arsdigita.de>.
2002-04-20 21:25:36 -07:00
hniksic
91a190a770 [svn] Implement several SSL features.
- allow checking of server cert
- allow defining client cert type
- allow limit of ssl protocol
- check more return values
- added debug message on break
Published by Thomas Lussnig in <3CC09969.5000607@bewegungsmelder.de>.
2002-04-20 19:26:48 -07:00
hniksic
bf018d5721 [svn] Revert order of check number 6 in download_child_p for clarity. 2002-04-20 19:15:11 -07:00
hniksic
29a66192cf [svn] Cookie interface and implementation changes
from <sxsofge9yao.fsf@florida.arsdigita.de>
and <sxslmbim7dg.fsf@florida.arsdigita.de>.
2002-04-20 13:46:38 -07:00
hniksic
a9e97711fa [svn] Keep the commands list in sort order! 2002-04-19 02:24:32 -07:00
hniksic
123034fa83 [svn] Remove stray conflict marker. 2002-04-16 13:15:23 -07:00
hniksic
7953158bce [svn] Correctly merge DOS-like absolute directories.
Published in <sxslmbomnm7.fsf@florida.arsdigita.de>.
2002-04-15 18:36:16 -07:00
hniksic
426bf23ae1 [svn] If content-type is not given, assume text/html. 2002-04-15 18:13:51 -07:00
hniksic
f8b4b8bd12 [svn] When downloading recursively, don't ignore rejection of HTML
documents that are themselves leaves of recursion.
2002-04-15 14:57:10 -07:00
abbotti
4c11f1b269 [svn] Updated several dependencies for object files, taking account of nested
include files.
Submitted by Ian Abbott.
2002-04-15 13:15:43 -07:00
abbotti
56698ffd1d [svn] Updated dependencies of connect$o to include utils.h 2002-04-15 12:10:23 -07:00
abbotti
caa0f23be3 [svn] Fix broken Windows builds due to the xxx_with_timeout stuff.
Submitted by Ian Abbotti in <3CBB2FFE.20193.73A594@localhost>.
2002-04-15 12:01:56 -07:00
hniksic
036f99c801 [svn] Extend the timeout to DNS lookups.
Published in <sxsn0w57ldh.fsf@florida.arsdigita.de>.
2002-04-14 19:21:38 -07:00
hniksic
fbf0306dd7 [svn] Have number_to_string handle the case when number < -MAX_INT.
Published in <sxs662uf7l9.fsf@florida.arsdigita.de>.
2002-04-14 12:18:33 -07:00
hniksic
081e4eb4f4 [svn] Use a marginally faster implementation of binary search.
Published in <sxs662uf7l9.fsf@florida.arsdigita.de>.
2002-04-14 11:39:43 -07:00
hniksic
0eee8f8b25 [svn] Document --post-data' and --post-file'. 2002-04-13 22:31:11 -07:00
hniksic
9f2cc07924 [svn] Minor cleanup of iread/iwrite.
Published in <sxsk7raj1t2.fsf@florida.arsdigita.de>.
2002-04-13 22:19:27 -07:00
hniksic
5cb8a6f44d [svn] Add the POST method.
Published in <sxssn5yj4eb.fsf@florida.arsdigita.de>.
2002-04-13 21:22:47 -07:00
hniksic
f3d3a50a56 [svn] Generalize connect_with_timeout into run_with_timeout.
Published in <sxs4rifxndi.fsf@florida.arsdigita.de>.
2002-04-13 15:18:28 -07:00
hniksic
5390ada318 [svn] Support FWTK-style proxies.
Pbublished in <sxslmbsxptu.fsf@florida.arsdigita.de>.
2002-04-12 20:04:47 -07:00
hniksic
278b63093f [svn] Remove stray conflict marker. 2002-04-12 13:28:05 -07:00
hniksic
faf77c8f51 [svn] Only define _VA_LIST when compiling with gcc.
Published in <sxsit6w1x5t.fsf@florida.arsdigita.de>.
2002-04-12 13:27:18 -07:00
abbotti
4aaf8fdcea [svn] Compensate for MS Windows two-second granularity of file modification
timestamps.
Submitted by Ian Abbott in <3CB7355C.21011.2134FDA@localhost>.
2002-04-12 12:21:02 -07:00
abbotti
cfd7b9a951 [svn] Use new function to test filename for common html suffixes.
Submitted by Ian Abbott in <3CB72D29.4898.1F34872@localhost> with minor
changes to formatting and comments.
2002-04-12 11:53:39 -07:00
hniksic
2a72eef0af [svn] Define _VA_LIST to prevent Solaris stdio.h from declaring va_list.
Published in <sxs1ydk4vg0.fsf@florida.arsdigita.de>.
2002-04-12 11:36:07 -07:00
abbotti
fa2fa7a100 [svn] Specify libtool mode explicitly when linking.
Submitted by Ian Abbott in <3CB6F27B.15581.10E13BA@localhost>.
2002-04-12 06:47:02 -07:00
hniksic
0cd669109b [svn] Implement connect timeout.
Published in <sxs1ydld8ha.fsf@florida.arsdigita.de>.
2002-04-11 18:14:18 -07:00
hniksic
fca8dcf829 [svn] Use stdarg only if compiling with an ANSI C compiler. 2002-04-11 12:13:57 -07:00
hniksic
c77a16309f [svn] Don't allow initial_length to exceed total_length.
Published in <sxssn62dq99.fsf@florida.arsdigita.de>.
2002-04-11 11:51:26 -07:00
hniksic
8f93191f26 [svn] Convert URLs in <form action=...>.
Published in <sxsit6yf7jo.fsf@florida.arsdigita.de>.
2002-04-11 10:51:45 -07:00
hniksic
1375a89141 [svn] Allow Wget to be compiled with a K&R compiler.
Published in <sxszo0af9k6.fsf@florida.arsdigita.de>.
2002-04-11 10:49:32 -07:00
hniksic
485673c3a8 [svn] Make sure directory and file names are encoded the same way.
Published in <sxsofgqmf6e.fsf@florida.arsdigita.de>.
2002-04-11 08:25:51 -07:00
hniksic
8c3287dabf [svn] Remove the OPTIONS_DEFINED_HERE kludge.
Published in <sxs4rijqmhv.fsf@florida.arsdigita.de>.
2002-04-10 14:20:55 -07:00
hniksic
1600aaeaa6 [svn] Revert to calculating ETA based on average download speed.
Published in <sxspu17sl10.fsf@florida.arsdigita.de>.
2002-04-10 07:10:03 -07:00
hniksic
538307f151 [svn] Keep updating a subinterval until it reaches or exceeds a watermark.
That way the measurement will be guaranteed to span a configurable
minimum of time.  The current default is 3s in 30 100ms intervals.

Published in <sxsu1qkszdb.fsf@florida.arsdigita.de>.
2002-04-10 02:24:28 -07:00
hniksic
c292e8e153 [svn] Print the current download speed, rather than the average.
Published in <sxs3cy4yacm.fsf@florida.arsdigita.de>.
2002-04-09 15:10:01 -07:00
abbotti
c3c1c24f5c [svn] Fix for Borland's broken (on Win9X) `utime' function.
Submitted by Ian Abbott in <3CB33A8E.15259.1E52AF@localhost>.
(Based on original patch by Chin-yuan Kuo in
<20020321015049.16722.qmail@web16202.mail.tpe.yahoo.com>.)
2002-04-09 11:29:54 -07:00
hniksic
07d72c3cd3 [svn] Propagate the result of ftp_retrieve_glob to the caller of ftp_loop.
Published in <sxssn663zwl.fsf@florida.arsdigita.de>.
2002-04-08 09:43:36 -07:00
abbotti
80a90d6d2c [svn] Updated several dependencies for object files.
Submitted by Ian Abbott in <3C9F8BA4.19135.14568BF@localhost>.
2002-03-26 10:59:44 -08:00
abbotti
9f485af560 [svn] Dependcies update for src/mswindows.c.
Submitted by Ian Abbott in <3C98D8C6.31335.36EB6F@localhost>.
2002-03-20 10:56:45 -08:00
abbotti
47a8225eda [svn] Don't include netdb.h on windows.
Submitted by Ian Abbott in <3C964B8C.18942.D3115@localhost>.
2002-03-18 12:21:58 -08:00
hniksic
1fa3b90235 [svn] Handle starting URL of recursing download being non-parsable.
Published in <sxszo26t33k.fsf@florida.arsdigita.de>.
2002-02-18 22:09:57 -08:00
hniksic
562ab4ae8a [svn] (DO_REALLOC_FROM_ALLOCA): Multiply with sizeof(type) when calling
xmalloc and memcpy.
Submitted by Andreas Damm in
<Pine.LNX.4.33.0202011632280.1281-200000@gate.rad-ab.u-net.com>.
2002-02-18 21:32:59 -08:00
hniksic
667d494978 [svn] Only include Unix-specific includes #ifndef WINDOWS. 2002-02-18 21:25:42 -08:00
hniksic
75a080ad0d [svn] Follow https links from http.
Submitted by Christian Lackas in <20020211202444.GA20371@lackas.desy.de>.
2002-02-18 21:23:35 -08:00
hniksic
57f36f8a6a [svn] Add the necessary includes for compilation under FreeBSD.
Submitted by Alan Eldridge in <200202130630.g1D6U3S07907@wwweasel.geeksrus.net>.
2002-02-18 21:21:42 -08:00
hniksic
a9ff5853a9 [svn] when -c used, mark already fully retrieved file as successfully retrieved.
Submitted by Ian Abbott in <3C6019F4.30803.FF43E9@localhost>.
2002-02-18 21:18:43 -08:00
hniksic
b9e90c34b4 [svn] Don't treat '?' as a query string separator when parsing FTP URLs.
Published in <sxslmdqxdmq.fsf@florida.arsdigita.de>.
2002-02-18 21:09:14 -08:00
hniksic
0e40fc9a3c [svn] Don't crash on <meta http-equiv=refresh>.
Published in <sxshep1q3je.fsf@florida.arsdigita.de>.
2002-01-31 19:34:31 -08:00
hniksic
a861f718ed [svn] Enable compilation on Windows.
Submitted by Herold Heiko in
<B11A7CEC1675D511A3890002A551AD7C37D8AE@srvnt08.previnet.it>.
2002-01-30 18:23:04 -08:00
hniksic
6c4c785cc2 [svn] Remove redirection cycle detection.
Published in <sxs7kpzhcwa.fsf@florida.arsdigita.de>.
2002-01-30 11:12:20 -08:00
hniksic
f2bb99d102 [svn] Wrap numeric IPv6 addresses in square brackets when sending out HTTP
`Host' header.
Published in <sxs7kq4vgzf.fsf@florida.arsdigita.de>.
2002-01-26 15:19:10 -08:00
hniksic
1bea726393 [svn] Allow all hex digits in IPv6 IP addresses.
Published in <sxsofjgvo72.fsf@florida.arsdigita.de>.
2002-01-26 12:43:17 -08:00
hniksic
ef1eda86c4 [svn] Allow IPv6 numeric addresses in URLs.
Submitted in <sxsu1t9uedf.fsf@florida.arsdigita.de>.
2002-01-26 11:00:38 -08:00
hniksic
a69cb0c3ad [svn] Various IPv6 fixes.
Submitted in <sxsd6zz2jf7.fsf@florida.arsdigita.de>.
2002-01-24 19:34:23 -08:00
hniksic
853a1c9e35 [svn] Fix some IPv6-related problems.
Submitted in <sxsg04w6zl6.fsf@florida.arsdigita.de>.
2002-01-23 22:19:35 -08:00
hniksic
cb40034035 [svn] Commit IPv6 support by Thomas Lussnig.
Published in <sxsk7u8715e.fsf@florida.arsdigita.de>.
2002-01-23 21:45:54 -08:00
hniksic
e59a7ee8ac [svn] Make -P work on Windows.
Submitted by Ian Abbott in <3C447E8F.13424.16ED42@localhost>.
2002-01-16 17:03:33 -08:00
hniksic
fb2ed23830 [svn] Skip initial whitespace before testing for EOL.
Submitted in <sxsu1tl6bf2.fsf@florida.arsdigita.de>.
2002-01-16 16:59:13 -08:00
hniksic
31d20e644c [svn] select the file descriptor only if no data is pending in SSL buffers.
Submitted by tony@bluetail.com.
Published in <sxslmezocyp.fsf@florida.arsdigita.de>.
2002-01-15 07:24:19 -08:00
hniksic
08c935bef2 [svn] Strip trailing whitespace in header_process().
Published in <sxsadvh0xpz.fsf@florida.arsdigita.de>.
2002-01-14 07:17:34 -08:00
hniksic
46617228fa [svn] URL-decode user and password in URL.
Published in <sxsita52hg6.fsf@florida.arsdigita.de>.
2002-01-14 05:26:16 -08:00
hniksic
524a1f54dc [svn] Handle links to relative "net locations," e.g. <a href="//www.server.com/">. 2002-01-13 17:56:40 -08:00
hniksic
cafe798fec [svn] Invalidate socket if get_contents encountered an error.
Published in <sxsita54sqy.fsf@florida.arsdigita.de>.
2002-01-13 17:39:16 -08:00
hniksic
11745f55bf [svn] Bump version to 1.8.1. 2001-12-24 13:02:25 -08:00
hniksic
5c859be2d4 [svn] Bump version to 1.8.1-pre3. 2001-12-19 06:59:01 -08:00
hniksic
8db1264218 [svn] Enqueue start_url in the canonical form.
Published in <sxsofkvi8zx.fsf@florida.arsdigita.de>.
2001-12-19 06:27:29 -08:00
hniksic
001cac91a4 [svn] Check for requested verbosity in logputs.
Published in <sxswuzjk0v6.fsf@florida.arsdigita.de>.
2001-12-19 01:36:58 -08:00
hniksic
ca9319aaba [svn] Treat the "shortcut icon" link as inline.
Published in <sxsadwgko2q.fsf@florida.arsdigita.de>.
2001-12-18 17:15:34 -08:00
hniksic
2cf87bea8b [svn] Fix crash introduced by previous patch. 2001-12-18 14:20:14 -08:00
hniksic
40fd876c57 [svn] Descend into HTML files we've already downloaded. 2001-12-18 14:14:31 -08:00
hniksic
416671063a [svn] Propagate referrer information from retrieve_tree to retrieve_url.
Submitted by Ian Abbott in <3C1F4BFE.17436.D2D7B2@localhost>.
2001-12-18 07:22:03 -08:00
hniksic
f03f033bf3 [svn] Bump version to 1.8.1-pre2. 2001-12-17 07:24:14 -08:00
hniksic
eb0f9de05d [svn] Simplify indentation in sleep_between_retrievals. 2001-12-17 07:00:25 -08:00
hniksic
75699d6213 [svn] Use the new function `random_number' that doesn't depend on RAND_MAX
being defined.
Published in <sxsheqqq6xb.fsf@florida.arsdigita.de>.
2001-12-17 06:05:08 -08:00
hniksic
a3500d32d7 [svn] Move path_simplify to url.c. 2001-12-14 07:46:00 -08:00
hniksic
0f120eee66 [svn] Fix error message when $WGETRC not found.
Published in <sxswuzrylnm.fsf@florida.arsdigita.de>.
2001-12-13 11:19:03 -08:00
hniksic
f031900662 [svn] Don't abort when one URL references more than one file.
Published in <sxs1yhz0w1m.fsf@florida.arsdigita.de>.
2001-12-13 11:18:31 -08:00
hniksic
5b575eef31 [svn] Check for conn->ssl before using ssl_iwrite. 2001-12-13 08:46:56 -08:00