hniksic
9f2cc07924
[svn] Minor cleanup of iread/iwrite.
...
Published in <sxsk7raj1t2.fsf@florida.arsdigita.de>.
2002-04-13 22:19:27 -07:00
hniksic
5cb8a6f44d
[svn] Add the POST method.
...
Published in <sxssn5yj4eb.fsf@florida.arsdigita.de>.
2002-04-13 21:22:47 -07:00
hniksic
f3d3a50a56
[svn] Generalize connect_with_timeout into run_with_timeout.
...
Published in <sxs4rifxndi.fsf@florida.arsdigita.de>.
2002-04-13 15:18:28 -07:00
hniksic
5390ada318
[svn] Support FWTK-style proxies.
...
Pbublished in <sxslmbsxptu.fsf@florida.arsdigita.de>.
2002-04-12 20:04:47 -07:00
hniksic
278b63093f
[svn] Remove stray conflict marker.
2002-04-12 13:28:05 -07:00
hniksic
faf77c8f51
[svn] Only define _VA_LIST when compiling with gcc.
...
Published in <sxsit6w1x5t.fsf@florida.arsdigita.de>.
2002-04-12 13:27:18 -07:00
abbotti
4aaf8fdcea
[svn] Compensate for MS Windows two-second granularity of file modification
...
timestamps.
Submitted by Ian Abbott in <3CB7355C.21011.2134FDA@localhost>.
2002-04-12 12:21:02 -07:00
abbotti
cfd7b9a951
[svn] Use new function to test filename for common html suffixes.
...
Submitted by Ian Abbott in <3CB72D29.4898.1F34872@localhost> with minor
changes to formatting and comments.
2002-04-12 11:53:39 -07:00
hniksic
2a72eef0af
[svn] Define _VA_LIST to prevent Solaris stdio.h from declaring va_list.
...
Published in <sxs1ydk4vg0.fsf@florida.arsdigita.de>.
2002-04-12 11:36:07 -07:00
abbotti
fa2fa7a100
[svn] Specify libtool mode explicitly when linking.
...
Submitted by Ian Abbott in <3CB6F27B.15581.10E13BA@localhost>.
2002-04-12 06:47:02 -07:00
hniksic
9de4909bea
[svn] Update copyright years.
2002-04-11 18:23:23 -07:00
hniksic
0cd669109b
[svn] Implement connect timeout.
...
Published in <sxs1ydld8ha.fsf@florida.arsdigita.de>.
2002-04-11 18:14:18 -07:00
hniksic
fca8dcf829
[svn] Use stdarg only if compiling with an ANSI C compiler.
2002-04-11 12:13:57 -07:00
hniksic
c77a16309f
[svn] Don't allow initial_length to exceed total_length.
...
Published in <sxssn62dq99.fsf@florida.arsdigita.de>.
2002-04-11 11:51:26 -07:00
hniksic
8f93191f26
[svn] Convert URLs in <form action=...>.
...
Published in <sxsit6yf7jo.fsf@florida.arsdigita.de>.
2002-04-11 10:51:45 -07:00
hniksic
1375a89141
[svn] Allow Wget to be compiled with a K&R compiler.
...
Published in <sxszo0af9k6.fsf@florida.arsdigita.de>.
2002-04-11 10:49:32 -07:00
hniksic
485673c3a8
[svn] Make sure directory and file names are encoded the same way.
...
Published in <sxsofgqmf6e.fsf@florida.arsdigita.de>.
2002-04-11 08:25:51 -07:00
hniksic
8c3287dabf
[svn] Remove the OPTIONS_DEFINED_HERE kludge.
...
Published in <sxs4rijqmhv.fsf@florida.arsdigita.de>.
2002-04-10 14:20:55 -07:00
hniksic
1600aaeaa6
[svn] Revert to calculating ETA based on average download speed.
...
Published in <sxspu17sl10.fsf@florida.arsdigita.de>.
2002-04-10 07:10:03 -07:00
hniksic
538307f151
[svn] Keep updating a subinterval until it reaches or exceeds a watermark.
...
That way the measurement will be guaranteed to span a configurable
minimum of time. The current default is 3s in 30 100ms intervals.
Published in <sxsu1qkszdb.fsf@florida.arsdigita.de>.
2002-04-10 02:24:28 -07:00
hniksic
c292e8e153
[svn] Print the current download speed, rather than the average.
...
Published in <sxs3cy4yacm.fsf@florida.arsdigita.de>.
2002-04-09 15:10:01 -07:00
abbotti
c3c1c24f5c
[svn] Fix for Borland's broken (on Win9X) `utime' function.
...
Submitted by Ian Abbott in <3CB33A8E.15259.1E52AF@localhost>.
(Based on original patch by Chin-yuan Kuo in
<20020321015049.16722.qmail@web16202.mail.tpe.yahoo.com>.)
2002-04-09 11:29:54 -07:00
hniksic
07d72c3cd3
[svn] Propagate the result of ftp_retrieve_glob to the caller of ftp_loop.
...
Published in <sxssn663zwl.fsf@florida.arsdigita.de>.
2002-04-08 09:43:36 -07:00
abbotti
80a90d6d2c
[svn] Updated several dependencies for object files.
...
Submitted by Ian Abbott in <3C9F8BA4.19135.14568BF@localhost>.
2002-03-26 10:59:44 -08:00
abbotti
9f485af560
[svn] Dependcies update for src/mswindows.c.
...
Submitted by Ian Abbott in <3C98D8C6.31335.36EB6F@localhost>.
2002-03-20 10:56:45 -08:00
abbotti
47a8225eda
[svn] Don't include netdb.h on windows.
...
Submitted by Ian Abbott in <3C964B8C.18942.D3115@localhost>.
2002-03-18 12:21:58 -08:00
hniksic
1fa3b90235
[svn] Handle starting URL of recursing download being non-parsable.
...
Published in <sxszo26t33k.fsf@florida.arsdigita.de>.
2002-02-18 22:09:57 -08:00
hniksic
562ab4ae8a
[svn] (DO_REALLOC_FROM_ALLOCA): Multiply with sizeof(type) when calling
...
xmalloc and memcpy.
Submitted by Andreas Damm in
<Pine.LNX.4.33.0202011632280.1281-200000@gate.rad-ab.u-net.com>.
2002-02-18 21:32:59 -08:00
hniksic
667d494978
[svn] Only include Unix-specific includes #ifndef WINDOWS.
2002-02-18 21:25:42 -08:00
hniksic
75a080ad0d
[svn] Follow https links from http.
...
Submitted by Christian Lackas in <20020211202444.GA20371@lackas.desy.de>.
2002-02-18 21:23:35 -08:00
hniksic
57f36f8a6a
[svn] Add the necessary includes for compilation under FreeBSD.
...
Submitted by Alan Eldridge in <200202130630.g1D6U3S07907@wwweasel.geeksrus.net>.
2002-02-18 21:21:42 -08:00
hniksic
a9ff5853a9
[svn] when -c used, mark already fully retrieved file as successfully retrieved.
...
Submitted by Ian Abbott in <3C6019F4.30803.FF43E9@localhost>.
2002-02-18 21:18:43 -08:00
hniksic
b9e90c34b4
[svn] Don't treat '?' as a query string separator when parsing FTP URLs.
...
Published in <sxslmdqxdmq.fsf@florida.arsdigita.de>.
2002-02-18 21:09:14 -08:00
hniksic
0e40fc9a3c
[svn] Don't crash on <meta http-equiv=refresh>.
...
Published in <sxshep1q3je.fsf@florida.arsdigita.de>.
2002-01-31 19:34:31 -08:00
hniksic
a861f718ed
[svn] Enable compilation on Windows.
...
Submitted by Herold Heiko in
<B11A7CEC1675D511A3890002A551AD7C37D8AE@srvnt08.previnet.it>.
2002-01-30 18:23:04 -08:00
hniksic
6c4c785cc2
[svn] Remove redirection cycle detection.
...
Published in <sxs7kpzhcwa.fsf@florida.arsdigita.de>.
2002-01-30 11:12:20 -08:00
hniksic
f2bb99d102
[svn] Wrap numeric IPv6 addresses in square brackets when sending out HTTP
...
`Host' header.
Published in <sxs7kq4vgzf.fsf@florida.arsdigita.de>.
2002-01-26 15:19:10 -08:00
hniksic
1bea726393
[svn] Allow all hex digits in IPv6 IP addresses.
...
Published in <sxsofjgvo72.fsf@florida.arsdigita.de>.
2002-01-26 12:43:17 -08:00
hniksic
774c7c7461
[svn] *** empty log message ***
2002-01-26 11:01:39 -08:00
hniksic
ef1eda86c4
[svn] Allow IPv6 numeric addresses in URLs.
...
Submitted in <sxsu1t9uedf.fsf@florida.arsdigita.de>.
2002-01-26 11:00:38 -08:00
hniksic
a69cb0c3ad
[svn] Various IPv6 fixes.
...
Submitted in <sxsd6zz2jf7.fsf@florida.arsdigita.de>.
2002-01-24 19:34:23 -08:00
hniksic
853a1c9e35
[svn] Fix some IPv6-related problems.
...
Submitted in <sxsg04w6zl6.fsf@florida.arsdigita.de>.
2002-01-23 22:19:35 -08:00
hniksic
cb40034035
[svn] Commit IPv6 support by Thomas Lussnig.
...
Published in <sxsk7u8715e.fsf@florida.arsdigita.de>.
2002-01-23 21:45:54 -08:00
hniksic
e59a7ee8ac
[svn] Make -P work on Windows.
...
Submitted by Ian Abbott in <3C447E8F.13424.16ED42@localhost>.
2002-01-16 17:03:33 -08:00
hniksic
fb2ed23830
[svn] Skip initial whitespace before testing for EOL.
...
Submitted in <sxsu1tl6bf2.fsf@florida.arsdigita.de>.
2002-01-16 16:59:13 -08:00
hniksic
31d20e644c
[svn] select the file descriptor only if no data is pending in SSL buffers.
...
Submitted by tony@bluetail.com .
Published in <sxslmezocyp.fsf@florida.arsdigita.de>.
2002-01-15 07:24:19 -08:00
hniksic
08c935bef2
[svn] Strip trailing whitespace in header_process().
...
Published in <sxsadvh0xpz.fsf@florida.arsdigita.de>.
2002-01-14 07:17:34 -08:00
hniksic
46617228fa
[svn] URL-decode user and password in URL.
...
Published in <sxsita52hg6.fsf@florida.arsdigita.de>.
2002-01-14 05:26:16 -08:00
hniksic
524a1f54dc
[svn] Handle links to relative "net locations," e.g. <a href="//www.server.com/">.
2002-01-13 17:56:40 -08:00
hniksic
cafe798fec
[svn] Invalidate socket if get_contents encountered an error.
...
Published in <sxsita54sqy.fsf@florida.arsdigita.de>.
2002-01-13 17:39:16 -08:00
hniksic
90afc592e4
[svn] Bumped version number to 1.8.1+cvs.
2001-12-29 02:15:55 -08:00
hniksic
11745f55bf
[svn] Bump version to 1.8.1.
2001-12-24 13:02:25 -08:00
hniksic
a92b46f8ae
[svn] Bump version.
2001-12-19 08:30:47 -08:00
hniksic
5c859be2d4
[svn] Bump version to 1.8.1-pre3.
2001-12-19 06:59:01 -08:00
hniksic
8db1264218
[svn] Enqueue start_url in the canonical form.
...
Published in <sxsofkvi8zx.fsf@florida.arsdigita.de>.
2001-12-19 06:27:29 -08:00
hniksic
001cac91a4
[svn] Check for requested verbosity in logputs.
...
Published in <sxswuzjk0v6.fsf@florida.arsdigita.de>.
2001-12-19 01:36:58 -08:00
hniksic
ca9319aaba
[svn] Treat the "shortcut icon" link as inline.
...
Published in <sxsadwgko2q.fsf@florida.arsdigita.de>.
2001-12-18 17:15:34 -08:00
hniksic
2cf87bea8b
[svn] Fix crash introduced by previous patch.
2001-12-18 14:20:14 -08:00
hniksic
40fd876c57
[svn] Descend into HTML files we've already downloaded.
2001-12-18 14:14:31 -08:00
hniksic
a45e8255cc
[svn] Allow standalone compilation of html-parse.c.
2001-12-18 11:33:36 -08:00
hniksic
416671063a
[svn] Propagate referrer information from retrieve_tree to retrieve_url.
...
Submitted by Ian Abbott in <3C1F4BFE.17436.D2D7B2@localhost>.
2001-12-18 07:22:03 -08:00
hniksic
daa2fd1afd
[svn] Bump version.
2001-12-17 09:04:27 -08:00
hniksic
f03f033bf3
[svn] Bump version to 1.8.1-pre2.
2001-12-17 07:24:14 -08:00
hniksic
eb0f9de05d
[svn] Simplify indentation in sleep_between_retrievals.
2001-12-17 07:00:25 -08:00
hniksic
75699d6213
[svn] Use the new function `random_number' that doesn't depend on RAND_MAX
...
being defined.
Published in <sxsheqqq6xb.fsf@florida.arsdigita.de>.
2001-12-17 06:05:08 -08:00
hniksic
a3500d32d7
[svn] Move path_simplify to url.c.
2001-12-14 07:46:00 -08:00
hniksic
0f120eee66
[svn] Fix error message when $WGETRC not found.
...
Published in <sxswuzrylnm.fsf@florida.arsdigita.de>.
2001-12-13 11:19:03 -08:00
hniksic
f031900662
[svn] Don't abort when one URL references more than one file.
...
Published in <sxs1yhz0w1m.fsf@florida.arsdigita.de>.
2001-12-13 11:18:31 -08:00
hniksic
5b575eef31
[svn] Check for conn->ssl before using ssl_iwrite.
2001-12-13 08:46:56 -08:00
hniksic
92676dafee
[svn] Bump version.
2001-12-13 01:47:51 -08:00
hniksic
6821132a4d
[svn] Bump version to 1.8.1-pre1.
2001-12-12 23:40:50 -08:00
hniksic
3b44ca73ab
[svn] Fix the broken URLs that pointed to info.webcrawler.com to point to
...
the new www.robotstxt.org site.
2001-12-12 23:29:05 -08:00
hniksic
3ddcea34a4
[svn] Mark <embed href=...> as external.
2001-12-12 23:18:59 -08:00
hniksic
b9f370004d
[svn] Cosmetic changes to get_urls_html.
2001-12-12 11:06:10 -08:00
hniksic
390adeea93
[svn] Use "incomplete" rather than "relative".
2001-12-12 10:32:17 -08:00
hniksic
d425985c37
[svn] Minor doc update.
2001-12-12 09:01:26 -08:00
hniksic
8817f4c1a4
[svn] Break up collect_tags_mapper into several functions.
...
Published in <sxsg06gla1h.fsf@florida.arsdigita.de>.
2001-12-12 07:43:01 -08:00
hniksic
1dee527a56
[svn] Use a typedef for IPv4 address.
...
Published in <sxsn10qrwbj.fsf@florida.arsdigita.de>.
2001-12-11 00:32:58 -08:00
hniksic
b8789d7798
[svn] Fix obvious memory leaks in the VMS directory parser.
...
Published in <sxsadwqpbo1.fsf@florida.arsdigita.de>.
2001-12-10 21:29:52 -08:00
hniksic
1365950c01
[svn] Logging system bugfixes and improvements.
...
Published in <sxsofl7vdyo.fsf@florida.arsdigita.de>.
2001-12-09 21:31:45 -08:00
hniksic
7d65f1b896
[svn] Doc update in read_whole_line.
2001-12-09 19:34:48 -08:00
hniksic
fb9368e889
[svn] Restore sanity check in address_list_set_faulty.
2001-12-09 18:33:08 -08:00
hniksic
943f657aa7
[svn] Rename long_to_string to number_to_string, and make it return a useful
...
value.
2001-12-09 18:29:12 -08:00
hniksic
997a87548c
[svn] Minor fix for path_simplify.
...
Submitted in <sxsheqzx1qv.fsf@florida.arsdigita.de>.
2001-12-09 18:12:17 -08:00
hniksic
0e72aa6e13
[svn] Rewrite path_simplify.
...
Published in <sxspu5nx2yi.fsf@florida.arsdigita.de>.
2001-12-09 17:58:37 -08:00
hniksic
233fcbc44d
[svn] Would abort when given invalid progress type.
...
Published in <sxsg06kxc9g.fsf@florida.arsdigita.de>.
2001-12-09 14:25:34 -08:00
hniksic
e521ee38ff
[svn] Remove stray debugging message.
...
Published in <sxszo4sxjpw.fsf@florida.arsdigita.de>.
2001-12-09 11:44:20 -08:00
hniksic
0a89fc1a10
[svn] Fix a minor ETA padding glitch.
...
Published in <sxs667hyp19.fsf@florida.arsdigita.de>.
2001-12-08 20:51:40 -08:00
hniksic
cdc0cc0c1a
[svn] Bump version.
2001-12-08 20:33:47 -08:00
hniksic
fdd51b8d46
[svn] Bump version to 1.8.
2001-12-08 17:37:17 -08:00
hniksic
dd84231c6a
[svn] Minor fixes prompted by `lint'.
...
Published in <sxsadwt2nkg.fsf@florida.arsdigita.de>.
2001-12-08 17:24:41 -08:00
hniksic
171feaa3f2
[svn] Bump version.
2001-12-07 21:08:57 -08:00
hniksic
60680e27db
[svn] Release 1.8-pre2.
2001-12-07 19:44:23 -08:00
hniksic
bfd017746b
[svn] Doc fix.
2001-12-06 02:48:09 -08:00
hniksic
4e5bbd646b
[svn] Various progress-bar related fixes.
...
Published in <sxspu5slja3.fsf@florida.arsdigita.de>.
2001-12-06 02:45:27 -08:00
hniksic
7c6f905f94
[svn] Bump version.
2001-12-05 23:23:55 -08:00
hniksic
760e87d7a0
[svn] Bump version to 1.8-pre1.
2001-12-05 23:17:20 -08:00
hniksic
39b2248bde
[svn] Fall back to dot progress when forced to background.
...
Published in <sxs1yi8n7lx.fsf@florida.arsdigita.de>.
2001-12-05 23:14:35 -08:00
hniksic
00407b0762
[svn] Update copyright year.
2001-12-05 21:54:50 -08:00
hniksic
f8e6feb6bc
[svn] Fix varargs usage in logvprintf.
...
Published in <sxs667knbe1.fsf@florida.arsdigita.de>.
2001-12-05 21:53:21 -08:00