hniksic
|
1fa3b90235
|
[svn] Handle starting URL of recursing download being non-parsable.
Published in <sxszo26t33k.fsf@florida.arsdigita.de>.
|
2002-02-18 22:09:57 -08:00 |
|
hniksic
|
562ab4ae8a
|
[svn] (DO_REALLOC_FROM_ALLOCA): Multiply with sizeof(type) when calling
xmalloc and memcpy.
Submitted by Andreas Damm in
<Pine.LNX.4.33.0202011632280.1281-200000@gate.rad-ab.u-net.com>.
|
2002-02-18 21:32:59 -08:00 |
|
hniksic
|
667d494978
|
[svn] Only include Unix-specific includes #ifndef WINDOWS.
|
2002-02-18 21:25:42 -08:00 |
|
hniksic
|
75a080ad0d
|
[svn] Follow https links from http.
Submitted by Christian Lackas in <20020211202444.GA20371@lackas.desy.de>.
|
2002-02-18 21:23:35 -08:00 |
|
hniksic
|
57f36f8a6a
|
[svn] Add the necessary includes for compilation under FreeBSD.
Submitted by Alan Eldridge in <200202130630.g1D6U3S07907@wwweasel.geeksrus.net>.
|
2002-02-18 21:21:42 -08:00 |
|
hniksic
|
a9ff5853a9
|
[svn] when -c used, mark already fully retrieved file as successfully retrieved.
Submitted by Ian Abbott in <3C6019F4.30803.FF43E9@localhost>.
|
2002-02-18 21:18:43 -08:00 |
|
hniksic
|
b9e90c34b4
|
[svn] Don't treat '?' as a query string separator when parsing FTP URLs.
Published in <sxslmdqxdmq.fsf@florida.arsdigita.de>.
|
2002-02-18 21:09:14 -08:00 |
|
hniksic
|
0e40fc9a3c
|
[svn] Don't crash on <meta http-equiv=refresh>.
Published in <sxshep1q3je.fsf@florida.arsdigita.de>.
|
2002-01-31 19:34:31 -08:00 |
|
hniksic
|
a861f718ed
|
[svn] Enable compilation on Windows.
Submitted by Herold Heiko in
<B11A7CEC1675D511A3890002A551AD7C37D8AE@srvnt08.previnet.it>.
|
2002-01-30 18:23:04 -08:00 |
|
hniksic
|
6c4c785cc2
|
[svn] Remove redirection cycle detection.
Published in <sxs7kpzhcwa.fsf@florida.arsdigita.de>.
|
2002-01-30 11:12:20 -08:00 |
|
hniksic
|
f2bb99d102
|
[svn] Wrap numeric IPv6 addresses in square brackets when sending out HTTP
`Host' header.
Published in <sxs7kq4vgzf.fsf@florida.arsdigita.de>.
|
2002-01-26 15:19:10 -08:00 |
|
hniksic
|
1bea726393
|
[svn] Allow all hex digits in IPv6 IP addresses.
Published in <sxsofjgvo72.fsf@florida.arsdigita.de>.
|
2002-01-26 12:43:17 -08:00 |
|
hniksic
|
ef1eda86c4
|
[svn] Allow IPv6 numeric addresses in URLs.
Submitted in <sxsu1t9uedf.fsf@florida.arsdigita.de>.
|
2002-01-26 11:00:38 -08:00 |
|
hniksic
|
a69cb0c3ad
|
[svn] Various IPv6 fixes.
Submitted in <sxsd6zz2jf7.fsf@florida.arsdigita.de>.
|
2002-01-24 19:34:23 -08:00 |
|
hniksic
|
853a1c9e35
|
[svn] Fix some IPv6-related problems.
Submitted in <sxsg04w6zl6.fsf@florida.arsdigita.de>.
|
2002-01-23 22:19:35 -08:00 |
|
hniksic
|
cb40034035
|
[svn] Commit IPv6 support by Thomas Lussnig.
Published in <sxsk7u8715e.fsf@florida.arsdigita.de>.
|
2002-01-23 21:45:54 -08:00 |
|
hniksic
|
e59a7ee8ac
|
[svn] Make -P work on Windows.
Submitted by Ian Abbott in <3C447E8F.13424.16ED42@localhost>.
|
2002-01-16 17:03:33 -08:00 |
|
hniksic
|
fb2ed23830
|
[svn] Skip initial whitespace before testing for EOL.
Submitted in <sxsu1tl6bf2.fsf@florida.arsdigita.de>.
|
2002-01-16 16:59:13 -08:00 |
|
hniksic
|
31d20e644c
|
[svn] select the file descriptor only if no data is pending in SSL buffers.
Submitted by tony@bluetail.com.
Published in <sxslmezocyp.fsf@florida.arsdigita.de>.
|
2002-01-15 07:24:19 -08:00 |
|
hniksic
|
08c935bef2
|
[svn] Strip trailing whitespace in header_process().
Published in <sxsadvh0xpz.fsf@florida.arsdigita.de>.
|
2002-01-14 07:17:34 -08:00 |
|
hniksic
|
46617228fa
|
[svn] URL-decode user and password in URL.
Published in <sxsita52hg6.fsf@florida.arsdigita.de>.
|
2002-01-14 05:26:16 -08:00 |
|
hniksic
|
524a1f54dc
|
[svn] Handle links to relative "net locations," e.g. <a href="//www.server.com/">.
|
2002-01-13 17:56:40 -08:00 |
|
hniksic
|
cafe798fec
|
[svn] Invalidate socket if get_contents encountered an error.
Published in <sxsita54sqy.fsf@florida.arsdigita.de>.
|
2002-01-13 17:39:16 -08:00 |
|
hniksic
|
11745f55bf
|
[svn] Bump version to 1.8.1.
|
2001-12-24 13:02:25 -08:00 |
|
hniksic
|
5c859be2d4
|
[svn] Bump version to 1.8.1-pre3.
|
2001-12-19 06:59:01 -08:00 |
|
hniksic
|
8db1264218
|
[svn] Enqueue start_url in the canonical form.
Published in <sxsofkvi8zx.fsf@florida.arsdigita.de>.
|
2001-12-19 06:27:29 -08:00 |
|
hniksic
|
001cac91a4
|
[svn] Check for requested verbosity in logputs.
Published in <sxswuzjk0v6.fsf@florida.arsdigita.de>.
|
2001-12-19 01:36:58 -08:00 |
|
hniksic
|
ca9319aaba
|
[svn] Treat the "shortcut icon" link as inline.
Published in <sxsadwgko2q.fsf@florida.arsdigita.de>.
|
2001-12-18 17:15:34 -08:00 |
|
hniksic
|
2cf87bea8b
|
[svn] Fix crash introduced by previous patch.
|
2001-12-18 14:20:14 -08:00 |
|
hniksic
|
40fd876c57
|
[svn] Descend into HTML files we've already downloaded.
|
2001-12-18 14:14:31 -08:00 |
|
hniksic
|
416671063a
|
[svn] Propagate referrer information from retrieve_tree to retrieve_url.
Submitted by Ian Abbott in <3C1F4BFE.17436.D2D7B2@localhost>.
|
2001-12-18 07:22:03 -08:00 |
|
hniksic
|
f03f033bf3
|
[svn] Bump version to 1.8.1-pre2.
|
2001-12-17 07:24:14 -08:00 |
|
hniksic
|
eb0f9de05d
|
[svn] Simplify indentation in sleep_between_retrievals.
|
2001-12-17 07:00:25 -08:00 |
|
hniksic
|
75699d6213
|
[svn] Use the new function `random_number' that doesn't depend on RAND_MAX
being defined.
Published in <sxsheqqq6xb.fsf@florida.arsdigita.de>.
|
2001-12-17 06:05:08 -08:00 |
|
hniksic
|
a3500d32d7
|
[svn] Move path_simplify to url.c.
|
2001-12-14 07:46:00 -08:00 |
|
hniksic
|
0f120eee66
|
[svn] Fix error message when $WGETRC not found.
Published in <sxswuzrylnm.fsf@florida.arsdigita.de>.
|
2001-12-13 11:19:03 -08:00 |
|
hniksic
|
f031900662
|
[svn] Don't abort when one URL references more than one file.
Published in <sxs1yhz0w1m.fsf@florida.arsdigita.de>.
|
2001-12-13 11:18:31 -08:00 |
|
hniksic
|
5b575eef31
|
[svn] Check for conn->ssl before using ssl_iwrite.
|
2001-12-13 08:46:56 -08:00 |
|
hniksic
|
6821132a4d
|
[svn] Bump version to 1.8.1-pre1.
|
2001-12-12 23:40:50 -08:00 |
|
hniksic
|
3b44ca73ab
|
[svn] Fix the broken URLs that pointed to info.webcrawler.com to point to
the new www.robotstxt.org site.
|
2001-12-12 23:29:05 -08:00 |
|
hniksic
|
3ddcea34a4
|
[svn] Mark <embed href=...> as external.
|
2001-12-12 23:18:59 -08:00 |
|
hniksic
|
b9f370004d
|
[svn] Cosmetic changes to get_urls_html.
|
2001-12-12 11:06:10 -08:00 |
|
hniksic
|
d425985c37
|
[svn] Minor doc update.
|
2001-12-12 09:01:26 -08:00 |
|
hniksic
|
8817f4c1a4
|
[svn] Break up collect_tags_mapper into several functions.
Published in <sxsg06gla1h.fsf@florida.arsdigita.de>.
|
2001-12-12 07:43:01 -08:00 |
|
hniksic
|
1dee527a56
|
[svn] Use a typedef for IPv4 address.
Published in <sxsn10qrwbj.fsf@florida.arsdigita.de>.
|
2001-12-11 00:32:58 -08:00 |
|
hniksic
|
b8789d7798
|
[svn] Fix obvious memory leaks in the VMS directory parser.
Published in <sxsadwqpbo1.fsf@florida.arsdigita.de>.
|
2001-12-10 21:29:52 -08:00 |
|
hniksic
|
1365950c01
|
[svn] Logging system bugfixes and improvements.
Published in <sxsofl7vdyo.fsf@florida.arsdigita.de>.
|
2001-12-09 21:31:45 -08:00 |
|
hniksic
|
fb9368e889
|
[svn] Restore sanity check in address_list_set_faulty.
|
2001-12-09 18:33:08 -08:00 |
|
hniksic
|
943f657aa7
|
[svn] Rename long_to_string to number_to_string, and make it return a useful
value.
|
2001-12-09 18:29:12 -08:00 |
|
hniksic
|
997a87548c
|
[svn] Minor fix for path_simplify.
Submitted in <sxsheqzx1qv.fsf@florida.arsdigita.de>.
|
2001-12-09 18:12:17 -08:00 |
|
hniksic
|
0e72aa6e13
|
[svn] Rewrite path_simplify.
Published in <sxspu5nx2yi.fsf@florida.arsdigita.de>.
|
2001-12-09 17:58:37 -08:00 |
|
hniksic
|
233fcbc44d
|
[svn] Would abort when given invalid progress type.
Published in <sxsg06kxc9g.fsf@florida.arsdigita.de>.
|
2001-12-09 14:25:34 -08:00 |
|
hniksic
|
e521ee38ff
|
[svn] Remove stray debugging message.
Published in <sxszo4sxjpw.fsf@florida.arsdigita.de>.
|
2001-12-09 11:44:20 -08:00 |
|
hniksic
|
0a89fc1a10
|
[svn] Fix a minor ETA padding glitch.
Published in <sxs667hyp19.fsf@florida.arsdigita.de>.
|
2001-12-08 20:51:40 -08:00 |
|
hniksic
|
fdd51b8d46
|
[svn] Bump version to 1.8.
|
2001-12-08 17:37:17 -08:00 |
|
hniksic
|
dd84231c6a
|
[svn] Minor fixes prompted by `lint'.
Published in <sxsadwt2nkg.fsf@florida.arsdigita.de>.
|
2001-12-08 17:24:41 -08:00 |
|
hniksic
|
60680e27db
|
[svn] Release 1.8-pre2.
|
2001-12-07 19:44:23 -08:00 |
|
hniksic
|
4e5bbd646b
|
[svn] Various progress-bar related fixes.
Published in <sxspu5slja3.fsf@florida.arsdigita.de>.
|
2001-12-06 02:45:27 -08:00 |
|
hniksic
|
760e87d7a0
|
[svn] Bump version to 1.8-pre1.
|
2001-12-05 23:17:20 -08:00 |
|
hniksic
|
39b2248bde
|
[svn] Fall back to dot progress when forced to background.
Published in <sxs1yi8n7lx.fsf@florida.arsdigita.de>.
|
2001-12-05 23:14:35 -08:00 |
|
hniksic
|
f8e6feb6bc
|
[svn] Fix varargs usage in logvprintf.
Published in <sxs667knbe1.fsf@florida.arsdigita.de>.
|
2001-12-05 21:53:21 -08:00 |
|
hniksic
|
fcf68c0e9a
|
[svn] --sslegdsock' -> --egd-file'
Published in <sxsadwwnc7h.fsf@florida.arsdigita.de>.
|
2001-12-05 21:35:17 -08:00 |
|
hniksic
|
e16c0ba78e
|
[svn] Add information about the beta releases.
|
2001-12-05 17:24:24 -08:00 |
|
hniksic
|
f5d20aef32
|
[svn] Make the message printed in ssl_init_prng translatable.
|
2001-12-05 17:15:05 -08:00 |
|
hniksic
|
0620ada923
|
[svn] Fix OpenSSL PRNG seeding.
Published in <sxs7ks1noc4.fsf@florida.arsdigita.de>.
|
2001-12-05 17:13:31 -08:00 |
|
hniksic
|
b248bfe395
|
[svn] Don't abort in read_whole_lines when a line begins with \0.
Published in <sxsu1v5nrtg.fsf@florida.arsdigita.de>.
|
2001-12-05 15:58:12 -08:00 |
|
hniksic
|
8a2ab60263
|
[svn] Fix overzealous URL-removal in register_download.
Published in <sxszo4yqq91.fsf@florida.arsdigita.de>.
|
2001-12-04 19:51:23 -08:00 |
|
hniksic
|
eef4527c24
|
[svn] Doc fix.
|
2001-12-04 15:42:18 -08:00 |
|
hniksic
|
0fdc1bd8c0
|
[svn] Fix downloading of duplicate URLs.
Published in <sxsvgfmu2bj.fsf@florida.arsdigita.de>.
|
2001-12-04 13:03:35 -08:00 |
|
hniksic
|
abf215c1e3
|
[svn] snprintf.c (dopr): Use `unsigned int' as the second argument to va_arg
when casting to `unsigned short' is intended.
Submitted by Ian Abbott in <3C0CB09F.21762.34A1F1@localhost>.
|
2001-12-04 04:44:58 -08:00 |
|
hniksic
|
f70c9c6ede
|
[svn] Windows update from Herold Heiko.
|
2001-12-04 02:33:18 -08:00 |
|
hniksic
|
e986f7dad3
|
[svn] Quote '?' as '%3F' in local files when `--html-extension' is turned on.
Published in <sxszo4ztiwr.fsf@florida.arsdigita.de>.
|
2001-12-04 01:49:37 -08:00 |
|
hniksic
|
79f868cd0f
|
[svn] Cast va_arg(..., int) to short if a short value is expected.
Published in <sxsbshgxfs5.fsf@florida.arsdigita.de>.
|
2001-12-03 11:31:17 -08:00 |
|
hniksic
|
f58c338aea
|
[svn] snprintf.c: Replace short int' and unsigned short int' with `int' when
using it as the second argument to `va_arg'.
Published in <sxsu1v8xisg.fsf@florida.arsdigita.de>.
|
2001-12-03 10:28:08 -08:00 |
|
hniksic
|
29a338cc58
|
[svn] Use address_list_new_one.
Published in <sxsbshgyz71.fsf@florida.arsdigita.de>.
|
2001-12-03 09:48:12 -08:00 |
|
hniksic
|
400201444f
|
[svn] Don't initialize TMPSTORE directly.
Submitted by Andre Majorel.
|
2001-12-03 09:31:23 -08:00 |
|
hniksic
|
6d93a95e37
|
[svn] Declare h_errno in host.c, but not elsewhere.
|
2001-12-03 09:22:06 -08:00 |
|
hniksic
|
f5799945b0
|
[svn] file_merge: if BASE doesn't contain a slash, just return a copy of FILE.
Published in <sxssnatmh6s.fsf@florida.arsdigita.de>.
|
2001-12-02 13:44:16 -08:00 |
|
hniksic
|
acf2d79a8a
|
[svn] When PWD fails, assume "/".
Published in <sxs667qr5a0.fsf@florida.arsdigita.de>.
|
2001-12-01 13:37:40 -08:00 |
|
hniksic
|
8b2a216c77
|
[svn] Make --base -i work.
Published in <sxsoflisqcf.fsf@florida.arsdigita.de>.
|
2001-12-01 11:17:19 -08:00 |
|
hniksic
|
07e6be3527
|
[svn] Don't document `-nh' in --help output.
Published in <sxs4rnau642.fsf@florida.arsdigita.de>.
|
2001-12-01 10:51:32 -08:00 |
|
hniksic
|
569fd61c95
|
[svn] Use the full path when building the authorization line.
Published in <sxsitbqu9iw.fsf@florida.arsdigita.de>.
|
2001-12-01 09:39:07 -08:00 |
|
hniksic
|
3ff0a9ad00
|
[svn] Minor tweak in path_matches in cookies.c.
|
2001-12-01 07:34:55 -08:00 |
|
hniksic
|
57dd93f915
|
[svn] Don't expect HTTP paths to begin with '/'.
Published in <sxsvgfrv7ky.fsf@florida.arsdigita.de>.
|
2001-11-30 21:22:17 -08:00 |
|
hniksic
|
92b269acad
|
[svn] Match hosts against domains per Netscape cookie "specification".
Published in <sxszo53v8by.fsf@florida.arsdigita.de>.
|
2001-11-30 21:08:03 -08:00 |
|
hniksic
|
f4d019a423
|
[svn] Correctly convert links in <meta http-equiv=Refresh content="...">.
Published in <sxsadx3wp49.fsf@florida.arsdigita.de>.
|
2001-11-30 20:18:51 -08:00 |
|
hniksic
|
7ab7f93f8d
|
[svn] Make -p work with framed pages.
Published in <sxsu1vby71t.fsf@florida.arsdigita.de>.
|
2001-11-30 19:06:41 -08:00 |
|
hniksic
|
406fb8bbef
|
[svn] Don't allow more than 20 successive redirections.
|
2001-11-30 13:33:31 -08:00 |
|
hniksic
|
a4db28e20f
|
[svn] Ignore -np when in -p mode.
Published in <sxsg06w2c52.fsf@florida.arsdigita.de>.
|
2001-11-30 13:17:53 -08:00 |
|
hniksic
|
5baed885db
|
[svn] Fix netrc authorization in conjunction with HTTP.
Submitted by Daniel BODEA in <011901c162ca$19779df0$25c0a8c0@GHOTIX>.
|
2001-11-30 01:33:22 -08:00 |
|
hniksic
|
2c37aef2d8
|
[svn] Don't forget to shutdown the SSL structure if the socket times out.
Submitted by T. Bharath in <3B3DEBC7.2537186A@responsenetworks.com>.
|
2001-11-30 00:57:03 -08:00 |
|
hniksic
|
7674ecd97e
|
[svn] Simplify display_image.
|
2001-11-30 00:02:33 -08:00 |
|
hniksic
|
ae3c268719
|
[svn] Implement EGD support.
Submitted by Christian Fraenkel in <005501c17920$1312d440$4a05a8c0@isn>.
|
2001-11-29 23:39:08 -08:00 |
|
hniksic
|
999388bfa0
|
[svn] Check for memmove and implement one if it's missing.
|
2001-11-29 11:43:29 -08:00 |
|
hniksic
|
b6bbc32e14
|
[svn] Guard against header files getting included twice.
|
2001-11-29 10:55:52 -08:00 |
|
hniksic
|
b65661a879
|
[svn] Remove char/unsigned char warnings emitted by Sun cc.
|
2001-11-29 10:48:43 -08:00 |
|
hniksic
|
fb98d1e4b0
|
[svn] Remove implicit declaration warnings.
|
2001-11-29 10:22:18 -08:00 |
|
hniksic
|
39482df431
|
[svn] descend_url_p: When resolving no_parent, compare with the start url,
not the parent url.
Published in <sxspu614ikm.fsf@florida.arsdigita.de>.
|
2001-11-29 09:04:28 -08:00 |
|
hniksic
|
9c1c7f27cd
|
[svn] Windows fixes by Herold Heiko.
|
2001-11-29 06:15:11 -08:00 |
|
hniksic
|
bb8e524316
|
[svn] Initialize al->faulty.
Published in <sxsvgft65an.fsf@florida.arsdigita.de>.
|
2001-11-29 06:06:03 -08:00 |
|