Commit Graph

134 Commits

Author SHA1 Message Date
hniksic c2c41a6b14 [svn] Remove unreachable "break" statements. 2005-04-28 06:52:02 -07:00
hniksic cf994330a3 [svn] Added reordering of addresses to try IPv4 first and the associated
--prefer-family switch.
2005-04-24 13:00:19 -07:00
hniksic 42139ce9b1 [svn] Define NO_ADDRESS only after the system headers have been included. 2005-04-07 13:43:26 -07:00
hniksic 6da4142b3b [svn] Use high-resolution timers on Windows. 2005-03-20 02:41:46 -08:00
hniksic b3363d2abd [svn] Fix escape chars in server response vulnerability. Server response is
now quoted to escape non-ASCII characters.
2005-03-04 11:34:31 -08:00
hniksic 16c53cdf93 [svn] Improve handling of numeric hosts when ENABLE_IPV6.
Published in <87psyr6jn7.fsf@xemacs.org>.
2005-03-04 11:21:02 -08:00
hniksic e3fb2ec5df [svn] Remove duplicate initialization. 2005-02-26 19:00:59 -08:00
hniksic 8b30dbf8b5 [svn] Docfix. 2003-12-14 07:25:29 -08:00
hniksic f57e571154 [svn] Cosmetic change. 2003-11-29 14:19:26 -08:00
hniksic 0fb0ee87c7 [svn] Renamed address_list_find to address_list_contains. 2003-11-18 14:18:44 -08:00
hniksic 133d69ff24 [svn] Don't auto-set opt.ipv4_only on systems without IPv6 sockets. 2003-11-17 04:59:54 -08:00
hniksic dcc890b007 [svn] Specify AI_ADDRCONFIG only when the address family is not explicitly
requested.
2003-11-14 18:18:41 -08:00
hniksic 98349dee6f [svn] Don't refer to nonexistent forget_host_lookup. 2003-11-14 18:10:56 -08:00
hniksic 8e330fdba0 [svn] Add support for -4/-6. 2003-11-14 17:49:52 -08:00
hniksic 615ae382f9 [svn] Cosmetic changes. 2003-11-14 05:55:02 -08:00
hniksic 4cef0cc3f9 [svn] Document that Winsock's gethostbyname might not grok numeric addresses. 2003-11-14 05:51:32 -08:00
hniksic fea4fb28cb [svn] Document that the IP addresses are returned in order. 2003-11-12 17:37:46 -08:00
hniksic 244efb6e50 [svn] Added (currently no-op) -4 and -6. 2003-11-11 13:48:35 -08:00
hniksic 1c35fe3c45 [svn] Mention that gethostbyname is not required to accept dotted-decimal
addresses.
2003-11-10 19:21:57 -08:00
hniksic 1d0ab81f37 [svn] Use a more standard error message. 2003-11-10 19:19:33 -08:00
hniksic 9e5222bd7c [svn] Add docs for address_list_release. 2003-11-10 16:26:14 -08:00
hniksic 02f90322e8 [svn] Network updates. 2003-11-10 05:20:46 -08:00
hniksic 5921fb2d57 [svn] Special-case numeric addresses only in the IPv4 case. 2003-11-10 04:56:08 -08:00
hniksic 8ccc51e5af [svn] Split passive host lookups to a separate function. 2003-11-09 17:38:09 -08:00
hniksic d7e592d797 [svn] Replace conaddr with socket_ip_address. 2003-11-07 18:57:51 -08:00
hniksic e75d817c09 [svn] Use autoheader to generate config.h.in. 2003-11-04 07:28:18 -08:00
hniksic 2063522623 [svn] Don't take the address of in.s_addr because that doesn't work on some
machines.
2003-11-02 15:48:45 -08:00
hniksic 5b8d5d5a05 [svn] Doc fix. 2003-10-31 18:29:38 -08:00
hniksic bed1c56453 [svn] Fixed declaration of VEC in lookup_host.
Removed the ip_default_family global variable.
2003-10-31 18:22:11 -08:00
hniksic 5f0a2b3f08 [svn] Use new macros xnew, xnew0, xnew_array, and xnew0_array in various places. 2003-10-31 06:55:50 -08:00
hniksic dbe01ae695 [svn] Removed address_list_from_single. 2003-10-31 02:50:03 -08:00
hniksic add61a2d9c [svn] Networking improvements: get rid of the MSOCK global variable,
move the sockaddr handling to connect.c, make sure Wget refreshes
the DNS lookup after it becomes stale.
2003-10-30 16:18:08 -08:00
hniksic 6f1250b1c6 [svn] Updated IPv6 code. 2003-10-29 15:13:25 -08:00
hniksic 90cb3309da [svn] Imported Mauro's IPv6 changes. 2003-10-29 10:23:56 -08:00
hniksic c81651f4c1 [svn] Change u_int32_t to uint32_t. 2003-10-25 18:41:56 -07:00
hniksic f58c6774e4 [svn] Provide the support for int32_t and u_int32_t. 2003-10-10 19:27:41 -07:00
hniksic 5155384340 [svn] Look for and use socklen_t. 2003-10-10 18:39:07 -07:00
hniksic 38ea4d5dad [svn] Renamed DEBUG to ENABLE_DEBUG. 2003-10-07 17:05:51 -07:00
hniksic 51a8e9fa50 [svn] Enabled separation of different timeout values. 2003-09-20 21:41:55 -07:00
hniksic 7870937036 [svn] Allow decimal values for --timeout, --wait, and --waitretry.
Message-ID: <m3llsjhx6t.fsf@hniksic.iskon.hr>
2003-09-20 16:12:18 -07:00
hniksic 7e7ce3dc0e [svn] Print the result of DNS lookup. 2003-09-10 13:46:32 -07:00
hniksic 10137bd186 [svn] New option --dns-cache. 2003-09-10 12:41:54 -07:00
hniksic cd8b1259f1 [svn] IPv6 configure auto-detection. 2003-09-09 12:30:45 -07:00
hniksic b2be7522c7 [svn] Update the license to include the OpenSSL exception. 2002-05-17 19:16:36 -07:00
abbotti caa0f23be3 [svn] Fix broken Windows builds due to the xxx_with_timeout stuff.
Submitted by Ian Abbotti in <3CBB2FFE.20193.73A594@localhost>.
2002-04-15 12:01:56 -07:00
hniksic 036f99c801 [svn] Extend the timeout to DNS lookups.
Published in <sxsn0w57ldh.fsf@florida.arsdigita.de>.
2002-04-14 19:21:38 -07:00
hniksic f3d3a50a56 [svn] Generalize connect_with_timeout into run_with_timeout.
Published in <sxs4rifxndi.fsf@florida.arsdigita.de>.
2002-04-13 15:18:28 -07:00
hniksic a861f718ed [svn] Enable compilation on Windows.
Submitted by Herold Heiko in
<B11A7CEC1675D511A3890002A551AD7C37D8AE@srvnt08.previnet.it>.
2002-01-30 18:23:04 -08:00
hniksic 774c7c7461 [svn] *** empty log message *** 2002-01-26 11:01:39 -08:00
hniksic a69cb0c3ad [svn] Various IPv6 fixes.
Submitted in <sxsd6zz2jf7.fsf@florida.arsdigita.de>.
2002-01-24 19:34:23 -08:00
hniksic 853a1c9e35 [svn] Fix some IPv6-related problems.
Submitted in <sxsg04w6zl6.fsf@florida.arsdigita.de>.
2002-01-23 22:19:35 -08:00
hniksic cb40034035 [svn] Commit IPv6 support by Thomas Lussnig.
Published in <sxsk7u8715e.fsf@florida.arsdigita.de>.
2002-01-23 21:45:54 -08:00
hniksic 1dee527a56 [svn] Use a typedef for IPv4 address.
Published in <sxsn10qrwbj.fsf@florida.arsdigita.de>.
2001-12-11 00:32:58 -08:00
hniksic fb9368e889 [svn] Restore sanity check in address_list_set_faulty. 2001-12-09 18:33:08 -08:00
hniksic dd84231c6a [svn] Minor fixes prompted by `lint'.
Published in <sxsadwt2nkg.fsf@florida.arsdigita.de>.
2001-12-08 17:24:41 -08:00
hniksic 29a338cc58 [svn] Use address_list_new_one.
Published in <sxsbshgyz71.fsf@florida.arsdigita.de>.
2001-12-03 09:48:12 -08:00
hniksic 400201444f [svn] Don't initialize TMPSTORE directly.
Submitted by Andre Majorel.
2001-12-03 09:31:23 -08:00
hniksic 6d93a95e37 [svn] Declare h_errno in host.c, but not elsewhere. 2001-12-03 09:22:06 -08:00
hniksic ca5098a425 [svn] Update copyright statement. 2001-11-30 02:50:29 -08:00
hniksic c828d1e8be [svn] Remove doc reference to non-extant ngethostbyname. 2001-11-30 02:44:17 -08:00
hniksic b4b0659e43 [svn] Fix preprocessor indentation. 2001-11-30 00:36:22 -08:00
hniksic b65661a879 [svn] Remove char/unsigned char warnings emitted by Sun cc. 2001-11-29 10:48:43 -08:00
hniksic bb8e524316 [svn] Initialize al->faulty.
Published in <sxsvgft65an.fsf@florida.arsdigita.de>.
2001-11-29 06:06:03 -08:00
hniksic 8196a09904 [svn] Don't reuse IP addresses proven to be faulty, unless only such ones remain.
Published in <sxs8zcsfemf.fsf@florida.arsdigita.de>.
2001-11-27 06:55:40 -08:00
hniksic 024cb5ed3a [svn] A lot of host name changes.
Published in <sxs3d32856s.fsf@florida.arsdigita.de>.
2001-11-25 21:36:33 -08:00
hniksic 95631700f7 [svn] Remove host canonicalization code.
Published in <sxsg072ai5v.fsf@florida.arsdigita.de>.
2001-11-25 09:13:20 -08:00
hniksic 222e9465b7 [svn] Implemented breadth-first retrieval.
Published in <sxsherjczw2.fsf@florida.arsdigita.de>.
2001-11-24 19:10:34 -08:00
hniksic d5be8ecca4 [svn] Rewrite parsing and handling of URLs.
Published in <sxs4rnnlklo.fsf@florida.arsdigita.de>.
2001-11-21 16:24:28 -08:00
hniksic f178e6c613 [svn] Clean up handling of schemes.
Published in <sxswv0n7h7s.fsf@florida.arsdigita.de>.
2001-11-18 16:12:05 -08:00
hniksic d60b54cba0 [svn] Applied Chris Seawood's patch for compilation under BEOS.
Patch published in <3B5D4CEF.5090208@seawood.org>.
2001-11-16 08:58:08 -08:00
hniksic 0b056d1720 [svn] Update copyright notices. 2001-05-27 12:35:15 -07:00
hniksic 72eca0976b [svn] Commit several minor changes:
* main.c (print_help): Document `--no-http-keep-alive'.

* utils.c (numdigit): Handle negative numbers *correctly*.

* hash.c (make_nocase_string_hash_table): Use term "nocase" rather
than the confusing "unsigned".

* utils.c (string_set_contains): Renamed from string_set_exists.

* hash.c (hash_table_contains): Renamed from hash_table_exists.

* cookies.c: Move case-insensitive hash tables to hash.c.

Published in <sxsheyq9vvl.fsf@florida.arsdigita.de>.
2001-05-12 13:06:41 -07:00
hniksic dfc1eb5766 [svn] Change default anonymous FTP password to "-wget@".
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
2001-04-29 03:53:55 -07:00
hniksic 8a0e9e765e [svn] Minor -Wall-induced fixes. Also, skip_url is removed.
Published in <sxs8zl5v5cw.fsf@florida.arsdigita.de>.
2001-04-12 20:39:23 -07:00
hniksic 1a6058b1ec [svn] Applied Philipp Thomas's safe-ctype patch. Published in
<20010330025159.U21662@jeffreys.suse.de>.
2001-03-30 14:36:59 -08:00
hniksic 1cddc05edb [svn] Committed memory debugging stuff.
Published in <sxs1yw34pt4.fsf@florida.arsdigita.de>.
2000-11-22 14:15:45 -08:00
hniksic 2ffb47eabf [svn] Committed <sxsbsv854j9.fsf@florida.arsdigita.de>. 2000-11-22 08:58:28 -08:00
hniksic b0b1c815c1 [svn] A bunch of new features:
- use mmap() to read whole files in core instead of allocating memory
  and read'ing it.

- use a new, more general, HTML parser (html-parse.c) and interface to
  it from Wget (html-url.c).

- respect <meta name=robots content=nofollow> (easy with the new HTML
  parser).

- use hash tables instead of linked lists in places where the lists
  were used to facilitate mappings.

- rewrite the code in host.c to be more readable and faster (hash
  tables instead of home-grown lists.)

- make convert_links properly convert partial URLs to complete ones
  for those URLs that have *not* been downloaded.

- use HTTP persistent connections where available.  very
  simple-minded, caches the last connection to the server.

Published in <sxshf533d5r.fsf@florida.arsdigita.de>.
2000-11-19 12:50:10 -08:00
hniksic 6a70f04a5c [svn] Don't clutter the host list with duplicate hosts.
Published in <sxsitpt56eh.fsf@florida.arsdigita.de>.
2000-11-12 16:46:13 -08:00
hniksic 094481c386 [svn] Committed host.c patch from <dpk8i3za97.fsf_-_@mraz.iskon.hr>. 2000-04-14 02:31:21 -07:00
dan 1ecfed1e10 [svn] * host.c (store_hostaddress): R. K. Owen's patch introduces a "left shift count
>= width of type" warning on 32-bit architectures.  Got rid of it by tricking
  the compiler w/ a variable.

* url.c (UNSAFE_CHAR): The macro didn't include all the illegal characters per
  RFC1738, namely everything above '~'.  It also generated a warning on OSes
  where char =~ unsigned char.  Fixed.
2000-04-04 20:08:10 -07:00
hniksic 858adf01cd [svn] Fix store_hostaddress() on big-endian 64-bit machines. 2000-03-31 06:07:07 -08:00
hniksic dee64b0b16 [svn] Fix indentation. 2000-03-31 06:05:53 -08:00
kwget 31d6616c48 [svn] Initial revision 1999-12-01 23:42:23 -08:00