moparisthebest/wget
1
0
Fork 0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Code Issues Releases Wiki Activity
2,387 Commits 1 Branch 0 Tags 9.6 MiB
3ab05cfe38
Commit Graph

1168 Commits

Author SHA1 Message Date
hniksic
a8155e7bcc [svn] Correctly calculate bandwidth as total data read divided with download 
time.
 2003-12-05 18:32:57 -08:00
hniksic
bf8350af62 [svn] Support the 303 See Other response. 2003-12-05 06:37:47 -08:00
hniksic
78706dc5ea [svn] * retr.c (fd_read_body): Report the amount of data *written* as 
amount_read.  This is not entirely logical, but that's what the
callers expect, and it's not easy to change.

* ftp.c (ftp_loop_internal): Ditto.

* http.c (http_loop): Be smarter about assigning restval; if we're
in the nth pass of a download, simply use the information we have
about how much data has been retrieved as restval.

* ftp.c (getftp): Ditto for FTP "REST" command.

* http.c (gethttp): When the server doesn't respect range, skip
the first RESTVAL bytes of the read body.  Never truncate the
output file.

* retr.c (fd_read_body): Support skipping initial STARTPOS octets.
 2003-11-30 15:39:04 -08:00
hniksic
381457408a [svn] Read the data in skip_short_body directly. 2003-11-30 06:33:00 -08:00
hniksic
2f357b5eb8 [svn] Better documentation for fd_read_body args. 2003-11-29 20:41:08 -08:00
hniksic
3390f7eb45 [svn] Try to reuse connections that return error codes. 2003-11-29 17:34:33 -08:00
hniksic
63d492c0ba [svn] Initialize SSL only the first time when an SSL URL is encountered. 2003-11-29 14:24:55 -08:00
hniksic
0ff9eb4727 [svn] Restructure generation of HTTP requests. Allow headers specified with 
--header to override generated headers.
 2003-11-29 10:40:01 -08:00
hniksic
83b0e38940 [svn] Don't include the Proxy-Authorization header in the request tunneled 
through proxy.
 2003-11-28 03:28:05 -08:00
hniksic
76b59b1ad7 [svn] Use the CONNECT method to establish passthrough over SSL traffic 
over proxies.
 2003-11-27 18:24:53 -08:00
hniksic
7c063c3175 [svn] Don't #include netinet/Winsock stuff. 2003-11-27 15:39:53 -08:00
hniksic
dfe1f43dc0 [svn] Use fd_read_hunk for reading HTTP response head. Support HTTP/0.9 
responses.
 2003-11-27 15:29:36 -08:00
hniksic
b83acf88c1 [svn] Don't calculate the ETA if nothing has yet been downloaded. 2003-11-27 14:59:36 -08:00
hniksic
f496a0ea07 [svn] Renamed sa_len to addrlen because IRIX defines sa_len as macro. 2003-11-27 02:59:41 -08:00
hniksic
3f84a5e00e [svn] Squash embedded newlines in links. 2003-11-26 08:37:04 -08:00
hniksic
1b2dce0493 [svn] Set con->csock to -1 where rbuf_uninitialize was previously used. 2003-11-25 16:38:20 -08:00
hniksic
c06c8d039f [svn] Added the trailing backslash that was missing. 2003-11-25 16:20:42 -08:00
hniksic
7736d5dc98 [svn] Remove headers.c and headers.h. 2003-11-21 00:48:45 -08:00
hniksic
d9fea91a0a [svn] Remove the "rbuf" buffering layer. Provide peeking primitives instead. 2003-11-20 17:48:11 -08:00
hniksic
0716c335a0 [svn] Renamed xread/xwrite/xclose to fd_read/fd_write/fd_close. The "x" prefix is 
not appropriate because the semantics have diverged from read/write/close
too significantly.
 2003-11-20 07:19:59 -08:00
hniksic
0c4b349c5a [svn] It's not necessary to initialize RES. 2003-11-19 17:26:02 -08:00
hniksic
bbcdd71484 [svn] Don't reference opt.ipv4_only and opt.ipv6_only if IPv6 is disabled. 2003-11-19 05:25:20 -08:00
hniksic
3792aa7058 [svn] Don't compile socket_has_inet6 if IPv6 is disabled. 2003-11-19 04:07:42 -08:00
hniksic
581f9539a3 [svn] Warn the user when using weak random seed. 2003-11-18 14:28:01 -08:00
hniksic
0fb0ee87c7 [svn] Renamed address_list_find to address_list_contains. 2003-11-18 14:18:44 -08:00
hniksic
ac1d8e5078 [svn] Make select_fd return 1 if select is unavailable. 2003-11-17 15:46:20 -08:00
hniksic
e4c730c3a5 [svn] Don't reference address list after releasing it. 2003-11-17 12:51:27 -08:00
hniksic
5fb7ffc9ad [svn] Fix alignment of FTP options output. 2003-11-17 05:13:33 -08:00
hniksic
133d69ff24 [svn] Don't auto-set opt.ipv4_only on systems without IPv6 sockets. 2003-11-17 04:59:54 -08:00
hniksic
c45fc0e595 [svn] Fix minor problems with --help text. 2003-11-16 15:42:38 -08:00
hniksic
cd8797a2a2 [svn] No longer include INET headers in ftp-basic.c. 2003-11-16 11:17:48 -08:00
hniksic
66cc6d43f6 [svn] Don't allow opt.ipv4_only and opt.ipv6_only to both be set. 2003-11-15 16:31:58 -08:00
hniksic
dcc890b007 [svn] Specify AI_ADDRCONFIG only when the address family is not explicitly 
requested.
 2003-11-14 18:18:41 -08:00
hniksic
98349dee6f [svn] Don't refer to nonexistent forget_host_lookup. 2003-11-14 18:10:56 -08:00
hniksic
36387204b0 [svn] Fix call to socket_ip_address. 2003-11-14 18:03:23 -08:00
hniksic
8e330fdba0 [svn] Add support for -4/-6. 2003-11-14 17:49:52 -08:00
hniksic
5a883689bc [svn] Enable -4 and -6 switches only when IPv6 is enabled. 2003-11-14 07:18:47 -08:00
hniksic
4e58524e8f [svn] Renamed register_extended to register_transport. 2003-11-14 05:43:46 -08:00
hniksic
6ddd0006e4 [svn] Preserve consecutive slashes in URLs. Make sure leading ".."'s are 
not stripped away.
 2003-11-13 17:36:02 -08:00
hniksic
9d907933ad [svn] Don't attempt to talk to two different SSL sites over the same secure 
connection.
 2003-11-13 14:48:03 -08:00
hniksic
509154dc81 [svn] Use the new function retryable_socket_connect_error instead of the 
CONNECT_ERROR macro.
 2003-11-13 14:27:38 -08:00
hniksic
1cfde0c27d [svn] Correctly check for unsupported socket families. 2003-11-13 12:26:18 -08:00
hniksic
0f99d1f220 [svn] Rewrote bindport and acceptport to use a more standard calling convention. 2003-11-13 09:05:06 -08:00
hniksic
a0bae929ea [svn] Turn on opt.ipv4_only if we're compiling with IPv6, and AI_ADDRINFO is not 
available, and AF_INET6 sockets can't be created.
 2003-11-13 08:41:17 -08:00
hniksic
fea4fb28cb [svn] Document that the IP addresses are returned in order. 2003-11-12 17:37:46 -08:00
hniksic
6f3dbca0c5 [svn] Better INT_MAX and UCHAR_MAX checks. 2003-11-11 16:42:09 -08:00
hniksic
244efb6e50 [svn] Added (currently no-op) -4 and -6. 2003-11-11 13:48:35 -08:00
hniksic
1d0ab81f37 [svn] Use a more standard error message. 2003-11-10 19:19:33 -08:00
hniksic
02f90322e8 [svn] Network updates. 2003-11-10 05:20:46 -08:00
hniksic
5921fb2d57 [svn] Special-case numeric addresses only in the IPv4 case. 2003-11-10 04:56:08 -08:00
hniksic
8ccc51e5af [svn] Split passive host lookups to a separate function. 2003-11-09 17:38:09 -08:00
hniksic
eb88464568 [svn] Download URLs from <object data="...">. 2003-11-08 17:33:33 -08:00
hniksic
113ad490d0 [svn] Fix core dump with --mirror. 2003-11-08 17:07:53 -08:00
hniksic
8cfaba536a [svn] Specify exact domain match on cookies that don't specify domain. 2003-11-08 14:32:52 -08:00
hniksic
4f19ac5494 [svn] Retire options -g, -G, -s, and -C. 2003-11-08 12:22:21 -08:00
hniksic
439d6a11fa [svn] Added --dont-remove-listing, removed -s. 2003-11-08 12:13:24 -08:00
hniksic
3b8e1052cb [svn] Support Windows-2000 ftp servers. By Gisle Vanem. 2003-11-08 11:20:29 -08:00
hniksic
94ca33d2fb [svn] Update the progress gauge even when the data does not arrive. 2003-11-08 08:56:52 -08:00
hniksic
cb393a062d [svn] Abort if wtimer_update is called on an uninitialized timer. 
On the other hand, allow wtimer_read on such a timer.
 2003-11-08 08:13:54 -08:00
hniksic
0bd6576cde [svn] Timer code update. 2003-11-07 20:55:44 -08:00
hniksic
d7e592d797 [svn] Replace conaddr with socket_ip_address. 2003-11-07 18:57:51 -08:00
hniksic
fef88bd179 [svn] Mark entries as deleted with the correct marker. 2003-11-07 16:52:23 -08:00
hniksic
bf1ce5b2ad [svn] Use 0xff in hash_table_clear. 2003-11-07 16:48:12 -08:00
hniksic
1a0adb90b4 [svn] Don't force silent lookup. 2003-11-07 16:11:29 -08:00
hniksic
7d12ad0f36 [svn] Explicitly check that fd>=0 in register_extended. 2003-11-07 15:45:03 -08:00
hniksic
4a2a06a881 [svn] Set last_info. 2003-11-07 08:46:01 -08:00
hniksic
ab15dd054b [svn] Allow NULL/0 as hash table keys. 2003-11-07 03:40:08 -08:00
hniksic
84db601be6 [svn] Allow empty port spec in URL. 2003-11-06 17:10:12 -08:00
hniksic
7409af5e07 [svn] Break up `--help' output to smaller chunks. 2003-11-06 15:56:26 -08:00
hniksic
19144a9f4c [svn] Don't declare log_* functions in main.c. 2003-11-06 14:48:17 -08:00
hniksic
ad75dd2662 [svn] Applied Dennis Smit's --preserve-permissions patch. 2003-11-06 12:33:20 -08:00
hniksic
f567bec34c [svn] Improved command line option processing, introduced boolean options. 2003-11-06 12:20:43 -08:00
hniksic
bc764dbb7c [svn] Improve SSL code. Only initialize PRNG when needed. 2003-11-06 05:06:59 -08:00
hniksic
49dfcb6036 [svn] Free INFO even if it doesn't register a closer. 2003-11-05 17:15:44 -08:00
hniksic
c8e92cdbd6 [svn] Get rid of ssl_iread/ssl_iwrite. Have the SSL code register its 
routines for reading and writing data.
 2003-11-05 17:12:03 -08:00
hniksic
1131c6a116 [svn] Fix compilation under pre-C99 compilers. 2003-11-05 13:33:46 -08:00
hniksic
2d00f882e0 [svn] Make setsockopt(SO_REUSEADDR) non-fatal if fails. 2003-11-05 07:12:14 -08:00
hniksic
5355da917f [svn] More specific error message in resolve_bind_address. 2003-11-05 06:42:42 -08:00
hniksic
38b37ed104 [svn] New option --keep-session-cookies. 2003-11-04 16:11:33 -08:00
hniksic
086dd1ca8a [svn] Delete config.h.in from `make realclean'. 2003-11-04 08:06:25 -08:00
hniksic
e75d817c09 [svn] Use autoheader to generate config.h.in. 2003-11-04 07:28:18 -08:00
hniksic
71b3daae55 [svn] Imported Mauro's IPv6 ChangeLog. 2003-11-04 05:40:21 -08:00
hniksic
f4cbba565e [svn] Only set a flag in the SIGWINCH handler. 2003-11-04 05:37:14 -08:00
hniksic
9af99f3b83 [svn] Enable SYSTEM_FNMATCH only if fnmatch.h is available. 2003-11-03 17:09:54 -08:00
hniksic
8cd9b4cd8a [svn] New function xsleep that resumes sleeps interrupted by signals 
on systems that support nanosleep.
 2003-11-03 13:57:04 -08:00
hniksic
2f2939d23e [svn] Don't shadow SEED. 2003-11-03 13:21:05 -08:00
hniksic
e958a474b0 [svn] Renamed logvprintf to log_vprintf_internal. 2003-11-03 12:08:46 -08:00
hniksic
3ec22d9843 [svn] Msg fix. 2003-11-02 18:44:41 -08:00
hniksic
b997a9d34f [svn] Don't parenthesize argument to N_. 2003-11-02 16:28:53 -08:00
hniksic
2063522623 [svn] Don't take the address of in.s_addr because that doesn't work on some 
machines.
 2003-11-02 15:48:45 -08:00
hniksic
6d3df65e88 [svn] Generalized the third argument to select_fd. 2003-11-02 15:17:59 -08:00
hniksic
095d89995e [svn] Abort on xfree(NULL). 2003-11-02 13:12:49 -08:00
hniksic
e2e9b753e4 [svn] Retired the `boolean' type. Renamed FREE_MAYBE to xfree_null and moved the 
definition from wget.h to xmalloc.h.  Moved the DEFAULT_LOGFILE
define to log.h.  Moved the INFINITE_RECURSION define to recur.h.
 2003-11-02 11:56:37 -08:00
hniksic
504effdc13 [svn] Improved support for entities. 2003-11-02 06:57:31 -08:00
hniksic
37dd65621c [svn] Document the Opie code better. Use uint32_t instead of unsigned long 
for 32-bit quantities.
 2003-11-01 08:36:43 -08:00
hniksic
7ec83a1b2a [svn] Don't call select_fd unless timeout is desired. 2003-11-01 06:01:53 -08:00
hniksic
bed1c56453 [svn] Fixed declaration of VEC in lookup_host. 
Removed the ip_default_family global variable.
 2003-10-31 18:22:11 -08:00
hniksic
5f0a2b3f08 [svn] Use new macros xnew, xnew0, xnew_array, and xnew0_array in various places. 2003-10-31 06:55:50 -08:00
hniksic
370ff7a576 [svn] Moved malloc-related code to xmalloc.c. Defined new macros xnew, xnew0, 
xnew_array, and xnew0_array.  Created xmalloc.h and log.h to unclutter
wget.h.
 2003-10-31 06:31:56 -08:00
hniksic
83e7fe2ca8 [svn] Retired broken code that checked for NULL ip_address in sockaddr_set_data. 2003-10-31 04:20:14 -08:00
hniksic
dbe01ae695 [svn] Removed address_list_from_single. 2003-10-31 02:50:03 -08:00
hniksic
add61a2d9c [svn] Networking improvements: get rid of the MSOCK global variable, 
move the sockaddr handling to connect.c, make sure Wget refreshes
the DNS lookup after it becomes stale.
 2003-10-30 16:18:08 -08:00
hniksic
e4ff71fca5 [svn] *** empty log message *** 2003-10-30 13:32:35 -08:00
hniksic
3f8a70c227 [svn] Use S >= 8' rather than S == 8' when looking for large integers. 2003-10-30 07:55:53 -08:00
hniksic
448a61fb83 [svn] Don't unescape URL escapes twice. 2003-10-30 07:42:52 -08:00
hniksic
29e36b051b [svn] Fix -p so it doesn't imply FTP recursion. 2003-10-30 05:00:29 -08:00
hniksic
6f1250b1c6 [svn] Updated IPv6 code. 2003-10-29 15:13:25 -08:00
hniksic
8c19243974 [svn] Dummy ChangeLog entry for Mauro's IPv6 changes. 2003-10-29 13:47:07 -08:00
hniksic
c81651f4c1 [svn] Change u_int32_t to uint32_t. 2003-10-25 18:41:56 -07:00
hniksic
dd356aff3d [svn] Reset the QUOTE flag after the closing quote. 2003-10-25 17:03:38 -07:00
hniksic
27d5becdaf [svn] Better document the workings of construct_relative(). 
Reformat is_valid_ipv6_address() to GNU formatting style.
 2003-10-25 04:58:24 -07:00
hniksic
51c82cd8b3 [svn] Fixed compilation under Ultrix. 2003-10-23 08:25:34 -07:00
hniksic
5fa95aabc7 [svn] Bump version. 2003-10-23 05:33:26 -07:00
hniksic
d66af0ab20 [svn] Don't use trailing commas in enums. 2003-10-23 05:15:39 -07:00
hniksic
168f03d21d [svn] Don't let absolute path specified by -P introduce absolute file names 
to links converted by -k.
 2003-10-16 08:48:24 -07:00
hniksic
31d919b23d [svn] Accept HTTP status 307 as redirect. 2003-10-14 16:32:15 -07:00
hniksic
3f6913663e [svn] Correctly loop through the linked list. 
By Philip Stadermann.
 2003-10-14 15:52:12 -07:00
hniksic
5535c9ff17 [svn] Expect links followed from Refreshes to contain URLs. 2003-10-13 07:32:25 -07:00
hniksic
7487dbfa81 [svn] Don't define int32_t because we're not using it. 2003-10-13 07:20:51 -07:00
hniksic
711bf72609 [svn] Remove VERY_LONG_TYPE; use LARGE_INT instead. Remove special code 
for handling VERY_LONG_TYPE overflows.
Make opt.quota a LARGE_INT.
 2003-10-11 06:57:11 -07:00
hniksic
a6f72ca66b [svn] Also check for short for int32_t. 2003-10-11 05:41:13 -07:00
hniksic
f58c6774e4 [svn] Provide the support for int32_t and u_int32_t. 2003-10-10 19:27:41 -07:00
hniksic
5155384340 [svn] Look for and use socklen_t. 2003-10-10 18:39:07 -07:00
hniksic
1b3cdef574 [svn] Don't descend into HTML that was downloaded by following <img src=...> 
and such.
 2003-10-10 07:25:10 -07:00
hniksic
ffc2d0f653 [svn] Make the first argument to hash_table_new a minimal count of items before 
regrow, not raw size, which is more useful.
 2003-10-09 19:46:09 -07:00
hniksic
233ebb78de [svn] Use hash table for tag lookup in html-url.c and html-parse.c. 2003-10-09 08:01:58 -07:00
hniksic
b49e89e78a [svn] Add const declarations to hash-table functions. 2003-10-09 06:32:28 -07:00
hniksic
ae1d264fcc [svn] Add FLAGS argument to map_html_tags. 2003-10-08 09:17:33 -07:00
hniksic
a9c3c58c9f [svn] Switch to binary search for find_tag. 2003-10-08 09:00:10 -07:00
hniksic
33dceca784 [svn] Fix typo in help string. 2003-10-08 08:24:56 -07:00
hniksic
6057dbec6f [svn] Add definitions of getopt_long and getopt_long_only to getopt.c. 
The definitions were lost when updating the file.
 2003-10-08 07:55:44 -07:00
hniksic
38ea4d5dad [svn] Renamed DEBUG to ENABLE_DEBUG. 2003-10-07 17:05:51 -07:00
hniksic
097923f7b1 [svn] Move fnmatch() to cmpt.c and don't use it under GNU libc. 2003-10-07 16:53:31 -07:00
hniksic
d7cbc755e0 [svn] Add a fresher getopt.c. 2003-10-07 15:58:27 -07:00
hniksic
3d823e690e [svn] Remove unused pointer from struct cookie. 2003-10-07 03:39:18 -07:00
hniksic
6359e38d96 [svn] Improve documentation of cookie code. 2003-10-06 17:47:08 -07:00
hniksic
abf7afb9d4 [svn] Fix type of _SetThreadExecutionState local var. 
By Gisle Vanem.
 2003-10-05 14:12:36 -07:00
hniksic
254291cc03 [svn] Fix crash when post-file is missing. 2003-10-04 15:26:58 -07:00
hniksic
711692375e [svn] Use WaitForSingleObject to wait for thread termination. 
By Gisle Vanem.
 2003-10-04 14:54:12 -07:00
hniksic
98b7ac79f3 [svn] Update ansi2knr.c and ansi2knr.1. 
Update log.c to use `...' in function definition argument lists
unconditionally.
 2003-10-04 03:34:10 -07:00
hniksic
351c4b9add [svn] Include winsock headers from mswindows.h. 
By Gisle Vanem.
 2003-10-03 09:37:47 -07:00
hniksic
87275db136 [svn] Fix compilation problem on non-Gcc compilers. 2003-10-03 09:11:09 -07:00
hniksic
5a905bcec3 [svn] Window-specific implementation of run_with_timeout. 
By Gisle Vanem.
 2003-10-02 16:28:49 -07:00
hniksic
eec3ea392d [svn] Better document html-parse macros. 2003-10-02 15:20:44 -07:00
hniksic
f70c6cacb9 [svn] Initialize DUMMY storage for DT. 2003-10-02 14:21:07 -07:00
hniksic
2e8899bc10 [svn] Added support for hexadecimal numeric entities. 2003-10-02 10:23:25 -07:00
hniksic
030704403b [svn] Subsecond granularity in run_with_timeout. 2003-10-02 06:37:45 -07:00
hniksic
65cec8deee [svn] Fix memory leak in a rare case in url.c. 
Translate error messages from url_parse().
 2003-10-01 12:59:48 -07:00
hniksic
d0f4a1e109 [svn] Initialize local variable to shut up the compiler. 2003-10-01 12:45:41 -07:00
hniksic
6a2477fdc2 [svn] *** empty log message *** 2003-10-01 06:44:46 -07:00
hniksic
451ddf3cf9 [svn] Display percentage in title bar. 
By Gisle Vanem.
 2003-09-30 14:24:36 -07:00
hniksic
b307160959 [svn] Made --spider work with FTP downloads. 
By Aaron S. Hawley.
 2003-09-30 14:14:02 -07:00
hniksic
a95b801f61 [svn] Windows fixes by Gisle Vanem. 2003-09-26 17:35:31 -07:00
hniksic
700df4394e [svn] Fixes to support out of the box compilation on various Windows compilers. 
By Gisle Vanem.
 2003-09-25 15:39:37 -07:00
hniksic
831f376303 [svn] Fix oversight in escape handling. 2003-09-25 15:31:35 -07:00
hniksic
e6fd9cb793 [svn] Force printing of ETA at the end of download. 2003-09-23 13:48:10 -07:00
hniksic
845a0988b1 [svn] Remove .libs directory when cleaning up. 2003-09-23 13:10:59 -07:00
hniksic
45164e05cc [svn] Fix a bug when loading cookies. Don't ignore domain-flag. 2003-09-22 18:08:01 -07:00
hniksic
625a9d3a9f [svn] Indicate where the download has started in progress bar. 2003-09-22 10:14:19 -07:00
hniksic
c2ffc02ab3 [svn] If hash/test functions aren't given, default to identity hash tables. 2003-09-22 07:32:17 -07:00
hniksic
e6d8f06093 [svn] Fix broken cast of BIT to unsigned char. 2003-09-21 19:05:34 -07:00
hniksic
3e9dc5b994 [svn] Modified path_simplify not to rely on extensive use of memmove. 2003-09-21 17:23:44 -07:00
hniksic
95c647eb44 [svn] Split off non-URL related stuff from url.c to convert.c. 2003-09-21 15:47:14 -07:00
hniksic
e0303dd8ea [svn] Improved init.c error messages. 2003-09-21 12:17:45 -07:00
hniksic
7211c51139 [svn] path_simplify would read two bytes past the end of the string in the "./" case. 2003-09-21 06:36:50 -07:00
hniksic
c06d32a309 [svn] Treat xhtml files just like regular html. 
By Matthew J. Mellon.
 2003-09-21 05:02:57 -07:00
hniksic
51a8e9fa50 [svn] Enabled separation of different timeout values. 2003-09-20 21:41:55 -07:00
hniksic
b8e416c6c7 [svn] Adjust bandwidth limitation sleep for the error of previous sleeps. 
Allow decimal numbers in bandwidth limit specification.
 2003-09-20 21:05:12 -07:00
hniksic
37183b0208 [svn] Make errors in command-line options fatal. 2003-09-20 17:41:49 -07:00
hniksic
7870937036 [svn] Allow decimal values for --timeout, --wait, and --waitretry. 
Message-ID: <m3llsjhx6t.fsf@hniksic.iskon.hr>
 2003-09-20 16:12:18 -07:00
hniksic
e7998ad916 [svn] Cosmetic fixes. 2003-09-20 14:08:41 -07:00
hniksic
101f896e47 [svn] Minor fixes and cosmetic changes. 
(uri_merge): Get rid of uri_merge_1.
(uri_merge): Merge "foo//", "bar" as "foo//bar", not "foo///bar",
i.e. don't add an extra slash merely because BASE ends with two
slashes.
(parse_credentials): Renamed from parse_uname.  Rewrittern in
standard [beg, end) calling style.
(url_skip_credentials): Renamed from url_skip_uname.  Made static.
(url_skip_credentials): Include # and ; as terminators.  Old code
would mistakenly consider "http://foo.com#hniksic@iskon.hr" to
contain a username.
(url_skip_scheme): Removed because it was unused.
(url_has_scheme): Require "scheme" to be at least one char long.
 2003-09-19 17:05:36 -07:00
hniksic
a504d10ed5 [svn] Default dir_prefix to NULL rather than ".". 2003-09-19 08:28:36 -07:00
hniksic
4fd9c65005 [svn] Cosmetic change. 2003-09-19 07:20:35 -07:00
hniksic
7b5fb50cb1 [svn] Renamed wget.h XDIGIT-related macros to (hopefully) clearer names. 2003-09-19 07:08:37 -07:00
hniksic
7c802e58d3 [svn] Introduce non-strict comment parsing. 2003-09-18 17:33:22 -07:00
hniksic
e71b2799d2 [svn] Add support for OS/400 ftp server. 2003-09-18 06:46:17 -07:00
hniksic
fb67dd6201 [svn] Call ssl_iread with the correct arguments. 2003-09-18 04:43:00 -07:00
hniksic
beb08d42ba [svn] Don't #define ctype.h macros to errors. 2003-09-18 04:39:22 -07:00
hniksic
4dcee39c88 [svn] Undef U, W, C after use. 2003-09-16 18:59:46 -07:00
hniksic
aa24b822ca [svn] Improved --restrict-file-names to accept ",nocontrol". 2003-09-16 18:32:05 -07:00
hniksic
d4281f04b2 [svn] Made sync_path more resilient to pathological values of u->file and u->dir. 2003-09-16 17:18:52 -07:00
hniksic
4b1afddab3 [svn] Allow unique_name to return the FILE argument unmodified. 
Streamline and optimize unique_name_1.
 2003-09-16 14:47:49 -07:00
hniksic
c95d75292b [svn] Work around VC's inability to cast unsigned __int64 to void. 2003-09-16 14:16:59 -07:00
hniksic
8514281d39 [svn] Have `make clean' also delete the core.<number> files created by recent 
Linux systems.
 2003-09-15 16:42:59 -07:00
hniksic
0e77942233 [svn] Don't pad shrunk POST'ed files. 
Message-ID: <m3u17dn1qk.fsf@hniksic.iskon.hr>
 2003-09-15 15:09:17 -07:00
hniksic
d54b2a086d [svn] Improved --limit-rate for small bandwidths. 
Message-ID: <m3znh5n2og.fsf@hniksic.iskon.hr>
 2003-09-15 14:48:43 -07:00
hniksic
9228f0bf53 [svn] Update progress code to use higher timer resolution. 
Message-ID: <m37k49oivp.fsf@hniksic.iskon.hr>
 2003-09-15 14:14:15 -07:00
hniksic
ea8a108b1f [svn] Implement xdigit_to_xchar more efficiently. 2003-09-15 10:50:43 -07:00
hniksic
016867ca33 [svn] Another version of parse_set_cookies, along with a test suite. 2003-09-15 08:35:47 -07:00
hniksic
79157a03fd [svn] Made strpbrk_or_eos a macro under Gcc. 2003-09-15 03:47:46 -07:00
hniksic
3abcd16d79 [svn] Allow trailing whitespace in Set-Cookies. Also allow empty Set-Cookies 
without spewing an error.
Message-ID: <m365jucpci.fsf@xemacs.org>.
 2003-09-15 03:35:01 -07:00
hniksic
0a3697ad65 [svn] New mechanism for quoting file names. 
Published in <m3smmzt4px.fsf@hniksic.iskon.hr>.
 2003-09-14 15:04:13 -07:00
hniksic
ebea9e7e0b [svn] Fixed a long-standing bug in the timer code that would cause Wget to 
crash when the system time was set back during a Wget run.
Message-ID: <m3znh8wag9.fsf@hniksic.iskon.hr>
 2003-09-13 16:12:45 -07:00
hniksic
7e7ce3dc0e [svn] Print the result of DNS lookup. 2003-09-10 13:46:32 -07:00
hniksic
bda244f564 [svn] Allow --foo=yes/no in addition to --foo=on/off. 2003-09-10 13:21:21 -07:00
hniksic
10137bd186 [svn] New option --dns-cache. 2003-09-10 12:41:54 -07:00
hniksic
cd8b1259f1 [svn] IPv6 configure auto-detection. 2003-09-09 12:30:45 -07:00
hniksic
0e9b4de751 [svn] Return an error from url_parse if the IP address is IPv6 and we don't 
handle IPv6.
 2003-09-09 06:06:58 -07:00
hniksic
05715ed4d6 [svn] Add proper detection of numeric IPv6 addresses. 
By Mauro Tortonesi.
 2003-09-05 13:36:17 -07:00
hniksic
30ac043b0a [svn] New option --retry-connrefused from Ahmod Dancy. 2003-09-04 14:34:58 -07:00
abbotti
0410411939 [svn] Fix for FTP directory traversal vulnerability (at least for Unix). 
Based on a patch by Red Hat.
Published in <85u02vg4hukbc2fltdd51uds5oq14rd92f@farscape.privy.mev.co.uk>.
 2003-01-11 12:12:35 -08:00
hniksic
27483fd0f5 [svn] Fix off-by-one error in cmd_file. 
Published in <sxsit2rfzqo.fsf@florida.munich.redhat.com>.
 2002-08-03 13:34:58 -07:00
hniksic
d7673d398b [svn] Check whether downloaded_html_set is non-NULL before using it. 
Posted in <sxsr8hsvnhh.fsf@florida.munich.redhat.com>.
 2002-07-24 14:16:30 -07:00
hniksic
89b37c7eff [svn] Allow almost any character in attribute/tag names. 2002-05-27 08:03:35 -07:00
hniksic
d3a636f2a5 [svn] Fall back to dot progress if the terminal type is "emacs". 
Published in <sxsd6vllhsi.fsf@florida.munich.redhat.com>.
 2002-05-24 07:53:18 -07:00
hniksic
f97f3ef416 [svn] Don't #define __STDC__ against the compiler's will. 
Published in <sxsptzr64ea.fsf@florida.munich.redhat.com>.
 2002-05-19 17:38:14 -07:00
hniksic
a4abdda23d [svn] Minor optimization of prime_size. 
Published in <sxswuu2p6pm.fsf@florida.munich.redhat.com>.
 2002-05-17 18:48:39 -07:00
abbotti
83dc077b17 [svn] (download_child_p): Minor optimization to avoid unnecessary call to 
schemes_are_similar_p function.
Published in <kvq7eu4okekh2ohb0rdvavt16nbgb02v00@farscape.privy.mev.co.uk>.
 2002-05-16 10:38:30 -07:00
abbotti
e863a6323b [svn] New function schemes_are_similar_p to test enumerated scheme codes for 
similarity (SCHEME_HTTP and SCHEME_HTTPS are similar).  Use it in recur.c
(download_child_p).  Fixes a bug that caused -H option to be ignored when
child scheme different to parent scheme.
Published in <agn4eu8apduek7magfu9bfe63gto8i7cdh@farscape.privy.mev.co.uk>.
 2002-05-16 10:22:24 -07:00
abbotti
043d305fb1 [svn] Don't ftruncate standard output. 
Submitted by Bill Richardson  <bill@riverstonenet.com>.
Final version of patch published in
<9vv1eus668tn7v3vn95e7l2lcjbbph8bi2@farscape.privy.mev.co.uk>.
 2002-05-14 05:23:51 -07:00
abbotti
55f59d0022 [svn] Synched strptime with glibc 2.1.3. 2002-05-09 03:14:15 -07:00
hniksic
fd42ae1311 [svn] Allow match_tail to be case insensitive. 
Published in <sxsznzabirr.fsf@florida.munich.redhat.com>.
 2002-05-08 11:24:40 -07:00
abbotti
291693c3c2 [svn] Do not store discarded cookie after it is delected. 
Submitted by Ian Abbott in
<2h2gdu0q04v94ltet2634888sh6imcrgnd@farscape.privy.mev.co.uk>.
 2002-05-07 10:22:33 -07:00
hniksic
58ee1f008a [svn] Fix matching of cookie domains. 
Published in <sxsy9fhu1bu.fsf@florida.arsdigita.de>.
 2002-04-20 21:25:36 -07:00
hniksic
91a190a770 [svn] Implement several SSL features. 
- allow checking of server cert
- allow defining client cert type
- allow limit of ssl protocol
- check more return values
- added debug message on break
Published by Thomas Lussnig in <3CC09969.5000607@bewegungsmelder.de>.
 2002-04-20 19:26:48 -07:00
hniksic
bf018d5721 [svn] Revert order of check number 6 in download_child_p for clarity. 2002-04-20 19:15:11 -07:00
hniksic
29a66192cf [svn] Cookie interface and implementation changes 
from <sxsofge9yao.fsf@florida.arsdigita.de>
and <sxslmbim7dg.fsf@florida.arsdigita.de>.
 2002-04-20 13:46:38 -07:00
hniksic
a9e97711fa [svn] Keep the commands list in sort order! 2002-04-19 02:24:32 -07:00
hniksic
123034fa83 [svn] Remove stray conflict marker. 2002-04-16 13:15:23 -07:00
hniksic
7953158bce [svn] Correctly merge DOS-like absolute directories. 
Published in <sxslmbomnm7.fsf@florida.arsdigita.de>.
 2002-04-15 18:36:16 -07:00
hniksic
426bf23ae1 [svn] If content-type is not given, assume text/html. 2002-04-15 18:13:51 -07:00
hniksic
f8b4b8bd12 [svn] When downloading recursively, don't ignore rejection of HTML 
documents that are themselves leaves of recursion.
 2002-04-15 14:57:10 -07:00
abbotti
4c11f1b269 [svn] Updated several dependencies for object files, taking account of nested 
include files.
Submitted by Ian Abbott.
 2002-04-15 13:15:43 -07:00
abbotti
56698ffd1d [svn] Updated dependencies of connect$o to include utils.h 2002-04-15 12:10:23 -07:00
abbotti
caa0f23be3 [svn] Fix broken Windows builds due to the xxx_with_timeout stuff. 
Submitted by Ian Abbotti in <3CBB2FFE.20193.73A594@localhost>.
 2002-04-15 12:01:56 -07:00
hniksic
036f99c801 [svn] Extend the timeout to DNS lookups. 
Published in <sxsn0w57ldh.fsf@florida.arsdigita.de>.
 2002-04-14 19:21:38 -07:00
hniksic
fbf0306dd7 [svn] Have number_to_string handle the case when number < -MAX_INT. 
Published in <sxs662uf7l9.fsf@florida.arsdigita.de>.
 2002-04-14 12:18:33 -07:00
hniksic
081e4eb4f4 [svn] Use a marginally faster implementation of binary search. 
Published in <sxs662uf7l9.fsf@florida.arsdigita.de>.
 2002-04-14 11:39:43 -07:00
hniksic
0eee8f8b25 [svn] Document --post-data' and --post-file'. 2002-04-13 22:31:11 -07:00
hniksic
9f2cc07924 [svn] Minor cleanup of iread/iwrite. 
Published in <sxsk7raj1t2.fsf@florida.arsdigita.de>.
 2002-04-13 22:19:27 -07:00
hniksic
5cb8a6f44d [svn] Add the POST method. 
Published in <sxssn5yj4eb.fsf@florida.arsdigita.de>.
 2002-04-13 21:22:47 -07:00
hniksic
f3d3a50a56 [svn] Generalize connect_with_timeout into run_with_timeout. 
Published in <sxs4rifxndi.fsf@florida.arsdigita.de>.
 2002-04-13 15:18:28 -07:00
hniksic
5390ada318 [svn] Support FWTK-style proxies. 
Pbublished in <sxslmbsxptu.fsf@florida.arsdigita.de>.
 2002-04-12 20:04:47 -07:00
hniksic
278b63093f [svn] Remove stray conflict marker. 2002-04-12 13:28:05 -07:00
hniksic
faf77c8f51 [svn] Only define _VA_LIST when compiling with gcc. 
Published in <sxsit6w1x5t.fsf@florida.arsdigita.de>.
 2002-04-12 13:27:18 -07:00
abbotti
4aaf8fdcea [svn] Compensate for MS Windows two-second granularity of file modification 
timestamps.
Submitted by Ian Abbott in <3CB7355C.21011.2134FDA@localhost>.
 2002-04-12 12:21:02 -07:00
abbotti
cfd7b9a951 [svn] Use new function to test filename for common html suffixes. 
Submitted by Ian Abbott in <3CB72D29.4898.1F34872@localhost> with minor
changes to formatting and comments.
 2002-04-12 11:53:39 -07:00
hniksic
2a72eef0af [svn] Define _VA_LIST to prevent Solaris stdio.h from declaring va_list. 
Published in <sxs1ydk4vg0.fsf@florida.arsdigita.de>.
 2002-04-12 11:36:07 -07:00
abbotti
fa2fa7a100 [svn] Specify libtool mode explicitly when linking. 
Submitted by Ian Abbott in <3CB6F27B.15581.10E13BA@localhost>.
 2002-04-12 06:47:02 -07:00
hniksic
0cd669109b [svn] Implement connect timeout. 
Published in <sxs1ydld8ha.fsf@florida.arsdigita.de>.
 2002-04-11 18:14:18 -07:00
hniksic
fca8dcf829 [svn] Use stdarg only if compiling with an ANSI C compiler. 2002-04-11 12:13:57 -07:00
hniksic
c77a16309f [svn] Don't allow initial_length to exceed total_length. 
Published in <sxssn62dq99.fsf@florida.arsdigita.de>.
 2002-04-11 11:51:26 -07:00
hniksic
8f93191f26 [svn] Convert URLs in <form action=...>. 
Published in <sxsit6yf7jo.fsf@florida.arsdigita.de>.
 2002-04-11 10:51:45 -07:00
hniksic
1375a89141 [svn] Allow Wget to be compiled with a K&R compiler. 
Published in <sxszo0af9k6.fsf@florida.arsdigita.de>.
 2002-04-11 10:49:32 -07:00
hniksic
485673c3a8 [svn] Make sure directory and file names are encoded the same way. 
Published in <sxsofgqmf6e.fsf@florida.arsdigita.de>.
 2002-04-11 08:25:51 -07:00
hniksic
8c3287dabf [svn] Remove the OPTIONS_DEFINED_HERE kludge. 
Published in <sxs4rijqmhv.fsf@florida.arsdigita.de>.
 2002-04-10 14:20:55 -07:00
hniksic
1600aaeaa6 [svn] Revert to calculating ETA based on average download speed. 
Published in <sxspu17sl10.fsf@florida.arsdigita.de>.
 2002-04-10 07:10:03 -07:00
hniksic
538307f151 [svn] Keep updating a subinterval until it reaches or exceeds a watermark. 
That way the measurement will be guaranteed to span a configurable
minimum of time.  The current default is 3s in 30 100ms intervals.

Published in <sxsu1qkszdb.fsf@florida.arsdigita.de>.
 2002-04-10 02:24:28 -07:00
hniksic
c292e8e153 [svn] Print the current download speed, rather than the average. 
Published in <sxs3cy4yacm.fsf@florida.arsdigita.de>.
 2002-04-09 15:10:01 -07:00
abbotti
c3c1c24f5c [svn] Fix for Borland's broken (on Win9X) `utime' function. 
Submitted by Ian Abbott in <3CB33A8E.15259.1E52AF@localhost>.
(Based on original patch by Chin-yuan Kuo in
<20020321015049.16722.qmail@web16202.mail.tpe.yahoo.com>.)
 2002-04-09 11:29:54 -07:00
hniksic
07d72c3cd3 [svn] Propagate the result of ftp_retrieve_glob to the caller of ftp_loop. 
Published in <sxssn663zwl.fsf@florida.arsdigita.de>.
 2002-04-08 09:43:36 -07:00
abbotti
80a90d6d2c [svn] Updated several dependencies for object files. 
Submitted by Ian Abbott in <3C9F8BA4.19135.14568BF@localhost>.
 2002-03-26 10:59:44 -08:00
abbotti
9f485af560 [svn] Dependcies update for src/mswindows.c. 
Submitted by Ian Abbott in <3C98D8C6.31335.36EB6F@localhost>.
 2002-03-20 10:56:45 -08:00
abbotti
47a8225eda [svn] Don't include netdb.h on windows. 
Submitted by Ian Abbott in <3C964B8C.18942.D3115@localhost>.
 2002-03-18 12:21:58 -08:00
hniksic
1fa3b90235 [svn] Handle starting URL of recursing download being non-parsable. 
Published in <sxszo26t33k.fsf@florida.arsdigita.de>.
 2002-02-18 22:09:57 -08:00
hniksic
562ab4ae8a [svn] (DO_REALLOC_FROM_ALLOCA): Multiply with sizeof(type) when calling 
xmalloc and memcpy.
Submitted by Andreas Damm in
<Pine.LNX.4.33.0202011632280.1281-200000@gate.rad-ab.u-net.com>.
 2002-02-18 21:32:59 -08:00
hniksic
667d494978 [svn] Only include Unix-specific includes #ifndef WINDOWS. 2002-02-18 21:25:42 -08:00
hniksic
75a080ad0d [svn] Follow https links from http. 
Submitted by Christian Lackas in <20020211202444.GA20371@lackas.desy.de>.
 2002-02-18 21:23:35 -08:00
hniksic
57f36f8a6a [svn] Add the necessary includes for compilation under FreeBSD. 
Submitted by Alan Eldridge in <200202130630.g1D6U3S07907@wwweasel.geeksrus.net>.
 2002-02-18 21:21:42 -08:00
hniksic
a9ff5853a9 [svn] when -c used, mark already fully retrieved file as successfully retrieved. 
Submitted by Ian Abbott in <3C6019F4.30803.FF43E9@localhost>.
 2002-02-18 21:18:43 -08:00
hniksic
b9e90c34b4 [svn] Don't treat '?' as a query string separator when parsing FTP URLs. 
Published in <sxslmdqxdmq.fsf@florida.arsdigita.de>.
 2002-02-18 21:09:14 -08:00
hniksic
0e40fc9a3c [svn] Don't crash on <meta http-equiv=refresh>. 
Published in <sxshep1q3je.fsf@florida.arsdigita.de>.
 2002-01-31 19:34:31 -08:00
hniksic
a861f718ed [svn] Enable compilation on Windows. 
Submitted by Herold Heiko in
<B11A7CEC1675D511A3890002A551AD7C37D8AE@srvnt08.previnet.it>.
 2002-01-30 18:23:04 -08:00
hniksic
6c4c785cc2 [svn] Remove redirection cycle detection. 
Published in <sxs7kpzhcwa.fsf@florida.arsdigita.de>.
 2002-01-30 11:12:20 -08:00
hniksic
f2bb99d102 [svn] Wrap numeric IPv6 addresses in square brackets when sending out HTTP 
`Host' header.
Published in <sxs7kq4vgzf.fsf@florida.arsdigita.de>.
 2002-01-26 15:19:10 -08:00
hniksic
1bea726393 [svn] Allow all hex digits in IPv6 IP addresses. 
Published in <sxsofjgvo72.fsf@florida.arsdigita.de>.
 2002-01-26 12:43:17 -08:00
hniksic
ef1eda86c4 [svn] Allow IPv6 numeric addresses in URLs. 
Submitted in <sxsu1t9uedf.fsf@florida.arsdigita.de>.
 2002-01-26 11:00:38 -08:00
hniksic
a69cb0c3ad [svn] Various IPv6 fixes. 
Submitted in <sxsd6zz2jf7.fsf@florida.arsdigita.de>.
 2002-01-24 19:34:23 -08:00
hniksic
853a1c9e35 [svn] Fix some IPv6-related problems. 
Submitted in <sxsg04w6zl6.fsf@florida.arsdigita.de>.
 2002-01-23 22:19:35 -08:00
hniksic
cb40034035 [svn] Commit IPv6 support by Thomas Lussnig. 
Published in <sxsk7u8715e.fsf@florida.arsdigita.de>.
 2002-01-23 21:45:54 -08:00
hniksic
e59a7ee8ac [svn] Make -P work on Windows. 
Submitted by Ian Abbott in <3C447E8F.13424.16ED42@localhost>.
 2002-01-16 17:03:33 -08:00
hniksic
fb2ed23830 [svn] Skip initial whitespace before testing for EOL. 
Submitted in <sxsu1tl6bf2.fsf@florida.arsdigita.de>.
 2002-01-16 16:59:13 -08:00
hniksic
31d20e644c [svn] select the file descriptor only if no data is pending in SSL buffers. 
Submitted by tony@bluetail.com.
Published in <sxslmezocyp.fsf@florida.arsdigita.de>.
 2002-01-15 07:24:19 -08:00
hniksic
08c935bef2 [svn] Strip trailing whitespace in header_process(). 
Published in <sxsadvh0xpz.fsf@florida.arsdigita.de>.
 2002-01-14 07:17:34 -08:00
hniksic
46617228fa [svn] URL-decode user and password in URL. 
Published in <sxsita52hg6.fsf@florida.arsdigita.de>.
 2002-01-14 05:26:16 -08:00
hniksic
524a1f54dc [svn] Handle links to relative "net locations," e.g. <a href="//www.server.com/">. 2002-01-13 17:56:40 -08:00
hniksic
cafe798fec [svn] Invalidate socket if get_contents encountered an error. 
Published in <sxsita54sqy.fsf@florida.arsdigita.de>.
 2002-01-13 17:39:16 -08:00
hniksic
11745f55bf [svn] Bump version to 1.8.1. 2001-12-24 13:02:25 -08:00
hniksic
5c859be2d4 [svn] Bump version to 1.8.1-pre3. 2001-12-19 06:59:01 -08:00
hniksic
8db1264218 [svn] Enqueue start_url in the canonical form. 
Published in <sxsofkvi8zx.fsf@florida.arsdigita.de>.
 2001-12-19 06:27:29 -08:00
hniksic
001cac91a4 [svn] Check for requested verbosity in logputs. 
Published in <sxswuzjk0v6.fsf@florida.arsdigita.de>.
 2001-12-19 01:36:58 -08:00
hniksic
ca9319aaba [svn] Treat the "shortcut icon" link as inline. 
Published in <sxsadwgko2q.fsf@florida.arsdigita.de>.
 2001-12-18 17:15:34 -08:00
hniksic
2cf87bea8b [svn] Fix crash introduced by previous patch. 2001-12-18 14:20:14 -08:00
hniksic
40fd876c57 [svn] Descend into HTML files we've already downloaded. 2001-12-18 14:14:31 -08:00
hniksic
416671063a [svn] Propagate referrer information from retrieve_tree to retrieve_url. 
Submitted by Ian Abbott in <3C1F4BFE.17436.D2D7B2@localhost>.
 2001-12-18 07:22:03 -08:00
hniksic
f03f033bf3 [svn] Bump version to 1.8.1-pre2. 2001-12-17 07:24:14 -08:00
hniksic
eb0f9de05d [svn] Simplify indentation in sleep_between_retrievals. 2001-12-17 07:00:25 -08:00
hniksic
75699d6213 [svn] Use the new function `random_number' that doesn't depend on RAND_MAX 
being defined.
Published in <sxsheqqq6xb.fsf@florida.arsdigita.de>.
 2001-12-17 06:05:08 -08:00
hniksic
a3500d32d7 [svn] Move path_simplify to url.c. 2001-12-14 07:46:00 -08:00
hniksic
0f120eee66 [svn] Fix error message when $WGETRC not found. 
Published in <sxswuzrylnm.fsf@florida.arsdigita.de>.
 2001-12-13 11:19:03 -08:00
hniksic
f031900662 [svn] Don't abort when one URL references more than one file. 
Published in <sxs1yhz0w1m.fsf@florida.arsdigita.de>.
 2001-12-13 11:18:31 -08:00
hniksic
5b575eef31 [svn] Check for conn->ssl before using ssl_iwrite. 2001-12-13 08:46:56 -08:00
hniksic
6821132a4d [svn] Bump version to 1.8.1-pre1. 2001-12-12 23:40:50 -08:00
hniksic
3b44ca73ab [svn] Fix the broken URLs that pointed to info.webcrawler.com to point to 
the new www.robotstxt.org site.
 2001-12-12 23:29:05 -08:00
hniksic
3ddcea34a4 [svn] Mark <embed href=...> as external. 2001-12-12 23:18:59 -08:00
hniksic
b9f370004d [svn] Cosmetic changes to get_urls_html. 2001-12-12 11:06:10 -08:00
hniksic
d425985c37 [svn] Minor doc update. 2001-12-12 09:01:26 -08:00
hniksic
8817f4c1a4 [svn] Break up collect_tags_mapper into several functions. 
Published in <sxsg06gla1h.fsf@florida.arsdigita.de>.
 2001-12-12 07:43:01 -08:00
hniksic
1dee527a56 [svn] Use a typedef for IPv4 address. 
Published in <sxsn10qrwbj.fsf@florida.arsdigita.de>.
 2001-12-11 00:32:58 -08:00
hniksic
b8789d7798 [svn] Fix obvious memory leaks in the VMS directory parser. 
Published in <sxsadwqpbo1.fsf@florida.arsdigita.de>.
 2001-12-10 21:29:52 -08:00
hniksic
1365950c01 [svn] Logging system bugfixes and improvements. 
Published in <sxsofl7vdyo.fsf@florida.arsdigita.de>.
 2001-12-09 21:31:45 -08:00
hniksic
fb9368e889 [svn] Restore sanity check in address_list_set_faulty. 2001-12-09 18:33:08 -08:00
hniksic
943f657aa7 [svn] Rename long_to_string to number_to_string, and make it return a useful 
value.
 2001-12-09 18:29:12 -08:00
hniksic
997a87548c [svn] Minor fix for path_simplify. 
Submitted in <sxsheqzx1qv.fsf@florida.arsdigita.de>.
 2001-12-09 18:12:17 -08:00
hniksic
0e72aa6e13 [svn] Rewrite path_simplify. 
Published in <sxspu5nx2yi.fsf@florida.arsdigita.de>.
 2001-12-09 17:58:37 -08:00
hniksic
233fcbc44d [svn] Would abort when given invalid progress type. 
Published in <sxsg06kxc9g.fsf@florida.arsdigita.de>.
 2001-12-09 14:25:34 -08:00
hniksic
e521ee38ff [svn] Remove stray debugging message. 
Published in <sxszo4sxjpw.fsf@florida.arsdigita.de>.
 2001-12-09 11:44:20 -08:00
hniksic
0a89fc1a10 [svn] Fix a minor ETA padding glitch. 
Published in <sxs667hyp19.fsf@florida.arsdigita.de>.
 2001-12-08 20:51:40 -08:00
hniksic
fdd51b8d46 [svn] Bump version to 1.8. 2001-12-08 17:37:17 -08:00
hniksic
dd84231c6a [svn] Minor fixes prompted by `lint'. 
Published in <sxsadwt2nkg.fsf@florida.arsdigita.de>.
 2001-12-08 17:24:41 -08:00
hniksic
60680e27db [svn] Release 1.8-pre2. 2001-12-07 19:44:23 -08:00
hniksic
4e5bbd646b [svn] Various progress-bar related fixes. 
Published in <sxspu5slja3.fsf@florida.arsdigita.de>.
 2001-12-06 02:45:27 -08:00
hniksic
760e87d7a0 [svn] Bump version to 1.8-pre1. 2001-12-05 23:17:20 -08:00
hniksic
39b2248bde [svn] Fall back to dot progress when forced to background. 
Published in <sxs1yi8n7lx.fsf@florida.arsdigita.de>.
 2001-12-05 23:14:35 -08:00
hniksic
f8e6feb6bc [svn] Fix varargs usage in logvprintf. 
Published in <sxs667knbe1.fsf@florida.arsdigita.de>.
 2001-12-05 21:53:21 -08:00
hniksic
fcf68c0e9a [svn] --sslegdsock' -> --egd-file' 
Published in <sxsadwwnc7h.fsf@florida.arsdigita.de>.
 2001-12-05 21:35:17 -08:00
hniksic
e16c0ba78e [svn] Add information about the beta releases. 2001-12-05 17:24:24 -08:00
hniksic
f5d20aef32 [svn] Make the message printed in ssl_init_prng translatable. 2001-12-05 17:15:05 -08:00
hniksic
0620ada923 [svn] Fix OpenSSL PRNG seeding. 
Published in <sxs7ks1noc4.fsf@florida.arsdigita.de>.
 2001-12-05 17:13:31 -08:00
hniksic
b248bfe395 [svn] Don't abort in read_whole_lines when a line begins with \0. 
Published in <sxsu1v5nrtg.fsf@florida.arsdigita.de>.
 2001-12-05 15:58:12 -08:00
hniksic
8a2ab60263 [svn] Fix overzealous URL-removal in register_download. 
Published in <sxszo4yqq91.fsf@florida.arsdigita.de>.
 2001-12-04 19:51:23 -08:00
hniksic
eef4527c24 [svn] Doc fix. 2001-12-04 15:42:18 -08:00
hniksic
0fdc1bd8c0 [svn] Fix downloading of duplicate URLs. 
Published in <sxsvgfmu2bj.fsf@florida.arsdigita.de>.
 2001-12-04 13:03:35 -08:00
hniksic
abf215c1e3 [svn] snprintf.c (dopr): Use `unsigned int' as the second argument to va_arg 
when casting to `unsigned short' is intended.
Submitted by Ian Abbott in <3C0CB09F.21762.34A1F1@localhost>.
 2001-12-04 04:44:58 -08:00
hniksic
f70c9c6ede [svn] Windows update from Herold Heiko. 2001-12-04 02:33:18 -08:00
hniksic
e986f7dad3 [svn] Quote '?' as '%3F' in local files when `--html-extension' is turned on. 
Published in <sxszo4ztiwr.fsf@florida.arsdigita.de>.
 2001-12-04 01:49:37 -08:00
hniksic
79f868cd0f [svn] Cast va_arg(..., int) to short if a short value is expected. 
Published in <sxsbshgxfs5.fsf@florida.arsdigita.de>.
 2001-12-03 11:31:17 -08:00
hniksic
f58c338aea [svn] snprintf.c: Replace short int' and unsigned short int' with `int' when 
using it as the second argument to `va_arg'.
Published in <sxsu1v8xisg.fsf@florida.arsdigita.de>.
 2001-12-03 10:28:08 -08:00
hniksic
29a338cc58 [svn] Use address_list_new_one. 
Published in <sxsbshgyz71.fsf@florida.arsdigita.de>.
 2001-12-03 09:48:12 -08:00
hniksic
400201444f [svn] Don't initialize TMPSTORE directly. 
Submitted by Andre Majorel.
 2001-12-03 09:31:23 -08:00
hniksic
6d93a95e37 [svn] Declare h_errno in host.c, but not elsewhere. 2001-12-03 09:22:06 -08:00
hniksic
f5799945b0 [svn] file_merge: if BASE doesn't contain a slash, just return a copy of FILE. 
Published in <sxssnatmh6s.fsf@florida.arsdigita.de>.
 2001-12-02 13:44:16 -08:00
hniksic
acf2d79a8a [svn] When PWD fails, assume "/". 
Published in <sxs667qr5a0.fsf@florida.arsdigita.de>.
 2001-12-01 13:37:40 -08:00
hniksic
8b2a216c77 [svn] Make --base -i work. 
Published in <sxsoflisqcf.fsf@florida.arsdigita.de>.
 2001-12-01 11:17:19 -08:00
hniksic
07e6be3527 [svn] Don't document `-nh' in --help output. 
Published in <sxs4rnau642.fsf@florida.arsdigita.de>.
 2001-12-01 10:51:32 -08:00
hniksic
569fd61c95 [svn] Use the full path when building the authorization line. 
Published in <sxsitbqu9iw.fsf@florida.arsdigita.de>.
 2001-12-01 09:39:07 -08:00
hniksic
3ff0a9ad00 [svn] Minor tweak in path_matches in cookies.c. 2001-12-01 07:34:55 -08:00
hniksic
57dd93f915 [svn] Don't expect HTTP paths to begin with '/'. 
Published in <sxsvgfrv7ky.fsf@florida.arsdigita.de>.
 2001-11-30 21:22:17 -08:00
hniksic
92b269acad [svn] Match hosts against domains per Netscape cookie "specification". 
Published in <sxszo53v8by.fsf@florida.arsdigita.de>.
 2001-11-30 21:08:03 -08:00
hniksic
f4d019a423 [svn] Correctly convert links in <meta http-equiv=Refresh content="...">. 
Published in <sxsadx3wp49.fsf@florida.arsdigita.de>.
 2001-11-30 20:18:51 -08:00
hniksic
7ab7f93f8d [svn] Make -p work with framed pages. 
Published in <sxsu1vby71t.fsf@florida.arsdigita.de>.
 2001-11-30 19:06:41 -08:00
hniksic
406fb8bbef [svn] Don't allow more than 20 successive redirections. 2001-11-30 13:33:31 -08:00
hniksic
a4db28e20f [svn] Ignore -np when in -p mode. 
Published in <sxsg06w2c52.fsf@florida.arsdigita.de>.
 2001-11-30 13:17:53 -08:00
hniksic
5baed885db [svn] Fix netrc authorization in conjunction with HTTP. 
Submitted by Daniel BODEA in <011901c162ca$19779df0$25c0a8c0@GHOTIX>.
 2001-11-30 01:33:22 -08:00
hniksic
2c37aef2d8 [svn] Don't forget to shutdown the SSL structure if the socket times out. 
Submitted by T. Bharath in <3B3DEBC7.2537186A@responsenetworks.com>.
 2001-11-30 00:57:03 -08:00
hniksic
7674ecd97e [svn] Simplify display_image. 2001-11-30 00:02:33 -08:00
hniksic
ae3c268719 [svn] Implement EGD support. 
Submitted by Christian Fraenkel in <005501c17920$1312d440$4a05a8c0@isn>.
 2001-11-29 23:39:08 -08:00
hniksic
999388bfa0 [svn] Check for memmove and implement one if it's missing. 2001-11-29 11:43:29 -08:00
hniksic
b6bbc32e14 [svn] Guard against header files getting included twice. 2001-11-29 10:55:52 -08:00
hniksic
b65661a879 [svn] Remove char/unsigned char warnings emitted by Sun cc. 2001-11-29 10:48:43 -08:00
hniksic
fb98d1e4b0 [svn] Remove implicit declaration warnings. 2001-11-29 10:22:18 -08:00
hniksic
39482df431 [svn] descend_url_p: When resolving no_parent, compare with the start url, 
not the parent url.
Published in <sxspu614ikm.fsf@florida.arsdigita.de>.
 2001-11-29 09:04:28 -08:00
hniksic
9c1c7f27cd [svn] Windows fixes by Herold Heiko. 2001-11-29 06:15:11 -08:00
hniksic
bb8e524316 [svn] Initialize al->faulty. 
Published in <sxsvgft65an.fsf@florida.arsdigita.de>.
 2001-11-29 06:06:03 -08:00
hniksic
6218fbed2b [svn] Accept the broken Content-Range format emitted by Sun's server. 
Published in <sxsg06x7kld.fsf@florida.arsdigita.de>.
 2001-11-29 06:03:33 -08:00
hniksic
fb7fb36cb8 [svn] Resurrect opt.dot_style. 2001-11-27 18:44:18 -08:00
hniksic
d4c6949a05 [svn] Use rand instead of random. 
Published in <sxsu1vgataq.fsf@florida.arsdigita.de>.
 2001-11-27 11:49:28 -08:00
hniksic
9b202ba261 [svn] * retr.c (retrieve_from_file): Initialize `new_file' to NULL to 
prevent seg fault.
Submitted by Ian Abbott in <3C03DE8A.845.D0E495@localhost>.
 2001-11-27 11:14:34 -08:00
hniksic
8196a09904 [svn] Don't reuse IP addresses proven to be faulty, unless only such ones remain. 
Published in <sxs8zcsfemf.fsf@florida.arsdigita.de>.
 2001-11-27 06:55:40 -08:00
hniksic
cca7541b10 [svn] Don't translate %d-%d. 2001-11-27 04:58:09 -08:00
hniksic
1c906e47d3 [svn] Remove stray HAVE_RANDOM check from main.c. 2001-11-27 04:54:31 -08:00
hniksic
9656223552 [svn] Fix FTP PASV output. 
Published in <sxslmgsfkgj.fsf@florida.arsdigita.de>.
 2001-11-27 04:49:13 -08:00
hniksic
baf8750197 [svn] Default the progress implementation to "bar". 
Published in <sxsu1vgfqx7.fsf@florida.arsdigita.de>.
 2001-11-27 02:29:45 -08:00
hniksic
69c78db55b [svn] Commence bar progress with two newlines. 2001-11-27 02:17:09 -08:00
hniksic
7175ea4a12 [svn] Check for random. 
Published in <sxs4rngh6t2.fsf@florida.arsdigita.de>.
 2001-11-27 02:11:13 -08:00
hniksic
bae3162c03 [svn] New option `--limit-rate'. 
Published in <sxsd725cn56.fsf@florida.arsdigita.de>.
 2001-11-26 12:07:13 -08:00
hniksic
278fb2412d [svn] Declare ERR in gethttp. 
Submitted by Ian Abbott in <3C022295.15135.464B54@localhost>.
 2001-11-26 04:51:25 -08:00
hniksic
84396de673 [svn] Allocate a timer directly in get_contents. 
Published in <sxsherhbsvl.fsf@florida.arsdigita.de>.
 2001-11-26 04:49:10 -08:00
hniksic
024cb5ed3a [svn] A lot of host name changes. 
Published in <sxs3d32856s.fsf@florida.arsdigita.de>.
 2001-11-25 21:36:33 -08:00
hniksic
f6921edc73 [svn] Be careful whether we want to descend into results of redirection. 
Published in <sxs7kse8hmq.fsf@florida.arsdigita.de>.
 2001-11-25 17:11:48 -08:00
hniksic
2c41d783c6 [svn] New option --random-wait. 
Submitted by Alan Eldridge in
<200111042106.fA4L63b75804@wwweasel.geeksrus.net>.
 2001-11-25 13:23:15 -08:00
hniksic
3afb9c659a [svn] Recursion and progress bar tweaks. 
Published in <sxsd727cvc0.fsf@florida.arsdigita.de>.
 2001-11-25 13:03:30 -08:00
hniksic
df05e7ff10 [svn] Handle <base href=...> when converting links. 
Published in <sxsadxaae3t.fsf@florida.arsdigita.de>.
 2001-11-25 10:40:55 -08:00
hniksic
2e6e3f21f8 [svn] Attempt to quote '?' as "%3F" when linking to local files. 
Given up on the attempt, as it breaks local browsing.
 2001-11-25 09:44:28 -08:00
hniksic
95631700f7 [svn] Remove host canonicalization code. 
Published in <sxsg072ai5v.fsf@florida.arsdigita.de>.
 2001-11-25 09:13:20 -08:00
hniksic
05463c7121 [svn] Commit progress bar tweaks. 
Published in <sxsd727cvc0.fsf@florida.arsdigita.de>.
 2001-11-24 20:46:26 -08:00
hniksic
222e9465b7 [svn] Implemented breadth-first retrieval. 
Published in <sxsherjczw2.fsf@florida.arsdigita.de>.
 2001-11-24 19:10:34 -08:00
hniksic
b88223f99d [svn] Don't modify bp->total_length if it equals zero. 2001-11-24 10:05:57 -08:00
hniksic
177b6ee8fd [svn] Print the actual error message when parsing of redirection URL fails. 2001-11-24 06:02:10 -08:00
hniksic
212eb1ddaf [svn] Fake a miniscule amount of download time when none is detected. 2001-11-23 18:38:47 -08:00
hniksic
1da2947d50 [svn] Fix typo that made us never use robots.txt. 2001-11-23 17:48:28 -08:00
hniksic
87ed8be305 [svn] Don't translate "%ld ". 2001-11-23 12:20:40 -08:00
hniksic
4f91014e3f [svn] Allow the user to force bar progress. 
Published in <sxs8zcxh2x5.fsf@florida.arsdigita.de>.
 2001-11-23 08:24:06 -08:00
hniksic
49b93249b1 [svn] Seed OpenSSL's RNG. 
Submitted by Lemble Gregory.
 2001-11-23 08:18:41 -08:00
hniksic
905472770e [svn] Minor progress bar fixes. 
Published in <sxsn11dh3fc.fsf@florida.arsdigita.de>.
 2001-11-23 08:12:53 -08:00
hniksic
eb9a02b828 [svn] Minor fix for the new progress bar. 2001-11-22 21:09:39 -08:00
hniksic
cdcf67a5bd [svn] Big progress bar update. 
Published in <sxsn11ehyn1.fsf@florida.arsdigita.de>.
 2001-11-22 20:59:52 -08:00
hniksic
4d352013ac [svn] Replace opt.no_flush with a function to disable/enable flushing. 
Published in <sxssnb6imyz.fsf@florida.arsdigita.de>.
 2001-11-22 12:13:13 -08:00
hniksic
d5be8ecca4 [svn] Rewrite parsing and handling of URLs. 
Published in <sxs4rnnlklo.fsf@florida.arsdigita.de>.
 2001-11-21 16:24:28 -08:00
hniksic
f4dcb55851 [svn] Split the copyright notice for easier translation. 2001-11-21 15:15:19 -08:00
hniksic
0296433553 [svn] Support the SIZE command. 
Originally by Dave Turner.  Modified by Ian Abbott and published
in <3BFAA33C.6236.6D42F6@localhost>.
 2001-11-20 13:01:27 -08:00
hniksic
a24b3d50f0 [svn] Don't use the now-obsolete TYPE variable. 
Published in <sxswv0ledyx.fsf@florida.arsdigita.de>.
 2001-11-20 08:03:41 -08:00
hniksic
94c5b23136 [svn] Handle shorthands in proxy URLs. 
Published in <sxs6686py1q.fsf@florida.arsdigita.de>.
 2001-11-19 08:15:42 -08:00
hniksic
de7f766f58 [svn] Remove --wait/--waitretry compatibility code. 
Published in <sxs6686py1q.fsf@florida.arsdigita.de>.
 2001-11-19 07:42:56 -08:00
hniksic
e8e8797873 [svn] Rewrite shorthand URLs in a step separate from parsing. 
Published in <sxspu6f7ecz.fsf@florida.arsdigita.de>.
 2001-11-18 17:14:14 -08:00
hniksic
f178e6c613 [svn] Clean up handling of schemes. 
Published in <sxswv0n7h7s.fsf@florida.arsdigita.de>.
 2001-11-18 16:12:05 -08:00
hniksic
303f406997 [svn] Don't list all the "known" (but unsupported) protocols. Instead, just 
skip the characters until the first ':'.
Published in <sxsitc8a848.fsf@florida.arsdigita.de>.
 2001-11-17 22:49:09 -08:00
hniksic
ee99e8998a [svn] Don't compile getopt.c on systems that already have getopt_long. 
Published in <sxshersbs0w.fsf@florida.arsdigita.de>.
 2001-11-17 20:52:18 -08:00
hniksic
d408dec0bd [svn] Use Solaris's libmd5 when available. 
Published in <sxsn11kbssm.fsf@florida.arsdigita.de>.
 2001-11-17 20:36:21 -08:00
hniksic
09b0fe29a8 [svn] Initialize vars to appease the compiler. 
Published in <sxszo5kbxs3.fsf@florida.arsdigita.de>.
 2001-11-17 20:14:12 -08:00
hniksic
6ef5baa07b [svn] Prettier printing of HTTP headers. 
Published in <sxs4rnsdcw1.fsf@florida.arsdigita.de>.
 2001-11-17 18:36:30 -08:00
hniksic
05f90bb302 [svn] Plug in new implementation of RES. 
Published in <sxselmwddt0.fsf@florida.arsdigita.de>.
 2001-11-17 18:17:30 -08:00
hniksic
12c8ef1796 [svn] *** empty log message *** 2001-11-17 17:34:25 -08:00
hniksic
1a96dcfcb8 [svn] Ignore trailing whitespace in header_extract_number. 
Published in <sxsheruo5gn.fsf@florida.arsdigita.de>.
 2001-11-16 11:57:43 -08:00
hniksic
3d9dda6485 [svn] Process attributes in order in which they appear in the tag. 
Submitted by Ian Abbott in <3B868388.6538.14A7848@localhost>
based on analysis by Edward Sabol.
 2001-11-16 11:44:42 -08:00
hniksic
fa6aeb869d [svn] Don't call rate() with bogus data. 
Submitted by Ian Abbott in <3B7A98A1.24985.9EF692@localhost>
 2001-11-16 11:38:03 -08:00
hniksic
90cdb82942 [svn] Use 0x22 instead of '"' or '\"'. 2001-11-16 09:26:42 -08:00
hniksic
ac74e16638 [svn] Applied Christian Fraenkel's patch from <3BAF5B30.189077D6@gmx.net>. 
Print SSL errors when connecting fails.
 2001-11-16 09:06:25 -08:00
hniksic
d60b54cba0 [svn] Applied Chris Seawood's patch for compilation under BEOS. 
Patch published in <3B5D4CEF.5090208@seawood.org>.
 2001-11-16 08:58:08 -08:00
hniksic
0c42479322 [svn] Applied Edward Sabol's patch from 
<200106131813.f5DIDss1294858@alderaan.gsfc.nasa.gov>.
It fixes a memory leak in url_equal, and comments it out,
as it's unused.
 2001-11-16 08:49:19 -08:00
hniksic
0ce7b6bffc [svn] Support XML-style empty tags. 2001-11-16 08:44:34 -08:00
hniksic
b4e6054de9 [svn] Check for do_realloc_newsize in loop condition because we're no longer 
setting SIZEVAR here.
 2001-06-26 02:48:51 -07:00
hniksic
d015d3cbd3 [svn] Fix access violation bug in DO_REALLOC_FROM_ALLOCA. 
Published in <sxspubriqay.fsf@florida.arsdigita.de>.
 2001-06-26 01:45:09 -07:00
hniksic
e98fca84a3 [svn] Allow more characters in attribute name. 
Published in <sxsr8wi9jeo.fsf@florida.arsdigita.de>.
 2001-06-18 11:49:33 -07:00
hniksic
e1f4cff68c [svn] Make sure that slashes don't sneak in as part of file name via 
query string.
Published in <sxsu21eb3te.fsf@florida.arsdigita.de>.
 2001-06-18 02:08:04 -07:00
hniksic
2255a89b24 [svn] After canonicalizing the URL, check for its existence among undesirable_urls. 
Published in <sxs7kyeohte.fsf@florida.arsdigita.de>.
 2001-06-14 14:48:00 -07:00
hniksic
c77d880776 [svn] Search netrc with the proper host name, not the proxy one. 2001-06-14 13:55:02 -07:00
hniksic
8f6b4f5bbb [svn] Define MAP_FAILED if it's missing. 
Published in <sxshexirelo.fsf@florida.arsdigita.de>.
 2001-06-14 13:28:19 -07:00
janp
46550636fe [svn] Provide correct prototype for ftp_parse_ls(). Pointed out by Bernhard Simon 
<bs@bsws.zid.tuwien.ac.at> in <200106071409.QAA08208@bsws.zid.tuwien.ac.at>.
 2001-06-09 10:44:07 -07:00
hniksic
6b9ac2db84 [svn] Increase version to 1.7. 2001-06-04 03:45:20 -07:00
hniksic
e6742c2313 [svn] ftp-ls.c typo fix by Karl Eichwalder. 2001-06-03 06:26:41 -07:00
hniksic
0b056d1720 [svn] Update copyright notices. 2001-05-27 12:35:15 -07:00
hniksic
b94a5c0e37 [svn] Released 1.7-pre1. 2001-05-26 03:01:45 -07:00
hniksic
6b405f2b66 [svn] Commit administrative changes in preparation for the 1.7 
prerelease.
Published in <sxsd78wwiwj.fsf@florida.arsdigita.de>.
 2001-05-26 02:38:24 -07:00
hniksic
2f298afc47 [svn] Don't include <sys/time.h> here. 
Published in <sxsae4gvtnb.fsf@florida.arsdigita.de>.
 2001-05-14 08:27:56 -07:00
hniksic
36eba40905 [svn] Make sure cookie code works with the real URL data, not the proxy one. 
Published in <sxsg0e8z3bp.fsf@florida.arsdigita.de>.
 2001-05-14 02:32:11 -07:00
hniksic
72eca0976b [svn] Commit several minor changes: 
* main.c (print_help): Document `--no-http-keep-alive'.

* utils.c (numdigit): Handle negative numbers *correctly*.

* hash.c (make_nocase_string_hash_table): Use term "nocase" rather
than the confusing "unsigned".

* utils.c (string_set_contains): Renamed from string_set_exists.

* hash.c (hash_table_contains): Renamed from hash_table_exists.

* cookies.c: Move case-insensitive hash tables to hash.c.

Published in <sxsheyq9vvl.fsf@florida.arsdigita.de>.
 2001-05-12 13:06:41 -07:00
hniksic
9588e1af80 [svn] Before concluding that the file is already fully retrieved, make sure 
that the file existed and `Range' was actually requested.

Published in <sxseltwf4ks.fsf@florida.arsdigita.de>.
 2001-05-11 05:37:37 -07:00
hniksic
43ef870bd3 [svn] Minor cookie fixes. Published in <sxsheyu9yp6.fsf@florida.arsdigita.de>. 2001-05-09 11:15:22 -07:00
hniksic
105627124e [svn] Make sure hstat.no_truncate gets properly initialized. 
Published in <sxspudk6pdl.fsf@florida.arsdigita.de>.
 2001-05-08 04:47:05 -07:00
hniksic
50980de841 [svn] Avoid useless file_exists_p. Published in 
<sxsr8y17zav.fsf@florida.arsdigita.de>.
 2001-05-07 12:08:29 -07:00
janp
5ff5e936a5 [svn] Correct the conversion of month entries for NT and VMS. 2001-05-02 03:15:17 -07:00
hniksic
72b9bb6d92 [svn] Zero out SIN before using it. 
Published in <sxs3daq8zdg.fsf@florida.arsdigita.de>.
 2001-04-30 03:19:41 -07:00
hniksic
3973f20a45 [svn] Refuse to download files from scratch if `-c' is used and the server 
doesn't support REST only for existing *and non-empty* files.
Published in <sxsae4zg4zc.fsf@florida.arsdigita.de>.
 2001-04-29 07:24:45 -07:00
hniksic
00773e7d15 [svn] Make `--cookies' respect its arg. 
Published in <sxs4rv8ht5e.fsf@florida.arsdigita.de>.
 2001-04-29 03:56:43 -07:00
hniksic
dfc1eb5766 [svn] Change default anonymous FTP password to "-wget@". 
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
 2001-04-29 03:53:55 -07:00
hniksic
b44f1701b0 [svn] Use alloca to allocate filename_plus_orig_suffix. 
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
 2001-04-28 09:36:46 -07:00
hniksic
d70101ea4e [svn] Commit various HTTP fixes. 
Published in <sxsy9slhu7g.fsf@florida.arsdigita.de>.

* http.c (gethttp): Return RETRUNNEEDED when the retrieval is
unneeded because the file is already there and fully downloaded,
and -c is specified.
(http_loop): Handle RETRUNNEEDED.

* wget.h (uerr_t): New value RETRUNNEEDED.

* http.c (http_loop): Set no_truncate for files that both exist
and are non-empty.
(gethttp): Consider the download finished when restval >= contlen,
not only when restval==contlen.
(gethttp): Handle redirection before giving up due to -c.
(gethttp): Clarify error message which explains that -c will not
truncate the file.
(gethttp): When returning CONTNOTSUPPORTED, don't forget to free
the stuff that needs freeing and release the socket.

* main.c (print_help): Wget booleans accept "off", not "no".
 2001-04-28 09:22:20 -07:00
hniksic
c6e565fd33 [svn] Send the no-cache directive when required regardless of whether we're 
going through a proxy.
Published in <sxsitjqncbx.fsf@florida.arsdigita.de>.
 2001-04-26 22:26:44 -07:00
hniksic
26ddb28a7c [svn] Improve documentation of mktime_from_utc. 
Rearrange http_atotm.
Published in <sxsoftjlyku.fsf@florida.arsdigita.de>.
 2001-04-26 22:11:38 -07:00
hniksic
07abfad1c2 [svn] Punish the *use* of ctype macros, rather than their mere presence. 
Published in <sxssnivlyut.fsf@florida.arsdigita.de>.
 2001-04-26 22:03:08 -07:00
hniksic
ae621c6770 [svn] Treat empty proxy environment vars as unset. 
Published in <sxssniwq8d6.fsf@florida.arsdigita.de>.
 2001-04-26 03:11:49 -07:00
hniksic
f0eb1fb758 [svn] Fix loading of cookies. 
Published in <sxslmopyao6.fsf@florida.arsdigita.de>.
 2001-04-24 19:29:54 -07:00
hniksic
425b5af0c9 [svn] Cosmetic change in DIGITS_* macros. 2001-04-24 18:55:13 -07:00
hniksic
9ae0328c3d [svn] Applied Roger Beeman's mktime_from_utc fix published in 
<Pine.HPX.4.02.10104181128180.6232-100000@mail1.cisco.com>.
Also, minor doc fixes.
 2001-04-24 17:50:22 -07:00
hniksic
d80f6cbe8c [svn] Reimplemented UNSAFE_CHAR and RESERVED_CHAR. 
Fixed snprintf.c to avoid ISDIGIT.
 2001-04-24 17:20:30 -07:00
hniksic
45eea7387f [svn] New timer functions. Published in <sxs8zkp28vk.fsf@florida.arsdigita.de>. 2001-04-24 16:09:45 -07:00
hniksic
5674776cad [svn] Rewritten long_to_string. The new version favors smaller numbers; 
much of the work is now done at compile-time.
Published in <sxsvgnv6oii.fsf@florida.arsdigita.de>.
 2001-04-23 19:06:34 -07:00
hniksic
6ba7711d6a [svn] Print download rate even when percentages are not available. 
Published in <sxs1yqjd4ct.fsf@florida.arsdigita.de>.
 2001-04-23 08:28:34 -07:00
hniksic
38120f75ef [svn] Write percentages when the length is authoritative. 
Published in <sxselujd8py.fsf@florida.arsdigita.de>.
 2001-04-23 06:53:29 -07:00
hniksic
ac7c8c1390 [svn] Improve performance of grow_hash_table. 
Published in <sxs66g8nd4c.fsf@florida.arsdigita.de>.
 2001-04-14 00:41:29 -07:00
hniksic
61bb00adc0 [svn] Various url.c-related changes. 
Published in <sxsvgo8nmub.fsf@florida.arsdigita.de>.

* retr.c (retrieve_url): Call uri_merge, not url_concat.
* html-url.c (collect_tags_mapper): Call uri_merge, not
url_concat.
* url.c (mkstruct): Use encode_string instead of xstrdup followed
by URL_CLEANSE.
(path_simplify_with_kludge): Deleted.
(contains_unsafe): Deleted.
(construct): Renamed to uri_merge_1.
(url_concat): Renamed to uri_merge.
* url.c (str_url): Use encode_string instead of the unnecessary
CLEANDUP.
(encode_string_maybe): New function, returns input string if no
encoding is needed.
(encode_string): Call encode_string_maybe to do the dirty work,
xstrdup if no work needed.
* wget.h (XDIGIT_TO_xchar): Define here.
* url.c (decode_string): Use new name.
(encode_string): Ditto.
* http.c (XDIGIT_TO_xchar): Rename HEXD2asc to XDIGIT_TO_xchar.
(dump_hash): Use new name.
* wget.h: Rename ASC2HEXD and HEXD2ASC to XCHAR_TO_XDIGIT and
XDIGIT_TO_XCHAR respectively.
 2001-04-13 21:11:35 -07:00
hniksic
8a0e9e765e [svn] Minor -Wall-induced fixes. Also, skip_url is removed. 
Published in <sxs8zl5v5cw.fsf@florida.arsdigita.de>.
 2001-04-12 20:39:23 -07:00
hniksic
eae28f142d [svn] Commit various hash table changes: 
* hash.c (hash_table_map): Allow deletion and change of the
element processed by MAPFUN.
(string_hash): Use the function from glib.
* hash.c (hash_table_remove): Rewrite to actually clear deleted
entries instead of just marking them as deleted.

Published in <sxsu23tvdur.fsf@florida.arsdigita.de>.
 2001-04-12 17:34:24 -07:00
hniksic
452c0bb9f7 [svn] Declare hash_table_get_pair and hash_table_count. 2001-04-12 12:45:18 -07:00
hniksic
cd1423a478 [svn] Declare http_atotm(). 2001-04-12 12:43:12 -07:00
hniksic
b4b33b5afc [svn] Use octal constants. 
Published in <sxsr8yy1dk6.fsf@florida.arsdigita.de>.
 2001-04-12 05:58:02 -07:00
hniksic
83fe8f3597 [svn] "Support DESTDIR when installing. 
Patch courtesy Karl Eichwalder.
Published in <sxs4rvu2tmu.fsf@florida.arsdigita.de>.
 2001-04-12 05:25:22 -07:00
hniksic
a98337f827 [svn] Make seconds optional in VMS time specification. 
Published in <sxs8zl62u9p.fsf@florida.arsdigita.de>.
 2001-04-12 05:22:50 -07:00
hniksic
963863113f [svn] Fix retrieval of directories when initial CWD is not `/'. 
Published in <sxsitkc709p.fsf@florida.arsdigita.de>.

* url.c (parseurl): Don't strip trailing slash when u->dir is "/"
because that strips the *leading* slash, thus forcing relative
FTP retrieval.
* ftp.c (getftp): Convert initial FTP directory from VMS to UNIX
notation for VMS servers.
(ftp_retrieve_dirs): Do not prepend '/' to f->name when
odir is an empty string.
 2001-04-10 17:24:59 -07:00
janp
90a26b7987 [svn] Make the AM/PM fix more efficient. 2001-04-10 10:09:42 -07:00
hniksic
5fa53b5a1d [svn] Implement better sorting and matching of cookies. 
Fix previously broken command-line options.
Published in <sxspuek9255.fsf@florida.arsdigita.de>.
 2001-04-10 09:04:18 -07:00
hniksic
579d051d57 [svn] Rewrite SSL #ifdef for better indentation. 2001-04-09 07:58:55 -07:00
hniksic
0c70c624f9 [svn] Fix recursive FTP retrieval so that 
`wget -r ftp://<username>:<password>@host/%2Fhome/hniksic/dir/'
works.
Published in <sxsk84ug8gt.fsf@florida.arsdigita.de>.
 2001-04-08 18:38:27 -07:00
hniksic
665a84b4a2 [svn] Implement tilde-expansion in file name arguments of 
`.wgetrc' commands.
Published in <sxsy9tbeyh3.fsf@florida.arsdigita.de>.
 2001-04-08 16:59:14 -07:00
hniksic
2cfb2d2ef6 [svn] Added support for cookies. 2001-04-08 15:25:24 -07:00
janp
7827420378 [svn] ftp-ls.c (ftp_parse_winnt_ls): The AM/PM change did assume 12:01PM == 
00:01, which was obviously wrong.
 2001-04-08 07:38:12 -07:00
janp
55587bdee2 [svn] ChangeLog: Removed an excess conflict marker. Reformatted the entry by 
Philipp Thomas from 2001-03-09.

ftp-ls.c (ftp_parse_winnt_ls): Ensure that adjusted PM hours lay
between 0 and 23. Elminate unused variable `sec'.
 2001-04-08 02:30:14 -07:00
hniksic
26547d3987 [svn] New function hash_table_count. 
Published in <sxsu2403zzw.fsf@florida.arsdigita.de>.
 2001-04-07 19:09:04 -07:00
hniksic
b5788b5eb7 [svn] Do the namespace tweaks only on systems we know about. 2001-04-05 21:44:04 -07:00
hniksic
3ecad253f2 [svn] Include string.h. 2001-04-05 20:43:35 -07:00
hniksic
4bc1d37ccf [svn] Specify "compilation environment" that works for Linux 
and Solaris.
Published in <sxs8zlezpsu.fsf@florida.arsdigita.de>.
 2001-04-05 20:41:59 -07:00
hniksic
31ea5aae27 [svn] Prepend literal newline with `\n\' inside quoted string. 2001-04-05 20:06:00 -07:00
hniksic
3c6093cf13 [svn] Remove VERY_LONG_FORMAT. Instead, define function very_long_to_string 
for printing VERY_LONG_TYPE numbers.
Published in <sxsd7aqzqr7.fsf@florida.arsdigita.de>.
 2001-04-05 19:51:41 -07:00
hniksic
c51015565a [svn] parse_uname() Would run past the end of the string if the 
username was present, but the URL did not contain a slash, e.g.
http://foo:bar@myhost.
Reported by Christian Fraenkel.
 2001-04-04 07:00:34 -07:00
hniksic
1d51748034 [svn] Fix support for rfc850 time recognition on systems where strptime 
format specs %a and %A are not the same.
Published in <49022.983849922@ideon.st.ryukoku.ac.jp>.
 2001-04-03 11:54:32 -07:00
hniksic
a3eea37c91 [svn] Small cleanup of mswindows.c by Paul Bludov. 
Published in <wget-patches@sunsite.auc.dk>.
 2001-04-03 11:22:04 -07:00
hniksic
d62d112aed [svn] Remove stray conflict marker. 2001-04-03 09:19:23 -07:00
hniksic
f1d534cd8c [svn] Make -c' and -O' work together. 
Published in <sxsitkmgokh.fsf@florida.arsdigita.de>.
 2001-04-03 05:24:49 -07:00
hniksic
1810f7a442 [svn] Handle trailing whitespace in .netrc. Published in 
<sxsitkofbfw.fsf@florida.arsdigita.de>.
 2001-04-01 16:28:25 -07:00
hniksic
cee04f2ef3 [svn] Fix memory allocation in cmd_address(). 
Published in <sxs66gogt0k.fsf@florida.arsdigita.de> under
the subject "Fix for opt.bind_address".
 2001-04-01 15:23:52 -07:00
hniksic
20a4341e1a [svn] Wget was ignoring an error when getting a directory failed. 
Fix courtesy Nicolas Lichtmaier.
 2001-04-01 14:34:40 -07:00
hniksic
4dbad3a894 [svn] Make sure -C is recognized. 2001-04-01 14:26:28 -07:00
hniksic
a52aaeb451 [svn] Make sure -c doesn't truncate the file. 
Published in <sxsofuhi4kc.fsf@florida.arsdigita.de>.
 2001-04-01 13:04:21 -07:00
hniksic
aa888ba8da [svn] Don't clear dl_file_url_map and dl_url_file_map in recursive_retrieve. 
Published in <sxsk856le2y.fsf@florida.arsdigita.de> under the subject
"Link conversion fix".
 2001-03-31 18:41:26 -08:00
hniksic
8c4cd805e2 [svn] Oops! Fix braino in recur.c -- clear the hash tables only when 
they are defined.
 2001-03-30 18:21:20 -08:00
hniksic
8f048b7be8 [svn] Committed my patch that makes HTTP code close its socket in premature 
returns (before the body was drained).  Published in
<sxsd7ayn0kt.fsf@florida.arsdigita.de>.
 2001-03-30 18:20:16 -08:00
hniksic
728584d072 [svn] Record downloaded files and downloaded HTML files in all cases. 
Published under the subject "Link conversion fix" in
<sxsn1a2n2zd.fsf@florida.arsdigita.de>.
 2001-03-30 18:05:54 -08:00
hniksic
e4d49f0b40 [svn] Published my patch "main.c tweaks" published in 
<sxspueyonjt.fsf@florida.arsdigita.de>.
 2001-03-30 15:17:59 -08:00
hniksic
1a6058b1ec [svn] Applied Philipp Thomas's safe-ctype patch. Published in 
<20010330025159.U21662@jeffreys.suse.de>.
 2001-03-30 14:36:59 -08:00
dan
f486b43c23 [svn] * {.,doc,src,util,windows}/Makefile.in: Moved top_builddir out of "User 
configuration section" of top Makefile and analogous spot in others.

* po/Makefile.in.in: Previous addition of top_builddir to
  po/Makefile.in was bogus -- it's generated from po/Makefile.in.in.
 2001-03-27 03:23:59 -08:00
dan
d41af5f52e [svn] Linking with OpenSSL previously required the user to set up all the 
appropriate -I, -L, and -R/-rpath flags in environment variables,
manually.  Automated everything, including bundling libtool so we can
successfully link with the OpenSSL shared libraries on just about any
platform.
 2001-03-17 06:21:19 -08:00
janp
5014d32c3a [svn] Skip `:port' in the host header if it is the DEFAULT_HTTPS_PORT when 
using SSL. Patch submitted by Hack Kampbjorn <hack@hackdata.com>.
 2001-03-08 15:11:03 -08:00
hniksic
71a53ffe25 [svn] Applied Jonas Jensen's patch to correctly calculate the number of bytes 
in the first line of the download that.
Published in <sxsu25hioxj.fsf@florida.arsdigita.de>.
 2001-03-01 14:25:20 -08:00
dan
b6febbc84b [svn] * po/*.po*: Updated after moving -nr to a different category. 
* wget.texi: Moved -nr from "Recursive Retrieval Options" to "FTP Options" and
  gave it a @cindex entry. Alphabetized FTP options by long option name.

* main.c (print_help): -nr belongs in "FTP options" section of --help output,
  not "Recursive retrieval" section.  Alphabetized FTP options by long option
  name.
 2001-02-23 13:31:54 -08:00
dan
2aa1d53fb2 [svn] * main.c (print_help): --help documentation for -N said it would re-download 
files if they had the _same_ timestamp on server.

* po/*.po*: Updated after changing --help's description of -N.
 2001-02-23 12:43:35 -08:00
dan
4fc318600e [svn] init.c (commands): Hack Kampbj?rn <hack@hackdata.com> discovered that 
"httpsproxy" had been inserted into commands[] out of alphabetical order,
causing "BUG: unknown command `httpuser'".
 2001-02-16 21:26:34 -08:00
janp
b3bb9b7ed9 [svn] Changes in FTP listing parser code - suport for VMS and MacOS, removed 
dependency on ftpparse as the copyright issue has not been resolved.
 2001-02-12 23:50:27 -08:00
hniksic
164ccc9e41 [svn] ChangeLog tweak; initialize con to appease the access checker. 2001-02-11 09:27:37 -08:00
hniksic
54811e2832 [svn] Applied Jan's patch to allow non-quoted @ character in 
passwords.  Published in <20010106173455.A9455@erwin.telekabel.at>.
 2001-02-10 16:28:22 -08:00
hniksic
b370dd1914 [svn] Applied Hack Kampbjorn's patch to print FTP type in debug output. 
Published in <3A7D94B5.D9B932FB@hackdata.com>.
 2001-02-10 16:06:59 -08:00
hniksic
366b832e3f [svn] Applied Jonas Jensen's download rate patch with my additions. 
Published in <015b01c09084$ce2d9330$0100000a@bob> and
<sxspugq3xai.fsf@florida.arsdigita.de>.
 2001-02-10 16:00:30 -08:00
hniksic
fdc20de365 [svn] Applied Tim Mooney's patch that fixes a build problem under Tru64. 
Published in
<Pine.OSF.4.33.0102072244450.2714-100000@dogbert.cc.ndsu.NoDak.edu>.
 2001-02-10 14:37:12 -08:00
hniksic
07f60f19a4 [svn] Applied Christian Fraenkel's patch "custom certificate patch for wget-1.7+dev; 
2nd try", published in <200102082132220160.00474E73@pop.gmx.net>.
It adds two options for custom certificates.
 2001-02-10 14:33:31 -08:00
hniksic
2f6cd9d698 [svn] Changes according to Herold Heiko's instructions how to make alloca() 
work under Windows: don't try to compile alloca.c, *and* don't forget
to include <malloc.h>.

Published in <sxsbssyibsu.fsf@florida.arsdigita.de>.
 2001-01-23 06:27:40 -08:00
dan
fa636eb71d [svn] url.c (str_url): Clarified this function's comment header after Hrvoje answered 
my question on the list as to when hide != 1.  Also Hrvoje pointed out I need to
use xstrdup() on the string literal.
 2001-01-10 22:16:46 -08:00
hniksic
3f91c7dfe1 [svn] Declare addrlen as int. Published in <sxsu27cbtzu.fsf@florida.arsdigita.de>. 2001-01-10 07:06:00 -08:00
dan
17e21ff7dd [svn] Jan did make a ChangeLog entry for his fix of the non-anonymous FTP recursion 
bug.  I just didn't use the right terms when searching for it.
 2001-01-10 00:53:42 -08:00
dan
f84a94e913 [svn] Made clarifications and corrections to --continue's --help output and wget.texi 
documentation.  Published in <200101100629.WAA09744@dilvish.speed.net>.
 2001-01-09 22:51:51 -08:00
dan
1993e140f2 [svn] url.c (str_url): Henrik van Ginhoven pointed out on the list that we shouldn't 
give away the number of characters in the password by replacing each character
with a 'x'.  Use "<password>" instead.
 2001-01-09 20:30:43 -08:00
dan
7140f393b2 [svn] When did the bug get fixed where recursive FTP would fail if logging in put 
you in a directory other than "/"?  I don't see a src/ChangeLog entry for
it.  In any case, my testing shows that it's fixed in 1.7-dev, but TODO and
a comment in src/ftp.c were not changed to reflect this.
 2001-01-09 20:17:06 -08:00
dan
040aae87b5 [svn] html-url.c: A bunch of fixup of `--page-requisites'-related comments to reflect 
Hrvoje's changes to my code when transplanting it into this new file, to fix
spelling mistakes, to clarify, etc.
 2001-01-09 18:54:52 -08:00
dan
bc5fd29baf [svn] 2001-01-09 Dan Harkless <wget@harkless.org> 
* html-url.c: Addition and clarification of comments related to -p.

	* url.c (write_backup_file): Clarified a comment.
	  [Committed this fix separately.]
 2001-01-09 18:28:24 -08:00
dan
cbe2ca1b80 [svn] Here're the changes we agreed to on the wget mailing list regarding the 
multiple-branches ChangeLog problem.  Note the new directories -- you'll need to
do a cvs update -d.
 2001-01-06 01:26:02 -08:00
hniksic
35325bd092 [svn] Include fragment identifiers in converted URLs. Published in 
<sxs8zorl90l.fsf@florida.arsdigita.de>.
 2001-01-04 05:53:53 -08:00
hniksic
f579cd1691 [svn] Csaba's Watcom changes. 2001-01-03 07:14:02 -08:00
dan
67bfa88fd8 [svn] ChangeLog: Since this flat file doesn't have multiple branches, 
looking at the dates would make you think that things went into
1.6 that actually just went into the 1.7-dev branch.  Added "[Not
in 1.6 branch.]" where appropriate to clarify.
 2000-12-31 04:45:42 -08:00
dan
86413b1d83 [svn] Need to say that stuff I did before releasing 1.6 happened on 12-30, not 12-31. 2000-12-31 04:10:59 -08:00
dan
e979053779 [svn] 2000-12-31 Dan Harkless <wget@harkless.org> 
* ftp.c, http.c:  Applied Hack Kampbj?rn <hack@hackdata.com>'s
        patch to deal with h_errno not being defined in netdb.h under Cygwin.

2000-12-30  Dan Harkless  <wget@harkless.org>

        * version.c: Released Wget version 1.6.  Note that on this branch we
        never actually had the version set to 1.6, but we still need the
        ChangeLog comment for posterity.
 2000-12-31 04:04:14 -08:00
dan
f105b3e43f [svn] Changed my address from dan-wget@dilvish.speed.net to wget@harkless.org 
everywhere -- dilvish will probably be going away soon.
 2000-12-31 03:18:37 -08:00
hniksic
23cbd15095 [svn] Igor Khristophorov's fix for check_end(). From 
<sxs4s027snq.fsf@florida.arsdigita.de>.
 2000-12-17 11:31:30 -08:00
hniksic
5099ec0306 [svn] Apply lint-expired fixes from <sxsn1du7ufa.fsf@florida.arsdigita.de>. 2000-12-17 10:52:52 -08:00
hniksic
f6a41b5669 [svn] Applied Csaba Raduly's patch from <802569B4.0043F7B1.00@Jagannath.uk.sophos>. 2000-12-17 10:18:14 -08:00
hniksic
2e8fc46b7b [svn] Include <netdb.h> where h_errno is used. Likewise for <errno.h> and errno. 
From <sxsvgsi7wcw.fsf@florida.arsdigita.de>.
 2000-12-17 10:12:02 -08:00
hniksic
b84f96df34 [svn] Use '"' rather than '\"' in assert. 2000-12-13 05:37:37 -08:00
hniksic
bdea0b3bf6 [svn] Made xfree alias to free if memory debugging is not used. 
From <sxsd7ezd7p2.fsf@florida.arsdigita.de>.
 2000-12-10 18:17:44 -08:00
hniksic
d5cd691b12 [svn] Fix -O timestamp bug. 
From <sxs7l57u6o6.fsf@florida.arsdigita.de>.
 2000-12-10 16:47:44 -08:00
hniksic
62b876401e [svn] Set the timestamp even when -O is used. 2000-12-10 16:31:14 -08:00
hniksic
afe131624b [svn] Add , before `int ssl'. 2000-12-06 09:22:27 -08:00
hniksic
b0e9dfd4e2 [svn] Fix opt.wait. 2000-12-05 16:24:40 -08:00
hniksic
47c6092ec4 [svn] Use a single version of RBUF_READCHAR. 2000-12-05 15:50:34 -08:00
hniksic
e754c99b46 [svn] Cosmetic cleanup of SSL stuff. 2000-12-05 15:35:56 -08:00
hniksic
7828e81c79 [svn] Committed C. Frankel's SSL patch. 2000-12-05 15:09:41 -08:00
hniksic
dc78acde56 [svn] Use the proper Jan's changelog entry. 2000-12-05 15:03:46 -08:00
hniksic
d1a855786c [svn] ChangeLog for Jan's last patch. 2000-12-05 14:44:46 -08:00
hniksic
7b5ad90acf [svn] Commit my url.c fix (space as unsafe character) and Jan's 
winnt directory listing parsing.
 2000-12-05 14:29:47 -08:00
hniksic
518fe8d06d [svn] Do away with line separator. 2000-11-29 08:19:46 -08:00
hniksic
7e900c50bf [svn] Undo Jan's typo fix. 2000-11-25 03:51:14 -08:00
hniksic
62994ffc8c [svn] Applied Karl Eichwalder's patch from 
<20001124044348.AF524DD15E@tux.gnu.franken.de>.
 2000-11-24 05:51:36 -08:00
hniksic
7c750db580 [svn] More memory debug tweaks. 
Published in <sxs4s0z2bwi.fsf@florida.arsdigita.de>.
 2000-11-23 13:44:56 -08:00
hniksic
1cddc05edb [svn] Committed memory debugging stuff. 
Published in <sxs1yw34pt4.fsf@florida.arsdigita.de>.
 2000-11-22 14:15:45 -08:00
hniksic
2ffb47eabf [svn] Committed <sxsbsv854j9.fsf@florida.arsdigita.de>. 2000-11-22 08:58:28 -08:00
hniksic
c3d636db03 [svn] Committed Jan's ftpparse patch with Hrvoje's modifications. 
<sxshf518e72.fsf@florida.arsdigita.de>.
 2000-11-21 08:48:39 -08:00
hniksic
d6a57bc2a6 [svn] Commit hash table bugfix. 
Published in <sxs8zqd9x1g.fsf@florida.arsdigita.de>.
 2000-11-21 08:42:29 -08:00
hniksic
6e598c81e3 [svn] Committed a bunch of different tweaks of mine. 
Published in <sxsr9463wrx.fsf@florida.arsdigita.de>.
 2000-11-20 18:06:36 -08:00
hniksic
fb42069e51 [svn] Constify check_end(). 2000-11-20 02:25:28 -08:00
hniksic
6f7fd37186 [svn] Auth tweaks. 
Published in <sxs3dgnz955.fsf@florida.arsdigita.de>.
 2000-11-19 18:10:54 -08:00
hniksic
ba3f5ce0a2 [svn] Bump version number. 2000-11-19 16:15:21 -08:00
hniksic
f2f77d87fd [svn] New option --no-http-keep-alive. 
Published in <sxsd7fr1pdf.fsf@florida.arsdigita.de>.
 2000-11-19 16:04:06 -08:00
hniksic
b27144fcce [svn] My patch "persistent connection tweaks". 
Published in <sxshf531qhj.fsf@florida.arsdigita.de>.

(Applied with the addition of correct calculation for the
length of the request.)
 2000-11-19 15:42:13 -08:00
hniksic
b0b1c815c1 [svn] A bunch of new features: 
- use mmap() to read whole files in core instead of allocating memory
  and read'ing it.

- use a new, more general, HTML parser (html-parse.c) and interface to
  it from Wget (html-url.c).

- respect <meta name=robots content=nofollow> (easy with the new HTML
  parser).

- use hash tables instead of linked lists in places where the lists
  were used to facilitate mappings.

- rewrite the code in host.c to be more readable and faster (hash
  tables instead of home-grown lists.)

- make convert_links properly convert partial URLs to complete ones
  for those URLs that have *not* been downloaded.

- use HTTP persistent connections where available.  very
  simple-minded, caches the last connection to the server.

Published in <sxshf533d5r.fsf@florida.arsdigita.de>.
 2000-11-19 12:50:10 -08:00
hniksic
ccf31643ab [svn] vsnprintf() fixup. 2000-11-16 08:37:49 -08:00
hniksic
cc3b6eb3e4 [svn] Do the _XOPEN_SOURCE/_SVID_SOURCE things only on Linux. 2000-11-15 10:10:01 -08:00
hniksic
6a70f04a5c [svn] Don't clutter the host list with duplicate hosts. 
Published in <sxsitpt56eh.fsf@florida.arsdigita.de>.
 2000-11-12 16:46:13 -08:00
hniksic
e1f1c1ff40 [svn] Better version of read_whole_line(). 
Published in <sxsr94jd7z4.fsf@florida.arsdigita.de>.
 2000-11-10 10:01:35 -08:00
hniksic
e18ca280fb [svn] Fix off-by-one error in comind(). 
Published in <sxsvgtvdcki.fsf@florida.arsdigita.de>.
 2000-11-10 08:20:55 -08:00
hniksic
f306ae9626 [svn] Changed last_slash[-1] to *(last_slash - 1). 2000-11-08 07:51:28 -08:00
hniksic
b72b6cf387 [svn] Correctly handle URLs where / does not follow the host name. 
Published in <sxsn1fag6zu.fsf@florida.arsdigita.de>.
 2000-11-08 01:15:40 -08:00
hniksic
34ea31bb01 [svn] Sort commands[]. 2000-11-07 03:43:36 -08:00
hniksic
0e2b74ce3b [svn] Commit "minor fixes". 2000-11-06 13:24:57 -08:00
hniksic
366ad1d6d9 [svn] Rewrote the logging code. 
Published at <sxs1ywrf300.fsf@florida.arsdigita.de>.
 2000-11-04 20:38:31 -08:00
hniksic
c2c821b3c9 [svn] snprintf.c addition. 2000-11-04 14:49:46 -08:00
hniksic
6e23da9254 [svn] Hide password from URL when non-verbose, too. 2000-11-01 17:41:20 -08:00
hniksic
6eb0870af0 [svn] Contributed fix. 2000-11-01 17:02:56 -08:00
hniksic
986c445029 [svn] Fixed minor memory leaks. 2000-11-01 16:18:27 -08:00
hniksic
b3758323ed [svn] Applied contributed fix. 2000-11-01 15:57:19 -08:00
hniksic
b7a8c6d3f5 [svn] Gracefully handle opt.downloaded overflowing. 
Published in <sxsd7gfnv17.fsf@florida.arsdigita.de>.
 2000-11-01 15:17:31 -08:00
hniksic
29cdc8da20 [svn] Updated long_to_string(); enhanced opt.downloaded to use 
64-bit types where available.
Published in <sxswvenqsmn.fsf@florida.arsdigita.de> and
<sxssnpbqshp.fsf@florida.arsdigita.de>.
 2000-11-01 13:51:25 -08:00
hniksic
b9eeb0c54c [svn] Fix "optimization" of query-strings in URLs. 
Published in <sxs3dhbwnmw.fsf@florida.arsdigita.de>.
 2000-11-01 10:31:53 -08:00
hniksic
6d13e17142 [svn] Detect redirection cycles. 
Published in <sxsd7ggtjac.fsf@florida.arsdigita.de>.
 2000-10-31 20:21:50 -08:00
hniksic
515d82fb95 [svn] Committed my patch from <sxsy9z4xz5m.fsf@florida.arsdigita.de> 
(recognize HTML entities.)
 2000-10-31 17:25:12 -08:00
hniksic
846b045a69 [svn] Applied my patch from <sxs3dhczfv5.fsf@florida.arsdigita.de>. 2000-10-31 16:38:57 -08:00
hniksic
f6715dd08d [svn] Committed my patch from <sxs7l6ozghz.fsf@florida.arsdigita.de>. 2000-10-31 16:26:33 -08:00
hniksic
0dd418242a [svn] Committed my patches from <sxsbsw16sbu.fsf@florida.arsdigita.de> 
and <sxsvgu824xk.fsf@florida.arsdigita.de>.
 2000-10-31 11:25:32 -08:00
hniksic
b095202cad [svn] Applied Adrian Aichner's patch from 
<20001029223711.28688.qmail@web10601.mail.yahoo.com>.
 2000-10-30 13:07:04 -08:00
dan
24c465b5ad [svn] retr.c (retrieve_url): Manually applied T. Bharath 
<TBharath@responsenetworks.com>'s patch to get wget to grok illegal relative URL
redirects.  Reformatted and re-commented it.
 2000-10-27 20:18:20 -07:00
dan
1396b30055 [svn] Manually applied Rob Mayoff <mayoff@dqd.com>'s patch (vs. 1.5.3, not 1.5.3+dev) 
to add --bind-address, making many necessary alphabetization, coding style,
comment, documentation, and naming fixes and additions.
 2000-10-23 23:19:17 -07:00
dan
2fbb4936a0 [svn] main.c (print_help): Clarified that --delete-after deletes local files. 2000-10-23 20:52:34 -07:00
dan
f4673bcdaf [svn] --delete-after wasn't implemented for files retrieved by FTP or corresponding to 
files specified on the commandline.  Made --convert-links be ignored when
--delete-after is specified.  Added note about this fact to --delete-after docs
and made general improvements to them, including the clarification that
--delete-after only deletes local files.
 2000-10-23 20:43:47 -07:00
dan
8a9be7627d [svn] ftp.c (getftp): Applied Piotr Sulecki <Piotr.Sulecki@ios.krakow.pl>'s 
patch to work around FTP servers that incorrectly respond to the
          	"REST" command with the remaining size rather than the total
          	file size.
 2000-10-20 00:28:57 -07:00
dan
8cf52e0dd3 [svn] Applied John Daily <jdaily@cyberdude.com>'s patch for his "quad" commands (which 
I renamed to "lockable_boolean") in the .wgetrc (currently just passive_ftp).
Wrote documentation for his changes and added the missing "referer" to the
.wgetrc section (making mention of the issue of "referrer" being the correct
spelling).
 2000-10-19 23:59:30 -07:00
dan
b3e2c0ff97 [svn] Implemented and documented new -E / --html-extension / html_extension option. 2000-10-19 22:55:46 -07:00
dan
cbf018d0c0 [svn] --retr-symlinks was not previously documented properly. Based on my newfound 
understanding of what its limitations are, added a TODO item.  Also made a minor
tweak in html.c to silence a warning.
 2000-10-09 15:43:11 -07:00
dan
7931200609 [svn] * *.{gmo,po,pot}: Regenerated after modifying wget --help output. 
* ftp.c (ftp_retrieve_list): Use new INFINITE_RECURSION #define.

* html.c: htmlfindurl() now takes final `dash_p_leaf_HTML' parameter.
Wrapped some > 80-column lines.  When -p is specified and we're at a
leaf node, do not traverse <A>, <AREA>, or <LINK> tags other than
<LINK REL="stylesheet">.

* html.h (htmlfindurl): Now takes final `dash_p_leaf_HTML' parameter.

* init.c: Added new -p / --page-requisites / page_requisites option.

* main.c (print_help): Clarified that -l inf and -l 0 both allow
infinite recursion.  Changed the unhelpful --mirrior description
to simply give the options it's equivalent to.  Added new -p option.
(main): Added some comments; handle new -p / --page-requisites.

* options.h (struct options): Added new page_requisites field.

* recur.c: Changed "URL-s" to "URLs" and "HTML-s" to "HTMLs".
Calculate and pass down new `dash_p_leaf_HTML' parameter to
get_urls_html().  Use new INFINITE_RECURSION #define.

* retr.c: Changed "URL-s" to "URLs".  get_urls_html() now takes
final `dash_p_leaf_HTML' parameter.

* url.c: get_urls_html() and htmlfindurl() now take final
`dash_p_leaf_HTML' parameter.

* url.h (get_urls_html): Now takes final `dash_p_leaf_HTML' parameter.

* wget.h: Added some comments and new INFINITE_RECURSION #define.

* wget.texi (Recursive Retrieval Options): Documented new -p option.
 2000-08-30 04:26:21 -07:00
dan
001392bf2b [svn] * main.c (print_help): -B / --base was not mentioned. 2000-08-23 15:40:20 -07:00
dan
1f0acebeb0 [svn] * main.c (print_help): Modified -nc description to mention that it also prevents 
the creation of multiple versions of the same file with ".<number>" suffixes.
 2000-08-22 20:11:55 -07:00
hniksic
7794db052c [svn] Committed Jan Prikryl's patch from 
<20000709171425.A16267@launzatte.cg.tuwien.ac.at>.
 2000-07-14 07:15:23 -07:00
dan
ae77e4f08e [svn] Oops. Meant to check this change in with my last one, but the commit wouldn't 
go through without doing an update first, and I forgot to make the change the
second time.  Just changed an erroneous main.c (main) to main.c (print_help).
 2000-06-09 14:40:26 -07:00
dan
eea2d24220 [svn] Heiko's --help output for --waitretry was over 80 columns. Shortened. It also 
said that 0 seconds are waited after the first retry, which I believe is
incorrect and does not match what's written elsewhere (e.g. wget.texi).  Changed
to 1.
 2000-06-09 13:59:56 -07:00
hniksic
1765080b2e [svn] Comment fix. 2000-06-09 01:03:19 -07:00
hniksic
2e806fb2f3 [svn] Don't try to chmod() symlinks. 2000-06-01 04:20:05 -07:00
hniksic
0eec6b9f30 [svn] Committed my patch <dpem6hln1k.fsf@mraz.iskon.hr>. 2000-06-01 03:47:03 -07:00
dan
b05feb3ae2 [svn] Damir Dzeko <ddzeko@zesoi.fer.hr> did not document his new --referer option. 
Did so (--help output and wget.texi).  Also tweaked --help output for --execute.
 2000-05-22 19:29:38 -07:00
hniksic
ee6065f581 [svn] Committed my patch from <dpd7mj3sap.fsf@mraz.iskon.hr>. 2000-05-19 00:37:22 -07:00
hniksic
094481c386 [svn] Committed host.c patch from <dpk8i3za97.fsf_-_@mraz.iskon.hr>. 2000-04-14 02:31:21 -07:00
hniksic
6b4a85888e [svn] Commit several fixes. 2000-04-12 06:23:35 -07:00
dan
1ecfed1e10 [svn] * host.c (store_hostaddress): R. K. Owen's patch introduces a "left shift count 
>= width of type" warning on 32-bit architectures.  Got rid of it by tricking
  the compiler w/ a variable.

* url.c (UNSAFE_CHAR): The macro didn't include all the illegal characters per
  RFC1738, namely everything above '~'.  It also generated a warning on OSes
  where char =~ unsigned char.  Fixed.
 2000-04-04 20:08:10 -07:00
hniksic
bc7060a81d [svn] More old fixes. 2000-03-31 06:14:58 -08:00
hniksic
aeabb42714 [svn] Commit another old fix. 2000-03-31 06:08:57 -08:00