moparisthebest/wget
1
0
Fork 0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Code Issues Releases Wiki Activity
2,732 Commits 1 Branch 0 Tags 9.6 MiB
e095cc064e
Commit Graph

1690 Commits

Author SHA1 Message Date
hniksic
bc768ec88a [svn] HAVE_FNMATCH_H is now HAVE_WORKING_FNMATCH_H. 2003-11-04 08:22:52 -08:00
hniksic
4914c2c49c [svn] New file. 2003-11-04 08:06:38 -08:00
hniksic
086dd1ca8a [svn] Delete config.h.in from `make realclean'. 2003-11-04 08:06:25 -08:00
hniksic
e75d817c09 [svn] Use autoheader to generate config.h.in. 2003-11-04 07:28:18 -08:00
hniksic
0e62563e27 [svn] Use more standard description. 2003-11-04 05:49:47 -08:00
hniksic
71b3daae55 [svn] Imported Mauro's IPv6 ChangeLog. 2003-11-04 05:40:21 -08:00
hniksic
f4cbba565e [svn] Only set a flag in the SIGWINCH handler. 2003-11-04 05:37:14 -08:00
hniksic
9af99f3b83 [svn] Enable SYSTEM_FNMATCH only if fnmatch.h is available. 2003-11-03 17:09:54 -08:00
hniksic
8cd9b4cd8a [svn] New function xsleep that resumes sleeps interrupted by signals 
on systems that support nanosleep.
 2003-11-03 13:57:04 -08:00
hniksic
2f2939d23e [svn] Don't shadow SEED. 2003-11-03 13:21:05 -08:00
hniksic
e958a474b0 [svn] Renamed logvprintf to log_vprintf_internal. 2003-11-03 12:08:46 -08:00
hniksic
3ec22d9843 [svn] Msg fix. 2003-11-02 18:44:41 -08:00
hniksic
b997a9d34f [svn] Don't parenthesize argument to N_. 2003-11-02 16:28:53 -08:00
hniksic
2063522623 [svn] Don't take the address of in.s_addr because that doesn't work on some 
machines.
 2003-11-02 15:48:45 -08:00
hniksic
6d3df65e88 [svn] Generalized the third argument to select_fd. 2003-11-02 15:17:59 -08:00
hniksic
c12e07faa6 [svn] Cosmetic change. 2003-11-02 13:16:43 -08:00
hniksic
12693decd1 [svn] Revert DEBUG_MALLOC to undefined. 2003-11-02 13:15:57 -08:00
hniksic
095d89995e [svn] Abort on xfree(NULL). 2003-11-02 13:12:49 -08:00
hniksic
e2e9b753e4 [svn] Retired the `boolean' type. Renamed FREE_MAYBE to xfree_null and moved the 
definition from wget.h to xmalloc.h.  Moved the DEFAULT_LOGFILE
define to log.h.  Moved the INFINITE_RECURSION define to recur.h.
 2003-11-02 11:56:37 -08:00
hniksic
3e207912bd [svn] Added undefs for FITS and SKIP_SEMI macros. 2003-11-02 08:48:40 -08:00
hniksic
504effdc13 [svn] Improved support for entities. 2003-11-02 06:57:31 -08:00
hniksic
37dd65621c [svn] Document the Opie code better. Use uint32_t instead of unsigned long 
for 32-bit quantities.
 2003-11-01 08:36:43 -08:00
hniksic
7ec83a1b2a [svn] Don't call select_fd unless timeout is desired. 2003-11-01 06:01:53 -08:00
hniksic
9d9e242e5d [svn] Improved fatal error message. 2003-10-31 18:51:47 -08:00
hniksic
3dc9f336e8 [svn] Renamed HASH_FULLNESS_THRESHOLD to HASH_MAX_FULLNESS. 2003-10-31 18:45:16 -08:00
hniksic
5b8d5d5a05 [svn] Doc fix. 2003-10-31 18:29:38 -08:00
hniksic
bed1c56453 [svn] Fixed declaration of VEC in lookup_host. 
Removed the ip_default_family global variable.
 2003-10-31 18:22:11 -08:00
hniksic
916d8c1586 [svn] New file. 2003-10-31 07:27:29 -08:00
hniksic
c6c171bed7 [svn] Don't declare long-gone function "pwd_cuserid". 2003-10-31 07:18:48 -08:00
hniksic
5f0a2b3f08 [svn] Use new macros xnew, xnew0, xnew_array, and xnew0_array in various places. 2003-10-31 06:55:50 -08:00
hniksic
370ff7a576 [svn] Moved malloc-related code to xmalloc.c. Defined new macros xnew, xnew0, 
xnew_array, and xnew0_array.  Created xmalloc.h and log.h to unclutter
wget.h.
 2003-10-31 06:31:56 -08:00
hniksic
83e7fe2ca8 [svn] Retired broken code that checked for NULL ip_address in sockaddr_set_data. 2003-10-31 04:20:14 -08:00
hniksic
dbe01ae695 [svn] Removed address_list_from_single. 2003-10-31 02:50:03 -08:00
hniksic
add61a2d9c [svn] Networking improvements: get rid of the MSOCK global variable, 
move the sockaddr handling to connect.c, make sure Wget refreshes
the DNS lookup after it becomes stale.
 2003-10-30 16:18:08 -08:00
hniksic
e4ff71fca5 [svn] *** empty log message *** 2003-10-30 13:32:35 -08:00
hniksic
3f8a70c227 [svn] Use S >= 8' rather than S == 8' when looking for large integers. 2003-10-30 07:55:53 -08:00
hniksic
448a61fb83 [svn] Don't unescape URL escapes twice. 2003-10-30 07:42:52 -08:00
hniksic
29e36b051b [svn] Fix -p so it doesn't imply FTP recursion. 2003-10-30 05:00:29 -08:00
hniksic
6369bc5944 [svn] Clarify how setoptval() works. 2003-10-30 03:09:18 -08:00
hniksic
6f1250b1c6 [svn] Updated IPv6 code. 2003-10-29 15:13:25 -08:00
hniksic
8c19243974 [svn] Dummy ChangeLog entry for Mauro's IPv6 changes. 2003-10-29 13:47:07 -08:00
hniksic
90cb3309da [svn] Imported Mauro's IPv6 changes. 2003-10-29 10:23:56 -08:00
hniksic
c81651f4c1 [svn] Change u_int32_t to uint32_t. 2003-10-25 18:41:56 -07:00
hniksic
dd356aff3d [svn] Reset the QUOTE flag after the closing quote. 2003-10-25 17:03:38 -07:00
hniksic
27d5becdaf [svn] Better document the workings of construct_relative(). 
Reformat is_valid_ipv6_address() to GNU formatting style.
 2003-10-25 04:58:24 -07:00
hniksic
51c82cd8b3 [svn] Fixed compilation under Ultrix. 2003-10-23 08:25:34 -07:00
hniksic
5fa95aabc7 [svn] Bump version. 2003-10-23 05:33:26 -07:00
hniksic
d66af0ab20 [svn] Don't use trailing commas in enums. 2003-10-23 05:15:39 -07:00
hniksic
168f03d21d [svn] Don't let absolute path specified by -P introduce absolute file names 
to links converted by -k.
 2003-10-16 08:48:24 -07:00
hniksic
31d919b23d [svn] Accept HTTP status 307 as redirect. 2003-10-14 16:32:15 -07:00
hniksic
c6dcc539f8 [svn] Updated comment. 2003-10-14 15:54:57 -07:00
hniksic
3f6913663e [svn] Correctly loop through the linked list. 
By Philip Stadermann.
 2003-10-14 15:52:12 -07:00
hniksic
5535c9ff17 [svn] Expect links followed from Refreshes to contain URLs. 2003-10-13 07:32:25 -07:00
hniksic
7487dbfa81 [svn] Don't define int32_t because we're not using it. 2003-10-13 07:20:51 -07:00
hniksic
711bf72609 [svn] Remove VERY_LONG_TYPE; use LARGE_INT instead. Remove special code 
for handling VERY_LONG_TYPE overflows.
Make opt.quota a LARGE_INT.
 2003-10-11 06:57:11 -07:00
hniksic
a6f72ca66b [svn] Also check for short for int32_t. 2003-10-11 05:41:13 -07:00
hniksic
f58c6774e4 [svn] Provide the support for int32_t and u_int32_t. 2003-10-10 19:27:41 -07:00
hniksic
5155384340 [svn] Look for and use socklen_t. 2003-10-10 18:39:07 -07:00
hniksic
1b3cdef574 [svn] Don't descend into HTML that was downloaded by following <img src=...> 
and such.
 2003-10-10 07:25:10 -07:00
hniksic
ffc2d0f653 [svn] Make the first argument to hash_table_new a minimal count of items before 
regrow, not raw size, which is more useful.
 2003-10-09 19:46:09 -07:00
hniksic
233ebb78de [svn] Use hash table for tag lookup in html-url.c and html-parse.c. 2003-10-09 08:01:58 -07:00
hniksic
b49e89e78a [svn] Add const declarations to hash-table functions. 2003-10-09 06:32:28 -07:00
hniksic
ae1d264fcc [svn] Add FLAGS argument to map_html_tags. 2003-10-08 09:17:33 -07:00
hniksic
a9c3c58c9f [svn] Switch to binary search for find_tag. 2003-10-08 09:00:10 -07:00
hniksic
33dceca784 [svn] Fix typo in help string. 2003-10-08 08:24:56 -07:00
hniksic
6057dbec6f [svn] Add definitions of getopt_long and getopt_long_only to getopt.c. 
The definitions were lost when updating the file.
 2003-10-08 07:55:44 -07:00
hniksic
e4d15a373b [svn] run_with_timeout docstring synch with utils.c. 2003-10-07 17:16:43 -07:00
hniksic
f1a802d1c0 [svn] Cosmetic changes to GNU convention. 2003-10-07 17:09:56 -07:00
hniksic
38ea4d5dad [svn] Renamed DEBUG to ENABLE_DEBUG. 2003-10-07 17:05:51 -07:00
hniksic
097923f7b1 [svn] Move fnmatch() to cmpt.c and don't use it under GNU libc. 2003-10-07 16:53:31 -07:00
hniksic
d7cbc755e0 [svn] Add a fresher getopt.c. 2003-10-07 15:58:27 -07:00
hniksic
cc5d6f0ab8 [svn] Doc typo fix. 2003-10-07 14:45:26 -07:00
hniksic
3d823e690e [svn] Remove unused pointer from struct cookie. 2003-10-07 03:39:18 -07:00
hniksic
df4064bc68 [svn] jar->chains_by_domain -> jar->chains 2003-10-06 17:49:58 -07:00
hniksic
6359e38d96 [svn] Improve documentation of cookie code. 2003-10-06 17:47:08 -07:00
hniksic
abf7afb9d4 [svn] Fix type of _SetThreadExecutionState local var. 
By Gisle Vanem.
 2003-10-05 14:12:36 -07:00
hniksic
30c3b5bc8a [svn] Doc update. 2003-10-04 15:58:34 -07:00
hniksic
533412b55c [svn] Doc update. 2003-10-04 15:51:00 -07:00
hniksic
254291cc03 [svn] Fix crash when post-file is missing. 2003-10-04 15:26:58 -07:00
hniksic
711692375e [svn] Use WaitForSingleObject to wait for thread termination. 
By Gisle Vanem.
 2003-10-04 14:54:12 -07:00
hniksic
98b7ac79f3 [svn] Update ansi2knr.c and ansi2knr.1. 
Update log.c to use `...' in function definition argument lists
unconditionally.
 2003-10-04 03:34:10 -07:00
hniksic
351c4b9add [svn] Include winsock headers from mswindows.h. 
By Gisle Vanem.
 2003-10-03 09:37:47 -07:00
hniksic
87275db136 [svn] Fix compilation problem on non-Gcc compilers. 2003-10-03 09:11:09 -07:00
hniksic
5a905bcec3 [svn] Window-specific implementation of run_with_timeout. 
By Gisle Vanem.
 2003-10-02 16:28:49 -07:00
hniksic
eec3ea392d [svn] Better document html-parse macros. 2003-10-02 15:20:44 -07:00
hniksic
f70c6cacb9 [svn] Initialize DUMMY storage for DT. 2003-10-02 14:21:07 -07:00
hniksic
2e8899bc10 [svn] Added support for hexadecimal numeric entities. 2003-10-02 10:23:25 -07:00
hniksic
675c1a703c [svn] Doc fixes. 2003-10-02 08:15:36 -07:00
hniksic
030704403b [svn] Subsecond granularity in run_with_timeout. 2003-10-02 06:37:45 -07:00
hniksic
4055ebc41f [svn] Synch doc/version.texi with src/version.c. 2003-10-01 13:44:15 -07:00
hniksic
65cec8deee [svn] Fix memory leak in a rare case in url.c. 
Translate error messages from url_parse().
 2003-10-01 12:59:48 -07:00
hniksic
d0f4a1e109 [svn] Initialize local variable to shut up the compiler. 2003-10-01 12:45:41 -07:00
hniksic
6a2477fdc2 [svn] *** empty log message *** 2003-10-01 06:44:46 -07:00
hniksic
111dea9622 [svn] Updated copyright and email. 2003-09-30 14:54:27 -07:00
hniksic
451ddf3cf9 [svn] Display percentage in title bar. 
By Gisle Vanem.
 2003-09-30 14:24:36 -07:00
hniksic
b307160959 [svn] Made --spider work with FTP downloads. 
By Aaron S. Hawley.
 2003-09-30 14:14:02 -07:00
hniksic
a95b801f61 [svn] Windows fixes by Gisle Vanem. 2003-09-26 17:35:31 -07:00
hniksic
700df4394e [svn] Fixes to support out of the box compilation on various Windows compilers. 
By Gisle Vanem.
 2003-09-25 15:39:37 -07:00
hniksic
831f376303 [svn] Fix oversight in escape handling. 2003-09-25 15:31:35 -07:00
hniksic
e6fd9cb793 [svn] Force printing of ETA at the end of download. 2003-09-23 13:48:10 -07:00
hniksic
845a0988b1 [svn] Remove .libs directory when cleaning up. 2003-09-23 13:10:59 -07:00
hniksic
d403f7f835 [svn] Cosmetic change in var names. 2003-09-23 11:39:22 -07:00
hniksic
45164e05cc [svn] Fix a bug when loading cookies. Don't ignore domain-flag. 2003-09-22 18:08:01 -07:00
hniksic
625a9d3a9f [svn] Indicate where the download has started in progress bar. 2003-09-22 10:14:19 -07:00
hniksic
c2ffc02ab3 [svn] If hash/test functions aren't given, default to identity hash tables. 2003-09-22 07:32:17 -07:00
hniksic
566289ea9d [svn] Added comment about SO_SNDBUF for post. 2003-09-22 06:55:22 -07:00
hniksic
b8fa2039a7 [svn] Doc update. 2003-09-22 06:34:55 -07:00
hniksic
bebad75ff9 [svn] Another doc update. 2003-09-22 05:07:20 -07:00
hniksic
f78016fb95 [svn] path_simplify doc update. 2003-09-22 05:03:34 -07:00
hniksic
e6d8f06093 [svn] Fix broken cast of BIT to unsigned char. 2003-09-21 19:05:34 -07:00
hniksic
3e9dc5b994 [svn] Modified path_simplify not to rely on extensive use of memmove. 2003-09-21 17:23:44 -07:00
hniksic
9d333d074b [svn] Include convert.h. 2003-09-21 16:32:42 -07:00
hniksic
dadde97838 [svn] Removed spurious includes. 2003-09-21 16:09:06 -07:00
hniksic
95c647eb44 [svn] Split off non-URL related stuff from url.c to convert.c. 2003-09-21 15:47:14 -07:00
hniksic
12ffc87ca7 [svn] Update copyright. 2003-09-21 14:39:00 -07:00
hniksic
e0303dd8ea [svn] Improved init.c error messages. 2003-09-21 12:17:45 -07:00
hniksic
7211c51139 [svn] path_simplify would read two bytes past the end of the string in the "./" case. 2003-09-21 06:36:50 -07:00
hniksic
c06d32a309 [svn] Treat xhtml files just like regular html. 
By Matthew J. Mellon.
 2003-09-21 05:02:57 -07:00
hniksic
51a8e9fa50 [svn] Enabled separation of different timeout values. 2003-09-20 21:41:55 -07:00
hniksic
b8e416c6c7 [svn] Adjust bandwidth limitation sleep for the error of previous sleeps. 
Allow decimal numbers in bandwidth limit specification.
 2003-09-20 21:05:12 -07:00
hniksic
37183b0208 [svn] Make errors in command-line options fatal. 2003-09-20 17:41:49 -07:00
hniksic
7870937036 [svn] Allow decimal values for --timeout, --wait, and --waitretry. 
Message-ID: <m3llsjhx6t.fsf@hniksic.iskon.hr>
 2003-09-20 16:12:18 -07:00
hniksic
e7998ad916 [svn] Cosmetic fixes. 2003-09-20 14:08:41 -07:00
hniksic
101f896e47 [svn] Minor fixes and cosmetic changes. 
(uri_merge): Get rid of uri_merge_1.
(uri_merge): Merge "foo//", "bar" as "foo//bar", not "foo///bar",
i.e. don't add an extra slash merely because BASE ends with two
slashes.
(parse_credentials): Renamed from parse_uname.  Rewrittern in
standard [beg, end) calling style.
(url_skip_credentials): Renamed from url_skip_uname.  Made static.
(url_skip_credentials): Include # and ; as terminators.  Old code
would mistakenly consider "http://foo.com#hniksic@iskon.hr" to
contain a username.
(url_skip_scheme): Removed because it was unused.
(url_has_scheme): Require "scheme" to be at least one char long.
 2003-09-19 17:05:36 -07:00
hniksic
a504d10ed5 [svn] Default dir_prefix to NULL rather than ".". 2003-09-19 08:28:36 -07:00
hniksic
4fd9c65005 [svn] Cosmetic change. 2003-09-19 07:20:35 -07:00
hniksic
7b5fb50cb1 [svn] Renamed wget.h XDIGIT-related macros to (hopefully) clearer names. 2003-09-19 07:08:37 -07:00
hniksic
7c802e58d3 [svn] Introduce non-strict comment parsing. 2003-09-18 17:33:22 -07:00
hniksic
e71b2799d2 [svn] Add support for OS/400 ftp server. 2003-09-18 06:46:17 -07:00
hniksic
fb67dd6201 [svn] Call ssl_iread with the correct arguments. 2003-09-18 04:43:00 -07:00
hniksic
beb08d42ba [svn] Don't #define ctype.h macros to errors. 2003-09-18 04:39:22 -07:00
hniksic
fdf7fd4d76 [svn] Removed unused macro ISODIGIT. 2003-09-16 19:00:12 -07:00
hniksic
4dcee39c88 [svn] Undef U, W, C after use. 2003-09-16 18:59:46 -07:00
hniksic
aa24b822ca [svn] Improved --restrict-file-names to accept ",nocontrol". 2003-09-16 18:32:05 -07:00
hniksic
d4281f04b2 [svn] Made sync_path more resilient to pathological values of u->file and u->dir. 2003-09-16 17:18:52 -07:00
hniksic
4b1afddab3 [svn] Allow unique_name to return the FILE argument unmodified. 
Streamline and optimize unique_name_1.
 2003-09-16 14:47:49 -07:00
hniksic
c95d75292b [svn] Work around VC's inability to cast unsigned __int64 to void. 2003-09-16 14:16:59 -07:00
hniksic
f5c82a6468 [svn] Added proper IPv6 configure detection. 
By Mauro Tortonesi.
 2003-09-16 05:24:29 -07:00
hniksic
8514281d39 [svn] Have `make clean' also delete the core.<number> files created by recent 
Linux systems.
 2003-09-15 16:42:59 -07:00
hniksic
0e77942233 [svn] Don't pad shrunk POST'ed files. 
Message-ID: <m3u17dn1qk.fsf@hniksic.iskon.hr>
 2003-09-15 15:09:17 -07:00
hniksic
d54b2a086d [svn] Improved --limit-rate for small bandwidths. 
Message-ID: <m3znh5n2og.fsf@hniksic.iskon.hr>
 2003-09-15 14:48:43 -07:00
hniksic
9228f0bf53 [svn] Update progress code to use higher timer resolution. 
Message-ID: <m37k49oivp.fsf@hniksic.iskon.hr>
 2003-09-15 14:14:15 -07:00
hniksic
ea8a108b1f [svn] Implement xdigit_to_xchar more efficiently. 2003-09-15 10:50:43 -07:00
hniksic
016867ca33 [svn] Another version of parse_set_cookies, along with a test suite. 2003-09-15 08:35:47 -07:00
hniksic
79157a03fd [svn] Made strpbrk_or_eos a macro under Gcc. 2003-09-15 03:47:46 -07:00
hniksic
3abcd16d79 [svn] Allow trailing whitespace in Set-Cookies. Also allow empty Set-Cookies 
without spewing an error.
Message-ID: <m365jucpci.fsf@xemacs.org>.
 2003-09-15 03:35:01 -07:00
hniksic
0a3697ad65 [svn] New mechanism for quoting file names. 
Published in <m3smmzt4px.fsf@hniksic.iskon.hr>.
 2003-09-14 15:04:13 -07:00
hniksic
ebea9e7e0b [svn] Fixed a long-standing bug in the timer code that would cause Wget to 
crash when the system time was set back during a Wget run.
Message-ID: <m3znh8wag9.fsf@hniksic.iskon.hr>
 2003-09-13 16:12:45 -07:00
hniksic
7e7ce3dc0e [svn] Print the result of DNS lookup. 2003-09-10 13:46:32 -07:00
hniksic
bda244f564 [svn] Allow --foo=yes/no in addition to --foo=on/off. 2003-09-10 13:21:21 -07:00
hniksic
10137bd186 [svn] New option --dns-cache. 2003-09-10 12:41:54 -07:00
hniksic
cd8b1259f1 [svn] IPv6 configure auto-detection. 2003-09-09 12:30:45 -07:00
hniksic
0e9b4de751 [svn] Return an error from url_parse if the IP address is IPv6 and we don't 
handle IPv6.
 2003-09-09 06:06:58 -07:00
hniksic
05715ed4d6 [svn] Add proper detection of numeric IPv6 addresses. 
By Mauro Tortonesi.
 2003-09-05 13:36:17 -07:00
hniksic
30ac043b0a [svn] New option --retry-connrefused from Ahmod Dancy. 2003-09-04 14:34:58 -07:00
abbotti
0410411939 [svn] Fix for FTP directory traversal vulnerability (at least for Unix). 
Based on a patch by Red Hat.
Published in <85u02vg4hukbc2fltdd51uds5oq14rd92f@farscape.privy.mev.co.uk>.
 2003-01-11 12:12:35 -08:00
hniksic
27483fd0f5 [svn] Fix off-by-one error in cmd_file. 
Published in <sxsit2rfzqo.fsf@florida.munich.redhat.com>.
 2002-08-03 13:34:58 -07:00
hniksic
d7673d398b [svn] Check whether downloaded_html_set is non-NULL before using it. 
Posted in <sxsr8hsvnhh.fsf@florida.munich.redhat.com>.
 2002-07-24 14:16:30 -07:00
hniksic
ac7a99c636 [svn] New file. 2002-05-29 18:51:09 -07:00
hniksic
89b37c7eff [svn] Allow almost any character in attribute/tag names. 2002-05-27 08:03:35 -07:00
hniksic
5ac6afa590 [svn] Bump version to 1.9-beta. 1.8.1+cvs no longer makes sense, now 
that 1.8.2 is being released.
 2002-05-25 11:09:30 -07:00
hniksic
d3a636f2a5 [svn] Fall back to dot progress if the terminal type is "emacs". 
Published in <sxsd6vllhsi.fsf@florida.munich.redhat.com>.
 2002-05-24 07:53:18 -07:00
hniksic
f97f3ef416 [svn] Don't #define __STDC__ against the compiler's will. 
Published in <sxsptzr64ea.fsf@florida.munich.redhat.com>.
 2002-05-19 17:38:14 -07:00
hniksic
b2be7522c7 [svn] Update the license to include the OpenSSL exception. 2002-05-17 19:16:36 -07:00
hniksic
a4abdda23d [svn] Minor optimization of prime_size. 
Published in <sxswuu2p6pm.fsf@florida.munich.redhat.com>.
 2002-05-17 18:48:39 -07:00
abbotti
83dc077b17 [svn] (download_child_p): Minor optimization to avoid unnecessary call to 
schemes_are_similar_p function.
Published in <kvq7eu4okekh2ohb0rdvavt16nbgb02v00@farscape.privy.mev.co.uk>.
 2002-05-16 10:38:30 -07:00
abbotti
e863a6323b [svn] New function schemes_are_similar_p to test enumerated scheme codes for 
similarity (SCHEME_HTTP and SCHEME_HTTPS are similar).  Use it in recur.c
(download_child_p).  Fixes a bug that caused -H option to be ignored when
child scheme different to parent scheme.
Published in <agn4eu8apduek7magfu9bfe63gto8i7cdh@farscape.privy.mev.co.uk>.
 2002-05-16 10:22:24 -07:00
abbotti
043d305fb1 [svn] Don't ftruncate standard output. 
Submitted by Bill Richardson  <bill@riverstonenet.com>.
Final version of patch published in
<9vv1eus668tn7v3vn95e7l2lcjbbph8bi2@farscape.privy.mev.co.uk>.
 2002-05-14 05:23:51 -07:00
abbotti
55f59d0022 [svn] Synched strptime with glibc 2.1.3. 2002-05-09 03:14:15 -07:00
hniksic
fd42ae1311 [svn] Allow match_tail to be case insensitive. 
Published in <sxsznzabirr.fsf@florida.munich.redhat.com>.
 2002-05-08 11:24:40 -07:00
abbotti
291693c3c2 [svn] Do not store discarded cookie after it is delected. 
Submitted by Ian Abbott in
<2h2gdu0q04v94ltet2634888sh6imcrgnd@farscape.privy.mev.co.uk>.
 2002-05-07 10:22:33 -07:00
hniksic
58ee1f008a [svn] Fix matching of cookie domains. 
Published in <sxsy9fhu1bu.fsf@florida.arsdigita.de>.
 2002-04-20 21:25:36 -07:00
hniksic
6fe9ec9f16 [svn] Indentation change. 2002-04-20 21:25:07 -07:00
hniksic
91a190a770 [svn] Implement several SSL features. 
- allow checking of server cert
- allow defining client cert type
- allow limit of ssl protocol
- check more return values
- added debug message on break
Published by Thomas Lussnig in <3CC09969.5000607@bewegungsmelder.de>.
 2002-04-20 19:26:48 -07:00
hniksic
bf018d5721 [svn] Revert order of check number 6 in download_child_p for clarity. 2002-04-20 19:15:11 -07:00
hniksic
d4b0486cc4 [svn] Remove needless level of indentation. 2002-04-20 17:54:13 -07:00
hniksic
29a66192cf [svn] Cookie interface and implementation changes 
from <sxsofge9yao.fsf@florida.arsdigita.de>
and <sxslmbim7dg.fsf@florida.arsdigita.de>.
 2002-04-20 13:46:38 -07:00
hniksic
a9e97711fa [svn] Keep the commands list in sort order! 2002-04-19 02:24:32 -07:00
hniksic
123034fa83 [svn] Remove stray conflict marker. 2002-04-16 13:15:23 -07:00
hniksic
7953158bce [svn] Correctly merge DOS-like absolute directories. 
Published in <sxslmbomnm7.fsf@florida.arsdigita.de>.
 2002-04-15 18:36:16 -07:00
hniksic
426bf23ae1 [svn] If content-type is not given, assume text/html. 2002-04-15 18:13:51 -07:00
hniksic
f8b4b8bd12 [svn] When downloading recursively, don't ignore rejection of HTML 
documents that are themselves leaves of recursion.
 2002-04-15 14:57:10 -07:00
abbotti
4c11f1b269 [svn] Updated several dependencies for object files, taking account of nested 
include files.
Submitted by Ian Abbott.
 2002-04-15 13:15:43 -07:00
abbotti
56698ffd1d [svn] Updated dependencies of connect$o to include utils.h 2002-04-15 12:10:23 -07:00
abbotti
caa0f23be3 [svn] Fix broken Windows builds due to the xxx_with_timeout stuff. 
Submitted by Ian Abbotti in <3CBB2FFE.20193.73A594@localhost>.
 2002-04-15 12:01:56 -07:00
hniksic
036f99c801 [svn] Extend the timeout to DNS lookups. 
Published in <sxsn0w57ldh.fsf@florida.arsdigita.de>.
 2002-04-14 19:21:38 -07:00
hniksic
fbf0306dd7 [svn] Have number_to_string handle the case when number < -MAX_INT. 
Published in <sxs662uf7l9.fsf@florida.arsdigita.de>.
 2002-04-14 12:18:33 -07:00
hniksic
081e4eb4f4 [svn] Use a marginally faster implementation of binary search. 
Published in <sxs662uf7l9.fsf@florida.arsdigita.de>.
 2002-04-14 11:39:43 -07:00
hniksic
0eee8f8b25 [svn] Document --post-data' and --post-file'. 2002-04-13 22:31:11 -07:00
hniksic
9f2cc07924 [svn] Minor cleanup of iread/iwrite. 
Published in <sxsk7raj1t2.fsf@florida.arsdigita.de>.
 2002-04-13 22:19:27 -07:00
hniksic
5cb8a6f44d [svn] Add the POST method. 
Published in <sxssn5yj4eb.fsf@florida.arsdigita.de>.
 2002-04-13 21:22:47 -07:00
hniksic
f3d3a50a56 [svn] Generalize connect_with_timeout into run_with_timeout. 
Published in <sxs4rifxndi.fsf@florida.arsdigita.de>.
 2002-04-13 15:18:28 -07:00
hniksic
5390ada318 [svn] Support FWTK-style proxies. 
Pbublished in <sxslmbsxptu.fsf@florida.arsdigita.de>.
 2002-04-12 20:04:47 -07:00
hniksic
278b63093f [svn] Remove stray conflict marker. 2002-04-12 13:28:05 -07:00
hniksic
faf77c8f51 [svn] Only define _VA_LIST when compiling with gcc. 
Published in <sxsit6w1x5t.fsf@florida.arsdigita.de>.
 2002-04-12 13:27:18 -07:00
abbotti
4aaf8fdcea [svn] Compensate for MS Windows two-second granularity of file modification 
timestamps.
Submitted by Ian Abbott in <3CB7355C.21011.2134FDA@localhost>.
 2002-04-12 12:21:02 -07:00
abbotti
cfd7b9a951 [svn] Use new function to test filename for common html suffixes. 
Submitted by Ian Abbott in <3CB72D29.4898.1F34872@localhost> with minor
changes to formatting and comments.
 2002-04-12 11:53:39 -07:00
hniksic
2a72eef0af [svn] Define _VA_LIST to prevent Solaris stdio.h from declaring va_list. 
Published in <sxs1ydk4vg0.fsf@florida.arsdigita.de>.
 2002-04-12 11:36:07 -07:00
abbotti
fa2fa7a100 [svn] Specify libtool mode explicitly when linking. 
Submitted by Ian Abbott in <3CB6F27B.15581.10E13BA@localhost>.
 2002-04-12 06:47:02 -07:00
hniksic
9de4909bea [svn] Update copyright years. 2002-04-11 18:23:23 -07:00
hniksic
0cd669109b [svn] Implement connect timeout. 
Published in <sxs1ydld8ha.fsf@florida.arsdigita.de>.
 2002-04-11 18:14:18 -07:00
hniksic
fca8dcf829 [svn] Use stdarg only if compiling with an ANSI C compiler. 2002-04-11 12:13:57 -07:00
hniksic
c77a16309f [svn] Don't allow initial_length to exceed total_length. 
Published in <sxssn62dq99.fsf@florida.arsdigita.de>.
 2002-04-11 11:51:26 -07:00
hniksic
8f93191f26 [svn] Convert URLs in <form action=...>. 
Published in <sxsit6yf7jo.fsf@florida.arsdigita.de>.
 2002-04-11 10:51:45 -07:00
hniksic
1375a89141 [svn] Allow Wget to be compiled with a K&R compiler. 
Published in <sxszo0af9k6.fsf@florida.arsdigita.de>.
 2002-04-11 10:49:32 -07:00
hniksic
485673c3a8 [svn] Make sure directory and file names are encoded the same way. 
Published in <sxsofgqmf6e.fsf@florida.arsdigita.de>.
 2002-04-11 08:25:51 -07:00
hniksic
8c3287dabf [svn] Remove the OPTIONS_DEFINED_HERE kludge. 
Published in <sxs4rijqmhv.fsf@florida.arsdigita.de>.
 2002-04-10 14:20:55 -07:00
hniksic
1600aaeaa6 [svn] Revert to calculating ETA based on average download speed. 
Published in <sxspu17sl10.fsf@florida.arsdigita.de>.
 2002-04-10 07:10:03 -07:00
hniksic
538307f151 [svn] Keep updating a subinterval until it reaches or exceeds a watermark. 
That way the measurement will be guaranteed to span a configurable
minimum of time.  The current default is 3s in 30 100ms intervals.

Published in <sxsu1qkszdb.fsf@florida.arsdigita.de>.
 2002-04-10 02:24:28 -07:00
hniksic
c292e8e153 [svn] Print the current download speed, rather than the average. 
Published in <sxs3cy4yacm.fsf@florida.arsdigita.de>.
 2002-04-09 15:10:01 -07:00
abbotti
c3c1c24f5c [svn] Fix for Borland's broken (on Win9X) `utime' function. 
Submitted by Ian Abbott in <3CB33A8E.15259.1E52AF@localhost>.
(Based on original patch by Chin-yuan Kuo in
<20020321015049.16722.qmail@web16202.mail.tpe.yahoo.com>.)
 2002-04-09 11:29:54 -07:00
hniksic
07d72c3cd3 [svn] Propagate the result of ftp_retrieve_glob to the caller of ftp_loop. 
Published in <sxssn663zwl.fsf@florida.arsdigita.de>.
 2002-04-08 09:43:36 -07:00
abbotti
80a90d6d2c [svn] Updated several dependencies for object files. 
Submitted by Ian Abbott in <3C9F8BA4.19135.14568BF@localhost>.
 2002-03-26 10:59:44 -08:00
abbotti
9f485af560 [svn] Dependcies update for src/mswindows.c. 
Submitted by Ian Abbott in <3C98D8C6.31335.36EB6F@localhost>.
 2002-03-20 10:56:45 -08:00
abbotti
47a8225eda [svn] Don't include netdb.h on windows. 
Submitted by Ian Abbott in <3C964B8C.18942.D3115@localhost>.
 2002-03-18 12:21:58 -08:00
hniksic
1fa3b90235 [svn] Handle starting URL of recursing download being non-parsable. 
Published in <sxszo26t33k.fsf@florida.arsdigita.de>.
 2002-02-18 22:09:57 -08:00
hniksic
562ab4ae8a [svn] (DO_REALLOC_FROM_ALLOCA): Multiply with sizeof(type) when calling 
xmalloc and memcpy.
Submitted by Andreas Damm in
<Pine.LNX.4.33.0202011632280.1281-200000@gate.rad-ab.u-net.com>.
 2002-02-18 21:32:59 -08:00
hniksic
667d494978 [svn] Only include Unix-specific includes #ifndef WINDOWS. 2002-02-18 21:25:42 -08:00
hniksic
75a080ad0d [svn] Follow https links from http. 
Submitted by Christian Lackas in <20020211202444.GA20371@lackas.desy.de>.
 2002-02-18 21:23:35 -08:00
hniksic
57f36f8a6a [svn] Add the necessary includes for compilation under FreeBSD. 
Submitted by Alan Eldridge in <200202130630.g1D6U3S07907@wwweasel.geeksrus.net>.
 2002-02-18 21:21:42 -08:00
hniksic
a9ff5853a9 [svn] when -c used, mark already fully retrieved file as successfully retrieved. 
Submitted by Ian Abbott in <3C6019F4.30803.FF43E9@localhost>.
 2002-02-18 21:18:43 -08:00
hniksic
b9e90c34b4 [svn] Don't treat '?' as a query string separator when parsing FTP URLs. 
Published in <sxslmdqxdmq.fsf@florida.arsdigita.de>.
 2002-02-18 21:09:14 -08:00
hniksic
0e40fc9a3c [svn] Don't crash on <meta http-equiv=refresh>. 
Published in <sxshep1q3je.fsf@florida.arsdigita.de>.
 2002-01-31 19:34:31 -08:00
hniksic
a861f718ed [svn] Enable compilation on Windows. 
Submitted by Herold Heiko in
<B11A7CEC1675D511A3890002A551AD7C37D8AE@srvnt08.previnet.it>.
 2002-01-30 18:23:04 -08:00
hniksic
6c4c785cc2 [svn] Remove redirection cycle detection. 
Published in <sxs7kpzhcwa.fsf@florida.arsdigita.de>.
 2002-01-30 11:12:20 -08:00
hniksic
f2bb99d102 [svn] Wrap numeric IPv6 addresses in square brackets when sending out HTTP 
`Host' header.
Published in <sxs7kq4vgzf.fsf@florida.arsdigita.de>.
 2002-01-26 15:19:10 -08:00
hniksic
1bea726393 [svn] Allow all hex digits in IPv6 IP addresses. 
Published in <sxsofjgvo72.fsf@florida.arsdigita.de>.
 2002-01-26 12:43:17 -08:00
hniksic
774c7c7461 [svn] *** empty log message *** 2002-01-26 11:01:39 -08:00
hniksic
ef1eda86c4 [svn] Allow IPv6 numeric addresses in URLs. 
Submitted in <sxsu1t9uedf.fsf@florida.arsdigita.de>.
 2002-01-26 11:00:38 -08:00
hniksic
a69cb0c3ad [svn] Various IPv6 fixes. 
Submitted in <sxsd6zz2jf7.fsf@florida.arsdigita.de>.
 2002-01-24 19:34:23 -08:00
hniksic
853a1c9e35 [svn] Fix some IPv6-related problems. 
Submitted in <sxsg04w6zl6.fsf@florida.arsdigita.de>.
 2002-01-23 22:19:35 -08:00
hniksic
cb40034035 [svn] Commit IPv6 support by Thomas Lussnig. 
Published in <sxsk7u8715e.fsf@florida.arsdigita.de>.
 2002-01-23 21:45:54 -08:00
hniksic
e59a7ee8ac [svn] Make -P work on Windows. 
Submitted by Ian Abbott in <3C447E8F.13424.16ED42@localhost>.
 2002-01-16 17:03:33 -08:00
hniksic
fb2ed23830 [svn] Skip initial whitespace before testing for EOL. 
Submitted in <sxsu1tl6bf2.fsf@florida.arsdigita.de>.
 2002-01-16 16:59:13 -08:00
hniksic
31d20e644c [svn] select the file descriptor only if no data is pending in SSL buffers. 
Submitted by tony@bluetail.com.
Published in <sxslmezocyp.fsf@florida.arsdigita.de>.
 2002-01-15 07:24:19 -08:00
hniksic
08c935bef2 [svn] Strip trailing whitespace in header_process(). 
Published in <sxsadvh0xpz.fsf@florida.arsdigita.de>.
 2002-01-14 07:17:34 -08:00
hniksic
46617228fa [svn] URL-decode user and password in URL. 
Published in <sxsita52hg6.fsf@florida.arsdigita.de>.
 2002-01-14 05:26:16 -08:00
hniksic
524a1f54dc [svn] Handle links to relative "net locations," e.g. <a href="//www.server.com/">. 2002-01-13 17:56:40 -08:00
hniksic
cafe798fec [svn] Invalidate socket if get_contents encountered an error. 
Published in <sxsita54sqy.fsf@florida.arsdigita.de>.
 2002-01-13 17:39:16 -08:00
hniksic
90afc592e4 [svn] Bumped version number to 1.8.1+cvs. 2001-12-29 02:15:55 -08:00
hniksic
11745f55bf [svn] Bump version to 1.8.1. 2001-12-24 13:02:25 -08:00
hniksic
a92b46f8ae [svn] Bump version. 2001-12-19 08:30:47 -08:00
hniksic
5c859be2d4 [svn] Bump version to 1.8.1-pre3. 2001-12-19 06:59:01 -08:00
hniksic
8db1264218 [svn] Enqueue start_url in the canonical form. 
Published in <sxsofkvi8zx.fsf@florida.arsdigita.de>.
 2001-12-19 06:27:29 -08:00
hniksic
001cac91a4 [svn] Check for requested verbosity in logputs. 
Published in <sxswuzjk0v6.fsf@florida.arsdigita.de>.
 2001-12-19 01:36:58 -08:00
hniksic
ca9319aaba [svn] Treat the "shortcut icon" link as inline. 
Published in <sxsadwgko2q.fsf@florida.arsdigita.de>.
 2001-12-18 17:15:34 -08:00
hniksic
2cf87bea8b [svn] Fix crash introduced by previous patch. 2001-12-18 14:20:14 -08:00
hniksic
40fd876c57 [svn] Descend into HTML files we've already downloaded. 2001-12-18 14:14:31 -08:00
hniksic
a45e8255cc [svn] Allow standalone compilation of html-parse.c. 2001-12-18 11:33:36 -08:00
hniksic
416671063a [svn] Propagate referrer information from retrieve_tree to retrieve_url. 
Submitted by Ian Abbott in <3C1F4BFE.17436.D2D7B2@localhost>.
 2001-12-18 07:22:03 -08:00
hniksic
daa2fd1afd [svn] Bump version. 2001-12-17 09:04:27 -08:00
hniksic
f03f033bf3 [svn] Bump version to 1.8.1-pre2. 2001-12-17 07:24:14 -08:00
hniksic
eb0f9de05d [svn] Simplify indentation in sleep_between_retrievals. 2001-12-17 07:00:25 -08:00
hniksic
75699d6213 [svn] Use the new function `random_number' that doesn't depend on RAND_MAX 
being defined.
Published in <sxsheqqq6xb.fsf@florida.arsdigita.de>.
 2001-12-17 06:05:08 -08:00
hniksic
a3500d32d7 [svn] Move path_simplify to url.c. 2001-12-14 07:46:00 -08:00
hniksic
0f120eee66 [svn] Fix error message when $WGETRC not found. 
Published in <sxswuzrylnm.fsf@florida.arsdigita.de>.
 2001-12-13 11:19:03 -08:00
hniksic
f031900662 [svn] Don't abort when one URL references more than one file. 
Published in <sxs1yhz0w1m.fsf@florida.arsdigita.de>.
 2001-12-13 11:18:31 -08:00
hniksic
5b575eef31 [svn] Check for conn->ssl before using ssl_iwrite. 2001-12-13 08:46:56 -08:00
hniksic
92676dafee [svn] Bump version. 2001-12-13 01:47:51 -08:00
hniksic
6821132a4d [svn] Bump version to 1.8.1-pre1. 2001-12-12 23:40:50 -08:00
hniksic
3b44ca73ab [svn] Fix the broken URLs that pointed to info.webcrawler.com to point to 
the new www.robotstxt.org site.
 2001-12-12 23:29:05 -08:00
hniksic
3ddcea34a4 [svn] Mark <embed href=...> as external. 2001-12-12 23:18:59 -08:00
hniksic
b9f370004d [svn] Cosmetic changes to get_urls_html. 2001-12-12 11:06:10 -08:00
hniksic
390adeea93 [svn] Use "incomplete" rather than "relative". 2001-12-12 10:32:17 -08:00
hniksic
d425985c37 [svn] Minor doc update. 2001-12-12 09:01:26 -08:00
hniksic
8817f4c1a4 [svn] Break up collect_tags_mapper into several functions. 
Published in <sxsg06gla1h.fsf@florida.arsdigita.de>.
 2001-12-12 07:43:01 -08:00
hniksic
1dee527a56 [svn] Use a typedef for IPv4 address. 
Published in <sxsn10qrwbj.fsf@florida.arsdigita.de>.
 2001-12-11 00:32:58 -08:00
hniksic
b8789d7798 [svn] Fix obvious memory leaks in the VMS directory parser. 
Published in <sxsadwqpbo1.fsf@florida.arsdigita.de>.
 2001-12-10 21:29:52 -08:00
hniksic
1365950c01 [svn] Logging system bugfixes and improvements. 
Published in <sxsofl7vdyo.fsf@florida.arsdigita.de>.
 2001-12-09 21:31:45 -08:00
hniksic
7d65f1b896 [svn] Doc update in read_whole_line. 2001-12-09 19:34:48 -08:00
hniksic
fb9368e889 [svn] Restore sanity check in address_list_set_faulty. 2001-12-09 18:33:08 -08:00
hniksic
943f657aa7 [svn] Rename long_to_string to number_to_string, and make it return a useful 
value.
 2001-12-09 18:29:12 -08:00
hniksic
997a87548c [svn] Minor fix for path_simplify. 
Submitted in <sxsheqzx1qv.fsf@florida.arsdigita.de>.
 2001-12-09 18:12:17 -08:00
hniksic
0e72aa6e13 [svn] Rewrite path_simplify. 
Published in <sxspu5nx2yi.fsf@florida.arsdigita.de>.
 2001-12-09 17:58:37 -08:00
hniksic
233fcbc44d [svn] Would abort when given invalid progress type. 
Published in <sxsg06kxc9g.fsf@florida.arsdigita.de>.
 2001-12-09 14:25:34 -08:00
hniksic
e521ee38ff [svn] Remove stray debugging message. 
Published in <sxszo4sxjpw.fsf@florida.arsdigita.de>.
 2001-12-09 11:44:20 -08:00
hniksic
0a89fc1a10 [svn] Fix a minor ETA padding glitch. 
Published in <sxs667hyp19.fsf@florida.arsdigita.de>.
 2001-12-08 20:51:40 -08:00
hniksic
cdc0cc0c1a [svn] Bump version. 2001-12-08 20:33:47 -08:00
hniksic
fdd51b8d46 [svn] Bump version to 1.8. 2001-12-08 17:37:17 -08:00
hniksic
dd84231c6a [svn] Minor fixes prompted by `lint'. 
Published in <sxsadwt2nkg.fsf@florida.arsdigita.de>.
 2001-12-08 17:24:41 -08:00
hniksic
171feaa3f2 [svn] Bump version. 2001-12-07 21:08:57 -08:00
hniksic
60680e27db [svn] Release 1.8-pre2. 2001-12-07 19:44:23 -08:00
hniksic
bfd017746b [svn] Doc fix. 2001-12-06 02:48:09 -08:00
hniksic
4e5bbd646b [svn] Various progress-bar related fixes. 
Published in <sxspu5slja3.fsf@florida.arsdigita.de>.
 2001-12-06 02:45:27 -08:00
hniksic
7c6f905f94 [svn] Bump version. 2001-12-05 23:23:55 -08:00
hniksic
760e87d7a0 [svn] Bump version to 1.8-pre1. 2001-12-05 23:17:20 -08:00
hniksic
39b2248bde [svn] Fall back to dot progress when forced to background. 
Published in <sxs1yi8n7lx.fsf@florida.arsdigita.de>.
 2001-12-05 23:14:35 -08:00
hniksic
00407b0762 [svn] Update copyright year. 2001-12-05 21:54:50 -08:00
hniksic
f8e6feb6bc [svn] Fix varargs usage in logvprintf. 
Published in <sxs667knbe1.fsf@florida.arsdigita.de>.
 2001-12-05 21:53:21 -08:00
hniksic
fcf68c0e9a [svn] --sslegdsock' -> --egd-file' 
Published in <sxsadwwnc7h.fsf@florida.arsdigita.de>.
 2001-12-05 21:35:17 -08:00
hniksic
e16c0ba78e [svn] Add information about the beta releases. 2001-12-05 17:24:24 -08:00
hniksic
f5d20aef32 [svn] Make the message printed in ssl_init_prng translatable. 2001-12-05 17:15:05 -08:00
hniksic
0620ada923 [svn] Fix OpenSSL PRNG seeding. 
Published in <sxs7ks1noc4.fsf@florida.arsdigita.de>.
 2001-12-05 17:13:31 -08:00
hniksic
b248bfe395 [svn] Don't abort in read_whole_lines when a line begins with \0. 
Published in <sxsu1v5nrtg.fsf@florida.arsdigita.de>.
 2001-12-05 15:58:12 -08:00
hniksic
8a2ab60263 [svn] Fix overzealous URL-removal in register_download. 
Published in <sxszo4yqq91.fsf@florida.arsdigita.de>.
 2001-12-04 19:51:23 -08:00
hniksic
936b074bd9 [svn] Doc fix. 2001-12-04 16:02:49 -08:00
hniksic
eef4527c24 [svn] Doc fix. 2001-12-04 15:42:18 -08:00
hniksic
c9dbaba251 [svn] Turn off debugging function. 2001-12-04 15:30:36 -08:00
hniksic
0fdc1bd8c0 [svn] Fix downloading of duplicate URLs. 
Published in <sxsvgfmu2bj.fsf@florida.arsdigita.de>.
 2001-12-04 13:03:35 -08:00
hniksic
abf215c1e3 [svn] snprintf.c (dopr): Use `unsigned int' as the second argument to va_arg 
when casting to `unsigned short' is intended.
Submitted by Ian Abbott in <3C0CB09F.21762.34A1F1@localhost>.
 2001-12-04 04:44:58 -08:00
hniksic
f70c9c6ede [svn] Windows update from Herold Heiko. 2001-12-04 02:33:18 -08:00
hniksic
b5b08b8110 [svn] Bump version. 2001-12-04 01:50:01 -08:00
hniksic
e986f7dad3 [svn] Quote '?' as '%3F' in local files when `--html-extension' is turned on. 
Published in <sxszo4ztiwr.fsf@florida.arsdigita.de>.
 2001-12-04 01:49:37 -08:00
hniksic
16b1387c7c [svn] Bump version. 2001-12-03 12:49:54 -08:00
hniksic
79f868cd0f [svn] Cast va_arg(..., int) to short if a short value is expected. 
Published in <sxsbshgxfs5.fsf@florida.arsdigita.de>.
 2001-12-03 11:31:17 -08:00
hniksic
f58c338aea [svn] snprintf.c: Replace short int' and unsigned short int' with `int' when 
using it as the second argument to `va_arg'.
Published in <sxsu1v8xisg.fsf@florida.arsdigita.de>.
 2001-12-03 10:28:08 -08:00
hniksic
29a338cc58 [svn] Use address_list_new_one. 
Published in <sxsbshgyz71.fsf@florida.arsdigita.de>.
 2001-12-03 09:48:12 -08:00
hniksic
400201444f [svn] Don't initialize TMPSTORE directly. 
Submitted by Andre Majorel.
 2001-12-03 09:31:23 -08:00
hniksic
6d93a95e37 [svn] Declare h_errno in host.c, but not elsewhere. 2001-12-03 09:22:06 -08:00
hniksic
f5799945b0 [svn] file_merge: if BASE doesn't contain a slash, just return a copy of FILE. 
Published in <sxssnatmh6s.fsf@florida.arsdigita.de>.
 2001-12-02 13:44:16 -08:00
hniksic
eb3cfe157a [svn] Bump version. 2001-12-02 08:40:37 -08:00
hniksic
d9d9bb2749 [svn] Bump version to 1.8-beta2. 2001-12-01 14:23:12 -08:00
hniksic
acf2d79a8a [svn] When PWD fails, assume "/". 
Published in <sxs667qr5a0.fsf@florida.arsdigita.de>.
 2001-12-01 13:37:40 -08:00
hniksic
8b2a216c77 [svn] Make --base -i work. 
Published in <sxsoflisqcf.fsf@florida.arsdigita.de>.
 2001-12-01 11:17:19 -08:00
hniksic
07e6be3527 [svn] Don't document `-nh' in --help output. 
Published in <sxs4rnau642.fsf@florida.arsdigita.de>.
 2001-12-01 10:51:32 -08:00
hniksic
d6064a4a94 [svn] Minor doc fix. 2001-12-01 09:48:34 -08:00
hniksic
569fd61c95 [svn] Use the full path when building the authorization line. 
Published in <sxsitbqu9iw.fsf@florida.arsdigita.de>.
 2001-12-01 09:39:07 -08:00
hniksic
3ff0a9ad00 [svn] Minor tweak in path_matches in cookies.c. 2001-12-01 07:34:55 -08:00
hniksic
57dd93f915 [svn] Don't expect HTTP paths to begin with '/'. 
Published in <sxsvgfrv7ky.fsf@florida.arsdigita.de>.
 2001-11-30 21:22:17 -08:00
hniksic
92b269acad [svn] Match hosts against domains per Netscape cookie "specification". 
Published in <sxszo53v8by.fsf@florida.arsdigita.de>.
 2001-11-30 21:08:03 -08:00
hniksic
f4d019a423 [svn] Correctly convert links in <meta http-equiv=Refresh content="...">. 
Published in <sxsadx3wp49.fsf@florida.arsdigita.de>.
 2001-11-30 20:18:51 -08:00
hniksic
4901488011 [svn] Bump version to 1.8-beta1+cvs. 2001-11-30 19:21:52 -08:00
hniksic
1f272be070 [svn] Bump version to 1.8-beta1. 2001-11-30 19:09:14 -08:00
hniksic
7ab7f93f8d [svn] Make -p work with framed pages. 
Published in <sxsu1vby71t.fsf@florida.arsdigita.de>.
 2001-11-30 19:06:41 -08:00
hniksic
406fb8bbef [svn] Don't allow more than 20 successive redirections. 2001-11-30 13:33:31 -08:00
hniksic
a4db28e20f [svn] Ignore -np when in -p mode. 
Published in <sxsg06w2c52.fsf@florida.arsdigita.de>.
 2001-11-30 13:17:53 -08:00
hniksic
ca5098a425 [svn] Update copyright statement. 2001-11-30 02:50:29 -08:00
hniksic
c828d1e8be [svn] Remove doc reference to non-extant ngethostbyname. 2001-11-30 02:44:17 -08:00
hniksic
5baed885db [svn] Fix netrc authorization in conjunction with HTTP. 
Submitted by Daniel BODEA in <011901c162ca$19779df0$25c0a8c0@GHOTIX>.
 2001-11-30 01:33:22 -08:00
hniksic
2c37aef2d8 [svn] Don't forget to shutdown the SSL structure if the socket times out. 
Submitted by T. Bharath in <3B3DEBC7.2537186A@responsenetworks.com>.
 2001-11-30 00:57:03 -08:00
hniksic
b4b0659e43 [svn] Fix preprocessor indentation. 2001-11-30 00:36:22 -08:00
hniksic
7674ecd97e [svn] Simplify display_image. 2001-11-30 00:02:33 -08:00
hniksic
ae3c268719 [svn] Implement EGD support. 
Submitted by Christian Fraenkel in <005501c17920$1312d440$4a05a8c0@isn>.
 2001-11-29 23:39:08 -08:00
hniksic
999388bfa0 [svn] Check for memmove and implement one if it's missing. 2001-11-29 11:43:29 -08:00
hniksic
b6bbc32e14 [svn] Guard against header files getting included twice. 2001-11-29 10:55:52 -08:00
hniksic
b65661a879 [svn] Remove char/unsigned char warnings emitted by Sun cc. 2001-11-29 10:48:43 -08:00
hniksic
fb98d1e4b0 [svn] Remove implicit declaration warnings. 2001-11-29 10:22:18 -08:00
hniksic
a3d3d452ab [svn] Make the MD5 references even more generic. 
Use OpenSSL's MD5 where available.
Published in <sxsg06x4f41.fsf@florida.arsdigita.de>.
 2001-11-29 10:17:54 -08:00
hniksic
39482df431 [svn] descend_url_p: When resolving no_parent, compare with the start url, 
not the parent url.
Published in <sxspu614ikm.fsf@florida.arsdigita.de>.
 2001-11-29 09:04:28 -08:00
hniksic
c99228cab2 [svn] Debugging function. 2001-11-29 06:57:30 -08:00
hniksic
9c1c7f27cd [svn] Windows fixes by Herold Heiko. 2001-11-29 06:15:11 -08:00
hniksic
bb8e524316 [svn] Initialize al->faulty. 
Published in <sxsvgft65an.fsf@florida.arsdigita.de>.
 2001-11-29 06:06:03 -08:00
hniksic
6218fbed2b [svn] Accept the broken Content-Range format emitted by Sun's server. 
Published in <sxsg06x7kld.fsf@florida.arsdigita.de>.
 2001-11-29 06:03:33 -08:00
hniksic
fb7fb36cb8 [svn] Resurrect opt.dot_style. 2001-11-27 18:44:18 -08:00
hniksic
f0dff25336 [svn] Fix typo. 2001-11-27 18:24:22 -08:00
hniksic
d4c6949a05 [svn] Use rand instead of random. 
Published in <sxsu1vgataq.fsf@florida.arsdigita.de>.
 2001-11-27 11:49:28 -08:00
hniksic
9b202ba261 [svn] * retr.c (retrieve_from_file): Initialize `new_file' to NULL to 
prevent seg fault.
Submitted by Ian Abbott in <3C03DE8A.845.D0E495@localhost>.
 2001-11-27 11:14:34 -08:00
hniksic
8196a09904 [svn] Don't reuse IP addresses proven to be faulty, unless only such ones remain. 
Published in <sxs8zcsfemf.fsf@florida.arsdigita.de>.
 2001-11-27 06:55:40 -08:00
hniksic
cca7541b10 [svn] Don't translate %d-%d. 2001-11-27 04:58:09 -08:00
hniksic
1c906e47d3 [svn] Remove stray HAVE_RANDOM check from main.c. 2001-11-27 04:54:31 -08:00
hniksic
9656223552 [svn] Fix FTP PASV output. 
Published in <sxslmgsfkgj.fsf@florida.arsdigita.de>.
 2001-11-27 04:49:13 -08:00
hniksic
baf8750197 [svn] Default the progress implementation to "bar". 
Published in <sxsu1vgfqx7.fsf@florida.arsdigita.de>.
 2001-11-27 02:29:45 -08:00
hniksic
69c78db55b [svn] Commence bar progress with two newlines. 2001-11-27 02:17:09 -08:00
hniksic
7175ea4a12 [svn] Check for random. 
Published in <sxs4rngh6t2.fsf@florida.arsdigita.de>.
 2001-11-27 02:11:13 -08:00
hniksic
bae3162c03 [svn] New option `--limit-rate'. 
Published in <sxsd725cn56.fsf@florida.arsdigita.de>.
 2001-11-26 12:07:13 -08:00
hniksic
278fb2412d [svn] Declare ERR in gethttp. 
Submitted by Ian Abbott in <3C022295.15135.464B54@localhost>.
 2001-11-26 04:51:25 -08:00
hniksic
84396de673 [svn] Allocate a timer directly in get_contents. 
Published in <sxsherhbsvl.fsf@florida.arsdigita.de>.
 2001-11-26 04:49:10 -08:00
hniksic
024cb5ed3a [svn] A lot of host name changes. 
Published in <sxs3d32856s.fsf@florida.arsdigita.de>.
 2001-11-25 21:36:33 -08:00
hniksic
f6921edc73 [svn] Be careful whether we want to descend into results of redirection. 
Published in <sxs7kse8hmq.fsf@florida.arsdigita.de>.
 2001-11-25 17:11:48 -08:00
hniksic
2c41d783c6 [svn] New option --random-wait. 
Submitted by Alan Eldridge in
<200111042106.fA4L63b75804@wwweasel.geeksrus.net>.
 2001-11-25 13:23:15 -08:00
hniksic
3afb9c659a [svn] Recursion and progress bar tweaks. 
Published in <sxsd727cvc0.fsf@florida.arsdigita.de>.
 2001-11-25 13:03:30 -08:00
hniksic
df05e7ff10 [svn] Handle <base href=...> when converting links. 
Published in <sxsadxaae3t.fsf@florida.arsdigita.de>.
 2001-11-25 10:40:55 -08:00
hniksic
2e6e3f21f8 [svn] Attempt to quote '?' as "%3F" when linking to local files. 
Given up on the attempt, as it breaks local browsing.
 2001-11-25 09:44:28 -08:00
hniksic
95631700f7 [svn] Remove host canonicalization code. 
Published in <sxsg072ai5v.fsf@florida.arsdigita.de>.
 2001-11-25 09:13:20 -08:00
hniksic
05463c7121 [svn] Commit progress bar tweaks. 
Published in <sxsd727cvc0.fsf@florida.arsdigita.de>.
 2001-11-24 20:46:26 -08:00
hniksic
222e9465b7 [svn] Implemented breadth-first retrieval. 
Published in <sxsherjczw2.fsf@florida.arsdigita.de>.
 2001-11-24 19:10:34 -08:00
hniksic
b88223f99d [svn] Don't modify bp->total_length if it equals zero. 2001-11-24 10:05:57 -08:00
hniksic
177b6ee8fd [svn] Print the actual error message when parsing of redirection URL fails. 2001-11-24 06:02:10 -08:00
hniksic
212eb1ddaf [svn] Fake a miniscule amount of download time when none is detected. 2001-11-23 18:38:47 -08:00
hniksic
1da2947d50 [svn] Fix typo that made us never use robots.txt. 2001-11-23 17:48:28 -08:00
hniksic
87ed8be305 [svn] Don't translate "%ld ". 2001-11-23 12:20:40 -08:00
hniksic
4f91014e3f [svn] Allow the user to force bar progress. 
Published in <sxs8zcxh2x5.fsf@florida.arsdigita.de>.
 2001-11-23 08:24:06 -08:00
hniksic
49b93249b1 [svn] Seed OpenSSL's RNG. 
Submitted by Lemble Gregory.
 2001-11-23 08:18:41 -08:00
hniksic
905472770e [svn] Minor progress bar fixes. 
Published in <sxsn11dh3fc.fsf@florida.arsdigita.de>.
 2001-11-23 08:12:53 -08:00
hniksic
eb9a02b828 [svn] Minor fix for the new progress bar. 2001-11-22 21:09:39 -08:00
hniksic
8e082d2558 [svn] Remove accidentally committed DEBUG_MALLOC. 2001-11-22 21:01:32 -08:00
hniksic
cdcf67a5bd [svn] Big progress bar update. 
Published in <sxsn11ehyn1.fsf@florida.arsdigita.de>.
 2001-11-22 20:59:52 -08:00
hniksic
4d352013ac [svn] Replace opt.no_flush with a function to disable/enable flushing. 
Published in <sxssnb6imyz.fsf@florida.arsdigita.de>.
 2001-11-22 12:13:13 -08:00
hniksic
d5be8ecca4 [svn] Rewrite parsing and handling of URLs. 
Published in <sxs4rnnlklo.fsf@florida.arsdigita.de>.
 2001-11-21 16:24:28 -08:00
hniksic
f4dcb55851 [svn] Split the copyright notice for easier translation. 2001-11-21 15:15:19 -08:00
hniksic
0296433553 [svn] Support the SIZE command. 
Originally by Dave Turner.  Modified by Ian Abbott and published
in <3BFAA33C.6236.6D42F6@localhost>.
 2001-11-20 13:01:27 -08:00
hniksic
a24b3d50f0 [svn] Don't use the now-obsolete TYPE variable. 
Published in <sxswv0ledyx.fsf@florida.arsdigita.de>.
 2001-11-20 08:03:41 -08:00
hniksic
94c5b23136 [svn] Handle shorthands in proxy URLs. 
Published in <sxs6686py1q.fsf@florida.arsdigita.de>.
 2001-11-19 08:15:42 -08:00
hniksic
de7f766f58 [svn] Remove --wait/--waitretry compatibility code. 
Published in <sxs6686py1q.fsf@florida.arsdigita.de>.
 2001-11-19 07:42:56 -08:00
hniksic
e8e8797873 [svn] Rewrite shorthand URLs in a step separate from parsing. 
Published in <sxspu6f7ecz.fsf@florida.arsdigita.de>.
 2001-11-18 17:14:14 -08:00
hniksic
f178e6c613 [svn] Clean up handling of schemes. 
Published in <sxswv0n7h7s.fsf@florida.arsdigita.de>.
 2001-11-18 16:12:05 -08:00
hniksic
303f406997 [svn] Don't list all the "known" (but unsupported) protocols. Instead, just 
skip the characters until the first ':'.
Published in <sxsitc8a848.fsf@florida.arsdigita.de>.
 2001-11-17 22:49:09 -08:00
hniksic
ee99e8998a [svn] Don't compile getopt.c on systems that already have getopt_long. 
Published in <sxshersbs0w.fsf@florida.arsdigita.de>.
 2001-11-17 20:52:18 -08:00
hniksic
d408dec0bd [svn] Use Solaris's libmd5 when available. 
Published in <sxsn11kbssm.fsf@florida.arsdigita.de>.
 2001-11-17 20:36:21 -08:00
hniksic
09b0fe29a8 [svn] Initialize vars to appease the compiler. 
Published in <sxszo5kbxs3.fsf@florida.arsdigita.de>.
 2001-11-17 20:14:12 -08:00
hniksic
6ef5baa07b [svn] Prettier printing of HTTP headers. 
Published in <sxs4rnsdcw1.fsf@florida.arsdigita.de>.
 2001-11-17 18:36:30 -08:00
hniksic
22bfc65534 [svn] Use 1.8-dev as version. 2001-11-17 18:19:45 -08:00
hniksic
05f90bb302 [svn] Plug in new implementation of RES. 
Published in <sxselmwddt0.fsf@florida.arsdigita.de>.
 2001-11-17 18:17:30 -08:00
hniksic
12c8ef1796 [svn] *** empty log message *** 2001-11-17 17:34:25 -08:00
hniksic
10269645bc [svn] Bumped version to 1.7.1. 2001-11-17 17:30:12 -08:00
hniksic
e798e61c06 [svn] Minor doc addition. 2001-11-17 10:03:57 -08:00
hniksic
2fe30df466 [svn] Bump version to 1.7.1-pre3. 2001-11-16 15:20:17 -08:00
hniksic
cbc468efed [svn] Bumped version to 1.7-pre2. 2001-11-16 13:41:51 -08:00
hniksic
1a96dcfcb8 [svn] Ignore trailing whitespace in header_extract_number. 
Published in <sxsheruo5gn.fsf@florida.arsdigita.de>.
 2001-11-16 11:57:43 -08:00
hniksic
3d9dda6485 [svn] Process attributes in order in which they appear in the tag. 
Submitted by Ian Abbott in <3B868388.6538.14A7848@localhost>
based on analysis by Edward Sabol.
 2001-11-16 11:44:42 -08:00
hniksic
fa6aeb869d [svn] Don't call rate() with bogus data. 
Submitted by Ian Abbott in <3B7A98A1.24985.9EF692@localhost>
 2001-11-16 11:38:03 -08:00
hniksic
90cdb82942 [svn] Use 0x22 instead of '"' or '\"'. 2001-11-16 09:26:42 -08:00
hniksic
ac74e16638 [svn] Applied Christian Fraenkel's patch from <3BAF5B30.189077D6@gmx.net>. 
Print SSL errors when connecting fails.
 2001-11-16 09:06:25 -08:00
hniksic
d60b54cba0 [svn] Applied Chris Seawood's patch for compilation under BEOS. 
Patch published in <3B5D4CEF.5090208@seawood.org>.
 2001-11-16 08:58:08 -08:00
hniksic
0c42479322 [svn] Applied Edward Sabol's patch from 
<200106131813.f5DIDss1294858@alderaan.gsfc.nasa.gov>.
It fixes a memory leak in url_equal, and comments it out,
as it's unused.
 2001-11-16 08:49:19 -08:00
hniksic
0ce7b6bffc [svn] Support XML-style empty tags. 2001-11-16 08:44:34 -08:00
hniksic
b4e6054de9 [svn] Check for do_realloc_newsize in loop condition because we're no longer 
setting SIZEVAR here.
 2001-06-26 02:48:51 -07:00
hniksic
d015d3cbd3 [svn] Fix access violation bug in DO_REALLOC_FROM_ALLOCA. 
Published in <sxspubriqay.fsf@florida.arsdigita.de>.
 2001-06-26 01:45:09 -07:00
hniksic
e98fca84a3 [svn] Allow more characters in attribute name. 
Published in <sxsr8wi9jeo.fsf@florida.arsdigita.de>.
 2001-06-18 11:49:33 -07:00
hniksic
e1f4cff68c [svn] Make sure that slashes don't sneak in as part of file name via 
query string.
Published in <sxsu21eb3te.fsf@florida.arsdigita.de>.
 2001-06-18 02:08:04 -07:00
hniksic
91ac958e45 [svn] Set version to 1.7.1-pre1. 2001-06-15 02:29:00 -07:00
hniksic
2255a89b24 [svn] After canonicalizing the URL, check for its existence among undesirable_urls. 
Published in <sxs7kyeohte.fsf@florida.arsdigita.de>.
 2001-06-14 14:48:00 -07:00
hniksic
f918e0ab51 [svn] Docfix. 2001-06-14 14:15:43 -07:00
hniksic
c77d880776 [svn] Search netrc with the proper host name, not the proxy one. 2001-06-14 13:55:02 -07:00
hniksic
8f6b4f5bbb [svn] Define MAP_FAILED if it's missing. 
Published in <sxshexirelo.fsf@florida.arsdigita.de>.
 2001-06-14 13:28:19 -07:00
janp
46550636fe [svn] Provide correct prototype for ftp_parse_ls(). Pointed out by Bernhard Simon 
<bs@bsws.zid.tuwien.ac.at> in <200106071409.QAA08208@bsws.zid.tuwien.ac.at>.
 2001-06-09 10:44:07 -07:00
hniksic
6b9ac2db84 [svn] Increase version to 1.7. 2001-06-04 03:45:20 -07:00
hniksic
e6742c2313 [svn] ftp-ls.c typo fix by Karl Eichwalder. 2001-06-03 06:26:41 -07:00
hniksic
0b056d1720 [svn] Update copyright notices. 2001-05-27 12:35:15 -07:00
hniksic
b94a5c0e37 [svn] Released 1.7-pre1. 2001-05-26 03:01:45 -07:00
hniksic
6b405f2b66 [svn] Commit administrative changes in preparation for the 1.7 
prerelease.
Published in <sxsd78wwiwj.fsf@florida.arsdigita.de>.
 2001-05-26 02:38:24 -07:00
hniksic
2f298afc47 [svn] Don't include <sys/time.h> here. 
Published in <sxsae4gvtnb.fsf@florida.arsdigita.de>.
 2001-05-14 08:27:56 -07:00
hniksic
36eba40905 [svn] Make sure cookie code works with the real URL data, not the proxy one. 
Published in <sxsg0e8z3bp.fsf@florida.arsdigita.de>.
 2001-05-14 02:32:11 -07:00
hniksic
72eca0976b [svn] Commit several minor changes: 
* main.c (print_help): Document `--no-http-keep-alive'.

* utils.c (numdigit): Handle negative numbers *correctly*.

* hash.c (make_nocase_string_hash_table): Use term "nocase" rather
than the confusing "unsigned".

* utils.c (string_set_contains): Renamed from string_set_exists.

* hash.c (hash_table_contains): Renamed from hash_table_exists.

* cookies.c: Move case-insensitive hash tables to hash.c.

Published in <sxsheyq9vvl.fsf@florida.arsdigita.de>.
 2001-05-12 13:06:41 -07:00
hniksic
9588e1af80 [svn] Before concluding that the file is already fully retrieved, make sure 
that the file existed and `Range' was actually requested.

Published in <sxseltwf4ks.fsf@florida.arsdigita.de>.
 2001-05-11 05:37:37 -07:00
hniksic
43ef870bd3 [svn] Minor cookie fixes. Published in <sxsheyu9yp6.fsf@florida.arsdigita.de>. 2001-05-09 11:15:22 -07:00
hniksic
105627124e [svn] Make sure hstat.no_truncate gets properly initialized. 
Published in <sxspudk6pdl.fsf@florida.arsdigita.de>.
 2001-05-08 04:47:05 -07:00
hniksic
50980de841 [svn] Avoid useless file_exists_p. Published in 
<sxsr8y17zav.fsf@florida.arsdigita.de>.
 2001-05-07 12:08:29 -07:00
janp
5ff5e936a5 [svn] Correct the conversion of month entries for NT and VMS. 2001-05-02 03:15:17 -07:00
hniksic
72b9bb6d92 [svn] Zero out SIN before using it. 
Published in <sxs3daq8zdg.fsf@florida.arsdigita.de>.
 2001-04-30 03:19:41 -07:00
hniksic
3973f20a45 [svn] Refuse to download files from scratch if `-c' is used and the server 
doesn't support REST only for existing *and non-empty* files.
Published in <sxsae4zg4zc.fsf@florida.arsdigita.de>.
 2001-04-29 07:24:45 -07:00
hniksic
00773e7d15 [svn] Make `--cookies' respect its arg. 
Published in <sxs4rv8ht5e.fsf@florida.arsdigita.de>.
 2001-04-29 03:56:43 -07:00
hniksic
dfc1eb5766 [svn] Change default anonymous FTP password to "-wget@". 
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
 2001-04-29 03:53:55 -07:00
hniksic
b44f1701b0 [svn] Use alloca to allocate filename_plus_orig_suffix. 
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
 2001-04-28 09:36:46 -07:00
hniksic
d70101ea4e [svn] Commit various HTTP fixes. 
Published in <sxsy9slhu7g.fsf@florida.arsdigita.de>.

* http.c (gethttp): Return RETRUNNEEDED when the retrieval is
unneeded because the file is already there and fully downloaded,
and -c is specified.
(http_loop): Handle RETRUNNEEDED.

* wget.h (uerr_t): New value RETRUNNEEDED.

* http.c (http_loop): Set no_truncate for files that both exist
and are non-empty.
(gethttp): Consider the download finished when restval >= contlen,
not only when restval==contlen.
(gethttp): Handle redirection before giving up due to -c.
(gethttp): Clarify error message which explains that -c will not
truncate the file.
(gethttp): When returning CONTNOTSUPPORTED, don't forget to free
the stuff that needs freeing and release the socket.

* main.c (print_help): Wget booleans accept "off", not "no".
 2001-04-28 09:22:20 -07:00
hniksic
c6e565fd33 [svn] Send the no-cache directive when required regardless of whether we're 
going through a proxy.
Published in <sxsitjqncbx.fsf@florida.arsdigita.de>.
 2001-04-26 22:26:44 -07:00
hniksic
26ddb28a7c [svn] Improve documentation of mktime_from_utc. 
Rearrange http_atotm.
Published in <sxsoftjlyku.fsf@florida.arsdigita.de>.
 2001-04-26 22:11:38 -07:00
hniksic
07abfad1c2 [svn] Punish the *use* of ctype macros, rather than their mere presence. 
Published in <sxssnivlyut.fsf@florida.arsdigita.de>.
 2001-04-26 22:03:08 -07:00
hniksic
ae621c6770 [svn] Treat empty proxy environment vars as unset. 
Published in <sxssniwq8d6.fsf@florida.arsdigita.de>.
 2001-04-26 03:11:49 -07:00
hniksic
f0eb1fb758 [svn] Fix loading of cookies. 
Published in <sxslmopyao6.fsf@florida.arsdigita.de>.
 2001-04-24 19:29:54 -07:00
hniksic
425b5af0c9 [svn] Cosmetic change in DIGITS_* macros. 2001-04-24 18:55:13 -07:00
hniksic
e559249a48 [svn] Minor doc fix. 2001-04-24 17:59:39 -07:00
hniksic
9ae0328c3d [svn] Applied Roger Beeman's mktime_from_utc fix published in 
<Pine.HPX.4.02.10104181128180.6232-100000@mail1.cisco.com>.
Also, minor doc fixes.
 2001-04-24 17:50:22 -07:00
hniksic
d80f6cbe8c [svn] Reimplemented UNSAFE_CHAR and RESERVED_CHAR. 
Fixed snprintf.c to avoid ISDIGIT.
 2001-04-24 17:20:30 -07:00
hniksic
45eea7387f [svn] New timer functions. Published in <sxs8zkp28vk.fsf@florida.arsdigita.de>. 2001-04-24 16:09:45 -07:00
hniksic
5674776cad [svn] Rewritten long_to_string. The new version favors smaller numbers; 
much of the work is now done at compile-time.
Published in <sxsvgnv6oii.fsf@florida.arsdigita.de>.
 2001-04-23 19:06:34 -07:00
hniksic
6ba7711d6a [svn] Print download rate even when percentages are not available. 
Published in <sxs1yqjd4ct.fsf@florida.arsdigita.de>.
 2001-04-23 08:28:34 -07:00
hniksic
38120f75ef [svn] Write percentages when the length is authoritative. 
Published in <sxselujd8py.fsf@florida.arsdigita.de>.
 2001-04-23 06:53:29 -07:00
hniksic
ac7c8c1390 [svn] Improve performance of grow_hash_table. 
Published in <sxs66g8nd4c.fsf@florida.arsdigita.de>.
 2001-04-14 00:41:29 -07:00
hniksic
61bb00adc0 [svn] Various url.c-related changes. 
Published in <sxsvgo8nmub.fsf@florida.arsdigita.de>.

* retr.c (retrieve_url): Call uri_merge, not url_concat.
* html-url.c (collect_tags_mapper): Call uri_merge, not
url_concat.
* url.c (mkstruct): Use encode_string instead of xstrdup followed
by URL_CLEANSE.
(path_simplify_with_kludge): Deleted.
(contains_unsafe): Deleted.
(construct): Renamed to uri_merge_1.
(url_concat): Renamed to uri_merge.
* url.c (str_url): Use encode_string instead of the unnecessary
CLEANDUP.
(encode_string_maybe): New function, returns input string if no
encoding is needed.
(encode_string): Call encode_string_maybe to do the dirty work,
xstrdup if no work needed.
* wget.h (XDIGIT_TO_xchar): Define here.
* url.c (decode_string): Use new name.
(encode_string): Ditto.
* http.c (XDIGIT_TO_xchar): Rename HEXD2asc to XDIGIT_TO_xchar.
(dump_hash): Use new name.
* wget.h: Rename ASC2HEXD and HEXD2ASC to XCHAR_TO_XDIGIT and
XDIGIT_TO_XCHAR respectively.
 2001-04-13 21:11:35 -07:00
hniksic
8a0e9e765e [svn] Minor -Wall-induced fixes. Also, skip_url is removed. 
Published in <sxs8zl5v5cw.fsf@florida.arsdigita.de>.
 2001-04-12 20:39:23 -07:00
hniksic
eae28f142d [svn] Commit various hash table changes: 
* hash.c (hash_table_map): Allow deletion and change of the
element processed by MAPFUN.
(string_hash): Use the function from glib.
* hash.c (hash_table_remove): Rewrite to actually clear deleted
entries instead of just marking them as deleted.

Published in <sxsu23tvdur.fsf@florida.arsdigita.de>.
 2001-04-12 17:34:24 -07:00
hniksic
452c0bb9f7 [svn] Declare hash_table_get_pair and hash_table_count. 2001-04-12 12:45:18 -07:00
hniksic
cd1423a478 [svn] Declare http_atotm(). 2001-04-12 12:43:12 -07:00
hniksic
b4b33b5afc [svn] Use octal constants. 
Published in <sxsr8yy1dk6.fsf@florida.arsdigita.de>.
 2001-04-12 05:58:02 -07:00
hniksic
83fe8f3597 [svn] "Support DESTDIR when installing. 
Patch courtesy Karl Eichwalder.
Published in <sxs4rvu2tmu.fsf@florida.arsdigita.de>.
 2001-04-12 05:25:22 -07:00
hniksic
a98337f827 [svn] Make seconds optional in VMS time specification. 
Published in <sxs8zl62u9p.fsf@florida.arsdigita.de>.
 2001-04-12 05:22:50 -07:00
hniksic
963863113f [svn] Fix retrieval of directories when initial CWD is not `/'. 
Published in <sxsitkc709p.fsf@florida.arsdigita.de>.

* url.c (parseurl): Don't strip trailing slash when u->dir is "/"
because that strips the *leading* slash, thus forcing relative
FTP retrieval.
* ftp.c (getftp): Convert initial FTP directory from VMS to UNIX
notation for VMS servers.
(ftp_retrieve_dirs): Do not prepend '/' to f->name when
odir is an empty string.
 2001-04-10 17:24:59 -07:00
janp
90a26b7987 [svn] Make the AM/PM fix more efficient. 2001-04-10 10:09:42 -07:00
janp
568b584271 [svn] ftp_parse_winnt_ls(): Made the fix for AM/PM more effective. 2001-04-10 10:05:43 -07:00
hniksic
5fa53b5a1d [svn] Implement better sorting and matching of cookies. 
Fix previously broken command-line options.
Published in <sxspuek9255.fsf@florida.arsdigita.de>.
 2001-04-10 09:04:18 -07:00
hniksic
579d051d57 [svn] Rewrite SSL #ifdef for better indentation. 2001-04-09 07:58:55 -07:00
hniksic
0c70c624f9 [svn] Fix recursive FTP retrieval so that 
`wget -r ftp://<username>:<password>@host/%2Fhome/hniksic/dir/'
works.
Published in <sxsk84ug8gt.fsf@florida.arsdigita.de>.
 2001-04-08 18:38:27 -07:00
hniksic
665a84b4a2 [svn] Implement tilde-expansion in file name arguments of 
`.wgetrc' commands.
Published in <sxsy9tbeyh3.fsf@florida.arsdigita.de>.
 2001-04-08 16:59:14 -07:00
hniksic
2cfb2d2ef6 [svn] Added support for cookies. 2001-04-08 15:25:24 -07:00
janp
7827420378 [svn] ftp-ls.c (ftp_parse_winnt_ls): The AM/PM change did assume 12:01PM == 
00:01, which was obviously wrong.
 2001-04-08 07:38:12 -07:00
janp
92b944bffe [svn] The AM/PM change did assume 12:01PM == 00:01, which was obviously 
wrong. Taken care of this anomaly.
 2001-04-08 07:36:58 -07:00
janp
55587bdee2 [svn] ChangeLog: Removed an excess conflict marker. Reformatted the entry by 
Philipp Thomas from 2001-03-09.

ftp-ls.c (ftp_parse_winnt_ls): Ensure that adjusted PM hours lay
between 0 and 23. Elminate unused variable `sec'.
 2001-04-08 02:30:14 -07:00
hniksic
26547d3987 [svn] New function hash_table_count. 
Published in <sxsu2403zzw.fsf@florida.arsdigita.de>.
 2001-04-07 19:09:04 -07:00
hniksic
b5788b5eb7 [svn] Do the namespace tweaks only on systems we know about. 2001-04-05 21:44:04 -07:00
hniksic
a37e71d3d6 [svn] Cast MMAP_FAILED to char *. 2001-04-05 21:43:13 -07:00
hniksic
3ecad253f2 [svn] Include string.h. 2001-04-05 20:43:35 -07:00
hniksic
4bc1d37ccf [svn] Specify "compilation environment" that works for Linux 
and Solaris.
Published in <sxs8zlezpsu.fsf@florida.arsdigita.de>.
 2001-04-05 20:41:59 -07:00
hniksic
31ea5aae27 [svn] Prepend literal newline with `\n\' inside quoted string. 2001-04-05 20:06:00 -07:00
hniksic
3c6093cf13 [svn] Remove VERY_LONG_FORMAT. Instead, define function very_long_to_string 
for printing VERY_LONG_TYPE numbers.
Published in <sxsd7aqzqr7.fsf@florida.arsdigita.de>.
 2001-04-05 19:51:41 -07:00
hniksic
c51015565a [svn] parse_uname() Would run past the end of the string if the 
username was present, but the URL did not contain a slash, e.g.
http://foo:bar@myhost.
Reported by Christian Fraenkel.
 2001-04-04 07:00:34 -07:00
hniksic
1d51748034 [svn] Fix support for rfc850 time recognition on systems where strptime 
format specs %a and %A are not the same.
Published in <49022.983849922@ideon.st.ryukoku.ac.jp>.
 2001-04-03 11:54:32 -07:00
hniksic
a3eea37c91 [svn] Small cleanup of mswindows.c by Paul Bludov. 
Published in <wget-patches@sunsite.auc.dk>.
 2001-04-03 11:22:04 -07:00
hniksic
d62d112aed [svn] Remove stray conflict marker. 2001-04-03 09:19:23 -07:00
hniksic
f1d534cd8c [svn] Make -c' and -O' work together. 
Published in <sxsitkmgokh.fsf@florida.arsdigita.de>.
 2001-04-03 05:24:49 -07:00
hniksic
66a0c39e22 [svn] Make sure opt.dfp is rewound only on the first retrieval. 
(See the code comment for a more detailed explanation.)
Published in <sxsy9tkqizz.fsf@florida.arsdigita.de>.
 2001-04-01 16:50:04 -07:00
hniksic
1810f7a442 [svn] Handle trailing whitespace in .netrc. Published in 
<sxsitkofbfw.fsf@florida.arsdigita.de>.
 2001-04-01 16:28:25 -07:00
hniksic
cee04f2ef3 [svn] Fix memory allocation in cmd_address(). 
Published in <sxs66gogt0k.fsf@florida.arsdigita.de> under
the subject "Fix for opt.bind_address".
 2001-04-01 15:23:52 -07:00
hniksic
20a4341e1a [svn] Wget was ignoring an error when getting a directory failed. 
Fix courtesy Nicolas Lichtmaier.
 2001-04-01 14:34:40 -07:00
hniksic
4dbad3a894 [svn] Make sure -C is recognized. 2001-04-01 14:26:28 -07:00
hniksic
a52aaeb451 [svn] Make sure -c doesn't truncate the file. 
Published in <sxsofuhi4kc.fsf@florida.arsdigita.de>.
 2001-04-01 13:04:21 -07:00
hniksic
aa888ba8da [svn] Don't clear dl_file_url_map and dl_url_file_map in recursive_retrieve. 
Published in <sxsk856le2y.fsf@florida.arsdigita.de> under the subject
"Link conversion fix".
 2001-03-31 18:41:26 -08:00
hniksic
22240955e6 [svn] Undef xmalloc and friends before redefining them when standalone. 2001-03-30 21:07:10 -08:00
hniksic
8c4cd805e2 [svn] Oops! Fix braino in recur.c -- clear the hash tables only when 
they are defined.
 2001-03-30 18:21:20 -08:00
hniksic
8f048b7be8 [svn] Committed my patch that makes HTTP code close its socket in premature 
returns (before the body was drained).  Published in
<sxsd7ayn0kt.fsf@florida.arsdigita.de>.
 2001-03-30 18:20:16 -08:00
hniksic
728584d072 [svn] Record downloaded files and downloaded HTML files in all cases. 
Published under the subject "Link conversion fix" in
<sxsn1a2n2zd.fsf@florida.arsdigita.de>.
 2001-03-30 18:05:54 -08:00
hniksic
e4d49f0b40 [svn] Published my patch "main.c tweaks" published in 
<sxspueyonjt.fsf@florida.arsdigita.de>.
 2001-03-30 15:17:59 -08:00
hniksic
1a6058b1ec [svn] Applied Philipp Thomas's safe-ctype patch. Published in 
<20010330025159.U21662@jeffreys.suse.de>.
 2001-03-30 14:36:59 -08:00
dan
f486b43c23 [svn] * {.,doc,src,util,windows}/Makefile.in: Moved top_builddir out of "User 
configuration section" of top Makefile and analogous spot in others.

* po/Makefile.in.in: Previous addition of top_builddir to
  po/Makefile.in was bogus -- it's generated from po/Makefile.in.in.
 2001-03-27 03:23:59 -08:00
dan
d41af5f52e [svn] Linking with OpenSSL previously required the user to set up all the 
appropriate -I, -L, and -R/-rpath flags in environment variables,
manually.  Automated everything, including bundling libtool so we can
successfully link with the OpenSSL shared libraries on just about any
platform.
 2001-03-17 06:21:19 -08:00
janp
5014d32c3a [svn] Skip `:port' in the host header if it is the DEFAULT_HTTPS_PORT when 
using SSL. Patch submitted by Hack Kampbjorn <hack@hackdata.com>.
 2001-03-08 15:11:03 -08:00
hniksic
71a53ffe25 [svn] Applied Jonas Jensen's patch to correctly calculate the number of bytes 
in the first line of the download that.
Published in <sxsu25hioxj.fsf@florida.arsdigita.de>.
 2001-03-01 14:25:20 -08:00
dan
b6febbc84b [svn] * po/*.po*: Updated after moving -nr to a different category. 
* wget.texi: Moved -nr from "Recursive Retrieval Options" to "FTP Options" and
  gave it a @cindex entry. Alphabetized FTP options by long option name.

* main.c (print_help): -nr belongs in "FTP options" section of --help output,
  not "Recursive retrieval" section.  Alphabetized FTP options by long option
  name.
 2001-02-23 13:31:54 -08:00
dan
2aa1d53fb2 [svn] * main.c (print_help): --help documentation for -N said it would re-download 
files if they had the _same_ timestamp on server.

* po/*.po*: Updated after changing --help's description of -N.
 2001-02-23 12:43:35 -08:00
dan
4fc318600e [svn] init.c (commands): Hack Kampbj?rn <hack@hackdata.com> discovered that 
"httpsproxy" had been inserted into commands[] out of alphabetical order,
causing "BUG: unknown command `httpuser'".
 2001-02-16 21:26:34 -08:00
janp
b3bb9b7ed9 [svn] Changes in FTP listing parser code - suport for VMS and MacOS, removed 
dependency on ftpparse as the copyright issue has not been resolved.
 2001-02-12 23:50:27 -08:00
janp
004b339d2e [svn] Removed ftpparse dependencies. New parser for VMS listings. MacOS 
NetPresenz FTP sevber is now supported.
 2001-02-12 23:44:59 -08:00
janp
ccfe785e9e [svn] Changes related to ftpparse removal. 2001-02-12 23:40:53 -08:00
janp
ae23f01b07 [svn] Removed because of unclear copyright statement and unwillingess of 
original author to resolve this.
 2001-02-12 23:40:14 -08:00
hniksic
164ccc9e41 [svn] ChangeLog tweak; initialize con to appease the access checker. 2001-02-11 09:27:37 -08:00
hniksic
54811e2832 [svn] Applied Jan's patch to allow non-quoted @ character in 
passwords.  Published in <20010106173455.A9455@erwin.telekabel.at>.
 2001-02-10 16:28:22 -08:00
hniksic
b370dd1914 [svn] Applied Hack Kampbjorn's patch to print FTP type in debug output. 
Published in <3A7D94B5.D9B932FB@hackdata.com>.
 2001-02-10 16:06:59 -08:00
hniksic
366b832e3f [svn] Applied Jonas Jensen's download rate patch with my additions. 
Published in <015b01c09084$ce2d9330$0100000a@bob> and
<sxspugq3xai.fsf@florida.arsdigita.de>.
 2001-02-10 16:00:30 -08:00
hniksic
fdc20de365 [svn] Applied Tim Mooney's patch that fixes a build problem under Tru64. 
Published in
<Pine.OSF.4.33.0102072244450.2714-100000@dogbert.cc.ndsu.NoDak.edu>.
 2001-02-10 14:37:12 -08:00
hniksic
07f60f19a4 [svn] Applied Christian Fraenkel's patch "custom certificate patch for wget-1.7+dev; 
2nd try", published in <200102082132220160.00474E73@pop.gmx.net>.
It adds two options for custom certificates.
 2001-02-10 14:33:31 -08:00
hniksic
2f6cd9d698 [svn] Changes according to Herold Heiko's instructions how to make alloca() 
work under Windows: don't try to compile alloca.c, *and* don't forget
to include <malloc.h>.

Published in <sxsbssyibsu.fsf@florida.arsdigita.de>.
 2001-01-23 06:27:40 -08:00
dan
fa636eb71d [svn] url.c (str_url): Clarified this function's comment header after Hrvoje answered 
my question on the list as to when hide != 1.  Also Hrvoje pointed out I need to
use xstrdup() on the string literal.
 2001-01-10 22:16:46 -08:00
hniksic
3f91c7dfe1 [svn] Declare addrlen as int. Published in <sxsu27cbtzu.fsf@florida.arsdigita.de>. 2001-01-10 07:06:00 -08:00
dan
17e21ff7dd [svn] Jan did make a ChangeLog entry for his fix of the non-anonymous FTP recursion 
bug.  I just didn't use the right terms when searching for it.
 2001-01-10 00:53:42 -08:00
dan
f84a94e913 [svn] Made clarifications and corrections to --continue's --help output and wget.texi 
documentation.  Published in <200101100629.WAA09744@dilvish.speed.net>.
 2001-01-09 22:51:51 -08:00
dan
48cf02169d [svn] Just clarified a comment in the fix I just committed. 2001-01-09 20:32:29 -08:00
dan
1993e140f2 [svn] url.c (str_url): Henrik van Ginhoven pointed out on the list that we shouldn't 
give away the number of characters in the password by replacing each character
with a 'x'.  Use "<password>" instead.
 2001-01-09 20:30:43 -08:00
dan
7140f393b2 [svn] When did the bug get fixed where recursive FTP would fail if logging in put 
you in a directory other than "/"?  I don't see a src/ChangeLog entry for
it.  In any case, my testing shows that it's fixed in 1.7-dev, but TODO and
a comment in src/ftp.c were not changed to reflect this.
 2001-01-09 20:17:06 -08:00
dan
040aae87b5 [svn] html-url.c: A bunch of fixup of `--page-requisites'-related comments to reflect 
Hrvoje's changes to my code when transplanting it into this new file, to fix
spelling mistakes, to clarify, etc.
 2001-01-09 18:54:52 -08:00
dan
bc5fd29baf [svn] 2001-01-09 Dan Harkless <wget@harkless.org> 
* html-url.c: Addition and clarification of comments related to -p.

	* url.c (write_backup_file): Clarified a comment.
	  [Committed this fix separately.]
 2001-01-09 18:28:24 -08:00
dan
a77dc45c4d [svn] Hrvoje's response to my "wondering" comment in write_backup_file() read 
extremely strangely without adding tags to show who was saying what.  Also, one
of his phrases was very misleading.
 2001-01-09 18:10:16 -08:00
dan
cbe2ca1b80 [svn] Here're the changes we agreed to on the wget mailing list regarding the 
multiple-branches ChangeLog problem.  Note the new directories -- you'll need to
do a cvs update -d.
 2001-01-06 01:26:02 -08:00
hniksic
35325bd092 [svn] Include fragment identifiers in converted URLs. Published in 
<sxs8zorl90l.fsf@florida.arsdigita.de>.
 2001-01-04 05:53:53 -08:00
hniksic
f579cd1691 [svn] Csaba's Watcom changes. 2001-01-03 07:14:02 -08:00
dan
67bfa88fd8 [svn] ChangeLog: Since this flat file doesn't have multiple branches, 
looking at the dates would make you think that things went into
1.6 that actually just went into the 1.7-dev branch.  Added "[Not
in 1.6 branch.]" where appropriate to clarify.
 2000-12-31 04:45:42 -08:00
dan
86413b1d83 [svn] Need to say that stuff I did before releasing 1.6 happened on 12-30, not 12-31. 2000-12-31 04:10:59 -08:00
dan
e979053779 [svn] 2000-12-31 Dan Harkless <wget@harkless.org> 
* ftp.c, http.c:  Applied Hack Kampbj?rn <hack@hackdata.com>'s
        patch to deal with h_errno not being defined in netdb.h under Cygwin.

2000-12-30  Dan Harkless  <wget@harkless.org>

        * version.c: Released Wget version 1.6.  Note that on this branch we
        never actually had the version set to 1.6, but we still need the
        ChangeLog comment for posterity.
 2000-12-31 04:04:14 -08:00
dan
f105b3e43f [svn] Changed my address from dan-wget@dilvish.speed.net to wget@harkless.org 
everywhere -- dilvish will probably be going away soon.
 2000-12-31 03:18:37 -08:00
hniksic
23cbd15095 [svn] Igor Khristophorov's fix for check_end(). From 
<sxs4s027snq.fsf@florida.arsdigita.de>.
 2000-12-17 11:31:30 -08:00
hniksic
5099ec0306 [svn] Apply lint-expired fixes from <sxsn1du7ufa.fsf@florida.arsdigita.de>. 2000-12-17 10:52:52 -08:00
hniksic
f6a41b5669 [svn] Applied Csaba Raduly's patch from <802569B4.0043F7B1.00@Jagannath.uk.sophos>. 2000-12-17 10:18:14 -08:00
hniksic
2e8fc46b7b [svn] Include <netdb.h> where h_errno is used. Likewise for <errno.h> and errno. 
From <sxsvgsi7wcw.fsf@florida.arsdigita.de>.
 2000-12-17 10:12:02 -08:00
hniksic
b84f96df34 [svn] Use '"' rather than '\"' in assert. 2000-12-13 05:37:37 -08:00
hniksic
28b5cd706f [svn] Removed. 2000-12-10 18:53:02 -08:00
hniksic
bdea0b3bf6 [svn] Made xfree alias to free if memory debugging is not used. 
From <sxsd7ezd7p2.fsf@florida.arsdigita.de>.
 2000-12-10 18:17:44 -08:00
hniksic
d5cd691b12 [svn] Fix -O timestamp bug. 
From <sxs7l57u6o6.fsf@florida.arsdigita.de>.
 2000-12-10 16:47:44 -08:00
hniksic
62b876401e [svn] Set the timestamp even when -O is used. 2000-12-10 16:31:14 -08:00
hniksic
3665d73453 [svn] Removed. 2000-12-09 18:25:19 -08:00
hniksic
afe131624b [svn] Add , before `int ssl'. 2000-12-06 09:22:27 -08:00
hniksic
cab759659e [svn] Move inclusion of gen_ssl.h below Wget's headers. 2000-12-06 09:18:14 -08:00
hniksic
b0e9dfd4e2 [svn] Fix opt.wait. 2000-12-05 16:24:40 -08:00
hniksic
47c6092ec4 [svn] Use a single version of RBUF_READCHAR. 2000-12-05 15:50:34 -08:00
hniksic
e754c99b46 [svn] Cosmetic cleanup of SSL stuff. 2000-12-05 15:35:56 -08:00
hniksic
ac5d0a9e4d [svn] New files. 2000-12-05 15:26:13 -08:00
hniksic
7828e81c79 [svn] Committed C. Frankel's SSL patch. 2000-12-05 15:09:41 -08:00
hniksic
dc78acde56 [svn] Use the proper Jan's changelog entry. 2000-12-05 15:03:46 -08:00
hniksic
d1a855786c [svn] ChangeLog for Jan's last patch. 2000-12-05 14:44:46 -08:00
hniksic
7b5ad90acf [svn] Commit my url.c fix (space as unsafe character) and Jan's 
winnt directory listing parsing.
 2000-12-05 14:29:47 -08:00
hniksic
518fe8d06d [svn] Do away with line separator. 2000-11-29 08:19:46 -08:00
hniksic
7e900c50bf [svn] Undo Jan's typo fix. 2000-11-25 03:51:14 -08:00
hniksic
62994ffc8c [svn] Applied Karl Eichwalder's patch from 
<20001124044348.AF524DD15E@tux.gnu.franken.de>.
 2000-11-24 05:51:36 -08:00
hniksic
7c750db580 [svn] More memory debug tweaks. 
Published in <sxs4s0z2bwi.fsf@florida.arsdigita.de>.
 2000-11-23 13:44:56 -08:00
hniksic
1cddc05edb [svn] Committed memory debugging stuff. 
Published in <sxs1yw34pt4.fsf@florida.arsdigita.de>.
 2000-11-22 14:15:45 -08:00
hniksic
d8c9ce30aa [svn] Make sure xfree is #define'd in standalone mode in files that 
support one.
 2000-11-22 09:00:31 -08:00
hniksic
2ffb47eabf [svn] Committed <sxsbsv854j9.fsf@florida.arsdigita.de>. 2000-11-22 08:58:28 -08:00
hniksic
9439a6659b [svn] Fixup ftpparse dependencies. 2000-11-21 09:01:39 -08:00
hniksic
c3d636db03 [svn] Committed Jan's ftpparse patch with Hrvoje's modifications. 
<sxshf518e72.fsf@florida.arsdigita.de>.
 2000-11-21 08:48:39 -08:00
hniksic
d6a57bc2a6 [svn] Commit hash table bugfix. 
Published in <sxs8zqd9x1g.fsf@florida.arsdigita.de>.
 2000-11-21 08:42:29 -08:00
hniksic
45eee9e56c [svn] Remove stray debugging statement. 2000-11-20 19:08:41 -08:00
hniksic
6e598c81e3 [svn] Committed a bunch of different tweaks of mine. 
Published in <sxsr9463wrx.fsf@florida.arsdigita.de>.
 2000-11-20 18:06:36 -08:00
hniksic
fb42069e51 [svn] Constify check_end(). 2000-11-20 02:25:28 -08:00
hniksic
7302e69dc2 [svn] Improved comments for the persistent connections feature. 2000-11-20 02:20:39 -08:00
hniksic
6f7fd37186 [svn] Auth tweaks. 
Published in <sxs3dgnz955.fsf@florida.arsdigita.de>.
 2000-11-19 18:10:54 -08:00
hniksic
ba3f5ce0a2 [svn] Bump version number. 2000-11-19 16:15:21 -08:00
hniksic
f2f77d87fd [svn] New option --no-http-keep-alive. 
Published in <sxsd7fr1pdf.fsf@florida.arsdigita.de>.
 2000-11-19 16:04:06 -08:00
hniksic
b27144fcce [svn] My patch "persistent connection tweaks". 
Published in <sxshf531qhj.fsf@florida.arsdigita.de>.

(Applied with the addition of correct calculation for the
length of the request.)
 2000-11-19 15:42:13 -08:00
hniksic
b0b1c815c1 [svn] A bunch of new features: 
- use mmap() to read whole files in core instead of allocating memory
  and read'ing it.

- use a new, more general, HTML parser (html-parse.c) and interface to
  it from Wget (html-url.c).

- respect <meta name=robots content=nofollow> (easy with the new HTML
  parser).

- use hash tables instead of linked lists in places where the lists
  were used to facilitate mappings.

- rewrite the code in host.c to be more readable and faster (hash
  tables instead of home-grown lists.)

- make convert_links properly convert partial URLs to complete ones
  for those URLs that have *not* been downloaded.

- use HTTP persistent connections where available.  very
  simple-minded, caches the last connection to the server.

Published in <sxshf533d5r.fsf@florida.arsdigita.de>.
 2000-11-19 12:50:10 -08:00
hniksic
ccf31643ab [svn] vsnprintf() fixup. 2000-11-16 08:37:49 -08:00
hniksic
cc3b6eb3e4 [svn] Do the _XOPEN_SOURCE/_SVID_SOURCE things only on Linux. 2000-11-15 10:10:01 -08:00
hniksic
6a70f04a5c [svn] Don't clutter the host list with duplicate hosts. 
Published in <sxsitpt56eh.fsf@florida.arsdigita.de>.
 2000-11-12 16:46:13 -08:00
hniksic
e1f1c1ff40 [svn] Better version of read_whole_line(). 
Published in <sxsr94jd7z4.fsf@florida.arsdigita.de>.
 2000-11-10 10:01:35 -08:00
hniksic
e18ca280fb [svn] Fix off-by-one error in comind(). 
Published in <sxsvgtvdcki.fsf@florida.arsdigita.de>.
 2000-11-10 08:20:55 -08:00
hniksic
f306ae9626 [svn] Changed last_slash[-1] to *(last_slash - 1). 2000-11-08 07:51:28 -08:00
hniksic
b72b6cf387 [svn] Correctly handle URLs where / does not follow the host name. 
Published in <sxsn1fag6zu.fsf@florida.arsdigita.de>.
 2000-11-08 01:15:40 -08:00
hniksic
34ea31bb01 [svn] Sort commands[]. 2000-11-07 03:43:36 -08:00
hniksic
0e2b74ce3b [svn] Commit "minor fixes". 2000-11-06 13:24:57 -08:00
hniksic
366ad1d6d9 [svn] Rewrote the logging code. 
Published at <sxs1ywrf300.fsf@florida.arsdigita.de>.
 2000-11-04 20:38:31 -08:00
hniksic
c2c821b3c9 [svn] snprintf.c addition. 2000-11-04 14:49:46 -08:00
hniksic
eef4a668b7 [svn] Update copyright blurbs with the year 2000. 2000-11-01 17:50:03 -08:00
hniksic
6e23da9254 [svn] Hide password from URL when non-verbose, too. 2000-11-01 17:41:20 -08:00
hniksic
c6575c6382 [svn] Another contributed fix... 2000-11-01 17:06:57 -08:00
hniksic
6eb0870af0 [svn] Contributed fix. 2000-11-01 17:02:56 -08:00
hniksic
986c445029 [svn] Fixed minor memory leaks. 2000-11-01 16:18:27 -08:00
hniksic
b3758323ed [svn] Applied contributed fix. 2000-11-01 15:57:19 -08:00
hniksic
b7a8c6d3f5 [svn] Gracefully handle opt.downloaded overflowing. 
Published in <sxsd7gfnv17.fsf@florida.arsdigita.de>.
 2000-11-01 15:17:31 -08:00
hniksic
29cdc8da20 [svn] Updated long_to_string(); enhanced opt.downloaded to use 
64-bit types where available.
Published in <sxswvenqsmn.fsf@florida.arsdigita.de> and
<sxssnpbqshp.fsf@florida.arsdigita.de>.
 2000-11-01 13:51:25 -08:00
hniksic
b9eeb0c54c [svn] Fix "optimization" of query-strings in URLs. 
Published in <sxs3dhbwnmw.fsf@florida.arsdigita.de>.
 2000-11-01 10:31:53 -08:00
hniksic
6d13e17142 [svn] Detect redirection cycles. 
Published in <sxsd7ggtjac.fsf@florida.arsdigita.de>.
 2000-10-31 20:21:50 -08:00
hniksic
515d82fb95 [svn] Committed my patch from <sxsy9z4xz5m.fsf@florida.arsdigita.de> 
(recognize HTML entities.)
 2000-10-31 17:25:12 -08:00
hniksic
846b045a69 [svn] Applied my patch from <sxs3dhczfv5.fsf@florida.arsdigita.de>. 2000-10-31 16:38:57 -08:00
hniksic
f6715dd08d [svn] Committed my patch from <sxs7l6ozghz.fsf@florida.arsdigita.de>. 2000-10-31 16:26:33 -08:00
hniksic
0dd418242a [svn] Committed my patches from <sxsbsw16sbu.fsf@florida.arsdigita.de> 
and <sxsvgu824xk.fsf@florida.arsdigita.de>.
 2000-10-31 11:25:32 -08:00
hniksic
b095202cad [svn] Applied Adrian Aichner's patch from 
<20001029223711.28688.qmail@web10601.mail.yahoo.com>.
 2000-10-30 13:07:04 -08:00
dan
24c465b5ad [svn] retr.c (retrieve_url): Manually applied T. Bharath 
<TBharath@responsenetworks.com>'s patch to get wget to grok illegal relative URL
redirects.  Reformatted and re-commented it.
 2000-10-27 20:18:20 -07:00
dan
1396b30055 [svn] Manually applied Rob Mayoff <mayoff@dqd.com>'s patch (vs. 1.5.3, not 1.5.3+dev) 
to add --bind-address, making many necessary alphabetization, coding style,
comment, documentation, and naming fixes and additions.
 2000-10-23 23:19:17 -07:00
dan
2fbb4936a0 [svn] main.c (print_help): Clarified that --delete-after deletes local files. 2000-10-23 20:52:34 -07:00
dan
f4673bcdaf [svn] --delete-after wasn't implemented for files retrieved by FTP or corresponding to 
files specified on the commandline.  Made --convert-links be ignored when
--delete-after is specified.  Added note about this fact to --delete-after docs
and made general improvements to them, including the clarification that
--delete-after only deletes local files.
 2000-10-23 20:43:47 -07:00
hniksic
778160a155 [svn] hniksic@iskon.hr -> hniksic@arsdigita.com 2000-10-23 08:43:04 -07:00
dan
8a9be7627d [svn] ftp.c (getftp): Applied Piotr Sulecki <Piotr.Sulecki@ios.krakow.pl>'s 
patch to work around FTP servers that incorrectly respond to the
          	"REST" command with the remaining size rather than the total
          	file size.
 2000-10-20 00:28:57 -07:00
dan
8cf52e0dd3 [svn] Applied John Daily <jdaily@cyberdude.com>'s patch for his "quad" commands (which 
I renamed to "lockable_boolean") in the .wgetrc (currently just passive_ftp).
Wrote documentation for his changes and added the missing "referer" to the
.wgetrc section (making mention of the issue of "referrer" being the correct
spelling).
 2000-10-19 23:59:30 -07:00
dan
b3e2c0ff97 [svn] Implemented and documented new -E / --html-extension / html_extension option. 2000-10-19 22:55:46 -07:00
dan
cbf018d0c0 [svn] --retr-symlinks was not previously documented properly. Based on my newfound 
understanding of what its limitations are, added a TODO item.  Also made a minor
tweak in html.c to silence a warning.
 2000-10-09 15:43:11 -07:00
dan
570f12e437 [svn] Accidentally said "system.wgetrc" instead of "system wgetrc". 2000-08-30 14:08:06 -07:00
dan
7931200609 [svn] * *.{gmo,po,pot}: Regenerated after modifying wget --help output. 
* ftp.c (ftp_retrieve_list): Use new INFINITE_RECURSION #define.

* html.c: htmlfindurl() now takes final `dash_p_leaf_HTML' parameter.
Wrapped some > 80-column lines.  When -p is specified and we're at a
leaf node, do not traverse <A>, <AREA>, or <LINK> tags other than
<LINK REL="stylesheet">.

* html.h (htmlfindurl): Now takes final `dash_p_leaf_HTML' parameter.

* init.c: Added new -p / --page-requisites / page_requisites option.

* main.c (print_help): Clarified that -l inf and -l 0 both allow
infinite recursion.  Changed the unhelpful --mirrior description
to simply give the options it's equivalent to.  Added new -p option.
(main): Added some comments; handle new -p / --page-requisites.

* options.h (struct options): Added new page_requisites field.

* recur.c: Changed "URL-s" to "URLs" and "HTML-s" to "HTMLs".
Calculate and pass down new `dash_p_leaf_HTML' parameter to
get_urls_html().  Use new INFINITE_RECURSION #define.

* retr.c: Changed "URL-s" to "URLs".  get_urls_html() now takes
final `dash_p_leaf_HTML' parameter.

* url.c: get_urls_html() and htmlfindurl() now take final
`dash_p_leaf_HTML' parameter.

* url.h (get_urls_html): Now takes final `dash_p_leaf_HTML' parameter.

* wget.h: Added some comments and new INFINITE_RECURSION #define.

* wget.texi (Recursive Retrieval Options): Documented new -p option.
 2000-08-30 04:26:21 -07:00
dan
001392bf2b [svn] * main.c (print_help): -B / --base was not mentioned. 2000-08-23 15:40:20 -07:00
dan
1f0acebeb0 [svn] * main.c (print_help): Modified -nc description to mention that it also prevents 
the creation of multiple versions of the same file with ".<number>" suffixes.
 2000-08-22 20:11:55 -07:00
hniksic
7794db052c [svn] Committed Jan Prikryl's patch from 
<20000709171425.A16267@launzatte.cg.tuwien.ac.at>.
 2000-07-14 07:15:23 -07:00
dan
ae77e4f08e [svn] Oops. Meant to check this change in with my last one, but the commit wouldn't 
go through without doing an update first, and I forgot to make the change the
second time.  Just changed an erroneous main.c (main) to main.c (print_help).
 2000-06-09 14:40:26 -07:00
dan
eea2d24220 [svn] Heiko's --help output for --waitretry was over 80 columns. Shortened. It also 
said that 0 seconds are waited after the first retry, which I believe is
incorrect and does not match what's written elsewhere (e.g. wget.texi).  Changed
to 1.
 2000-06-09 13:59:56 -07:00
hniksic
1765080b2e [svn] Comment fix. 2000-06-09 01:03:19 -07:00
hniksic
2e806fb2f3 [svn] Don't try to chmod() symlinks. 2000-06-01 04:20:05 -07:00
hniksic
0eec6b9f30 [svn] Committed my patch <dpem6hln1k.fsf@mraz.iskon.hr>. 2000-06-01 03:47:03 -07:00
dan
b05feb3ae2 [svn] Damir Dzeko <ddzeko@zesoi.fer.hr> did not document his new --referer option. 
Did so (--help output and wget.texi).  Also tweaked --help output for --execute.
 2000-05-22 19:29:38 -07:00
hniksic
ee6065f581 [svn] Committed my patch from <dpd7mj3sap.fsf@mraz.iskon.hr>. 2000-05-19 00:37:22 -07:00
hniksic
80cebf2a76 [svn] hniksic@srce.hr -> hniksic@iskon.hr 2000-04-21 02:34:39 -07:00
hniksic
094481c386 [svn] Committed host.c patch from <dpk8i3za97.fsf_-_@mraz.iskon.hr>. 2000-04-14 02:31:21 -07:00
hniksic
6b4a85888e [svn] Commit several fixes. 2000-04-12 06:23:35 -07:00
dan
1ecfed1e10 [svn] * host.c (store_hostaddress): R. K. Owen's patch introduces a "left shift count 
>= width of type" warning on 32-bit architectures.  Got rid of it by tricking
  the compiler w/ a variable.

* url.c (UNSAFE_CHAR): The macro didn't include all the illegal characters per
  RFC1738, namely everything above '~'.  It also generated a warning on OSes
  where char =~ unsigned char.  Fixed.
 2000-04-04 20:08:10 -07:00
hniksic
bc7060a81d [svn] More old fixes. 2000-03-31 06:14:58 -08:00
hniksic
aeabb42714 [svn] Commit another old fix. 2000-03-31 06:08:57 -08:00
hniksic
858adf01cd [svn] Fix store_hostaddress() on big-endian 64-bit machines. 2000-03-31 06:07:07 -08:00
hniksic
dee64b0b16 [svn] Fix indentation. 2000-03-31 06:05:53 -08:00
hniksic
0d42b49e30 [svn] Commit really old change. 2000-03-31 06:04:54 -08:00
hniksic
6b0aaebf33 [svn] Committed patch from <dp8zyzz1se.fsf@mraz.iskon.hr>. 2000-03-31 05:51:53 -08:00
hniksic
c71f174ed6 [svn] Changes from <9t9pusol5a1.fsf@mraz.iskon.hr>. 2000-03-21 07:47:45 -08:00
dan
4454f6ce0a [svn] * TODO: Removed done item: we now have an option (-G) that makes it easy to 
download a single HTML document and all its constituents.

* po/*.{gmo,po,pot}: Regenerated after adding new options.

* po/hr.po: Hrvoje forgot '\n's on his translations of my altered messages,
causing msgfmt to balk and `make install' to fail.


* wget.texi (Recursive Retrieval Options): In -K description, added a link to
the discussion of interaction with -N.
(Recursive Accept/Reject Options): Did some alphabetizing and added descriptions
of new --follow-tags and -G / --ignore-tags options.
(Following Links): Changed "the loads of" to "loads of".
(Wgetrc Commands): Added descriptions of new follow_tags and ignore_tags
commands.


* html.c (idmatch): Implemented checking of my new --follow-tags and
--ignore-tags options.

* init.c (commands): Added comment reminding people adding new entries doing
allocation to add corresponding freeing in cleanup().
(commands): Added new followtags and ignoretags commands.
(cleanup): Free storage for new followtags and ignoretags.

* main.c: Use of "comma-separated list" was random -- normalized it.  Did some
alphabetization.  Added comments pointing out "Options without arguments" and
"Options accepting an argument" sections of long_options[].  Added new options
--follow-tags and -G / --ignore-tags.  Added comment that Damir's --referer is
currently undocumented.  Added comment that Heiko's --waitretry is partially
undocumented (mentioned in --help but not in wget.texi).  Moved improperly
sorted 24, 129, and 'G' cases.

* options.h (struct options): Added new fields follow_tags and ignore_tags.

* wget.h: Added "#define EQ 0" so we can say "strcmp(a, b) == EQ".
 2000-03-10 22:48:06 -08:00
dan
66ced51104 [svn] Dan Berger responded to my email. Added his explanation of what his patch was 
coded for (downloading StarOffice from Sun's website).  He says he doesn't use
wget any more, so he won't be writing a patch that allows downloading that
without breaking anything (such a patch would apparently involve stopping
certain characters in the URL from being escaped).
 2000-03-02 15:49:37 -08:00
dan
3a8c75cac4 [svn] Dan Berger's query string patch is totally bogus. If you have two different 
URLs, gen_page.cgi?page1 and get_page.cgi?page2, they'll both be saved as
get_page.cgi and the second will overwrite the first.  Also, parameters to
implicit CGIs, like "http://www.host.com/db/?2000-03-02" cause the URLs to be
printed with trailing garbage characters, and could seg fault.  I'm not sure
what Dan had in mind with this patch (no explanatory comments), but I'm removing
it for now.  If he can rewrite it so it doesn't break stuff, okay.
 2000-03-02 14:48:07 -08:00
dan
03e5e4fe4d [svn] recur.c (parse_robots): Applied Edward J. Sabol's patch for Guan Yang's reported 
problem with "User-agent:<space>*<space>" lines.
 2000-03-02 13:28:59 -08:00
dan
d2e1d7fe9d [svn] Hrvoje didn't regenerate the .info files after changing wget.texi. 
Got rid of newly-introduced nested-if warnings in ftp.c and http.c.  Fixed
apparently completely untested code in main.c that was trying to provide --wait
/ --waitretry backwards compatibility, but had multiple fundamental bugs.
 2000-03-02 13:17:47 -08:00
hniksic
5d8cfbd904 [svn] Applied contributed patches (see ChangeLog for details.) 2000-03-02 06:45:37 -08:00
hniksic
1dc66a6cf6 [svn] *** empty log message *** 2000-03-02 06:23:22 -08:00
hniksic
33dbab7add [svn] Added contributed patch. 2000-03-02 06:18:53 -08:00
hniksic
2b2fd2924a [svn] Added user-contributed patches. 2000-03-02 06:16:12 -08:00
hniksic
cf35e2009d [svn] Applied contributed patch. 2000-03-02 05:34:05 -08:00
hniksic
f4f8e83327 [svn] Applied Edward Sabol's patch. 2000-03-02 05:28:31 -08:00
dan
4331c39c9a [svn] Implemented the item I formerly had in the TODO: When -K and -N are used 
together, we compare local file X.orig (if extant) against server file X.
Previously -k and -N were worthless in combination because the local converted
files always differed from the server versions.
 2000-03-01 22:33:48 -08:00
dan
e0a58713f7 [svn] Upped version number from 1.5.3. to 1.5.3+dev. Because the development source 
is available via anonymous CVS and desirable features are being added, it's
quite possible for end-users to be getting their hands on development versions.
They may report bugs, so if we don't change the version number, we'll have to
continually followup the statement "I'm using version 1.5.3" with the question
"The FTP archive or the CVS source?"  Better to just make this development
version have a unique number.  Once we're ready to actually release the next
version, we can up the version from 1.5.3+dev to 1.5.4, or 1.6, or whatever it
turns out to be (depending on how much development gets done).

Also made minor updates (dates, email addresses) to wget.texi.
 2000-02-29 16:50:52 -08:00
dan
e5408e7db8 [svn] Implemented new -K / --backup-converted / backup_converted = on option. 2000-02-29 16:17:23 -08:00
kwget
31d6616c48 [svn] Initial revision 1999-12-01 23:42:23 -08:00