moparisthebest
/
wget
mirror of https://github.com/moparisthebest/wget
1
0
Fork 0
Code Issues Releases Wiki Activity
1,319 Commits 1 Branch 0 Tags 9.6 MiB
Commit Graph

703 Commits

Author SHA1 Message Date
hniksic 31d919b23d [svn] Accept HTTP status 307 as redirect. 2003-10-14 16:32:15 -07:00
hniksic 3f6913663e [svn] Correctly loop through the linked list. 
By Philip Stadermann.
 2003-10-14 15:52:12 -07:00
hniksic 5535c9ff17 [svn] Expect links followed from Refreshes to contain URLs. 2003-10-13 07:32:25 -07:00
hniksic 7487dbfa81 [svn] Don't define int32_t because we're not using it. 2003-10-13 07:20:51 -07:00
hniksic 711bf72609 [svn] Remove VERY_LONG_TYPE; use LARGE_INT instead. Remove special code 
for handling VERY_LONG_TYPE overflows.
Make opt.quota a LARGE_INT.
 2003-10-11 06:57:11 -07:00
hniksic a6f72ca66b [svn] Also check for short for int32_t. 2003-10-11 05:41:13 -07:00
hniksic f58c6774e4 [svn] Provide the support for int32_t and u_int32_t. 2003-10-10 19:27:41 -07:00
hniksic 5155384340 [svn] Look for and use socklen_t. 2003-10-10 18:39:07 -07:00
hniksic 1b3cdef574 [svn] Don't descend into HTML that was downloaded by following <img src=...> 
and such.
 2003-10-10 07:25:10 -07:00
hniksic ffc2d0f653 [svn] Make the first argument to hash_table_new a minimal count of items before 
regrow, not raw size, which is more useful.
 2003-10-09 19:46:09 -07:00
hniksic 233ebb78de [svn] Use hash table for tag lookup in html-url.c and html-parse.c. 2003-10-09 08:01:58 -07:00
hniksic b49e89e78a [svn] Add const declarations to hash-table functions. 2003-10-09 06:32:28 -07:00
hniksic ae1d264fcc [svn] Add FLAGS argument to map_html_tags. 2003-10-08 09:17:33 -07:00
hniksic a9c3c58c9f [svn] Switch to binary search for find_tag. 2003-10-08 09:00:10 -07:00
hniksic 33dceca784 [svn] Fix typo in help string. 2003-10-08 08:24:56 -07:00
hniksic 6057dbec6f [svn] Add definitions of getopt_long and getopt_long_only to getopt.c. 
The definitions were lost when updating the file.
 2003-10-08 07:55:44 -07:00
hniksic 38ea4d5dad [svn] Renamed DEBUG to ENABLE_DEBUG. 2003-10-07 17:05:51 -07:00
hniksic 097923f7b1 [svn] Move fnmatch() to cmpt.c and don't use it under GNU libc. 2003-10-07 16:53:31 -07:00
hniksic d7cbc755e0 [svn] Add a fresher getopt.c. 2003-10-07 15:58:27 -07:00
hniksic 3d823e690e [svn] Remove unused pointer from struct cookie. 2003-10-07 03:39:18 -07:00
hniksic 6359e38d96 [svn] Improve documentation of cookie code. 2003-10-06 17:47:08 -07:00
hniksic abf7afb9d4 [svn] Fix type of _SetThreadExecutionState local var. 
By Gisle Vanem.
 2003-10-05 14:12:36 -07:00
hniksic 254291cc03 [svn] Fix crash when post-file is missing. 2003-10-04 15:26:58 -07:00
hniksic 711692375e [svn] Use WaitForSingleObject to wait for thread termination. 
By Gisle Vanem.
 2003-10-04 14:54:12 -07:00
hniksic 98b7ac79f3 [svn] Update ansi2knr.c and ansi2knr.1. 
Update log.c to use `...' in function definition argument lists
unconditionally.
 2003-10-04 03:34:10 -07:00
hniksic 351c4b9add [svn] Include winsock headers from mswindows.h. 
By Gisle Vanem.
 2003-10-03 09:37:47 -07:00
hniksic 87275db136 [svn] Fix compilation problem on non-Gcc compilers. 2003-10-03 09:11:09 -07:00
hniksic 5a905bcec3 [svn] Window-specific implementation of run_with_timeout. 
By Gisle Vanem.
 2003-10-02 16:28:49 -07:00
hniksic eec3ea392d [svn] Better document html-parse macros. 2003-10-02 15:20:44 -07:00
hniksic f70c6cacb9 [svn] Initialize DUMMY storage for DT. 2003-10-02 14:21:07 -07:00
hniksic 2e8899bc10 [svn] Added support for hexadecimal numeric entities. 2003-10-02 10:23:25 -07:00
hniksic 030704403b [svn] Subsecond granularity in run_with_timeout. 2003-10-02 06:37:45 -07:00
hniksic 65cec8deee [svn] Fix memory leak in a rare case in url.c. 
Translate error messages from url_parse().
 2003-10-01 12:59:48 -07:00
hniksic d0f4a1e109 [svn] Initialize local variable to shut up the compiler. 2003-10-01 12:45:41 -07:00
hniksic 6a2477fdc2 [svn] *** empty log message *** 2003-10-01 06:44:46 -07:00
hniksic 451ddf3cf9 [svn] Display percentage in title bar. 
By Gisle Vanem.
 2003-09-30 14:24:36 -07:00
hniksic b307160959 [svn] Made --spider work with FTP downloads. 
By Aaron S. Hawley.
 2003-09-30 14:14:02 -07:00
hniksic a95b801f61 [svn] Windows fixes by Gisle Vanem. 2003-09-26 17:35:31 -07:00
hniksic 700df4394e [svn] Fixes to support out of the box compilation on various Windows compilers. 
By Gisle Vanem.
 2003-09-25 15:39:37 -07:00
hniksic 831f376303 [svn] Fix oversight in escape handling. 2003-09-25 15:31:35 -07:00
hniksic e6fd9cb793 [svn] Force printing of ETA at the end of download. 2003-09-23 13:48:10 -07:00
hniksic 845a0988b1 [svn] Remove .libs directory when cleaning up. 2003-09-23 13:10:59 -07:00
hniksic 45164e05cc [svn] Fix a bug when loading cookies. Don't ignore domain-flag. 2003-09-22 18:08:01 -07:00
hniksic 625a9d3a9f [svn] Indicate where the download has started in progress bar. 2003-09-22 10:14:19 -07:00
hniksic c2ffc02ab3 [svn] If hash/test functions aren't given, default to identity hash tables. 2003-09-22 07:32:17 -07:00
hniksic e6d8f06093 [svn] Fix broken cast of BIT to unsigned char. 2003-09-21 19:05:34 -07:00
hniksic 3e9dc5b994 [svn] Modified path_simplify not to rely on extensive use of memmove. 2003-09-21 17:23:44 -07:00
hniksic 95c647eb44 [svn] Split off non-URL related stuff from url.c to convert.c. 2003-09-21 15:47:14 -07:00
hniksic e0303dd8ea [svn] Improved init.c error messages. 2003-09-21 12:17:45 -07:00
hniksic 7211c51139 [svn] path_simplify would read two bytes past the end of the string in the "./" case. 2003-09-21 06:36:50 -07:00
hniksic c06d32a309 [svn] Treat xhtml files just like regular html. 
By Matthew J. Mellon.
 2003-09-21 05:02:57 -07:00
hniksic 51a8e9fa50 [svn] Enabled separation of different timeout values. 2003-09-20 21:41:55 -07:00
hniksic b8e416c6c7 [svn] Adjust bandwidth limitation sleep for the error of previous sleeps. 
Allow decimal numbers in bandwidth limit specification.
 2003-09-20 21:05:12 -07:00
hniksic 37183b0208 [svn] Make errors in command-line options fatal. 2003-09-20 17:41:49 -07:00
hniksic 7870937036 [svn] Allow decimal values for --timeout, --wait, and --waitretry. 
Message-ID: <m3llsjhx6t.fsf@hniksic.iskon.hr>
 2003-09-20 16:12:18 -07:00
hniksic e7998ad916 [svn] Cosmetic fixes. 2003-09-20 14:08:41 -07:00
hniksic 101f896e47 [svn] Minor fixes and cosmetic changes. 
(uri_merge): Get rid of uri_merge_1.
(uri_merge): Merge "foo//", "bar" as "foo//bar", not "foo///bar",
i.e. don't add an extra slash merely because BASE ends with two
slashes.
(parse_credentials): Renamed from parse_uname.  Rewrittern in
standard [beg, end) calling style.
(url_skip_credentials): Renamed from url_skip_uname.  Made static.
(url_skip_credentials): Include # and ; as terminators.  Old code
would mistakenly consider "http://foo.com#hniksic@iskon.hr" to
contain a username.
(url_skip_scheme): Removed because it was unused.
(url_has_scheme): Require "scheme" to be at least one char long.
 2003-09-19 17:05:36 -07:00
hniksic a504d10ed5 [svn] Default dir_prefix to NULL rather than ".". 2003-09-19 08:28:36 -07:00
hniksic 4fd9c65005 [svn] Cosmetic change. 2003-09-19 07:20:35 -07:00
hniksic 7b5fb50cb1 [svn] Renamed wget.h XDIGIT-related macros to (hopefully) clearer names. 2003-09-19 07:08:37 -07:00
hniksic 7c802e58d3 [svn] Introduce non-strict comment parsing. 2003-09-18 17:33:22 -07:00
hniksic e71b2799d2 [svn] Add support for OS/400 ftp server. 2003-09-18 06:46:17 -07:00
hniksic fb67dd6201 [svn] Call ssl_iread with the correct arguments. 2003-09-18 04:43:00 -07:00
hniksic beb08d42ba [svn] Don't #define ctype.h macros to errors. 2003-09-18 04:39:22 -07:00
hniksic 4dcee39c88 [svn] Undef U, W, C after use. 2003-09-16 18:59:46 -07:00
hniksic aa24b822ca [svn] Improved --restrict-file-names to accept ",nocontrol". 2003-09-16 18:32:05 -07:00
hniksic d4281f04b2 [svn] Made sync_path more resilient to pathological values of u->file and u->dir. 2003-09-16 17:18:52 -07:00
hniksic 4b1afddab3 [svn] Allow unique_name to return the FILE argument unmodified. 
Streamline and optimize unique_name_1.
 2003-09-16 14:47:49 -07:00
hniksic c95d75292b [svn] Work around VC's inability to cast unsigned __int64 to void. 2003-09-16 14:16:59 -07:00
hniksic 8514281d39 [svn] Have `make clean' also delete the core.<number> files created by recent 
Linux systems.
 2003-09-15 16:42:59 -07:00
hniksic 0e77942233 [svn] Don't pad shrunk POST'ed files. 
Message-ID: <m3u17dn1qk.fsf@hniksic.iskon.hr>
 2003-09-15 15:09:17 -07:00
hniksic d54b2a086d [svn] Improved --limit-rate for small bandwidths. 
Message-ID: <m3znh5n2og.fsf@hniksic.iskon.hr>
 2003-09-15 14:48:43 -07:00
hniksic 9228f0bf53 [svn] Update progress code to use higher timer resolution. 
Message-ID: <m37k49oivp.fsf@hniksic.iskon.hr>
 2003-09-15 14:14:15 -07:00
hniksic ea8a108b1f [svn] Implement xdigit_to_xchar more efficiently. 2003-09-15 10:50:43 -07:00
hniksic 016867ca33 [svn] Another version of parse_set_cookies, along with a test suite. 2003-09-15 08:35:47 -07:00
hniksic 79157a03fd [svn] Made strpbrk_or_eos a macro under Gcc. 2003-09-15 03:47:46 -07:00
hniksic 3abcd16d79 [svn] Allow trailing whitespace in Set-Cookies. Also allow empty Set-Cookies 
without spewing an error.
Message-ID: <m365jucpci.fsf@xemacs.org>.
 2003-09-15 03:35:01 -07:00
hniksic 0a3697ad65 [svn] New mechanism for quoting file names. 
Published in <m3smmzt4px.fsf@hniksic.iskon.hr>.
 2003-09-14 15:04:13 -07:00
hniksic ebea9e7e0b [svn] Fixed a long-standing bug in the timer code that would cause Wget to 
crash when the system time was set back during a Wget run.
Message-ID: <m3znh8wag9.fsf@hniksic.iskon.hr>
 2003-09-13 16:12:45 -07:00
hniksic 7e7ce3dc0e [svn] Print the result of DNS lookup. 2003-09-10 13:46:32 -07:00
hniksic bda244f564 [svn] Allow --foo=yes/no in addition to --foo=on/off. 2003-09-10 13:21:21 -07:00
hniksic 10137bd186 [svn] New option --dns-cache. 2003-09-10 12:41:54 -07:00
hniksic cd8b1259f1 [svn] IPv6 configure auto-detection. 2003-09-09 12:30:45 -07:00
hniksic 0e9b4de751 [svn] Return an error from url_parse if the IP address is IPv6 and we don't 
handle IPv6.
 2003-09-09 06:06:58 -07:00
hniksic 05715ed4d6 [svn] Add proper detection of numeric IPv6 addresses. 
By Mauro Tortonesi.
 2003-09-05 13:36:17 -07:00
hniksic 30ac043b0a [svn] New option --retry-connrefused from Ahmod Dancy. 2003-09-04 14:34:58 -07:00
abbotti 0410411939 [svn] Fix for FTP directory traversal vulnerability (at least for Unix). 
Based on a patch by Red Hat.
Published in <85u02vg4hukbc2fltdd51uds5oq14rd92f@farscape.privy.mev.co.uk>.
 2003-01-11 12:12:35 -08:00
hniksic 27483fd0f5 [svn] Fix off-by-one error in cmd_file. 
Published in <sxsit2rfzqo.fsf@florida.munich.redhat.com>.
 2002-08-03 13:34:58 -07:00
hniksic d7673d398b [svn] Check whether downloaded_html_set is non-NULL before using it. 
Posted in <sxsr8hsvnhh.fsf@florida.munich.redhat.com>.
 2002-07-24 14:16:30 -07:00
hniksic 89b37c7eff [svn] Allow almost any character in attribute/tag names. 2002-05-27 08:03:35 -07:00
hniksic d3a636f2a5 [svn] Fall back to dot progress if the terminal type is "emacs". 
Published in <sxsd6vllhsi.fsf@florida.munich.redhat.com>.
 2002-05-24 07:53:18 -07:00
hniksic f97f3ef416 [svn] Don't #define __STDC__ against the compiler's will. 
Published in <sxsptzr64ea.fsf@florida.munich.redhat.com>.
 2002-05-19 17:38:14 -07:00
hniksic a4abdda23d [svn] Minor optimization of prime_size. 
Published in <sxswuu2p6pm.fsf@florida.munich.redhat.com>.
 2002-05-17 18:48:39 -07:00
abbotti 83dc077b17 [svn] (download_child_p): Minor optimization to avoid unnecessary call to 
schemes_are_similar_p function.
Published in <kvq7eu4okekh2ohb0rdvavt16nbgb02v00@farscape.privy.mev.co.uk>.
 2002-05-16 10:38:30 -07:00
abbotti e863a6323b [svn] New function schemes_are_similar_p to test enumerated scheme codes for 
similarity (SCHEME_HTTP and SCHEME_HTTPS are similar).  Use it in recur.c
(download_child_p).  Fixes a bug that caused -H option to be ignored when
child scheme different to parent scheme.
Published in <agn4eu8apduek7magfu9bfe63gto8i7cdh@farscape.privy.mev.co.uk>.
 2002-05-16 10:22:24 -07:00
abbotti 043d305fb1 [svn] Don't ftruncate standard output. 
Submitted by Bill Richardson  <bill@riverstonenet.com>.
Final version of patch published in
<9vv1eus668tn7v3vn95e7l2lcjbbph8bi2@farscape.privy.mev.co.uk>.
 2002-05-14 05:23:51 -07:00
abbotti 55f59d0022 [svn] Synched strptime with glibc 2.1.3. 2002-05-09 03:14:15 -07:00
hniksic fd42ae1311 [svn] Allow match_tail to be case insensitive. 
Published in <sxsznzabirr.fsf@florida.munich.redhat.com>.
 2002-05-08 11:24:40 -07:00
abbotti 291693c3c2 [svn] Do not store discarded cookie after it is delected. 
Submitted by Ian Abbott in
<2h2gdu0q04v94ltet2634888sh6imcrgnd@farscape.privy.mev.co.uk>.
 2002-05-07 10:22:33 -07:00
hniksic 58ee1f008a [svn] Fix matching of cookie domains. 
Published in <sxsy9fhu1bu.fsf@florida.arsdigita.de>.
 2002-04-20 21:25:36 -07:00
hniksic 91a190a770 [svn] Implement several SSL features. 
- allow checking of server cert
- allow defining client cert type
- allow limit of ssl protocol
- check more return values
- added debug message on break
Published by Thomas Lussnig in <3CC09969.5000607@bewegungsmelder.de>.
 2002-04-20 19:26:48 -07:00
hniksic bf018d5721 [svn] Revert order of check number 6 in download_child_p for clarity. 2002-04-20 19:15:11 -07:00
hniksic 29a66192cf [svn] Cookie interface and implementation changes 
from <sxsofge9yao.fsf@florida.arsdigita.de>
and <sxslmbim7dg.fsf@florida.arsdigita.de>.
 2002-04-20 13:46:38 -07:00
hniksic a9e97711fa [svn] Keep the commands list in sort order! 2002-04-19 02:24:32 -07:00
hniksic 123034fa83 [svn] Remove stray conflict marker. 2002-04-16 13:15:23 -07:00
hniksic 7953158bce [svn] Correctly merge DOS-like absolute directories. 
Published in <sxslmbomnm7.fsf@florida.arsdigita.de>.
 2002-04-15 18:36:16 -07:00
hniksic 426bf23ae1 [svn] If content-type is not given, assume text/html. 2002-04-15 18:13:51 -07:00
hniksic f8b4b8bd12 [svn] When downloading recursively, don't ignore rejection of HTML 
documents that are themselves leaves of recursion.
 2002-04-15 14:57:10 -07:00
abbotti 4c11f1b269 [svn] Updated several dependencies for object files, taking account of nested 
include files.
Submitted by Ian Abbott.
 2002-04-15 13:15:43 -07:00
abbotti 56698ffd1d [svn] Updated dependencies of connect$o to include utils.h 2002-04-15 12:10:23 -07:00
abbotti caa0f23be3 [svn] Fix broken Windows builds due to the xxx_with_timeout stuff. 
Submitted by Ian Abbotti in <3CBB2FFE.20193.73A594@localhost>.
 2002-04-15 12:01:56 -07:00
hniksic 036f99c801 [svn] Extend the timeout to DNS lookups. 
Published in <sxsn0w57ldh.fsf@florida.arsdigita.de>.
 2002-04-14 19:21:38 -07:00
hniksic fbf0306dd7 [svn] Have number_to_string handle the case when number < -MAX_INT. 
Published in <sxs662uf7l9.fsf@florida.arsdigita.de>.
 2002-04-14 12:18:33 -07:00
hniksic 081e4eb4f4 [svn] Use a marginally faster implementation of binary search. 
Published in <sxs662uf7l9.fsf@florida.arsdigita.de>.
 2002-04-14 11:39:43 -07:00
hniksic 0eee8f8b25 [svn] Document `--post-data' and `--post-file'. 2002-04-13 22:31:11 -07:00
hniksic 9f2cc07924 [svn] Minor cleanup of iread/iwrite. 
Published in <sxsk7raj1t2.fsf@florida.arsdigita.de>.
 2002-04-13 22:19:27 -07:00
hniksic 5cb8a6f44d [svn] Add the POST method. 
Published in <sxssn5yj4eb.fsf@florida.arsdigita.de>.
 2002-04-13 21:22:47 -07:00
hniksic f3d3a50a56 [svn] Generalize connect_with_timeout into run_with_timeout. 
Published in <sxs4rifxndi.fsf@florida.arsdigita.de>.
 2002-04-13 15:18:28 -07:00
hniksic 5390ada318 [svn] Support FWTK-style proxies. 
Pbublished in <sxslmbsxptu.fsf@florida.arsdigita.de>.
 2002-04-12 20:04:47 -07:00
hniksic 278b63093f [svn] Remove stray conflict marker. 2002-04-12 13:28:05 -07:00
hniksic faf77c8f51 [svn] Only define _VA_LIST when compiling with gcc. 
Published in <sxsit6w1x5t.fsf@florida.arsdigita.de>.
 2002-04-12 13:27:18 -07:00
abbotti 4aaf8fdcea [svn] Compensate for MS Windows two-second granularity of file modification 
timestamps.
Submitted by Ian Abbott in <3CB7355C.21011.2134FDA@localhost>.
 2002-04-12 12:21:02 -07:00
abbotti cfd7b9a951 [svn] Use new function to test filename for common html suffixes. 
Submitted by Ian Abbott in <3CB72D29.4898.1F34872@localhost> with minor
changes to formatting and comments.
 2002-04-12 11:53:39 -07:00
hniksic 2a72eef0af [svn] Define _VA_LIST to prevent Solaris stdio.h from declaring va_list. 
Published in <sxs1ydk4vg0.fsf@florida.arsdigita.de>.
 2002-04-12 11:36:07 -07:00
abbotti fa2fa7a100 [svn] Specify libtool mode explicitly when linking. 
Submitted by Ian Abbott in <3CB6F27B.15581.10E13BA@localhost>.
 2002-04-12 06:47:02 -07:00
hniksic 0cd669109b [svn] Implement connect timeout. 
Published in <sxs1ydld8ha.fsf@florida.arsdigita.de>.
 2002-04-11 18:14:18 -07:00
hniksic fca8dcf829 [svn] Use stdarg only if compiling with an ANSI C compiler. 2002-04-11 12:13:57 -07:00
hniksic c77a16309f [svn] Don't allow initial_length to exceed total_length. 
Published in <sxssn62dq99.fsf@florida.arsdigita.de>.
 2002-04-11 11:51:26 -07:00
hniksic 8f93191f26 [svn] Convert URLs in <form action=...>. 
Published in <sxsit6yf7jo.fsf@florida.arsdigita.de>.
 2002-04-11 10:51:45 -07:00
hniksic 1375a89141 [svn] Allow Wget to be compiled with a K&R compiler. 
Published in <sxszo0af9k6.fsf@florida.arsdigita.de>.
 2002-04-11 10:49:32 -07:00
hniksic 485673c3a8 [svn] Make sure directory and file names are encoded the same way. 
Published in <sxsofgqmf6e.fsf@florida.arsdigita.de>.
 2002-04-11 08:25:51 -07:00
hniksic 8c3287dabf [svn] Remove the OPTIONS_DEFINED_HERE kludge. 
Published in <sxs4rijqmhv.fsf@florida.arsdigita.de>.
 2002-04-10 14:20:55 -07:00
hniksic 1600aaeaa6 [svn] Revert to calculating ETA based on average download speed. 
Published in <sxspu17sl10.fsf@florida.arsdigita.de>.
 2002-04-10 07:10:03 -07:00
hniksic 538307f151 [svn] Keep updating a subinterval until it reaches or exceeds a watermark. 
That way the measurement will be guaranteed to span a configurable
minimum of time.  The current default is 3s in 30 100ms intervals.

Published in <sxsu1qkszdb.fsf@florida.arsdigita.de>.
 2002-04-10 02:24:28 -07:00
hniksic c292e8e153 [svn] Print the current download speed, rather than the average. 
Published in <sxs3cy4yacm.fsf@florida.arsdigita.de>.
 2002-04-09 15:10:01 -07:00
abbotti c3c1c24f5c [svn] Fix for Borland's broken (on Win9X) `utime' function. 
Submitted by Ian Abbott in <3CB33A8E.15259.1E52AF@localhost>.
(Based on original patch by Chin-yuan Kuo in
<20020321015049.16722.qmail@web16202.mail.tpe.yahoo.com>.)
 2002-04-09 11:29:54 -07:00
hniksic 07d72c3cd3 [svn] Propagate the result of ftp_retrieve_glob to the caller of ftp_loop. 
Published in <sxssn663zwl.fsf@florida.arsdigita.de>.
 2002-04-08 09:43:36 -07:00
abbotti 80a90d6d2c [svn] Updated several dependencies for object files. 
Submitted by Ian Abbott in <3C9F8BA4.19135.14568BF@localhost>.
 2002-03-26 10:59:44 -08:00
abbotti 9f485af560 [svn] Dependcies update for src/mswindows.c. 
Submitted by Ian Abbott in <3C98D8C6.31335.36EB6F@localhost>.
 2002-03-20 10:56:45 -08:00
abbotti 47a8225eda [svn] Don't include netdb.h on windows. 
Submitted by Ian Abbott in <3C964B8C.18942.D3115@localhost>.
 2002-03-18 12:21:58 -08:00
hniksic 1fa3b90235 [svn] Handle starting URL of recursing download being non-parsable. 
Published in <sxszo26t33k.fsf@florida.arsdigita.de>.
 2002-02-18 22:09:57 -08:00
hniksic 562ab4ae8a [svn] (DO_REALLOC_FROM_ALLOCA): Multiply with sizeof(type) when calling 
xmalloc and memcpy.
Submitted by Andreas Damm in
<Pine.LNX.4.33.0202011632280.1281-200000@gate.rad-ab.u-net.com>.
 2002-02-18 21:32:59 -08:00
hniksic 667d494978 [svn] Only include Unix-specific includes #ifndef WINDOWS. 2002-02-18 21:25:42 -08:00
hniksic 75a080ad0d [svn] Follow https links from http. 
Submitted by Christian Lackas in <20020211202444.GA20371@lackas.desy.de>.
 2002-02-18 21:23:35 -08:00
hniksic 57f36f8a6a [svn] Add the necessary includes for compilation under FreeBSD. 
Submitted by Alan Eldridge in <200202130630.g1D6U3S07907@wwweasel.geeksrus.net>.
 2002-02-18 21:21:42 -08:00
hniksic a9ff5853a9 [svn] when -c used, mark already fully retrieved file as successfully retrieved. 
Submitted by Ian Abbott in <3C6019F4.30803.FF43E9@localhost>.
 2002-02-18 21:18:43 -08:00
hniksic b9e90c34b4 [svn] Don't treat '?' as a query string separator when parsing FTP URLs. 
Published in <sxslmdqxdmq.fsf@florida.arsdigita.de>.
 2002-02-18 21:09:14 -08:00
hniksic 0e40fc9a3c [svn] Don't crash on <meta http-equiv=refresh>. 
Published in <sxshep1q3je.fsf@florida.arsdigita.de>.
 2002-01-31 19:34:31 -08:00
hniksic a861f718ed [svn] Enable compilation on Windows. 
Submitted by Herold Heiko in
<B11A7CEC1675D511A3890002A551AD7C37D8AE@srvnt08.previnet.it>.
 2002-01-30 18:23:04 -08:00
hniksic 6c4c785cc2 [svn] Remove redirection cycle detection. 
Published in <sxs7kpzhcwa.fsf@florida.arsdigita.de>.
 2002-01-30 11:12:20 -08:00
hniksic f2bb99d102 [svn] Wrap numeric IPv6 addresses in square brackets when sending out HTTP 
`Host' header.
Published in <sxs7kq4vgzf.fsf@florida.arsdigita.de>.
 2002-01-26 15:19:10 -08:00
hniksic 1bea726393 [svn] Allow all hex digits in IPv6 IP addresses. 
Published in <sxsofjgvo72.fsf@florida.arsdigita.de>.
 2002-01-26 12:43:17 -08:00
hniksic ef1eda86c4 [svn] Allow IPv6 numeric addresses in URLs. 
Submitted in <sxsu1t9uedf.fsf@florida.arsdigita.de>.
 2002-01-26 11:00:38 -08:00
hniksic a69cb0c3ad [svn] Various IPv6 fixes. 
Submitted in <sxsd6zz2jf7.fsf@florida.arsdigita.de>.
 2002-01-24 19:34:23 -08:00
hniksic 853a1c9e35 [svn] Fix some IPv6-related problems. 
Submitted in <sxsg04w6zl6.fsf@florida.arsdigita.de>.
 2002-01-23 22:19:35 -08:00
hniksic cb40034035 [svn] Commit IPv6 support by Thomas Lussnig. 
Published in <sxsk7u8715e.fsf@florida.arsdigita.de>.
 2002-01-23 21:45:54 -08:00
hniksic e59a7ee8ac [svn] Make -P work on Windows. 
Submitted by Ian Abbott in <3C447E8F.13424.16ED42@localhost>.
 2002-01-16 17:03:33 -08:00
hniksic fb2ed23830 [svn] Skip initial whitespace before testing for EOL. 
Submitted in <sxsu1tl6bf2.fsf@florida.arsdigita.de>.
 2002-01-16 16:59:13 -08:00
hniksic 31d20e644c [svn] select the file descriptor only if no data is pending in SSL buffers. 
Submitted by tony@bluetail.com.
Published in <sxslmezocyp.fsf@florida.arsdigita.de>.
 2002-01-15 07:24:19 -08:00
hniksic 08c935bef2 [svn] Strip trailing whitespace in header_process(). 
Published in <sxsadvh0xpz.fsf@florida.arsdigita.de>.
 2002-01-14 07:17:34 -08:00
hniksic 46617228fa [svn] URL-decode user and password in URL. 
Published in <sxsita52hg6.fsf@florida.arsdigita.de>.
 2002-01-14 05:26:16 -08:00
hniksic 524a1f54dc [svn] Handle links to relative "net locations," e.g. <a href="//www.server.com/">. 2002-01-13 17:56:40 -08:00
hniksic cafe798fec [svn] Invalidate socket if get_contents encountered an error. 
Published in <sxsita54sqy.fsf@florida.arsdigita.de>.
 2002-01-13 17:39:16 -08:00
hniksic 11745f55bf [svn] Bump version to 1.8.1. 2001-12-24 13:02:25 -08:00
hniksic 5c859be2d4 [svn] Bump version to 1.8.1-pre3. 2001-12-19 06:59:01 -08:00
hniksic 8db1264218 [svn] Enqueue start_url in the canonical form. 
Published in <sxsofkvi8zx.fsf@florida.arsdigita.de>.
 2001-12-19 06:27:29 -08:00
hniksic 001cac91a4 [svn] Check for requested verbosity in logputs. 
Published in <sxswuzjk0v6.fsf@florida.arsdigita.de>.
 2001-12-19 01:36:58 -08:00
hniksic ca9319aaba [svn] Treat the "shortcut icon" link as inline. 
Published in <sxsadwgko2q.fsf@florida.arsdigita.de>.
 2001-12-18 17:15:34 -08:00
hniksic 2cf87bea8b [svn] Fix crash introduced by previous patch. 2001-12-18 14:20:14 -08:00
hniksic 40fd876c57 [svn] Descend into HTML files we've already downloaded. 2001-12-18 14:14:31 -08:00
hniksic 416671063a [svn] Propagate referrer information from retrieve_tree to retrieve_url. 
Submitted by Ian Abbott in <3C1F4BFE.17436.D2D7B2@localhost>.
 2001-12-18 07:22:03 -08:00
hniksic f03f033bf3 [svn] Bump version to 1.8.1-pre2. 2001-12-17 07:24:14 -08:00
hniksic eb0f9de05d [svn] Simplify indentation in sleep_between_retrievals. 2001-12-17 07:00:25 -08:00
hniksic 75699d6213 [svn] Use the new function `random_number' that doesn't depend on RAND_MAX 
being defined.
Published in <sxsheqqq6xb.fsf@florida.arsdigita.de>.
 2001-12-17 06:05:08 -08:00
hniksic a3500d32d7 [svn] Move path_simplify to url.c. 2001-12-14 07:46:00 -08:00
hniksic 0f120eee66 [svn] Fix error message when $WGETRC not found. 
Published in <sxswuzrylnm.fsf@florida.arsdigita.de>.
 2001-12-13 11:19:03 -08:00
hniksic f031900662 [svn] Don't abort when one URL references more than one file. 
Published in <sxs1yhz0w1m.fsf@florida.arsdigita.de>.
 2001-12-13 11:18:31 -08:00
hniksic 5b575eef31 [svn] Check for conn->ssl before using ssl_iwrite. 2001-12-13 08:46:56 -08:00
hniksic 6821132a4d [svn] Bump version to 1.8.1-pre1. 2001-12-12 23:40:50 -08:00
hniksic 3b44ca73ab [svn] Fix the broken URLs that pointed to info.webcrawler.com to point to 
the new www.robotstxt.org site.
 2001-12-12 23:29:05 -08:00
hniksic 3ddcea34a4 [svn] Mark <embed href=...> as external. 2001-12-12 23:18:59 -08:00
hniksic b9f370004d [svn] Cosmetic changes to get_urls_html. 2001-12-12 11:06:10 -08:00
hniksic d425985c37 [svn] Minor doc update. 2001-12-12 09:01:26 -08:00
hniksic 8817f4c1a4 [svn] Break up collect_tags_mapper into several functions. 
Published in <sxsg06gla1h.fsf@florida.arsdigita.de>.
 2001-12-12 07:43:01 -08:00
hniksic 1dee527a56 [svn] Use a typedef for IPv4 address. 
Published in <sxsn10qrwbj.fsf@florida.arsdigita.de>.
 2001-12-11 00:32:58 -08:00
hniksic b8789d7798 [svn] Fix obvious memory leaks in the VMS directory parser. 
Published in <sxsadwqpbo1.fsf@florida.arsdigita.de>.
 2001-12-10 21:29:52 -08:00
hniksic 1365950c01 [svn] Logging system bugfixes and improvements. 
Published in <sxsofl7vdyo.fsf@florida.arsdigita.de>.
 2001-12-09 21:31:45 -08:00
hniksic fb9368e889 [svn] Restore sanity check in address_list_set_faulty. 2001-12-09 18:33:08 -08:00
hniksic 943f657aa7 [svn] Rename long_to_string to number_to_string, and make it return a useful 
value.
 2001-12-09 18:29:12 -08:00
hniksic 997a87548c [svn] Minor fix for path_simplify. 
Submitted in <sxsheqzx1qv.fsf@florida.arsdigita.de>.
 2001-12-09 18:12:17 -08:00
hniksic 0e72aa6e13 [svn] Rewrite path_simplify. 
Published in <sxspu5nx2yi.fsf@florida.arsdigita.de>.
 2001-12-09 17:58:37 -08:00
hniksic 233fcbc44d [svn] Would abort when given invalid progress type. 
Published in <sxsg06kxc9g.fsf@florida.arsdigita.de>.
 2001-12-09 14:25:34 -08:00
hniksic e521ee38ff [svn] Remove stray debugging message. 
Published in <sxszo4sxjpw.fsf@florida.arsdigita.de>.
 2001-12-09 11:44:20 -08:00
hniksic 0a89fc1a10 [svn] Fix a minor ETA padding glitch. 
Published in <sxs667hyp19.fsf@florida.arsdigita.de>.
 2001-12-08 20:51:40 -08:00
hniksic fdd51b8d46 [svn] Bump version to 1.8. 2001-12-08 17:37:17 -08:00
hniksic dd84231c6a [svn] Minor fixes prompted by `lint'. 
Published in <sxsadwt2nkg.fsf@florida.arsdigita.de>.
 2001-12-08 17:24:41 -08:00
hniksic 60680e27db [svn] Release 1.8-pre2. 2001-12-07 19:44:23 -08:00
hniksic 4e5bbd646b [svn] Various progress-bar related fixes. 
Published in <sxspu5slja3.fsf@florida.arsdigita.de>.
 2001-12-06 02:45:27 -08:00
hniksic 760e87d7a0 [svn] Bump version to 1.8-pre1. 2001-12-05 23:17:20 -08:00
hniksic 39b2248bde [svn] Fall back to dot progress when forced to background. 
Published in <sxs1yi8n7lx.fsf@florida.arsdigita.de>.
 2001-12-05 23:14:35 -08:00
hniksic f8e6feb6bc [svn] Fix varargs usage in logvprintf. 
Published in <sxs667knbe1.fsf@florida.arsdigita.de>.
 2001-12-05 21:53:21 -08:00
hniksic fcf68c0e9a [svn] `--sslegdsock' -> `--egd-file' 
Published in <sxsadwwnc7h.fsf@florida.arsdigita.de>.
 2001-12-05 21:35:17 -08:00
hniksic e16c0ba78e [svn] Add information about the beta releases. 2001-12-05 17:24:24 -08:00
hniksic f5d20aef32 [svn] Make the message printed in ssl_init_prng translatable. 2001-12-05 17:15:05 -08:00
hniksic 0620ada923 [svn] Fix OpenSSL PRNG seeding. 
Published in <sxs7ks1noc4.fsf@florida.arsdigita.de>.
 2001-12-05 17:13:31 -08:00
hniksic b248bfe395 [svn] Don't abort in read_whole_lines when a line begins with \0. 
Published in <sxsu1v5nrtg.fsf@florida.arsdigita.de>.
 2001-12-05 15:58:12 -08:00
hniksic 8a2ab60263 [svn] Fix overzealous URL-removal in register_download. 
Published in <sxszo4yqq91.fsf@florida.arsdigita.de>.
 2001-12-04 19:51:23 -08:00
hniksic eef4527c24 [svn] Doc fix. 2001-12-04 15:42:18 -08:00
hniksic 0fdc1bd8c0 [svn] Fix downloading of duplicate URLs. 
Published in <sxsvgfmu2bj.fsf@florida.arsdigita.de>.
 2001-12-04 13:03:35 -08:00
hniksic abf215c1e3 [svn] snprintf.c (dopr): Use `unsigned int' as the second argument to va_arg 
when casting to `unsigned short' is intended.
Submitted by Ian Abbott in <3C0CB09F.21762.34A1F1@localhost>.
 2001-12-04 04:44:58 -08:00
hniksic f70c9c6ede [svn] Windows update from Herold Heiko. 2001-12-04 02:33:18 -08:00
hniksic e986f7dad3 [svn] Quote '?' as '%3F' in local files when `--html-extension' is turned on. 
Published in <sxszo4ztiwr.fsf@florida.arsdigita.de>.
 2001-12-04 01:49:37 -08:00
hniksic 79f868cd0f [svn] Cast va_arg(..., int) to short if a short value is expected. 
Published in <sxsbshgxfs5.fsf@florida.arsdigita.de>.
 2001-12-03 11:31:17 -08:00
hniksic f58c338aea [svn] snprintf.c: Replace `short int' and `unsigned short int' with `int' when 
using it as the second argument to `va_arg'.
Published in <sxsu1v8xisg.fsf@florida.arsdigita.de>.
 2001-12-03 10:28:08 -08:00
hniksic 29a338cc58 [svn] Use address_list_new_one. 
Published in <sxsbshgyz71.fsf@florida.arsdigita.de>.
 2001-12-03 09:48:12 -08:00
hniksic 400201444f [svn] Don't initialize TMPSTORE directly. 
Submitted by Andre Majorel.
 2001-12-03 09:31:23 -08:00
hniksic 6d93a95e37 [svn] Declare h_errno in host.c, but not elsewhere. 2001-12-03 09:22:06 -08:00
hniksic f5799945b0 [svn] file_merge: if BASE doesn't contain a slash, just return a copy of FILE. 
Published in <sxssnatmh6s.fsf@florida.arsdigita.de>.
 2001-12-02 13:44:16 -08:00
hniksic acf2d79a8a [svn] When PWD fails, assume "/". 
Published in <sxs667qr5a0.fsf@florida.arsdigita.de>.
 2001-12-01 13:37:40 -08:00
hniksic 8b2a216c77 [svn] Make --base -i work. 
Published in <sxsoflisqcf.fsf@florida.arsdigita.de>.
 2001-12-01 11:17:19 -08:00
hniksic 07e6be3527 [svn] Don't document `-nh' in --help output. 
Published in <sxs4rnau642.fsf@florida.arsdigita.de>.
 2001-12-01 10:51:32 -08:00
hniksic 569fd61c95 [svn] Use the full path when building the authorization line. 
Published in <sxsitbqu9iw.fsf@florida.arsdigita.de>.
 2001-12-01 09:39:07 -08:00
hniksic 3ff0a9ad00 [svn] Minor tweak in path_matches in cookies.c. 2001-12-01 07:34:55 -08:00
hniksic 57dd93f915 [svn] Don't expect HTTP paths to begin with '/'. 
Published in <sxsvgfrv7ky.fsf@florida.arsdigita.de>.
 2001-11-30 21:22:17 -08:00
hniksic 92b269acad [svn] Match hosts against domains per Netscape cookie "specification". 
Published in <sxszo53v8by.fsf@florida.arsdigita.de>.
 2001-11-30 21:08:03 -08:00
hniksic f4d019a423 [svn] Correctly convert links in <meta http-equiv=Refresh content="...">. 
Published in <sxsadx3wp49.fsf@florida.arsdigita.de>.
 2001-11-30 20:18:51 -08:00
hniksic 7ab7f93f8d [svn] Make -p work with framed pages. 
Published in <sxsu1vby71t.fsf@florida.arsdigita.de>.
 2001-11-30 19:06:41 -08:00
hniksic 406fb8bbef [svn] Don't allow more than 20 successive redirections. 2001-11-30 13:33:31 -08:00
hniksic a4db28e20f [svn] Ignore -np when in -p mode. 
Published in <sxsg06w2c52.fsf@florida.arsdigita.de>.
 2001-11-30 13:17:53 -08:00
hniksic 5baed885db [svn] Fix netrc authorization in conjunction with HTTP. 
Submitted by Daniel BODEA in <011901c162ca$19779df0$25c0a8c0@GHOTIX>.
 2001-11-30 01:33:22 -08:00
hniksic 2c37aef2d8 [svn] Don't forget to shutdown the SSL structure if the socket times out. 
Submitted by T. Bharath in <3B3DEBC7.2537186A@responsenetworks.com>.
 2001-11-30 00:57:03 -08:00
hniksic 7674ecd97e [svn] Simplify display_image. 2001-11-30 00:02:33 -08:00
hniksic ae3c268719 [svn] Implement EGD support. 
Submitted by Christian Fraenkel in <005501c17920$1312d440$4a05a8c0@isn>.
 2001-11-29 23:39:08 -08:00
hniksic 999388bfa0 [svn] Check for memmove and implement one if it's missing. 2001-11-29 11:43:29 -08:00
hniksic b6bbc32e14 [svn] Guard against header files getting included twice. 2001-11-29 10:55:52 -08:00
hniksic b65661a879 [svn] Remove char/unsigned char warnings emitted by Sun cc. 2001-11-29 10:48:43 -08:00
hniksic fb98d1e4b0 [svn] Remove implicit declaration warnings. 2001-11-29 10:22:18 -08:00
hniksic 39482df431 [svn] descend_url_p: When resolving no_parent, compare with the start url, 
not the parent url.
Published in <sxspu614ikm.fsf@florida.arsdigita.de>.
 2001-11-29 09:04:28 -08:00
hniksic 9c1c7f27cd [svn] Windows fixes by Herold Heiko. 2001-11-29 06:15:11 -08:00
hniksic bb8e524316 [svn] Initialize al->faulty. 
Published in <sxsvgft65an.fsf@florida.arsdigita.de>.
 2001-11-29 06:06:03 -08:00
hniksic 6218fbed2b [svn] Accept the broken Content-Range format emitted by Sun's server. 
Published in <sxsg06x7kld.fsf@florida.arsdigita.de>.
 2001-11-29 06:03:33 -08:00
hniksic fb7fb36cb8 [svn] Resurrect opt.dot_style. 2001-11-27 18:44:18 -08:00
hniksic d4c6949a05 [svn] Use rand instead of random. 
Published in <sxsu1vgataq.fsf@florida.arsdigita.de>.
 2001-11-27 11:49:28 -08:00
hniksic 9b202ba261 [svn] * retr.c (retrieve_from_file): Initialize `new_file' to NULL to 
prevent seg fault.
Submitted by Ian Abbott in <3C03DE8A.845.D0E495@localhost>.
 2001-11-27 11:14:34 -08:00
hniksic 8196a09904 [svn] Don't reuse IP addresses proven to be faulty, unless only such ones remain. 
Published in <sxs8zcsfemf.fsf@florida.arsdigita.de>.
 2001-11-27 06:55:40 -08:00
hniksic cca7541b10 [svn] Don't translate %d-%d. 2001-11-27 04:58:09 -08:00
hniksic 1c906e47d3 [svn] Remove stray HAVE_RANDOM check from main.c. 2001-11-27 04:54:31 -08:00
hniksic 9656223552 [svn] Fix FTP PASV output. 
Published in <sxslmgsfkgj.fsf@florida.arsdigita.de>.
 2001-11-27 04:49:13 -08:00
hniksic baf8750197 [svn] Default the progress implementation to "bar". 
Published in <sxsu1vgfqx7.fsf@florida.arsdigita.de>.
 2001-11-27 02:29:45 -08:00
hniksic 69c78db55b [svn] Commence bar progress with two newlines. 2001-11-27 02:17:09 -08:00