Commit Graph

682 Commits

Author SHA1 Message Date
hniksic 1b3cdef574 [svn] Don't descend into HTML that was downloaded by following <img src=...>
and such.
2003-10-10 07:25:10 -07:00
hniksic ffc2d0f653 [svn] Make the first argument to hash_table_new a minimal count of items before
regrow, not raw size, which is more useful.
2003-10-09 19:46:09 -07:00
hniksic 233ebb78de [svn] Use hash table for tag lookup in html-url.c and html-parse.c. 2003-10-09 08:01:58 -07:00
hniksic b49e89e78a [svn] Add const declarations to hash-table functions. 2003-10-09 06:32:28 -07:00
hniksic ae1d264fcc [svn] Add FLAGS argument to map_html_tags. 2003-10-08 09:17:33 -07:00
hniksic a9c3c58c9f [svn] Switch to binary search for find_tag. 2003-10-08 09:00:10 -07:00
hniksic 33dceca784 [svn] Fix typo in help string. 2003-10-08 08:24:56 -07:00
hniksic 6057dbec6f [svn] Add definitions of getopt_long and getopt_long_only to getopt.c.
The definitions were lost when updating the file.
2003-10-08 07:55:44 -07:00
hniksic e4d15a373b [svn] run_with_timeout docstring synch with utils.c. 2003-10-07 17:16:43 -07:00
hniksic f1a802d1c0 [svn] Cosmetic changes to GNU convention. 2003-10-07 17:09:56 -07:00
hniksic 38ea4d5dad [svn] Renamed DEBUG to ENABLE_DEBUG. 2003-10-07 17:05:51 -07:00
hniksic 097923f7b1 [svn] Move fnmatch() to cmpt.c and don't use it under GNU libc. 2003-10-07 16:53:31 -07:00
hniksic d7cbc755e0 [svn] Add a fresher getopt.c. 2003-10-07 15:58:27 -07:00
hniksic cc5d6f0ab8 [svn] Doc typo fix. 2003-10-07 14:45:26 -07:00
hniksic 3d823e690e [svn] Remove unused pointer from struct cookie. 2003-10-07 03:39:18 -07:00
hniksic df4064bc68 [svn] jar->chains_by_domain -> jar->chains 2003-10-06 17:49:58 -07:00
hniksic 6359e38d96 [svn] Improve documentation of cookie code. 2003-10-06 17:47:08 -07:00
hniksic abf7afb9d4 [svn] Fix type of _SetThreadExecutionState local var.
By Gisle Vanem.
2003-10-05 14:12:36 -07:00
hniksic 30c3b5bc8a [svn] Doc update. 2003-10-04 15:58:34 -07:00
hniksic 533412b55c [svn] Doc update. 2003-10-04 15:51:00 -07:00
hniksic 254291cc03 [svn] Fix crash when post-file is missing. 2003-10-04 15:26:58 -07:00
hniksic 711692375e [svn] Use WaitForSingleObject to wait for thread termination.
By Gisle Vanem.
2003-10-04 14:54:12 -07:00
hniksic 98b7ac79f3 [svn] Update ansi2knr.c and ansi2knr.1.
Update log.c to use `...' in function definition argument lists
unconditionally.
2003-10-04 03:34:10 -07:00
hniksic 351c4b9add [svn] Include winsock headers from mswindows.h.
By Gisle Vanem.
2003-10-03 09:37:47 -07:00
hniksic 87275db136 [svn] Fix compilation problem on non-Gcc compilers. 2003-10-03 09:11:09 -07:00
hniksic 5a905bcec3 [svn] Window-specific implementation of run_with_timeout.
By Gisle Vanem.
2003-10-02 16:28:49 -07:00
hniksic eec3ea392d [svn] Better document html-parse macros. 2003-10-02 15:20:44 -07:00
hniksic f70c6cacb9 [svn] Initialize DUMMY storage for DT. 2003-10-02 14:21:07 -07:00
hniksic 2e8899bc10 [svn] Added support for hexadecimal numeric entities. 2003-10-02 10:23:25 -07:00
hniksic 675c1a703c [svn] Doc fixes. 2003-10-02 08:15:36 -07:00
hniksic 030704403b [svn] Subsecond granularity in run_with_timeout. 2003-10-02 06:37:45 -07:00
hniksic 4055ebc41f [svn] Synch doc/version.texi with src/version.c. 2003-10-01 13:44:15 -07:00
hniksic 65cec8deee [svn] Fix memory leak in a rare case in url.c.
Translate error messages from url_parse().
2003-10-01 12:59:48 -07:00
hniksic d0f4a1e109 [svn] Initialize local variable to shut up the compiler. 2003-10-01 12:45:41 -07:00
hniksic 6a2477fdc2 [svn] *** empty log message *** 2003-10-01 06:44:46 -07:00
hniksic 111dea9622 [svn] Updated copyright and email. 2003-09-30 14:54:27 -07:00
hniksic 451ddf3cf9 [svn] Display percentage in title bar.
By Gisle Vanem.
2003-09-30 14:24:36 -07:00
hniksic b307160959 [svn] Made --spider work with FTP downloads.
By Aaron S. Hawley.
2003-09-30 14:14:02 -07:00
hniksic a95b801f61 [svn] Windows fixes by Gisle Vanem. 2003-09-26 17:35:31 -07:00
hniksic 700df4394e [svn] Fixes to support out of the box compilation on various Windows compilers.
By Gisle Vanem.
2003-09-25 15:39:37 -07:00
hniksic 831f376303 [svn] Fix oversight in escape handling. 2003-09-25 15:31:35 -07:00
hniksic e6fd9cb793 [svn] Force printing of ETA at the end of download. 2003-09-23 13:48:10 -07:00
hniksic 845a0988b1 [svn] Remove .libs directory when cleaning up. 2003-09-23 13:10:59 -07:00
hniksic d403f7f835 [svn] Cosmetic change in var names. 2003-09-23 11:39:22 -07:00
hniksic 45164e05cc [svn] Fix a bug when loading cookies. Don't ignore domain-flag. 2003-09-22 18:08:01 -07:00
hniksic 625a9d3a9f [svn] Indicate where the download has started in progress bar. 2003-09-22 10:14:19 -07:00
hniksic c2ffc02ab3 [svn] If hash/test functions aren't given, default to identity hash tables. 2003-09-22 07:32:17 -07:00
hniksic 566289ea9d [svn] Added comment about SO_SNDBUF for post. 2003-09-22 06:55:22 -07:00
hniksic b8fa2039a7 [svn] Doc update. 2003-09-22 06:34:55 -07:00
hniksic bebad75ff9 [svn] Another doc update. 2003-09-22 05:07:20 -07:00
hniksic f78016fb95 [svn] path_simplify doc update. 2003-09-22 05:03:34 -07:00
hniksic e6d8f06093 [svn] Fix broken cast of BIT to unsigned char. 2003-09-21 19:05:34 -07:00
hniksic 3e9dc5b994 [svn] Modified path_simplify not to rely on extensive use of memmove. 2003-09-21 17:23:44 -07:00
hniksic 9d333d074b [svn] Include convert.h. 2003-09-21 16:32:42 -07:00
hniksic dadde97838 [svn] Removed spurious includes. 2003-09-21 16:09:06 -07:00
hniksic 95c647eb44 [svn] Split off non-URL related stuff from url.c to convert.c. 2003-09-21 15:47:14 -07:00
hniksic 12ffc87ca7 [svn] Update copyright. 2003-09-21 14:39:00 -07:00
hniksic e0303dd8ea [svn] Improved init.c error messages. 2003-09-21 12:17:45 -07:00
hniksic 7211c51139 [svn] path_simplify would read two bytes past the end of the string in the "./" case. 2003-09-21 06:36:50 -07:00
hniksic c06d32a309 [svn] Treat xhtml files just like regular html.
By Matthew J. Mellon.
2003-09-21 05:02:57 -07:00
hniksic 51a8e9fa50 [svn] Enabled separation of different timeout values. 2003-09-20 21:41:55 -07:00
hniksic b8e416c6c7 [svn] Adjust bandwidth limitation sleep for the error of previous sleeps.
Allow decimal numbers in bandwidth limit specification.
2003-09-20 21:05:12 -07:00
hniksic 37183b0208 [svn] Make errors in command-line options fatal. 2003-09-20 17:41:49 -07:00
hniksic 7870937036 [svn] Allow decimal values for --timeout, --wait, and --waitretry.
Message-ID: <m3llsjhx6t.fsf@hniksic.iskon.hr>
2003-09-20 16:12:18 -07:00
hniksic e7998ad916 [svn] Cosmetic fixes. 2003-09-20 14:08:41 -07:00
hniksic 101f896e47 [svn] Minor fixes and cosmetic changes.
(uri_merge): Get rid of uri_merge_1.
(uri_merge): Merge "foo//", "bar" as "foo//bar", not "foo///bar",
i.e. don't add an extra slash merely because BASE ends with two
slashes.
(parse_credentials): Renamed from parse_uname.  Rewrittern in
standard [beg, end) calling style.
(url_skip_credentials): Renamed from url_skip_uname.  Made static.
(url_skip_credentials): Include # and ; as terminators.  Old code
would mistakenly consider "http://foo.com#hniksic@iskon.hr" to
contain a username.
(url_skip_scheme): Removed because it was unused.
(url_has_scheme): Require "scheme" to be at least one char long.
2003-09-19 17:05:36 -07:00
hniksic a504d10ed5 [svn] Default dir_prefix to NULL rather than ".". 2003-09-19 08:28:36 -07:00
hniksic 4fd9c65005 [svn] Cosmetic change. 2003-09-19 07:20:35 -07:00
hniksic 7b5fb50cb1 [svn] Renamed wget.h XDIGIT-related macros to (hopefully) clearer names. 2003-09-19 07:08:37 -07:00
hniksic 7c802e58d3 [svn] Introduce non-strict comment parsing. 2003-09-18 17:33:22 -07:00
hniksic e71b2799d2 [svn] Add support for OS/400 ftp server. 2003-09-18 06:46:17 -07:00
hniksic fb67dd6201 [svn] Call ssl_iread with the correct arguments. 2003-09-18 04:43:00 -07:00
hniksic beb08d42ba [svn] Don't #define ctype.h macros to errors. 2003-09-18 04:39:22 -07:00
hniksic fdf7fd4d76 [svn] Removed unused macro ISODIGIT. 2003-09-16 19:00:12 -07:00
hniksic 4dcee39c88 [svn] Undef U, W, C after use. 2003-09-16 18:59:46 -07:00
hniksic aa24b822ca [svn] Improved --restrict-file-names to accept ",nocontrol". 2003-09-16 18:32:05 -07:00
hniksic d4281f04b2 [svn] Made sync_path more resilient to pathological values of u->file and u->dir. 2003-09-16 17:18:52 -07:00
hniksic 4b1afddab3 [svn] Allow unique_name to return the FILE argument unmodified.
Streamline and optimize unique_name_1.
2003-09-16 14:47:49 -07:00
hniksic c95d75292b [svn] Work around VC's inability to cast unsigned __int64 to void. 2003-09-16 14:16:59 -07:00
hniksic f5c82a6468 [svn] Added proper IPv6 configure detection.
By Mauro Tortonesi.
2003-09-16 05:24:29 -07:00
hniksic 8514281d39 [svn] Have `make clean' also delete the core.<number> files created by recent
Linux systems.
2003-09-15 16:42:59 -07:00
hniksic 0e77942233 [svn] Don't pad shrunk POST'ed files.
Message-ID: <m3u17dn1qk.fsf@hniksic.iskon.hr>
2003-09-15 15:09:17 -07:00
hniksic d54b2a086d [svn] Improved --limit-rate for small bandwidths.
Message-ID: <m3znh5n2og.fsf@hniksic.iskon.hr>
2003-09-15 14:48:43 -07:00
hniksic 9228f0bf53 [svn] Update progress code to use higher timer resolution.
Message-ID: <m37k49oivp.fsf@hniksic.iskon.hr>
2003-09-15 14:14:15 -07:00
hniksic ea8a108b1f [svn] Implement xdigit_to_xchar more efficiently. 2003-09-15 10:50:43 -07:00
hniksic 016867ca33 [svn] Another version of parse_set_cookies, along with a test suite. 2003-09-15 08:35:47 -07:00
hniksic 79157a03fd [svn] Made strpbrk_or_eos a macro under Gcc. 2003-09-15 03:47:46 -07:00
hniksic 3abcd16d79 [svn] Allow trailing whitespace in Set-Cookies. Also allow empty Set-Cookies
without spewing an error.
Message-ID: <m365jucpci.fsf@xemacs.org>.
2003-09-15 03:35:01 -07:00
hniksic 0a3697ad65 [svn] New mechanism for quoting file names.
Published in <m3smmzt4px.fsf@hniksic.iskon.hr>.
2003-09-14 15:04:13 -07:00
hniksic ebea9e7e0b [svn] Fixed a long-standing bug in the timer code that would cause Wget to
crash when the system time was set back during a Wget run.
Message-ID: <m3znh8wag9.fsf@hniksic.iskon.hr>
2003-09-13 16:12:45 -07:00
hniksic 7e7ce3dc0e [svn] Print the result of DNS lookup. 2003-09-10 13:46:32 -07:00
hniksic bda244f564 [svn] Allow --foo=yes/no in addition to --foo=on/off. 2003-09-10 13:21:21 -07:00
hniksic 10137bd186 [svn] New option --dns-cache. 2003-09-10 12:41:54 -07:00
hniksic cd8b1259f1 [svn] IPv6 configure auto-detection. 2003-09-09 12:30:45 -07:00
hniksic 0e9b4de751 [svn] Return an error from url_parse if the IP address is IPv6 and we don't
handle IPv6.
2003-09-09 06:06:58 -07:00
hniksic 05715ed4d6 [svn] Add proper detection of numeric IPv6 addresses.
By Mauro Tortonesi.
2003-09-05 13:36:17 -07:00
hniksic 30ac043b0a [svn] New option --retry-connrefused from Ahmod Dancy. 2003-09-04 14:34:58 -07:00
abbotti 0410411939 [svn] Fix for FTP directory traversal vulnerability (at least for Unix).
Based on a patch by Red Hat.
Published in <85u02vg4hukbc2fltdd51uds5oq14rd92f@farscape.privy.mev.co.uk>.
2003-01-11 12:12:35 -08:00
hniksic 27483fd0f5 [svn] Fix off-by-one error in cmd_file.
Published in <sxsit2rfzqo.fsf@florida.munich.redhat.com>.
2002-08-03 13:34:58 -07:00
hniksic d7673d398b [svn] Check whether downloaded_html_set is non-NULL before using it.
Posted in <sxsr8hsvnhh.fsf@florida.munich.redhat.com>.
2002-07-24 14:16:30 -07:00
hniksic ac7a99c636 [svn] New file. 2002-05-29 18:51:09 -07:00
hniksic 89b37c7eff [svn] Allow almost any character in attribute/tag names. 2002-05-27 08:03:35 -07:00
hniksic 5ac6afa590 [svn] Bump version to 1.9-beta. 1.8.1+cvs no longer makes sense, now
that 1.8.2 is being released.
2002-05-25 11:09:30 -07:00
hniksic d3a636f2a5 [svn] Fall back to dot progress if the terminal type is "emacs".
Published in <sxsd6vllhsi.fsf@florida.munich.redhat.com>.
2002-05-24 07:53:18 -07:00
hniksic f97f3ef416 [svn] Don't #define __STDC__ against the compiler's will.
Published in <sxsptzr64ea.fsf@florida.munich.redhat.com>.
2002-05-19 17:38:14 -07:00
hniksic b2be7522c7 [svn] Update the license to include the OpenSSL exception. 2002-05-17 19:16:36 -07:00
hniksic a4abdda23d [svn] Minor optimization of prime_size.
Published in <sxswuu2p6pm.fsf@florida.munich.redhat.com>.
2002-05-17 18:48:39 -07:00
abbotti 83dc077b17 [svn] (download_child_p): Minor optimization to avoid unnecessary call to
schemes_are_similar_p function.
Published in <kvq7eu4okekh2ohb0rdvavt16nbgb02v00@farscape.privy.mev.co.uk>.
2002-05-16 10:38:30 -07:00
abbotti e863a6323b [svn] New function schemes_are_similar_p to test enumerated scheme codes for
similarity (SCHEME_HTTP and SCHEME_HTTPS are similar).  Use it in recur.c
(download_child_p).  Fixes a bug that caused -H option to be ignored when
child scheme different to parent scheme.
Published in <agn4eu8apduek7magfu9bfe63gto8i7cdh@farscape.privy.mev.co.uk>.
2002-05-16 10:22:24 -07:00
abbotti 043d305fb1 [svn] Don't ftruncate standard output.
Submitted by Bill Richardson  <bill@riverstonenet.com>.
Final version of patch published in
<9vv1eus668tn7v3vn95e7l2lcjbbph8bi2@farscape.privy.mev.co.uk>.
2002-05-14 05:23:51 -07:00
abbotti 55f59d0022 [svn] Synched strptime with glibc 2.1.3. 2002-05-09 03:14:15 -07:00
hniksic fd42ae1311 [svn] Allow match_tail to be case insensitive.
Published in <sxsznzabirr.fsf@florida.munich.redhat.com>.
2002-05-08 11:24:40 -07:00
abbotti 291693c3c2 [svn] Do not store discarded cookie after it is delected.
Submitted by Ian Abbott in
<2h2gdu0q04v94ltet2634888sh6imcrgnd@farscape.privy.mev.co.uk>.
2002-05-07 10:22:33 -07:00
hniksic 58ee1f008a [svn] Fix matching of cookie domains.
Published in <sxsy9fhu1bu.fsf@florida.arsdigita.de>.
2002-04-20 21:25:36 -07:00
hniksic 6fe9ec9f16 [svn] Indentation change. 2002-04-20 21:25:07 -07:00
hniksic 91a190a770 [svn] Implement several SSL features.
- allow checking of server cert
- allow defining client cert type
- allow limit of ssl protocol
- check more return values
- added debug message on break
Published by Thomas Lussnig in <3CC09969.5000607@bewegungsmelder.de>.
2002-04-20 19:26:48 -07:00
hniksic bf018d5721 [svn] Revert order of check number 6 in download_child_p for clarity. 2002-04-20 19:15:11 -07:00
hniksic d4b0486cc4 [svn] Remove needless level of indentation. 2002-04-20 17:54:13 -07:00
hniksic 29a66192cf [svn] Cookie interface and implementation changes
from <sxsofge9yao.fsf@florida.arsdigita.de>
and <sxslmbim7dg.fsf@florida.arsdigita.de>.
2002-04-20 13:46:38 -07:00
hniksic a9e97711fa [svn] Keep the commands list in sort order! 2002-04-19 02:24:32 -07:00
hniksic 123034fa83 [svn] Remove stray conflict marker. 2002-04-16 13:15:23 -07:00
hniksic 7953158bce [svn] Correctly merge DOS-like absolute directories.
Published in <sxslmbomnm7.fsf@florida.arsdigita.de>.
2002-04-15 18:36:16 -07:00
hniksic 426bf23ae1 [svn] If content-type is not given, assume text/html. 2002-04-15 18:13:51 -07:00
hniksic f8b4b8bd12 [svn] When downloading recursively, don't ignore rejection of HTML
documents that are themselves leaves of recursion.
2002-04-15 14:57:10 -07:00
abbotti 4c11f1b269 [svn] Updated several dependencies for object files, taking account of nested
include files.
Submitted by Ian Abbott.
2002-04-15 13:15:43 -07:00
abbotti 56698ffd1d [svn] Updated dependencies of connect$o to include utils.h 2002-04-15 12:10:23 -07:00
abbotti caa0f23be3 [svn] Fix broken Windows builds due to the xxx_with_timeout stuff.
Submitted by Ian Abbotti in <3CBB2FFE.20193.73A594@localhost>.
2002-04-15 12:01:56 -07:00
hniksic 036f99c801 [svn] Extend the timeout to DNS lookups.
Published in <sxsn0w57ldh.fsf@florida.arsdigita.de>.
2002-04-14 19:21:38 -07:00
hniksic fbf0306dd7 [svn] Have number_to_string handle the case when number < -MAX_INT.
Published in <sxs662uf7l9.fsf@florida.arsdigita.de>.
2002-04-14 12:18:33 -07:00
hniksic 081e4eb4f4 [svn] Use a marginally faster implementation of binary search.
Published in <sxs662uf7l9.fsf@florida.arsdigita.de>.
2002-04-14 11:39:43 -07:00
hniksic 0eee8f8b25 [svn] Document `--post-data' and `--post-file'. 2002-04-13 22:31:11 -07:00
hniksic 9f2cc07924 [svn] Minor cleanup of iread/iwrite.
Published in <sxsk7raj1t2.fsf@florida.arsdigita.de>.
2002-04-13 22:19:27 -07:00
hniksic 5cb8a6f44d [svn] Add the POST method.
Published in <sxssn5yj4eb.fsf@florida.arsdigita.de>.
2002-04-13 21:22:47 -07:00
hniksic f3d3a50a56 [svn] Generalize connect_with_timeout into run_with_timeout.
Published in <sxs4rifxndi.fsf@florida.arsdigita.de>.
2002-04-13 15:18:28 -07:00
hniksic 5390ada318 [svn] Support FWTK-style proxies.
Pbublished in <sxslmbsxptu.fsf@florida.arsdigita.de>.
2002-04-12 20:04:47 -07:00
hniksic 278b63093f [svn] Remove stray conflict marker. 2002-04-12 13:28:05 -07:00
hniksic faf77c8f51 [svn] Only define _VA_LIST when compiling with gcc.
Published in <sxsit6w1x5t.fsf@florida.arsdigita.de>.
2002-04-12 13:27:18 -07:00
abbotti 4aaf8fdcea [svn] Compensate for MS Windows two-second granularity of file modification
timestamps.
Submitted by Ian Abbott in <3CB7355C.21011.2134FDA@localhost>.
2002-04-12 12:21:02 -07:00
abbotti cfd7b9a951 [svn] Use new function to test filename for common html suffixes.
Submitted by Ian Abbott in <3CB72D29.4898.1F34872@localhost> with minor
changes to formatting and comments.
2002-04-12 11:53:39 -07:00
hniksic 2a72eef0af [svn] Define _VA_LIST to prevent Solaris stdio.h from declaring va_list.
Published in <sxs1ydk4vg0.fsf@florida.arsdigita.de>.
2002-04-12 11:36:07 -07:00
abbotti fa2fa7a100 [svn] Specify libtool mode explicitly when linking.
Submitted by Ian Abbott in <3CB6F27B.15581.10E13BA@localhost>.
2002-04-12 06:47:02 -07:00
hniksic 9de4909bea [svn] Update copyright years. 2002-04-11 18:23:23 -07:00
hniksic 0cd669109b [svn] Implement connect timeout.
Published in <sxs1ydld8ha.fsf@florida.arsdigita.de>.
2002-04-11 18:14:18 -07:00
hniksic fca8dcf829 [svn] Use stdarg only if compiling with an ANSI C compiler. 2002-04-11 12:13:57 -07:00
hniksic c77a16309f [svn] Don't allow initial_length to exceed total_length.
Published in <sxssn62dq99.fsf@florida.arsdigita.de>.
2002-04-11 11:51:26 -07:00
hniksic 8f93191f26 [svn] Convert URLs in <form action=...>.
Published in <sxsit6yf7jo.fsf@florida.arsdigita.de>.
2002-04-11 10:51:45 -07:00
hniksic 1375a89141 [svn] Allow Wget to be compiled with a K&R compiler.
Published in <sxszo0af9k6.fsf@florida.arsdigita.de>.
2002-04-11 10:49:32 -07:00
hniksic 485673c3a8 [svn] Make sure directory and file names are encoded the same way.
Published in <sxsofgqmf6e.fsf@florida.arsdigita.de>.
2002-04-11 08:25:51 -07:00
hniksic 8c3287dabf [svn] Remove the OPTIONS_DEFINED_HERE kludge.
Published in <sxs4rijqmhv.fsf@florida.arsdigita.de>.
2002-04-10 14:20:55 -07:00
hniksic 1600aaeaa6 [svn] Revert to calculating ETA based on average download speed.
Published in <sxspu17sl10.fsf@florida.arsdigita.de>.
2002-04-10 07:10:03 -07:00