Saint Xavier
9a2ea3938d
Basic IDN/IRI support
2008-07-20 13:10:02 +02:00
Steven Schubiger
2c77220411
Undo the USE_GNULIB_ALLOC defines.
2008-04-20 11:46:52 +02:00
Steven Schubiger
76780021d8
Use Gnulib's alloc functions throughout the source.
2008-04-19 01:21:24 +02:00
Steven Schubiger
87f85de75b
Use Gnulib's quote function in recur.c.
2008-04-16 12:28:19 +02:00
Micah Cowan
bc8f473272
Updated copyright year.
2008-01-25 05:04:01 -08:00
Micah Cowan
462e643a7e
Merge SFLC licensing changes for OpenSSL with tip.
2007-12-07 17:37:07 -08:00
Micah Cowan
86395b297b
Updated licensing exception for OpenSSL from the SFLC.
2007-11-28 00:05:33 -08:00
Micah Cowan
212396c7e1
Eschew config-post.h.
2007-10-18 20:50:40 -07:00
Micah Cowan
20a19fa69f
Print any errors from unlinking robots.txt.
2007-10-14 19:10:38 -07:00
Micah Cowan
38b0f4ba27
Josh's patch to remove robots.txt when appriopriate.
2007-10-14 19:00:33 -07:00
Micah Cowan
5dd09d9ba5
Update copyright lists, conforming to maintainer guidelines
2007-09-28 15:45:31 -07:00
micah
a7d6a8b512
[svn] Modification of patch to recur.c
2007-08-27 14:28:22 -07:00
micah
248cb3e907
[svn] Various small fixes, courtesy of Gisle Vanem <giva@bgnett.no>.
2007-08-27 10:48:16 -07:00
micah
7d2066b221
[svn] Make indentation consistent (all-spaces, no tabs).
2007-08-02 20:38:21 -07:00
micah
c17f57f1fa
[svn] Fix for bug #20296 : User:pass@ given in Referer header.
2007-07-29 18:22:34 -07:00
micah
4d7c5e087b
[svn] Merge of fix for bugs 20341 and 20410.
2007-07-09 22:53:22 -07:00
mtortonesi
763229b67f
[svn] #include'd spider.h to get rid of compiler warnings.
2006-08-28 07:41:40 -07:00
mtortonesi
0dbef4ccb4
[svn] Several fixes for recursive spider mode.
2006-08-24 08:27:57 -07:00
mtortonesi
1c7493b83e
[svn] Added sanity checks for -k, -p, -r and -N when -O is given. Added fixes for 64-bit platforms. Updated copyright and maintainer information.
2006-07-14 06:25:50 -07:00
mtortonesi
01093c0c33
[svn] Fixed recursive spider mode.
2006-05-25 09:11:29 -07:00
mtortonesi
ea4ffded27
[svn] Restricted operational semantics of frontcmp and proclist from generic strings to directory names, and fixed dirname matching algorithm. Renamed above mentioned functions to subdir_p and dir_matches_p respectively. Added testcases for subdir_p and dir_matches_p.
2006-03-15 06:55:29 -08:00
mtortonesi
0bd1751372
[svn] recur.c: changed type of html_allowed member of struct queue_element to bool.
2006-03-14 05:52:17 -08:00
hniksic
097695b723
[svn] New option --ignore-case for case-insensitive matching.
2005-07-06 12:44:00 -07:00
hniksic
db9de5b075
[svn] Update FSF's address and copyright years.
2005-07-01 19:26:52 -07:00
hniksic
2447fb9a9b
[svn] Move extern declarations to .h files.
2005-06-27 11:19:22 -07:00
hniksic
002def87d2
[svn] Rename LARGE_INT to SUM_SIZE_INT, and simplify its handling.
2005-06-25 07:39:51 -07:00
hniksic
74fbb03b10
[svn] Use bool type for boolean variables and values.
2005-06-22 12:38:10 -07:00
hniksic
277e840a0f
[svn] Remove K&R support.
2005-06-19 15:34:58 -07:00
hniksic
b49b6db4f1
[svn] Correct logic of check #6 in download_child_p.
...
By Larry Jones and Hrvoje Niksic.
2005-04-09 15:18:36 -07:00
hniksic
e2e9b753e4
[svn] Retired the `boolean' type. Renamed FREE_MAYBE to xfree_null and moved the
...
definition from wget.h to xmalloc.h. Moved the DEFAULT_LOGFILE
define to log.h. Moved the INFINITE_RECURSION define to recur.h.
2003-11-02 11:56:37 -08:00
hniksic
5f0a2b3f08
[svn] Use new macros xnew, xnew0, xnew_array, and xnew0_array in various places.
2003-10-31 06:55:50 -08:00
hniksic
711bf72609
[svn] Remove VERY_LONG_TYPE; use LARGE_INT instead. Remove special code
...
for handling VERY_LONG_TYPE overflows.
Make opt.quota a LARGE_INT.
2003-10-11 06:57:11 -07:00
hniksic
1b3cdef574
[svn] Don't descend into HTML that was downloaded by following <img src=...>
...
and such.
2003-10-10 07:25:10 -07:00
hniksic
097923f7b1
[svn] Move fnmatch() to cmpt.c and don't use it under GNU libc.
2003-10-07 16:53:31 -07:00
hniksic
95c647eb44
[svn] Split off non-URL related stuff from url.c to convert.c.
2003-09-21 15:47:14 -07:00
hniksic
d7673d398b
[svn] Check whether downloaded_html_set is non-NULL before using it.
...
Posted in <sxsr8hsvnhh.fsf@florida.munich.redhat.com>.
2002-07-24 14:16:30 -07:00
hniksic
b2be7522c7
[svn] Update the license to include the OpenSSL exception.
2002-05-17 19:16:36 -07:00
abbotti
83dc077b17
[svn] (download_child_p): Minor optimization to avoid unnecessary call to
...
schemes_are_similar_p function.
Published in <kvq7eu4okekh2ohb0rdvavt16nbgb02v00@farscape.privy.mev.co.uk>.
2002-05-16 10:38:30 -07:00
abbotti
e863a6323b
[svn] New function schemes_are_similar_p to test enumerated scheme codes for
...
similarity (SCHEME_HTTP and SCHEME_HTTPS are similar). Use it in recur.c
(download_child_p). Fixes a bug that caused -H option to be ignored when
child scheme different to parent scheme.
Published in <agn4eu8apduek7magfu9bfe63gto8i7cdh@farscape.privy.mev.co.uk>.
2002-05-16 10:22:24 -07:00
hniksic
6fe9ec9f16
[svn] Indentation change.
2002-04-20 21:25:07 -07:00
hniksic
bf018d5721
[svn] Revert order of check number 6 in download_child_p for clarity.
2002-04-20 19:15:11 -07:00
hniksic
d4b0486cc4
[svn] Remove needless level of indentation.
2002-04-20 17:54:13 -07:00
hniksic
f8b4b8bd12
[svn] When downloading recursively, don't ignore rejection of HTML
...
documents that are themselves leaves of recursion.
2002-04-15 14:57:10 -07:00
abbotti
cfd7b9a951
[svn] Use new function to test filename for common html suffixes.
...
Submitted by Ian Abbott in <3CB72D29.4898.1F34872@localhost> with minor
changes to formatting and comments.
2002-04-12 11:53:39 -07:00
hniksic
1fa3b90235
[svn] Handle starting URL of recursing download being non-parsable.
...
Published in <sxszo26t33k.fsf@florida.arsdigita.de>.
2002-02-18 22:09:57 -08:00
hniksic
75a080ad0d
[svn] Follow https links from http.
...
Submitted by Christian Lackas in <20020211202444.GA20371@lackas.desy.de>.
2002-02-18 21:23:35 -08:00
hniksic
8db1264218
[svn] Enqueue start_url in the canonical form.
...
Published in <sxsofkvi8zx.fsf@florida.arsdigita.de>.
2001-12-19 06:27:29 -08:00
hniksic
2cf87bea8b
[svn] Fix crash introduced by previous patch.
2001-12-18 14:20:14 -08:00
hniksic
40fd876c57
[svn] Descend into HTML files we've already downloaded.
2001-12-18 14:14:31 -08:00
hniksic
416671063a
[svn] Propagate referrer information from retrieve_tree to retrieve_url.
...
Submitted by Ian Abbott in <3C1F4BFE.17436.D2D7B2@localhost>.
2001-12-18 07:22:03 -08:00
