Jookia e4db00d74d Add option to write URL rejections to a tab-delimited CSV log. ... * main.c: Add "--rejected-log" option. * init.c: Add "rejectedlog" command. * options.h: Add "rejected_log" parameter string. * wget.texi: Add brief documentation on new --rejected-log option. * recur.c: Optionally log details of URLs not traversed. Add reject_reason enum. (download_child_p -> download_child): Return a reject_reason. (descend_redirect_p -> descend_redirect): Return a reject_reason. (retrieve_tree): Support logging reasons for rejection. Add write_reject_log_header that writes a CSV format header to a file. Add write_reject_log_url that writes a url struct to a file in CSV format. Add write_reject_log_reason that writes the URL and parent URL as well as the rejection reason to a CSV file. * Test--rejected-log.px: Add a basic test for the --rejected-log command. * tests/Makefile.am: Run Test--rejected-log.px. This allows you to figure out why URLs are being rejected and some context around it. CSV is used as the output format since it can be used easily parsed, it's delimited by tabs instead of commas to allow using all (quoted) URL characters and includes column names which may be used for compatibility.		2015-08-06 08:10:55 +02:00
..
fdl.texi	maint: update copyright year ranges to include 2015	2015-03-09 16:32:01 +01:00
Makefile.am	Convert wget.texi to UTF-8	2015-03-17 09:52:23 +01:00
sample.wgetrc	sample.wgetrc: Fix wrong command 'locale' into 'localencoding'	2014-12-19 17:05:33 +01:00
texi2pod.pl	Convert wget.texi to UTF-8	2015-03-17 09:52:23 +01:00
wget.texi	Add option to write URL rejections to a tab-delimited CSV log.	2015-08-06 08:10:55 +02:00