182 Commits

Author	SHA1	Message	Date
Gijs van Tulder	6d67d793f5	Add support for chunks to the WARC outputter.	2012-01-28 14:09:29 +01:00
Gijs van Tulder	586ade4fb1	Fix memory leak.	2012-01-28 14:08:52 +01:00
Gijs van Tulder	e3820953b2	Add support for WARC files.	2011-11-04 22:25:00 +01:00
Giuseppe Scrivano	706871e92e	Do not define max twice.	2011-08-13 10:44:40 +02:00
Giuseppe Scrivano	1e09ee5ea8	Do not register redirects when in spider mode.	2011-07-26 12:42:40 +02:00
Giuseppe Scrivano	f90ca4e54a	Parse URLs read from a file.	2011-06-08 11:32:34 +02:00
Giuseppe Scrivano	544f0d478a	Fix indentation.	2011-06-05 14:31:24 +02:00
Giuseppe Scrivano	00723a80f1	Define max	2011-05-24 11:13:04 +02:00
Giuseppe Scrivano	3fb4d068a7	Avoid a small buffer when retrieving a file.	2011-05-23 20:27:42 +02:00
Filipe Brandenburger	e219e587b3	Support HTTP/1.1 307 redirects keep request method.	2011-03-03 14:02:25 +01:00
Giuseppe Scrivano	2f6aa1d741	mass change: update copyright years.	2011-01-01 13:19:37 +01:00
Giuseppe Scrivano	9ae052b1e2	Remove redundant guard.	2010-12-01 13:15:13 +01:00
Giuseppe Scrivano	334a8e9027	Convert a static local buffer to be allocated dinamically.	2010-12-01 12:47:30 +01:00
Giuseppe Scrivano	c5dc4d1664	Remove unnecessary code.	2010-10-21 13:27:31 +02:00
Giuseppe Scrivano	542c549985	Silent warnings reported by clang.	2010-10-16 03:04:25 +02:00
Giuseppe Scrivano	3e25a9817f	Introduce --trust-server-names. Close CVE-2010-2252.	2010-07-28 21:22:22 +02:00
Giuseppe Scrivano	293008f682	Mass update copyright years.	2010-05-08 21:56:15 +02:00
Giuseppe Scrivano	1cee086162	Support HTTP/1.1.	2010-05-01 22:34:11 +02:00
Steven Schubiger	a801efcd96	Don't delete an input file fetched via FTP.	2010-03-04 22:09:31 +01:00
Steven Schubiger	33d8b23dfd	Check stricter for supported URL scheme.	2010-03-02 21:41:32 +01:00
Steven Schubiger	f391a5b5b0	Fix memory leak in retrieve_from_file.	2010-03-02 20:35:02 +01:00
Steven Schubiger	ec6950f1a6	Make -i work with FTP.	2010-03-02 00:00:17 +01:00
Paul Townsend	068991e8a0	Time-measurement fix	2010-01-27 10:08:26 -08:00
Micah Cowan	b9e9ad65cc	Ran update-copyright.	2009-09-04 00:13:47 -07:00
Micah Cowan	b014f8fae9	Improved exit status handling.	2009-08-27 23:08:58 -07:00
Micah Cowan	5daac18e96	Adjust some typos from vms merge, and remove some elements we don't want to include without further consideration first.	2009-07-04 18:42:59 -07:00
Micah Cowan	d5e283b1a7	Automated merge.	2009-07-04 15:32:57 -07:00
Micah Cowan	a00b834bb3	Referer/IRI fix.	2009-07-01 23:17:33 -07:00
Micah Cowan	44cde778dd	Fix Test-iri-list.	2009-06-29 01:07:12 -07:00
Micah Cowan	50e12521d6	Fixes to restore Test-iri and Test-iri-forced-remote	2009-06-28 20:55:01 -07:00
Micah Cowan	4f3dd68173	Merge with mainline.	2009-06-25 01:14:11 -07:00
Micah Cowan	4bbcfc2a1d	Fix for bug #24948.	2009-06-15 23:33:41 -07:00
Micah Cowan	94d6650817	Merge in gerel's url-parsing stuff.	2009-06-13 04:48:18 -07:00
Steven Schubiger	116b261a9f	Move duplicated code to a function.	2009-04-13 22:19:13 +02:00
gerel	ea3745e8dc	removed some more calls	2009-02-01 15:03:51 -03:00
Micah Cowan	1b4ed7dcb7	Automated merge.	2008-12-01 07:05:29 -08:00
Micah Cowan	289ff1c86a	Merge with mainline.	2008-11-26 07:08:38 -08:00
Alexander Drozdov	b0bdf95494	Fix underflow, incorrect assertion.	2008-10-31 11:13:10 -07:00
Saint Xavier	66dd4bda74	IRI requirement: do not percent-encode already percent-encoded values (try1)	2008-09-27 11:13:21 +02:00
Saint Xavier	5133d57366	Fixes: use encoding got from the remote server serving the list file and use quote_n() for quote'ing several args	2008-08-15 15:03:38 +02:00
Xavier Saint	cbd54b549a	Automated merge.	2008-08-14 18:45:13 +02:00
Xavier Saint	723dbfc818	Correct iri handling while fetching a remote file list with -i and provide a test	2008-08-14 18:26:53 +02:00
Xavier Saint	e6b4e761d1	Don't forget to free the iri struct	2008-08-14 17:42:16 +02:00
Xavier Saint	44a22c78a7	Automated merge.	2008-08-07 10:27:19 +02:00
Xavier Saint	84395897ad	iri.h is already included in wget.h, so don't include it in C files	2008-08-04 11:08:33 +02:00
Micah Cowan	0fae9cb388	stsc: better message for "unsupported schemes".	2008-08-03 22:03:04 -07:00
Xavier Saint	bfd8a73f00	quote*() functions don't like that much NULL arg	2008-08-02 11:22:14 +02:00
Xavier Saint	b967d49f79	opt.remote_encoding should not override opt.locale, add a force arguments to set_uri_encoding()	2008-07-30 10:15:55 +02:00
Saint Xavier	3ae04f5fe4	Use DEBUGP instead of commenting out all the _wonderful_ printfs	2008-07-24 14:32:31 +02:00
Saint Xavier	ccd62071dc	Automated merge.	2008-07-24 00:58:10 +02:00