7 Commits

Author	SHA1	Message	Date
Tim Rühsen	0c18773308	Add size of buffer to warc_timestamp()	2014-11-24 10:41:08 +01:00
Gijs van Tulder	7df4b05f0b	warc: Follow the guidelines for metadata records ... Do not use the same UUID for the manifest and arguments records. Write the manifest as a metadata record, not as a resource.	2013-04-14 14:01:01 +02:00
Giuseppe Scrivano	8ac9c05fc0	warc: Cut long lines to 80 columns.	2012-05-18 11:28:49 +02:00
Tim Ruehsen	2e86829809	removed 'const' warnings. ... * hash.h (hash_table_put): Make argument "value" const. * hash.c (hash_table_put): Make argument value const. Cast `value' to void. * http.c (request_set_header): Make argument `name' const. Cast `value' and `name' to void*. (request_remove_header): Make argument `name' const. * url.c (url_file_name): Make `index_filename' static. * warc.h (warc_write_cdx_record): Make `url', `timestamp', `mime_type', `payload_digest', `redirect_location', `warc_filename', response_uuid' arguments const. Make `checksum' const. * warc.c (warc_write_date_header): Make the `timestamp' argument const. Make `extension' const. (warc_write_cdx_record): Make `url', `timestamp', `mime_type', `payload_digest', `redirect_location', `warc_filename', response_uuid' arguments const. Make `checksum' const.	2012-05-14 23:20:10 +02:00
Tim Ruehsen	0aa3c5d33c	Fix some compiler warnings.	2012-05-05 15:24:35 +02:00
Gijs van Tulder	6a25955fe6	warc: support large files.	2012-02-25 11:58:21 +01:00
Gijs van Tulder	e3820953b2	Add support for WARC files.	2011-11-04 22:25:00 +01:00