Gijs van Tulder
|
7df4b05f0b
|
warc: Follow the guidelines for metadata records
Do not use the same UUID for the manifest and arguments records.
Write the manifest as a metadata record, not as a resource.
|
2013-04-14 14:01:01 +02:00 |
|
Gijs van Tulder
|
edbeaa0c4e
|
warc: correctly write the field length in the skip length field
|
2013-04-06 20:57:47 +02:00 |
|
Giuseppe Scrivano
|
3ebbd84518
|
warc: remove a magic number
|
2012-11-26 22:50:06 +01:00 |
|
Ángel González
|
2c1e0326a3
|
Fix compilation under gcc -std=c89
|
2012-11-25 15:01:03 +01:00 |
|
Gijs van Tulder
|
359dd16760
|
warc: fix format string for off_t in CDX function.
|
2012-11-24 16:06:32 +01:00 |
|
Giuseppe Scrivano
|
1e229375aa
|
warc: fix format string for off_t
|
2012-11-24 12:27:16 +01:00 |
|
Hrvoje Niksic
|
85b98d0834
|
Use hash_table_get instead of hash_table_get_pair.
|
2012-08-26 11:48:07 +02:00 |
|
Tim Ruehsen
|
321b5dce85
|
* fix a few little dissonances
|
2012-06-04 22:05:40 +02:00 |
|
Gijs van Tulder
|
1d14c18d7f
|
warc: Fix segfault if CDX record is not found.
|
2012-06-02 14:26:18 +02:00 |
|
Mike Frysinger
|
639a454528
|
warc: use the right type for the gzip stream
|
2012-05-26 14:05:56 +02:00 |
|
Giuseppe Scrivano
|
9cc514d21c
|
Use the right type as result from readline.
|
2012-05-26 02:55:53 +02:00 |
|
Giuseppe Scrivano
|
8ac9c05fc0
|
warc: Cut long lines to 80 columns.
|
2012-05-18 11:28:49 +02:00 |
|
Tim Ruehsen
|
2e86829809
|
removed 'const' warnings.
* hash.h (hash_table_put): Make argument "value" const.
* hash.c (hash_table_put): Make argument value const. Cast `value' to
void.
* http.c (request_set_header): Make argument `name' const. Cast `value'
and `name' to void*.
(request_remove_header): Make argument `name' const.
* url.c (url_file_name): Make `index_filename' static.
* warc.h (warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
* warc.c (warc_write_date_header): Make the `timestamp' argument const.
Make `extension' const.
(warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
|
2012-05-14 23:20:10 +02:00 |
|
Tim Ruehsen
|
0aa3c5d33c
|
Fix some compiler warnings.
|
2012-05-05 15:24:35 +02:00 |
|
Tim Ruehsen
|
bd4f1e6042
|
Fix a memory leak.
|
2012-04-13 21:35:29 +02:00 |
|
Tim Ruehsen
|
2541e0b579
|
warc: make warc_uuid_str implementation depend on HAVE_LIBUUID
|
2012-04-01 13:59:46 +02:00 |
|
Gijs van Tulder
|
6a25955fe6
|
warc: support large files.
|
2012-02-25 11:58:21 +01:00 |
|
Steven Schubiger
|
c60530b369
|
warc: add license header.
|
2012-02-17 17:05:26 +01:00 |
|
Gijs van Tulder
|
0a8a898fbe
|
Fix a linker error if zlib is not found.
|
2012-01-11 15:27:06 +01:00 |
|
Gijs van Tulder
|
1316701791
|
Fix for gzip bug in WARC + zlib 1.2.4.
|
2011-11-20 18:28:19 +01:00 |
|
Steven Schweda
|
eed850d938
|
warc: Fix a problem under OS X.
|
2011-11-05 11:52:51 +01:00 |
|
Gijs van Tulder
|
e3820953b2
|
Add support for WARC files.
|
2011-11-04 22:25:00 +01:00 |
|