moparisthebest/wget
1
0
Fork 0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Code Issues Releases Wiki Activity
3,085 Commits 1 Branch 0 Tags 9.6 MiB
848d7537e1
Commit Graph

1942 Commits

Author SHA1 Message Date
Mike Frysinger
639a454528 warc: use the right type for the gzip stream 2012-05-26 14:05:56 +02:00
Giuseppe Scrivano
9cc514d21c Use the right type as result from readline. 2012-05-26 02:55:53 +02:00
Tim Ruehsen
370f96d36c gnutls: honor the specified timeout value 
* gnutls.c (wgnutls_poll): Honor the specified `timeout' value.
(wgnutls_peek): Likewise.
 2012-05-21 22:54:41 +02:00
illusionoflife
e93bb4fa28 Remove unused arguments. 2012-05-20 21:02:25 +02:00
Giuseppe Scrivano
8ac9c05fc0 warc: Cut long lines to 80 columns. 2012-05-18 11:28:49 +02:00
Tim Ruehsen
2e86829809 removed 'const' warnings. 
* hash.h (hash_table_put): Make argument "value" const.
* hash.c (hash_table_put): Make argument value const.  Cast `value' to
void.
* http.c (request_set_header): Make argument `name' const.  Cast `value'
and `name' to void*.
(request_remove_header): Make argument `name' const.
* url.c (url_file_name): Make `index_filename' static.
* warc.h (warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
* warc.c (warc_write_date_header): Make the `timestamp' argument const.
Make `extension' const.
(warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
 2012-05-14 23:20:10 +02:00
Tim Ruehsen
d19cc259cb gnutls: do not call fcntl in a loop. 
* gnutls.c (wgnutls_read_timeout): removed warnings, moved fcntl stuff
outside loop.
 2012-05-14 22:18:41 +02:00
Tim Ruehsen
0b4c04b583 gnutls: remove deprecated gnutls types. 2012-05-13 16:03:39 +02:00
Gijs van Tulder
f5a1097871 Add support for -accept-regex and --reject-regex. 2012-05-09 21:18:23 +02:00
Tim Ruehsen
0aa3c5d33c Fix some compiler warnings. 2012-05-05 15:24:35 +02:00
Tim Ruehsen
378c203079 Use empty query in local filenames. 2012-04-24 21:46:06 +02:00
Tim Ruehsen
c6889dab18 Fix a possible invalid `free'. 2012-04-22 18:36:09 +02:00
Tim Ruehsen
196f70a7df Silent compiler warning. 2012-04-21 13:48:18 +02:00
Tim Ruehsen
0fcd1bb235 Fix memory leak. 2012-04-21 12:19:25 +02:00
Tim Ruehsen
f1d4aeaffb Fix memory leak. 2012-04-21 12:08:45 +02:00
Phil Pennock
fd582e4543 Add support for TLS SNI 2012-04-13 23:58:46 +02:00
Tim Ruehsen
bd4f1e6042 Fix a memory leak. 2012-04-13 21:35:29 +02:00
Daniel Kahn Gillmor
154d499be2 Enable client certificates when GNU TLS is used. 2012-04-07 14:43:12 +02:00
Gijs van Tulder
08a147c672 Fix a segfault on an incomplete STYLE tag. 2012-04-01 23:29:16 +02:00
Giuseppe Scrivano
b30ba732ad gnutls: Fix a memory leak. 2012-04-01 16:30:59 +02:00
Giuseppe Scrivano
3bb17fca04 gnutls: do not access unitialized variable. 2012-04-01 16:26:44 +02:00
Tim Ruehsen
2541e0b579 warc: make warc_uuid_str implementation depend on HAVE_LIBUUID 2012-04-01 13:59:46 +02:00
Tim Ruehsen
2ffc383654 activate itimer support. 2012-03-29 20:13:27 +02:00
Giuseppe Scrivano
6533cf2452 Assume some headers files provided by gnulib are always present. 2012-03-25 17:49:55 +02:00
Ray Satiro
44ea82bc67 Fix build under mingw when OpenSSL is used. 2012-03-25 13:47:53 +02:00
Steven Schubiger
0ccaa999a2 Fix typo. 2012-03-08 10:00:51 +01:00
Sasikantha Babu
b9b510ca5f Accept --bit option 2012-03-05 22:23:06 +01:00
Giuseppe Scrivano
04f29f2f08 Report stdout close errors. 2012-02-26 02:41:07 +01:00
Gijs van Tulder
6a25955fe6 warc: support large files. 2012-02-25 11:58:21 +01:00
Giuseppe Scrivano
408126aae0 Print some diagnostic messages to stderr not to stdout. 2012-02-23 11:56:44 +01:00
Giuseppe Scrivano
bcc2abf116 Handle correctly some malloc failures. 2012-02-23 11:45:05 +01:00
Giuseppe Scrivano
611a219fb0 gnutls: Remove two unused variables. 2012-02-23 11:11:49 +01:00
Steven Schubiger
c60530b369 warc: add license header. 2012-02-17 17:05:26 +01:00
Gijs van Tulder
6d67d793f5 Add support for chunks to the WARC outputter. 2012-01-28 14:09:29 +01:00
Gijs van Tulder
586ade4fb1 Fix memory leak. 2012-01-28 14:08:52 +01:00
Gijs van Tulder
0a8a898fbe Fix a linker error if zlib is not found. 2012-01-11 15:27:06 +01:00
Sasikantha Babu
5e1badae1e Properly format IPv6 addresses. 2012-01-09 00:03:23 +01:00
Gijs van Tulder
1316701791 Fix for gzip bug in WARC + zlib 1.2.4. 2011-11-20 18:28:19 +01:00
Steven Schweda
eed850d938 warc: Fix a problem under OS X. 2011-11-05 11:52:51 +01:00
Steven Schweda
127036d3ec gnutls: fix memory leak. 2011-11-04 22:31:48 +01:00
Gijs van Tulder
e3820953b2 Add support for WARC files. 2011-11-04 22:25:00 +01:00
Steven Schweda
8c7bd588fe Fix some problems under VMS. 2011-10-23 13:11:22 +02:00
Henrik Holst
fce4e757a2 Add support for --content-on-error. 2011-10-06 13:25:17 +02:00
Giuseppe Scrivano
356fc9fc68 Fix typo in an inline comment. 2011-09-19 17:29:48 +02:00
Giuseppe Scrivano
91aeb7db2f Fix copyright year. 2011-09-19 17:29:33 +02:00
Giuseppe Scrivano
bbe6b86c9e Return a network failure when FTP downloads fail and --timestamping is used. 2011-09-13 10:11:46 +02:00
Giuseppe Scrivano
19ef7249b8 Allow --timestamping and --continue at the same time. 2011-09-07 12:57:55 +02:00
Jakob Matthes
c3a0c1a5b5 Do not exit prematurely when --help is passed. 2011-09-06 15:53:39 +02:00
Christian Jullien
eb557e9e77 Fix a build problem under solaris. 2011-09-04 13:30:01 +02:00
Mojca Miklavec
a25607f788 Now --version works again. 2011-09-02 13:37:10 +02:00
Giuseppe Scrivano
d23ce97885 Fix some other problems with GNU TLS and non blocking sockets. 2011-08-30 16:43:25 +02:00
Giuseppe Scrivano
66bbc5bc63 Fix some problems with the GNU TLS backend and not-blocking sockets. 2011-08-29 16:21:45 +02:00
Giuseppe Scrivano
a024990e18 Detect some failures when write to stdout fails. 2011-08-27 11:19:24 +02:00
Giuseppe Scrivano
5bcd75d32f gnutls: Honor read timeout. 2011-08-26 17:13:56 +02:00
Giuseppe Scrivano
547bcb0d3f Silent a compiler warning. 2011-08-26 12:37:17 +02:00
Giuseppe Scrivano
5e3c9b55f2 Prefers utime over futimens when available. 2011-08-25 11:41:51 +02:00
Giuseppe Scrivano
2158e58bc1 Silence compiler warning. 2011-08-19 12:08:46 +02:00
Giuseppe Scrivano
34a6f7fc32 Update ChangeLog 2011-08-19 10:08:02 +02:00
Giuseppe Scrivano
9fab5a9f28 Fix a memory leak. 2011-08-18 15:17:20 +02:00
Giuseppe Scrivano
c79ff7f47a Fix a build error detected MacOS and NetBSD. 2011-08-18 14:00:57 +02:00
Giuseppe Scrivano
75d04cadf5 Fix a hang on redirects which change the transfer-encoding 2011-08-18 11:46:58 +02:00
Giuseppe Scrivano
706871e92e Do not define max twice. 2011-08-13 10:44:40 +02:00
Giuseppe Scrivano
24a76e1a8f Don't define snprintf and vsnprintf twice. 2011-08-13 10:43:43 +02:00
Giuseppe Scrivano
375d9ee3f7 css: do not include "wget.h" 2011-08-12 17:21:27 +02:00
Giuseppe Scrivano
3382df979c Use sigprocmask instead of sigsetmask. 2011-08-11 14:23:39 +02:00
Giuseppe Scrivano
f3c2686ef7 allow --with-libgnutls-prefix and --with-libssl-prefix. 2011-08-11 12:07:32 +02:00
Giuseppe Scrivano
76c651e3a1 gnutls: don't use gnutls_certificate_type_set_priority. 2011-08-11 10:32:44 +02:00
Giuseppe Scrivano
a73e3a914e Don't invoke hg to set version string. 2011-08-11 10:26:43 +02:00
Giuseppe Scrivano
228299b4f7 Fix a linker error on systems with an older gnutls version. 2011-08-10 21:35:59 +02:00
Jochen Roderburg
c25d0f6997 Ensure it doesn't print more IPs than available ones. 2011-08-06 23:28:42 +02:00
Giuseppe Scrivano
aed17cca14 Initialize show_all_dns_entries to false. 2011-08-06 22:28:31 +02:00
Giuseppe Scrivano
1f06428483 Introduce `show_all_dns_entries'. 2011-08-06 12:38:42 +02:00
Giuseppe Scrivano
1d9bb1c7b0 Use Cache-Control when --no-cache is specified. 2011-08-06 10:56:07 +02:00
Giuseppe Scrivano
9b21660d70 Accept always the file if it is the specified output destination. 2011-08-05 22:39:55 +02:00
Giuseppe Scrivano
c6cf57d215 gnutls: do not use a deprecated function. 2011-08-05 21:36:08 +02:00
Giuseppe Scrivano
473ec526d2 Maintain the cookie value quoted if it was in the server response. 2011-08-02 22:58:38 +02:00
Giuseppe Scrivano
0b5b100fc9 Exit immediately on a SIGPIPE error while logging. 2011-07-29 15:49:11 +02:00
Carlos Martín Nieto
e24571d336 Do not use PATH_MAX. 2011-07-26 12:49:44 +02:00
Giuseppe Scrivano
1e09ee5ea8 Do not register redirects when in spider mode. 2011-07-26 12:42:40 +02:00
Merinov Nikolay
37c85ecba3 Fix problem with IDN and UTF-8 encoding. 2011-07-26 09:27:08 +02:00
Giuseppe Scrivano
f90ca4e54a Parse URLs read from a file. 2011-06-08 11:32:34 +02:00
Giuseppe Scrivano
544f0d478a Fix indentation. 2011-06-05 14:31:24 +02:00
Giuseppe Scrivano
67d81d15a5 Fix ChangeLog entry. 2011-06-05 14:11:49 +02:00
Giuseppe Scrivano
00723a80f1 Define max 2011-05-24 11:13:04 +02:00
Adrien Nader
d7991738d6 Set stdout mode to binary under Windows. 2011-05-23 21:56:44 +02:00
Giuseppe Scrivano
3fb4d068a7 Avoid a small buffer when retrieving a file. 2011-05-23 20:27:42 +02:00
Giuseppe Scrivano
cd81370afe Fix error messages under Windows. 2011-05-23 20:24:20 +02:00
Ray Satiro
4a685764a8 Ensure sockets are not blocking after a select under Windows. 2011-05-15 21:59:50 +02:00
Ray Satiro
53427a9b76 openssl: Prevent loops on read errors. 2011-05-15 16:54:58 +02:00
Giuseppe Scrivano
ee6021a3b0 Fix GCC warnings. 2011-04-24 13:03:48 +02:00
Giuseppe Scrivano
df99868cb1 Update src/ChangeLog. 2011-04-24 12:57:18 +02:00
Daniel Manrique
0db305126b Set exit status when invalid host given 2011-04-23 15:31:41 -04:00
Giuseppe Scrivano
366dbedf1b gnutls: use the blocking socket. 2011-04-19 14:40:21 +02:00
Giuseppe Scrivano
87a176daa7 Use futimens instead of utimes. 2011-04-19 12:33:46 +02:00
Giuseppe Scrivano
a50931df8c Use mkdir module from gnulib. 2011-04-19 11:31:25 +02:00
Giuseppe Scrivano
179dacd735 Use utimes instead of utime. 2011-04-18 14:37:42 +02:00
Giuseppe Scrivano
1eb1e76e9a Fix build error. 2011-04-18 14:32:14 +02:00
Giuseppe Scrivano
8d764f3ac6 Use correctly FIONBIO values. 2011-04-17 13:07:01 +02:00
Giuseppe Scrivano
b0a3d43014 openssl: make openssl_peek non-blocking. 2011-04-13 13:57:37 +02:00
Cristian Rodrwuez
cbe8eb725b openssl: Use SSLv2 only when available. 2011-04-11 11:08:39 +02:00
Giuseppe Scrivano
c09d62159b Remove tight loop around gnutls_record_recv. 2011-04-07 12:56:51 +02:00
Giuseppe Scrivano
0424cb1aed Allow X509 v1 certificates. 2011-04-07 12:55:42 +02:00
Ray Satiro
96c3ec36c2 gnutls: Check for the GNUTLS_E_AGAIN return code. 2011-04-07 12:25:39 +02:00
Giuseppe Scrivano
d18b9749d9 Fix a bug recently introduced in wgnutls_peek. 2011-04-07 12:02:07 +02:00
Giuseppe Scrivano
6dca252c60 openssl: Retry to read if a non-blocking socket returns immediately. 2011-04-04 16:56:51 +02:00
Giuseppe Scrivano
4d564bd630 Ensure FD_TO_SOCKET is defined under Windows. 2011-04-04 16:46:38 +02:00
Giuseppe Scrivano
99e9291da3 Silent compiler warning under Windows. 2011-04-04 12:52:35 +02:00
Giuseppe Scrivano
1cba1a7659 Fix openssl detection under Windows. 2011-04-04 00:13:53 +02:00
Giuseppe Scrivano
b1acde223f Fix build under Windows. 2011-04-03 20:23:31 +02:00
Giuseppe Scrivano
ca244196f1 Make wgnutls_peek non blocking. 2011-04-03 02:15:22 +02:00
Giuseppe Scrivano
28db25933b Now --no-parent doesn't fetch wrong files if HTTP and HTTPS are used together. 2011-03-31 01:37:12 +02:00
Giuseppe Scrivano
1f883393c8 Add new line to some debug messages. 2011-03-31 00:51:35 +02:00
Giuseppe Scrivano
244b732e0a Silent compiler warning. 2011-03-21 13:41:41 +01:00
Giuseppe Scrivano
024683705d Silent compiler warning. 2011-03-21 13:14:20 +01:00
Giuseppe Scrivano
3a62674582 Fix some memory leaks. 2011-03-11 15:25:58 +01:00
Filipe Brandenburger
e219e587b3 Support HTTP/1.1 307 redirects keep request method. 2011-03-03 14:02:25 +01:00
Filipe Brandenburger
bb6a72caea Do not adjust the extension if the file ends in .htm. 2011-03-02 10:57:44 +01:00
Gilles Carry
09bc5b5787 Use stderr instead of stdout to prompt password. 2011-02-24 09:40:31 +01:00
Steven Schubiger
e076a6d39d Move duplicated code in http.c to a function 2011-02-23 10:37:48 +01:00
Giuseppe Scrivano
2f6aa1d741 mass change: update copyright years. 2011-01-01 13:19:37 +01:00
Filipe Brandenburger
e52cd21256 Initialize `total_downloaded_bytes'. 2010-12-10 23:55:54 +01:00
Giuseppe Scrivano
cdfd8a8e91 If -nc and -k are used at the same time, use only the latter 2010-12-09 13:27:17 +01:00
Jessica McKellar
8e742d05cf Make the help message clearer. 2010-12-07 10:46:42 +01:00
Giuseppe Scrivano
8c33c34bf6 Remove md5 from build info information. 2010-12-02 11:50:26 +01:00
Giuseppe Scrivano
9ae052b1e2 Remove redundant guard. 2010-12-01 13:15:13 +01:00
Giuseppe Scrivano
334a8e9027 Convert a static local buffer to be allocated dinamically. 2010-12-01 12:47:30 +01:00
Reza Snowdon
20a64d03d8 Exit immediately if the system config file cannot be parsed. 2010-11-29 15:24:48 +01:00
Giuseppe Scrivano
8aa378bd9e Revert 2444. 2010-11-22 18:04:42 +01:00
Giuseppe Scrivano
f97c9ac8e7 Fix typo in src/ChangeLog file. 2010-11-22 15:17:01 +01:00
Giuseppe Scrivano
2aa2a913c3 On a network error, attempt to resume the download, not restart it. 2010-11-21 22:56:20 +01:00
Giuseppe Scrivano
a2596ccf21 Fix an infinite loop with error message '<filename> has sprung into existence' 2010-11-19 17:14:21 +01:00
Reza Snowdon
8c7afaf3bb Implement --config. 2010-10-29 00:20:31 +02:00
Jessica McKellar
69fb378d59 Print the total download time as part of the summary for recursive downloads. 2010-10-24 21:45:30 +02:00
Giuseppe Scrivano
ea96533903 gnutls: Read correctly last chunk of data. 2010-10-24 01:21:01 +02:00
Giuseppe Scrivano
8405493e1d gnutls: fix build under mingw32. 2010-10-23 13:50:31 +02:00
Giuseppe Scrivano
b38c40b34e gnutls: peek blocks until data is available. 2010-10-23 12:34:49 +02:00
Giuseppe Scrivano
c5dc4d1664 Remove unnecessary code. 2010-10-21 13:27:31 +02:00
Manfred Koizar
cea1f0718d Do not assume external links type to be always "text/html". 2010-10-18 10:55:16 +02:00
Giuseppe Scrivano
542c549985 Silent warnings reported by clang. 2010-10-16 03:04:25 +02:00
Giuseppe Scrivano
7ae38d431e Fix indentation. 2010-10-11 22:49:14 +02:00
Steven Schubiger
af928aaaaa Fix compiler warning. 2010-10-11 22:46:00 +02:00
Ivanov Anton
62aab82ead Fixed crash while processing page with invalid `style' attribute. 2010-10-08 13:39:36 +02:00
Giuseppe Scrivano
62864cee6e Remove unused local variable. 2010-10-06 12:24:38 +02:00
Merinov Nikolay
b5c9573ad6 Add --unlink. 2010-09-29 13:34:09 +02:00
Dennis, CHENG Renquan
6230b73df0 Fix problem when content-disposition is used with recursive downloading. 2010-09-24 14:07:58 +02:00
Giuseppe Scrivano
6a5a964d7e Do not use HTML quoting in CSS files. 2010-09-14 12:14:34 +02:00
Giuseppe Scrivano
822a32d813 Align --trust-server-names help text. 2010-09-12 14:21:03 +02:00
Giuseppe Scrivano
6ce3d0cf12 Convert correctly URLs that need to be encoded to local files. 2010-08-20 03:11:07 +02:00
Giuseppe Scrivano
2107eb06ab Use persistent connections with proxies supporting them. 2010-08-09 12:56:49 +02:00
Giuseppe Scrivano
87ad80cacc Specify the connection header when keep alive connections are not used. 2010-08-09 12:32:04 +02:00