moparisthebest/wget
1
0
Fork 0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Code Issues Releases Wiki Activity
3,379 Commits 1 Branch 0 Tags 9.6 MiB
566696cb82
Commit Graph

446 Commits

Author SHA1 Message Date
Tim Ruehsen
848d7537e1 fixed 204 response handling, added new Test-204.px 2014-04-24 13:27:44 +02:00
Yousong Zhou
dfa1f4e064 Make wget capable of starting downloads from a specified position. 
This patch adds an option `--start-pos' for specifying starting position
of a HTTP or FTP download.

Signed-off-by: Yousong Zhou <yszhou4tech@gmail.com>
 2014-03-21 11:21:00 +01:00
Giuseppe Scrivano
43c89ab7a5 http: aesthetic change 2014-03-04 17:26:32 +01:00
Vladimír Pýcha
5bb2f43165 URL-decode the filename parameter of Content-Disposition HTTP header if it is encoded 2014-03-03 11:07:00 +01:00
Håkon Vågsether
d260ded060 Fix checking the URL length when filename is specified 2014-01-07 15:59:29 +01:00
Giuseppe Scrivano
38933de17c http: Increase max header value length to 512 2013-11-02 11:53:18 +01:00
Pavel Mateja
aed7d4163a http: specify Host when CONNECT is used. 2013-11-02 11:30:04 +01:00
Giuseppe Scrivano
42c15e47b4 Remove assert which is always true 2013-10-30 21:20:50 +01:00
Darshit Shah
92035dbabd Fix erroneous error codes when HTTP Digest Authentication fails. 2013-07-22 19:31:07 +02:00
Giuseppe Scrivano
a300f1e47d Fix some memory leaks a problem introduced with the last commit 2013-07-13 16:25:43 +02:00
Giuseppe Scrivano
c52bbad9e4 Make --backups work as documented 2013-07-13 13:36:55 +02:00
Giuseppe Scrivano
e9cc8b2f7c Fix HTTP Digest authentication when the algorithm is not specified 2013-07-12 19:07:22 +02:00
Tomas Hozza
8760123cee Set sock variable to -1 if no persistent conn exists 
Wget should set sock variable to -1 if no persistent
connection exists. Function persistent_available_p()
tests persistent connection but if test_socket_open()
fails it closes the socket but will not set sock variable
to -1. After returning from persistent_available_p()
it is possible that sock has still value of already
closed connection.

Signed-off-by: Tomas Hozza <thozza@redhat.com>
 2013-07-11 20:50:42 +02:00
Darshit Shah
9e0d87a248 Download response body data for all requests 2013-06-27 20:07:47 +02:00
Darshit Shah
90896e3314 Follow RFC 2616 and httpbis specifications when handling redirects 2013-06-16 22:31:16 +02:00
Dmitry Bogatov
027d9f385d Non-functionality improvement in src/http.c. 
Pulled `request_set_method` functionality into `request_new`
to ensure these functions always called in right order.
 2013-05-12 19:28:22 +02:00
Giuseppe Scrivano
550457bcad Fix crash when receiving a HTTP redirect upon a POST request 
The crash was introduced by a recent commit.
 2013-05-02 21:57:20 +02:00
Darshit Shah
54fd8de415 Improve output in case of --post-{file,body} commands. 2013-04-24 21:08:33 +02:00
Gijs van Tulder
81409cb9c8 Remove old reference to opt.post_data. 2013-04-23 22:02:29 +02:00
Darshit Shah
6c30653a1a Add a generic --method command to set a method in HTTP Requests. 
Add supplementary --body-data and --body-file commands to send BODY Data.

Signed-off-by: Darshit Shah <darnir@gmail.com>
 2013-04-14 12:57:58 +02:00
Darshit Shah
50238e49b9 Make wget abort if --post-file does not exist 
Signed-off-by: Darshit Shah <darnir@gmail.com>
 2013-03-14 21:19:13 +01:00
Tim Ruehsen
b60ff61b75 Added support for MD5-sess authentication 2012-11-25 18:16:20 +01:00
Giuseppe Scrivano
fe401688a6 Fix a regression when -c and --content-dispositionn are used together. 2012-10-07 13:00:46 +02:00
y-iida@secom.co.jp
4759cf099f Fix a build error. 2012-08-21 20:46:27 +02:00
Tim Ruehsen
4fe805a7ec Add support for RFC 2617 Digest Access Authentication 2012-07-07 10:58:30 +02:00
Giuseppe Scrivano
172a117647 Fix some log messages. 2012-07-07 10:27:09 +02:00
Tim Ruehsen
2e86829809 removed 'const' warnings. 
* hash.h (hash_table_put): Make argument "value" const.
* hash.c (hash_table_put): Make argument value const.  Cast `value' to
void.
* http.c (request_set_header): Make argument `name' const.  Cast `value'
and `name' to void*.
(request_remove_header): Make argument `name' const.
* url.c (url_file_name): Make `index_filename' static.
* warc.h (warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
* warc.c (warc_write_date_header): Make the `timestamp' argument const.
Make `extension' const.
(warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
 2012-05-14 23:20:10 +02:00
Tim Ruehsen
0fcd1bb235 Fix memory leak. 2012-04-21 12:19:25 +02:00
Phil Pennock
fd582e4543 Add support for TLS SNI 2012-04-13 23:58:46 +02:00
Gijs van Tulder
6a25955fe6 warc: support large files. 2012-02-25 11:58:21 +01:00
Gijs van Tulder
586ade4fb1 Fix memory leak. 2012-01-28 14:08:52 +01:00
Sasikantha Babu
5e1badae1e Properly format IPv6 addresses. 2012-01-09 00:03:23 +01:00
Gijs van Tulder
e3820953b2 Add support for WARC files. 2011-11-04 22:25:00 +01:00
Henrik Holst
fce4e757a2 Add support for --content-on-error. 2011-10-06 13:25:17 +02:00
Giuseppe Scrivano
19ef7249b8 Allow --timestamping and --continue at the same time. 2011-09-07 12:57:55 +02:00
Giuseppe Scrivano
9fab5a9f28 Fix a memory leak. 2011-08-18 15:17:20 +02:00
Giuseppe Scrivano
75d04cadf5 Fix a hang on redirects which change the transfer-encoding 2011-08-18 11:46:58 +02:00
Giuseppe Scrivano
1d9bb1c7b0 Use Cache-Control when --no-cache is specified. 2011-08-06 10:56:07 +02:00
Filipe Brandenburger
e219e587b3 Support HTTP/1.1 307 redirects keep request method. 2011-03-03 14:02:25 +01:00
Filipe Brandenburger
bb6a72caea Do not adjust the extension if the file ends in .htm. 2011-03-02 10:57:44 +01:00
Steven Schubiger
e076a6d39d Move duplicated code in http.c to a function 2011-02-23 10:37:48 +01:00
Giuseppe Scrivano
2f6aa1d741 mass change: update copyright years. 2011-01-01 13:19:37 +01:00
Giuseppe Scrivano
9ae052b1e2 Remove redundant guard. 2010-12-01 13:15:13 +01:00
Giuseppe Scrivano
8aa378bd9e Revert 2444. 2010-11-22 18:04:42 +01:00
Giuseppe Scrivano
2aa2a913c3 On a network error, attempt to resume the download, not restart it. 2010-11-21 22:56:20 +01:00
Giuseppe Scrivano
a2596ccf21 Fix an infinite loop with error message '<filename> has sprung into existence' 2010-11-19 17:14:21 +01:00
Giuseppe Scrivano
542c549985 Silent warnings reported by clang. 2010-10-16 03:04:25 +02:00
Merinov Nikolay
b5c9573ad6 Add --unlink. 2010-09-29 13:34:09 +02:00
Dennis, CHENG Renquan
6230b73df0 Fix problem when content-disposition is used with recursive downloading. 2010-09-24 14:07:58 +02:00
Giuseppe Scrivano
2107eb06ab Use persistent connections with proxies supporting them. 2010-08-09 12:56:49 +02:00
Giuseppe Scrivano
87ad80cacc Specify the connection header when keep alive connections are not used. 2010-08-09 12:32:04 +02:00
Giuseppe Scrivano
3e25a9817f Introduce --trust-server-names. Close CVE-2010-2252. 2010-07-28 21:22:22 +02:00
Alan Jenkins
954fead685 Fix a failure if the server doesn't specify a content-length and -c is used. 2010-07-20 19:42:13 +02:00
Giuseppe Scrivano
57584fe2da Fix another case of -N and -c not working well together. 2010-07-18 20:10:42 +02:00
Giuseppe Scrivano
b7f54921f6 Now --timestamping and --continue works well together. 2010-07-11 15:47:18 +02:00
Giuseppe Scrivano
117c25970b Send a HEAD before the GET when -N and --content-disposition are used together. 2010-06-14 19:24:47 +02:00
Muthu Subramanian K
aca9f566b6 Report the total avg transfer speed correctly with multiple URL's and -c. 2010-06-11 00:35:30 +02:00
Giuseppe Scrivano
bd5527dad4 If --content-disposition is used, do not send a HEAD request. 2010-06-03 16:46:56 +02:00
Giuseppe Scrivano
af5008cdb4 Tiny aesthetic changes. 2010-05-27 12:14:59 +02:00
Giuseppe Scrivano
8ff8a1d289 Send new cookies when the authorization fails. 2010-05-27 12:09:56 +02:00
Giuseppe Scrivano
475c452780 Ignore HTTP 1xx responses. 2010-05-25 17:52:13 +02:00
Giuseppe Scrivano
84b2d52598 http_atotm copies the NUL character of the locale string. 2010-05-23 10:58:05 +02:00
Giuseppe Scrivano
58a9721edf Use the gnulib md5 module. 2010-05-16 01:34:17 +02:00
Giuseppe Scrivano
293008f682 Mass update copyright years. 2010-05-08 21:56:15 +02:00
Giuseppe Scrivano
282798f52e Give a nicer message on a malformed status line. 2010-05-05 12:27:29 +02:00
Giuseppe Scrivano
d829a89218 Check `resp_status' function return code. 2010-05-04 17:34:40 +02:00
Giuseppe Scrivano
1cee086162 Support HTTP/1.1. 2010-05-01 22:34:11 +02:00
Micah Cowan
7585b7019d --no-match-server-timestamps -> --no-use-server-timestamps 2010-01-09 20:21:37 -08:00
David Holman
1f08245076 --no-match-server-timestamps 2010-01-09 18:57:18 -08:00
Arvind Jamuna Dixit
d5361eca21 Support RFC 2231. 2010-01-09 14:23:29 -08:00
Micah Cowan
4a08094db8 [mq]: cfg-mk 2009-09-21 20:39:44 -07:00
Steven Schweda
5ef1d7b949 Fixes needed for VMS. 2009-09-11 19:41:57 -07:00
Micah Cowan
b014f8fae9 Improved exit status handling. 2009-08-27 23:08:58 -07:00
Micah Cowan
d21dde51b8 Heed cookies from 401s. 2009-08-27 00:40:48 -07:00
Tony Lewis
ee1df87dd8 Parse content-length before using it. Fixes NTLM (#27192). 2009-08-17 20:47:05 -07:00
Micah Cowan
9dadbf6fe9 Rename --html-extension to --adjust-extension. 2009-07-28 17:37:58 -07:00
Peter Pisar
2524076dd2 Translation fixes. 2009-07-05 14:35:21 -07:00
Micah Cowan
ae042e99cf Remove version.h; we generate version.c these days. 2009-07-04 16:15:26 -07:00
Micah Cowan
d5e283b1a7 Automated merge. 2009-07-04 15:32:57 -07:00
Micah Cowan
4f3dd68173 Merge with mainline. 2009-06-25 01:14:11 -07:00
Xin Zou
37b7e547c3 Fix some memory leaks. 2009-06-11 19:16:51 -07:00
Micah Cowan
8477863e75 Fix bad setlocale usage. 2009-06-11 18:58:26 -07:00
Steven Schubiger
116b261a9f Move duplicated code to a function. 2009-04-13 22:19:13 +02:00
Steven Schubiger
42253233c3 Adjust copyright years. 2009-03-03 21:16:47 +01:00
Steven Schubiger
fb7916aa1d Improve messages when writing a document to stdout. 2009-02-21 17:32:12 +01:00
Micah Cowan
58de6f0033 Not-so-automated merge. 2008-12-01 22:59:03 -08:00
Micah Cowan
78a7657395 Automated merge. 2008-11-26 21:55:12 -08:00
Micah Cowan
d8c11a82ca Automated merge. 2008-11-26 21:53:40 -08:00
Saint Xavier
51f8e65633 Fixes bug #24862: --content-disposition doesn't work with HTTP authentication 2008-11-27 00:19:06 +01:00
Micah Cowan
289ff1c86a Merge with mainline. 2008-11-26 07:08:38 -08:00
Steven Schubiger
f33c275621 Move numurls out of options struct. 2008-11-16 20:53:58 +01:00
Micah Cowan
c7f74c62d3 Don't download content just to ignore it. 2008-11-13 00:59:53 -08:00
Saint Xavier
65ab102f07 Make --auth-no-challenge work with user:pass@ in URLs. 2008-11-10 23:17:17 -08:00
Saint Xavier
d82f80ecab Change global variable model for state-object 2008-07-24 00:56:29 +02:00
Saint Xavier
b30a0dd817 Automated merge. 2008-07-20 21:45:09 +02:00
Saint Xavier
7410cb9764 In spider mode, do not report links as broken if they were utf8 encoded 2008-07-20 18:52:20 +02:00
Saint Xavier
9a2ea3938d Basic IDN/IRI support 2008-07-20 13:10:02 +02:00
Micah Cowan
2e2ac6ad2f Merge current tip with CSS stuff. 2008-07-11 16:30:51 -07:00
Saint Xavier
d3007f1b3a Automated merge. 2008-06-26 18:10:16 +02:00
Micah Cowan
6db8909f87 stsc: escnonprint -> quotearg_style 2008-06-24 12:08:46 -07:00