Commit Graph

468 Commits

Author SHA1 Message Date
Tim Rühsen 94b8458af1 Fix possible authentication problem with turkish locale
The test server now treats authentication schemes case-independent.
2014-11-18 12:49:52 +01:00
Tim Rühsen 176c2b17fc Add 'Accept-Encoding: identity' to request header
Fixes bug #40819
Reported-by: Noël Köthe <noel@debian.org>
2014-11-11 20:05:21 +01:00
Darshit Shah 170a469533 Honour Keep-Alive when range not satisfiable 2014-11-09 14:33:13 +05:30
Darshit Shah d81a8d5f56 Remove redundant condition eval 2014-11-09 14:20:22 +05:30
Matthew Atkinson e0f149d29d Always send Content-Length with POST, PUT, PATCH 2014-11-05 08:42:51 +01:00
Giuseppe Scrivano ea97693b54 http: Always check for "Connection: close" presence 2014-11-01 13:22:07 +01:00
Tim Rühsen c2bb6bc875 fix memory leak 2014-10-30 11:05:07 +01:00
Tim Rühsen a5c6ae8f28 use CLOSE_INVALIDATE instead of fd_close 2014-10-30 11:05:07 +01:00
Tim Rühsen 42333c4a5e always set fd invalid after close 2014-10-30 11:05:07 +01:00
Tim Rühsen 148065bc00 content for commit 6092205538 2014-10-29 16:18:01 +01:00
Darshit Shah eab853b7e6 Plug memory leaks 2014-07-24 14:23:43 +05:30
Darshit Shah 550cd6e9d2 Fix indentation and remove excess variable 2014-07-05 16:18:38 +05:30
Darshit Shah 97ce41b2d0 Remove unused error codes 2014-07-05 16:18:31 +05:30
Giuseppe Scrivano bb025955c3 Fix a problem with ISA server proxy 2014-06-16 16:39:04 +02:00
Giuseppe Scrivano c03855be40 ftp: Replace main() with main in comments. 2014-06-12 18:49:16 +02:00
Giuseppe Scrivano dd1b69c600 Remove trailing empty lines 2014-06-12 18:49:15 +02:00
Giuseppe Scrivano 8e6de1fb5f Drop usage of strncpy 2014-06-12 18:49:13 +02:00
Darshit Shah 8624553a31 Whitespace and formatting changes.(Aesthetic only)
This commit makes lots of whitespace only changes. It has been ensured that this
commit does not make any changes to the functioning of the program. The only
changes that have been made are:
    * Remove trailing whitespaces
    * Convert tabs to spaces
    * Fix indentation issues in the code
    * Other aesthetic changes to the formatting of comments
2014-05-30 21:12:57 +05:30
Darshit Shah 4eeabffee6 More progress bar aesthetic changes
This commit introduces two new changes to how the progress bar looks:
1. Support the --progress=bar:noscroll option which will prevent the filename
   from scrolling in the progress bar
2. Print human readable value for the amount already downloaded for any file
2014-05-30 13:28:02 +05:30
Tim Ruehsen 38a7829dcb Fix compiler warnings 2014-05-12 12:18:50 +02:00
Benjamin Goose 351e438e51 Plug memory leak 2014-05-10 00:47:10 +02:00
Darshit Shah 8c2fd06ba8 Add --show-progress to force display progress bar
This is a relatively large commit that implements two major features:

1. Implement --show-progress switch to force the display of the progress bar in
   any verbosity level
2. Edit the implementation of the progress bar so that the filename is displayed
   in the same line.
2014-05-01 01:07:43 +02:00
Tim Ruehsen 848d7537e1 fixed 204 response handling, added new Test-204.px 2014-04-24 13:27:44 +02:00
Yousong Zhou dfa1f4e064 Make wget capable of starting downloads from a specified position.
This patch adds an option `--start-pos' for specifying starting position
of a HTTP or FTP download.

Signed-off-by: Yousong Zhou <yszhou4tech@gmail.com>
2014-03-21 11:21:00 +01:00
Giuseppe Scrivano 43c89ab7a5 http: aesthetic change 2014-03-04 17:26:32 +01:00
Vladimír Pýcha 5bb2f43165 URL-decode the filename parameter of Content-Disposition HTTP header if it is encoded 2014-03-03 11:07:00 +01:00
Håkon Vågsether d260ded060 Fix checking the URL length when filename is specified 2014-01-07 15:59:29 +01:00
Giuseppe Scrivano 38933de17c http: Increase max header value length to 512 2013-11-02 11:53:18 +01:00
Pavel Mateja aed7d4163a http: specify Host when CONNECT is used. 2013-11-02 11:30:04 +01:00
Giuseppe Scrivano 42c15e47b4 Remove assert which is always true 2013-10-30 21:20:50 +01:00
Darshit Shah 92035dbabd Fix erroneous error codes when HTTP Digest Authentication fails. 2013-07-22 19:31:07 +02:00
Giuseppe Scrivano a300f1e47d Fix some memory leaks a problem introduced with the last commit 2013-07-13 16:25:43 +02:00
Giuseppe Scrivano c52bbad9e4 Make --backups work as documented 2013-07-13 13:36:55 +02:00
Giuseppe Scrivano e9cc8b2f7c Fix HTTP Digest authentication when the algorithm is not specified 2013-07-12 19:07:22 +02:00
Tomas Hozza 8760123cee Set sock variable to -1 if no persistent conn exists
Wget should set sock variable to -1 if no persistent
connection exists. Function persistent_available_p()
tests persistent connection but if test_socket_open()
fails it closes the socket but will not set sock variable
to -1. After returning from persistent_available_p()
it is possible that sock has still value of already
closed connection.

Signed-off-by: Tomas Hozza <thozza@redhat.com>
2013-07-11 20:50:42 +02:00
Darshit Shah 9e0d87a248 Download response body data for all requests 2013-06-27 20:07:47 +02:00
Darshit Shah 90896e3314 Follow RFC 2616 and httpbis specifications when handling redirects 2013-06-16 22:31:16 +02:00
Dmitry Bogatov 027d9f385d Non-functionality improvement in src/http.c.
Pulled `request_set_method` functionality into `request_new`
to ensure these functions always called in right order.
2013-05-12 19:28:22 +02:00
Giuseppe Scrivano 550457bcad Fix crash when receiving a HTTP redirect upon a POST request
The crash was introduced by a recent commit.
2013-05-02 21:57:20 +02:00
Darshit Shah 54fd8de415 Improve output in case of --post-{file,body} commands. 2013-04-24 21:08:33 +02:00
Gijs van Tulder 81409cb9c8 Remove old reference to opt.post_data. 2013-04-23 22:02:29 +02:00
Darshit Shah 6c30653a1a Add a generic --method command to set a method in HTTP Requests.
Add supplementary --body-data and --body-file commands to send BODY Data.

Signed-off-by: Darshit Shah <darnir@gmail.com>
2013-04-14 12:57:58 +02:00
Darshit Shah 50238e49b9 Make wget abort if --post-file does not exist
Signed-off-by: Darshit Shah <darnir@gmail.com>
2013-03-14 21:19:13 +01:00
Tim Ruehsen b60ff61b75 Added support for MD5-sess authentication 2012-11-25 18:16:20 +01:00
Giuseppe Scrivano fe401688a6 Fix a regression when -c and --content-dispositionn are used together. 2012-10-07 13:00:46 +02:00
y-iida@secom.co.jp 4759cf099f Fix a build error. 2012-08-21 20:46:27 +02:00
Tim Ruehsen 4fe805a7ec Add support for RFC 2617 Digest Access Authentication 2012-07-07 10:58:30 +02:00
Giuseppe Scrivano 172a117647 Fix some log messages. 2012-07-07 10:27:09 +02:00
Tim Ruehsen 2e86829809 removed 'const' warnings.
* hash.h (hash_table_put): Make argument "value" const.
* hash.c (hash_table_put): Make argument value const.  Cast `value' to
void.
* http.c (request_set_header): Make argument `name' const.  Cast `value'
and `name' to void*.
(request_remove_header): Make argument `name' const.
* url.c (url_file_name): Make `index_filename' static.
* warc.h (warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
* warc.c (warc_write_date_header): Make the `timestamp' argument const.
Make `extension' const.
(warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
2012-05-14 23:20:10 +02:00
Tim Ruehsen 0fcd1bb235 Fix memory leak. 2012-04-21 12:19:25 +02:00
Phil Pennock fd582e4543 Add support for TLS SNI 2012-04-13 23:58:46 +02:00
Gijs van Tulder 6a25955fe6 warc: support large files. 2012-02-25 11:58:21 +01:00
Gijs van Tulder 586ade4fb1 Fix memory leak. 2012-01-28 14:08:52 +01:00
Sasikantha Babu 5e1badae1e Properly format IPv6 addresses. 2012-01-09 00:03:23 +01:00
Gijs van Tulder e3820953b2 Add support for WARC files. 2011-11-04 22:25:00 +01:00
Henrik Holst fce4e757a2 Add support for --content-on-error. 2011-10-06 13:25:17 +02:00
Giuseppe Scrivano 19ef7249b8 Allow --timestamping and --continue at the same time. 2011-09-07 12:57:55 +02:00
Giuseppe Scrivano 9fab5a9f28 Fix a memory leak. 2011-08-18 15:17:20 +02:00
Giuseppe Scrivano 75d04cadf5 Fix a hang on redirects which change the transfer-encoding 2011-08-18 11:46:58 +02:00
Giuseppe Scrivano 1d9bb1c7b0 Use Cache-Control when --no-cache is specified. 2011-08-06 10:56:07 +02:00
Filipe Brandenburger e219e587b3 Support HTTP/1.1 307 redirects keep request method. 2011-03-03 14:02:25 +01:00
Filipe Brandenburger bb6a72caea Do not adjust the extension if the file ends in .htm. 2011-03-02 10:57:44 +01:00
Steven Schubiger e076a6d39d Move duplicated code in http.c to a function 2011-02-23 10:37:48 +01:00
Giuseppe Scrivano 2f6aa1d741 mass change: update copyright years. 2011-01-01 13:19:37 +01:00
Giuseppe Scrivano 9ae052b1e2 Remove redundant guard. 2010-12-01 13:15:13 +01:00
Giuseppe Scrivano 8aa378bd9e Revert 2444. 2010-11-22 18:04:42 +01:00
Giuseppe Scrivano 2aa2a913c3 On a network error, attempt to resume the download, not restart it. 2010-11-21 22:56:20 +01:00
Giuseppe Scrivano a2596ccf21 Fix an infinite loop with error message '<filename> has sprung into existence' 2010-11-19 17:14:21 +01:00
Giuseppe Scrivano 542c549985 Silent warnings reported by clang. 2010-10-16 03:04:25 +02:00
Merinov Nikolay b5c9573ad6 Add --unlink. 2010-09-29 13:34:09 +02:00
Dennis, CHENG Renquan 6230b73df0 Fix problem when content-disposition is used with recursive downloading. 2010-09-24 14:07:58 +02:00
Giuseppe Scrivano 2107eb06ab Use persistent connections with proxies supporting them. 2010-08-09 12:56:49 +02:00
Giuseppe Scrivano 87ad80cacc Specify the connection header when keep alive connections are not used. 2010-08-09 12:32:04 +02:00
Giuseppe Scrivano 3e25a9817f Introduce --trust-server-names. Close CVE-2010-2252. 2010-07-28 21:22:22 +02:00
Alan Jenkins 954fead685 Fix a failure if the server doesn't specify a content-length and -c is used. 2010-07-20 19:42:13 +02:00
Giuseppe Scrivano 57584fe2da Fix another case of -N and -c not working well together. 2010-07-18 20:10:42 +02:00
Giuseppe Scrivano b7f54921f6 Now --timestamping and --continue works well together. 2010-07-11 15:47:18 +02:00
Giuseppe Scrivano 117c25970b Send a HEAD before the GET when -N and --content-disposition are used together. 2010-06-14 19:24:47 +02:00
Muthu Subramanian K aca9f566b6 Report the total avg transfer speed correctly with multiple URL's and -c. 2010-06-11 00:35:30 +02:00
Giuseppe Scrivano bd5527dad4 If --content-disposition is used, do not send a HEAD request. 2010-06-03 16:46:56 +02:00
Giuseppe Scrivano af5008cdb4 Tiny aesthetic changes. 2010-05-27 12:14:59 +02:00
Giuseppe Scrivano 8ff8a1d289 Send new cookies when the authorization fails. 2010-05-27 12:09:56 +02:00
Giuseppe Scrivano 475c452780 Ignore HTTP 1xx responses. 2010-05-25 17:52:13 +02:00
Giuseppe Scrivano 84b2d52598 http_atotm copies the NUL character of the locale string. 2010-05-23 10:58:05 +02:00
Giuseppe Scrivano 58a9721edf Use the gnulib md5 module. 2010-05-16 01:34:17 +02:00
Giuseppe Scrivano 293008f682 Mass update copyright years. 2010-05-08 21:56:15 +02:00
Giuseppe Scrivano 282798f52e Give a nicer message on a malformed status line. 2010-05-05 12:27:29 +02:00
Giuseppe Scrivano d829a89218 Check `resp_status' function return code. 2010-05-04 17:34:40 +02:00
Giuseppe Scrivano 1cee086162 Support HTTP/1.1. 2010-05-01 22:34:11 +02:00
Micah Cowan 7585b7019d --no-match-server-timestamps -> --no-use-server-timestamps 2010-01-09 20:21:37 -08:00
David Holman 1f08245076 --no-match-server-timestamps 2010-01-09 18:57:18 -08:00
Arvind Jamuna Dixit d5361eca21 Support RFC 2231. 2010-01-09 14:23:29 -08:00
Micah Cowan 4a08094db8 [mq]: cfg-mk 2009-09-21 20:39:44 -07:00
Steven Schweda 5ef1d7b949 Fixes needed for VMS. 2009-09-11 19:41:57 -07:00
Micah Cowan b014f8fae9 Improved exit status handling. 2009-08-27 23:08:58 -07:00
Micah Cowan d21dde51b8 Heed cookies from 401s. 2009-08-27 00:40:48 -07:00
Tony Lewis ee1df87dd8 Parse content-length before using it. Fixes NTLM (#27192). 2009-08-17 20:47:05 -07:00
Micah Cowan 9dadbf6fe9 Rename --html-extension to --adjust-extension. 2009-07-28 17:37:58 -07:00
Peter Pisar 2524076dd2 Translation fixes. 2009-07-05 14:35:21 -07:00
Micah Cowan ae042e99cf Remove version.h; we generate version.c these days. 2009-07-04 16:15:26 -07:00