moparisthebest/wget
1
0
Fork 0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Code Issues Releases Wiki Activity
2,637 Commits 1 Branch 0 Tags 9.6 MiB
d92049ef66
Commit Graph

326 Commits

Author SHA1 Message Date
mtortonesi
d8f368d062 [svn] Implement correct parsing of HTTP Content-Disposition header. 2006-02-03 01:33:57 -08:00
mtortonesi
bfd24dba71 [svn] Removed empty lines in output format. 2006-01-30 02:06:10 -08:00
mtortonesi
b5be7ce301 [svn] Commited new HTTP output format. 2006-01-30 00:54:09 -08:00
mtortonesi
823228830e [svn] Fixed pre-download verbose output which was broken by HTTP code refactoring. 2005-12-07 00:24:24 -08:00
mtortonesi
e7433e4027 [svn] Removed C++ style comments from http.c and test.c, as we support C89 compilers as well. 2005-12-05 02:55:30 -08:00
mtortonesi
d40086ba5f [svn] Major refactoring of HTTP code. Added support for Content-Disposition header. 2005-11-23 02:18:18 -08:00
hniksic
9aae245890 [svn] Tell OpenSSL to renegotiate automatically (mode SSL_MODE_AUTO_RETRY). 
By Jeremy Shapiro.
 2005-08-26 03:42:31 -07:00
hniksic
b138e352e0 [svn] Don't read more than the amount of data specified by the content-length 
header.  Removed the obsolete "kill_lines" wgetrc var.
 2005-08-08 15:51:19 -07:00
hniksic
ac4f55a297 [svn] Allow null MESSAGE. 2005-07-06 02:25:12 -07:00
hniksic
2ef83f89bd [svn] Don't print write error message twice. 2005-07-04 15:53:17 -07:00
hniksic
6f6af2d913 [svn] Only allocate an error string on actual error. 2005-07-04 14:42:09 -07:00
hniksic
550c39e714 [svn] Correctly print SSL errors. 2005-07-03 14:20:33 -07:00
hniksic
d7ddbd9720 [svn] Document reasoning behind CLOSE_INVALIDATED more accurately. 2005-07-02 06:23:54 -07:00
hniksic
79a8def8c8 [svn] Document the side effect of test_socket_open. 2005-07-02 06:22:13 -07:00
hniksic
025fcc29a8 [svn] Correctly skip error message body for keep-alive connections. 2005-07-02 04:03:29 -07:00
hniksic
db9de5b075 [svn] Update FSF's address and copyright years. 2005-07-01 19:26:52 -07:00
hniksic
f238f09492 [svn] Minor improvements to fd_read_hunk. 2005-07-01 16:37:50 -07:00
hniksic
5b26cb40a9 [svn] Explicitly document all cases when generating the Host header. 2005-06-30 08:09:39 -07:00
hniksic
2447fb9a9b [svn] Move extern declarations to .h files. 2005-06-27 11:19:22 -07:00
hniksic
bb8a5f2eb9 [svn] Check for timegm and use it where available. 2005-06-27 06:22:30 -07:00
hniksic
0561a866c3 [svn] Remove obsolete comment. 2005-06-27 05:53:01 -07:00
hniksic
9468fba4f7 [svn] Correctly query the old locale value. 2005-06-27 04:50:04 -07:00
hniksic
2254e5c4e4 [svn] Set all locale categories. 2005-06-26 19:06:52 -07:00
hniksic
68e27bf7e2 [svn] Improve "POST data file missing" error message. 2005-06-26 18:11:10 -07:00
hniksic
319f52d756 [svn] When the download is finished, print the time the download took. 
Always invoke SIZE, not only when continuing the download.
 2005-06-25 17:41:09 -07:00
hniksic
e24bc5db1b [svn] Rewrite with_thousand_seps to be size-agnostic. Remove printing of separators 
from sizes.
 2005-06-25 16:09:29 -07:00
hniksic
bd74e419d6 [svn] Don't pattern-match server redirects. 2005-06-25 08:04:47 -07:00
hniksic
002def87d2 [svn] Rename LARGE_INT to SUM_SIZE_INT, and simplify its handling. 2005-06-25 07:39:51 -07:00
hniksic
61c5b229b7 [svn] Consistently prepend / to path when entering cookie code. 2005-06-24 05:15:03 -07:00
hniksic
74fbb03b10 [svn] Use bool type for boolean variables and values. 2005-06-22 12:38:10 -07:00
hniksic
6895126a68 [svn] Fix crash with --no-cookies. 2005-06-21 18:06:48 -07:00
hniksic
908d7a4bce [svn] Don't cast return type of malloc/realloc. Assume ANSI C signal handlers. 2005-06-19 16:03:27 -07:00
hniksic
277e840a0f [svn] Remove K&R support. 2005-06-19 15:34:58 -07:00
hniksic
613719687c [svn] Fix broken --save-headers. 2005-06-18 07:13:16 -07:00
hniksic
1805044ecd [svn] When -E is in use, check for file existence after appending ".html" to the 
name and modify the file name if necessary.
 2005-06-17 15:06:26 -07:00
hniksic
4206f96614 [svn] Gettext-ize previously missed messages. 
By Benno Schulenberg.
 2005-06-15 13:26:37 -07:00
hniksic
eeacdb2ebc [svn] Don't attempt to "skip short body" if we're issuing a HEAD request (in which 
case the response head is not followed by a body).
 2005-05-30 07:29:01 -07:00
hniksic
5771564c9c [svn] Document the origin of the "cookie date" format. 2005-05-24 07:16:27 -07:00
hniksic
05a000a477 [svn] Don't clobber the file when -c fails in the first attempt. 2005-05-17 02:01:31 -07:00
hniksic
fc5a9adfab [svn] Clarify the logic of persistent_available_p. 2005-05-16 15:01:10 -07:00
hniksic
c1ba8c2111 [svn] Would forget to close the connection when keep_alive was not used. 2005-05-14 12:24:22 -07:00
hniksic
c2bc8982b7 [svn] Tell the user about --no-check-certificate. 2005-05-11 08:52:27 -07:00
hniksic
5feb3f6696 [svn] Check for the server's identity after the SSL handshake. 2005-05-10 08:17:37 -07:00
hniksic
ee18acce0a [svn] Check for wildcards in unescaped URL path. 2005-05-08 10:52:26 -07:00
hniksic
1fab70a664 [svn] Fix warnings reported by gcc -Wstrict-prototypes -Wmissing-prototypes. 2005-05-08 02:58:39 -07:00
hniksic
58828beb5f [svn] Doc fix. 2005-05-07 10:13:18 -07:00
hniksic
247387fef5 [svn] Doc fix. 2005-05-07 10:11:29 -07:00
hniksic
4c4c440401 [svn] Fix request-line argument when talking to SSL server over proxy. 2005-05-06 16:27:47 -07:00
hniksic
302c744e9a [svn] Don't complain about "unknown authentication scheme" if the scheme 
is Basic.  Allow empty user-agent meaning "don't send User-Agent".
 2005-05-06 10:16:15 -07:00
hniksic
4192de0002 [svn] Minor doc fix. 2005-05-06 06:56:16 -07:00
hniksic
818fbdf32a [svn] Comment doc fix. 2005-05-05 15:02:46 -07:00
hniksic
a231f88b54 [svn] Zero out all of struct tm before passing it to strptime. 2005-05-05 14:49:28 -07:00
hniksic
0967c21094 [svn] Fix K&R incompatibilities reported by `gcc -Wtraditional'. 2005-05-03 08:24:30 -07:00
hniksic
b8af169bb5 [svn] Remove unreached (and useless) break statements. 2005-04-28 06:56:31 -07:00
hniksic
c2c41a6b14 [svn] Remove unreachable "break" statements. 2005-04-28 06:52:02 -07:00
hniksic
c4a5b4dfc7 [svn] Set the CONNECT user-agent in the correct request object. 2005-04-27 15:31:12 -07:00
mtortonesi
e815fe81a0 [svn] Add the --user, --password, --ftp-user and --ftp-password options. 
Rename the --ftp-passwd, --http-passwd and --proxy-passwd options to
--ftp-password, --http-password and --proxy-password respectively.
Deprecate the login and passwd .wgetrc commands.
 2005-04-27 14:30:22 -07:00
hniksic
8f935cf74c [svn] Add --random-file option. Bail out in case of error during 
SSL initialization.
 2005-04-27 14:08:40 -07:00
hniksic
b8efb6d762 [svn] Allow separate specification of certificate type and private key type. 2005-04-27 10:15:10 -07:00
hniksic
b8d826f243 [svn] Renamed src/gen_sslfunc.c to src/openssl.c and src/gen_sslfunc.h to 
src/ssl.h.
 2005-04-26 14:41:41 -07:00
hniksic
4edde35100 [svn] Renamed the SSL switches and commands. 2005-04-26 10:22:56 -07:00
hniksic
428c1a2b3c [svn] Fix various cookie-related problems. 2005-04-26 06:34:33 -07:00
hniksic
5bcaac1177 [svn] Remember that the NTLM-authorized TCP connections stay authorized. 2005-04-22 19:03:19 -07:00
hniksic
add6c24a19 [svn] Fix bugs in NTML handling. 2005-04-22 08:15:25 -07:00
hniksic
85c143a2a5 [svn] Fix the check whether a new header needs to be allocated. 
By FUJISHIMA Satsuki.
 2005-04-20 13:15:05 -07:00
hniksic
155ca3d489 [svn] Change orders of parameters of base64_encode, so it makes more sense. 
Mention NTLM support in http.c.
 2005-04-18 07:23:23 -07:00
hniksic
d406908e94 [svn] Fix potential memory leak in request_set_header. 2005-04-17 09:59:35 -07:00
hniksic
ab18c0eaed [svn] Really disable persistent connections over proxy. 2005-04-16 06:06:29 -07:00
hniksic
c547fdd6b3 [svn] Report an error in skip_short_body to the caller. 2005-04-14 14:12:57 -07:00
hniksic
4cf3365fcf [svn] Open the output file in binary mode. 
By Gisle Vanem.
 2005-04-12 13:32:31 -07:00
hniksic
364dc617a4 [svn] Doc fix. 2005-04-11 06:41:28 -07:00
hniksic
52ad80309f [svn] Added NTLM support. 2005-04-06 13:42:22 -07:00
hniksic
e65ff5729a [svn] Avoid explicit 64-bit constants; construct them by multiplication at 
compile-time.
 2005-04-01 10:22:38 -08:00
hniksic
b9a31d78dd [svn] Support human-readable file size printing. 
Don't use persistent connection over proxies.
 2005-03-22 05:20:02 -08:00
hniksic
7c044778bc [svn] Improve built-in memory debugger. 2005-03-20 07:07:40 -08:00
hniksic
72ce32e8ab [svn] Limit the maximum amount of memory allocated by fd_read_hunk and its 
callers.  Don't allocate more than 64k bytes on headers; don't allocate
more than 4k bytes on a single line.
 2005-03-19 09:35:15 -08:00
hniksic
c36e9a5272 [svn] Concatenate strings using concat_strings. 2005-03-19 09:23:32 -08:00
hniksic
976c54d0e6 [svn] Handle multiple Set-Cookie headers sent by the server. 2005-03-06 14:53:02 -08:00
hniksic
e2241936d0 [svn] Remove warnings under Borland C. 2005-03-05 18:11:10 -08:00
hniksic
b3363d2abd [svn] Fix escape chars in server response vulnerability. Server response is 
now quoted to escape non-ASCII characters.
 2005-03-04 11:34:31 -08:00
hniksic
50d143f3fe [svn] Fix a possible race condition when opening files. 
Published in <87r7j6vy9g.fsf@xemacs.org>.
 2005-03-04 11:26:18 -08:00
hniksic
ef22bf610a [svn] Large file support added. Published in <87psyr6jn7.fsf@xemacs.org>. 2005-02-23 14:21:04 -08:00
mtortonesi
65af6f7432 [svn] Fixed -k when using -O. 2004-11-18 16:44:38 -08:00
hniksic
2fdf38285b [svn] Fix typo. 2004-03-31 11:14:05 -08:00
hniksic
7488d701bf [svn] Send the Proxy-Authorization header over non-SSL connections too. 2004-03-30 15:19:16 -08:00
hniksic
a0642cc62e [svn] Revamped MS console logic. Submitted by David Fritz. 2004-02-25 15:45:24 -08:00
hniksic
5114df6b33 [svn] Respect --ignore-length. 
Inhibit keep-alive when --ignore-length is used.
 2004-02-06 17:48:54 -08:00
hniksic
2c0e2b0afa [svn] Fixes by Christian Biere: 
* progress.c (bar_set_params): Fixed syntax error when HAVE_ISATTY
was undefined.
* ftp.c (ftp_loop_internal): Allocate a larger buffer in case
"try" gets translated to something large.  Ditto in http_loop in
http.c.
* http.c (response_header_copy): Don't write to buf[BUFSIZE].
* ftp-opie.c (skey_response): Eliminate unnecessary string
concatenation; just call gen_md5_update twice.
 2004-01-27 17:02:26 -08:00
hniksic
4bbe443be3 [svn] Fix generation of `Content-Length'. 2003-12-16 12:42:06 -08:00
hniksic
261183c609 [svn] retr.c (fd_read_body): Pass total size to progress_create, not 
the remaining amount.
 2003-12-12 14:55:20 -08:00
hniksic
a8155e7bcc [svn] Correctly calculate bandwidth as total data read divided with download 
time.
 2003-12-05 18:32:57 -08:00
hniksic
bf8350af62 [svn] Support the 303 See Other response. 2003-12-05 06:37:47 -08:00
hniksic
78706dc5ea [svn] * retr.c (fd_read_body): Report the amount of data *written* as 
amount_read.  This is not entirely logical, but that's what the
callers expect, and it's not easy to change.

* ftp.c (ftp_loop_internal): Ditto.

* http.c (http_loop): Be smarter about assigning restval; if we're
in the nth pass of a download, simply use the information we have
about how much data has been retrieved as restval.

* ftp.c (getftp): Ditto for FTP "REST" command.

* http.c (gethttp): When the server doesn't respect range, skip
the first RESTVAL bytes of the read body.  Never truncate the
output file.

* retr.c (fd_read_body): Support skipping initial STARTPOS octets.
 2003-11-30 15:39:04 -08:00
hniksic
381457408a [svn] Read the data in skip_short_body directly. 2003-11-30 06:33:00 -08:00
hniksic
2f357b5eb8 [svn] Better documentation for fd_read_body args. 2003-11-29 20:41:08 -08:00
hniksic
3390f7eb45 [svn] Try to reuse connections that return error codes. 2003-11-29 17:34:33 -08:00
hniksic
63d492c0ba [svn] Initialize SSL only the first time when an SSL URL is encountered. 2003-11-29 14:24:55 -08:00
hniksic
ddd2644bc8 [svn] Docfix. 2003-11-29 14:19:46 -08:00
hniksic
0ff9eb4727 [svn] Restructure generation of HTTP requests. Allow headers specified with 
--header to override generated headers.
 2003-11-29 10:40:01 -08:00
hniksic
83b0e38940 [svn] Don't include the Proxy-Authorization header in the request tunneled 
through proxy.
 2003-11-28 03:28:05 -08:00
hniksic
76b59b1ad7 [svn] Use the CONNECT method to establish passthrough over SSL traffic 
over proxies.
 2003-11-27 18:24:53 -08:00
hniksic
dfe1f43dc0 [svn] Use fd_read_hunk for reading HTTP response head. Support HTTP/0.9 
responses.
 2003-11-27 15:29:36 -08:00
hniksic
7736d5dc98 [svn] Remove headers.c and headers.h. 2003-11-21 00:48:45 -08:00
hniksic
d9fea91a0a [svn] Remove the "rbuf" buffering layer. Provide peeking primitives instead. 2003-11-20 17:48:11 -08:00
hniksic
0716c335a0 [svn] Renamed xread/xwrite/xclose to fd_read/fd_write/fd_close. The "x" prefix is 
not appropriate because the semantics have diverged from read/write/close
too significantly.
 2003-11-20 07:19:59 -08:00
hniksic
0fb0ee87c7 [svn] Renamed address_list_find to address_list_contains. 2003-11-18 14:18:44 -08:00
hniksic
36387204b0 [svn] Fix call to socket_ip_address. 2003-11-14 18:03:23 -08:00
hniksic
9d907933ad [svn] Don't attempt to talk to two different SSL sites over the same secure 
connection.
 2003-11-13 14:48:03 -08:00
hniksic
509154dc81 [svn] Use the new function retryable_socket_connect_error instead of the 
CONNECT_ERROR macro.
 2003-11-13 14:27:38 -08:00
hniksic
c4ba08110d [svn] Mark clearly where the response begins and ends in the debug output. 2003-11-08 17:05:35 -08:00
hniksic
d7e592d797 [svn] Replace conaddr with socket_ip_address. 2003-11-07 18:57:51 -08:00
hniksic
1a0adb90b4 [svn] Don't force silent lookup. 2003-11-07 16:11:29 -08:00
hniksic
bc764dbb7c [svn] Improve SSL code. Only initialize PRNG when needed. 2003-11-06 05:06:59 -08:00
hniksic
c8e92cdbd6 [svn] Get rid of ssl_iread/ssl_iwrite. Have the SSL code register its 
routines for reading and writing data.
 2003-11-05 17:12:03 -08:00
hniksic
38b37ed104 [svn] New option --keep-session-cookies. 2003-11-04 16:11:33 -08:00
hniksic
e2e9b753e4 [svn] Retired the `boolean' type. Renamed FREE_MAYBE to xfree_null and moved the 
definition from wget.h to xmalloc.h.  Moved the DEFAULT_LOGFILE
define to log.h.  Moved the INFINITE_RECURSION define to recur.h.
 2003-11-02 11:56:37 -08:00
hniksic
370ff7a576 [svn] Moved malloc-related code to xmalloc.c. Defined new macros xnew, xnew0, 
xnew_array, and xnew0_array.  Created xmalloc.h and log.h to unclutter
wget.h.
 2003-10-31 06:31:56 -08:00
hniksic
add61a2d9c [svn] Networking improvements: get rid of the MSOCK global variable, 
move the sockaddr handling to connect.c, make sure Wget refreshes
the DNS lookup after it becomes stale.
 2003-10-30 16:18:08 -08:00
hniksic
6f1250b1c6 [svn] Updated IPv6 code. 2003-10-29 15:13:25 -08:00
hniksic
90cb3309da [svn] Imported Mauro's IPv6 changes. 2003-10-29 10:23:56 -08:00
hniksic
31d919b23d [svn] Accept HTTP status 307 as redirect. 2003-10-14 16:32:15 -07:00
hniksic
711bf72609 [svn] Remove VERY_LONG_TYPE; use LARGE_INT instead. Remove special code 
for handling VERY_LONG_TYPE overflows.
Make opt.quota a LARGE_INT.
 2003-10-11 06:57:11 -07:00
hniksic
38ea4d5dad [svn] Renamed DEBUG to ENABLE_DEBUG. 2003-10-07 17:05:51 -07:00
hniksic
097923f7b1 [svn] Move fnmatch() to cmpt.c and don't use it under GNU libc. 2003-10-07 16:53:31 -07:00
hniksic
254291cc03 [svn] Fix crash when post-file is missing. 2003-10-04 15:26:58 -07:00
hniksic
95c647eb44 [svn] Split off non-URL related stuff from url.c to convert.c. 2003-09-21 15:47:14 -07:00
hniksic
c06d32a309 [svn] Treat xhtml files just like regular html. 
By Matthew J. Mellon.
 2003-09-21 05:02:57 -07:00
hniksic
7b5fb50cb1 [svn] Renamed wget.h XDIGIT-related macros to (hopefully) clearer names. 2003-09-19 07:08:37 -07:00
hniksic
0e77942233 [svn] Don't pad shrunk POST'ed files. 
Message-ID: <m3u17dn1qk.fsf@hniksic.iskon.hr>
 2003-09-15 15:09:17 -07:00
hniksic
9228f0bf53 [svn] Update progress code to use higher timer resolution. 
Message-ID: <m37k49oivp.fsf@hniksic.iskon.hr>
 2003-09-15 14:14:15 -07:00
hniksic
0a3697ad65 [svn] New mechanism for quoting file names. 
Published in <m3smmzt4px.fsf@hniksic.iskon.hr>.
 2003-09-14 15:04:13 -07:00
hniksic
30ac043b0a [svn] New option --retry-connrefused from Ahmod Dancy. 2003-09-04 14:34:58 -07:00
hniksic
b2be7522c7 [svn] Update the license to include the OpenSSL exception. 2002-05-17 19:16:36 -07:00
abbotti
043d305fb1 [svn] Don't ftruncate standard output. 
Submitted by Bill Richardson  <bill@riverstonenet.com>.
Final version of patch published in
<9vv1eus668tn7v3vn95e7l2lcjbbph8bi2@farscape.privy.mev.co.uk>.
 2002-05-14 05:23:51 -07:00
hniksic
29a66192cf [svn] Cookie interface and implementation changes 
from <sxsofge9yao.fsf@florida.arsdigita.de>
and <sxslmbim7dg.fsf@florida.arsdigita.de>.
 2002-04-20 13:46:38 -07:00
hniksic
426bf23ae1 [svn] If content-type is not given, assume text/html. 2002-04-15 18:13:51 -07:00
hniksic
9f2cc07924 [svn] Minor cleanup of iread/iwrite. 
Published in <sxsk7raj1t2.fsf@florida.arsdigita.de>.
 2002-04-13 22:19:27 -07:00
hniksic
5cb8a6f44d [svn] Add the POST method. 
Published in <sxssn5yj4eb.fsf@florida.arsdigita.de>.
 2002-04-13 21:22:47 -07:00
abbotti
4aaf8fdcea [svn] Compensate for MS Windows two-second granularity of file modification 
timestamps.
Submitted by Ian Abbott in <3CB7355C.21011.2134FDA@localhost>.
 2002-04-12 12:21:02 -07:00
abbotti
cfd7b9a951 [svn] Use new function to test filename for common html suffixes. 
Submitted by Ian Abbott in <3CB72D29.4898.1F34872@localhost> with minor
changes to formatting and comments.
 2002-04-12 11:53:39 -07:00
hniksic
1375a89141 [svn] Allow Wget to be compiled with a K&R compiler. 
Published in <sxszo0af9k6.fsf@florida.arsdigita.de>.
 2002-04-11 10:49:32 -07:00
hniksic
a9ff5853a9 [svn] when -c used, mark already fully retrieved file as successfully retrieved. 
Submitted by Ian Abbott in <3C6019F4.30803.FF43E9@localhost>.
 2002-02-18 21:18:43 -08:00
hniksic
f2bb99d102 [svn] Wrap numeric IPv6 addresses in square brackets when sending out HTTP 
`Host' header.
Published in <sxs7kq4vgzf.fsf@florida.arsdigita.de>.
 2002-01-26 15:19:10 -08:00
hniksic
cafe798fec [svn] Invalidate socket if get_contents encountered an error. 
Published in <sxsita54sqy.fsf@florida.arsdigita.de>.
 2002-01-13 17:39:16 -08:00
hniksic
5b575eef31 [svn] Check for conn->ssl before using ssl_iwrite. 2001-12-13 08:46:56 -08:00
hniksic
dd84231c6a [svn] Minor fixes prompted by `lint'. 
Published in <sxsadwt2nkg.fsf@florida.arsdigita.de>.
 2001-12-08 17:24:41 -08:00
hniksic
6d93a95e37 [svn] Declare h_errno in host.c, but not elsewhere. 2001-12-03 09:22:06 -08:00
hniksic
569fd61c95 [svn] Use the full path when building the authorization line. 
Published in <sxsitbqu9iw.fsf@florida.arsdigita.de>.
 2001-12-01 09:39:07 -08:00
hniksic
2c37aef2d8 [svn] Don't forget to shutdown the SSL structure if the socket times out. 
Submitted by T. Bharath in <3B3DEBC7.2537186A@responsenetworks.com>.
 2001-11-30 00:57:03 -08:00
hniksic
b65661a879 [svn] Remove char/unsigned char warnings emitted by Sun cc. 2001-11-29 10:48:43 -08:00