moparisthebest/wget
1
0
Fork 0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Code Issues Releases Wiki Activity
3,527 Commits 1 Branch 0 Tags 9.6 MiB
44aedd8321
Commit Graph

468 Commits

Author SHA1 Message Date
Phil Pennock
fd582e4543 Add support for TLS SNI 2012-04-13 23:58:46 +02:00
Gijs van Tulder
6a25955fe6 warc: support large files. 2012-02-25 11:58:21 +01:00
Gijs van Tulder
586ade4fb1 Fix memory leak. 2012-01-28 14:08:52 +01:00
Sasikantha Babu
5e1badae1e Properly format IPv6 addresses. 2012-01-09 00:03:23 +01:00
Gijs van Tulder
e3820953b2 Add support for WARC files. 2011-11-04 22:25:00 +01:00
Henrik Holst
fce4e757a2 Add support for --content-on-error. 2011-10-06 13:25:17 +02:00
Giuseppe Scrivano
19ef7249b8 Allow --timestamping and --continue at the same time. 2011-09-07 12:57:55 +02:00
Giuseppe Scrivano
9fab5a9f28 Fix a memory leak. 2011-08-18 15:17:20 +02:00
Giuseppe Scrivano
75d04cadf5 Fix a hang on redirects which change the transfer-encoding 2011-08-18 11:46:58 +02:00
Giuseppe Scrivano
1d9bb1c7b0 Use Cache-Control when --no-cache is specified. 2011-08-06 10:56:07 +02:00
Filipe Brandenburger
e219e587b3 Support HTTP/1.1 307 redirects keep request method. 2011-03-03 14:02:25 +01:00
Filipe Brandenburger
bb6a72caea Do not adjust the extension if the file ends in .htm. 2011-03-02 10:57:44 +01:00
Steven Schubiger
e076a6d39d Move duplicated code in http.c to a function 2011-02-23 10:37:48 +01:00
Giuseppe Scrivano
2f6aa1d741 mass change: update copyright years. 2011-01-01 13:19:37 +01:00
Giuseppe Scrivano
9ae052b1e2 Remove redundant guard. 2010-12-01 13:15:13 +01:00
Giuseppe Scrivano
8aa378bd9e Revert 2444. 2010-11-22 18:04:42 +01:00
Giuseppe Scrivano
2aa2a913c3 On a network error, attempt to resume the download, not restart it. 2010-11-21 22:56:20 +01:00
Giuseppe Scrivano
a2596ccf21 Fix an infinite loop with error message '<filename> has sprung into existence' 2010-11-19 17:14:21 +01:00
Giuseppe Scrivano
542c549985 Silent warnings reported by clang. 2010-10-16 03:04:25 +02:00
Merinov Nikolay
b5c9573ad6 Add --unlink. 2010-09-29 13:34:09 +02:00
Dennis, CHENG Renquan
6230b73df0 Fix problem when content-disposition is used with recursive downloading. 2010-09-24 14:07:58 +02:00
Giuseppe Scrivano
2107eb06ab Use persistent connections with proxies supporting them. 2010-08-09 12:56:49 +02:00
Giuseppe Scrivano
87ad80cacc Specify the connection header when keep alive connections are not used. 2010-08-09 12:32:04 +02:00
Giuseppe Scrivano
3e25a9817f Introduce --trust-server-names. Close CVE-2010-2252. 2010-07-28 21:22:22 +02:00
Alan Jenkins
954fead685 Fix a failure if the server doesn't specify a content-length and -c is used. 2010-07-20 19:42:13 +02:00
Giuseppe Scrivano
57584fe2da Fix another case of -N and -c not working well together. 2010-07-18 20:10:42 +02:00
Giuseppe Scrivano
b7f54921f6 Now --timestamping and --continue works well together. 2010-07-11 15:47:18 +02:00
Giuseppe Scrivano
117c25970b Send a HEAD before the GET when -N and --content-disposition are used together. 2010-06-14 19:24:47 +02:00
Muthu Subramanian K
aca9f566b6 Report the total avg transfer speed correctly with multiple URL's and -c. 2010-06-11 00:35:30 +02:00
Giuseppe Scrivano
bd5527dad4 If --content-disposition is used, do not send a HEAD request. 2010-06-03 16:46:56 +02:00
Giuseppe Scrivano
af5008cdb4 Tiny aesthetic changes. 2010-05-27 12:14:59 +02:00
Giuseppe Scrivano
8ff8a1d289 Send new cookies when the authorization fails. 2010-05-27 12:09:56 +02:00
Giuseppe Scrivano
475c452780 Ignore HTTP 1xx responses. 2010-05-25 17:52:13 +02:00
Giuseppe Scrivano
84b2d52598 http_atotm copies the NUL character of the locale string. 2010-05-23 10:58:05 +02:00
Giuseppe Scrivano
58a9721edf Use the gnulib md5 module. 2010-05-16 01:34:17 +02:00
Giuseppe Scrivano
293008f682 Mass update copyright years. 2010-05-08 21:56:15 +02:00
Giuseppe Scrivano
282798f52e Give a nicer message on a malformed status line. 2010-05-05 12:27:29 +02:00
Giuseppe Scrivano
d829a89218 Check `resp_status' function return code. 2010-05-04 17:34:40 +02:00
Giuseppe Scrivano
1cee086162 Support HTTP/1.1. 2010-05-01 22:34:11 +02:00
Micah Cowan
7585b7019d --no-match-server-timestamps -> --no-use-server-timestamps 2010-01-09 20:21:37 -08:00
David Holman
1f08245076 --no-match-server-timestamps 2010-01-09 18:57:18 -08:00
Arvind Jamuna Dixit
d5361eca21 Support RFC 2231. 2010-01-09 14:23:29 -08:00
Micah Cowan
4a08094db8 [mq]: cfg-mk 2009-09-21 20:39:44 -07:00
Steven Schweda
5ef1d7b949 Fixes needed for VMS. 2009-09-11 19:41:57 -07:00
Micah Cowan
b014f8fae9 Improved exit status handling. 2009-08-27 23:08:58 -07:00
Micah Cowan
d21dde51b8 Heed cookies from 401s. 2009-08-27 00:40:48 -07:00
Tony Lewis
ee1df87dd8 Parse content-length before using it. Fixes NTLM (#27192). 2009-08-17 20:47:05 -07:00
Micah Cowan
9dadbf6fe9 Rename --html-extension to --adjust-extension. 2009-07-28 17:37:58 -07:00
Peter Pisar
2524076dd2 Translation fixes. 2009-07-05 14:35:21 -07:00
Micah Cowan
ae042e99cf Remove version.h; we generate version.c these days. 2009-07-04 16:15:26 -07:00
Micah Cowan
d5e283b1a7 Automated merge. 2009-07-04 15:32:57 -07:00
Micah Cowan
4f3dd68173 Merge with mainline. 2009-06-25 01:14:11 -07:00
Xin Zou
37b7e547c3 Fix some memory leaks. 2009-06-11 19:16:51 -07:00
Micah Cowan
8477863e75 Fix bad setlocale usage. 2009-06-11 18:58:26 -07:00
Steven Schubiger
116b261a9f Move duplicated code to a function. 2009-04-13 22:19:13 +02:00
Steven Schubiger
42253233c3 Adjust copyright years. 2009-03-03 21:16:47 +01:00
Steven Schubiger
fb7916aa1d Improve messages when writing a document to stdout. 2009-02-21 17:32:12 +01:00
Micah Cowan
58de6f0033 Not-so-automated merge. 2008-12-01 22:59:03 -08:00
Micah Cowan
78a7657395 Automated merge. 2008-11-26 21:55:12 -08:00
Micah Cowan
d8c11a82ca Automated merge. 2008-11-26 21:53:40 -08:00
Saint Xavier
51f8e65633 Fixes bug #24862: --content-disposition doesn't work with HTTP authentication 2008-11-27 00:19:06 +01:00
Micah Cowan
289ff1c86a Merge with mainline. 2008-11-26 07:08:38 -08:00
Steven Schubiger
f33c275621 Move numurls out of options struct. 2008-11-16 20:53:58 +01:00
Micah Cowan
c7f74c62d3 Don't download content just to ignore it. 2008-11-13 00:59:53 -08:00
Saint Xavier
65ab102f07 Make --auth-no-challenge work with user:pass@ in URLs. 2008-11-10 23:17:17 -08:00
Saint Xavier
d82f80ecab Change global variable model for state-object 2008-07-24 00:56:29 +02:00
Saint Xavier
b30a0dd817 Automated merge. 2008-07-20 21:45:09 +02:00
Saint Xavier
7410cb9764 In spider mode, do not report links as broken if they were utf8 encoded 2008-07-20 18:52:20 +02:00
Saint Xavier
9a2ea3938d Basic IDN/IRI support 2008-07-20 13:10:02 +02:00
Micah Cowan
2e2ac6ad2f Merge current tip with CSS stuff. 2008-07-11 16:30:51 -07:00
Saint Xavier
d3007f1b3a Automated merge. 2008-06-26 18:10:16 +02:00
Micah Cowan
6db8909f87 stsc: escnonprint -> quotearg_style 2008-06-24 12:08:46 -07:00
Micah Cowan
25585dce47 stsc's patch to initialize, free hs->message. 2008-06-23 12:54:50 -07:00
Micah Cowan
b2dbe2b7e4 stsc's better-messages-for-spider-mode patch. 2008-06-22 15:07:19 -07:00
Saint Xavier
ed558a83f6 The prefered way is to avoid #ifdef flooding, so take it that way. Introduce iri.c and iri.h for achieving it 2008-06-19 22:07:03 +02:00
Micah Cowan
c94d559bc3 Don't abort when len > contlen, when we set it that way. 2008-06-16 21:49:15 -07:00
Saint Xavier
8fc5241a2d Automaetd merge. 2008-06-08 13:00:15 +02:00
Micah Cowan
dac53e8bdf Minor tweaks to Henri's patch. 2008-05-31 00:24:53 -07:00
Micah Cowan
48b53471e8 Henri's -Wall patch. 2008-05-30 22:42:36 -07:00
Saint Xavier
4aab9e8f0a Detect HTTP Content-Type server encoding 2008-05-25 03:49:00 +02:00
Micah Cowan
d78cd8d8f8 Merging heads. 2008-05-15 22:36:20 -07:00
Micah Cowan
e72b57629b Merge quote module stuff with current mainline. 2008-05-15 19:13:08 -07:00
Joao Ferreira
9fa15c310f Changed some comments related with bug fix #23238, to make things clearer. 2008-05-14 23:21:06 +01:00
Joao Ferreira
888c30ba01 Fixed bug #23238: --no-clobber doesn't work with -O flag 
"wget -nc -O file URL" now checks if "file" exists first. If it does, it terminates.
 2008-05-14 22:10:37 +01:00
Micah Cowan
202caab4c2 Parse html from files when -r -nc is active. 2008-04-27 12:11:03 -07:00
Micah Cowan
ad21f8e2b7 Add fix from eleven, for doing HTTPS auth over a proxy (in eleven, changeset 883844a4ac33). 2008-04-26 21:28:35 -07:00
Steven Schubiger
883ff34537 Further quote*()-related integrations in http.c. 2008-04-26 14:25:50 +02:00
Micah Cowan
b2ad06272d Make http.c's handling of --quiet --server-response consistent with ftp.c's. 2008-04-22 23:07:19 -07:00
Micah Cowan
714ccdcd84 Steven Schweda's VMS patch. 2008-04-22 14:48:36 -07:00
Micah Cowan
1c231299bd Fix merge glitches, get it to build. 2008-04-22 01:47:39 -07:00
Micah Cowan
caae3b70f4 Merging Ted Mielczarek's CSS changes with tip. 2008-04-22 01:28:15 -07:00
Micah Cowan
a0d0f332d5 Ted Mielczarek's CSS wonder-patch, applied against the source from around the time the patch was written. 2008-04-22 00:15:48 -07:00
Steven Schubiger
2c77220411 Undo the USE_GNULIB_ALLOC defines. 2008-04-20 11:46:52 +02:00
Steven Schubiger
76780021d8 Use Gnulib's alloc functions throughout the source. 2008-04-19 01:21:24 +02:00
Micah Cowan
92956183a7 Applied Steven Schubiger's patch to use Gnulib's quote function in http.c. 2008-04-14 15:45:40 -07:00
Micah Cowan
af6517900e Better messages for --spider without -r. 2008-02-11 14:55:25 -08:00
Micah Cowan
4c1a59ea48 Fix #22242: Option to allow auths before challenged. 2008-02-10 17:31:27 -08:00
Micah Cowan
653a658a58 Fixed #22251: Terminated download gets new filename. 2008-02-10 14:39:41 -08:00
Micah Cowan
c1b7382ec4 Ugly fix to make -nc without --content-disposition go back to not fetching files. 2008-02-03 12:20:52 -08:00
Micah Cowan
d92eda101b Properly handle missing Content-Length for partial HTTP fetches. 2008-01-31 02:01:00 -08:00
Micah Cowan
bc8f473272 Updated copyright year. 2008-01-25 05:04:01 -08:00
Micah Cowan
462e643a7e Merge SFLC licensing changes for OpenSSL with tip. 2007-12-07 17:37:07 -08:00
Micah Cowan
86395b297b Updated licensing exception for OpenSSL from the SFLC. 2007-11-28 00:05:33 -08:00
Micah Cowan
212396c7e1 Eschew config-post.h. 2007-10-18 20:50:40 -07:00
Micah Cowan
da99855784 ISSPACE -> c_isspace 2007-10-14 14:46:24 -07:00
Micah Cowan
e402ae37f4 Put send_head_first check where it needs to be. 2007-10-09 00:12:51 -07:00
Micah Cowan
53d0aff795 Automated merge with file:/home/micah/devel/wget/eleven 2007-10-04 23:23:35 -07:00
Micah Cowan
7d33170f7f Hack to make -c work again without HEAD. 2007-10-04 23:00:08 -07:00
Micah Cowan
1b28d66fcb Fix silly scoping bug. 2007-10-02 23:15:08 -07:00
Micah Cowan
1153d3d05c Warn about host resolution failure. 2007-10-02 22:12:04 -07:00
Micah Cowan
5f341d6bc1 Dates as well as times in output timestamps 2007-10-02 20:31:23 -07:00
Micah Cowan
27478c069f Fix gethttp returning RETROK, which caused abortion. 2007-09-28 18:21:08 -07:00
Micah Cowan
5dd09d9ba5 Update copyright lists, conforming to maintainer guidelines 2007-09-28 15:45:31 -07:00
micah
db4f2e31ca [svn] Apply Jochen's patch to stop local size always reporting as 0 2007-09-24 22:20:58 -07:00
Micah Cowan
e3dffde871 Timestamp files, regardless of HEAD 2007-09-12 09:34:14 -07:00
micah
adc0632654 [svn] Fix #20747: Wget was returning error for non-recursive --spider when file exists. 2007-08-29 21:34:34 -07:00
micah
6e3d978b8b [svn] Fix #20323 - Adjustments and tests for when HEAD should be sent. 2007-08-29 21:16:24 -07:00
micah
4358313069 [svn] Fix #20322 - Use timestamp from most recent response. 2007-08-29 20:35:49 -07:00
micah
2fe72be505 [svn] Fix for bug #20512: Don't abort for negative Content-Length values. 2007-07-31 15:39:52 -07:00
micah
c17f57f1fa [svn] Fix for bug #20296: User:pass@ given in Referer header. 2007-07-29 18:22:34 -07:00
micah
e4600575bb [svn] Fix for bug #20299: Basic auth creds sent before challenge 2007-07-29 17:29:05 -07:00
micah
78aefb3bbf [svn] Backing out incomplete changes for bug 20323, until the full fix is 
ready (so we have a working trunk).
 2007-07-10 21:39:36 -07:00
micah
4d7c5e087b [svn] Merge of fix for bugs 20341 and 20410. 2007-07-09 22:53:22 -07:00
mtortonesi
dfeb089f3c [svn] Skip HEAD request and start immediately with GET if -O is given. 2007-07-03 16:01:25 -07:00
hniksic
a83387134c [svn] Escape non-printable characters in server response. 2007-02-02 01:36:49 -08:00
mtortonesi
14ee3a6c03 [svn] Fix -P in case HTTP Content-Disposition header is present. 2006-12-27 01:42:28 -08:00
mtortonesi
763229b67f [svn] #include'd spider.h to get rid of compiler warnings. 2006-08-28 07:41:40 -07:00
mtortonesi
0dbef4ccb4 [svn] Several fixes for recursive spider mode. 2006-08-24 08:27:57 -07:00
mtortonesi
8c45a34a55 [svn] Fixed a timestamping related bug in HTTP downloads. 2006-08-21 06:38:15 -07:00
mtortonesi
a9c3209a9b [svn] Fix broken -c in new HTTP code. 2006-08-17 03:49:29 -07:00
hniksic
8566a72767 [svn] Avoid code repetition between time_str and datetime_str. 2006-08-08 07:32:53 -07:00
mtortonesi
1c7493b83e [svn] Added sanity checks for -k, -p, -r and -N when -O is given. Added fixes for 64-bit platforms. Updated copyright and maintainer information. 2006-07-14 06:25:50 -07:00
mtortonesi
01093c0c33 [svn] Fixed recursive spider mode. 2006-05-25 09:11:29 -07:00
mtortonesi
9a66d92f60 [svn] Improvements/fixes to HTTP Content-Disposition header support. 2006-04-28 02:15:14 -07:00
hniksic
a46aa44f57 [svn] Document parse_content_disposition. 2006-04-08 09:05:42 -07:00
mtortonesi
ea4ffded27 [svn] Restricted operational semantics of frontcmp and proclist from generic strings to directory names, and fixed dirname matching algorithm. Renamed above mentioned functions to subdir_p and dir_matches_p respectively. Added testcases for subdir_p and dir_matches_p. 2006-03-15 06:55:29 -08:00
mtortonesi
46c94e5f26 [svn] Fixed recursive HTTP retrieval 2006-03-02 01:27:45 -08:00
hniksic
65cc42ee09 [svn] Use the extract_param function for parsing the www-authenticate header. 2006-02-28 14:32:56 -08:00
hniksic
6d2dc0a1b3 [svn] Use extract_params to parse the Set-Cookies header. 2006-02-28 12:50:37 -08:00
hniksic
66ee895734 [svn] Deleted extract_param_value_delim. 2006-02-28 12:09:34 -08:00
hniksic
c90e4f9c1a [svn] Parse Content-Disposition better. Implement memrchr where missing. 2006-02-28 11:27:52 -08:00
hniksic
e8b61e46ab [svn] Only use FILE.N.html if FILE.html exists. 2006-02-25 15:28:49 -08:00
mtortonesi
d8f368d062 [svn] Implement correct parsing of HTTP Content-Disposition header. 2006-02-03 01:33:57 -08:00
mtortonesi
bfd24dba71 [svn] Removed empty lines in output format. 2006-01-30 02:06:10 -08:00
mtortonesi
b5be7ce301 [svn] Commited new HTTP output format. 2006-01-30 00:54:09 -08:00
mtortonesi
823228830e [svn] Fixed pre-download verbose output which was broken by HTTP code refactoring. 2005-12-07 00:24:24 -08:00
mtortonesi
e7433e4027 [svn] Removed C++ style comments from http.c and test.c, as we support C89 compilers as well. 2005-12-05 02:55:30 -08:00
mtortonesi
d40086ba5f [svn] Major refactoring of HTTP code. Added support for Content-Disposition header. 2005-11-23 02:18:18 -08:00
hniksic
9aae245890 [svn] Tell OpenSSL to renegotiate automatically (mode SSL_MODE_AUTO_RETRY). 
By Jeremy Shapiro.
 2005-08-26 03:42:31 -07:00
hniksic
b138e352e0 [svn] Don't read more than the amount of data specified by the content-length 
header.  Removed the obsolete "kill_lines" wgetrc var.
 2005-08-08 15:51:19 -07:00