moparisthebest/wget
1
0
Fork 0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Code Issues Releases Wiki Activity
3,092 Commits 1 Branch 0 Tags 9.6 MiB
4eeabffee6
Commit Graph

194 Commits

Author SHA1 Message Date
Saint Xavier
66dd4bda74 IRI requirement: do not percent-encode already percent-encoded values (try1) 2008-09-27 11:13:21 +02:00
Saint Xavier
5133d57366 Fixes: use encoding got from the remote server serving the list file and use quote_n() for quote'ing several args 2008-08-15 15:03:38 +02:00
Xavier Saint
cbd54b549a Automated merge. 2008-08-14 18:45:13 +02:00
Xavier Saint
723dbfc818 Correct iri handling while fetching a remote file list with -i and provide a test 2008-08-14 18:26:53 +02:00
Xavier Saint
e6b4e761d1 Don't forget to free the iri struct 2008-08-14 17:42:16 +02:00
Xavier Saint
44a22c78a7 Automated merge. 2008-08-07 10:27:19 +02:00
Xavier Saint
84395897ad iri.h is already included in wget.h, so don't include it in C files 2008-08-04 11:08:33 +02:00
Micah Cowan
0fae9cb388 stsc: better message for "unsupported schemes". 2008-08-03 22:03:04 -07:00
Xavier Saint
bfd8a73f00 quote*() functions don't like that much NULL arg 2008-08-02 11:22:14 +02:00
Xavier Saint
b967d49f79 opt.remote_encoding should not override opt.locale, add a force arguments to set_uri_encoding() 2008-07-30 10:15:55 +02:00
Saint Xavier
3ae04f5fe4 Use DEBUGP instead of commenting out all the _wonderful_ printfs 2008-07-24 14:32:31 +02:00
Saint Xavier
ccd62071dc Automated merge. 2008-07-24 00:58:10 +02:00
Saint Xavier
d82f80ecab Change global variable model for state-object 2008-07-24 00:56:29 +02:00
Micah Cowan
e4371807f6 stsc: -i URL improvements. 2008-07-22 13:33:42 -07:00
Saint Xavier
b30a0dd817 Automated merge. 2008-07-20 21:45:09 +02:00
Saint Xavier
1e9ced0170 Get rid of the supplementary bool pointer in url_parse () arguments; UGLY :) 2008-07-20 18:47:52 +02:00
Saint Xavier
da6b3f4b61 Use dt rather than result 2008-07-20 18:20:18 +02:00
Saint Xavier
9a2ea3938d Basic IDN/IRI support 2008-07-20 13:10:02 +02:00
Micah Cowan
b28a6abfe6 -i accepts URLs (stsc). For #21265. 2008-07-11 17:16:49 -07:00
Micah Cowan
714ccdcd84 Steven Schweda's VMS patch. 2008-04-22 14:48:36 -07:00
Micah Cowan
caae3b70f4 Merging Ted Mielczarek's CSS changes with tip. 2008-04-22 01:28:15 -07:00
Micah Cowan
a0d0f332d5 Ted Mielczarek's CSS wonder-patch, applied against the source from around the time the patch was written. 2008-04-22 00:15:48 -07:00
Micah Cowan
bc8f473272 Updated copyright year. 2008-01-25 05:04:01 -08:00
Micah Cowan
462e643a7e Merge SFLC licensing changes for OpenSSL with tip. 2007-12-07 17:37:07 -08:00
Micah Cowan
86395b297b Updated licensing exception for OpenSSL from the SFLC. 2007-11-28 00:05:33 -08:00
Micah Cowan
212396c7e1 Eschew config-post.h. 2007-10-18 20:50:40 -07:00
Micah Cowan
5dd09d9ba5 Update copyright lists, conforming to maintainer guidelines 2007-09-28 15:45:31 -07:00
micah
7d2066b221 [svn] Make indentation consistent (all-spaces, no tabs). 2007-08-02 20:38:21 -07:00
micah
10da871ac4 [svn] Merging fix #20499: MAX_REDIRECTIONS should be configurable. 2007-07-28 19:37:14 -07:00
micah
4d7c5e087b [svn] Merge of fix for bugs 20341 and 20410. 2007-07-09 22:53:22 -07:00
hniksic
3f51773542 [svn] Fixed problem with recursive FTP retrieval. 2006-11-21 14:18:12 -08:00
mtortonesi
1c7493b83e [svn] Added sanity checks for -k, -p, -r and -N when -O is given. Added fixes for 64-bit platforms. Updated copyright and maintainer information. 2006-07-14 06:25:50 -07:00
mtortonesi
9d9f134fdf [svn] Fixed recursive FTP retrieval over proxy. 2006-06-12 09:26:28 -07:00
mtortonesi
01093c0c33 [svn] Fixed recursive spider mode. 2006-05-25 09:11:29 -07:00
hniksic
a202418374 [svn] Made [0.5*wait, 1.5*wait) the range of --random-wait. 2006-02-05 00:35:22 -08:00
mtortonesi
1ff7c1fa70 [svn] retr.c: Changed semantics of no_proxy_match. 2005-10-05 02:46:07 -07:00
hniksic
a95c910f9c [svn] Change name of param. 2005-09-17 05:55:21 -07:00
hniksic
3d5863424b [svn] Make timers measure seconds directly, not milliseconds. 2005-07-06 09:35:42 -07:00
hniksic
db9de5b075 [svn] Update FSF's address and copyright years. 2005-07-01 19:26:52 -07:00
hniksic
176b61461b [svn] Display smaller download rate numbers with more digits of precision. 2005-07-01 17:40:54 -07:00
hniksic
f238f09492 [svn] Minor improvements to fd_read_hunk. 2005-07-01 16:37:50 -07:00
hniksic
2447fb9a9b [svn] Move extern declarations to .h files. 2005-06-27 11:19:22 -07:00
hniksic
319f52d756 [svn] When the download is finished, print the time the download took. 
Always invoke SIZE, not only when continuing the download.
 2005-06-25 17:41:09 -07:00
hniksic
bd74e419d6 [svn] Don't pattern-match server redirects. 2005-06-25 08:04:47 -07:00
hniksic
002def87d2 [svn] Rename LARGE_INT to SUM_SIZE_INT, and simplify its handling. 2005-06-25 07:39:51 -07:00
hniksic
74fbb03b10 [svn] Use bool type for boolean variables and values. 2005-06-22 12:38:10 -07:00
hniksic
277e840a0f [svn] Remove K&R support. 2005-06-19 15:34:58 -07:00
hniksic
91479b4c8e [svn] Reset the sleep_adjust limit value for new downloads. Fixes Debian bug 
232276.
 2005-05-05 02:48:08 -07:00
hniksic
0967c21094 [svn] Fix K&R incompatibilities reported by `gcc -Wtraditional'. 2005-05-03 08:24:30 -07:00
hniksic
9756b0adf5 [svn] Don't ignore timeout when progress=dot. 2005-04-16 13:12:43 -07:00
hniksic
0e3c6ed569 [svn] Clean up prototypes and definitions of ssl_init and ssl_connect. 
Don't include SSL headers in retr.c.
 2005-04-11 07:33:36 -07:00
hniksic
14a2d25b2e [svn] Better selection of POSIX clocks. 2005-04-08 11:19:20 -07:00
hniksic
2219d47ba3 [svn] Extract timers to a separate file. 2005-04-07 14:37:22 -07:00
hniksic
7c044778bc [svn] Improve built-in memory debugger. 2005-03-20 07:07:40 -08:00
hniksic
828a50e4f3 [svn] Undo the 2004-11-18 change to fd_read_body. Instead, always use the 
"exact" flag.
 2005-03-19 09:38:46 -08:00
hniksic
72ce32e8ab [svn] Limit the maximum amount of memory allocated by fd_read_hunk and its 
callers.  Don't allocate more than 64k bytes on headers; don't allocate
more than 4k bytes on a single line.
 2005-03-19 09:35:15 -08:00
hniksic
b3363d2abd [svn] Fix escape chars in server response vulnerability. Server response is 
now quoted to escape non-ASCII characters.
 2005-03-04 11:34:31 -08:00
hniksic
ef22bf610a [svn] Large file support added. Published in <87psyr6jn7.fsf@xemacs.org>. 2005-02-23 14:21:04 -08:00
mtortonesi
14645396e2 [svn] Fixed a timeout problem in src/retr.c:fd_read_body when using http_proxy. 2004-11-18 13:05:30 -08:00
hniksic
5c07512ec9 [svn] Don't change Windows console title if quiet. 
Submitted by Gisle Vanem.
 2004-03-03 16:05:26 -08:00
hniksic
489452a23a [svn] Declare the pointers to literal strings as `const'. 2003-12-14 05:35:27 -08:00
hniksic
261183c609 [svn] retr.c (fd_read_body): Pass total size to progress_create, not 
the remaining amount.
 2003-12-12 14:55:20 -08:00
hniksic
9179f2e699 [svn] Don't fiddle with "interactive timeout" if read timeout is unset. 2003-12-12 14:40:39 -08:00
hniksic
a8155e7bcc [svn] Correctly calculate bandwidth as total data read divided with download 
time.
 2003-12-05 18:32:57 -08:00
hniksic
78706dc5ea [svn] * retr.c (fd_read_body): Report the amount of data *written* as 
amount_read.  This is not entirely logical, but that's what the
callers expect, and it's not easy to change.

* ftp.c (ftp_loop_internal): Ditto.

* http.c (http_loop): Be smarter about assigning restval; if we're
in the nth pass of a download, simply use the information we have
about how much data has been retrieved as restval.

* ftp.c (getftp): Ditto for FTP "REST" command.

* http.c (gethttp): When the server doesn't respect range, skip
the first RESTVAL bytes of the read body.  Never truncate the
output file.

* retr.c (fd_read_body): Support skipping initial STARTPOS octets.
 2003-11-30 15:39:04 -08:00
hniksic
2f357b5eb8 [svn] Better documentation for fd_read_body args. 2003-11-29 20:41:08 -08:00
hniksic
3390f7eb45 [svn] Try to reuse connections that return error codes. 2003-11-29 17:34:33 -08:00
hniksic
8f286c1238 [svn] Remove obsolete finder_t typedef. 2003-11-27 15:34:32 -08:00
hniksic
dfe1f43dc0 [svn] Use fd_read_hunk for reading HTTP response head. Support HTTP/0.9 
responses.
 2003-11-27 15:29:36 -08:00
hniksic
d9fea91a0a [svn] Remove the "rbuf" buffering layer. Provide peeking primitives instead. 2003-11-20 17:48:11 -08:00
hniksic
0716c335a0 [svn] Renamed xread/xwrite/xclose to fd_read/fd_write/fd_close. The "x" prefix is 
not appropriate because the semantics have diverged from read/write/close
too significantly.
 2003-11-20 07:19:59 -08:00
hniksic
34a06b07b0 [svn] Doc fix. 2003-11-08 11:29:36 -08:00
hniksic
94ca33d2fb [svn] Update the progress gauge even when the data does not arrive. 2003-11-08 08:56:52 -08:00
hniksic
0bd6576cde [svn] Timer code update. 2003-11-07 20:55:44 -08:00
hniksic
c8e92cdbd6 [svn] Get rid of ssl_iread/ssl_iwrite. Have the SSL code register its 
routines for reading and writing data.
 2003-11-05 17:12:03 -08:00
hniksic
8cd9b4cd8a [svn] New function xsleep that resumes sleeps interrupted by signals 
on systems that support nanosleep.
 2003-11-03 13:57:04 -08:00
hniksic
e2e9b753e4 [svn] Retired the `boolean' type. Renamed FREE_MAYBE to xfree_null and moved the 
definition from wget.h to xmalloc.h.  Moved the DEFAULT_LOGFILE
define to log.h.  Moved the INFINITE_RECURSION define to recur.h.
 2003-11-02 11:56:37 -08:00
hniksic
29e36b051b [svn] Fix -p so it doesn't imply FTP recursion. 2003-10-30 05:00:29 -08:00
hniksic
711bf72609 [svn] Remove VERY_LONG_TYPE; use LARGE_INT instead. Remove special code 
for handling VERY_LONG_TYPE overflows.
Make opt.quota a LARGE_INT.
 2003-10-11 06:57:11 -07:00
hniksic
f70c6cacb9 [svn] Initialize DUMMY storage for DT. 2003-10-02 14:21:07 -07:00
hniksic
451ddf3cf9 [svn] Display percentage in title bar. 
By Gisle Vanem.
 2003-09-30 14:24:36 -07:00
hniksic
b8fa2039a7 [svn] Doc update. 2003-09-22 06:34:55 -07:00
hniksic
95c647eb44 [svn] Split off non-URL related stuff from url.c to convert.c. 2003-09-21 15:47:14 -07:00
hniksic
b8e416c6c7 [svn] Adjust bandwidth limitation sleep for the error of previous sleeps. 
Allow decimal numbers in bandwidth limit specification.
 2003-09-20 21:05:12 -07:00
hniksic
7870937036 [svn] Allow decimal values for --timeout, --wait, and --waitretry. 
Message-ID: <m3llsjhx6t.fsf@hniksic.iskon.hr>
 2003-09-20 16:12:18 -07:00
hniksic
e7998ad916 [svn] Cosmetic fixes. 2003-09-20 14:08:41 -07:00
hniksic
fb67dd6201 [svn] Call ssl_iread with the correct arguments. 2003-09-18 04:43:00 -07:00
hniksic
d54b2a086d [svn] Improved --limit-rate for small bandwidths. 
Message-ID: <m3znh5n2og.fsf@hniksic.iskon.hr>
 2003-09-15 14:48:43 -07:00
hniksic
9228f0bf53 [svn] Update progress code to use higher timer resolution. 
Message-ID: <m37k49oivp.fsf@hniksic.iskon.hr>
 2003-09-15 14:14:15 -07:00
hniksic
b2be7522c7 [svn] Update the license to include the OpenSSL exception. 2002-05-17 19:16:36 -07:00
hniksic
9f2cc07924 [svn] Minor cleanup of iread/iwrite. 
Published in <sxsk7raj1t2.fsf@florida.arsdigita.de>.
 2002-04-13 22:19:27 -07:00
hniksic
5cb8a6f44d [svn] Add the POST method. 
Published in <sxssn5yj4eb.fsf@florida.arsdigita.de>.
 2002-04-13 21:22:47 -07:00
hniksic
5390ada318 [svn] Support FWTK-style proxies. 
Pbublished in <sxslmbsxptu.fsf@florida.arsdigita.de>.
 2002-04-12 20:04:47 -07:00
abbotti
cfd7b9a951 [svn] Use new function to test filename for common html suffixes. 
Submitted by Ian Abbott in <3CB72D29.4898.1F34872@localhost> with minor
changes to formatting and comments.
 2002-04-12 11:53:39 -07:00
hniksic
6c4c785cc2 [svn] Remove redirection cycle detection. 
Published in <sxs7kpzhcwa.fsf@florida.arsdigita.de>.
 2002-01-30 11:12:20 -08:00
hniksic
eb0f9de05d [svn] Simplify indentation in sleep_between_retrievals. 2001-12-17 07:00:25 -08:00
hniksic
75699d6213 [svn] Use the new function `random_number' that doesn't depend on RAND_MAX 
being defined.
Published in <sxsheqqq6xb.fsf@florida.arsdigita.de>.
 2001-12-17 06:05:08 -08:00
hniksic
0fdc1bd8c0 [svn] Fix downloading of duplicate URLs. 
Published in <sxsvgfmu2bj.fsf@florida.arsdigita.de>.
 2001-12-04 13:03:35 -08:00
hniksic
406fb8bbef [svn] Don't allow more than 20 successive redirections. 2001-11-30 13:33:31 -08:00
hniksic
a4db28e20f [svn] Ignore -np when in -p mode. 
Published in <sxsg06w2c52.fsf@florida.arsdigita.de>.
 2001-11-30 13:17:53 -08:00