Commit Graph

178 Commits

Author SHA1 Message Date
Saint Xavier da6b3f4b61 Use dt rather than result 2008-07-20 18:20:18 +02:00
Saint Xavier 9a2ea3938d Basic IDN/IRI support 2008-07-20 13:10:02 +02:00
Micah Cowan b28a6abfe6 -i accepts URLs (stsc). For #21265. 2008-07-11 17:16:49 -07:00
Micah Cowan 714ccdcd84 Steven Schweda's VMS patch. 2008-04-22 14:48:36 -07:00
Micah Cowan caae3b70f4 Merging Ted Mielczarek's CSS changes with tip. 2008-04-22 01:28:15 -07:00
Micah Cowan a0d0f332d5 Ted Mielczarek's CSS wonder-patch, applied against the source from around the time the patch was written. 2008-04-22 00:15:48 -07:00
Micah Cowan bc8f473272 Updated copyright year. 2008-01-25 05:04:01 -08:00
Micah Cowan 462e643a7e Merge SFLC licensing changes for OpenSSL with tip. 2007-12-07 17:37:07 -08:00
Micah Cowan 86395b297b Updated licensing exception for OpenSSL from the SFLC. 2007-11-28 00:05:33 -08:00
Micah Cowan 212396c7e1 Eschew config-post.h. 2007-10-18 20:50:40 -07:00
Micah Cowan 5dd09d9ba5 Update copyright lists, conforming to maintainer guidelines 2007-09-28 15:45:31 -07:00
micah 7d2066b221 [svn] Make indentation consistent (all-spaces, no tabs). 2007-08-02 20:38:21 -07:00
micah 10da871ac4 [svn] Merging fix #20499: MAX_REDIRECTIONS should be configurable. 2007-07-28 19:37:14 -07:00
micah 4d7c5e087b [svn] Merge of fix for bugs 20341 and 20410. 2007-07-09 22:53:22 -07:00
hniksic 3f51773542 [svn] Fixed problem with recursive FTP retrieval. 2006-11-21 14:18:12 -08:00
mtortonesi 1c7493b83e [svn] Added sanity checks for -k, -p, -r and -N when -O is given. Added fixes for 64-bit platforms. Updated copyright and maintainer information. 2006-07-14 06:25:50 -07:00
mtortonesi 9d9f134fdf [svn] Fixed recursive FTP retrieval over proxy. 2006-06-12 09:26:28 -07:00
mtortonesi 01093c0c33 [svn] Fixed recursive spider mode. 2006-05-25 09:11:29 -07:00
hniksic a202418374 [svn] Made [0.5*wait, 1.5*wait) the range of --random-wait. 2006-02-05 00:35:22 -08:00
mtortonesi 1ff7c1fa70 [svn] retr.c: Changed semantics of no_proxy_match. 2005-10-05 02:46:07 -07:00
hniksic a95c910f9c [svn] Change name of param. 2005-09-17 05:55:21 -07:00
hniksic 3d5863424b [svn] Make timers measure seconds directly, not milliseconds. 2005-07-06 09:35:42 -07:00
hniksic db9de5b075 [svn] Update FSF's address and copyright years. 2005-07-01 19:26:52 -07:00
hniksic 176b61461b [svn] Display smaller download rate numbers with more digits of precision. 2005-07-01 17:40:54 -07:00
hniksic f238f09492 [svn] Minor improvements to fd_read_hunk. 2005-07-01 16:37:50 -07:00
hniksic 2447fb9a9b [svn] Move extern declarations to .h files. 2005-06-27 11:19:22 -07:00
hniksic 319f52d756 [svn] When the download is finished, print the time the download took.
Always invoke SIZE, not only when continuing the download.
2005-06-25 17:41:09 -07:00
hniksic bd74e419d6 [svn] Don't pattern-match server redirects. 2005-06-25 08:04:47 -07:00
hniksic 002def87d2 [svn] Rename LARGE_INT to SUM_SIZE_INT, and simplify its handling. 2005-06-25 07:39:51 -07:00
hniksic 74fbb03b10 [svn] Use bool type for boolean variables and values. 2005-06-22 12:38:10 -07:00
hniksic 277e840a0f [svn] Remove K&R support. 2005-06-19 15:34:58 -07:00
hniksic 91479b4c8e [svn] Reset the sleep_adjust limit value for new downloads. Fixes Debian bug
232276.
2005-05-05 02:48:08 -07:00
hniksic 0967c21094 [svn] Fix K&R incompatibilities reported by `gcc -Wtraditional'. 2005-05-03 08:24:30 -07:00
hniksic 9756b0adf5 [svn] Don't ignore timeout when progress=dot. 2005-04-16 13:12:43 -07:00
hniksic 0e3c6ed569 [svn] Clean up prototypes and definitions of ssl_init and ssl_connect.
Don't include SSL headers in retr.c.
2005-04-11 07:33:36 -07:00
hniksic 14a2d25b2e [svn] Better selection of POSIX clocks. 2005-04-08 11:19:20 -07:00
hniksic 2219d47ba3 [svn] Extract timers to a separate file. 2005-04-07 14:37:22 -07:00
hniksic 7c044778bc [svn] Improve built-in memory debugger. 2005-03-20 07:07:40 -08:00
hniksic 828a50e4f3 [svn] Undo the 2004-11-18 change to fd_read_body. Instead, always use the
"exact" flag.
2005-03-19 09:38:46 -08:00
hniksic 72ce32e8ab [svn] Limit the maximum amount of memory allocated by fd_read_hunk and its
callers.  Don't allocate more than 64k bytes on headers; don't allocate
more than 4k bytes on a single line.
2005-03-19 09:35:15 -08:00
hniksic b3363d2abd [svn] Fix escape chars in server response vulnerability. Server response is
now quoted to escape non-ASCII characters.
2005-03-04 11:34:31 -08:00
hniksic ef22bf610a [svn] Large file support added. Published in <87psyr6jn7.fsf@xemacs.org>. 2005-02-23 14:21:04 -08:00
mtortonesi 14645396e2 [svn] Fixed a timeout problem in src/retr.c:fd_read_body when using http_proxy. 2004-11-18 13:05:30 -08:00
hniksic 5c07512ec9 [svn] Don't change Windows console title if quiet.
Submitted by Gisle Vanem.
2004-03-03 16:05:26 -08:00
hniksic 489452a23a [svn] Declare the pointers to literal strings as `const'. 2003-12-14 05:35:27 -08:00
hniksic 261183c609 [svn] retr.c (fd_read_body): Pass total size to progress_create, not
the remaining amount.
2003-12-12 14:55:20 -08:00
hniksic 9179f2e699 [svn] Don't fiddle with "interactive timeout" if read timeout is unset. 2003-12-12 14:40:39 -08:00
hniksic a8155e7bcc [svn] Correctly calculate bandwidth as total data read divided with download
time.
2003-12-05 18:32:57 -08:00
hniksic 78706dc5ea [svn] * retr.c (fd_read_body): Report the amount of data *written* as
amount_read.  This is not entirely logical, but that's what the
callers expect, and it's not easy to change.

* ftp.c (ftp_loop_internal): Ditto.

* http.c (http_loop): Be smarter about assigning restval; if we're
in the nth pass of a download, simply use the information we have
about how much data has been retrieved as restval.

* ftp.c (getftp): Ditto for FTP "REST" command.

* http.c (gethttp): When the server doesn't respect range, skip
the first RESTVAL bytes of the read body.  Never truncate the
output file.

* retr.c (fd_read_body): Support skipping initial STARTPOS octets.
2003-11-30 15:39:04 -08:00
hniksic 2f357b5eb8 [svn] Better documentation for fd_read_body args. 2003-11-29 20:41:08 -08:00
hniksic 3390f7eb45 [svn] Try to reuse connections that return error codes. 2003-11-29 17:34:33 -08:00
hniksic 8f286c1238 [svn] Remove obsolete finder_t typedef. 2003-11-27 15:34:32 -08:00
hniksic dfe1f43dc0 [svn] Use fd_read_hunk for reading HTTP response head. Support HTTP/0.9
responses.
2003-11-27 15:29:36 -08:00
hniksic d9fea91a0a [svn] Remove the "rbuf" buffering layer. Provide peeking primitives instead. 2003-11-20 17:48:11 -08:00
hniksic 0716c335a0 [svn] Renamed xread/xwrite/xclose to fd_read/fd_write/fd_close. The "x" prefix is
not appropriate because the semantics have diverged from read/write/close
too significantly.
2003-11-20 07:19:59 -08:00
hniksic 34a06b07b0 [svn] Doc fix. 2003-11-08 11:29:36 -08:00
hniksic 94ca33d2fb [svn] Update the progress gauge even when the data does not arrive. 2003-11-08 08:56:52 -08:00
hniksic 0bd6576cde [svn] Timer code update. 2003-11-07 20:55:44 -08:00
hniksic c8e92cdbd6 [svn] Get rid of ssl_iread/ssl_iwrite. Have the SSL code register its
routines for reading and writing data.
2003-11-05 17:12:03 -08:00
hniksic 8cd9b4cd8a [svn] New function xsleep that resumes sleeps interrupted by signals
on systems that support nanosleep.
2003-11-03 13:57:04 -08:00
hniksic e2e9b753e4 [svn] Retired the `boolean' type. Renamed FREE_MAYBE to xfree_null and moved the
definition from wget.h to xmalloc.h.  Moved the DEFAULT_LOGFILE
define to log.h.  Moved the INFINITE_RECURSION define to recur.h.
2003-11-02 11:56:37 -08:00
hniksic 29e36b051b [svn] Fix -p so it doesn't imply FTP recursion. 2003-10-30 05:00:29 -08:00
hniksic 711bf72609 [svn] Remove VERY_LONG_TYPE; use LARGE_INT instead. Remove special code
for handling VERY_LONG_TYPE overflows.
Make opt.quota a LARGE_INT.
2003-10-11 06:57:11 -07:00
hniksic f70c6cacb9 [svn] Initialize DUMMY storage for DT. 2003-10-02 14:21:07 -07:00
hniksic 451ddf3cf9 [svn] Display percentage in title bar.
By Gisle Vanem.
2003-09-30 14:24:36 -07:00
hniksic b8fa2039a7 [svn] Doc update. 2003-09-22 06:34:55 -07:00
hniksic 95c647eb44 [svn] Split off non-URL related stuff from url.c to convert.c. 2003-09-21 15:47:14 -07:00
hniksic b8e416c6c7 [svn] Adjust bandwidth limitation sleep for the error of previous sleeps.
Allow decimal numbers in bandwidth limit specification.
2003-09-20 21:05:12 -07:00
hniksic 7870937036 [svn] Allow decimal values for --timeout, --wait, and --waitretry.
Message-ID: <m3llsjhx6t.fsf@hniksic.iskon.hr>
2003-09-20 16:12:18 -07:00
hniksic e7998ad916 [svn] Cosmetic fixes. 2003-09-20 14:08:41 -07:00
hniksic fb67dd6201 [svn] Call ssl_iread with the correct arguments. 2003-09-18 04:43:00 -07:00
hniksic d54b2a086d [svn] Improved --limit-rate for small bandwidths.
Message-ID: <m3znh5n2og.fsf@hniksic.iskon.hr>
2003-09-15 14:48:43 -07:00
hniksic 9228f0bf53 [svn] Update progress code to use higher timer resolution.
Message-ID: <m37k49oivp.fsf@hniksic.iskon.hr>
2003-09-15 14:14:15 -07:00
hniksic b2be7522c7 [svn] Update the license to include the OpenSSL exception. 2002-05-17 19:16:36 -07:00
hniksic 9f2cc07924 [svn] Minor cleanup of iread/iwrite.
Published in <sxsk7raj1t2.fsf@florida.arsdigita.de>.
2002-04-13 22:19:27 -07:00
hniksic 5cb8a6f44d [svn] Add the POST method.
Published in <sxssn5yj4eb.fsf@florida.arsdigita.de>.
2002-04-13 21:22:47 -07:00
hniksic 5390ada318 [svn] Support FWTK-style proxies.
Pbublished in <sxslmbsxptu.fsf@florida.arsdigita.de>.
2002-04-12 20:04:47 -07:00
abbotti cfd7b9a951 [svn] Use new function to test filename for common html suffixes.
Submitted by Ian Abbott in <3CB72D29.4898.1F34872@localhost> with minor
changes to formatting and comments.
2002-04-12 11:53:39 -07:00
hniksic 6c4c785cc2 [svn] Remove redirection cycle detection.
Published in <sxs7kpzhcwa.fsf@florida.arsdigita.de>.
2002-01-30 11:12:20 -08:00
hniksic eb0f9de05d [svn] Simplify indentation in sleep_between_retrievals. 2001-12-17 07:00:25 -08:00
hniksic 75699d6213 [svn] Use the new function `random_number' that doesn't depend on RAND_MAX
being defined.
Published in <sxsheqqq6xb.fsf@florida.arsdigita.de>.
2001-12-17 06:05:08 -08:00
hniksic 0fdc1bd8c0 [svn] Fix downloading of duplicate URLs.
Published in <sxsvgfmu2bj.fsf@florida.arsdigita.de>.
2001-12-04 13:03:35 -08:00
hniksic 406fb8bbef [svn] Don't allow more than 20 successive redirections. 2001-11-30 13:33:31 -08:00
hniksic a4db28e20f [svn] Ignore -np when in -p mode.
Published in <sxsg06w2c52.fsf@florida.arsdigita.de>.
2001-11-30 13:17:53 -08:00
hniksic fb98d1e4b0 [svn] Remove implicit declaration warnings. 2001-11-29 10:22:18 -08:00
hniksic d4c6949a05 [svn] Use rand instead of random.
Published in <sxsu1vgataq.fsf@florida.arsdigita.de>.
2001-11-27 11:49:28 -08:00
hniksic 9b202ba261 [svn] * retr.c (retrieve_from_file): Initialize `new_file' to NULL to
prevent seg fault.
Submitted by Ian Abbott in <3C03DE8A.845.D0E495@localhost>.
2001-11-27 11:14:34 -08:00
hniksic bae3162c03 [svn] New option `--limit-rate'.
Published in <sxsd725cn56.fsf@florida.arsdigita.de>.
2001-11-26 12:07:13 -08:00
hniksic 84396de673 [svn] Allocate a timer directly in get_contents.
Published in <sxsherhbsvl.fsf@florida.arsdigita.de>.
2001-11-26 04:49:10 -08:00
hniksic 024cb5ed3a [svn] A lot of host name changes.
Published in <sxs3d32856s.fsf@florida.arsdigita.de>.
2001-11-25 21:36:33 -08:00
hniksic 2c41d783c6 [svn] New option --random-wait.
Submitted by Alan Eldridge in
<200111042106.fA4L63b75804@wwweasel.geeksrus.net>.
2001-11-25 13:23:15 -08:00
hniksic 3afb9c659a [svn] Recursion and progress bar tweaks.
Published in <sxsd727cvc0.fsf@florida.arsdigita.de>.
2001-11-25 13:03:30 -08:00
hniksic df05e7ff10 [svn] Handle <base href=...> when converting links.
Published in <sxsadxaae3t.fsf@florida.arsdigita.de>.
2001-11-25 10:40:55 -08:00
hniksic 05463c7121 [svn] Commit progress bar tweaks.
Published in <sxsd727cvc0.fsf@florida.arsdigita.de>.
2001-11-24 20:46:26 -08:00
hniksic 222e9465b7 [svn] Implemented breadth-first retrieval.
Published in <sxsherjczw2.fsf@florida.arsdigita.de>.
2001-11-24 19:10:34 -08:00
hniksic 177b6ee8fd [svn] Print the actual error message when parsing of redirection URL fails. 2001-11-24 06:02:10 -08:00
hniksic cdcf67a5bd [svn] Big progress bar update.
Published in <sxsn11ehyn1.fsf@florida.arsdigita.de>.
2001-11-22 20:59:52 -08:00
hniksic 4d352013ac [svn] Replace opt.no_flush with a function to disable/enable flushing.
Published in <sxssnb6imyz.fsf@florida.arsdigita.de>.
2001-11-22 12:13:13 -08:00
hniksic d5be8ecca4 [svn] Rewrite parsing and handling of URLs.
Published in <sxs4rnnlklo.fsf@florida.arsdigita.de>.
2001-11-21 16:24:28 -08:00
hniksic f178e6c613 [svn] Clean up handling of schemes.
Published in <sxswv0n7h7s.fsf@florida.arsdigita.de>.
2001-11-18 16:12:05 -08:00