moparisthebest/wget
1
0
Fork 0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Code Issues Releases Wiki Activity
1,931 Commits 1 Branch 0 Tags 9.6 MiB
4d7c5e087b
Commit Graph

168 Commits

Author SHA1 Message Date
hniksic
7c044778bc [svn] Improve built-in memory debugger. 2005-03-20 07:07:40 -08:00
hniksic
30aaf5a19a [svn] Use the passive FTP transfer mode by default. 2005-03-06 11:34:25 -08:00
hniksic
e2241936d0 [svn] Remove warnings under Borland C. 2005-03-05 18:11:10 -08:00
hniksic
ef22bf610a [svn] Large file support added. Published in <87psyr6jn7.fsf@xemacs.org>. 2005-02-23 14:21:04 -08:00
mtortonesi
787f482f03 [svn] Added the --ftp-passwd command line option. 2005-02-18 17:52:01 -08:00
mtortonesi
ca13ffd249 [svn] Added string.c module. Updated copyright information and added names of new contributors to the documentation. 2005-01-01 13:29:11 -08:00
hniksic
a0642cc62e [svn] Revamped MS console logic. Submitted by David Fritz. 2004-02-25 15:45:24 -08:00
hniksic
eef22ee91e [svn] Remove ws_help; it doesn't make sense to invoke the help browser for 
--help.
 2004-02-22 07:45:59 -08:00
hniksic
489452a23a [svn] Declare the pointers to literal strings as `const'. 2003-12-14 05:35:27 -08:00
hniksic
0d0fe50435 [svn] New option --protocol-directories. 2003-12-05 19:01:31 -08:00
hniksic
78706dc5ea [svn] * retr.c (fd_read_body): Report the amount of data *written* as 
amount_read.  This is not entirely logical, but that's what the
callers expect, and it's not easy to change.

* ftp.c (ftp_loop_internal): Ditto.

* http.c (http_loop): Be smarter about assigning restval; if we're
in the nth pass of a download, simply use the information we have
about how much data has been retrieved as restval.

* ftp.c (getftp): Ditto for FTP "REST" command.

* http.c (gethttp): When the server doesn't respect range, skip
the first RESTVAL bytes of the read body.  Never truncate the
output file.

* retr.c (fd_read_body): Support skipping initial STARTPOS octets.
 2003-11-30 15:39:04 -08:00
hniksic
bbcdd71484 [svn] Don't reference opt.ipv4_only and opt.ipv6_only if IPv6 is disabled. 2003-11-19 05:25:20 -08:00
hniksic
5fb7ffc9ad [svn] Fix alignment of FTP options output. 2003-11-17 05:13:33 -08:00
hniksic
133d69ff24 [svn] Don't auto-set opt.ipv4_only on systems without IPv6 sockets. 2003-11-17 04:59:54 -08:00
hniksic
c45fc0e595 [svn] Fix minor problems with --help text. 2003-11-16 15:42:38 -08:00
hniksic
66cc6d43f6 [svn] Don't allow opt.ipv4_only and opt.ipv6_only to both be set. 2003-11-15 16:31:58 -08:00
hniksic
22b37f3ef1 [svn] Doc fix. 2003-11-14 18:05:21 -08:00
hniksic
5a883689bc [svn] Enable -4 and -6 switches only when IPv6 is enabled. 2003-11-14 07:18:47 -08:00
hniksic
244efb6e50 [svn] Added (currently no-op) -4 and -6. 2003-11-11 13:48:35 -08:00
hniksic
113ad490d0 [svn] Fix core dump with --mirror. 2003-11-08 17:07:53 -08:00
hniksic
4f19ac5494 [svn] Retire options -g, -G, -s, and -C. 2003-11-08 12:22:21 -08:00
hniksic
439d6a11fa [svn] Added --dont-remove-listing, removed -s. 2003-11-08 12:13:24 -08:00
hniksic
7409af5e07 [svn] Break up `--help' output to smaller chunks. 2003-11-06 15:56:26 -08:00
hniksic
19144a9f4c [svn] Don't declare log_* functions in main.c. 2003-11-06 14:48:17 -08:00
hniksic
ad75dd2662 [svn] Applied Dennis Smit's --preserve-permissions patch. 2003-11-06 12:33:20 -08:00
hniksic
f567bec34c [svn] Improved command line option processing, introduced boolean options. 2003-11-06 12:20:43 -08:00
hniksic
bc764dbb7c [svn] Improve SSL code. Only initialize PRNG when needed. 2003-11-06 05:06:59 -08:00
hniksic
38b37ed104 [svn] New option --keep-session-cookies. 2003-11-04 16:11:33 -08:00
hniksic
e2e9b753e4 [svn] Retired the `boolean' type. Renamed FREE_MAYBE to xfree_null and moved the 
definition from wget.h to xmalloc.h.  Moved the DEFAULT_LOGFILE
define to log.h.  Moved the INFINITE_RECURSION define to recur.h.
 2003-11-02 11:56:37 -08:00
hniksic
29e36b051b [svn] Fix -p so it doesn't imply FTP recursion. 2003-10-30 05:00:29 -08:00
hniksic
711bf72609 [svn] Remove VERY_LONG_TYPE; use LARGE_INT instead. Remove special code 
for handling VERY_LONG_TYPE overflows.
Make opt.quota a LARGE_INT.
 2003-10-11 06:57:11 -07:00
hniksic
33dceca784 [svn] Fix typo in help string. 2003-10-08 08:24:56 -07:00
hniksic
38ea4d5dad [svn] Renamed DEBUG to ENABLE_DEBUG. 2003-10-07 17:05:51 -07:00
hniksic
6359e38d96 [svn] Improve documentation of cookie code. 2003-10-06 17:47:08 -07:00
hniksic
eec3ea392d [svn] Better document html-parse macros. 2003-10-02 15:20:44 -07:00
hniksic
111dea9622 [svn] Updated copyright and email. 2003-09-30 14:54:27 -07:00
hniksic
9d333d074b [svn] Include convert.h. 2003-09-21 16:32:42 -07:00
hniksic
51a8e9fa50 [svn] Enabled separation of different timeout values. 2003-09-20 21:41:55 -07:00
hniksic
37183b0208 [svn] Make errors in command-line options fatal. 2003-09-20 17:41:49 -07:00
hniksic
7c802e58d3 [svn] Introduce non-strict comment parsing. 2003-09-18 17:33:22 -07:00
hniksic
aa24b822ca [svn] Improved --restrict-file-names to accept ",nocontrol". 2003-09-16 18:32:05 -07:00
hniksic
0a3697ad65 [svn] New mechanism for quoting file names. 
Published in <m3smmzt4px.fsf@hniksic.iskon.hr>.
 2003-09-14 15:04:13 -07:00
hniksic
10137bd186 [svn] New option --dns-cache. 2003-09-10 12:41:54 -07:00
hniksic
30ac043b0a [svn] New option --retry-connrefused from Ahmod Dancy. 2003-09-04 14:34:58 -07:00
hniksic
b2be7522c7 [svn] Update the license to include the OpenSSL exception. 2002-05-17 19:16:36 -07:00
hniksic
91a190a770 [svn] Implement several SSL features. 
- allow checking of server cert
- allow defining client cert type
- allow limit of ssl protocol
- check more return values
- added debug message on break
Published by Thomas Lussnig in <3CC09969.5000607@bewegungsmelder.de>.
 2002-04-20 19:26:48 -07:00
hniksic
29a66192cf [svn] Cookie interface and implementation changes 
from <sxsofge9yao.fsf@florida.arsdigita.de>
and <sxslmbim7dg.fsf@florida.arsdigita.de>.
 2002-04-20 13:46:38 -07:00
hniksic
0eee8f8b25 [svn] Document --post-data' and --post-file'. 2002-04-13 22:31:11 -07:00
hniksic
5cb8a6f44d [svn] Add the POST method. 
Published in <sxssn5yj4eb.fsf@florida.arsdigita.de>.
 2002-04-13 21:22:47 -07:00
hniksic
8c3287dabf [svn] Remove the OPTIONS_DEFINED_HERE kludge. 
Published in <sxs4rijqmhv.fsf@florida.arsdigita.de>.
 2002-04-10 14:20:55 -07:00
hniksic
1365950c01 [svn] Logging system bugfixes and improvements. 
Published in <sxsofl7vdyo.fsf@florida.arsdigita.de>.
 2001-12-09 21:31:45 -08:00
hniksic
e521ee38ff [svn] Remove stray debugging message. 
Published in <sxszo4sxjpw.fsf@florida.arsdigita.de>.
 2001-12-09 11:44:20 -08:00
hniksic
39b2248bde [svn] Fall back to dot progress when forced to background. 
Published in <sxs1yi8n7lx.fsf@florida.arsdigita.de>.
 2001-12-05 23:14:35 -08:00
hniksic
fcf68c0e9a [svn] --sslegdsock' -> --egd-file' 
Published in <sxsadwwnc7h.fsf@florida.arsdigita.de>.
 2001-12-05 21:35:17 -08:00
hniksic
0620ada923 [svn] Fix OpenSSL PRNG seeding. 
Published in <sxs7ks1noc4.fsf@florida.arsdigita.de>.
 2001-12-05 17:13:31 -08:00
hniksic
07e6be3527 [svn] Don't document `-nh' in --help output. 
Published in <sxs4rnau642.fsf@florida.arsdigita.de>.
 2001-12-01 10:51:32 -08:00
hniksic
ae3c268719 [svn] Implement EGD support. 
Submitted by Christian Fraenkel in <005501c17920$1312d440$4a05a8c0@isn>.
 2001-11-29 23:39:08 -08:00
hniksic
fb7fb36cb8 [svn] Resurrect opt.dot_style. 2001-11-27 18:44:18 -08:00
hniksic
1c906e47d3 [svn] Remove stray HAVE_RANDOM check from main.c. 2001-11-27 04:54:31 -08:00
hniksic
bae3162c03 [svn] New option `--limit-rate'. 
Published in <sxsd725cn56.fsf@florida.arsdigita.de>.
 2001-11-26 12:07:13 -08:00
hniksic
2c41d783c6 [svn] New option --random-wait. 
Submitted by Alan Eldridge in
<200111042106.fA4L63b75804@wwweasel.geeksrus.net>.
 2001-11-25 13:23:15 -08:00
hniksic
95631700f7 [svn] Remove host canonicalization code. 
Published in <sxsg072ai5v.fsf@florida.arsdigita.de>.
 2001-11-25 09:13:20 -08:00
hniksic
222e9465b7 [svn] Implemented breadth-first retrieval. 
Published in <sxsherjczw2.fsf@florida.arsdigita.de>.
 2001-11-24 19:10:34 -08:00
hniksic
905472770e [svn] Minor progress bar fixes. 
Published in <sxsn11dh3fc.fsf@florida.arsdigita.de>.
 2001-11-23 08:12:53 -08:00
hniksic
cdcf67a5bd [svn] Big progress bar update. 
Published in <sxsn11ehyn1.fsf@florida.arsdigita.de>.
 2001-11-22 20:59:52 -08:00
hniksic
d5be8ecca4 [svn] Rewrite parsing and handling of URLs. 
Published in <sxs4rnnlklo.fsf@florida.arsdigita.de>.
 2001-11-21 16:24:28 -08:00
hniksic
f4dcb55851 [svn] Split the copyright notice for easier translation. 2001-11-21 15:15:19 -08:00
hniksic
de7f766f58 [svn] Remove --wait/--waitretry compatibility code. 
Published in <sxs6686py1q.fsf@florida.arsdigita.de>.
 2001-11-19 07:42:56 -08:00
hniksic
e8e8797873 [svn] Rewrite shorthand URLs in a step separate from parsing. 
Published in <sxspu6f7ecz.fsf@florida.arsdigita.de>.
 2001-11-18 17:14:14 -08:00
hniksic
ee99e8998a [svn] Don't compile getopt.c on systems that already have getopt_long. 
Published in <sxshersbs0w.fsf@florida.arsdigita.de>.
 2001-11-17 20:52:18 -08:00
hniksic
0b056d1720 [svn] Update copyright notices. 2001-05-27 12:35:15 -07:00
hniksic
72eca0976b [svn] Commit several minor changes: 
* main.c (print_help): Document `--no-http-keep-alive'.

* utils.c (numdigit): Handle negative numbers *correctly*.

* hash.c (make_nocase_string_hash_table): Use term "nocase" rather
than the confusing "unsigned".

* utils.c (string_set_contains): Renamed from string_set_exists.

* hash.c (hash_table_contains): Renamed from hash_table_exists.

* cookies.c: Move case-insensitive hash tables to hash.c.

Published in <sxsheyq9vvl.fsf@florida.arsdigita.de>.
 2001-05-12 13:06:41 -07:00
hniksic
00773e7d15 [svn] Make `--cookies' respect its arg. 
Published in <sxs4rv8ht5e.fsf@florida.arsdigita.de>.
 2001-04-29 03:56:43 -07:00
hniksic
dfc1eb5766 [svn] Change default anonymous FTP password to "-wget@". 
Published in <sxsu239htnl.fsf@florida.arsdigita.de>.
 2001-04-29 03:53:55 -07:00
hniksic
d70101ea4e [svn] Commit various HTTP fixes. 
Published in <sxsy9slhu7g.fsf@florida.arsdigita.de>.

* http.c (gethttp): Return RETRUNNEEDED when the retrieval is
unneeded because the file is already there and fully downloaded,
and -c is specified.
(http_loop): Handle RETRUNNEEDED.

* wget.h (uerr_t): New value RETRUNNEEDED.

* http.c (http_loop): Set no_truncate for files that both exist
and are non-empty.
(gethttp): Consider the download finished when restval >= contlen,
not only when restval==contlen.
(gethttp): Handle redirection before giving up due to -c.
(gethttp): Clarify error message which explains that -c will not
truncate the file.
(gethttp): When returning CONTNOTSUPPORTED, don't forget to free
the stuff that needs freeing and release the socket.

* main.c (print_help): Wget booleans accept "off", not "no".
 2001-04-28 09:22:20 -07:00
hniksic
d80f6cbe8c [svn] Reimplemented UNSAFE_CHAR and RESERVED_CHAR. 
Fixed snprintf.c to avoid ISDIGIT.
 2001-04-24 17:20:30 -07:00
hniksic
5fa53b5a1d [svn] Implement better sorting and matching of cookies. 
Fix previously broken command-line options.
Published in <sxspuek9255.fsf@florida.arsdigita.de>.
 2001-04-10 09:04:18 -07:00
hniksic
2cfb2d2ef6 [svn] Added support for cookies. 2001-04-08 15:25:24 -07:00
hniksic
f1d534cd8c [svn] Make -c' and -O' work together. 
Published in <sxsitkmgokh.fsf@florida.arsdigita.de>.
 2001-04-03 05:24:49 -07:00
hniksic
4dbad3a894 [svn] Make sure -C is recognized. 2001-04-01 14:26:28 -07:00
hniksic
e4d49f0b40 [svn] Published my patch "main.c tweaks" published in 
<sxspueyonjt.fsf@florida.arsdigita.de>.
 2001-03-30 15:17:59 -08:00
hniksic
1a6058b1ec [svn] Applied Philipp Thomas's safe-ctype patch. Published in 
<20010330025159.U21662@jeffreys.suse.de>.
 2001-03-30 14:36:59 -08:00
dan
b6febbc84b [svn] * po/*.po*: Updated after moving -nr to a different category. 
* wget.texi: Moved -nr from "Recursive Retrieval Options" to "FTP Options" and
  gave it a @cindex entry. Alphabetized FTP options by long option name.

* main.c (print_help): -nr belongs in "FTP options" section of --help output,
  not "Recursive retrieval" section.  Alphabetized FTP options by long option
  name.
 2001-02-23 13:31:54 -08:00
dan
2aa1d53fb2 [svn] * main.c (print_help): --help documentation for -N said it would re-download 
files if they had the _same_ timestamp on server.

* po/*.po*: Updated after changing --help's description of -N.
 2001-02-23 12:43:35 -08:00
hniksic
07f60f19a4 [svn] Applied Christian Fraenkel's patch "custom certificate patch for wget-1.7+dev; 
2nd try", published in <200102082132220160.00474E73@pop.gmx.net>.
It adds two options for custom certificates.
 2001-02-10 14:33:31 -08:00
dan
f84a94e913 [svn] Made clarifications and corrections to --continue's --help output and wget.texi 
documentation.  Published in <200101100629.WAA09744@dilvish.speed.net>.
 2001-01-09 22:51:51 -08:00
dan
f105b3e43f [svn] Changed my address from dan-wget@dilvish.speed.net to wget@harkless.org 
everywhere -- dilvish will probably be going away soon.
 2000-12-31 03:18:37 -08:00
hniksic
5099ec0306 [svn] Apply lint-expired fixes from <sxsn1du7ufa.fsf@florida.arsdigita.de>. 2000-12-17 10:52:52 -08:00
hniksic
2e8fc46b7b [svn] Include <netdb.h> where h_errno is used. Likewise for <errno.h> and errno. 
From <sxsvgsi7wcw.fsf@florida.arsdigita.de>.
 2000-12-17 10:12:02 -08:00
hniksic
d5cd691b12 [svn] Fix -O timestamp bug. 
From <sxs7l57u6o6.fsf@florida.arsdigita.de>.
 2000-12-10 16:47:44 -08:00
hniksic
62994ffc8c [svn] Applied Karl Eichwalder's patch from 
<20001124044348.AF524DD15E@tux.gnu.franken.de>.
 2000-11-24 05:51:36 -08:00
hniksic
1cddc05edb [svn] Committed memory debugging stuff. 
Published in <sxs1yw34pt4.fsf@florida.arsdigita.de>.
 2000-11-22 14:15:45 -08:00
hniksic
2ffb47eabf [svn] Committed <sxsbsv854j9.fsf@florida.arsdigita.de>. 2000-11-22 08:58:28 -08:00
hniksic
f2f77d87fd [svn] New option --no-http-keep-alive. 
Published in <sxsd7fr1pdf.fsf@florida.arsdigita.de>.
 2000-11-19 16:04:06 -08:00
hniksic
b0b1c815c1 [svn] A bunch of new features: 
- use mmap() to read whole files in core instead of allocating memory
  and read'ing it.

- use a new, more general, HTML parser (html-parse.c) and interface to
  it from Wget (html-url.c).

- respect <meta name=robots content=nofollow> (easy with the new HTML
  parser).

- use hash tables instead of linked lists in places where the lists
  were used to facilitate mappings.

- rewrite the code in host.c to be more readable and faster (hash
  tables instead of home-grown lists.)

- make convert_links properly convert partial URLs to complete ones
  for those URLs that have *not* been downloaded.

- use HTTP persistent connections where available.  very
  simple-minded, caches the last connection to the server.

Published in <sxshf533d5r.fsf@florida.arsdigita.de>.
 2000-11-19 12:50:10 -08:00
hniksic
eef4a668b7 [svn] Update copyright blurbs with the year 2000. 2000-11-01 17:50:03 -08:00
hniksic
b7a8c6d3f5 [svn] Gracefully handle opt.downloaded overflowing. 
Published in <sxsd7gfnv17.fsf@florida.arsdigita.de>.
 2000-11-01 15:17:31 -08:00
hniksic
29cdc8da20 [svn] Updated long_to_string(); enhanced opt.downloaded to use 
64-bit types where available.
Published in <sxswvenqsmn.fsf@florida.arsdigita.de> and
<sxssnpbqshp.fsf@florida.arsdigita.de>.
 2000-11-01 13:51:25 -08:00
dan
1396b30055 [svn] Manually applied Rob Mayoff <mayoff@dqd.com>'s patch (vs. 1.5.3, not 1.5.3+dev) 
to add --bind-address, making many necessary alphabetization, coding style,
comment, documentation, and naming fixes and additions.
 2000-10-23 23:19:17 -07:00
dan
2fbb4936a0 [svn] main.c (print_help): Clarified that --delete-after deletes local files. 2000-10-23 20:52:34 -07:00