1
0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Commit Graph

282 Commits

Author SHA1 Message Date
hniksic
556b2cf861 [svn] Update the documentation on RES.
Published in <sxssn5mvsnk.fsf@florida.munich.redhat.com>.
2002-04-23 17:37:39 -07:00
hniksic
b9210ecbc8 [svn] Correctly document that the bar display is the default one. 2002-04-15 14:54:33 -07:00
hniksic
f0c20666da [svn] Document `--limit-rate'.
Published in <sxszo07w76u.fsf@florida.arsdigita.de>.
2002-04-13 15:44:16 -07:00
hniksic
08bee01a23 [svn] Warn against specifying passwords on the command line.
Published in <sxsu1qjp6y2.fsf@florida.arsdigita.de>.
2002-04-10 14:42:16 -07:00
hniksic
5f63b4f873 [svn] Undocument simple_host_check. 2001-12-16 10:05:34 -08:00
hniksic
3b44ca73ab [svn] Fix the broken URLs that pointed to info.webcrawler.com to point to
the new www.robotstxt.org site.
2001-12-12 23:29:05 -08:00
hniksic
5eb068a46a [svn] Explain how to get the cookie file from IE. 2001-12-11 00:15:11 -08:00
hniksic
1f1f302bb0 [svn] Handle @asis in table. 2001-12-11 00:11:39 -08:00
hniksic
fdd51b8d46 [svn] Bump version to 1.8. 2001-12-08 17:37:17 -08:00
hniksic
75fcce81a4 [svn] More documentation for --load-cookies. 2001-12-08 12:14:00 -08:00
hniksic
5379abeee0 [svn] Examples section of the documentation revamped.
Include EXAMPLES in the man page.
2001-12-07 22:47:48 -08:00
hniksic
a244a67bc3 [svn] Doc update.
Published in <sxsy9kny8e1.fsf@florida.arsdigita.de>.
2001-11-30 18:36:21 -08:00
hniksic
0f56f4056a [svn] Document ftp_proxy in sample.wgetrc.
Submitted by Ingo T. Storm in <026a01c17913$acfac660$7400a8c0@dukat.cb.de>.
2001-11-29 23:32:17 -08:00
hniksic
2c41d783c6 [svn] New option --random-wait.
Submitted by Alan Eldridge in
<200111042106.fA4L63b75804@wwweasel.geeksrus.net>.
2001-11-25 13:23:15 -08:00
hniksic
dc3f406061 [svn] Download the new `--progress' option. 2001-11-23 09:04:26 -08:00
hniksic
08ebc7576e [svn] Small doc fixes.
Published in <sxsy9kzk4qb.fsf@florida.arsdigita.de>.
2001-11-21 16:52:19 -08:00
hniksic
4f5a898a66 [svn] Fix installation of info files.
Published in <sxslmh6i9me.fsf@florida.arsdigita.de>.
2001-11-16 15:23:22 -08:00
hniksic
dc0070ca2d [svn] Apply Peter Farmer's changes from <3BD110CB.61EBED92@zveno.com>. 2001-11-16 09:19:47 -08:00
hniksic
006e936b9e [svn] Upgrade version to 1.7.1. 2001-06-16 06:10:34 -07:00
hniksic
468778c895 [svn] Make `make install' non-interactive.
Published in <20010611201545.A9740@adam.yggdrasil.com>.
2001-06-15 11:36:31 -07:00
hniksic
9b7f6ff41d [svn] Take DESTDIR into account when creating directory for wgetrc. 2001-06-15 06:31:56 -07:00
janp
4f9affe92e [svn] Changes for builddir != srcdir. 2001-06-05 14:43:14 -07:00
hniksic
7416812ad1 [svn] Updated version to 1.7. 2001-06-04 04:23:23 -07:00
hniksic
87dbcfdb4b [svn] Fix mailing list address. 2001-05-31 07:00:55 -07:00
hniksic
4213dc9b2b [svn] Clarify; link to "free-software-for-freedom.html". 2001-05-27 14:43:28 -07:00
hniksic
1f4b5402c3 [svn] Update list of contributors.
Published in <sxsofsemvua.fsf@florida.arsdigita.de>.
2001-05-27 12:33:34 -07:00
hniksic
6b405f2b66 [svn] Commit administrative changes in preparation for the 1.7
prerelease.
Published in <sxsd78wwiwj.fsf@florida.arsdigita.de>.
2001-05-26 02:38:24 -07:00
hniksic
0ea6f28018 [svn] Document new behavior of -c.
Published in <sxs7l028zee.fsf@florida.arsdigita.de>.
2001-04-30 03:19:30 -07:00
hniksic
55c0317e53 [svn] Document cookie-related options.
Published in <sxs8zkmnaec.fsf@florida.arsdigita.de>.
2001-04-26 23:08:23 -07:00
hniksic
83fe8f3597 [svn] "Support DESTDIR when installing.
Patch courtesy Karl Eichwalder.
Published in <sxs4rvu2tmu.fsf@florida.arsdigita.de>.
2001-04-12 05:25:22 -07:00
hniksic
b4394a057b [svn] Fix documentation of --convert-links. Published in
<sxs4rw9jq63.fsf@florida.arsdigita.de>.
2001-03-31 18:54:31 -08:00
dan
f486b43c23 [svn] * {.,doc,src,util,windows}/Makefile.in: Moved top_builddir out of "User
configuration section" of top Makefile and analogous spot in others.

* po/Makefile.in.in: Previous addition of top_builddir to
  po/Makefile.in was bogus -- it's generated from po/Makefile.in.in.
2001-03-27 03:23:59 -08:00
dan
c33a1f97fe [svn] TODO: -p should probably go "_two_ more hops" on <FRAMESET> pages.
wget.texi (Recursive Retrieval Options): Explained that you need
to use -r -l1 -p to get the two levels of requisites for a
<FRAMESET> page.  Also made a few other wording improvements.
2001-03-26 19:22:17 -08:00
dan
d41af5f52e [svn] Linking with OpenSSL previously required the user to set up all the
appropriate -I, -L, and -R/-rpath flags in environment variables,
manually.  Automated everything, including bundling libtool so we can
successfully link with the OpenSSL shared libraries on just about any
platform.
2001-03-17 06:21:19 -08:00
dan
9d673c1da2 [svn] Makefile.in: Using '^' in the sed call caused a weird failure on Solaris 2.6.
Changed it to a ','.
2001-03-17 02:19:46 -08:00
dan
9e94eb26ef [svn] wget.texi: Mentioned that .listing symlinked to /etc/passwd is not a security
hole, but that other files could be, so root shouldn't run wget in user dirs.
2001-02-23 14:49:42 -08:00
dan
b6febbc84b [svn] * po/*.po*: Updated after moving -nr to a different category.
* wget.texi: Moved -nr from "Recursive Retrieval Options" to "FTP Options" and
  gave it a @cindex entry. Alphabetized FTP options by long option name.

* main.c (print_help): -nr belongs in "FTP options" section of --help output,
  not "Recursive retrieval" section.  Alphabetized FTP options by long option
  name.
2001-02-23 13:31:54 -08:00
dan
9f71ad5f81 [svn] Oops, _all_ those fixes were to the time-stamping documentation. 2001-02-23 12:21:20 -08:00
dan
a09ac9ea6c [svn] wget.texi: Corrections, clarifications, and English fixes to time-stamping
documentation and a couple other places.
2001-02-23 12:16:07 -08:00
dan
776d65e829 [svn] * configure.in: Look for perl and pod2man and make substitutions.
* Makefile.in (install): Do install.man if we have pod2man.

* Makefile.in: Make wget man page and install it if we have pod2man.  Added some
  missing '$(srcdir)/'s.  Added missing dependencies on install targets
  (allowing you to just do `make install' rather than forcing you to do `make &&
  make install').  Also, Makefile rules should always use output file parameters
  if available rather than redirecting stdout with '>', or you falsely satisfy
  dependencies if the tool you're running is missing or fails -- fixed call of
  texi2pod.pl that did this wrong.

* texi2pod.pl: Removed from CVS.  Now automatically generated.

* texi2pod.pl.in: This new file is processed into texi2pod.pl, getting the
  appropriate path to the Perl 5+ executable on this system and becoming
  executable (CVS files, by contrast, don't arrive executable).
2001-02-22 18:09:36 -08:00
dan
c9471c3b38 [svn] wget.texi (Download Options): Further improvement to --continue documentation --
explain interaction with -r and -N, mention usefulness for downloading new
sections of appended-to files, etc.
2001-02-19 15:22:48 -08:00
hniksic
18d476b8d0 [svn] Applied doc fixes from Jan's "realclean patch". The doc fixes
include the new texi2pod generator for creating the man page out
of Texinfo docs.
Published in <20010106184340.A14968@erwin.telekabel.at>.
2001-02-10 16:22:42 -08:00
dan
f84a94e913 [svn] Made clarifications and corrections to --continue's --help output and wget.texi
documentation.  Published in <200101100629.WAA09744@dilvish.speed.net>.
2001-01-09 22:51:51 -08:00
dan
cbe2ca1b80 [svn] Here're the changes we agreed to on the wget mailing list regarding the
multiple-branches ChangeLog problem.  Note the new directories -- you'll need to
do a cvs update -d.
2001-01-06 01:26:02 -08:00
dan
67bfa88fd8 [svn] ChangeLog: Since this flat file doesn't have multiple branches,
looking at the dates would make you think that things went into
1.6 that actually just went into the 1.7-dev branch.  Added "[Not
in 1.6 branch.]" where appropriate to clarify.
2000-12-31 04:45:42 -08:00
dan
25fc74cf86 [svn] Need to write the ChangeLog in such a way that it looks like the 1.6 changes
went in on the correct date.
2000-12-31 04:07:25 -08:00
dan
e8905e2e87 [svn] Makefile.in (distclean): sample.wgetrc.munged_for_texi_inclusion needs to be
included in the distribution or it'll get regenerated due to the wget.info
dependency, and then that file will get regenerated, forcing people to have
makeinfo installed unnecessarily.  We could use a kludge of a 0-length file in
the distro, but the file isn't that big and should compress very well.

wget.texi: Changed "VERSION 1.5.3+dev" to "VERSION 1.7-dev" and "UPDATED Feb
2000" to "UPDATED Dec 2000".  Like the comment in the file says, it'd be nice if
these were handled automatically...
2000-12-31 03:50:52 -08:00
dan
f105b3e43f [svn] Changed my address from dan-wget@dilvish.speed.net to wget@harkless.org
everywhere -- dilvish will probably be going away soon.
2000-12-31 03:18:37 -08:00
hniksic
0db59ca6f6 [svn] Makefile.in fix from <sxshf4dvv29.fsf@florida.arsdigita.de>. 2000-12-09 19:03:14 -08:00
hniksic
b0b1c815c1 [svn] A bunch of new features:
- use mmap() to read whole files in core instead of allocating memory
  and read'ing it.

- use a new, more general, HTML parser (html-parse.c) and interface to
  it from Wget (html-url.c).

- respect <meta name=robots content=nofollow> (easy with the new HTML
  parser).

- use hash tables instead of linked lists in places where the lists
  were used to facilitate mappings.

- rewrite the code in host.c to be more readable and faster (hash
  tables instead of home-grown lists.)

- make convert_links properly convert partial URLs to complete ones
  for those URLs that have *not* been downloaded.

- use HTTP persistent connections where available.  very
  simple-minded, caches the last connection to the server.

Published in <sxshf533d5r.fsf@florida.arsdigita.de>.
2000-11-19 12:50:10 -08:00
hniksic
06825343f1 [svn] Doc tweaks.
Published by me in <sxs8zqkayf2.fsf@florida.arsdigita.de>.
2000-11-16 04:35:27 -08:00
hniksic
1a5c5a006a [svn] Robots doc changes.
Published at <sxsn1f1o6s2.fsf@florida.arsdigita.de>.
2000-11-15 02:44:18 -08:00
hniksic
d889ef73f4 [svn] Introduce GFDL; remove warnings.
Published at <sxsaeb2qigu.fsf@florida.arsdigita.de>.
2000-11-14 14:49:07 -08:00
hniksic
cc7b24c138 [svn] cc.fer.hr -> srk.fer.hr 2000-11-10 06:47:30 -08:00
hniksic
4960a155c4 [svn] Minor fixes: use $(srcdir) in sample.wgetrc.munged_for_texi_inclusion;
added names of many contributors.
2000-11-04 23:06:41 -08:00
hniksic
6a5009aee8 [svn] Added more contributors to the contributors section. 2000-11-04 20:56:11 -08:00
dan
e7fb0946fa [svn] Forgot to mention that I documented Rob's new bind_address command in the Wgetrc
Commands section as well.
2000-10-24 15:39:18 -07:00
hniksic
2aa950f52d [svn] *** empty log message *** 2000-10-24 02:14:40 -07:00
dan
1396b30055 [svn] Manually applied Rob Mayoff <mayoff@dqd.com>'s patch (vs. 1.5.3, not 1.5.3+dev)
to add --bind-address, making many necessary alphabetization, coding style,
comment, documentation, and naming fixes and additions.
2000-10-23 23:19:17 -07:00
dan
f4673bcdaf [svn] --delete-after wasn't implemented for files retrieved by FTP or corresponding to
files specified on the commandline.  Made --convert-links be ignored when
--delete-after is specified.  Added note about this fact to --delete-after docs
and made general improvements to them, including the clarification that
--delete-after only deletes local files.
2000-10-23 20:43:47 -07:00
dan
5781c8b006 [svn] Include -E on my preferred commandline for downloading a single page and
requisites and making sure it displays properly locally.
2000-10-20 16:06:45 -07:00
dan
8cf52e0dd3 [svn] Applied John Daily <jdaily@cyberdude.com>'s patch for his "quad" commands (which
I renamed to "lockable_boolean") in the .wgetrc (currently just passive_ftp).
Wrote documentation for his changes and added the missing "referer" to the
.wgetrc section (making mention of the issue of "referrer" being the correct
spelling).
2000-10-19 23:59:30 -07:00
dan
b3e2c0ff97 [svn] Implemented and documented new -E / --html-extension / html_extension option. 2000-10-19 22:55:46 -07:00
dan
cbf018d0c0 [svn] --retr-symlinks was not previously documented properly. Based on my newfound
understanding of what its limitations are, added a TODO item.  Also made a minor
tweak in html.c to silence a warning.
2000-10-09 15:43:11 -07:00
dan
7931200609 [svn] * *.{gmo,po,pot}: Regenerated after modifying wget --help output.
* ftp.c (ftp_retrieve_list): Use new INFINITE_RECURSION #define.

* html.c: htmlfindurl() now takes final `dash_p_leaf_HTML' parameter.
Wrapped some > 80-column lines.  When -p is specified and we're at a
leaf node, do not traverse <A>, <AREA>, or <LINK> tags other than
<LINK REL="stylesheet">.

* html.h (htmlfindurl): Now takes final `dash_p_leaf_HTML' parameter.

* init.c: Added new -p / --page-requisites / page_requisites option.

* main.c (print_help): Clarified that -l inf and -l 0 both allow
infinite recursion.  Changed the unhelpful --mirrior description
to simply give the options it's equivalent to.  Added new -p option.
(main): Added some comments; handle new -p / --page-requisites.

* options.h (struct options): Added new page_requisites field.

* recur.c: Changed "URL-s" to "URLs" and "HTML-s" to "HTMLs".
Calculate and pass down new `dash_p_leaf_HTML' parameter to
get_urls_html().  Use new INFINITE_RECURSION #define.

* retr.c: Changed "URL-s" to "URLs".  get_urls_html() now takes
final `dash_p_leaf_HTML' parameter.

* url.c: get_urls_html() and htmlfindurl() now take final
`dash_p_leaf_HTML' parameter.

* url.h (get_urls_html): Now takes final `dash_p_leaf_HTML' parameter.

* wget.h: Added some comments and new INFINITE_RECURSION #define.

* wget.texi (Recursive Retrieval Options): Documented new -p option.
2000-08-30 04:26:21 -07:00
dan
f4fcbd194b [svn] * wget.texi (Logging and Input File Options): -B / --base was not documented as
a separate item, and the .wgetrc version was misleading.

* wget.texi (Wgetrc Commands): Changed all instances of ", the same as" to the
  more grammatical " -- the same as".
2000-08-23 15:41:21 -07:00
dan
f21839b197 [svn] * wget.texi (Download Options): Using -c on a file that's already fully
downloaded results in an unchanged file and no second ".1" copy.
2000-08-23 14:36:31 -07:00
dan
28668d2875 [svn] * wget.texi (Download Options): --no-clobber's documentation was
severely lacking -- ameliorated the situation.  Some of the
previously-undocumented stuff (like the multiple-file-version numeric-suffixing)
that's now mentioned for the first (and only) time in the -nc documentation
should probably be mentioned elsewhere, but due to the way that wget.texi's
hierarchy is laid out, I had a hard time finding anywhere else appropriate.
2000-08-22 20:04:20 -07:00
dan
cf1e1c68de [svn] wget.texi (HTTP Options): Minor clarification in "download a single HTML page
and all files necessary to display it" example.
2000-07-17 17:19:47 -07:00
dan
b05feb3ae2 [svn] Damir Dzeko <ddzeko@zesoi.fer.hr> did not document his new --referer option.
Did so (--help output and wget.texi).  Also tweaked --help output for --execute.
2000-05-22 19:29:38 -07:00
dan
b27657dd51 [svn] Realized this morning in the shower that I put the (uncommented) waitretry
setting in the local section, which is prefaced by a comment saying that stuff
in there shouldn't be set in the global file.  Moved the setting to the global
section.
2000-04-18 19:09:28 -07:00
dan
0a8054755c [svn] * Makefile.in (sample.wgetrc.munged_for_texi_inclusion): Added build,
dependencies, and distclean cleanup of this new file.

* sample.wgetrc: Uncommented waitretry and set it to 10, clarified some wording,
  and re-wrapped some text to 71 columns due to @sample indentation in
  wget.texi.

* wget.texi: Herold further expounded on the behavior of waitretry -- reworded
  docs again.  Changed note saying _all_ lines in sample.wgetrc are commented
  out.  Don't have an entire hand- cut-and-pasted copy of sample.wgetrc in this
  file -- use @include.
2000-04-13 12:37:52 -07:00
dan
367f3b15d7 [svn] Makefile (install.wgetrc): I completely missed the message that the new wgetrc
wasn't being installed the first couple of times I ran `make install' after
changing sample.wgetrc.  Added blank lines around the message and a "<Hit RETURN
to acknowledge>", and reworded the message to be a bit more clear.
2000-04-12 21:37:51 -07:00
dan
b89e043ade [svn] D'oh! Forgot to change the month to 04. 2000-04-12 18:44:43 -07:00
dan
63fecba717 [svn] * sample.wgetrc: Added entries for backup_converted and waitretry.
* wget.texi (waitretry): Herold Heiko <Heiko.Herold@previnet.it>'s
new option was undocumented until now.  Reworded the suggested documentation he
sent to the list.
2000-04-12 18:42:34 -07:00
dan
4454f6ce0a [svn] * TODO: Removed done item: we now have an option (-G) that makes it easy to
download a single HTML document and all its constituents.

* po/*.{gmo,po,pot}: Regenerated after adding new options.

* po/hr.po: Hrvoje forgot '\n's on his translations of my altered messages,
causing msgfmt to balk and `make install' to fail.


* wget.texi (Recursive Retrieval Options): In -K description, added a link to
the discussion of interaction with -N.
(Recursive Accept/Reject Options): Did some alphabetizing and added descriptions
of new --follow-tags and -G / --ignore-tags options.
(Following Links): Changed "the loads of" to "loads of".
(Wgetrc Commands): Added descriptions of new follow_tags and ignore_tags
commands.


* html.c (idmatch): Implemented checking of my new --follow-tags and
--ignore-tags options.

* init.c (commands): Added comment reminding people adding new entries doing
allocation to add corresponding freeing in cleanup().
(commands): Added new followtags and ignoretags commands.
(cleanup): Free storage for new followtags and ignoretags.

* main.c: Use of "comma-separated list" was random -- normalized it.  Did some
alphabetization.  Added comments pointing out "Options without arguments" and
"Options accepting an argument" sections of long_options[].  Added new options
--follow-tags and -G / --ignore-tags.  Added comment that Damir's --referer is
currently undocumented.  Added comment that Heiko's --waitretry is partially
undocumented (mentioned in --help but not in wget.texi).  Moved improperly
sorted 24, 129, and 'G' cases.

* options.h (struct options): Added new fields follow_tags and ignore_tags.

* wget.h: Added "#define EQ 0" so we can say "strcmp(a, b) == EQ".
2000-03-10 22:48:06 -08:00
hniksic
18959ba4ab [svn] Spelling fixes. 2000-03-02 05:44:56 -08:00
hniksic
a8622f4462 [svn] Update. 2000-03-02 05:36:47 -08:00
dan
fce9edf954 [svn] Added a note about my newly-implemented interaction between -K and -N. 2000-03-01 23:06:10 -08:00
dan
e0a58713f7 [svn] Upped version number from 1.5.3. to 1.5.3+dev. Because the development source
is available via anonymous CVS and desirable features are being added, it's
quite possible for end-users to be getting their hands on development versions.
They may report bugs, so if we don't change the version number, we'll have to
continually followup the statement "I'm using version 1.5.3" with the question
"The FTP archive or the CVS source?"  Better to just make this development
version have a unique number.  Once we're ready to actually release the next
version, we can up the version from 1.5.3+dev to 1.5.4, or 1.6, or whatever it
turns out to be (depending on how much development gets done).

Also made minor updates (dates, email addresses) to wget.texi.
2000-02-29 16:50:52 -08:00
dan
e5408e7db8 [svn] Implemented new -K / --backup-converted / backup_converted = on option. 2000-02-29 16:17:23 -08:00
kwget
31d6616c48 [svn] Initial revision 1999-12-01 23:42:23 -08:00