1
0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Commit Graph

2101 Commits

Author SHA1 Message Date
hniksic
b0b1c815c1 [svn] A bunch of new features:
- use mmap() to read whole files in core instead of allocating memory
  and read'ing it.

- use a new, more general, HTML parser (html-parse.c) and interface to
  it from Wget (html-url.c).

- respect <meta name=robots content=nofollow> (easy with the new HTML
  parser).

- use hash tables instead of linked lists in places where the lists
  were used to facilitate mappings.

- rewrite the code in host.c to be more readable and faster (hash
  tables instead of home-grown lists.)

- make convert_links properly convert partial URLs to complete ones
  for those URLs that have *not* been downloaded.

- use HTTP persistent connections where available.  very
  simple-minded, caches the last connection to the server.

Published in <sxshf533d5r.fsf@florida.arsdigita.de>.
2000-11-19 12:50:10 -08:00
hniksic
ccf31643ab [svn] vsnprintf() fixup. 2000-11-16 08:37:49 -08:00
hniksic
69cb9be79c [svn] *** empty log message *** 2000-11-16 08:29:46 -08:00
hniksic
06825343f1 [svn] Doc tweaks.
Published by me in <sxs8zqkayf2.fsf@florida.arsdigita.de>.
2000-11-16 04:35:27 -08:00
hniksic
8c20fc19c3 [svn] Updated by Const Kaplinsky. 2000-11-16 03:45:23 -08:00
hniksic
2097b8beaf [svn] Compile in vsnprintf.c under Windows.
Published by Herold Heiko in
<412FC0AFD62ED31191B40008C7E9A11A2AABF0@srvnt04.previnet.it>.
2000-11-16 01:52:45 -08:00
hniksic
cc3b6eb3e4 [svn] Do the _XOPEN_SOURCE/_SVID_SOURCE things only on Linux. 2000-11-15 10:10:01 -08:00
hniksic
1a5c5a006a [svn] Robots doc changes.
Published at <sxsn1f1o6s2.fsf@florida.arsdigita.de>.
2000-11-15 02:44:18 -08:00
hniksic
d889ef73f4 [svn] Introduce GFDL; remove warnings.
Published at <sxsaeb2qigu.fsf@florida.arsdigita.de>.
2000-11-14 14:49:07 -08:00
hniksic
fa90bec240 [svn] One more todo item. 2000-11-14 14:45:43 -08:00
hniksic
3e9e52f19a [svn] Remove "debug" comment. 2000-11-12 16:48:19 -08:00
hniksic
6a70f04a5c [svn] Don't clutter the host list with duplicate hosts.
Published in <sxsitpt56eh.fsf@florida.arsdigita.de>.
2000-11-12 16:46:13 -08:00
hniksic
e1f1c1ff40 [svn] Better version of read_whole_line().
Published in <sxsr94jd7z4.fsf@florida.arsdigita.de>.
2000-11-10 10:01:35 -08:00
hniksic
e18ca280fb [svn] Fix off-by-one error in comind().
Published in <sxsvgtvdcki.fsf@florida.arsdigita.de>.
2000-11-10 08:20:55 -08:00
hniksic
cc7b24c138 [svn] cc.fer.hr -> srk.fer.hr 2000-11-10 06:47:30 -08:00
hniksic
81ac9c3133 [svn] Mentioned CVS. 2000-11-09 01:18:36 -08:00
hniksic
fa8ded0134 [svn] Beautify... 2000-11-08 09:11:25 -08:00
hniksic
f306ae9626 [svn] Changed last_slash[-1] to *(last_slash - 1). 2000-11-08 07:51:28 -08:00
hniksic
b72b6cf387 [svn] Correctly handle URLs where / does not follow the host name.
Published in <sxsn1fag6zu.fsf@florida.arsdigita.de>.
2000-11-08 01:15:40 -08:00
hniksic
34ea31bb01 [svn] Sort commands[]. 2000-11-07 03:43:36 -08:00
hniksic
2d3efb50d0 [svn] Update. 2000-11-07 03:40:59 -08:00
hniksic
0e2b74ce3b [svn] Commit "minor fixes". 2000-11-06 13:24:57 -08:00
hniksic
e006b1628b [svn] Update. 2000-11-06 02:57:45 -08:00
hniksic
37978d75e7 [svn] New file. 2000-11-06 02:56:49 -08:00
hniksic
bfca6f02b4 [svn] Spelling fixlet. 2000-11-06 02:16:37 -08:00
hniksic
ac96041552 [svn] As of recently, path simplification does stop at '?'. 2000-11-06 02:03:57 -08:00
hniksic
0102833a13 [svn] Committed modified .po files due to modification to .pot. 2000-11-04 23:12:18 -08:00
hniksic
4960a155c4 [svn] Minor fixes: use $(srcdir) in sample.wgetrc.munged_for_texi_inclusion;
added names of many contributors.
2000-11-04 23:06:41 -08:00
hniksic
6a5009aee8 [svn] Added more contributors to the contributors section. 2000-11-04 20:56:11 -08:00
hniksic
366ad1d6d9 [svn] Rewrote the logging code.
Published at <sxs1ywrf300.fsf@florida.arsdigita.de>.
2000-11-04 20:38:31 -08:00
hniksic
c2c821b3c9 [svn] snprintf.c addition. 2000-11-04 14:49:46 -08:00
hniksic
eef4a668b7 [svn] Update copyright blurbs with the year 2000. 2000-11-01 17:50:03 -08:00
hniksic
6e23da9254 [svn] Hide password from URL when non-verbose, too. 2000-11-01 17:41:20 -08:00
hniksic
c6575c6382 [svn] Another contributed fix... 2000-11-01 17:06:57 -08:00
hniksic
6eb0870af0 [svn] Contributed fix. 2000-11-01 17:02:56 -08:00
hniksic
268ac1fc7f [svn] Another contributed fix. 2000-11-01 16:21:53 -08:00
hniksic
986c445029 [svn] Fixed minor memory leaks. 2000-11-01 16:18:27 -08:00
hniksic
b3758323ed [svn] Applied contributed fix. 2000-11-01 15:57:19 -08:00
hniksic
88df27b3a5 [svn] Updated prep -> gnu, etc. 2000-11-01 15:46:37 -08:00
hniksic
b7a8c6d3f5 [svn] Gracefully handle opt.downloaded overflowing.
Published in <sxsd7gfnv17.fsf@florida.arsdigita.de>.
2000-11-01 15:17:31 -08:00
hniksic
28293eafd0 [svn] Mention Dan, the web page, and the CVS server. 2000-11-01 13:52:52 -08:00
hniksic
29cdc8da20 [svn] Updated long_to_string(); enhanced opt.downloaded to use
64-bit types where available.
Published in <sxswvenqsmn.fsf@florida.arsdigita.de> and
<sxssnpbqshp.fsf@florida.arsdigita.de>.
2000-11-01 13:51:25 -08:00
hniksic
b9eeb0c54c [svn] Fix "optimization" of query-strings in URLs.
Published in <sxs3dhbwnmw.fsf@florida.arsdigita.de>.
2000-11-01 10:31:53 -08:00
hniksic
30a8557586 [svn] Even newer translations. 2000-10-31 20:47:22 -08:00
hniksic
45d664d1a5 [svn] Newer translations. 2000-10-31 20:38:35 -08:00
hniksic
6d13e17142 [svn] Detect redirection cycles.
Published in <sxsd7ggtjac.fsf@florida.arsdigita.de>.
2000-10-31 20:21:50 -08:00
hniksic
515d82fb95 [svn] Committed my patch from <sxsy9z4xz5m.fsf@florida.arsdigita.de>
(recognize HTML entities.)
2000-10-31 17:25:12 -08:00
hniksic
846b045a69 [svn] Applied my patch from <sxs3dhczfv5.fsf@florida.arsdigita.de>. 2000-10-31 16:38:57 -08:00
hniksic
f6715dd08d [svn] Committed my patch from <sxs7l6ozghz.fsf@florida.arsdigita.de>. 2000-10-31 16:26:33 -08:00
hniksic
0dd418242a [svn] Committed my patches from <sxsbsw16sbu.fsf@florida.arsdigita.de>
and <sxsvgu824xk.fsf@florida.arsdigita.de>.
2000-10-31 11:25:32 -08:00