Gijs van Tulder
e3820953b2
Add support for WARC files.
2011-11-04 22:25:00 +01:00
Giuseppe Scrivano
2f6aa1d741
mass change: update copyright years.
2011-01-01 13:19:37 +01:00
Giuseppe Scrivano
293008f682
Mass update copyright years.
2010-05-08 21:56:15 +02:00
Giuseppe Scrivano
1cee086162
Support HTTP/1.1.
2010-05-01 22:34:11 +02:00
Steven Schubiger
a801efcd96
Don't delete an input file fetched via FTP.
2010-03-04 22:09:31 +01:00
Steven Schubiger
c770bdc149
Declare set_local_file().
2009-09-05 20:41:19 +02:00
Micah Cowan
b9e9ad65cc
Ran update-copyright.
2009-09-04 00:13:47 -07:00
Micah Cowan
b014f8fae9
Improved exit status handling.
2009-08-27 23:08:58 -07:00
Micah Cowan
5daac18e96
Adjust some typos from vms merge, and remove some elements we don't want to include without further consideration first.
2009-07-04 18:42:59 -07:00
Micah Cowan
d5e283b1a7
Automated merge.
2009-07-04 15:32:57 -07:00
Micah Cowan
4f3dd68173
Merge with mainline.
2009-06-25 01:14:11 -07:00
gerel
ea3745e8dc
removed some more calls
2009-02-01 15:03:51 -03:00
Saint Xavier
d82f80ecab
Change global variable model for state-object
2008-07-24 00:56:29 +02:00
Micah Cowan
714ccdcd84
Steven Schweda's VMS patch.
2008-04-22 14:48:36 -07:00
Micah Cowan
bc8f473272
Updated copyright year.
2008-01-25 05:04:01 -08:00
Micah Cowan
86395b297b
Updated licensing exception for OpenSSL from the SFLC.
2007-11-28 00:05:33 -08:00
Micah Cowan
5dd09d9ba5
Update copyright lists, conforming to maintainer guidelines
2007-09-28 15:45:31 -07:00
micah
4d7c5e087b
[svn] Merge of fix for bugs 20341 and 20410.
2007-07-09 22:53:22 -07:00
hniksic
3f51773542
[svn] Fixed problem with recursive FTP retrieval.
2006-11-21 14:18:12 -08:00
mtortonesi
1c7493b83e
[svn] Added sanity checks for -k, -p, -r and -N when -O is given. Added fixes for 64-bit platforms. Updated copyright and maintainer information.
2006-07-14 06:25:50 -07:00
mtortonesi
01093c0c33
[svn] Fixed recursive spider mode.
2006-05-25 09:11:29 -07:00
hniksic
db9de5b075
[svn] Update FSF's address and copyright years.
2005-07-01 19:26:52 -07:00
hniksic
f238f09492
[svn] Minor improvements to fd_read_hunk.
2005-07-01 16:37:50 -07:00
hniksic
2447fb9a9b
[svn] Move extern declarations to .h files.
2005-06-27 11:19:22 -07:00
hniksic
319f52d756
[svn] When the download is finished, print the time the download took.
...
Always invoke SIZE, not only when continuing the download.
2005-06-25 17:41:09 -07:00
hniksic
74fbb03b10
[svn] Use bool type for boolean variables and values.
2005-06-22 12:38:10 -07:00
hniksic
277e840a0f
[svn] Remove K&R support.
2005-06-19 15:34:58 -07:00
hniksic
7c044778bc
[svn] Improve built-in memory debugger.
2005-03-20 07:07:40 -08:00
hniksic
72ce32e8ab
[svn] Limit the maximum amount of memory allocated by fd_read_hunk and its
...
callers. Don't allocate more than 64k bytes on headers; don't allocate
more than 4k bytes on a single line.
2005-03-19 09:35:15 -08:00
hniksic
ef22bf610a
[svn] Large file support added. Published in <87psyr6jn7.fsf@xemacs.org>.
2005-02-23 14:21:04 -08:00
hniksic
a8155e7bcc
[svn] Correctly calculate bandwidth as total data read divided with download
...
time.
2003-12-05 18:32:57 -08:00
hniksic
78706dc5ea
[svn] * retr.c (fd_read_body): Report the amount of data *written* as
...
amount_read. This is not entirely logical, but that's what the
callers expect, and it's not easy to change.
* ftp.c (ftp_loop_internal): Ditto.
* http.c (http_loop): Be smarter about assigning restval; if we're
in the nth pass of a download, simply use the information we have
about how much data has been retrieved as restval.
* ftp.c (getftp): Ditto for FTP "REST" command.
* http.c (gethttp): When the server doesn't respect range, skip
the first RESTVAL bytes of the read body. Never truncate the
output file.
* retr.c (fd_read_body): Support skipping initial STARTPOS octets.
2003-11-30 15:39:04 -08:00
hniksic
2f357b5eb8
[svn] Better documentation for fd_read_body args.
2003-11-29 20:41:08 -08:00
hniksic
dfe1f43dc0
[svn] Use fd_read_hunk for reading HTTP response head. Support HTTP/0.9
...
responses.
2003-11-27 15:29:36 -08:00
hniksic
d9fea91a0a
[svn] Remove the "rbuf" buffering layer. Provide peeking primitives instead.
2003-11-20 17:48:11 -08:00
hniksic
711bf72609
[svn] Remove VERY_LONG_TYPE; use LARGE_INT instead. Remove special code
...
for handling VERY_LONG_TYPE overflows.
Make opt.quota a LARGE_INT.
2003-10-11 06:57:11 -07:00
hniksic
95c647eb44
[svn] Split off non-URL related stuff from url.c to convert.c.
2003-09-21 15:47:14 -07:00
hniksic
9228f0bf53
[svn] Update progress code to use higher timer resolution.
...
Message-ID: <m37k49oivp.fsf@hniksic.iskon.hr>
2003-09-15 14:14:15 -07:00
hniksic
b2be7522c7
[svn] Update the license to include the OpenSSL exception.
2002-05-17 19:16:36 -07:00
hniksic
84396de673
[svn] Allocate a timer directly in get_contents.
...
Published in <sxsherhbsvl.fsf@florida.arsdigita.de>.
2001-11-26 04:49:10 -08:00
hniksic
05463c7121
[svn] Commit progress bar tweaks.
...
Published in <sxsd727cvc0.fsf@florida.arsdigita.de>.
2001-11-24 20:46:26 -08:00
hniksic
d5be8ecca4
[svn] Rewrite parsing and handling of URLs.
...
Published in <sxs4rnnlklo.fsf@florida.arsdigita.de>.
2001-11-21 16:24:28 -08:00
hniksic
0b056d1720
[svn] Update copyright notices.
2001-05-27 12:35:15 -07:00
hniksic
45eea7387f
[svn] New timer functions. Published in <sxs8zkp28vk.fsf@florida.arsdigita.de>.
2001-04-24 16:09:45 -07:00
hniksic
366b832e3f
[svn] Applied Jonas Jensen's download rate patch with my additions.
...
Published in <015b01c09084$ce2d9330$0100000a@bob> and
<sxspugq3xai.fsf@florida.arsdigita.de>.
2001-02-10 16:00:30 -08:00
hniksic
b0e9dfd4e2
[svn] Fix opt.wait.
2000-12-05 16:24:40 -08:00
hniksic
b0b1c815c1
[svn] A bunch of new features:
...
- use mmap() to read whole files in core instead of allocating memory
and read'ing it.
- use a new, more general, HTML parser (html-parse.c) and interface to
it from Wget (html-url.c).
- respect <meta name=robots content=nofollow> (easy with the new HTML
parser).
- use hash tables instead of linked lists in places where the lists
were used to facilitate mappings.
- rewrite the code in host.c to be more readable and faster (hash
tables instead of home-grown lists.)
- make convert_links properly convert partial URLs to complete ones
for those URLs that have *not* been downloaded.
- use HTTP persistent connections where available. very
simple-minded, caches the last connection to the server.
Published in <sxshf533d5r.fsf@florida.arsdigita.de>.
2000-11-19 12:50:10 -08:00
hniksic
b7a8c6d3f5
[svn] Gracefully handle opt.downloaded overflowing.
...
Published in <sxsd7gfnv17.fsf@florida.arsdigita.de>.
2000-11-01 15:17:31 -08:00
kwget
31d6616c48
[svn] Initial revision
1999-12-01 23:42:23 -08:00
