1
0
mirror of https://github.com/moparisthebest/wget synced 2024-07-03 16:38:41 -04:00
Go to file
Darshit Shah 69c45cba43 Add checks for valid listing file in FTP
When Wget retrieves a file through FTP, it first downloads a .listing
file and parses it for information about the files and other metadata.
Some servers may serve invalid .listing files. This patch checks for one
such known inconsistency wherein multiple lines in a listing file have
the same name. Such a filesystem is clearly not possible and hence we
eliminate duplicate entries here.

Signed-off-by: Darshit Shah <darnir@gmail.com>
2014-10-27 09:18:13 +01:00
build-aux Remove trailing whitespaces 2014-06-12 18:49:14 +02:00
doc CVE-2014-4877: Arbitrary Symlink Access 2014-10-27 09:18:13 +01:00
gnulib@98ca2c063c gnulib: update module 2014-05-24 13:29:19 +02:00
m4 Fix autoconf warning 2012-09-30 17:48:13 +02:00
msdos Remove trailing empty lines 2014-06-12 18:49:15 +02:00
po po/POTFILES.in: add missing file 2014-06-12 18:49:15 +02:00
src Add checks for valid listing file in FTP 2014-10-27 09:18:13 +01:00
testenv Minor optimizations of Python tests 2014-10-23 20:39:25 +02:00
tests fixed IRI misbehaviour(s) 2014-10-20 08:53:12 +02:00
util Replace @VAR@ in Makefile.am files with $VAR 2014-06-12 18:49:15 +02:00
vms Do not depend on always defined macros 2014-06-12 18:49:15 +02:00
.gitignore Switched to parallel test harness 2014-10-01 14:41:32 +05:30
.gitmodules gnulib: add as a git submodule 2013-12-22 14:12:05 +01:00
.x-sc_po_check [mq]: cfg-mk 2009-09-21 20:39:44 -07:00
.x-sc_trailing_blank [mq]: cfg-mk 2009-09-21 20:39:44 -07:00
ABOUT-NLS Remove trailing empty lines 2014-06-12 18:49:15 +02:00
AUTHORS Fix typo. 2010-09-07 18:05:19 +02:00
bootstrap bootstrap: update from gnulib. 2012-09-20 21:11:26 +02:00
bootstrap.conf css-url.c (get_uri_string): Fix regression from 8e6de1fb5 2014-10-22 20:26:28 +02:00
cfg.mk Remove tab-space indentation 2014-06-28 17:53:42 +02:00
ChangeLog css-url.c (get_uri_string): Fix regression from 8e6de1fb5 2014-10-22 20:26:28 +02:00
ChangeLog.README [mq]: cfg-mk 2009-09-21 20:39:44 -07:00
configure.ac Switched to parallel test harness 2014-10-01 14:41:32 +05:30
COPYING Fix copyright year. 2011-05-19 10:34:26 +02:00
MAILING-LIST Remove trailing empty lines 2014-06-12 18:49:15 +02:00
Makefile.am Introducing Python based Test Environment 2014-07-24 16:51:58 +05:30
NEWS Fix a problem with ISA server proxy 2014-06-16 16:39:04 +02:00
README Remove MAINTAINER from the README file. 2010-07-12 13:56:58 +02:00
README.checkout Support libpsl for cookie domain checking 2014-06-05 16:20:34 +05:30

                                                          -*- text -*-
GNU Wget
========
                  Current Web home: http://www.gnu.org/software/wget/

GNU Wget is a free utility for non-interactive download of files from
the Web.  It supports HTTP, HTTPS, and FTP protocols, as well as
retrieval through HTTP proxies.

It can follow links in HTML pages and create local versions of remote
web sites, fully recreating the directory structure of the original
site.  This is sometimes referred to as "recursive downloading."
While doing that, Wget respects the Robot Exclusion Standard
(/robots.txt).  Wget can be instructed to convert the links in
downloaded HTML files to the local files for offline viewing.

Recursive downloading also works with FTP, where Wget can retrieves a
hierarchy of directories and files.

With both HTTP and FTP, Wget can check whether a remote file has
changed on the server since the previous run, and only download the
newer files.

Wget has been designed for robustness over slow or unstable network
connections; if a download fails due to a network problem, it will
keep retrying until the whole file has been retrieved.  If the server
supports regetting, it will instruct the server to continue the
download from where it left off.

If you are behind a firewall that requires the use of a socks style
gateway, you can get the socks library and compile wget with support
for socks.

Most of the features are configurable, either through command-line
options, or via initialization file .wgetrc.  Wget allows you to
install a global startup file (/usr/local/etc/wgetrc by default) for
site settings.

Wget works under almost all Unix variants in use today and, unlike
many of its historical predecessors, is written entirely in C, thus
requiring no additional software, such as Perl.  The external software
it does work with, such as OpenSSL, is optional.  As Wget uses the GNU
Autoconf, it is easily built on and ported to new Unix-like systems.
The installation procedure is described in the INSTALL file.

As with other GNU software, the latest version of Wget can be found at
the master GNU archive site ftp.gnu.org, and its mirrors.  Wget
resides at <ftp://ftp.gnu.org/pub/gnu/wget/>.

Please report bugs in Wget to <bug-wget@gnu.org>.

See the file `MAILING-LIST' for information about Wget mailing lists.
Wget's home page is at <http://www.gnu.org/software/wget/>.

If you would like to contribute code for Wget, please read
http://wget.addictivecode.org/PatchGuidelines.

Wget was originally written and mainained by Hrvoje Niksic.  Please see
the file AUTHORS for a list of major contributors, and the ChangeLogs
for a detailed listing of all contributions.


Copyright (C) 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004
2005, 2006, 2007, 2008, 2009 Free Software Foundation, Inc.

This program is free software; you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 3 of the License, or
(at your option) any later version.

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

You should have received a copy of the GNU General Public License
along with this program; if not, write to the Free Software
Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301
USA.

Additional permission under GNU GPL version 3 section 7

If you modify this program, or any covered work, by linking or
combining it with the OpenSSL project's OpenSSL library (or a
modified version of that library), containing parts covered by the
terms of the OpenSSL or SSLeay licenses, the Free Software Foundation
grants you additional permission to convey the resulting work.
Corresponding Source for a non-source form of such a combination
shall include the source code for the parts of OpenSSL used as well
as that of the covered work.