1999-12-02 15:42:23 +08:00
|
|
|
|
GNU Wget NEWS -- history of user-visible changes.
|
|
|
|
|
|
2001-01-16 08:50:00 +08:00
|
|
|
|
Copyright (C) 1997, 1998, 2000, 2001 Free Software Foundation, Inc.
|
1999-12-02 15:42:23 +08:00
|
|
|
|
See the end for copying conditions.
|
|
|
|
|
|
|
|
|
|
Please send GNU Wget bug reports to <bug-wget@gnu.org>.
|
|
|
|
|
|
2001-04-04 21:55:09 +08:00
|
|
|
|
* Changes in Wget 1.7.
|
2001-01-16 08:50:00 +08:00
|
|
|
|
|
2001-04-04 21:55:09 +08:00
|
|
|
|
** SSL (`https') pages now work if you compile Wget with SSL support;
|
|
|
|
|
use the `--with-ssl' configure flag. You need to have OpenSSL
|
|
|
|
|
installed.
|
2001-02-24 04:47:18 +08:00
|
|
|
|
|
2001-04-09 06:25:24 +08:00
|
|
|
|
** Cookies are now supported. Wget will accept cookies sent by the
|
|
|
|
|
server and return them in later requests. Additionally, it can load
|
|
|
|
|
and save cookies to disk, in the same format that Netscape uses.
|
|
|
|
|
|
|
|
|
|
** "Keep-alive" (persistent) HTTP connections are now supported.
|
|
|
|
|
Using keep-alive allows Wget to share one TCP/IP connection for
|
|
|
|
|
many retrievals, making multiple-file downloads faster and less
|
|
|
|
|
stressing for the server and the network.
|
2001-04-04 21:55:09 +08:00
|
|
|
|
|
|
|
|
|
** Wget now recognizes FTP directory listings generated by NT and VMS
|
|
|
|
|
servers.
|
2001-01-16 17:24:44 +08:00
|
|
|
|
|
|
|
|
|
** It is now possible to recurse through FTP sites where logging in
|
|
|
|
|
puts you in some directory other than '/'.
|
2001-01-16 08:50:00 +08:00
|
|
|
|
|
2001-04-09 07:59:14 +08:00
|
|
|
|
** You may now use `~' to mean home directory in `.wgetrc'. For
|
|
|
|
|
example, `load_cookies = ~/.netscape/cookies.txt' works as you would
|
|
|
|
|
expect.
|
|
|
|
|
|
2001-01-16 17:24:44 +08:00
|
|
|
|
** The HTML parser has been rewritten. The new one works more
|
|
|
|
|
reliably, allows finer-grained control over which tags and attributes
|
|
|
|
|
are detected, and has better support for some features like correctly
|
|
|
|
|
skipping comments and declarations, decoding entities, etc. It is
|
|
|
|
|
also more general.
|
2001-01-16 08:50:00 +08:00
|
|
|
|
|
|
|
|
|
** <meta name="robots"> tags are now respected.
|
2001-01-16 17:24:44 +08:00
|
|
|
|
|
|
|
|
|
** Wget's internal tables now use hash tables instead of linked lists
|
|
|
|
|
where appropriate. This results in huge speedups when retrieving
|
|
|
|
|
large sites (thousands of documents).
|
|
|
|
|
|
2001-04-04 21:55:09 +08:00
|
|
|
|
** Wget now has a man page, automatically generated from the Texinfo
|
|
|
|
|
documentation. (The last version that shipped with a man page was
|
|
|
|
|
1.4.5). To get this, you need to have pod2man from the Perl
|
|
|
|
|
distribution installed on your system.
|
2001-01-16 08:50:00 +08:00
|
|
|
|
|
2000-12-31 20:05:29 +08:00
|
|
|
|
* Changes in Wget 1.6
|
2000-03-01 08:50:52 +08:00
|
|
|
|
|
2000-11-02 05:52:52 +08:00
|
|
|
|
** Administrative changes.
|
|
|
|
|
|
|
|
|
|
*** Maintainership. Due to Hrvoje being plagued with a "real job",
|
2001-01-16 17:24:44 +08:00
|
|
|
|
Dan Harkless is the most active maintainer (not that he doesn't have a
|
|
|
|
|
real job as well). Hrvoje still participates occasionally, and both
|
|
|
|
|
are being helped by many other people.
|
2000-11-02 05:52:52 +08:00
|
|
|
|
|
|
|
|
|
*** Web page. Thanks to Jan Prikryl, Wget has an "official" web page.
|
|
|
|
|
Take a look at:
|
|
|
|
|
|
2000-11-13 08:48:19 +08:00
|
|
|
|
http://sunsite.dk/wget/
|
2000-11-02 05:52:52 +08:00
|
|
|
|
|
|
|
|
|
*** Anonymous CVS. Thanks to ever-helpful Karsten Thygesen, Wget
|
|
|
|
|
sources are now available at an anonymous CVS server. Take a look at
|
|
|
|
|
the web page for downloading instructions.
|
|
|
|
|
|
2000-03-01 08:50:52 +08:00
|
|
|
|
** New -K / --backup-converted / backup_converted = on option causes files
|
2000-03-02 14:33:48 +08:00
|
|
|
|
modified due to -k to be saved with a .orig prefix before being changed. When
|
|
|
|
|
using -N as well, it is these .orig files that are compared against the server.
|
2000-04-05 10:02:08 +08:00
|
|
|
|
|
2000-11-24 22:04:55 +08:00
|
|
|
|
** New --follow-tags / follow_tags = ... option allows you to restrict
|
|
|
|
|
Wget to following only certain HTML tags when doing a recursive
|
|
|
|
|
retrieval. -G / --ignore-tags / ignore_tags = ... is just the
|
|
|
|
|
opposite -- all tags but the ones you specify will be followed.
|
2000-08-31 05:07:40 +08:00
|
|
|
|
|
|
|
|
|
** New --waitretry / waitretry = SECONDS option allows waiting between retries
|
|
|
|
|
of failed downloads. Wget will use "linear" backoff, waiting 1 second after the
|
|
|
|
|
first failure, 2 after the second, up to SECONDS. waitretry is set to 10 by
|
|
|
|
|
default in the system wgetrc.
|
|
|
|
|
|
2000-11-24 22:04:55 +08:00
|
|
|
|
** New -p / --page-requisites / page_requisites = on option causes
|
|
|
|
|
Wget to download all ancillary files necessary to display a given HTML
|
|
|
|
|
page properly (e.g. inlined images).
|
2000-10-21 06:29:42 +08:00
|
|
|
|
|
2000-11-24 22:04:55 +08:00
|
|
|
|
** New -E / --html-extension / html_extension = on option causes Wget
|
|
|
|
|
to append ".html" to text/html filenames not ending in regexp
|
|
|
|
|
"\.[Hh][Tt][Mm][Ll]?".
|
2000-10-21 06:29:42 +08:00
|
|
|
|
|
|
|
|
|
** New type of .wgetrc command -- "lockable Boolean". Can be set to on, off,
|
|
|
|
|
always, or never. This allows the .wgetrc to override the commandline. So far,
|
|
|
|
|
passive_ftp is the only .wgetrc command which takes a lockable Boolean.
|
|
|
|
|
|
2000-11-24 22:04:55 +08:00
|
|
|
|
** A number of new translation files have been added.
|
2000-10-25 06:41:32 +08:00
|
|
|
|
|
|
|
|
|
** New --bind-address / bind_address = <address> option for people on hosts
|
|
|
|
|
bound to multiple IP addresses.
|
2000-10-31 12:24:14 +08:00
|
|
|
|
|
|
|
|
|
** wget now accepts (illegal per HTTP spec) relative URLs in HTTP redirects.
|
2000-03-01 08:50:52 +08:00
|
|
|
|
|
1999-12-02 15:42:23 +08:00
|
|
|
|
* Wget 1.5.3 is a bugfix release with no user-visible changes.
|
|
|
|
|
|
|
|
|
|
* Wget 1.5.2 is a bugfix release with no user-visible changes.
|
|
|
|
|
|
|
|
|
|
* Wget 1.5.1 is a bugfix release with no user-visible changes.
|
|
|
|
|
|
|
|
|
|
* Changes in Wget 1.5.0
|
|
|
|
|
|
|
|
|
|
** Wget speaks many languages!
|
|
|
|
|
|
|
|
|
|
On systems with gettext(), Wget will output messages in the language
|
|
|
|
|
set by the current locale, if available. At this time we support
|
|
|
|
|
Czech, German, Croatian, Italian, Norwegian and Portuguese.
|
|
|
|
|
|
|
|
|
|
** Opie (Skey) is now supported with FTP.
|
|
|
|
|
|
|
|
|
|
** HTTP Digest Access Authentication (RFC2069) is now supported.
|
|
|
|
|
|
|
|
|
|
** The new `-b' option makes Wget go to background automatically.
|
|
|
|
|
|
|
|
|
|
** The `-I' and `-X' options now accept wildcard arguments.
|
|
|
|
|
|
|
|
|
|
** The `-w' option now accepts suffixes `s' for seconds, `m' for
|
|
|
|
|
minutes, `h' for hours, `d' for days and `w' for weeks.
|
|
|
|
|
|
|
|
|
|
** Upon getting SIGHUP, the whole previous log is now copied to
|
|
|
|
|
`wget-log'.
|
|
|
|
|
|
|
|
|
|
** Wget now understands proxy settings with explicit usernames and
|
|
|
|
|
passwords, e.g. `http://user:password@proxy.foo.com/'.
|
|
|
|
|
|
|
|
|
|
** You can use the new `--cut-dirs' option to make Wget create less
|
|
|
|
|
directories.
|
|
|
|
|
|
|
|
|
|
** The `;type=a' appendix to FTP URLs is now recognized. For
|
|
|
|
|
instance, the following command will retrieve the welcoming message in
|
|
|
|
|
ASCII type transfer:
|
|
|
|
|
|
|
|
|
|
wget "ftp://ftp.somewhere.com/welcome.msg;type=a"
|
|
|
|
|
|
|
|
|
|
** `--help' and `--version' options have been redone to to conform to
|
|
|
|
|
standards set by other GNU utilities.
|
|
|
|
|
|
|
|
|
|
** Wget should now be compilable under MS Windows environment. MS
|
|
|
|
|
Visual C++ and Watcom C have been used successfully.
|
|
|
|
|
|
|
|
|
|
** If the file length is known, percentages are displayed during
|
|
|
|
|
download.
|
|
|
|
|
|
|
|
|
|
** The manual page, now hopelessly out of date, is no longer
|
|
|
|
|
distributed with Wget.
|
|
|
|
|
|
|
|
|
|
* Wget 1.4.5 is a bugfix release with no user-visible changes.
|
|
|
|
|
|
|
|
|
|
* Wget 1.4.4 is a bugfix release with no user-visible changes.
|
|
|
|
|
|
|
|
|
|
* Changes in Wget 1.4.3
|
|
|
|
|
|
|
|
|
|
** Wget is now a GNU utility.
|
|
|
|
|
|
|
|
|
|
** Can do passive FTP.
|
|
|
|
|
|
|
|
|
|
** Reads .netrc.
|
|
|
|
|
|
|
|
|
|
** Info documentation expanded.
|
|
|
|
|
|
|
|
|
|
** Compiles on pre-ANSI compilers.
|
|
|
|
|
|
|
|
|
|
** Global wgetrc now goes to /usr/local/etc (i.e. $sysconfdir).
|
|
|
|
|
|
|
|
|
|
** Lots of bugfixes.
|
|
|
|
|
|
|
|
|
|
* Changes in Wget 1.4.2
|
|
|
|
|
|
|
|
|
|
** New mirror site at ftp://sunsite.auc.dk/pub/infosystems/wget/,
|
|
|
|
|
thanks to Karsten Thygesen.
|
|
|
|
|
|
|
|
|
|
** Mailing list! Mail to wget-request@sunsite.auc.dk to subscribe.
|
|
|
|
|
|
|
|
|
|
** New option --delete-after for proxy prefetching.
|
|
|
|
|
|
|
|
|
|
** New option --retr-symlinks to retrieve symbolic links like plain
|
|
|
|
|
files.
|
|
|
|
|
|
|
|
|
|
** rmold.pl -- script to remove files deleted on the remote server
|
|
|
|
|
|
|
|
|
|
** --convert-links should work now.
|
|
|
|
|
|
|
|
|
|
** Minor bugfixes.
|
|
|
|
|
|
|
|
|
|
* Changes in Wget 1.4.1
|
|
|
|
|
|
|
|
|
|
** Minor bugfixes.
|
|
|
|
|
|
|
|
|
|
** Added -I (the opposite of -X).
|
|
|
|
|
|
|
|
|
|
** Dot tracing is now customizable; try wget --dot-style=binary
|
|
|
|
|
|
|
|
|
|
* Changes in Wget 1.4.0
|
|
|
|
|
|
|
|
|
|
** Wget 1.4.0 [formerly known as Geturl] is an extensive rewrite of
|
|
|
|
|
Geturl. Although many things look suspiciously similar, most of the
|
|
|
|
|
stuff was rewritten, like recursive retrieval, HTTP, FTP and mostly
|
|
|
|
|
everything else. Wget should be now easier to debug, maintain and,
|
|
|
|
|
most importantly, use.
|
|
|
|
|
|
|
|
|
|
** Recursive HTTP should now work without glitches, even with Location
|
|
|
|
|
changes, server-generated directory listings and other naughty stuff.
|
|
|
|
|
|
|
|
|
|
** HTTP regetting is supported on servers that support Range
|
|
|
|
|
specification. WWW authorization is supported -- try
|
|
|
|
|
wget http://user:password@hostname/
|
|
|
|
|
|
|
|
|
|
** FTP support was rewritten and widely enhanced. Globbing should now
|
|
|
|
|
work flawlessly. Symbolic links are created locally. All the
|
|
|
|
|
information the Unix-style ls listing can give is now recognized.
|
|
|
|
|
|
|
|
|
|
** Recursive FTP is supported, e.g.
|
|
|
|
|
wget -r ftp://gnjilux.cc.fer.hr/pub/unix/util/
|
|
|
|
|
|
|
|
|
|
** You can specify "rejected" directories, to which you do not want to
|
|
|
|
|
enter, e.g. with wget -X /pub
|
|
|
|
|
|
|
|
|
|
** Time-stamping is supported, with both HTTP and FTP. Try wget -N URL.
|
|
|
|
|
|
|
|
|
|
** A new texinfo reference manual is provided. It can be read with
|
|
|
|
|
Emacs, standalone info, or converted to HTML, dvi or postscript.
|
|
|
|
|
|
|
|
|
|
** Fixed a long-standing bug, so that Wget now works over SLIP
|
|
|
|
|
connections.
|
|
|
|
|
|
|
|
|
|
** You can have a system-wide wgetrc (/usr/local/lib/wgetrc by
|
|
|
|
|
default). Settings in $HOME/.wgetrc override the global ones, of
|
|
|
|
|
course :-)
|
|
|
|
|
|
|
|
|
|
** You can set up quota in .wgetrc to prevent sucking too much
|
|
|
|
|
data. Try `quota = 5M' in .wgetrc (or quota = 100K if you want your
|
|
|
|
|
sysadmin to like you).
|
|
|
|
|
|
|
|
|
|
** Download rate is printed after retrieval.
|
|
|
|
|
|
|
|
|
|
** Wget now sends the `Referer' header when retrieving
|
|
|
|
|
recursively.
|
|
|
|
|
|
|
|
|
|
** With the new --no-parent option Wget can retrieve FTP recursively
|
|
|
|
|
through a proxy server.
|
|
|
|
|
|
|
|
|
|
** HTML parser, as well as the whole of Wget was rewritten to be much
|
|
|
|
|
faster and less memory-consuming (yes, both).
|
|
|
|
|
|
|
|
|
|
** Absolute links can be converted to relative links locally. Check
|
|
|
|
|
wget -k.
|
|
|
|
|
|
|
|
|
|
** Wget catches hangup, filtering the output to a log file and
|
|
|
|
|
resuming work. Try kill -HUP %?wget.
|
|
|
|
|
|
|
|
|
|
** User-defined headers can be sent. Try
|
|
|
|
|
|
|
|
|
|
wget http://fly.cc.her.hr/ --header='Accept-Charset: iso-8859-2'
|
|
|
|
|
|
|
|
|
|
** Acceptance/Rejection lists may contain wildcards.
|
|
|
|
|
|
|
|
|
|
** Wget can display HTTP headers and/or FTP server response with the
|
|
|
|
|
new `-S' option. It can save the original HTTP headers with `-s'.
|
|
|
|
|
|
|
|
|
|
** socks library is now supported (thanks to Antonio Rosella
|
|
|
|
|
<Antonio.Rosella@agip.it>). Configure with --with-socks.
|
|
|
|
|
|
|
|
|
|
** There is a nicer display of REST-ed output.
|
|
|
|
|
|
|
|
|
|
** Many new options (like -x to force directory hierarchy, or -m to
|
|
|
|
|
turn on mirroring options).
|
|
|
|
|
|
|
|
|
|
** Wget is now distributed under GNU General Public License (GPL).
|
|
|
|
|
|
|
|
|
|
** Lots of small features I can't remember. :-)
|
|
|
|
|
|
|
|
|
|
** A host of bugfixes.
|
|
|
|
|
|
|
|
|
|
* Changes in Geturl 1.3
|
|
|
|
|
|
|
|
|
|
** Added FTP globbing support (ftp://fly.cc.fer.hr/*)
|
|
|
|
|
|
|
|
|
|
** Added support for no_proxy
|
|
|
|
|
|
|
|
|
|
** Added support for ftp://user:password@host/
|
|
|
|
|
|
|
|
|
|
** Added support for %xx in URL syntax
|
|
|
|
|
|
|
|
|
|
** More natural command-line options
|
|
|
|
|
|
|
|
|
|
** Added -e switch to execute .geturlrc commands from the command-line
|
|
|
|
|
|
|
|
|
|
** Added support for robots.txt
|
|
|
|
|
|
|
|
|
|
** Fixed some minor bugs
|
|
|
|
|
|
|
|
|
|
* Geturl 1.2 is a bugfix release with no user-visible changes.
|
|
|
|
|
|
|
|
|
|
* Changes in Geturl 1.1
|
|
|
|
|
|
|
|
|
|
** REST supported in FTP
|
|
|
|
|
|
|
|
|
|
** Proxy servers supported
|
|
|
|
|
|
|
|
|
|
** GNU getopt used, which enables command-line arguments to be ordered
|
|
|
|
|
as you wish, e.g. geturl http://fly.cc.fer.hr/ -vo log is the same as
|
|
|
|
|
geturl -vo log http://fly.cc.fer.hr/
|
|
|
|
|
|
|
|
|
|
** Netscape-compatible URL syntax for HTTP supported: host[:port]/dir/file
|
|
|
|
|
|
|
|
|
|
** NcFTP-compatible colon URL syntax for FTP supported: host:/dir/file
|
|
|
|
|
|
|
|
|
|
** <base href="xxx"> supported
|
|
|
|
|
|
|
|
|
|
** autoconf supported
|
|
|
|
|
|
|
|
|
|
----------------------------------------------------------------------
|
|
|
|
|
Copyright information:
|
|
|
|
|
|
2001-04-04 21:55:09 +08:00
|
|
|
|
Copyright (C) 1997, 1998, 2000, 2001 Free Software Foundation, Inc.
|
1999-12-02 15:42:23 +08:00
|
|
|
|
|
|
|
|
|
Permission is granted to anyone to make or distribute verbatim
|
|
|
|
|
copies of this document as received, in any medium, provided that
|
|
|
|
|
the copyright notice and this permission notice are preserved, thus
|
|
|
|
|
giving the recipient permission to redistribute in turn.
|
|
|
|
|
|
|
|
|
|
Permission is granted to distribute modified versions of this
|
|
|
|
|
document, or of portions of it, under the above conditions,
|
|
|
|
|
provided also that they carry prominent notices stating who last
|
|
|
|
|
changed them.
|