From 84a93f4127173f1bc50d52f07fd18f9dc093f893 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Tim=20R=C3=BChsen?= Date: Sat, 18 Mar 2017 19:05:38 +0100 Subject: [PATCH] Fix links to www.robotstxt.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit * NEWS: Fix links * doc/wget.texi: Likewise * src/res.c: Likewise Reported-by: Noël Köthe --- NEWS | 2 +- doc/wget.texi | 4 ++-- src/res.c | 6 +++--- 3 files changed, 6 insertions(+), 6 deletions(-) diff --git a/NEWS b/NEWS index 625ae978..420a15d7 100644 --- a/NEWS +++ b/NEWS @@ -698,7 +698,7 @@ addresses when accessing the first one fails. non-standard port. ** Wget now supports the robots.txt directives specified in -. +. ** URL parser has been fixed, especially the infamous overzealous quoting. Wget no longer dequotes reserved characters, e.g. `%3F' is diff --git a/doc/wget.texi b/doc/wget.texi index 755f882c..a2bf9dc7 100644 --- a/doc/wget.texi +++ b/doc/wget.texi @@ -4266,7 +4266,7 @@ server. Until version 1.8, Wget supported the first version of the standard, written by Martijn Koster in 1994 and available at -@url{http://www.robotstxt.org/robotstxt.html}. As of version 1.8, +@url{http://www.robotstxt.org/orig.html}. As of version 1.8, Wget has supported the additional directives specified in the internet draft @samp{} titled ``A Method for Web Robots Control''. The draft, which has as far as I know never made to @@ -4285,7 +4285,7 @@ this: @end example This is explained in some detail at -@url{http://www.robotstxt.org/wc/meta-user.html}. Wget supports this +@url{http://www.robotstxt.org/meta.html}. Wget supports this method of robot exclusion in addition to the usual @file{/robots.txt} exclusion. diff --git a/src/res.c b/src/res.c index fb608dd5..fd2a3cd9 100644 --- a/src/res.c +++ b/src/res.c @@ -37,12 +37,12 @@ as that of the covered work. */ disallow access to certain parts of the site. The first specification was written by Martijn Koster in 1994, and - is still available at . + is still available at . In 1996, Martijn wrote an Internet Draft specifying an improved RES specification; however, that work was apparently abandoned since the draft has expired in 1997 and hasn't been replaced since. The draft is available at - . + . This file implements RES as specified by the draft. Note that this only handles the "robots.txt" support. The META tag that controls @@ -428,7 +428,7 @@ free_specs (struct robot_specs *specs) /* The inner matching engine: return true if RECORD_PATH matches URL_PATH. The rules for matching are described at - , section 3.2.2. */ + , section 3.2.2. */ static bool matches (const char *record_path, const char *url_path)