github-repos/wget
1
0
Fork 0
mirror of https://github.com/mirror/wget.git synced 2025-03-26 10:14:10 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,062 Commits 2 Branches 31 Tags 32 MiB
ce8ce5bfc0
Commit Graph

532 Commits

Author SHA1 Message Date
Yousong Zhou
91e9a20752 Fix --content-on-error option handling. 
* src/http.c: Log --content-on-error downloads.
* src/retr.c (retrieve_url): Register the download of an error page
when --content-on-error is specified.
 2015-03-09 11:45:01 +01:00
Tim Ruehsen
103cbf1751 src/http.c: Revert commit d81a8d5f56 
The removal of the 'redundant' condition was a failure.
Fixes: #43876
Reported-by: Sean Jensen-Grey <seanj@xyke.com>
 2014-12-27 23:27:20 +01:00
Darshit Shah
4b845615fa Define MIN and MAx macros in a single location 
MIN and MAx are macros that a developer will universally expect
throughout the source. Yet, they were being defined in multiple places
across the source. Instead, define them in a single location in the
common wget.h header file and use them consistently everywhere.
 2014-12-04 18:36:54 +05:30
Tim Ruehsen
4850e9c873 Replaced xfree_null() by xfree() and nullify argument after freeing. 2014-12-01 16:15:37 +01:00
Tim Ruehsen
5edc97f3f8 Select most secure challenge from WWW-Authenticate 
This patch also adds support for multiple challenges per
WWW-Authenticate header line.
The test Test-auth-both.py now succeeds and thus is taken away
from XFAIL_TESTS (expected to fail tests).
 2014-11-26 16:41:56 +01:00
Tim Rühsen
0c18773308 Add size of buffer to warc_timestamp() 2014-11-24 10:41:08 +01:00
Darshit Shah
e94a542d0f Declare extern numurls in common header 2014-11-22 17:26:06 +05:30
Darshit Shah
c6b750061a Add extern declaration for version.c strings 2014-11-22 17:26:06 +05:30
Tim Rühsen
3c51ad7f02 Removed form feeds from sources and NEWS 2014-11-20 16:35:34 +01:00
Gisle Vanem
6a9b2d36e1 Fix C89 issue in http.c found by MSVC 16 2014-11-20 16:20:20 +01:00
Tim Rühsen
7b43510fe3 Fixes possible issues with Wget running in a turkish locale 2014-11-20 10:56:21 +01:00
Tim Rühsen
1356e90a14 Trivial fixes for C89 compliancy 2014-11-20 09:56:57 +01:00
Darshit Shah
c6ee033425 Make 504 Gateway Timeout non fatal 2014-11-19 18:03:17 +05:30
Tim Ruehsen
50ec4d9c3d Fix warnings from clang-analyzer 3.6 2014-11-18 20:44:56 +01:00
Tim Rühsen
94b8458af1 Fix possible authentication problem with turkish locale 
The test server now treats authentication schemes case-independent.
 2014-11-18 12:49:52 +01:00
Tim Rühsen
176c2b17fc Add 'Accept-Encoding: identity' to request header 
Fixes bug #40819
Reported-by: Noël Köthe <noel@debian.org>
 2014-11-11 20:05:21 +01:00
Darshit Shah
170a469533 Honour Keep-Alive when range not satisfiable 2014-11-09 14:33:13 +05:30
Darshit Shah
d81a8d5f56 Remove redundant condition eval 2014-11-09 14:20:22 +05:30
Matthew Atkinson
e0f149d29d Always send Content-Length with POST, PUT, PATCH 2014-11-05 08:42:51 +01:00
Giuseppe Scrivano
ea97693b54 http: Always check for "Connection: close" presence 2014-11-01 13:22:07 +01:00
Tim Rühsen
c2bb6bc875 fix memory leak 2014-10-30 11:05:07 +01:00
Tim Rühsen
a5c6ae8f28 use CLOSE_INVALIDATE instead of fd_close 2014-10-30 11:05:07 +01:00
Tim Rühsen
42333c4a5e always set fd invalid after close 2014-10-30 11:05:07 +01:00
Tim Rühsen
148065bc00 content for commit 6092205538 2014-10-29 16:18:01 +01:00
Darshit Shah
eab853b7e6 Plug memory leaks 2014-07-24 14:23:43 +05:30
Darshit Shah
550cd6e9d2 Fix indentation and remove excess variable 2014-07-05 16:18:38 +05:30
Darshit Shah
97ce41b2d0 Remove unused error codes 2014-07-05 16:18:31 +05:30
Giuseppe Scrivano
bb025955c3 Fix a problem with ISA server proxy 2014-06-16 16:39:04 +02:00
Giuseppe Scrivano
c03855be40 ftp: Replace main() with main in comments. 2014-06-12 18:49:16 +02:00
Giuseppe Scrivano
dd1b69c600 Remove trailing empty lines 2014-06-12 18:49:15 +02:00
Giuseppe Scrivano
8e6de1fb5f Drop usage of strncpy 2014-06-12 18:49:13 +02:00
Darshit Shah
8624553a31 Whitespace and formatting changes.(Aesthetic only) 
This commit makes lots of whitespace only changes. It has been ensured that this
commit does not make any changes to the functioning of the program. The only
changes that have been made are:
    * Remove trailing whitespaces
    * Convert tabs to spaces
    * Fix indentation issues in the code
    * Other aesthetic changes to the formatting of comments
 2014-05-30 21:12:57 +05:30
Darshit Shah
4eeabffee6 More progress bar aesthetic changes 
This commit introduces two new changes to how the progress bar looks:
1. Support the --progress=bar:noscroll option which will prevent the filename
   from scrolling in the progress bar
2. Print human readable value for the amount already downloaded for any file
 2014-05-30 13:28:02 +05:30
Tim Ruehsen
38a7829dcb Fix compiler warnings 2014-05-12 12:18:50 +02:00
Benjamin Goose
351e438e51 Plug memory leak 2014-05-10 00:47:10 +02:00
Darshit Shah
8c2fd06ba8 Add --show-progress to force display progress bar 
This is a relatively large commit that implements two major features:

1. Implement --show-progress switch to force the display of the progress bar in
   any verbosity level
2. Edit the implementation of the progress bar so that the filename is displayed
   in the same line.
 2014-05-01 01:07:43 +02:00
Tim Ruehsen
848d7537e1 fixed 204 response handling, added new Test-204.px 2014-04-24 13:27:44 +02:00
Yousong Zhou
dfa1f4e064 Make wget capable of starting downloads from a specified position. 
This patch adds an option `--start-pos' for specifying starting position
of a HTTP or FTP download.

Signed-off-by: Yousong Zhou <yszhou4tech@gmail.com>
 2014-03-21 11:21:00 +01:00
Giuseppe Scrivano
43c89ab7a5 http: aesthetic change 2014-03-04 17:26:32 +01:00
Vladimír Pýcha
5bb2f43165 URL-decode the filename parameter of Content-Disposition HTTP header if it is encoded 2014-03-03 11:07:00 +01:00
Håkon Vågsether
d260ded060 Fix checking the URL length when filename is specified 2014-01-07 15:59:29 +01:00
Giuseppe Scrivano
38933de17c http: Increase max header value length to 512 2013-11-02 11:53:18 +01:00
Pavel Mateja
aed7d4163a http: specify Host when CONNECT is used. 2013-11-02 11:30:04 +01:00
Giuseppe Scrivano
42c15e47b4 Remove assert which is always true 2013-10-30 21:20:50 +01:00
Darshit Shah
92035dbabd Fix erroneous error codes when HTTP Digest Authentication fails. 2013-07-22 19:31:07 +02:00
Giuseppe Scrivano
a300f1e47d Fix some memory leaks a problem introduced with the last commit 2013-07-13 16:25:43 +02:00
Giuseppe Scrivano
c52bbad9e4 Make --backups work as documented 2013-07-13 13:36:55 +02:00
Giuseppe Scrivano
e9cc8b2f7c Fix HTTP Digest authentication when the algorithm is not specified 2013-07-12 19:07:22 +02:00
Tomas Hozza
8760123cee Set sock variable to -1 if no persistent conn exists 
Wget should set sock variable to -1 if no persistent
connection exists. Function persistent_available_p()
tests persistent connection but if test_socket_open()
fails it closes the socket but will not set sock variable
to -1. After returning from persistent_available_p()
it is possible that sock has still value of already
closed connection.

Signed-off-by: Tomas Hozza <thozza@redhat.com>
 2013-07-11 20:50:42 +02:00
Darshit Shah
9e0d87a248 Download response body data for all requests 2013-06-27 20:07:47 +02:00
Darshit Shah
90896e3314 Follow RFC 2616 and httpbis specifications when handling redirects 2013-06-16 22:31:16 +02:00
Dmitry Bogatov
027d9f385d Non-functionality improvement in src/http.c. 
Pulled `request_set_method` functionality into `request_new`
to ensure these functions always called in right order.
 2013-05-12 19:28:22 +02:00
Giuseppe Scrivano
550457bcad Fix crash when receiving a HTTP redirect upon a POST request 
The crash was introduced by a recent commit.
 2013-05-02 21:57:20 +02:00
Darshit Shah
54fd8de415 Improve output in case of --post-{file,body} commands. 2013-04-24 21:08:33 +02:00
Gijs van Tulder
81409cb9c8 Remove old reference to opt.post_data. 2013-04-23 22:02:29 +02:00
Darshit Shah
6c30653a1a Add a generic --method command to set a method in HTTP Requests. 
Add supplementary --body-data and --body-file commands to send BODY Data.

Signed-off-by: Darshit Shah <darnir@gmail.com>
 2013-04-14 12:57:58 +02:00
Darshit Shah
50238e49b9 Make wget abort if --post-file does not exist 
Signed-off-by: Darshit Shah <darnir@gmail.com>
 2013-03-14 21:19:13 +01:00
Tim Ruehsen
b60ff61b75 Added support for MD5-sess authentication 2012-11-25 18:16:20 +01:00
Giuseppe Scrivano
fe401688a6 Fix a regression when -c and --content-dispositionn are used together. 2012-10-07 13:00:46 +02:00
y-iida@secom.co.jp
4759cf099f Fix a build error. 2012-08-21 20:46:27 +02:00
Tim Ruehsen
4fe805a7ec Add support for RFC 2617 Digest Access Authentication 2012-07-07 10:58:30 +02:00
Giuseppe Scrivano
172a117647 Fix some log messages. 2012-07-07 10:27:09 +02:00
Tim Ruehsen
2e86829809 removed 'const' warnings. 
* hash.h (hash_table_put): Make argument "value" const.
* hash.c (hash_table_put): Make argument value const.  Cast `value' to
void.
* http.c (request_set_header): Make argument `name' const.  Cast `value'
and `name' to void*.
(request_remove_header): Make argument `name' const.
* url.c (url_file_name): Make `index_filename' static.
* warc.h (warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
* warc.c (warc_write_date_header): Make the `timestamp' argument const.
Make `extension' const.
(warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
 2012-05-14 23:20:10 +02:00
Tim Ruehsen
0fcd1bb235 Fix memory leak. 2012-04-21 12:19:25 +02:00
Phil Pennock
fd582e4543 Add support for TLS SNI 2012-04-13 23:58:46 +02:00
Gijs van Tulder
6a25955fe6 warc: support large files. 2012-02-25 11:58:21 +01:00
Gijs van Tulder
586ade4fb1 Fix memory leak. 2012-01-28 14:08:52 +01:00
Sasikantha Babu
5e1badae1e Properly format IPv6 addresses. 2012-01-09 00:03:23 +01:00
Gijs van Tulder
e3820953b2 Add support for WARC files. 2011-11-04 22:25:00 +01:00
Henrik Holst
fce4e757a2 Add support for --content-on-error. 2011-10-06 13:25:17 +02:00
Giuseppe Scrivano
19ef7249b8 Allow --timestamping and --continue at the same time. 2011-09-07 12:57:55 +02:00
Giuseppe Scrivano
9fab5a9f28 Fix a memory leak. 2011-08-18 15:17:20 +02:00
Giuseppe Scrivano
75d04cadf5 Fix a hang on redirects which change the transfer-encoding 2011-08-18 11:46:58 +02:00
Giuseppe Scrivano
1d9bb1c7b0 Use Cache-Control when --no-cache is specified. 2011-08-06 10:56:07 +02:00
Filipe Brandenburger
e219e587b3 Support HTTP/1.1 307 redirects keep request method. 2011-03-03 14:02:25 +01:00
Filipe Brandenburger
bb6a72caea Do not adjust the extension if the file ends in .htm. 2011-03-02 10:57:44 +01:00
Steven Schubiger
e076a6d39d Move duplicated code in http.c to a function 2011-02-23 10:37:48 +01:00
Giuseppe Scrivano
2f6aa1d741 mass change: update copyright years. 2011-01-01 13:19:37 +01:00
Giuseppe Scrivano
9ae052b1e2 Remove redundant guard. 2010-12-01 13:15:13 +01:00
Giuseppe Scrivano
8aa378bd9e Revert 2444. 2010-11-22 18:04:42 +01:00
Giuseppe Scrivano
2aa2a913c3 On a network error, attempt to resume the download, not restart it. 2010-11-21 22:56:20 +01:00
Giuseppe Scrivano
a2596ccf21 Fix an infinite loop with error message '<filename> has sprung into existence' 2010-11-19 17:14:21 +01:00
Giuseppe Scrivano
542c549985 Silent warnings reported by clang. 2010-10-16 03:04:25 +02:00
Merinov Nikolay
b5c9573ad6 Add --unlink. 2010-09-29 13:34:09 +02:00
Dennis, CHENG Renquan
6230b73df0 Fix problem when content-disposition is used with recursive downloading. 2010-09-24 14:07:58 +02:00
Giuseppe Scrivano
2107eb06ab Use persistent connections with proxies supporting them. 2010-08-09 12:56:49 +02:00
Giuseppe Scrivano
87ad80cacc Specify the connection header when keep alive connections are not used. 2010-08-09 12:32:04 +02:00
Giuseppe Scrivano
3e25a9817f Introduce --trust-server-names. Close CVE-2010-2252. 2010-07-28 21:22:22 +02:00
Alan Jenkins
954fead685 Fix a failure if the server doesn't specify a content-length and -c is used. 2010-07-20 19:42:13 +02:00
Giuseppe Scrivano
57584fe2da Fix another case of -N and -c not working well together. 2010-07-18 20:10:42 +02:00
Giuseppe Scrivano
b7f54921f6 Now --timestamping and --continue works well together. 2010-07-11 15:47:18 +02:00
Giuseppe Scrivano
117c25970b Send a HEAD before the GET when -N and --content-disposition are used together. 2010-06-14 19:24:47 +02:00
Muthu Subramanian K
aca9f566b6 Report the total avg transfer speed correctly with multiple URL's and -c. 2010-06-11 00:35:30 +02:00
Giuseppe Scrivano
bd5527dad4 If --content-disposition is used, do not send a HEAD request. 2010-06-03 16:46:56 +02:00
Giuseppe Scrivano
af5008cdb4 Tiny aesthetic changes. 2010-05-27 12:14:59 +02:00
Giuseppe Scrivano
8ff8a1d289 Send new cookies when the authorization fails. 2010-05-27 12:09:56 +02:00
Giuseppe Scrivano
475c452780 Ignore HTTP 1xx responses. 2010-05-25 17:52:13 +02:00
Giuseppe Scrivano
84b2d52598 http_atotm copies the NUL character of the locale string. 2010-05-23 10:58:05 +02:00
Giuseppe Scrivano
58a9721edf Use the gnulib md5 module. 2010-05-16 01:34:17 +02:00
Giuseppe Scrivano
293008f682 Mass update copyright years. 2010-05-08 21:56:15 +02:00
Giuseppe Scrivano
282798f52e Give a nicer message on a malformed status line. 2010-05-05 12:27:29 +02:00
Giuseppe Scrivano
d829a89218 Check `resp_status' function return code. 2010-05-04 17:34:40 +02:00
Giuseppe Scrivano
1cee086162 Support HTTP/1.1. 2010-05-01 22:34:11 +02:00
Micah Cowan
7585b7019d --no-match-server-timestamps -> --no-use-server-timestamps 2010-01-09 20:21:37 -08:00
David Holman
1f08245076 --no-match-server-timestamps 2010-01-09 18:57:18 -08:00
Arvind Jamuna Dixit
d5361eca21 Support RFC 2231. 2010-01-09 14:23:29 -08:00
Micah Cowan
4a08094db8 [mq]: cfg-mk 2009-09-21 20:39:44 -07:00
Steven Schweda
5ef1d7b949 Fixes needed for VMS. 2009-09-11 19:41:57 -07:00
Micah Cowan
b014f8fae9 Improved exit status handling. 2009-08-27 23:08:58 -07:00
Micah Cowan
d21dde51b8 Heed cookies from 401s. 2009-08-27 00:40:48 -07:00
Tony Lewis
ee1df87dd8 Parse content-length before using it. Fixes NTLM (#27192). 2009-08-17 20:47:05 -07:00
Micah Cowan
9dadbf6fe9 Rename --html-extension to --adjust-extension. 2009-07-28 17:37:58 -07:00
Peter Pisar
2524076dd2 Translation fixes. 2009-07-05 14:35:21 -07:00
Micah Cowan
ae042e99cf Remove version.h; we generate version.c these days. 2009-07-04 16:15:26 -07:00
Micah Cowan
d5e283b1a7 Automated merge. 2009-07-04 15:32:57 -07:00
Micah Cowan
4f3dd68173 Merge with mainline. 2009-06-25 01:14:11 -07:00
Xin Zou
37b7e547c3 Fix some memory leaks. 2009-06-11 19:16:51 -07:00
Micah Cowan
8477863e75 Fix bad setlocale usage. 2009-06-11 18:58:26 -07:00
Steven Schubiger
116b261a9f Move duplicated code to a function. 2009-04-13 22:19:13 +02:00
Steven Schubiger
42253233c3 Adjust copyright years. 2009-03-03 21:16:47 +01:00
Steven Schubiger
fb7916aa1d Improve messages when writing a document to stdout. 2009-02-21 17:32:12 +01:00
Micah Cowan
58de6f0033 Not-so-automated merge. 2008-12-01 22:59:03 -08:00
Micah Cowan
78a7657395 Automated merge. 2008-11-26 21:55:12 -08:00
Micah Cowan
d8c11a82ca Automated merge. 2008-11-26 21:53:40 -08:00
Saint Xavier
51f8e65633 Fixes bug #24862: --content-disposition doesn't work with HTTP authentication 2008-11-27 00:19:06 +01:00
Micah Cowan
289ff1c86a Merge with mainline. 2008-11-26 07:08:38 -08:00
Steven Schubiger
f33c275621 Move numurls out of options struct. 2008-11-16 20:53:58 +01:00
Micah Cowan
c7f74c62d3 Don't download content just to ignore it. 2008-11-13 00:59:53 -08:00
Saint Xavier
65ab102f07 Make --auth-no-challenge work with user:pass@ in URLs. 2008-11-10 23:17:17 -08:00
Saint Xavier
d82f80ecab Change global variable model for state-object 2008-07-24 00:56:29 +02:00
Saint Xavier
b30a0dd817 Automated merge. 2008-07-20 21:45:09 +02:00
Saint Xavier
7410cb9764 In spider mode, do not report links as broken if they were utf8 encoded 2008-07-20 18:52:20 +02:00
Saint Xavier
9a2ea3938d Basic IDN/IRI support 2008-07-20 13:10:02 +02:00
Micah Cowan
2e2ac6ad2f Merge current tip with CSS stuff. 2008-07-11 16:30:51 -07:00
Saint Xavier
d3007f1b3a Automated merge. 2008-06-26 18:10:16 +02:00
Micah Cowan
6db8909f87 stsc: escnonprint -> quotearg_style 2008-06-24 12:08:46 -07:00
Micah Cowan
25585dce47 stsc's patch to initialize, free hs->message. 2008-06-23 12:54:50 -07:00
Micah Cowan
b2dbe2b7e4 stsc's better-messages-for-spider-mode patch. 2008-06-22 15:07:19 -07:00
Saint Xavier
ed558a83f6 The prefered way is to avoid #ifdef flooding, so take it that way. Introduce iri.c and iri.h for achieving it 2008-06-19 22:07:03 +02:00
Micah Cowan
c94d559bc3 Don't abort when len > contlen, when we set it that way. 2008-06-16 21:49:15 -07:00
Saint Xavier
8fc5241a2d Automaetd merge. 2008-06-08 13:00:15 +02:00
Micah Cowan
dac53e8bdf Minor tweaks to Henri's patch. 2008-05-31 00:24:53 -07:00
Micah Cowan
48b53471e8 Henri's -Wall patch. 2008-05-30 22:42:36 -07:00
Saint Xavier
4aab9e8f0a Detect HTTP Content-Type server encoding 2008-05-25 03:49:00 +02:00
Micah Cowan
d78cd8d8f8 Merging heads. 2008-05-15 22:36:20 -07:00
Micah Cowan
e72b57629b Merge quote module stuff with current mainline. 2008-05-15 19:13:08 -07:00
Joao Ferreira
9fa15c310f Changed some comments related with bug fix #23238, to make things clearer. 2008-05-14 23:21:06 +01:00
Joao Ferreira
888c30ba01 Fixed bug #23238: --no-clobber doesn't work with -O flag 
"wget -nc -O file URL" now checks if "file" exists first. If it does, it terminates.
 2008-05-14 22:10:37 +01:00
Micah Cowan
202caab4c2 Parse html from files when -r -nc is active. 2008-04-27 12:11:03 -07:00
Micah Cowan
ad21f8e2b7 Add fix from eleven, for doing HTTPS auth over a proxy (in eleven, changeset 883844a4ac33). 2008-04-26 21:28:35 -07:00