Commit Graph

405 Commits

Author SHA1 Message Date
Giuseppe Scrivano
fec5bb9e93 Merge remote-tracking branch 'origin/master' into parallel-wget 2013-06-23 18:33:06 +02:00
Darshit Shah
90896e3314 Follow RFC 2616 and httpbis specifications when handling redirects 2013-06-16 22:31:16 +02:00
Ray Satiro
8e5038747b MinGW compatibility fixes 2013-05-22 00:16:58 +02:00
Giuseppe Scrivano
ced4c1de82 Merge remote-tracking branch 'origin/master' into parallel-wget 2013-05-19 16:50:07 +02:00
Dmitry Bogatov
027d9f385d Non-functionality improvement in src/http.c.
Pulled `request_set_method` functionality into `request_new`
to ensure these functions always called in right order.
2013-05-12 19:28:22 +02:00
Giuseppe Scrivano
550457bcad Fix crash when receiving a HTTP redirect upon a POST request
The crash was introduced by a recent commit.
2013-05-02 21:57:20 +02:00
Darshit Shah
54fd8de415 Improve output in case of --post-{file,body} commands. 2013-04-24 21:08:33 +02:00
Gijs van Tulder
81409cb9c8 Remove old reference to opt.post_data. 2013-04-23 22:02:29 +02:00
Giuseppe Scrivano
04fcd759fd Ensure that each thread uses a different socket 2013-04-21 23:12:56 +02:00
Giuseppe Scrivano
e9058befae Merge branch 'master' into parallel-wget
Conflicts:
	src/init.c
	src/main.c
2013-04-21 21:11:53 +02:00
Darshit Shah
6c30653a1a Add a generic --method command to set a method in HTTP Requests.
Add supplementary --body-data and --body-file commands to send BODY Data.

Signed-off-by: Darshit Shah <darnir@gmail.com>
2013-04-14 12:57:58 +02:00
Darshit Shah
50238e49b9 Make wget abort if --post-file does not exist
Signed-off-by: Darshit Shah <darnir@gmail.com>
2013-03-14 21:19:13 +01:00
Giuseppe Scrivano
617bb37d6e Fix segfault 2012-12-02 00:52:42 +01:00
Giuseppe Scrivano
e6d8e165c5 Fix a deadlock 2012-11-29 23:40:33 +01:00
Tim Ruehsen
b60ff61b75 Added support for MD5-sess authentication 2012-11-25 18:16:20 +01:00
Giuseppe Scrivano
fe401688a6 Fix a regression when -c and --content-dispositionn are used together. 2012-10-07 13:00:46 +02:00
y-iida@secom.co.jp
4759cf099f Fix a build error. 2012-08-21 20:46:27 +02:00
Ilim Ugur
fa9aaf2ce6 Correct two merging mistakes in src/convert.h and src/http.c. Replace bootstrap. 2012-08-14 20:24:18 +03:00
Ilim Ugur
eb01e9d442 Resolve conflicts to complete merging with master branch. 2012-08-14 19:47:52 +03:00
Ilim Ugur
8cfac52713 Remove cat and rm commands. Few corrections with ifdef macros. 2012-08-01 20:35:25 +03:00
Ilim Ugur
11d09dd001 Add FTP support to metalink code. (for single-threaded downloads only) 2012-08-01 00:37:40 +03:00
Ilim Ugur
159c371492 Update fallbacking for metalink: next source goes on from where the previous one failed. 2012-07-31 17:25:21 +03:00
Ilim Ugur
38b1df95f9 Make thread support optional. - No check for semaphore in configure.ac. 2012-07-29 23:43:03 +03:00
Ilim Ugur
47bd180ab0 Transfer struct range to wget.h. Make metalink code optional. 2012-07-27 17:08:26 +03:00
Ilim Ugur
9fd1e97e40 Correct minor mistakes in syntax. Prevent a leak in http_loop. 2012-07-24 23:59:47 +03:00
Ilim Ugur
1e1054db8a Initial attempt at incorporating sems logically. 2012-07-11 01:07:44 +03:00
Ilim Ugur
5c608df4e1 Update if statement involving hs->restval http.c:2859 2012-07-10 21:51:41 +03:00
Ilim Ugur
7ccf4210f6 Corrected faulty logic on thread creation. Segments recorded separately then merged. 2012-07-10 11:32:57 +03:00
Ilim Ugur
8c66c94989 Initial attempt at achieving segmented downloading from multiple resources. 2012-07-09 23:46:11 +03:00
Tim Ruehsen
4fe805a7ec Add support for RFC 2617 Digest Access Authentication 2012-07-07 10:58:30 +02:00
Giuseppe Scrivano
172a117647 Fix some log messages. 2012-07-07 10:27:09 +02:00
Micah Cowan
15bfd733f9 Fix some very broken pconn-freeing logic (suspect more like this...). 2012-07-05 18:22:28 -07:00
Ilim Ugur
f63e2230d7 Implemented resource fallbacking during metalink download. No -c behavior. 2012-07-06 02:53:03 +03:00
Micah Cowan
671d681304 Fix bad persistence check. 2012-07-02 16:06:37 -07:00
Micah Cowan
fc220632fb Merge Giuseppe's parallel-wget patch. 2012-06-30 16:46:29 -07:00
Tim Ruehsen
2e86829809 removed 'const' warnings.
* hash.h (hash_table_put): Make argument "value" const.
* hash.c (hash_table_put): Make argument value const.  Cast `value' to
void.
* http.c (request_set_header): Make argument `name' const.  Cast `value'
and `name' to void*.
(request_remove_header): Make argument `name' const.
* url.c (url_file_name): Make `index_filename' static.
* warc.h (warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
* warc.c (warc_write_date_header): Make the `timestamp' argument const.
Make `extension' const.
(warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
2012-05-14 23:20:10 +02:00
Tim Ruehsen
0fcd1bb235 Fix memory leak. 2012-04-21 12:19:25 +02:00
Phil Pennock
fd582e4543 Add support for TLS SNI 2012-04-13 23:58:46 +02:00
Gijs van Tulder
6a25955fe6 warc: support large files. 2012-02-25 11:58:21 +01:00
Gijs van Tulder
586ade4fb1 Fix memory leak. 2012-01-28 14:08:52 +01:00
Sasikantha Babu
5e1badae1e Properly format IPv6 addresses. 2012-01-09 00:03:23 +01:00
Gijs van Tulder
e3820953b2 Add support for WARC files. 2011-11-04 22:25:00 +01:00
Henrik Holst
fce4e757a2 Add support for --content-on-error. 2011-10-06 13:25:17 +02:00
Giuseppe Scrivano
19ef7249b8 Allow --timestamping and --continue at the same time. 2011-09-07 12:57:55 +02:00
Giuseppe Scrivano
9fab5a9f28 Fix a memory leak. 2011-08-18 15:17:20 +02:00
Giuseppe Scrivano
75d04cadf5 Fix a hang on redirects which change the transfer-encoding 2011-08-18 11:46:58 +02:00
Giuseppe Scrivano
1d9bb1c7b0 Use Cache-Control when --no-cache is specified. 2011-08-06 10:56:07 +02:00
Filipe Brandenburger
e219e587b3 Support HTTP/1.1 307 redirects keep request method. 2011-03-03 14:02:25 +01:00
Filipe Brandenburger
bb6a72caea Do not adjust the extension if the file ends in .htm. 2011-03-02 10:57:44 +01:00
Steven Schubiger
e076a6d39d Move duplicated code in http.c to a function 2011-02-23 10:37:48 +01:00