Commit Graph

240 Commits

Author SHA1 Message Date
Gijs van Tulder
52dd6da6e0 Keep the same method on a 307 redirect 2013-05-02 23:04:31 +02:00
Darshit Shah
6c30653a1a Add a generic --method command to set a method in HTTP Requests.
Add supplementary --body-data and --body-file commands to send BODY Data.

Signed-off-by: Darshit Shah <darnir@gmail.com>
2013-04-14 12:57:58 +02:00
Michael Stapelberg
a2c0835007 Bugfix: Avoid double free of iri->orig_url
When accessing a URL using IDN which directly redirects to another page,
wget would xfree_null(iri->orig_url); in src/retr.c:retrieve_url()
first, then later xfree_null(iri->orig_url); in src/iri.c:iri_free()
again.

This can be tested with wget -O /dev/null http://μφ.net
2012-12-09 13:47:23 +01:00
Giuseppe Scrivano
4f09a3118f Fix comment 2012-11-15 00:35:17 +01:00
Giuseppe Scrivano
b1838bdfd1 Fix -c with servers that don't specify a content-length
* retr.c (fd_read_body): Correctly check the return code from
write_data.
2012-11-13 23:58:04 +01:00
Giuseppe Scrivano
96418c6885 Rename --bits to --report-bps. 2012-06-06 14:10:07 +02:00
illusionoflife
e93bb4fa28 Remove unused arguments. 2012-05-20 21:02:25 +02:00
Sasikantha Babu
b9b510ca5f Accept --bit option 2012-03-05 22:23:06 +01:00
Gijs van Tulder
6d67d793f5 Add support for chunks to the WARC outputter. 2012-01-28 14:09:29 +01:00
Gijs van Tulder
586ade4fb1 Fix memory leak. 2012-01-28 14:08:52 +01:00
Gijs van Tulder
e3820953b2 Add support for WARC files. 2011-11-04 22:25:00 +01:00
Giuseppe Scrivano
706871e92e Do not define max twice. 2011-08-13 10:44:40 +02:00
Giuseppe Scrivano
1e09ee5ea8 Do not register redirects when in spider mode. 2011-07-26 12:42:40 +02:00
Giuseppe Scrivano
f90ca4e54a Parse URLs read from a file. 2011-06-08 11:32:34 +02:00
Giuseppe Scrivano
544f0d478a Fix indentation. 2011-06-05 14:31:24 +02:00
Giuseppe Scrivano
00723a80f1 Define max 2011-05-24 11:13:04 +02:00
Giuseppe Scrivano
3fb4d068a7 Avoid a small buffer when retrieving a file. 2011-05-23 20:27:42 +02:00
Filipe Brandenburger
e219e587b3 Support HTTP/1.1 307 redirects keep request method. 2011-03-03 14:02:25 +01:00
Giuseppe Scrivano
2f6aa1d741 mass change: update copyright years. 2011-01-01 13:19:37 +01:00
Giuseppe Scrivano
9ae052b1e2 Remove redundant guard. 2010-12-01 13:15:13 +01:00
Giuseppe Scrivano
334a8e9027 Convert a static local buffer to be allocated dinamically. 2010-12-01 12:47:30 +01:00
Giuseppe Scrivano
c5dc4d1664 Remove unnecessary code. 2010-10-21 13:27:31 +02:00
Giuseppe Scrivano
542c549985 Silent warnings reported by clang. 2010-10-16 03:04:25 +02:00
Giuseppe Scrivano
3e25a9817f Introduce --trust-server-names. Close CVE-2010-2252. 2010-07-28 21:22:22 +02:00
Giuseppe Scrivano
293008f682 Mass update copyright years. 2010-05-08 21:56:15 +02:00
Giuseppe Scrivano
1cee086162 Support HTTP/1.1. 2010-05-01 22:34:11 +02:00
Steven Schubiger
a801efcd96 Don't delete an input file fetched via FTP. 2010-03-04 22:09:31 +01:00
Steven Schubiger
33d8b23dfd Check stricter for supported URL scheme. 2010-03-02 21:41:32 +01:00
Steven Schubiger
f391a5b5b0 Fix memory leak in retrieve_from_file. 2010-03-02 20:35:02 +01:00
Steven Schubiger
ec6950f1a6 Make -i work with FTP. 2010-03-02 00:00:17 +01:00
Paul Townsend
068991e8a0 Time-measurement fix 2010-01-27 10:08:26 -08:00
Micah Cowan
b9e9ad65cc Ran update-copyright. 2009-09-04 00:13:47 -07:00
Micah Cowan
b014f8fae9 Improved exit status handling. 2009-08-27 23:08:58 -07:00
Micah Cowan
5daac18e96 Adjust some typos from vms merge, and remove some elements we don't want to include without further consideration first. 2009-07-04 18:42:59 -07:00
Micah Cowan
d5e283b1a7 Automated merge. 2009-07-04 15:32:57 -07:00
Micah Cowan
a00b834bb3 Referer/IRI fix. 2009-07-01 23:17:33 -07:00
Micah Cowan
44cde778dd Fix Test-iri-list. 2009-06-29 01:07:12 -07:00
Micah Cowan
50e12521d6 Fixes to restore Test-iri and Test-iri-forced-remote 2009-06-28 20:55:01 -07:00
Micah Cowan
4f3dd68173 Merge with mainline. 2009-06-25 01:14:11 -07:00
Micah Cowan
4bbcfc2a1d Fix for bug #24948. 2009-06-15 23:33:41 -07:00
Micah Cowan
94d6650817 Merge in gerel's url-parsing stuff. 2009-06-13 04:48:18 -07:00
Steven Schubiger
116b261a9f Move duplicated code to a function. 2009-04-13 22:19:13 +02:00
gerel
ea3745e8dc removed some more calls 2009-02-01 15:03:51 -03:00
Micah Cowan
1b4ed7dcb7 Automated merge. 2008-12-01 07:05:29 -08:00
Micah Cowan
289ff1c86a Merge with mainline. 2008-11-26 07:08:38 -08:00
Alexander Drozdov
b0bdf95494 Fix underflow, incorrect assertion. 2008-10-31 11:13:10 -07:00
Saint Xavier
66dd4bda74 IRI requirement: do not percent-encode already percent-encoded values (try1) 2008-09-27 11:13:21 +02:00
Saint Xavier
5133d57366 Fixes: use encoding got from the remote server serving the list file and use quote_n() for quote'ing several args 2008-08-15 15:03:38 +02:00
Xavier Saint
cbd54b549a Automated merge. 2008-08-14 18:45:13 +02:00
Xavier Saint
723dbfc818 Correct iri handling while fetching a remote file list with -i and provide a test 2008-08-14 18:26:53 +02:00
Xavier Saint
e6b4e761d1 Don't forget to free the iri struct 2008-08-14 17:42:16 +02:00
Xavier Saint
44a22c78a7 Automated merge. 2008-08-07 10:27:19 +02:00
Xavier Saint
84395897ad iri.h is already included in wget.h, so don't include it in C files 2008-08-04 11:08:33 +02:00
Micah Cowan
0fae9cb388 stsc: better message for "unsupported schemes". 2008-08-03 22:03:04 -07:00
Xavier Saint
bfd8a73f00 quote*() functions don't like that much NULL arg 2008-08-02 11:22:14 +02:00
Xavier Saint
b967d49f79 opt.remote_encoding should not override opt.locale, add a force arguments to set_uri_encoding() 2008-07-30 10:15:55 +02:00
Saint Xavier
3ae04f5fe4 Use DEBUGP instead of commenting out all the _wonderful_ printfs 2008-07-24 14:32:31 +02:00
Saint Xavier
ccd62071dc Automated merge. 2008-07-24 00:58:10 +02:00
Saint Xavier
d82f80ecab Change global variable model for state-object 2008-07-24 00:56:29 +02:00
Micah Cowan
e4371807f6 stsc: -i URL improvements. 2008-07-22 13:33:42 -07:00
Saint Xavier
b30a0dd817 Automated merge. 2008-07-20 21:45:09 +02:00
Saint Xavier
1e9ced0170 Get rid of the supplementary bool pointer in url_parse () arguments; UGLY :) 2008-07-20 18:47:52 +02:00
Saint Xavier
da6b3f4b61 Use dt rather than result 2008-07-20 18:20:18 +02:00
Saint Xavier
9a2ea3938d Basic IDN/IRI support 2008-07-20 13:10:02 +02:00
Micah Cowan
b28a6abfe6 -i accepts URLs (stsc). For #21265. 2008-07-11 17:16:49 -07:00
Micah Cowan
714ccdcd84 Steven Schweda's VMS patch. 2008-04-22 14:48:36 -07:00
Micah Cowan
caae3b70f4 Merging Ted Mielczarek's CSS changes with tip. 2008-04-22 01:28:15 -07:00
Micah Cowan
a0d0f332d5 Ted Mielczarek's CSS wonder-patch, applied against the source from around the time the patch was written. 2008-04-22 00:15:48 -07:00
Micah Cowan
bc8f473272 Updated copyright year. 2008-01-25 05:04:01 -08:00
Micah Cowan
462e643a7e Merge SFLC licensing changes for OpenSSL with tip. 2007-12-07 17:37:07 -08:00
Micah Cowan
86395b297b Updated licensing exception for OpenSSL from the SFLC. 2007-11-28 00:05:33 -08:00
Micah Cowan
212396c7e1 Eschew config-post.h. 2007-10-18 20:50:40 -07:00
Micah Cowan
5dd09d9ba5 Update copyright lists, conforming to maintainer guidelines 2007-09-28 15:45:31 -07:00
micah
7d2066b221 [svn] Make indentation consistent (all-spaces, no tabs). 2007-08-02 20:38:21 -07:00
micah
10da871ac4 [svn] Merging fix #20499: MAX_REDIRECTIONS should be configurable. 2007-07-28 19:37:14 -07:00
micah
4d7c5e087b [svn] Merge of fix for bugs 20341 and 20410. 2007-07-09 22:53:22 -07:00
hniksic
3f51773542 [svn] Fixed problem with recursive FTP retrieval. 2006-11-21 14:18:12 -08:00
mtortonesi
1c7493b83e [svn] Added sanity checks for -k, -p, -r and -N when -O is given. Added fixes for 64-bit platforms. Updated copyright and maintainer information. 2006-07-14 06:25:50 -07:00
mtortonesi
9d9f134fdf [svn] Fixed recursive FTP retrieval over proxy. 2006-06-12 09:26:28 -07:00
mtortonesi
01093c0c33 [svn] Fixed recursive spider mode. 2006-05-25 09:11:29 -07:00
hniksic
a202418374 [svn] Made [0.5*wait, 1.5*wait) the range of --random-wait. 2006-02-05 00:35:22 -08:00
mtortonesi
1ff7c1fa70 [svn] retr.c: Changed semantics of no_proxy_match. 2005-10-05 02:46:07 -07:00
hniksic
a95c910f9c [svn] Change name of param. 2005-09-17 05:55:21 -07:00
hniksic
3d5863424b [svn] Make timers measure seconds directly, not milliseconds. 2005-07-06 09:35:42 -07:00
hniksic
db9de5b075 [svn] Update FSF's address and copyright years. 2005-07-01 19:26:52 -07:00
hniksic
176b61461b [svn] Display smaller download rate numbers with more digits of precision. 2005-07-01 17:40:54 -07:00
hniksic
f238f09492 [svn] Minor improvements to fd_read_hunk. 2005-07-01 16:37:50 -07:00
hniksic
2447fb9a9b [svn] Move extern declarations to .h files. 2005-06-27 11:19:22 -07:00
hniksic
319f52d756 [svn] When the download is finished, print the time the download took.
Always invoke SIZE, not only when continuing the download.
2005-06-25 17:41:09 -07:00
hniksic
bd74e419d6 [svn] Don't pattern-match server redirects. 2005-06-25 08:04:47 -07:00
hniksic
002def87d2 [svn] Rename LARGE_INT to SUM_SIZE_INT, and simplify its handling. 2005-06-25 07:39:51 -07:00
hniksic
74fbb03b10 [svn] Use bool type for boolean variables and values. 2005-06-22 12:38:10 -07:00
hniksic
277e840a0f [svn] Remove K&R support. 2005-06-19 15:34:58 -07:00
hniksic
91479b4c8e [svn] Reset the sleep_adjust limit value for new downloads. Fixes Debian bug
232276.
2005-05-05 02:48:08 -07:00
hniksic
0967c21094 [svn] Fix K&R incompatibilities reported by `gcc -Wtraditional'. 2005-05-03 08:24:30 -07:00
hniksic
9756b0adf5 [svn] Don't ignore timeout when progress=dot. 2005-04-16 13:12:43 -07:00
hniksic
0e3c6ed569 [svn] Clean up prototypes and definitions of ssl_init and ssl_connect.
Don't include SSL headers in retr.c.
2005-04-11 07:33:36 -07:00
hniksic
14a2d25b2e [svn] Better selection of POSIX clocks. 2005-04-08 11:19:20 -07:00
hniksic
2219d47ba3 [svn] Extract timers to a separate file. 2005-04-07 14:37:22 -07:00
hniksic
7c044778bc [svn] Improve built-in memory debugger. 2005-03-20 07:07:40 -08:00