Ray Satiro
242ddfc74e
Change growable string object to null terminate
...
src/ChangeLog
src/url.c
@ src/url.c:
Any function directly writing to the members of a growable string
object must call append_null(). Functions that already do this I've
changed to call append_null(): shorten_length(), append_char(),
append_string(), append_uri_pathel().
- (append_null)
New function to null terminate a growable string object.
- (shorten_length)
New function to shorten the length of a growable string object.
2012-10-13 13:34:23 +02:00
Nikolay Merinov
13c6e7832a
Recieve ftp listing even when .listing file exist and --no-clobber option is given.
2012-10-07 15:22:34 +02:00
Giuseppe Scrivano
22bd8011e8
Fallback to PATH_MAX when pathconf is not available
2012-10-07 13:09:56 +02:00
Giuseppe Scrivano
fe401688a6
Fix a regression when -c and --content-dispositionn are used together.
2012-10-07 13:00:46 +02:00
Nikolay Merinov
022dbcb343
Support new WinNT ftp listing format
2012-09-30 18:18:38 +02:00
Tim Ruehsen
67e6027ea1
Add support for file names longer than MAX_FILE.
2012-09-29 13:47:53 +02:00
Steven Schubiger
e9845d2813
Combine duplicated code.
2012-09-29 11:40:01 +02:00
Ilim Ugur
c24dce1d07
Correct faulty logic in elect_resources and elect_checksums.
2012-09-18 23:39:45 +03:00
Ilim Ugur
e7e869f951
Update ChangeLogs. Add missing prototypes to metalink.c. Remove static variable temp from multi.c.(NOT WORKING)
2012-09-18 01:16:56 +03:00
Ilim Ugur
bfe30ea754
Update ChangeLogs to reflect changes before August 16.
2012-09-14 01:06:40 +03:00
Nguyễn Thái Ngọc Duy
74f6cb8884
Mark more strings for translation
2012-09-02 16:06:24 +02:00
Tim Ruehsen
e2cb2fa2e3
don't error if CA directory is empty
2012-09-02 14:17:50 +02:00
Tim Ruehsen
b718128b4f
gnutls: deinit gnutls_x509_crt_t
2012-09-02 14:16:47 +02:00
Giuseppe Scrivano
06fc1edb54
Remove static modifier for functions used in other modules.
2012-08-28 21:38:12 +02:00
Hrvoje Niksic
85b98d0834
Use hash_table_get instead of hash_table_get_pair.
2012-08-26 11:48:07 +02:00
Ilim Ugur
dcc6abee90
Correct allocation size in interoption availability checks for --metalink.
2012-08-22 12:26:07 +03:00
y-iida@secom.co.jp
4759cf099f
Fix a build error.
2012-08-21 20:46:27 +02:00
Ilim Ugur
4cd6292b31
Parse metalink info to an internal set of structures.
2012-08-20 16:02:27 +03:00
Ilim Ugur
6b59fab021
Correct shallow copying in ftp.c. Correct malloc statement in retr.c. Support multi-thread FTP downloads.
2012-08-18 15:54:38 +03:00
Ilim Ugur
1d18db4bac
Interpret name attribute of file tags in metalink as relative paths. Support -P with metalink downloads.
2012-08-18 02:46:53 +03:00
Ilim Ugur
ed8335aa76
Change --metalink-file to --metalink. Support --quota w/ --metalink. Correct clean_range_res_data(). Add interoption availability checks for --metalink.
2012-08-17 22:53:47 +03:00
Ilim Ugur
87a2b8dcb6
Add header comment to new files. Comment the GSoC code.
2012-08-16 19:14:31 +03:00
Ilim Ugur
a41525e5c2
Transfer handling temp files portion of the code to multi.c.
2012-08-16 16:22:53 +03:00
Ilim Ugur
76790a386a
Add a default value for opt.jobs. Remove a (now) redundant variable.
2012-08-16 15:39:24 +03:00
Ilim Ugur
c25d01feb7
Transfer struct range array to multi.c. Delete to redundant variables in retr.c.
2012-08-16 14:22:08 +03:00
Ilim Ugur
f51826d9d8
Correct a source of memory leak when --jobs is not explicitly specified.
2012-08-15 02:24:12 +03:00
Ilim Ugur
721697aef6
Correct segmentation fault when specifying a non-existing metalink file path/URL.
2012-08-15 01:48:48 +03:00
Ilim Ugur
270460da98
Update man page and --help documentation. Update default value for --retries.
2012-08-15 00:43:52 +03:00
Ilim Ugur
fa9aaf2ce6
Correct two merging mistakes in src/convert.h and src/http.c. Replace bootstrap.
2012-08-14 20:24:18 +03:00
Ilim Ugur
eb01e9d442
Resolve conflicts to complete merging with master branch.
2012-08-14 19:47:52 +03:00
Ilim Ugur
2807c5c56d
Generate random temp file names.
2012-08-13 01:56:02 +03:00
Ilim Ugur
e37ea16957
Update the logic of delete_temp_files() in multi.c.
2012-08-13 01:11:49 +03:00
Ilim Ugur
5abb1dc188
Update initial URL check and final download printing in main.c. Update the logic of merge_temp_files() in multi.c.
2012-08-12 23:57:59 +03:00
Ilim Ugur
54e5b5d373
Add option --metalink-file. Add a few interoption availability checks for --metalink-file.
2012-08-12 23:21:02 +03:00
Ilim Ugur
768202bf88
Assign values to a few uninitialized variables in retrieve_from_file()
2012-08-12 18:30:03 +03:00
Ilim Ugur
5e2c6fefe4
Delete existing temp_ files before starting to download. Retry on failed download or invalid hash using new option --retries.
2012-08-12 03:20:47 +03:00
Ilim Ugur
0ea58b0c31
Remove option --verify. Compare strongest supported hash type to verify files.
2012-08-11 04:47:31 +03:00
Ilim Ugur
3d19087207
Go back to using <hash_type>_stream functions in gnulib. (Reduces a lot of code)
2012-08-11 02:51:09 +03:00
Ilim Ugur
dc7e47d4d1
Correct faulty lengths in verification and faulty logic in case --verify=all.
2012-08-11 01:45:39 +03:00
Ilim Ugur
b1bc6efc8a
Initial working attempt at verifying hashes.
2012-08-10 23:04:58 +03:00
Ilim Ugur
d65343a57b
Correct fread error in metalink.c. - Still computes hash wrong.
2012-08-10 20:39:56 +03:00
Ilim Ugur
68dbb9ead7
Add sha256. Rewrite hash verification code. - not working
2012-08-08 14:20:08 +03:00
Ilim Ugur
98db799759
Initial attempt at verifying hashes. - not working
2012-08-03 20:47:31 +03:00
Ilim Ugur
8cfac52713
Remove cat and rm commands. Few corrections with ifdef macros.
2012-08-01 20:35:25 +03:00
Ilim Ugur
11d09dd001
Add FTP support to metalink code. (for single-threaded downloads only)
2012-08-01 00:37:40 +03:00
Ilim Ugur
159c371492
Update fallbacking for metalink: next source goes on from where the previous one failed.
2012-07-31 17:25:21 +03:00
Ilim Ugur
38b1df95f9
Make thread support optional. - No check for semaphore in configure.ac.
2012-07-29 23:43:03 +03:00
Ilim Ugur
f07e0a67b4
Have wget --version list metalink as supported.
2012-07-28 03:15:42 +03:00
Ilim Ugur
47bd180ab0
Transfer struct range to wget.h. Make metalink code optional.
2012-07-27 17:08:26 +03:00
Ilim Ugur
198acf4844
Do not fallback to next resource if there is an IO error. Delete a few redundant variables.
2012-07-26 21:29:48 +03:00
Ilim Ugur
5090e0c433
Set a minimum chunk size.
2012-07-25 17:41:53 +03:00
Ilim Ugur
bb28bda88f
Accept metalink files specified as URLs. Better counting of the files downloaded in retrieve_from_file.
2012-07-25 01:05:04 +03:00
Ilim Ugur
9fd1e97e40
Correct minor mistakes in syntax. Prevent a leak in http_loop.
2012-07-24 23:59:47 +03:00
Ilim Ugur
40493a76fe
Redesign the code block in retrieve_from_file.
2012-07-24 19:03:51 +03:00
Ilim Ugur
6f102902ad
Make metalink check in configure.ac automatic.
2012-07-24 00:52:17 +03:00
Ilim Ugur
2f6ef8922b
Use pkg-config of libmetalink in configure.ac
2012-07-22 12:44:33 +03:00
Ilim Ugur
39aaaf57f8
Try using pkg-config of libmetalink in configure.ac - error during make
2012-07-22 00:33:20 +03:00
Ilim Ugur
5f4debb6f8
Update configure.ac and src/Makefile.am
2012-07-21 00:40:23 +03:00
Ilim Ugur
2b8e2f8879
Initial attempt at fallbacking in threaded downloads.
2012-07-15 23:59:54 +03:00
Ilim Ugur
b5a8d663f7
Fix No URLs found in <file> message printed after download.
2012-07-15 23:31:47 +03:00
Ilim Ugur
44f75a1955
Separate segmented download and fallbacking.
2012-07-15 00:48:28 +03:00
Ilim Ugur
f4c42b94d8
Remove obsolete retry tag in retr.c
2012-07-11 01:51:34 +03:00
Ilim Ugur
1e1054db8a
Initial attempt at incorporating sems logically.
2012-07-11 01:07:44 +03:00
Ilim Ugur
5c608df4e1
Update if statement involving hs->restval http.c:2859
2012-07-10 21:51:41 +03:00
Ilim Ugur
8bc3dbf2d4
Corrected the dual usage mistake of loop variable in retr.c.
2012-07-10 12:26:57 +03:00
Ilim Ugur
7ccf4210f6
Corrected faulty logic on thread creation. Segments recorded separately then merged.
2012-07-10 11:32:57 +03:00
Ilim Ugur
8c66c94989
Initial attempt at achieving segmented downloading from multiple resources.
2012-07-09 23:46:11 +03:00
Steven Schubiger
31674653eb
Include missing header.
2012-07-08 11:36:54 +02:00
Steven Schubiger
c32ef46f99
Fix header comments for exits.h and exits.c.
2012-07-08 11:30:53 +02:00
Tim Ruehsen
4fe805a7ec
Add support for RFC 2617 Digest Access Authentication
2012-07-07 10:58:30 +02:00
Giuseppe Scrivano
172a117647
Fix some log messages.
2012-07-07 10:27:09 +02:00
Micah Cowan
15bfd733f9
Fix some very broken pconn-freeing logic (suspect more like this...).
2012-07-05 18:22:28 -07:00
Ilim Ugur
f63e2230d7
Implemented resource fallbacking during metalink download. No -c behavior.
2012-07-06 02:53:03 +03:00
Ilim Ugur
693b791082
A rough initial attempt at achieving Goal #2 .
2012-07-05 17:36:51 +03:00
Ilim Ugur
02d225b5ca
Merge http://addictivecode.org/git/parallel-wget into parallel-wget
2012-07-03 15:59:16 +03:00
Micah Cowan
671d681304
Fix bad persistence check.
2012-07-02 16:06:37 -07:00
Ilim Ugur
6ceea0d064
retrieve_from_file in retr.c now checks for metalink files.
2012-07-03 00:51:53 +03:00
Micah Cowan
fc220632fb
Merge Giuseppe's parallel-wget patch.
2012-06-30 16:46:29 -07:00
Giuseppe Scrivano
ae0598df9b
Check for fclose errors.
2012-06-17 22:24:32 +02:00
Giuseppe Scrivano
90e9d9e1bd
Move cleanup related code to `cleanup'
2012-06-16 12:20:33 +02:00
Giuseppe Scrivano
93720df4c8
Do not close stdout twice.
2012-06-16 12:15:03 +02:00
Giuseppe Scrivano
aa2f287c68
help: Move --report-speed under 'Logging and input file'.
2012-06-09 13:13:28 +02:00
Giuseppe Scrivano
6b5c0c742d
Rename, again, --reports-bits to report-speed.
2012-06-06 20:41:25 +02:00
Giuseppe Scrivano
96418c6885
Rename --bits to --report-bps.
2012-06-06 14:10:07 +02:00
Tim Ruehsen
321b5dce85
* fix a few little dissonances
2012-06-04 22:05:40 +02:00
Giuseppe Scrivano
6741bc4233
Revert 2b1dd8d23b
2012-06-02 19:36:45 +02:00
Gijs van Tulder
1d14c18d7f
warc: Fix segfault if CDX record is not found.
2012-06-02 14:26:18 +02:00
Ángel González
ee9d4a9057
fix segfault on wrong urls (bug 36570)
2012-06-02 13:33:54 +02:00
Steven Schweda
2b1dd8d23b
Guard inclusion of some headers.
2012-05-26 14:39:13 +02:00
Mike Frysinger
639a454528
warc: use the right type for the gzip stream
2012-05-26 14:05:56 +02:00
Giuseppe Scrivano
9cc514d21c
Use the right type as result from readline.
2012-05-26 02:55:53 +02:00
Tim Ruehsen
370f96d36c
gnutls: honor the specified timeout value
...
* gnutls.c (wgnutls_poll): Honor the specified `timeout' value.
(wgnutls_peek): Likewise.
2012-05-21 22:54:41 +02:00
illusionoflife
e93bb4fa28
Remove unused arguments.
2012-05-20 21:02:25 +02:00
Giuseppe Scrivano
8ac9c05fc0
warc: Cut long lines to 80 columns.
2012-05-18 11:28:49 +02:00
Tim Ruehsen
2e86829809
removed 'const' warnings.
...
* hash.h (hash_table_put): Make argument "value" const.
* hash.c (hash_table_put): Make argument value const. Cast `value' to
void.
* http.c (request_set_header): Make argument `name' const. Cast `value'
and `name' to void*.
(request_remove_header): Make argument `name' const.
* url.c (url_file_name): Make `index_filename' static.
* warc.h (warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
* warc.c (warc_write_date_header): Make the `timestamp' argument const.
Make `extension' const.
(warc_write_cdx_record): Make `url', `timestamp', `mime_type',
`payload_digest', `redirect_location', `warc_filename', response_uuid'
arguments const. Make `checksum' const.
2012-05-14 23:20:10 +02:00
Tim Ruehsen
d19cc259cb
gnutls: do not call fcntl in a loop.
...
* gnutls.c (wgnutls_read_timeout): removed warnings, moved fcntl stuff
outside loop.
2012-05-14 22:18:41 +02:00
Tim Ruehsen
0b4c04b583
gnutls: remove deprecated gnutls types.
2012-05-13 16:03:39 +02:00
Gijs van Tulder
f5a1097871
Add support for -accept-regex and --reject-regex.
2012-05-09 21:18:23 +02:00
Tim Ruehsen
0aa3c5d33c
Fix some compiler warnings.
2012-05-05 15:24:35 +02:00
Tim Ruehsen
378c203079
Use empty query in local filenames.
2012-04-24 21:46:06 +02:00
