mirror of
https://github.com/mirror/wget.git
synced 2025-02-19 08:10:21 +08:00
93e5a97f25
* fuzz/Makefile.am: Add wget_robots_fuzzer * fuzz/wget_robots_fuzzer.c: New fuzzer * fuzz/wget_robots_fuzzer.in: Initial corpora
15 lines
151 B
Plaintext
15 lines
151 B
Plaintext
User-
|
|
Disallow: : *
|
|
Disallow: /x
|
|
Disallow: / *
|
|
DisallowDisallw: : *
|
|
Disallow: /x*
|
|
|
|
*
|
|
Dix
|
|
Disallow: zw *
|
|
Disallow: : *
|
|
Disallow:t:w
|
|
Disallow: ox
|
|
Diwww
|