To my surprise, they seem to try to enter a /robots.txt subdirectory
that's how they decide if it is a file or a directory... if it is a
file, then they download it...
To my surprise, they seem to try to enter a /robots.txt subdirectory
that's how they decide if it is a file or a directory... if it is a
file, then they download it...
Yes, I suspected that might be the case... I wonder, though, if they
do anything special if the cd succeeds
or if they just conclude "not a file" and skip it. (According to the
spec, they shouldn't look for anything inside that directory, if it exists.)
Sysop: | Coz |
---|---|
Location: | Anoka, MN |
Users: | 2 |
Nodes: | 4 (0 / 4) |
Uptime: | 17:31:49 |
Calls: | 97 |
Files: | 4,636 |
Messages: | 216,466 |