To my surprise, they seem to try to enter a /robots.txt subdirectory
that's how they decide if it is a file or a directory... if it is a
file, then they download it...
To my surprise, they seem to try to enter a /robots.txt subdirectory
that's how they decide if it is a file or a directory... if it is a
file, then they download it...
Yes, I suspected that might be the case... I wonder, though, if they
do anything special if the cd succeeds
or if they just conclude "not a file" and skip it. (According to the
spec, they shouldn't look for anything inside that directory, if it exists.)
Sysop: | Coz |
---|---|
Location: | Anoka, MN |
Users: | 2 |
Nodes: | 4 (0 / 4) |
Uptime: | 190:45:46 |
Calls: | 337 |
Files: | 5,979 |
Messages: | 231,036 |