Tuesday, 21 November 2006

Robot abuse

Time for a quick clue stick beating:

Don't list sensitive files / folders in your robots.txt file

More info can be found in The Web Robots FAQ.

Also make sure you've turned directory browsing off and protected anything sensitive with even basic access controls, the Internet's a wild place. Very basic stuff really.