Categories

Updated: 02/19/2005

Block Bad Bots

This simple robots.txt file will help deter some of the unwanted bots that spider your site for email addresses and things of that nature that result in spam. This works for all websites and it is not just limited to phpBB. This has also been configured to allow Google AdSense bots to spider your site if you use the program.
©2003-2019 jCay.com