Categories

Updated: 05/07/2002

robots.txt generator

This script lets you browse through your server s directory structure. If a robots.txt is found, it is read and the appropriate allowed/disallowed folders are checked/unchecked. Just change the checkers and hit the update button to update the robots.txt. You may also delete the file or edit the comment. Changes are always made to User-agent: * . Additionally the script warns, if no index-files or htaccess files were found. Updated: Now PHP 4.2 security conform.
©2003-2019 jCay.com