Categories

Updated: 03/07/2008

robots.spider(tm)

robots.spider(tm) will read a robots.txt file and compare it with the pages on the site. Search engines spider the site. If there are no references to a directory or file, it will not be indexed. robots.txt files should not refer to unreferenced content because it allows other viewers to identify areas of your site that you don''t want indexed. The read depth limits the number of pages scanned.
Similar Scripts for "robots.spider(tm)"

Compare and Merge

Compare and Merge is a visual file comparison utility. It lets you see the differences between text files, and makes it easy to resolve these differences. For programmers, web developers, and anyone else who works with multiple revisions of files. ...

FSGuide - commander of the web

FSGuide is a two-panel file management tool that helps performing advanced file operations through the web. Features: user authentication, access control lists, 2-panel layout, bookmarks, filelist, file uploader (and run any application after upload!...

Trellian SiteLoad

Trellian SiteLoad is a state of the art website and mirror application. It is the smart way to upload and maintain your web site. SiteLoad automatically keeps track of all changes to your website and ONLY uploads new, or changed files. The versatile ...

Beyond Compare

Beyond Compare is a directory and file compare utility. Synchronize files between laptop and PC, home and office, etc. Compare directory trees side-by-side with mismatches highlighted. Display text files side-by-side with changes highlighted. Gre...

Total Commander

A file manager for Windows platforms. Features: Two file windows side by side; Multiple language support; Enhanced search function; Compare files / synchronize directories; Quick View panel with bitmap display; ZIP, ARJ, LZH, RAR, UC2, TAR, GZ, CAB, ...
©2003-2008 jCay.com