Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable. By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with
RoboGen
(Popularity: ) : RoboGen is a visual editor for Robot Exclusion Files. It allows the user to quickly and easily create the ROBOTS.TXT ... Robot-Analyzer Professional V2.1
(Popularity: ) : Robot-Analyzer Professional works together with Search Engine optimization tools to specifically guide Search Engine spiders to relevant areas of your ... Page Promoter
(Popularity: ) : Page Promoter is an ultimate URL registration, search engine optimization and promotion tool for submitting Web sites to thousands search ... NetPromoter Pack
(Popularity: ) : NetPromoter is an ultimate Search Engine Optimization, Web site promotion and site statistics software package, which copes with an entire ... A1 Sitemap Generator
(Popularity: ) : Create text, HTML, RSS and XML sitemaps (Yahoo, Google etc.) to help search engines crawl and index your website. Near-endless ... Robot-Manager
(Popularity: ) : Manage and track visits by robots, spiders and crawlers to your website. Identify which spiders visited, when they visited, and ... AtomPark HTML Password Protector
(Popularity: ) : Will you have to lay down thinking password protected web pages and HTML documents are just not for you? No ...
User reviews
Similar scripts
Easy Robots.txt Generator
(Popularity: ) : The robots.txt file is the first thing search engine "spiders" look for when indexing a website. The robots.txt file tells ... robots.txt generator
(Popularity: ) : The robots.txt generator is a script that is created using PHP programming with which you will be able to browse ... robots.txt Tools And Tutorial
(Popularity: ) : This site provides the tools to create and validate robots. It searches the engine spiders and similar for robots the ... robots/text generator
(Popularity: ) : robots/text generator is a multi-platform compatible script. It runs a check if robots.txt exists in your server's directory structure. If ... I, Robot
(Popularity: ) : From this tutorial, you will gain the cost effective way to secure particular website pages from spiders, bots, crawlers, robots ... JillyBoel Spambot Foiler
(Popularity: ) : JillyBoel Spambot Foiler is a counter to Spambots that attempt to collect email addresses from your website. This is achieved ... Onix Full Text Indexing and Retrieval Toolkit
(Popularity: ) : Onix is a high performance full-text indexing and retrieval engine toolkit. Onix provides access to one of the fastest text ... Web dev hosted tools
(Popularity: ) : Tools include a link popularity tool, Robots.txt file generator, meta tag analyzer, screen resolution validator, .htaccess generator and more. MySQL to TXT for Excel
(Popularity: ) : MySQL to TXT for Excel is a tool for database used for formatting the MySQL forms into Excel outputs. Supports ... TXT Generator Class
(Popularity: ) : TXT Generator Class is a very simple Test generator which can generates test files without any text editors. This script ...
Screenshot
Rate me
supported os's
Windows 98 Windows Me Windows NT Windows 2000 Windows XP Windows 2003
Software Library
) : RoboGen is a visual editor for Robot Exclusion Files. It allows the user to quickly and easily create the ROBOTS.TXT ...
