Free Robots.txt Generator

Search Engine Optimization

Robots.txt Generator


Default - All Robots are:  
    
Crawl-Delay:
    
Sitemap: (leave blank if you don't have) 
     
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
Restricted Directories: The path is relative to root and must contain a trailing slash "/"
 
 
 
 
 
 
   



Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.


About Robots.txt Generator

Robots.txt Generator is a free tool for webmasters that allows you to create Robots.txt files online. It’s quick and easy to use, saving webmasters the time it would take to create a file from scratch manually. Robots.txt generator is fully customizable and allows you to customize the period for which the file should be valid or disabled, as well as the conditions under which it should be disabled. You can also choose not to have any conditions set at all, which allows you to allow all crawlers through your site without having any restrictions on them whatsoever.