Robots.txt Generator

Default - All Robots are:

Crawl-Delay:

Sitemap: (leave blank if you don't have)

Search Robots:	Google
	Google Image
	Google Mobile
	MSN Search
	Yahoo
	Yahoo MM
	Yahoo Blogs
	Ask/Teoma
	GigaBlast
	DMOZ Checker
	Nutch
	Alexa/Wayback
	Baidu
	Naver
	MSN PicSearch

Restricted Directories:	The path is relative to root and must contain a trailing slash "/"

Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.

Robots.txt (Robots) is a text file (.txt) with UTF-8 encoding, which is located in the root (root directory) of the site and serves to indicate the permissions and prohibitions of indexing for search robots.

Composing the correct Robots.txt for your website is the first step towards the SEO promotion of your website. With this tool, you will be able to create a file, observing all the rules of the search engines. The main advantage of this tool is that here you can immediately set up indexing rules for all known search robots.

Robots.txt Generator

LATEST BLOGS

SEARCH

Popular SEO Tools