Robots.txt Generator

Generate robots.txt files for your website. Control search engine crawling and indexing.

User Agent (Optional)

Use * for all bots, or specify like Googlebot, Bingbot, etc.

Allow Paths (Optional)

Disallow Paths (Optional)

Sitemap URL (Optional)

Crawl Delay (Optional)

Tip: Leave paths empty to allow all. Use /*.php$ to block all PHP files, or /admin/ to block admin directories.

Use Blog Machine to generate thousands of SEO-optimized blog posts automatically. Auto-post to WordPress. Starting at $1.25 per blog.