Leaderboard ad · 728×90

robots.txt Generator

Configure User-agent, Allow / Disallow rules and a sitemap to generate a ready-to-deploy robots.txt.

Defaults to * (all crawlers) when empty.

Preview
User-agent: *
Disallow: /admin/
Disallow: /api/
In-content ad · responsive