Where does robots.txt need to go?

At the root of your domain, e.g. https://example.com/robots.txt — it won't be recognized anywhere else.

Does robots.txt guarantee pages won't be indexed?

No — it only requests that crawlers not access certain paths. Use a noindex meta tag for pages that must never appear in search results.

Yes, adding a Sitemap directive helps search engines discover your sitemap.xml automatically.

Build a valid robots.txt with an interactive rule builder.

Private by default Instant results No signup

Processed locally

Your data never leaves your browser tab.

Multiple rules

Different directives for different crawlers.

Instant preview

See the generated robots.txt update live.

Generate title, description, OG and Twitter meta tags.

Create Open Graph tags for rich social previews.

Generate a sitemap.xml from a list of URLs.

Turn any title into a clean, SEO-friendly slug.