Skip to content

docs: explain that default domains are noindexed with a custom domain - #8590

Draft
mintlify[bot] wants to merge 1 commit into
mainfrom
autopilot/ea2684e1
Draft

mintlify[bot] wants to merge 1 commit into
mainfrom
autopilot/ea2684e1

Conversation

@mintlify

@mintlify mintlify Bot commented Nov 18, 2026 •

Copy link
Copy Markdown
Contributor

Custom domain docs, the help center article on indexed default subdomains, and the publish/domain agent topic now say Mintlify sends X-Robots-Tag: noindex from default Mintlify addresses when a site has a custom domain at a domain or subdomain. Subpath sites keep the old behavior.

Based on a merged change that stops search engines from indexing default Mintlify addresses for sites hosted on a custom domain. Swept "noindex", "default address", "crawlable" and "mintlify.site" across English docs, mint-instructions and the agent skill (no skill changes needed).


Note

Low Risk
Documentation-only updates to SEO and custom-domain guidance; no application code changes.

Overview
Updates user-facing docs to match new platform behavior: default <subdomain>.mintlify.site URLs are no longer described as automatically crawlable when you use a custom domain.

For domain/subdomain hosting, docs now state Mintlify returns X-Robots-Tag: noindex on the default address so search engines stop indexing it (while the URL stays reachable). Subpath setups are called out as unchanged—the default address can still be indexed.

Touched pages: the custom domain canonical Note, the help center article on duplicate default URLs in search (reframed around when noindex applies and updated keywords), and the mint-instructions publish/domain rule for agents.

Reviewed by Cursor Bugbot for commit a9d2b62. Bugbot is set up for automated code reviews on this repo. Configure here.

@mintlify
mintlify Bot requested a review from N43527 November 18, 2026 22:13
@mintlify

mintlify Bot commented Nov 18, 2026 •

Copy link
Copy Markdown
Contributor Author

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated
Mintlify Docs 🟢 Ready View Preview Nov 18, 2026, 10:14 PM

💡 Tip: Enable Automations to automatically generate PRs for you.

@mintlify

mintlify Bot commented Nov 19, 2026

Copy link
Copy Markdown
Contributor Author

A later merged change reverted the behavior this PR documents: Mintlify no longer sends X-Robots-Tag: noindex from default Mintlify addresses when a site has a custom domain. The current docs on main (default address stays reachable and crawlable) are accurate again, so every change in this PR is now wrong. I recommend closing this PR without merging.

This branch was successfully deployed

1 active deployment
staging — a9d2b62e Deployed Nov 18, 2026 by mintlify[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant