Remove Okta Custom Domain URLs From Search Engine Indexing
Last Updated:
Overview
Okta does not control custom domain URLs and cannot directly remove them from search engine indexes. Domain owners must request the removal of URLs from Google search results directly or implement a fully self-hosted Sign-In Widget to manage the robots.txt file.
Applies To
- Okta Identity Engine (OIE)
- Okta Classic Engine
- Okta Custom Domains
- Google Search Console
- Self-Hosted Sign-In Widget
Cause
Only the domain owner can request the removal of URLs from Google search results. When using the Okta hosted sign-in experience or a custom domain managed by Okta, administrators cannot modify the robots.txt file to block search engines due to security restrictions.
Solution
How do administrators remove Okta custom domain URLs from search engine indexing?
Remove an Okta site or specific pages from Google search results by following the official Google documentation or by implementing a fully self-hosted Sign-In Widget to gain full control over the robots.txt file.
- Follow the official Google documentation for removing information from search results: Remove a page hosted on your site from Google.
- Locate the option related to removing a result from a Google Search.
- Implement a fully self-hosted Sign-In Widget to gain full control over the robots.txt file and set rules for search engine crawlers. Review the Embedded Okta Sign-In Widget fundamentals for more information.
