Robots and Indexing Control Plan
Act as an SEO technical specialist and search engine indexing expert.
- Category
- SEO & Content Discoverability
- Output
- Markdown
- Fields
- 3
- seo
- documentation
- step-by-step
- best-practices
- risk-mitigation
- action-planning
Prompt
Act as an SEO technical specialist and search engine indexing expert. Create a precise, actionable indexing control plan for a website based on the details provided below.
Context:
- Site Type: Site Type
- Pages/URLs to Index: Pages to Index
- Pages/URLs to Exclude: Pages to Exclude
Instructions:
1. Evaluate each page or URL group and assign the most appropriate indexing control method (robots.txt, meta noindex, canonical tag, or authentication/password protection). Explain the rationale for each choice.
2. Provide exact, copy-paste-ready directives or HTML meta tags for implementation. If a platform is specified, tailor the steps accordingly; otherwise, provide standard, platform-agnostic examples.
3. Identify and explain the most dangerous mistakes that could accidentally hide valuable pages (e.g., blocking JS/CSS in robots.txt, using robots.txt to block noindex pages, noindexing revenue-driving pages, or conflicting directives).
4. Outline a clear, step-by-step verification process using Google Search Console to confirm indexing status and catch errors.
5. Create a quick-reference decision matrix summarizing "Use X when Y" for common indexing scenarios.
6. Rely strictly on the provided information. Do not invent URLs, platform specifics, or search engine guidelines. If any detail is ambiguous or missing, list it under a short "Open Questions" section instead of guessing.
Return your response using this structure:
- Recommended Indexing Strategy
- Exact Implementation Code/Directives
- Critical Pitfalls & Risk Mitigation
- Search Console Verification Steps
- Quick-Reference Decision Matrix
- Open Questions / Needs Confirmation
Format the response in clear Markdown. Keep explanations concise and focused on preventing accidental de-indexing of important pages.
How to use this prompt
- Fill in the fields above. Required ones are marked with *.
- Check the prompt preview: your answers appear highlighted in place.
- Select Copy prompt and paste it into ChatGPT, Claude, Gemini or any AI assistant.
More SEO & Content Discoverability prompts
- AI Search Optimization Get Cited by Chatgpt PerplexityHelp me structure and refine my content so that AI answer engines (such as ChatGPT, Perplexity, Google AI Overviews, and Gemini) are highly likely to cite…
- Keyword Intent ClassifierAnalyze the provided keyword list, classify each keyword by search intent, map it to a marketing funnel stage, recommend a suitable page format, and assign…
- Competitor Keyword Gap FinderIdentify high-value keyword gaps between my website and a set of specified competitors, then provide a prioritized action plan for content creation.
- Competitor SEO Gap AnalysisConduct a structured competitor SEO gap analysis based on the context provided.
- Content Gap AnalysisPerform a content gap analysis to help the user build topical authority and improve search rankings.
- Diagnose a Traffic DropSystematically diagnose a recent drop in organic search traffic and provide a clear, actionable recovery path.