# User-agent rules for search engine crawlers and AI search bots User-agent: * Allow: / Allow: /setup Allow: /creators Allow: /channel/ Allow: /about Allow: /feedback Allow: /faq Disallow: /admin/ Disallow: /api/ Disallow: /auth_success.html # Dedicated rules for AI Search Engines & LLM Indexers User-agent: GPTBot Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / # Sitemap Index Location Sitemap: https://swiftsnip.in/sitemap.xml