# Best Adobe Commerce Maintenance Companies - robots.txt # B2B TechSelect Research # --- Search engines --- User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: DuckDuckBot Allow: / User-agent: Slurp Allow: / User-agent: YandexBot Allow: / # --- AI search crawlers --- User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: GPTBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / User-agent: anthropic-ai Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: cohere-ai Allow: / User-agent: CCBot Allow: / User-agent: Bytespider Allow: / # --- Default --- User-agent: * Allow: / # --- Sitemaps & AI resources --- Sitemap: https://best-adobe-commerce-maintenance-companies.com/sitemap.xml # Note: If model-training access is not desired, GPTBot can be disallowed # while keeping OAI-SearchBot allowed to retain ChatGPT Search visibility: # # User-agent: GPTBot # Disallow: / # # User-agent: OAI-SearchBot # Allow: /