# Robots.txt para SysJuros - Otimizado para SEO e IA # https://lp.sysjuros.com # Permitir todos os crawlers de busca User-agent: * Allow: / Disallow: /api/ Disallow: /_next/ Disallow: /private/ # Google User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-News Allow: / # Bing User-agent: Bingbot Allow: / User-agent: MSNBot Allow: / # Yahoo User-agent: Slurp Allow: / # Yandex User-agent: Yandex Allow: / # Baidu User-agent: Baiduspider Allow: / # DuckDuckGo User-agent: DuckDuckBot Allow: / # ===== CRAWLERS DE IA ===== # OpenAI / ChatGPT User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / # Anthropic / Claude User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / User-agent: ClaudeBot Allow: / # Google AI / Bard / Gemini User-agent: Google-Extended Allow: / # Meta AI User-agent: FacebookBot Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: meta-externalagent Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # Cohere AI User-agent: cohere-ai Allow: / # Microsoft Copilot User-agent: Copilot Allow: / # Amazon / Alexa User-agent: ia_archiver Allow: / # Apple / Siri User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Common Crawl (usado por muitas IAs) User-agent: CCBot Allow: / # Outros crawlers de IA User-agent: omgili Allow: / User-agent: omgilibot Allow: / User-agent: YouBot Allow: / # Sitemap Sitemap: https://lp.sysjuros.com/sitemap.xml # Host preferido Host: https://lp.sysjuros.com