# Clevis AI — robots.txt
#
# Search and AI/answer-engine crawlers are explicitly welcome on the public
# marketing + content surface. The crawlers below are the ones we most want
# reading us: Googlebot, Bingbot, GPTBot, OAI-SearchBot, ChatGPT-User,
# ClaudeBot, Claude-Web, PerplexityBot, Google-Extended, Applebot-Extended,
# Twitterbot, facebookexternalhit — all governed by the single group below.
#
# Authenticated app routes serve an empty JS shell to crawlers (audit S7);
# disallowing them keeps crawl budget on the content that can actually rank.
# ProtectedRoute also emits <meta name="robots" content="noindex"> as
# defense-in-depth.

User-agent: *
Allow: /
Disallow: /dashboard
Disallow: /assistant
Disallow: /accounting
Disallow: /marketing
Disallow: /carbon
Disallow: /agronomy
Disallow: /regional-intelligence
Disallow: /seeds
Disallow: /inputs
Disallow: /maps
Disallow: /import
Disallow: /notifications
Disallow: /subscription
Disallow: /add-acres
Disallow: /profile
Disallow: /brief
Disallow: /admin/
Disallow: /onboarding
Disallow: /welcome
Disallow: /welcome-pro
Disallow: /choose-plan
Disallow: /auth
Disallow: /verify-email
Disallow: /forgot-password
Disallow: /reset-password
Disallow: /confirm-newsletter
Disallow: /government-programs

Sitemap: https://clevis.ai/sitemap.xml