# https://www.robotstxt.org/robotstxt.html User-agent: GPTBot Disallow: User-agent: OAI-SearchBot Disallow: User-agent: ChatGPT-User Disallow: User-agent: ClaudeBot Disallow: User-agent: Claude-SearchBot Disallow: User-agent: PerplexityBot Disallow: User-agent: Google-Extended Disallow: User-agent: Applebot-Extended Disallow: User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: * Disallow: /source/ Disallow: /i/ Disallow: /user/ Disallow: /fr/user/ Disallow: /es/user/ Disallow: /pt/user/ Disallow: /pt-BR/user/ Disallow: /de/user/ Disallow: /my-bets Disallow: /fr/my-bets Disallow: /es/my-bets Disallow: /pt/my-bets Disallow: /pt-BR/my-bets Disallow: /de/my-bets Disallow: /profile Disallow: /fr/profile Disallow: /es/profile Disallow: /pt/profile Disallow: /pt-BR/profile Disallow: /de/profile # Block crawler-discovered route templates (e.g. /guides/$slug) that leak from the client JS # bundle. After path normalization the "$" becomes "%24"; no real URL contains it, so this is # safe. "$" is the robots end-of-URL anchor, hence we match the encoded form. Disallow: /*%24 Sitemap: https://clutch.vip/sitemap.xml