User-agent: * Allow: / Disallow: /mcp # AI assistants and AI search are welcome (same rules) User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot Allow: / Allow: /llms.txt Disallow: /mcp Sitemap: https://www.ferntool.com/sitemap.xml