GPTBot: https://openai.com/gptbot ClaudeBot: https://www.anthropic.com/claude PerplexityBot: https://www.perplexity.ai/bot CCBot: https://commoncrawl.org