# Growthr — robots.txt # https://growthr.com/robots.txt User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / # Private paths (proposals, reports, archives) are not listed here: listing them # would advertise them. They are kept out of indexes by X-Robots-Tag: noindex and # 404 rules in .htaccess instead. # AI and answer-engine crawlers, named explicitly. A named group ignores the * # block entirely, so the Content-Signal line is repeated here. User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Claude-Web User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: GoogleOther User-agent: Applebot User-agent: Applebot-Extended User-agent: Bingbot User-agent: cohere-ai User-agent: CCBot User-agent: Amazonbot User-agent: Meta-ExternalAgent User-agent: Bytespider Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / # Sitemap Sitemap: https://growthr.com/sitemap.xml # LLM content files (https://llmstxt.org) # https://growthr.com/llms.txt # https://growthr.com/llms-full.txt