User-agent: * Allow: / Disallow: /api/* Disallow: /websiteapi/* Disallow: /static/* Disallow: /share/* Disallow: /login/* Disallow: /callback* Disallow: /oauth/* Disallow: /create/* Disallow: /preview/* Disallow: /form/* Disallow: /subscribe/* Disallow: /subscribecenter* Disallow: /upgrade* Disallow: /dev/* # 分享出来的 markdown 文章页(/artifact/:token)由 server 直接渲染成带正文的可索引页面, # 这里显式放行,防止以后有人给 User-agent: * 加规则时顺手把它关掉。 Allow: /artifact/ # AI search bots — explicitly allowlisted so the GEO citation flow won't # silently degrade if a future User-agent: * tweak adds noindex / disallow. # These bots are already implicitly allowed by the wildcard above; the # explicit blocks just lock the contract in. User-agent: GPTBot Allow: / Disallow: /api/* Disallow: /websiteapi/* User-agent: ChatGPT-User Allow: / Disallow: /api/* Disallow: /websiteapi/* User-agent: ClaudeBot Allow: / Disallow: /api/* Disallow: /websiteapi/* User-agent: anthropic-ai Allow: / Disallow: /api/* Disallow: /websiteapi/* User-agent: PerplexityBot Allow: / Disallow: /api/* Disallow: /websiteapi/* User-agent: Google-Extended Allow: / Disallow: /api/* Disallow: /websiteapi/* User-agent: Applebot-Extended Allow: / Disallow: /api/* Disallow: /websiteapi/* User-agent: Bytespider Allow: / Disallow: /api/* Disallow: /websiteapi/* Sitemap: https://kollab.im/sitemap.xml