User-agent: * Allow: / # Discourage scraping of large dynamic indexes Disallow: /api/ # AI training and dataset crawlers — opt out (operator preference, not a security control) User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: anthropic-ai Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Applebot-Extended Disallow: / Sitemap: https://research.zhouyitelecom.org/sitemap-index.xml