# robots.txt - 新游纪城市定向挑战赛官网 # https://event.xin-youji.com # 通用规则:允许所有爬虫访问 User-agent: * Allow: / Disallow: /admin/ Disallow: /api/ Crawl-delay: 10 # Sitemap Host: event.xin-youji.com Sitemap: https://event.xin-youji.com/sitemap.xml # ----------------------------------------------- # AI 大模型爬虫(显式允许,提升收录权重) # ----------------------------------------------- # OpenAI GPTBot User-agent: GPTBot Allow: / # OpenAI ChatGPT-User (browsing plugin) User-agent: ChatGPT-User Allow: / # Google Gemini / Bard User-agent: Google-Extended Allow: / # Anthropic ClaudeBot User-agent: ClaudeBot Allow: / # Meta AI User-agent: Meta-ExternalAgent Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # Bytedance (字节跳动 AI 产品) User-agent: Bytespider Allow: / # Baidu AI (文心一言 / 百度 AI 搜索) User-agent: Baiduspider Allow: / # Microsoft Bing AI / Copilot User-agent: Bingbot Allow: / # llms.txt 专为大模型设计的站点概述文件(摘要版) # 访问地址: https://event.xin-youji.com/llms.txt # llms-full.txt 专为大模型设计的全站完整内容文件(详细版) # 访问地址: https://event.xin-youji.com/llms-full.txt