shen/Hextra-AI-Insight-Daily
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update robots.txt

Browse Source
This commit is contained in:
何夕2077
2025-11-04 20:28:11 +08:00
committed by GitHub
parent f6b14855d4
commit 5c783f7369
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
layouts/robots.txt
View File

@@ -1,7 +1,7 @@
User-agent: * User-agent: *
# 不允许抓取 Cloudflare 的内部目录 # 不允许抓取 Cloudflare 的内部目录
Disallow: /cdn-cgi/ # Disallow: /cdn-cgi/
# 新增：不允许抓取 /en 和 /ja 目录 # 新增：不允许抓取 /en 和 /ja 目录
# Disallow: /en/ # Disallow: /en/