shen/Hextra-AI-Insight-Daily
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update robots.txt

Browse Source
This commit is contained in:
何夕2077
2025-11-04 18:14:17 +08:00
committed by GitHub
parent 003c3b50f0
commit 3cb52ea4fd
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
layouts/robots.txt
View File

@@ -4,8 +4,8 @@ User-agent: *
Disallow: /cdn-cgi/ Disallow: /cdn-cgi/
# 新增：不允许抓取 /en 和 /ja 目录 # 新增：不允许抓取 /en 和 /ja 目录
Disallow: /en/ # Disallow: /en/
Disallow: /ja/ # Disallow: /ja/
# 站点地图 # 站点地图
Sitemap: https://ai.hubtoday.app/sitemap.xml Sitemap: https://ai.hubtoday.app/sitemap.xml