Tools
Robots.txt Generator
Easily generate a robots.txt file to control how search engines crawl and index your website.
封鎖 AI 爬蟲
勾選要拒絕的 AI 爬蟲。未勾選的爬蟲沿用上方預設規則。
AI 搜尋
模型訓練
使用者代理
Common Crawl
robots.txt Output
已複製到剪貼簿
Easily generate a robots.txt file to control how search engines crawl and index your website.