# YJTOON robots.txt # NOTE: Cloudflare prepends its own managed robots.txt block (AI-bot + content # signals) to this file at the edge. For Googlebot/Bing the first matching # User-agent:* group wins, so the Disallow rules below only take full effect # if the Cloudflare managed block is disabled. HTTP-level blocks in .htaccess # (dev/, data/, db/, content/, etc.) remain the authoritative protection. User-agent: * Allow: / # Core Sitemap: https://yjtoon.com/sitemap.xml # No indexing of internal Disallow: /dev/ Disallow: /data/ Disallow: /db/ Disallow: /content/ Disallow: /cgi-bin/ Disallow: /*.php$ Disallow: /_backups/ Disallow: /logs/