# AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot, Bingbot, # and any others) are intentionally ALLOWED. They are covered by the `User-agent: *` # group below, which permits the whole site apart from the infrastructure paths. # There are deliberately no per-bot groups: a crawler obeys only the single most # specific group that matches it, so adding one per bot would silently drop the # Disallow rules below for that bot. Do not add a Disallow for these agents # without an explicit decision - it directly suppresses AI-assistant visibility. User-agent: * Disallow: /.github/ Disallow: /.phan/ Disallow: /assets/ Disallow: /backup/ Disallow: /bin/ Disallow: /cache/ Disallow: /logs/ Disallow: /system/ Disallow: /tests/ Disallow: /tmp/ Disallow: /user/ Disallow: /vendor/ Disallow: /webserver-configs/ Allow: /user/pages/ Allow: /user/themes/ Allow: /user/images/ Allow: / Allow: *.css$ Allow: *.js$ Allow: /system/*.js$ Sitemap: https://omnivery.com/sitemap.xml Sitemap: https://omnivery.com/docs/sitemap.xml