# AI discovery resources # LLM guide: https://autoservisnaoprema.com/llms.txt # Full catalog text: https://autoservisnaoprema.com/llms-full.txt # Product feed JSON: https://autoservisnaoprema.com/ai-products.json # AI discovery sitemap: https://autoservisnaoprema.com/ai-sitemap.xml # Sitemap index: https://autoservisnaoprema.com/sitemap_index.xml # Shared exclusions for crawlers allowed on the site: # - large attachment downloads (?attachment_id=&download_file=) are file downloads, not pages # - facet/filter URLs are uncached, combinatorially infinite duplicates # To block a crawler from everything, use "Disallow: /" instead. # AI Crawlers - allowed for discovery User-agent: GPTBot Allow: / Disallow: /wp-admin/ Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= User-agent: Claude-Web Allow: / Disallow: /wp-admin/ Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= User-agent: Google-Extended Allow: / Disallow: /wp-admin/ Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= User-agent: PerplexityBot Allow: / Disallow: /wp-admin/ Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= User-agent: anthropic-ai Allow: / Disallow: /wp-admin/ Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= User-agent: CCBot Allow: / Disallow: /wp-admin/ Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= User-agent: OAI-SearchBot Allow: / Disallow: /wp-admin/ Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= # Additional AI crawlers - allowed for discovery User-agent: ChatGPT-User Allow: / Disallow: /wp-admin/ Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= User-agent: ClaudeBot Allow: / Disallow: /wp-admin/ Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= User-agent: Bytespider Allow: / Disallow: /wp-admin/ Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= User-agent: Applebot-Extended Allow: / Disallow: /wp-admin/ Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= User-agent: Claude-User Allow: / Disallow: /wp-admin/ Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= User-agent: Claude-SearchBot Allow: / Disallow: /wp-admin/ Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= # Low-value / abusive crawlers - blocked (added 2026-09-22, ASO perf) User-agent: PetalBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Baiduspider-image Disallow: / # Generic directives User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-content/plugins/ Disallow: /readme.html Disallow: /license.txt Disallow: /*?attachment_id= Disallow: /*?download_file= Disallow: /*?*filter_ Disallow: /*?*add-to-cart= Disallow: /*?*proizvodjac= Disallow: /wp-cron.php # Sitemap Sitemap: https://autoservisnaoprema.com/sitemap_index.xml Sitemap: https://autoservisnaoprema.com/ai-sitemap.xml