# AlgoBars | robots.txt # Allow all well-behaved crawlers full access User-agent: * Allow: / # Internal / ephemeral surfaces — never index Disallow: /instance Disallow: /demo/ # Block noisy AI scrapers (optional; remove if you want them indexing) User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / # Sitemap location Sitemap: https://algobars.com/sitemap.xml Sitemap: https://algobars.com/image-sitemap.xml