# Robots.txt for India Cyber Cafe (Production) # Comprehensive Crawling & Indexing Policy User-agent: * # Allow crawling of all public routes Allow: / Allow: /services Allow: /services/ Allow: /price-list Allow: /store Allow: /store/ Allow: /forms-documents Allow: /forms-documents/ Allow: /about Allow: /contact Allow: /pay Allow: /legal/ # Disallow private user portals, admin dashboard & payment checkouts Disallow: /admin Disallow: /admin/ Disallow: /operator Disallow: /operator/ Disallow: /profile Disallow: /track Disallow: /track/ Disallow: /my-documents Disallow: /my-documents/ Disallow: /store/*/*/checkout Disallow: /store/order-confirmation Disallow: /api/ Disallow: /*.env Disallow: /*.json$ # Googlebot specific User-agent: Googlebot Allow: / Crawl-delay: 0 # Bingbot specific User-agent: Bingbot Allow: / Crawl-delay: 1 # XML Sitemap Sitemap: https://b.indiacybercafe.com/sitemap.xml