# General crawlers User-agent: * Allow: / # AI Search & LLM crawlers - explicitly allowed for GEO/AI visibility User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: Google-Extended Allow: / User-agent: GoogleBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: Bytespider Allow: / User-agent: CCBot Allow: / User-agent: FacebookBot Allow: / # Allow all crawlers to access public pages Allow: /about Allow: /services Allow: /portfolio Allow: /blog Allow: /contact Allow: /web Allow: /mobile Allow: /marketing Allow: /shopify Allow: /ecommerce-marketplace Allow: /software-tools Allow: /agents Allow: /team Allow: /privacy Allow: /terms Allow: /portfolio/websites Allow: /portfolio/applications Allow: /portfolio/creatives Allow: /portfolio/ads-seo Allow: /portfolio/designs # Disallow admin and user areas Disallow: /admin Disallow: /user Disallow: /employee Disallow: /manager Disallow: /login Disallow: /signup # Disallow API routes Disallow: /api/ # Disallow service checkout pages (private) Disallow: /services/checkout Disallow: /services/domains Disallow: /services/hosting # Allow specific static assets Allow: /images/ Allow: /favicon.ico Allow: /favicon.svg Allow: /_next/static/ Allow: /llms.txt # Sitemap location Sitemap: https://formiqstudio.in/sitemap.xml