# robots.txt for https://aadhakilo.com # Allow all major search engines and AI crawlers full access User-agent: * Disallow: # Explicitly allow Google Search & Gemini User-agent: Googlebot Disallow: User-agent: Googlebot-Image Disallow: User-agent: Googlebot-Mobile Disallow: User-agent: GoogleOther Disallow: # Allow Bing (Microsoft) User-agent: Bingbot Disallow: # Allow OpenAI ChatGPT crawler User-agent: GPTBot Disallow: # Allow Anthropic Claude crawler User-agent: ClaudeBot Disallow: # Allow Common Crawl and other web archives User-agent: CCBot Disallow: # Allow Perplexity AI crawler User-agent: PerplexityBot Disallow: # Sitemap location (helps all crawlers find your pages) Sitemap: https://aadhakilo.com/sitemap.xml