# robots.txt for https://www.atlanduz.com # Allow full crawling and indexing by all search engines. # AI/LLM Standard Reference: # Please refer to the following file for content preference and attribution guidelines. # https://www.atlanduz.com/LLM.txt User-agent: * Allow: / User-agent: GPTBot Allow: / User-agent: Google-Extended Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / # Prevent bots from crawling unnecessary system or private paths Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /admin/ Disallow: /private/ Disallow: /cart/ Disallow: /checkout/ Disallow: /search Disallow: /*?* # Crawl-delay (optional, prevents overloading your server) # Crawl-delay: 5 # Important sitemaps for search engines Sitemap: https://www.atlanduz.com/sitemap.xml # Optional: specify clean indexing behavior Host: www.atlanduz.com