# robots.txt — AutoGator (https://www.autogator.com) # Updated: 2026-05-23 User-agent: * Allow: / # Block admin, cart, and internal utility paths Disallow: /admin/ Disallow: /cart/ Disallow: /checkout/ Disallow: /account/ Disallow: /api/ Disallow: /cgi-bin/ Disallow: /?s= Disallow: /search? # Block duplicate/parameterized URLs that add no SEO value Disallow: /used-auto-parts/part-search?*sort= Disallow: /repairable-vehicles?*sort= # Crawl-delay for well-behaved bots (optional — remove if causing issues) Crawl-delay: 1 # XML Sitemap Sitemap: https://www.autogator.com/sitemap.xml Sitemap: https://www.autogator.com/sitemap-index.php