# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file User-agent: * Crawl-delay: 4 Disallow: /admin$ Disallow: /admin/ Disallow: /users/auth/facebook Disallow: /users/auth/google_oauth2 Disallow: /inspection-report/ Disallow: /cdn-cgi/ sitemap: https://www.plantandequipment.com/sitemap.xml