## robots.txt file for http://www.cmhc-schl.gc.ca User-Agent: * Disallow: / User-Agent: Googlebot Disallow: /commonspot/ Disallow: /scripts/ Disallow: /eSubmit/ Disallow: /pcr/ Allow: / User-Agent: msnbot Crawl-delay: 10 Disallow: /commonspot/ Disallow: /scripts/ Disallow: /eSubmit/ Disallow: /pcr/ Allow: / User-agent: Slurp Crawl-delay: 10 Disallow: /commonspot/ Disallow: /scripts/ Disallow: /eSubmit/ Disallow: /pcr/ Allow: / User-Agent: DFAIT-crawler Disallow: /commonspot/ Disallow: /scripts/ Disallow: /eSubmit/ Disallow: /pcr/ Allow: / User-agent: Browsershots Disallow: Allow: