User-agent: * # directed to all spiders (search engine robots) # directs robots NOT to read and index files in these directories or containing characters Disallow: /magazines/ #all files in these directories Disallow: /hancock/ Disallow: /solar/ Disallow: /qo/ Disallow: /map/