# # This document controls which URLs are robots not allowed # to go to. This is for all Robots. # # There are all URLs relative to the site. The trailing / is # necessary. For instance, Disallow:/admin/ will stop # the robots from going into http://xxx.com/admin/ # however, http://xxx.com/admin.html is ok. # User-agent: * Disallow: /admin/ Disallow: /backup/ Disallow: /bin/ Disallow: /cgi-bin/