# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-Agent: * # Disallow: / Disallow: /users/ Disallow: /sessions/ Disallow: /packages/ Disallow: /distributions/ Disallow: /home/distributions/ Disallow: /categories/ Disallow: /debs/ Disallow: /metapackages/ Disallow: /repositories/ Disallow: /admin/