# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-Agent: * Disallow: /user/ Disallow: /en/user/ Disallow: /fr/user/ Disallow: /users/ Disallow: /en/users/ Disallow: /fr/users/ Disallow: /markers/ Disallow: /en/markers/ Disallow: /fr/markers/ Disallow: /map/ Disallow: /en/map/ Disallow: /fr/map/