###################################################### # # robots.txt file is read by most robots # # JSR Added this file to avoid these errors: # # "Padding is invalid and cannot be removed." # See: http://jagbarcelo.blogspot.com/2009/08/solution-padding-invalid-cannot-be.html # # Summing up, this event appears when there is a big time difference (lap time) between # the page that contains the resource and the resource itself being requested. # During that lapse, the application pool might have been recycled, recompiled, # the server restarted, etc, thus changing the value of t and thus, # rendering the older t value useless (the cryptographic checks fail). # ###################################################### # # address all robots using wild card * # User-agent: * # # list folders robots are not allowed to index # User-agent: * Disallow: /WebResource.axd # # Other examples: # #Disallow: /nutsNbolts/turtle_without_clothes.html #Disallow: /nof/misc/404redirect/ #Disallow: /nof/comment-form/