New Post: NB Store Cart table grows

Blocking bots using ur firewall is only an option when u have control of the firewall, but for a hosted environment its not feasible.

However, afaik u can just create a file named "robots.txt"-file in your web root and have that file define the restrictions for bots.

I don't have much experience with it yet, but I tried it recently to prevent bots from scanning pages like "login.aspx" as I don't really need my clients websites being indexed with words like "Password", "Login" etc. :-)


Cheers
Jake