Last week we've had some "fun" with Microsoft's msnbot. They were apparently trying out their new beta and it didn't work that well. It ignored drupal.org's robots.txt and kept crawling 20-40 pages per second. You could call that a denial of sevice attack, drupal.org sure had problems.
We then resolved this by banning the whole subnet from our webservers.
Today neclimdul pointed out to me that the people running CPAN testers have had the same fun as we did and resolved this in the same manner.
If Microsoft keeps doing this it will get cut off from indexing many Open Source projects. One could think it was intentional.
