Today I noticed that the Yandex bot was on a rampage through my site, in-fact I had over 3500 hits on my site from this bot alone, and that’s only between the hours of 00:00 to 09:30.
So I tried the usual robots.txt disallow trick and that didn’t seem to stem it’s mayhem. Then as I was searching for a cure from this manic bot I came across quite a number of webmasters with the exact same issue.
Some of which were mainly arguing about what the ‘best’ way would be to rid this manic bot. The ‘best’ way is to not have this bot coming back, no matter what method you use.
After reading all of this, I then found this post and it seemed to have worked.
My workaround is this…
robots.txt
User-agent: Yandex
Disallow: /
.htaccess
# Exclude Yandex
SetEnvIfNoCase User-Agent "^Yandex" bad_bot
Deny from 77.88.26.27
Deny from 213.180.209.10
It seems to have worked (for now) will update if I find anything else.
