Today I noticed that the Yandex bot was on a rampage through my site, in-fact I had over 3500 hits on my site from this bot alone, and that’s only between the hours of 00:00 to 09:30.
So I tried the usual robots.txt disallow trick and that didn’t seem to stem it’s mayhem. Then as I was searching for a cure from this manic bot I came across quite a number of webmasters with the exact same issue.
Some of which were mainly arguing about what the ‘best’ way would be to rid this manic bot. The ‘best’ way is to not have this bot coming back, no matter what method you use.
My workaround is this…
# Exclude Yandex
SetEnvIfNoCase User-Agent "^Yandex" bad_bot
Deny from 18.104.22.168
Deny from 22.214.171.124
It seems to have worked (for now) will update if I find anything else.