Yandex has the largest search engine in the Russian Federation. The last time I checked, it had a 60 percent market share in that country. It has other services as well, including free e-mail.
If you want to block Yandex IP addresses, or simply reroute requests, I’m going to give you the IP address ranges you need.
If you use “Yandexbot” to block or reroute requests, you’ll get most of them but not all. Yandex uses other user agents. One includes “YandexAntivirus” and another includes “YandexDirect”. There are probably more.
Many search engines will cloak themselves as web browsers. The user agents won’t show you who they are. I’m sure Yandex does this as well. If you go by user agents only, you’ll miss the cloaked requests. It’s a good idea to use the known IP address ranges along with the correct user agents.
I don’t know why they cloak themselves but I can guess. They’re probably trying to find out if website owners are showing the same things to bots as they show to people.
I don’t allow any of the bots on my site. Until recently I only used “Yandex” as the user agent. It caught all the bots that identified themselves but not those who didn’t. I’m now using all the CIDR ranges I listed above.
I’ll be sure to update this article if I find more of their IP address ranges.
Contrary to popular belief and TV and movie representation, very few Russians can speak English. Out of those very few, it’s extremely unlikely that any will visit my website.
I prefer writing like I speak as much as possible. It’s American English with contractions and a little slang here and there. If Russians living in the United States want to read an article, they’ll need a translation service (like Google Translate) regardless of what search engine they use to get to it.
I’m not blocking the Russian Federation, only the search engines that originate from there.
Changed 220.127.116.11-18.104.22.168 to 22.214.171.124-126.96.36.199 and 188.8.131.52/24 to 184.108.40.206/18 in the Russia sections.
Added 220.127.116.11-18.104.22.168 and 22.214.171.124/19 to the Russia sections.
By: RT Cunningham
February 10, 2018
Previous and Next Articles: