1.2.1683 - new scraper Cloudflare::Radar, support of CaptchaAI service, bug fixes

Improvements

• Added new scraper Cloudflare::Radar, defines categories of domains
• In scrapers Util::ReCaptcha2, Util::ReCaptcha3, Util::hCaptcha added support of CaptchaAI
• In Rank::Ahrefs added page rating collection (URL rating)
• Updated list of languages in DeepL::Translator

Corrections due to changes in the issue

• Adaptation to changes in Google and Yandex layout
• Fixed collection of totalcount in SE::Yandex for some queries
• Fixed region selection in SE::Yandex::Direct
• Fixed work of Rank::Ahrefs::KeywordGenerator with Country - United Kingdom
• In Shop::Yandex::Market some queries did not return any results
• SE::Google::Images, Rank::Ahrefs::KeywordGenerator, Shop::Yandex::Market

Bug fixes

• Fixed unnecessary use of session on the last retry in SE::Google
• Fixed scraping of Yandex search results when there is only 1 result in the output
• Fixed error in Telegram::GroupScraper, because of which not all names and links to logins were scraped
• Fixed bug in SE::Yandex::Position, due to which the query was erroneously searched along with the searched domain
• Fixed problem in Check::RosKomNadzor, due to which the proxy sometimes did not change during mass scraping
• In HTML::LinkExtractor fixed collection of internal links after redirect
• Puppeteer: improved handling of sites requesting access in a modal dialog

​