1.2.2106 - Updated SE::Rambler, depth limit in LinkExtractor during scraping, and other enhancements

Enhancements

• In HTML::LinkExtractor the ability to specify a limit on the number of links when parsing in depth has been added.
  
• In Util::AntiGate support for Capsola, capmonster.cloud has been added.
  
• In Util::Turnstile support for captcha.guru has been added.
  
• In Rank::MajesticSEO the ability to specify custom user-agents to increase scraping success has been added.
• In the scrapers Rank::Ahrefs::*, an experimental option "Do not search for sitekey" has been added, which disables the search for sitekey, thereby speeding up the initiation of the task.
  
• SE::Rambler has been completely rewritten:
  • the list of languages has been updated.
  • the ability to specify a region has been added.
  • the option to choose between desktop or mobile search results has been added.
  • the captcha handling has been updated.
• JS scrapers: added support for session tags.

Corrections made due to changes in the search results

• SE::Bing - reduced the number of Short output detected errors.
  
• Adaptation to changes in the layout for SE::Google and SE::Yandex.
• Fixed the collection of flat variables in Social::Instagram::post.
• Fixed the collection of $location in Social::Instagram::profile.
  
• Fixed sitekey search in Rank::Ahrefs::* scrapers.
• Corrected the functionality of SE::YouTube when Result type = Movie.
  
• Fixed the collection of $author_link in GooglePlay::Apps.
• SE::Bing::position, SE::Google::ByImage, SE::DuckDuckGo, SE::Google::Images, Shop::Wildberries::productInfo

Corrections

• Fixed an error in Rank::CMS that caused it to fail in some cases.
• Corrected the error in using SE::Yahoo through the Redis API.
  
• Corrected the operation of SE::YouTube for requests from JS scrapers.
  
• Fixed the operation of Net::Whois with .se domains.
• Corrected the mistaken identification of a request as unsuccessful in Shop::eBay.
  
• Corrected the filling of results in Rank::KeysSo

​