1.2.1848 - 2 new scrapers, many improvements and fixes to built-in scrapers

Improvements

• New scrapers added:
  • SE::YouTube::Video - allows you to collect video data from YouTube (including subtitles)
  • Rank::BingAnalytics - scraper of data from Bing analytics in the Edge sidebar
• The following scrapers have been removed due to irrelevance: Rank::Alexa, Rank::Alexa::API, SE::MailRu, SE::MailRu::Position
  
• Fixed question-answer scraping (PAA) in SE::Google
• Improved handling of the 404 response code in Rank::KeysSo
• In Rank::Ahrefs::KeywordDifficulty "shortage" has been added to the variables.
  
• In Util::Turnstile CapSolver provider added
• Turnstile pass proxy option added to all Ahrefs scrapers, more here
  
• Bukvarix scrapers have added the possibility to use their API key, more information here
  
• In Maps::Google added possibility to receive a link to "I am the company owner"
  
• In SE::Google::KeywordPlanner added ability to collect search volume trends, additional information here
  
• Language list updated in DeepL::Translator
• In Social::Instagram::Profile the ability to collect with authorisation has been added
• Improved cache detection in SE::Google::Cache
  
• In Net::Whois a new method for processing results for some domain zones has been added
• Migration of embedded scrapers to JS APIv2 continues, with 10 scrapers rewritten in this release

Corrections due to changes in the issue

• Corrected operation SE::Yandex::Register via Chrome, more information here
• In SE::Google no results were collected for News type, also corrected to get $totalcount when no results are available
• Corrected operation SE::Yandex::Position when selecting Search sites from (rstr=)
• In Shop::Yandex::Market corrected price scraping
• Corrected and adapted to changes in sources: SE::Google, SE::Yandex::SQI, Rank::KeysSo, Cloudflare::Radar, SE::Quora, SE::Yandex::Translate, Shop::AliExpress, SE::Startpage, Rank::Ahrefs

Corrections

• Fixed job freezing during restart
  
• Fixed an issue with sending an incorrectly resolved captcha message to Util::AntiGate
• In CoinMarketCap::LastPrice was empty $data
• Rank::Ahrefs::KeywordGenerator did not proceed to solving the captcha at a particular result format
  
• Corrected an error in SE::Yandex::Direct::Frequency, which caused all requests to fail when using the accounts
• Corrected SEO::Ping
• Fixed entity decoding in Rank::MOZ
• JS scrapers: corrected this.utils.urlFromHTML(), not all entities were decoded correctly

​