1.2.852 - a new scraper for Google Keyword Planner, Native NodeJS, many fixes and improvements

Improvements

• Added scraper SE::Google::KeywordPlanner
  • collects suggest lists and keyword ideas
  • for each keyword idea, the average number of requests per month, competition, search volumes, minimum and maximum bids are sraped
  • there is the ability to specify multiple keywords in the query
• In SE::Yandex::ByImage added function Get full links to page, which allows you to get real links to pages
• In SE::Yandex::SQI added variables to collect the number of reviews and ratings, as well as rating
• Improved verification of captcha answers in Yandex scrapers
• Automatic limit increase on Linux OS
• Improved regular expression work
• When banning a proxy, more detailed information is now displayed in the task log
• Native NodeJS now in beta, many optimizations have been made, due to which in most scenarios this gives a maximum speed increase of 1.5-2 times, and a decrease in memory consumption by 2-4 times
  • Starting from 1.2.822 all beta versions have Native NodeJS enabled, stable versions come out with oldnode enabled
• Native NodeJS: experimental support of HTTP/2 added
• Native NodeJS: updating Node.js to the current version
• JS scrapers: added option allow_dangerous_node_modules

Corrections due to changes in the issuance

• Fixed captcha download in SE::Yandex
• Fixed Rank::Ahrefs: in $anchors variable $bl replaced with $domains
• In SE::Google fixed:
  • scraping of mobile news
  • bug with duplication of links in the results
  • scraping anchor in advertising, related keywords, and the first result in the search issuance did not always fall into serp
• In SE::Google::Images fixed scraping of gif
• Fixed SE::Yandex::ByImage, removed flat variables $height and $width
• SE::Yandex, SE::Google::ByImage, SE::DuckDuckGo, Social::Instagram::Post, Rank::Ahrefs, Rank::Bukvarix::Domain, SE::MailRu, SE::Yandex::Suggest

Corrections

• Fixed work of Net::Whois with 3rd level domains, and improved verification of the received response
• Fixed work of Extra query string in SE::Bing
• Fixed work of Rank::SEMrush and Rank::SerpStat::Keyword when received response without data
• Fixed bug with variable types
• Fixed a bug where queries were mistakenly considered failed when a task was paused
• Fixed work of Bypass Cloudflare
• Fixed dynamic thread limit
• Fixed bug when using Request delay
• Fixed warning about exceeding the limit in the Queries field
• Fixed work of $tools.task.id in the result file name
• JS scrapers: getting sessions and http2 work fixed (bug appeared in one of the previous versions)
• JS scrapers: fixed page encoding detection
• Native NodeJS: fixed behavior for some errors
• Native NodeJS: fixed problem when updating A-Parser on Windows
• Native NodeJS: fixed work save_to_file
• Native NodeJS: fixed work of SOCKS5 proxies with authorization
• Native NodeJS: fixed data substitution after Query Builder