1.2.1604 - scraping Google People also ask, new methods in JS scrapers, adaptation to changes

Improvements

• In SE::Google added scraping of People also ask
• In Rank::Ahrefs added a new scraping method, the data obtained in the old way was slightly different from those in the browser
• Implemented gzip bomb protection
• In SE::Yandex::Register improved work with numbers and optimized registration process
• Improved work with sessions in SE::Yandex::WordStat
• For Yandex scrapers, the ability to use accounts on their domains has been added
• In all Yandex scrapers, work with smart captcha is adapted to changes in sources
• JS scrapers: added method this.puppeteer.logScreenshot(), it allows you to log a screenshot of the current page
• JS scrapers: added methods this.isContextAlive(), this.console.log, this.console.setPrefix and .setGlobalConsolePrefix
• In SE::Yandex::WordStat::ByDate added correct handling of situations when there are no results for a query
• HTML::TextExtractor - optimized processing speed

Corrections due to changes in the issue

• Adaptation to changes in Google and Yandex layout
• SE::Yandex::Register adapted to changes at the source
• Fixed authorization by login/password in SE::Google::KeywordPlanner
• SE::Google::SafeBrowsing, Telegram::GroupScraper, SE::Baidu, Rank::MajesticSEO, Shop::Wildberries::Suggest, Social::Instagram::Tag, Social::Instagram::Profile

Bug fixes

• Fixed problem with HTML::TextExtractor::LangDetect freezing on some requests
• Fixed work of methods tools.task.* in JS API v2
• Fixed encoding error in Net::HTTP
• Fixed work with proxy in Puppeteer, the problem appeared in one of the previous versions
• Fixed bug with collecting title in Shop::Wildberries::ProductInfo in some cases
• In Shop::Wildberries::ProductsList fixed tag scraping
• Fixed work of SE::Bing::Translator in some cases
• Fixed incorrect Node initialization on Enterprise license
• In SE::Bing - fixed bug with output $pages

​