1.2.570 - new scrapers API::Server::Redis and SE::Startpage, improvements in existing scrapers

Improvements

• Added new scraper API::Server::Redis (only for Enterprise license)
• In SE::Google::Modern added the ability to detect the presence of advanced snippets (rich snippets) in the output
• Due to changes in the source service, the scraper SE::IxQuick has been removed and instead it was added SE::Startpage with almost the same functionality
• In SE::Google::Modern implemented the ability to specify additional headers for requests
• Improved scraping site labels in SE::Yandex, and also added support for new types of labels
• Improved logic of function Get full links in SE::Baidu
• Optimized sub-query processing algorithm

Corrections due to changes in the issuance

• Improved work of SE::YouTube, due with testing a new layout
• In SE::Google::Translate reworked retry mechanism, added session support
• Fixed scraping snippets in SE::Google::Images
• Fully reworked GooglePlay::Apps - now it scrapes only the first page of results
• Fixed scraping mobile issuance in SE::Google::Modern
• Fixed work SE::Seznam in the absence of results
• Fixed work Rank::Linkpad, the scraper is completely rewritten
• SE::Bing::Translator, SE::DuckDuckGo::Images, SE::Bing::Images

Corrections

• An issue has been fixed due to which, in some cases, when requesting through the API, an empty array of pages was returned
• Fixed speed reduction in Net::Whois
• Fixed bug in scraper optimization
• Fixed saving parameter Report period in SE::Yandex::Direct::Frequency
• In HTML::LinkExtractor fixed collection of links if they have line breaks