Skip to main content

Overview and Application

List of all existing built-in scrapers in A-Parser with descriptions and links to their pages.

Search engine scrapers​

Scraper NameDescription
SE::GoogleSE::GoogleScraping all data from Google search results: links, anchors, snippets, Related keywords, scraping ad blocks. Multithreading, ReCaptcha bypass
SE::YandexSE::YandexScraping all data from Yandex search results: links, anchors, snippets, Related keywords, scraping ad blocks. Maximum scraping depth
SE::AOLSE::AOLScraping all data from AOL search results: links, anchors, snippets
SE::BingSE::BingScraping all data from Bing search results: links, anchors, snippets, Related keywords, Maximum scraping depth
SE::BaiduSE::BaiduScraping all data from Baidu search results: links, anchors, snippets, Related keywords
SE::BaiduSE::BaiduScraping all data from Baidu search results: links, anchors, snippets, Related keywords
SE::DogpileSE::DogpileScraping all data from Dogpile search results: links, anchors, snippets, Related keywords
SE::DuckDuckGoSE::DuckDuckGoScraping all data from DuckDuckGo search results: links, anchors, snippets
SE::MailRuSE::MailRuScraping all data from MailRu search results: links, anchors, snippets
SE::SeznamSE::SeznamCzech search engine scraper seznam.cz: links, anchors, snippets, Related keywords
SE::YahooSE::YahooScraping all data from Yahoo search results: links, anchors, snippets, Related keywords, Maximum scraping depth
SE::YoutubeSE::YoutubeScraping data from Youtube search results: links, title, description, username, thumbnail link, number of views, video length
SE::AskSE::AskAmerican Google search results scraper through Ask.com: links, anchors, snippets, Related keywords
SE::RamblerSE::RamblerScraping all data from Rambler search results: links, anchors, snippets
SE::StartpageSE::StartpageScraping all data from Startpage search results: links, anchors, snippets

Examples​

Indexing pages in Google and Yandex

Video Scraping of thematic domains by keyword phrase from Google

Questions and answers from Google search results

Scraping thematic domains by keyword phrase from Google and getting various parameters by domains

Scraping Google news with date and converting it

Scraping only snippets from Google

Spell checking in Google

Scraping links and anchors from Google to CSV

Scraping text from Google search engine using task chain

Yandex cache scraper

Scraping only snippets from Yandex

Getting Yandex search results and result position number

Number of pages of a site in Yandex

Scraping competition by key from Yandex

Finding free niches in the RU segment of the Internet

Search engine position scrapers​

Parser NameDescription
SE::Google::PositionSE::Google::PositionChecking website positions by keywords in Google: links, list of all positions
SE::Yandex::PositionSE::Yandex::PositionChecking website positions by keywords in Yandex: links, list of all positions
SE::Bing::PositionSE::Bing::PositionChecking website positions by keywords in Bing: links, list of all positions
SE::MailRu::PositionSE::MailRu::PositionChecking website positions by keywords in MailRu: links, list of all positions

Examples​

Getting website positions simultaneously for multiple regions

Getting website positions simultaneously for multiple regions

Overview of result representation options

Search engine suggestion parsers​

Parser NameDescription
SE::Google::SuggestSE::Google::SuggestGoogle suggestion parser: number of results for the query, suggestions for the query, query type
SE::Yandex::SuggestSE::Yandex::SuggestYandex suggestion parser: number of results for the query, suggestions for the query
SE::Bing::SuggestSE::Bing::SuggestBing suggestion parser: number of results for the query, suggestions for the query
SE::Aol::SuggestSE::Aol::SuggestAol suggestion parser: number of results for the query, suggestions for the query
SE::Yahoo::SuggestSE::Yahoo::SuggestYahoo suggestion parser: number of results for the query, suggestions for the query
SE::Youtube::SuggestSE::Youtube::SuggestYoutube suggestion parser: suggestions for the query

Examples​

Preset for parsing suggestions with the ability to exclude suggestions containing stop words from the results

Keyword parsers​

Parser NameDescription
SE::Google::TrendsSE::Google::TrendsGoogle trends keyword parser
SE::Yandex::WordstatSE::Yandex::WordstatKeyword and impression statistics parser from wordstat.yandex.ru
SE::Yandex::Wordstat::ByDateSE::Yandex::Wordstat::ByDateYandex WordStat impression statistics parser by months or weeks, keyword statistics
SE::Yandex::Direct::FrequencySE::Yandex::Direct::FrequencyNumber of views
Rank::Bukvarix::DomainRank::Bukvarix::DomainCollection of keywords by domain from Bukvarix: keyword, frequency, position
Rank::Bukvarix::KeywordRank::Bukvarix::KeywordCollection of keywords by keyword from Bukvarix: keyword, frequency, position
Rank::Ahrefs::KeywordDifficultyRank::Ahrefs::KeywordDifficultyKeyword difficulty, keywords, number of keywords
Rank::Ahrefs::KeywordGeneratorRank::Ahrefs::KeywordGeneratorAhrefs keyword parser: keyword ideas, questions with keywords
SE::Google::KeywordPlannerSE::Google::KeywordPlannerCollection of suggestions, keywords, competition, min. and max. bids
SE::Yandex::DirectSE::Yandex::DirectNumber of ads for a specific query, title, text and domain, links, anchors, tags

Examples​

Seasonality of keywords

Estimating frequency using WordStat

Deep parsing of Wordstat

Getting a list of Google Trends categories

Formatting Google Trends date

Account registration parsers​

Parser NameDescription
SE::Yandex::RegisterSE::Yandex::RegisterYandex account registration parser

Examples​

Getting a complete list of Yandex regions

Automating Yandex account registration

Site and domain parameter parsers​

Parser NameDescription
SE::Google::TrustCheckSE::Google::TrustCheckChecks website for trust
SE::Google::CompromisedSE::Google::CompromisedChecks for the presence of the message "This site may be hacked"
SE::Google::SafeBrowsingSE::Google::SafeBrowsingChecks domain in Google blacklist
SE::Yandex::SafeBrowsingSE::Yandex::SafeBrowsingChecks domain in Yandex blacklist
SE::Yandex::SQISE::Yandex::SQIChecks site quality index in Yandex
Net::WhoisNet::WhoisDetermines if a domain is registered or not, domain creation date, and registration expiration date
Net::DnsNet::DnsResolves domains to IP addresses
Rank::CmsRank::CmsDetermines all popular forums, blogs, CMS, guestbooks, wikis, and many other types of engines
Rank::AlexaRank::AlexaDetermines global Alexa ranking position
Rank::Alexa::ApiRank::Alexa::ApiFast Alexa checker via API
Rank::ArchiveRank::ArchiveParses the date of the first and last caching of the site in the web archive
Rank::LinkpadRank::LinkpadParses backlinks and statistics from linkpad.ru
Rank::MajesticSEORank::MajesticSEOParses the number of backlinks from majesticseo.com
Rank::MustatRank::MustatEvaluates traffic on the site, as well as the cost and rating of the domain
Rank::Social::SignalRank::Social::SignalParses social signals
Rank::CurlieRank::CurlieChecks the presence of the site in the Curlie directory (analog of DMOZ)
Rank::AhrefsRank::AhrefsParses ahrefs.com
Rank::KeysSoRank::KeysSoParses keys.so
Rank::MOZRank::MOZParses MOZ
SecurityTrails::IpSecurityTrails::IpCollects domains by IP
SecurityTrails::DomainSecurityTrails::DomainParses SecurityTrails

Examples​

Parsing thematic domains by keyword phrase from Google and obtaining various parameters by domains

Information about the site

Net::Whois selecting arbitrary data

Get notifications in Telegram about the end of domain registration period

Collecting a database of e-mail addresses

Determining a list of domains on IP

Determining CMS for 1000000 domains in 15 hours

Parsing site domains by a certain CMS

WordPress sites with subscriptions

Parsers of various services​

Parser NameDescription
SE::Yandex::RegisterSE::Yandex::RegisterAllows to register accounts on Yandex
SE::Bing::TranslatorSE::Bing::TranslatorTranslator via www.bing.com/translator/
SE::Google::TranslateSE::Google::TranslateGoogle translator
SE::Yandex::TranslateSE::Yandex::TranslateYandex translator
SE::Bing::ImagesSE::Bing::ImagesScraper for images from Bing search engine
SE::Google::ImagesSE::Google::ImagesScraper for images by keywords from Google
SE::Google::ByImageSE::Google::ByImageSearch for images by link
SE::Yandex::ImagesSE::Yandex::ImagesScraper for images by keywords from Yandex
SE::Yandex::ByImageSE::Yandex::ByImageScraper for images by link from Yandex
SE::DuckDuckGo::ImagesSE::DuckDuckGo::ImagesScraper for images from DuckDuckGo
SE::Dogpile::ImagesSE::Dogpile::ImagesScraper for images from Dogpile
Util::AntiGateUtil::AntiGateCaptcha recognition via AntiGate service
Util::YandexRecognizeUtil::YandexRecognizeCaptcha recognition from Yandex
Util::ReCaptcha2Util::ReCaptcha2ReCaptcha recognition from resources Anti-captcha.com, Rucaptcha.com, Capmonster, Π‘apmonster.cloud, Xevil, 2captcha, R.I.P.captcha
SEO::PingSEO::PingMass sending of Ping requests to services supporting Weblog API (Google Blog Search, Feed Burner, Ping-o-Matic, etc.)
Check::RosKomNadzorCheck::RosKomNadzorSite check in Roskomnadzor database
SE::Yandex::SpellerSE::Yandex::SpellerChecking pages for text errors via Yandex.Speller
GooglePlay::AppsGooglePlay::AppsGoogle Play apps scraper
Social::Instagram::PostSocial::Instagram::PostScraper for data on Instagram posts
Social::Instagram::ProfileSocial::Instagram::ProfileScraper for data from Instagram profiles
Social::Instagram::TagSocial::Instagram::TagScraper for posts by tags on Instagram
Social::Instagram::GeoSocial::Instagram::GeoScraper for posts on Instagram in a specified location
Telegram::GroupScraperTelegram::GroupScraperScraper for data from public groups in Telegram
API::Server::RedisAPI::Server::RedisWorking with A-Parser via Redis
SE::Google::CacheSE::Google::CacheChecking for page availability in Google cache
Social::Instagram::GeoSocial::Instagram::GeoScraper for posts on Instagram in a specified location
DeepL::TranslatorDeepL::TranslatorText translator via www.deepl.com
CoinMarketCap::LastPriceCoinMarketCap::LastPriceCoinMarketCap store scraper: token name, current price in USD

Examples​

Automating Yandex account registration

Comparison of translator speeds

Using files as requests in DeepL

Loading files from a directory for translation in DeepL

Downloading images of a specified resolution and size

Creating JS scrapers. Working with CAPTCHA

Creating JS scrapers. Working with ReCaptcha2

Example of working with SEO::Ping

Parsing location links for Social::Instagram::Geo

Parsing information about Instagram users

Parsing users from public groups in Telegram

Store scrapers​

Parser NameDescription
Shop::AmazonShop::AmazonScraper for amazon.com search results
Shop::Yandex::MarketShop::Yandex::MarketYandex.Market scraper
Shop::AliExpressShop::AliExpressScraper for AliExpress search results
Shop::eBayShop::eBayScraper for Ebay search results

Examples​

Parsing products from a website

Map scrapers​

Parser NameDescription
Maps::GoogleMaps::GoogleGoogle Maps scraper: organization name, address and coordinates, rating, number of reviews and pricing policy, website, phone, photo
Maps::YandexMaps::YandexYandex Maps scraper: organization name, address and coordinates, rating, number of reviews and pricing policy, website, phone, photo, social networks

Examples​

Parsing Google Maps to collect all organizations in a certain area

Content Scrapers​

Scraper NameDescription
Check::BackLinkCheck::BackLinkchecks the presence of your link(s) in the link database
HTML::LinkExtractorHTML::LinkExtractorscraper of external and internal links from the specified site, can follow internal links to the selected level
HTML::ArticleExtractorHTML::ArticleExtractorscraper of articles
HTML::TextExtractorHTML::TextExtractorscraper of text blocks
HTML::TextExtractor::LangDetectHTML::TextExtractor::LangDetectdetection of the page language without using third-party services
HTML::EmailExtractorHTML::EmailExtractorscraper of email addresses from site pages
Net::HTTPNet::HTTPdownloads the specified page, supports multi-page scraping

Examples​

Checking if there are links to the page in Yandex cache

Scraping a site in depth based on HTML::LinkExtractor scraper

Video scraping of Booking.com resource using Net::HTTP

Periodic checking of backlinks with writing results to a table

Scraping a site in depth based on HTML::LinkExtractor scraper

Collecting cross-linked topics

Finding subdomains of a site

Scraping sites and saving links to images

Generating sitemap.xml using JavaScript capabilities

Getting site pages and checking indexing in Google and Yandex

Analysis of page response speed on the site

Scraping e-mails from contact pages

Checking the length of text on pages

Transliteration