Overview and Application
List of all existing built-in scrapers in A-Parser by topic, with descriptions and links to their pages.
Search engine scrapers
| Scraper name | Description |
|---|---|
 SE::Google | Scraping all data from Google search results: links, anchors, snippets, Related keywords, scraping ad blocks. Multi-threading, ReCaptcha bypass |
 SE::Yandex | Scraping all data from Yandex search results: links, anchors, snippets, Related keywords, scraping ad blocks. Maximum scraping depth |
 SE::AOL | Scraping all data from AOL search results: links, anchors, snippets |
 SE::Bing | Scraping all data from Bing search results: links, anchors, snippets, Related keywords, Maximum scraping depth |
 SE::Baidu | Scraping all data from Baidu search results: links, anchors, snippets, Related keywords |
| SE::Baidu | Scraping all data from Baidu search results: links, anchors, snippets, Related keywords |
 SE::Dogpile | Scraping all data from Dogpile search results: links, anchors, snippets, Related keywords |
 SE::DuckDuckGo | Scraping all data from DuckDuckGo search results: links, anchors, snippets |
 SE::MailRu | Scraping all data from MailRu search results: links, anchors, snippets |
 SE::Seznam | Scraper for the Czech search engine seznam.cz: links, anchors, snippets, Related keywords |
 SE::Yahoo | Scraping all data from Yahoo search results: links, anchors, snippets, Related keywords, Maximum scraping depth |
 SE::Youtube | Scraping data from Youtube search results: links, title, description, username, preview image link, view count, video duration |
 SE::Ask | Scraper for American Google search results via Ask.com: links, anchors, snippets, Related keywords |
 SE::Rambler | Scraping all data from Rambler search results: links, anchors, snippets |
 SE::Startpage | Scraping all data from Startpage search results: links, anchors, snippets |
Examples
🔗 Page indexing in Google and Yandex
Page indexing in Google and Yandex
🔗 Video Scraping of thematic domains by keyword from Google
Video Scraping of thematic domains by keyword from Google
🔗 Questions and answers from Google search results
Questions and answers from Google search results
🔗 Scraping thematic domains by keyword from Google and obtaining various domain parameters
Scraping thematic domains by keyword from Google and obtaining various domain parameters
🔗 Scraping Google news with date and converting it
Scraping Google news with date and converting it
🔗 Scraping only snippets from Google
Scraping only snippets from Google
🔗 Spell check in Google
Spell check in Google
🔗 Scraping links and anchors from Google to CSV
Scraping links and anchors from Google to CSV
🔗 Scraping text from Google search engine using a task chain
Scraping text from Google search engine using a task chain
🔗 Yandex cache scraper
Yandex cache scraper
🔗 Scraping only snippets from Yandex
Scraping only snippets from Yandex
🔗 Getting Yandex search results and result position number
Getting Yandex search results and result position number
🔗 Number of website pages in Yandex
Number of website pages in Yandex
🔗 Scraping competition by keyword from Yandex
Scraping competition by keyword from Yandex
🔗 Searching for free niches in the RU segment of the internet
Searching for free niches in the RU segment of the internet
Search engine rank scrapers
| Scraper name | Description |
|---|---|
 SE::Google::Position | Checking website positions by keywords in Google: links, list of all positions |
 SE::Yandex::Position | Checking website positions by keywords in Yandex: links, list of all positions |
 SE::Bing::Position | Checking website positions by keywords in Bing: links, list of all positions |
 SE::MailRu::Position | Checking website positions by keywords in MailRu: links, list of all positions |
Examples
🔗 Getting website positions for several regions simultaneously
Getting website positions for several regions simultaneously
🔗 Getting website positions for several regions simultaneously
Getting website positions for several regions simultaneously
🔗 Overview of result presentation options
Overview of result presentation options
Search suggestion scrapers
| Scraper name | Description |
|---|---|
 SE::Google::Suggest | Google suggestion scraper: number of results per query, query suggestions, query type |
 SE::Yandex::Suggest | Yandex suggestion scraper: number of results per query, query suggestions |
 SE::Bing::Suggest | Bing suggestion scraper: number of results per query, query suggestions |
 SE::Aol::Suggest | Aol suggestion scraper: number of results per query, query suggestions |
 SE::Yahoo::Suggest | Yahoo suggestion scraper: number of results per query, query suggestions |
 SE::Youtube::Suggest | Youtube suggestion scraper: query suggestions |
Examples
🔗 Preset for scraping suggestions with the ability to exclude suggestions containing stop words from results
Preset for scraping suggestions with the ability to exclude suggestions containing stop words from results
Keyword scrapers
| Scraper name | Description |
|---|---|
 SE::Google::Trends | Google trending keyword scraper |
 SE::Yandex::WordCraft | Scraper for user queries and popular websites in Yandex search with Yandex Webmaster WordCraft |
 SE::Yandex::Wordstat | Scraper for keywords and impression statistics from wordstat.yandex.ru |
 SE::Yandex::Wordstat::ByDate | Yandex WordStat impression statistics scraper by months or weeks, keyword statistics |
 SE::Yandex::Direct::Frequency | Number of views |
 Rank::Bukvarix::Domain | Collecting keywords by domain from Bukvarix: keyword, frequency, position |
 Rank::Bukvarix::Keyword | Collecting keywords by keyword from Bukvarix: keyword, frequency, position |
 Rank::Ahrefs::KeywordDifficulty | Keyword difficulty, keywords, number of keywords |
 Rank::Ahrefs::KeywordGenerator | Ahrefs keyword collection: keyword ideas, questions with keywords |
 SE::Google::KeywordPlanner | Collecting suggestions, keywords, competition, min. and max. bids |
 SE::Yandex::Direct | Number of ads for a specific query, title, text and domain, links, anchors, tags |
Examples
🔗 Keyword seasonality
Keyword seasonality
🔗 Frequency estimation via WordStat
Frequency estimation via WordStat
🔗 Deep Wordstat scraping
Deep Wordstat scraping
🔗 Getting Google Trends category list
Getting Google Trends category list
🔗 Google Trends date formatting
Google Trends date formatting
Account registration
| Scraper name | Description |
|---|---|
 SE::Yandex::Register | Account registration in Yandex |
Examples
🔗 Getting the full list of Yandex regions
Getting the full list of Yandex regions
🔗 Yandex account registration automation
Yandex account registration automation
Website and domain parameter scrapers
| Scraper name | Description |
|---|---|
 SE::Google::TrustCheck | Checking website trust |
 SE::Google::Compromised | Checking for “This site may be hacked” notice |
 SE::Google::SafeBrowsing | Checking domain in Google blacklist |
 SE::Yandex::SafeBrowsing | Checking domain in Yandex blacklist |
 SE::Yandex::SQI | Checking Site Quality Index in Yandex |
 Net::Whois | Determines if a domain is registered, creation date, and registration expiry date |
 Net::Dns | Scraper resolves domains to IP addresses |
 Rank::Cms | Identifies all popular forums, blogs, CMS, guestbooks, wikis, and many other engine types |
 Rank::Archive | Scraper for first and last caching date of a website in the web archive |
 Rank::Linkpad | Scraper for inbound links and statistics from linkpad.ru |
 Rank::MajesticSEO | Scraper for number of inbound links from majesticseo.com |
 Rank::Mustat | Website traffic estimation, also domain cost and rating |
 Rank::Social::Signal | Social signals scraper |
 Rank::Curlie | Checking website presence in Curlie directory (DMOZ alternative) |
 Rank::Ahrefs | ahrefs.com scraper |
 Rank::KeysSo | keys.so scraper |
 Rank::MOZ | MOZ scraper |
 SecurityTrails::Ip | Collects domains by IP |
 SecurityTrails::Domain | SecurityTrails scraper |
Examples
🔗 Scraping thematic domains by keyword from Google and obtaining various domain parameters
Scraping thematic domains by keyword from Google and obtaining various domain parameters
🔗 Website information
Website information
🔗 Net::Whois selecting arbitrary data
Net::Whois selecting arbitrary data
🔗 Getting Telegram notifications about domain registration expiry
Getting Telegram notifications about domain registration expiry
🔗 Collecting e-mail address database
Collecting e-mail address database
🔗 Determining domain list on an IP
Determining domain list on an IP
🔗 Determining CMS for 1,000,000 domains in 15 hours
Determining CMS for 1,000,000 domains in 15 hours
🔗 Scraping website domains by specific CMS
Scraping website domains by specific CMS
🔗 WordPress websites with subscriptions
WordPress websites with subscriptions
Various service scrapers
| Scraper name | Description |
|---|---|
| SE::Yandex::Register | Allows registering accounts in Yandex |
 SE::Bing::Translator | Translator via www.bing.com/translator/ service |
 SE::Google::Translate | Google Translate |
 SE::Yandex::Translate | Yandex Translate |
 SE::Bing::Images | Image scraper from Bing search engine |
 SE::Google::Images | Image scraper by Google keywords |
 SE::Google::ByImage | Search for images by link |
 SE::Yandex::Images | Image scraper by Yandex keywords |
 SE::Yandex::ByImage | Image scraper by link from Yandex |
 SE::DuckDuckGo::Images | Image scraper from DuckDuckGo |
 SE::Dogpile::Images | Image scraper from Dogpile |
 Util::AntiGate | Captcha recognition via AntiGate service |
 Util::YandexRecognize | Captcha recognition from Yandex |
 Util::ReCaptcha2 | Recaptcha recognition from Anti-captcha.com, Rucaptcha.com, Capmonster, Capmonster.cloud, Xevil, 2captcha, R.I.P.captcha resources |
 SEO::Ping | Bulk sending of Ping requests to services supporting Weblog API (Google Blog Search, Feed Burner, Ping-o-Matic, etc.) |
 Check::RosKomNadzor | Checking website in Roskomnadzor database |
 SE::Yandex::Speller | Checking pages for text errors via Yandex.Speller |
 GooglePlay::Apps | Google Play app scraper |
 Social::Instagram::Post | Instagram post data scraper |
 Social::Instagram::Profile | Instagram profile data scraper |
 Social::Instagram::Tag | Instagram post scraper by tags |
 Social::Instagram::Geo | Instagram post scraper in specified location |
 Telegram::GroupScraper | Public Telegram group data scraper |
 API::Server::Redis | Working with A-Parser via Redis |
 SE::Google::Cache | Checking page presence in Google cache |
| Social::Instagram::Geo | Instagram post scraper in specified location |
 DeepL::Translator | Text translator via www.deepl.com service |
 CoinMarketCap::LastPrice | CoinMarketCap shop scraper: token name, current price in USD |
Examples
🔗 Yandex account registration automation
Yandex account registration automation
🔗 Comparing translator speeds
Comparing translator speeds
🔗 Using entire files as queries
Using entire files as queries
🔗 Loading files from a directory for translation in DeepL
Loading files from a directory for translation in DeepL
🔗 Downloading images of specified resolution and size
Downloading images of specified resolution and size
🔗 Creating JS scrapers. Working with CAPTCHA
Creating JS scrapers. Working with CAPTCHA
🔗 Creating JS scrapers. Working with ReCaptcha2
Creating JS scrapers. Working with ReCaptcha2
🔗 Example of working with SEO::Ping
Example of working with SEO::Ping
🔗 Location link scraper for Social::Instagram::Geo
Location link scraper for Social::Instagram::Geo
🔗 Scraping Instagram user information
Scraping Instagram user information
🔗 Scraping users of public groups in Telegram
Scraping users of public groups in Telegram
Shop scrapers
| Scraper name | Description |
|---|---|
 Shop::Amazon | amazon.com search results scraper |
 Shop::Yandex::Market | Yandex.Market scraper |
 Shop::AliExpress | Shop::AliExpress search results scraper |
 Shop::eBay | Ebay search results scraper |
 Shop::Wildberries::ProductsList | Wildberries product list scraper |
 Shop::Wildberries::ProductInfo | Wildberries product page scraper |
 Shop::Wildberries::Suggest | Wildberries search suggestion scraper |
| Shop::Yandex::Market | Product scraper from YANDEX.MARKET |
Examples
🔗 Scraping products from a website
Scraping products from a website
Map scrapers
| Scraper name | Description |
|---|---|
 Maps::Google | Google Maps scraper: organization name, address and coordinates, rating, review count and price policy, website, phone, photo |
 Maps::Yandex | Yandex Maps scraper: organization name, address and coordinates, rating, review count and price policy, website, phone, photo, social networks |
Examples
🔗 Scraping Google Maps to collect all organizations in a specific area
Scraping Google Maps to collect all organizations in a specific area
Content scrapers
| Scraper name | Description |
|---|---|
 Check::BackLink | Checks the presence of your link(s) against a link database |
 HTML::LinkExtractor | Scraper for outbound and internal links from a specified website, can crawl internal links to a chosen level |
 HTML::ArticleExtractor | Article scraper |
 HTML::TextExtractor | Text block scraper |
 HTML::TextExtractor::LangDetect | Page language detection without using third-party services |
 HTML::EmailExtractor | Scraping e-mail addresses from website pages |
 Net::HTTP | Downloads the specified page, supports multi-page scraping |
Examples
🔗 Checking if there are links to a page in Yandex cache
Checking if there are links to a page in Yandex cache
🔗 Deep website scraping based on HTML::LinkExtractor scraper
Deep website scraping based on HTML::LinkExtractor scraper
🔗 Video scraping of Booking.com resource using Net::HTTP
Video scraping of Booking.com resource using Net::HTTP
🔗 Periodic inbound link check with appending results to a table
Periodic inbound link check with appending results to a table
🔗 Deep website scraping based on HTML::LinkExtractor scraper
Deep website scraping based on HTML::LinkExtractor scraper
🔗 Collecting interlinked topics
Collecting interlinked topics
🔗 Searching for website subdomains
Searching for website subdomains
🔗 Scraping websites and saving image links
Scraping websites and saving image links
🔗 Generating sitemap.xml using JavaScript capabilities
Generating sitemap.xml using JavaScript capabilities
🔗 Getting website pages and checking indexing in Google and Yandex
Getting website pages and checking indexing in Google and Yandex
🔗 Analyzing page response speed on a website
Analyzing page response speed on a website
🔗 Scraping e-mails from contact pages
Scraping e-mails from contact pages
🔗 Checking text length on pages
Checking text length on pages
🔗 Transliteration
Transliteration