Overview and application
A list of all existing built-in scrapers in A-Parser, categorized by topic, with descriptions and links to their respective pages.
Search Engine Scrapers
| Title of the Scraper | Description |
|---|---|
 SE::Google | Scraping all data from Google search results: links, anchors, snippets, Related keywords, ad block scraping. Multithreading, ReCaptcha bypass |
 SE::Yandex | Scraping all data from Yandex search results: links, anchors, snippets, Related keywords, ad block scraping. Maximum scraping depth |
 SE::AOL | Scraping all data from AOL search results: links, anchors, snippets |
 SE::Bing | Scraping all data from Bing search results: links, anchors, snippets, Related keywords, Maximum scraping depth |
 SE::Baidu | Scraping all data from Baidu search results: links, anchors, snippets, Related keywords |
| SE::Baidu | Scraping all data from Baidu search results: links, anchors, snippets, Related keywords |
 SE::Dogpile | Scraping all data from Dogpile search results: links, anchors, snippets, Related keywords |
 SE::DuckDuckGo | Scraping all data from DuckDuckGo search results: links, anchors, snippets |
 SE::MailRu | Scraping all data from MailRu search results: links, anchors, snippets |
 SE::Seznam | Scraper for the Czech search engine seznam.cz: links, anchors, snippets, Related keywords |
 SE::Yahoo | Scraping all data from Yahoo search results: links, anchors, snippets, Related keywords, Maximum scraping depth |
 SE::Youtube | Scraping data from Youtube search results: links, title, description, username, preview image link, view count, video duration |
 SE::Ask | Scraper for US Google search results via Ask.com: links, anchors, snippets, Related keywords |
 SE::Rambler | Scraping all data from Rambler search results: links, anchors, snippets |
 SE::Startpage | Scraping all data from Startpage search results: links, anchors, snippets |
Examples
🔗 Indexing pages in Google and Yandex
Indexing pages in Google and Yandex
🔗 Video Scraping thematic domains by keyword phrase from Google
Video Scraping thematic domains by keyword phrase from Google
🔗 Questions and answers from Google search results
Questions and answers from Google search results
🔗 Scraping thematic domains by keyword phrase from Google and getting various parameters for domains
Scraping thematic domains by keyword phrase from Google and getting various parameters for domains
🔗 Scraping Google news with date and converting it
Scraping Google news with date and converting it
🔗 Scraping only snippets from Google
Scraping only snippets from Google
🔗 Checking spelling in Google
Checking spelling in Google
🔗 Scraping links and anchors from Google into CSV
Scraping links and anchors from Google into CSV
🔗 Scraping text from Google search engine using a chain of tasks
Scraping text from Google search engine using a chain of tasks
🔗 Yandex cache scraper
Yandex cache scraper
🔗 Scraping only snippets from Yandex
Scraping only snippets from Yandex
🔗 Getting Yandex search results and result position number
Getting Yandex search results and result position number
🔗 Number of website pages in Yandex
Number of website pages in Yandex
🔗 Scraping competition by keyword from Yandex
Scraping competition by keyword from Yandex
🔗 Searching for free niches in the RU segment of the internet
Searching for free niches in the RU segment of the internet
Position Scrapers in Search Engines
| Title of the Scraper | Description |
|---|---|
 SE::Google::Position | Checking website positions by keywords in Google: links, list of all positions |
 SE::Yandex::Position | Checking website positions by keywords in Yandex: links, list of all positions |
 SE::Bing::Position | Checking website positions by keywords in Bing: links, list of all positions |
 SE::MailRu::Position | Checking website positions by keywords in MailRu: links, list of all positions |
Examples
🔗 Getting site positions simultaneously for multiple regions
Getting site positions simultaneously for multiple regions
🔗 Getting site positions simultaneously for multiple regions
Getting site positions simultaneously for multiple regions
🔗 Overview of result representation options
Overview of result representation options
Search Engine Suggestion Scrapers
| Title of the Scraper | Description |
|---|---|
 SE::Google::Suggest | Google Suggestions Scraper: number of results per query, suggestions for the query, query type |
 SE::Yandex::Suggest | Yandex Suggestions Scraper: number of results per query, suggestions for the query |
 SE::Bing::Suggest | Bing Suggestions Scraper: number of results per query, suggestions for the query |
 SE::Aol::Suggest | Aol Suggestions Scraper: number of results per query, suggestions for the query |
 SE::Yahoo::Suggest | Yahoo Suggestions Scraper: number of results per query, suggestions for the query |
 SE::Youtube::Suggest | Youtube Suggestions Scraper: suggestions for the query |
Examples
🔗 Preset for scraping suggestions with the ability to exclude suggestions containing stop words from the results
Preset for scraping suggestions with the ability to exclude suggestions containing stop words from the results
Keyword Scrapers
| Title of the Scraper | Description |
|---|---|
 SE::Google::Trends | Google Trending Keywords Scraper |
 SE::Yandex::WordCraft | Scraper for user queries and popular sites in Yandex search with Yandex Webmaster WordCraft |
 SE::Yandex::Wordstat | Scraper for keywords and impression statistics from the service wordstat.yandex.ru |
 SE::Yandex::Wordstat::ByDate | Scraper for Yandex WordStat impression statistics by month or week, keyword statistics |
 SE::Yandex::Direct::Frequency | View count |
 Rank::Bukvarix::Domain | Collecting keywords by domain from Bukvarix: keyword, frequency, position |
 Rank::Bukvarix::Keyword | Collecting keywords by keyword from Bukvarix: keyword, frequency, position |
 Rank::Ahrefs::KeywordDifficulty | Keyword difficulty, keywords, number of keywords |
 Rank::Ahrefs::KeywordGenerator | Collecting Ahrefs keywords: keyword ideas, questions with keywords |
 SE::Google::KeywordPlanner | Collecting suggestions, keywords, competition, min. and max. bids |
 SE::Yandex::Direct | Number of ads for a specific query, title, text and domain, links, anchors, tags |
Examples
🔗 Keyword seasonality
Keyword seasonality
🔗 Evaluating frequency using WordStat
Evaluating frequency using WordStat
🔗 Deep Wordstat scraping
Deep Wordstat scraping
🔗 Getting a list of Google Trends categories
Getting a list of Google Trends categories
🔗 Formatting date in Google Trends
Formatting date in Google Trends
Account Registration Scrapers
| Title of the Scraper | Description |
|---|---|
 SE::Yandex::Register | Yandex account registration |
Examples
🔗 Getting the full list of Yandex regions
Getting the full list of Yandex regions
🔗 Automating Yandex account registration
Automating Yandex account registration
Site and Domain Parameter Scrapers
| Title of the Scraper | Description |
|---|---|
 SE::Google::TrustCheck | Checking site trust |
 SE::Google::Compromised | Checking for the presence of the message 'This site may be hacked' |
 SE::Google::SafeBrowsing | Checking domain in Google blacklist |
 SE::Yandex::SafeBrowsing | Checking domain in Yandex blacklist |
 SE::Yandex::SQI | Checking the Quality Index of a site in Yandex |
 Net::Whois | Determines if the domain is registered, the domain creation date, and the registration expiry date |
 Net::Dns | Scraper resolves domains into IP addresses |
 Rank::Cms | Determines all popular forums, blogs, CMS, guestbooks, wikis, and many other types of engines |
 Rank::Archive | Scraper for the date of the first and last caching of the site in the web archive |
 Rank::Linkpad | Scraper for backlinks and statistics from the service linkpad.ru |
 Rank::MajesticSEO | Scraper for the number of backlinks from the service majesticseo.com |
 Rank::Mustat | Site traffic estimation, as well as domain cost and rating |
 Rank::Social::Signal | Social Signals Scraper |
 Rank::Curlie | Checking for the presence of the site in the Curlie catalog (DMOZ analogue) |
 Rank::Ahrefs | Ahrefs.com scraper |
 Rank::KeysSo | Keys.so scraper |
 Rank::MOZ | MOZ scraper |
 SecurityTrails::Ip | Collects domains by IP |
 SecurityTrails::Domain | SecurityTrails scraper |
Examples
🔗 Scraping thematic domains by keyword phrase from Google and getting various parameters for domains
Scraping thematic domains by keyword phrase from Google and getting various parameters for domains
🔗 Site information
Site information
🔗 Net::Whois selecting arbitrary data
Net::Whois selecting arbitrary data
🔗 Getting notifications in Telegram about domain registration expiry
Getting notifications in Telegram about domain registration expiry
🔗 Collecting an e-mail address database
Collecting an e-mail address database
🔗 Determining the list of domains on an IP
Determining the list of domains on an IP
🔗 Determining CMS for 1,000,000 domains in 15 hours
Determining CMS for 1,000,000 domains in 15 hours
🔗 Scraping site domains for a specific CMS
Scraping site domains for a specific CMS
🔗 WordPress sites with subscriptions
WordPress sites with subscriptions
Various Services Scrapers
| Title of the Scraper | Description |
|---|---|
| SE::Yandex::Register | Allows registering accounts in Yandex |
 SE::Bing::Translator | Translator via the service www.bing.com/translator/ |
 SE::Google::Translate | Google Translator |
 SE::Yandex::Translate | Yandex Translator |
 SE::Bing::Images | Image Scraper from Bing search engine |
 SE::Google::Images | Google keyword Image Scraper |
 SE::Google::ByImage | Image search by link |
 SE::Yandex::Images | Yandex keyword Image Scraper |
 SE::Yandex::ByImage | Image Scraper by link from Yandex |
 SE::DuckDuckGo::Images | Image Scraper from DuckDuckGo |
 SE::Dogpile::Images | Image Scraper from Dogpile |
 Util::AntiGate | Captcha recognition via AntiGate service |
 Util::YandexRecognize | Captcha recognition from Yandex |
 Util::ReCaptcha2 | Recaptcha recognition from Anti-captcha.com, Rucaptcha.com, Capmonster, Capmonster.cloud, Xevil, 2captcha, R.I.P.captcha resources |
 SEO::Ping | Bulk sending Ping requests to services supporting Weblog API (Google Blog Search, Feed Burner, Ping-o-Matic, etc.) |
 Check::RosKomNadzor | Checking the site in the Roskomnadzor database |
 SE::Yandex::Speller | Checking pages for text errors via Yandex.Speller |
 GooglePlay::Apps | Google Play app scraper |
 Social::Instagram::Post | Instagram post data scraper |
 Social::Instagram::Profile | Instagram profile data scraper |
 Social::Instagram::Tag | Instagram posts by tags scraper |
 Social::Instagram::Geo | Instagram posts scraper in a specified location |
 Telegram::GroupScraper | Data Scraper from public Telegram groups |
 API::Server::Redis | Working with A-Parser via Redis |
 SE::Google::Cache | Checking for the presence of pages in the Google cache |
| Social::Instagram::Geo | Instagram posts scraper in a specified location |
 DeepL::Translator | Text translator via the service www.deepl.com |
 CoinMarketCap::LastPrice | CoinMarketCap store scraper: token name, current price in USD |
Examples
🔗 Automating Yandex account registration
Automating Yandex account registration
🔗 Comparing translator speed
Comparing translator speed
🔗 Using entire files as queries
Using entire files as queries
🔗 Loading files from a directory for translation in DeepL
Loading files from a directory for translation in DeepL
🔗 Downloading images of a specified resolution and size
Downloading images of a specified resolution and size
🔗 Creating JS scrapers. Working with CAPTCHA
Creating JS scrapers. Working with CAPTCHA
🔗 Creating JS scrapers. Working with ReCaptcha2
Creating JS scrapers. Working with ReCaptcha2
🔗 Example of working with SEO::Ping
Example of working with SEO::Ping
🔗 Scraper for location links for Social::Instagram::Geo
Scraper for location links for Social::Instagram::Geo
🔗 Scraping information about Instagram users
Scraping information about Instagram users
🔗 Scraping users of public Telegram groups
Scraping users of public Telegram groups
Shop Scrapers
| Title of the Scraper | Description |
|---|---|
 Shop::Amazon | Amazon.com search results scraper |
 Shop::Yandex::Market | Yandex.Market scraper |
 Shop::AliExpress | Shop::AliExpress search results scraper |
 Shop::eBay | Ebay search results scraper |
 Shop::Wildberries::ProductsList | Wildberries product list scraper |
 Shop::Wildberries::ProductInfo | Wildberries product page scraper |
 Shop::Wildberries::Suggest | Wildberries search suggestions scraper |
| Shop::Yandex::Market | YANDEX.MARKET product scraper |
Examples
🔗 Scraping products from a website
Scraping products from a website
Map Scrapers
| Title of the Scraper | Description |
|---|---|
 Maps::Google | Google Maps scraper: organization name, address and coordinates, rating, number of reviews and pricing policy, website, phone, photos |
 Maps::Yandex | Yandex Maps scraper: organization name, address and coordinates, rating, number of reviews and pricing policy, website, phone, photos, social networks |
Examples
🔗 Scraping Google Maps to collect all organizations in a specific area
Scraping Google Maps to collect all organizations in a specific area
Content Scrapers
| Title of the Scraper | Description |
|---|---|
 Check::BackLink | Checks the location of your link(s) against a link database |
 HTML::LinkExtractor | Scraper for external and internal links from a specified site, can follow internal links up to a selected level |
 HTML::ArticleExtractor | Article scraper |
 HTML::TextExtractor | Text block scraper |
 HTML::TextExtractor::LangDetect | Page language detection, without using third-party services |
 HTML::EmailExtractor | Scraping e-mail addresses from website pages |
 Net::HTTP | Downloads the specified page, supports multi-page scraping |
Examples
🔗 Checking if there are links to the page in the Yandex cache
Checking if there are links to the page in the Yandex cache
🔗 Deep site scraping based on the HTML::LinkExtractor scraper
Deep site scraping based on the HTML::LinkExtractor scraper
🔗 Video scraping of Booking.com using Net::HTTP
Video scraping of Booking.com using Net::HTTP
🔗 Periodic backlink check with result appending to a table
Periodic backlink check with result appending to a table
🔗 Deep site scraping based on the HTML::LinkExtractor scraper
Deep site scraping based on the HTML::LinkExtractor scraper
🔗 Collecting interlinked topics
Collecting interlinked topics
🔗 Searching for site subdomains
Searching for site subdomains
🔗 Scraping sites and saving links to images
Scraping sites and saving links to images
🔗 Generating sitemap.xml using JavaScript capabilities
Generating sitemap.xml using JavaScript capabilities
🔗 Getting site pages and checking indexation in Google and Yandex
Getting site pages and checking indexation in Google and Yandex
🔗 Analyzing page response speed on a website
Analyzing page response speed on a website
🔗 Scraping e-mail from contact pages
Scraping e-mail from contact pages
🔗 Checking text length on pages
Checking text length on pages
🔗 Transliteration
Transliteration