Overview and Application
A list by topic of all existing built-in scrapers in A-Parser with a description and links to their pages.
Search Engine Scrapers
| Scraper Name | Description |
|---|---|
 SE::Google | Scraping all data from Google search results: links, anchors, snippets, Related keywords, scraping ad blocks. Multithreading, bypassing ReCaptcha |
 SE::Yandex | Scraping all data from Yandex search results: links, anchors, snippets, Related keywords, scraping ad blocks. Maximum scraping depth |
 SE::AOL | Scraping all data from AOL search results: links, anchors, snippets |
 SE::Bing | Scraping all data from Bing search results: links, anchors, snippets, Related keywords, Maximum scraping depth |
 SE::Baidu | Scraping all data from Baidu search results: links, anchors, snippets, Related keywords |
| SE::Baidu | Scraping all data from Baidu search results: links, anchors, snippets, Related keywords |
 SE::Dogpile | Scraping all data from Dogpile search results: links, anchors, snippets, Related keywords |
 SE::DuckDuckGo | Scraping all data from DuckDuckGo search results: links, anchors, snippets |
 SE::MailRu | Scraping all data from MailRu search results: links, anchors, snippets |
 SE::Seznam | Scraper for the Czech search engine seznam.cz: links, anchors, snippets, Related keywords |
 SE::Yahoo | Scraping all data from Yahoo search results: links, anchors, snippets, Related keywords, Maximum scraping depth |
 SE::Youtube | Scraping data from Youtube search results: links, title, description, username, link to preview image, view count, video length |
 SE::Ask | Scraper for American search results of Google via Ask.com: links, anchors, snippets, Related keywords |
 SE::Rambler | Scraping all data from Rambler search results: links, anchors, snippets |
 SE::Startpage | Scraping all data from Startpage search results: links, anchors, snippets |
Examples
🔗 Indexing pages in Google and Yandex
Indexing pages in Google and Yandex
🔗 Video Scraping of thematic domains by keyword from Google
Video Scraping of thematic domains by keyword from Google
🔗 Questions and answers from Google search results
Questions and answers from Google search results
🔗 Scraping thematic domains by keyword from Google and obtaining various parameters for the domains
Scraping thematic domains by keyword from Google and obtaining various parameters for the domains
🔗 Scraping Google news with date and converting it
Scraping Google news with date and converting it
🔗 Scraping from Google snippets only
Scraping from Google snippets only
🔗 Spell check in Google
Spell check in Google
🔗 Scraping from Google links and anchors into CSV
Scraping from Google links and anchors into CSV
🔗 Scraping text from Google search engine using a chain of tasks
Scraping text from Google search engine using a chain of tasks
🔗 Yandex cache scraper
Yandex cache scraper
🔗 Scraping from Yandex snippets only
Scraping from Yandex snippets only
🔗 Getting Yandex search results and the position number of the result
Getting Yandex search results and the position number of the result
🔗 Number of site pages in Yandex
Number of site pages in Yandex
🔗 Scraping competition by keyword from Yandex
Scraping competition by keyword from Yandex
🔗 Searching for free niches in the RU segment of the internet
Searching for free niches in the RU segment of the internet
Search Engine Position Scrapers
| Scraper Name | Description |
|---|---|
 SE::Google::Position | Checking site positions by keywords in Google: links, list of all positions |
 SE::Yandex::Position | Checking site positions by keywords in Yandex: links, list of all positions |
 SE::Bing::Position | Checking site positions by keywords in Bing: links, list of all positions |
 SE::MailRu::Position | Checking site positions by keywords in MailRu: links, list of all positions |
Examples
🔗 Obtaining site positions simultaneously for multiple regions
Obtaining site positions simultaneously for multiple regions
🔗 Obtaining site positions simultaneously for multiple regions
Obtaining site positions simultaneously for multiple regions
🔗 Overview of result presentation options
Overview of result presentation options
Search Engine Suggestion Scrapers
| Scraper Name | Description |
|---|---|
 SE::Google::Suggest | Google suggestions scraper: number of results for a query, query suggestions, query type |
 SE::Yandex::Suggest | Yandex suggestions scraper: number of results for a query, query suggestions |
 SE::Bing::Suggest | Bing suggestions scraper: number of results for a query, query suggestions |
 SE::Aol::Suggest | Aol suggestions scraper: number of results for a query, query suggestions |
 SE::Yahoo::Suggest | Yahoo suggestions scraper: number of results for a query, query suggestions |
 SE::Youtube::Suggest | Youtube suggestions scraper: query suggestions |
Examples
🔗 Preset for parsing suggestions with the ability to exclude suggestions containing stop words from the results
Preset for parsing suggestions with the ability to exclude suggestions containing stop words from the results
Keyword Scrapers
| Scraper Name | Description |
|---|---|
 SE::Google::Trends | Google trending keywords scraper |
 SE::Yandex::Wordstat | Yandex keyword and statistics scraper from wordstat.yandex.ru |
 SE::Yandex::Wordstat::ByDate | Yandex WordStat statistics scraper by months or weeks, keyword statistics |
 SE::Yandex::Direct::Frequency | Number of views |
 Rank::Bukvarix::Domain | Keyword collection by domain from Bukvarix: keyword, frequency, position |
 Rank::Bukvarix::Keyword | Keyword collection by keyword from Bukvarix: keyword, frequency, position |
 Rank::Ahrefs::KeywordDifficulty | Keyword difficulty, keywords, number of keywords |
 Rank::Ahrefs::KeywordGenerator | Ahrefs keyword collection: keyword ideas, questions with keywords |
 SE::Google::KeywordPlanner | Collection of suggestions, keywords, competition, min. and max. bids |
 SE::Yandex::Direct | Number of ads for a specific query, title, text and domain, links, anchors, tags |
Examples
🔗 Seasonality of keywords
Seasonality of keywords
🔗 Estimating frequency by WordStat
Estimating frequency by WordStat
🔗 In-depth parsing of Wordstat
In-depth parsing of Wordstat
🔗 Getting a list of Google Trends categories
Getting a list of Google Trends categories
🔗 Formatting the date for Google Trends
Formatting the date for Google Trends
Account Registration Scrapers
| Scraper Name | Description |
|---|---|
 SE::Yandex::Register | Yandex account registration |
Examples
🔗 Getting the full list of Yandex regions
Getting the full list of Yandex regions
🔗 Automating the registration of Yandex accounts
Automating the registration of Yandex accounts
Site and Domain Parameter Scrapers
| Scraper Name | Description |
|---|---|
 SE::Google::TrustCheck | Site trust check |
 SE::Google::Compromised | Checking for the presence of the notice "This site may be hacked" |
 SE::Google::SafeBrowsing | Checking the domain in Google's blacklist |
 SE::Yandex::SafeBrowsing | Checking the domain in Yandex's blacklist |
 SE::Yandex::SQI | Checking the Site Quality Index in Yandex |
 Net::Whois | Determines whether a domain is registered or not, the domain creation date, as well as the registration expiration date |
 Net::Dns | The scraper resolves domains into IP addresses |
 Rank::Cms | Identifies all popular forums, blogs, CMS, guestbooks, wikis, and many other types of engines |
 Rank::Archive | Scraper of the date of the first and last caching of the site in the web archive |
 Rank::Linkpad | Scraper of backlinks and statistics from the service linkpad.ru |
 Rank::MajesticSEO | Scraper of the number of backlinks from the service majesticseo.com |
 Rank::Mustat | Assessment of traffic on the site, as well as the cost and rating of the domain |
 Rank::Social::Signal | Social signals scraper |
 Rank::Curlie | Checking for the presence of the site in the Curlie directory (analog of DMOZ) |
 Rank::Ahrefs | Scraper of ahrefs.com |
 Rank::KeysSo | Scraper of keys.so |
 Rank::MOZ | Scraper of MOZ |
 SecurityTrails::Ip | Collects domains by IP |
 SecurityTrails::Domain | Scraper of SecurityTrails |
Examples
🔗 Parsing thematic domains by a keyword from Google and obtaining various parameters for the domains
Parsing thematic domains by a keyword from Google and obtaining various parameters for the domains
🔗 Site information
Site information
🔗 Net::Whois selecting arbitrary data
Net::Whois selecting arbitrary data
🔗 Receiving notifications in Telegram about the expiration of domain registrations
Receiving notifications in Telegram about the expiration of domain registrations
🔗 Collecting a database of e-mail addresses
Collecting a database of e-mail addresses
🔗 Determining the list of domains on an IP
Determining the list of domains on an IP
🔗 Identifying CMS for 1000000 domains in 15 hours
Identifying CMS for 1000000 domains in 15 hours
🔗 Parsing domains of sites by a certain CMS
Parsing domains of sites by a certain CMS
🔗 WordPress sites with subscriptions
WordPress sites with subscriptions
Scrapers of various services
| Scraper Name | Description |
|---|---|
| SE::Yandex::Register | Allows to register accounts in Yandex |
 SE::Bing::Translator | Translator through the service www.bing.com/translator/ |
 SE::Google::Translate | Google Translator |
 SE::Yandex::Translate | Yandex Translator |
 SE::Bing::Images | Bing image scraper |
 SE::Google::Images | Google image scraper by keywords |
 SE::Google::ByImage | Search for images by link |
 SE::Yandex::Images | Yandex image scraper by keywords |
 SE::Yandex::ByImage | Yandex image scraper by link |
 SE::DuckDuckGo::Images | DuckDuckGo image scraper |
 SE::Dogpile::Images | Dogpile image scraper |
 Util::AntiGate | Captcha recognition through the AntiGate service |
 Util::YandexRecognize | Captcha recognition by Yandex |
 Util::ReCaptcha2 | Recognition of reCAPTCHA from resources Anti-captcha.com, Rucaptcha.com, Capmonster, Сapmonster.cloud, Xevil, 2captcha, R.I.P.captcha |
 SEO::Ping | Bulk sending of Ping requests to services supporting Weblog API(Google Blog Search, Feed Burner, Ping-o-Matic, etc.) |
 Check::RosKomNadzor | Checking the site in the Roskomnadzor database |
 SE::Yandex::Speller | Checking pages for text errors through Yandex.Speller |
 GooglePlay::Apps | Google Play app scraper |
 Social::Instagram::Post | Instagram post data scraper |
 Social::Instagram::Profile | Instagram profile data scraper |
 Social::Instagram::Tag | Instagram post scraper by tags |
 Social::Instagram::Geo | Instagram post scraper in a specified location |
 Telegram::GroupScraper | Public group data scraper in Telegram |
 API::Server::Redis | Working with A-Parser through Redis |
 SE::Google::Cache | Checking the presence of pages in Google cache |
| Social::Instagram::Geo | Instagram post scraper in a specified location |
 DeepL::Translator | Text translator through the service www.deepl.com |
 CoinMarketCap::LastPrice | CoinMarketCap store scraper: token name, current price in USD |
Examples
🔗 Automation of Yandex account registration
Automation of Yandex account registration
🔗 Comparison of translators' speed
Comparison of translators' speed
🔗 Using entire files as queries
Using entire files as queries
🔗 Uploading files from a directory for translation in DeepL
Uploading files from a directory for translation in DeepL
🔗 Downloading images of specified resolution and size
Downloading images of specified resolution and size
🔗 Creating JS scrapers. Working with CAPTCHA
Creating JS scrapers. Working with CAPTCHA
🔗 Creating JS scrapers. Working with ReCaptcha2
Creating JS scrapers. Working with ReCaptcha2
🔗 Example of working with SEO::Ping
Example of working with SEO::Ping
🔗 Scraper of location links for Social::Instagram::Geo
Scraper of location links for Social::Instagram::Geo
🔗 Scraping information about Instagram users
Scraping information about Instagram users
🔗 Scraping users of public groups in Telegram
Scraping users of public groups in Telegram
Scrapers for shops
| Scraper name | Description |
|---|---|
 Shop::Amazon | Scraper of Amazon search results |
 Shop::Yandex::Market | Scraper of Yandex.Market |
 Shop::AliExpress | Scraper of Shop::AliExpress search results |
 Shop::eBay | Scraper of eBay search results |
 Shop::Wildberries::ProductsList | Scraper of Wildberries product list |
 Shop::Wildberries::ProductInfo | Scraper of Wildberries product page |
 Shop::Wildberries::Suggest | Scraper of Wildberries search suggestions |
| Shop::Yandex::Market | Scraper of products from YANDEX.MARKET |
Examples
🔗 Scraping products from a website
Scraping products from a website
Scrapers for maps
| Scraper name | Description |
|---|---|
 Maps::Google | Scraper of Google Maps: organization name, address and coordinates, rating, number of reviews and pricing policy, website, phone, photos |
 Maps::Yandex | Scraper of Yandex Maps: organization name, address and coordinates, rating, number of reviews and pricing policy, website, phone, photos, social networks |
Examples
🔗 Scraping Google Maps to collect all organizations in a certain area
Scraping Google Maps to collect all organizations in a certain area
Scrapers for content
| Scraper Name | Description |
|---|---|
 Check::BackLink | Checks for the presence of your link(s) in the link database |
 HTML::LinkExtractor | Scraper for external and internal links from the specified site, can navigate through internal links up to a selected level |
 HTML::ArticleExtractor | Article scraper |
 HTML::TextExtractor | Text block scraper |
 HTML::TextExtractor::LangDetect | Page language detection without using external services |
 HTML::EmailExtractor | Scraping e-mail addresses from website pages |
 Net::HTTP | Downloads the specified page, supports multi-page scraping |
Examples
🔗 Checking if there are links to the page in the Yandex cache
Checking if there are links to the page in the Yandex cache
🔗 Deep website scraping based on the HTML::LinkExtractor scraper
Deep website scraping based on the HTML::LinkExtractor scraper
🔗 Video scraping of Booking.com using Net::HTTP
Video scraping of Booking.com using Net::HTTP
🔗 Periodic backlink check with results appended to a table
Periodic backlink check with results appended to a table
🔗 Deep website scraping based on the HTML::LinkExtractor scraper
Deep website scraping based on the HTML::LinkExtractor scraper
🔗 Collecting interlinked topics
Collecting interlinked topics
🔗 Searching for website subdomains
Searching for website subdomains
🔗 Scraping websites and saving links to images
Scraping websites and saving links to images
🔗 Generating sitemap.xml using JavaScript capabilities
Generating sitemap.xml using JavaScript capabilities
🔗 Retrieving website pages and checking indexing in Google and Yandex
Retrieving website pages and checking indexing in Google and Yandex
🔗 Analyzing page response speed on a website
Analyzing page response speed on a website
🔗 Scraping e-mail from contact pages
Scraping e-mail from contact pages
🔗 Checking the length of text on pages
Checking the length of text on pages
🔗 Transliteration
Transliteration