Skip to main content

Several scrapers in one task


A-Parser supports processing requests with several scrapers at once, which allows:

  • Parsing the output of several search engines at once
  • Analyzing domains by a multitude of parameters
  • Collecting keywords from the suggestions of different search engines and Yandex.Wordstat simultaneously
  • Gathering Whois and DNS information for domains
  • Many other application options

Adding a scraper

To add a new scraper, simply click on the Add Parser button in the Task Editor:

The Add Parser button in the Task Editor

Each scraper is numbered, and the results for each scraper in the results constructor and when formatting results are available through shortcuts:

$p1, $p2... - where the number indicates the scraper number.

In the general result format by default, the results for each scraper are displayed sequentially, in the format specified in the settings of each scraper

Using multiple scrapers in one task increases the overall scraping speed because the number of simultaneous requests to one scraper decreases, and as a result, bans of proxies or captcha displays occur less frequently

Each scraper parses the original request or its variation when using the query builder, has its own request format in the settings, however, it is not possible to pass the results of the previous scraper as requests to another scraper (this feature is planned for the future)

Example of domain analysis

Example of site domain analysis

In this example, we use a list of domains that will soon expire (become available for registration again) as requests. We are interested in selecting domains with good parameters, for which we used six different scrapers:

In the results format, we display the original request (domain) and the results from each scraper, in the order we need:

$query, $p1.totalcount, $p2.globalRank, $p3.totalcount, $p4.trustrank, $p5.exists, $\n
Download example

How to import an example into A-Parser


⏩ Video example of creating a preset from several scrapers

This video tutorial discusses how to create a preset for parsing thematic domains by a keyword from Google search results, and obtaining various parameters for domains.

The lesson covers:

  • Scraping Google search results
  • Displaying unique results as main domains
  • Obtaining such parameters as:
    • whether the domain is registered or not
    • registration date and domain expiration date
    • website language
    • title and description
    • website quality index
    • position in the global Alexa ranking
    • the country with the highest traffic according to Alexa
    • position in the ranking of that country according to Alexa