Skip to main content

Query Constructor

Query Builder - allows you to split the original query into parts and/or transform queries according to specific rules.

Capabilities​

  • Splitting the query into parts using a regular expression or an arbitrary delimiter
  • Substring replacement in the query or replacement by regular expression
  • Extracting the domain/main domain from a URL
  • Adding the ! sign before each word in the query (required for the SE::Yandex::WordStatSE::Yandex::WordStat)
  • Converting the query to upper/lower case
Query Builder

The resulting new variables can be used in the Query Format when forming the request to the scraper and in the Result Format when forming the result.

Basic Use Cases​

  • Extracting the domain from a link for subsequent domain checking in Rank::AhrefsRank::Ahrefs and similar scrapers
  • Automatic substitution of the ! symbol before each word in the query for SE::Yandex::WordStatSE::Yandex::WordStat

Using only part of the original string in the request​

For example, if we have a file of queries:

keyword1;100000
keyword2;200000

We can split the keyword and existing data about the keyword frequency, check the keyword for competitiveness and write the result to a file in the format keyword;frequency;competitiveness

Using proxies bypassing the proxy checker​

If you create the variable $proxy, the current request will use this specific proxy, bypassing the Proxy Checker. The proxy must be passed in the format http://ip:port or socks://ip:port.

Example Usage​

Checking the Ahrefs rating of a domain and saving additional information from the query
Suppose we have a file with queries in the format: page link followed by a space and a description:

http://gofuckbiz.com/showthread.php?t=30454&page=11 GoFuckBiz.com Forum   
https://searchengines.guru/ru/forum/720568 SearchEngines.guru Forum

We need to check the Ahrefs rating for the domain using the Rank::AhrefsRank::Ahrefs scraper and save the original link, domain, Ahrefs rating, and original description in the result. Then the task will look like this:

Example of using the Query Builder

As a result, we will get:

http://gofuckbiz.com/showthread.php?t=30454&page=11  Ahrefs rating of gofuckbiz.com: 51, Description: GoFuckBiz.com Forum
https://searchengines.guru/ru/forum/720568  Ahrefs rating of searchengines.guru: 77, Description: SearchEngines.guru Forum

Download example

How to import the example into A-Parser

eJyFVOtO2zAUfpXIQhNMVdpC2aZICJVLp02FMii/KENecpJ6dWzjS4FVffcdO2lS
2KZJlRufy3du3/GKWGoW5kqDAWtIcrciKnyThGSQU8ct6RBFtQHt1XfkmopFkgzn
GnKDqsZoReyLAnSTS9CaZYBKluH90YF+yaUuqYdaUu681U4Qx5ksKRNk/W/3W8v4
w9RpYfADHursWqChsCylyqZzStb39x2CBpiQGVURMZLqx1UwzsQiiqrUI00tE0Uk
86g1qLJJgqTSd6IzMKlmyjJZK2pTFM9mgjTxbugSphLj5ZhmKx7h7ZKWoeSMWvDa
uOrG7l5sn30pNMuYx6e8Sto3ui3kVrDHUKmQaOujMzAjLUsUWQgAIaVNwXd1bwlC
uOD7rfIhSU65gQ4xmOqIYiLZWw2zgHVLPQn1onxFpBhyPoYl8NYs4J84xjNkxTBH
py+1499NJn9grJvytkPh6J805tCghNvJ5KL1yuRYFptmcFYyi3dzKp3ws+6hcAGg
mp5derNSamjC1Mh1dCS+AuF51o5sqFrRqzLCehjpdAobXqNJzVsNBTwHEP+fkO+7
8fvjvQjPvZ2NeBpMheMc3aQfladk2CKTknu/BQ18ranRcc6apvasWpfKm2yWp+XK
VqYoTKXIWTGpF2rDKiemuPITcSpLxcE2CTkD1y1nh6bmhr+0XXvrfBpCvHosrJTc
fL2p+qc0w0wPfYIljnc7ag2ZUs5vr8fbGu9orFQTca71G04FtpK5tSrpdguZu3Tx
g/2KU1l2zVw+WVxumsVqro7t0UFvcDh4p2gBR/1+NHO9wf7Anwfgz0EvnAdBkkaf
5QixTiqsmfARDIYwQHU6B1EwASYunHZd/OECu7L7cb93+OHT/4BvAsL5FgLxVVso
JPIHZ+LnV7+wzTu8ev3OJqs1cv+nuarM/EyCEJ9BvCKxSdJf/waafQGO