Skip to main content

Query Builder

Query Builder - allows you to split the original query into parts and/or transform queries according to certain rules

Capabilities​

  • Splitting the query into parts using a regular expression or using an arbitrary delimiter
  • Replacing a substring in the query or replacing with a regular expression
  • Extracting the domain/main domain from a link
  • Adding the ! sign before each word in the query (necessary for the scraper SE::Yandex::WordStatSE::Yandex::WordStat)
  • Converting the query to upper/lower case
Query Builder

The new variables obtained can be used in Query Format when forming a query to the scraper and in Result Format when forming the result

Basic use cases​

  • Extracting the domain from a link for subsequent domain verification in Rank::AhrefsRank::Ahrefs and similar scrapers
  • Automatic insertion of the ! symbol before each word in the query for SE::Yandex::WordStatSE::Yandex::WordStat

Using only part of the original string in the request​

For example, we have a file with queries:

keyword1;100000
keyword2;200000

We can split the keyword and the already existing data about the keyword frequency, check the keyword for competitiveness, and record the result in the format keyword;frequency;competitiveness

Using proxies without proxy checker​

If you create a variable $proxy, then this proxy will be used in the current request bypassing the Proxy Checker. The proxy must be passed in the format http://ip:port or socks://ip:port

Example​

Checking the Ahrefs rating of a domain and saving additional information from the query
Suppose we have a file with queries in the format of a page link and a description separated by a space:

http://gofuckbiz.com/showthread.php?t=30454&page=11 Форум GoFuckBiz.com  
https://searchengines.guru/ru/forum/720568 Форум SearchEngines.guru

We need to check the Ahrefs rating for the domain using the scraper Rank::AhrefsRank::Ahrefs and save the original link, domain, Ahrefs rating, and the original description in the result. Then the task will look like this:

Example of using the Query Builder

As a result, we will get:

http://gofuckbiz.com/showthread.php?t=30454&page=11  Ahrefs rating of gofuckbiz.com: 51, Description: Форум GoFuckBiz.com
https://searchengines.guru/ru/forum/720568  Ahrefs rating of searchengines.guru: 77, Description: Форум SearchEngines.guru

Download example

How to import an example into A-Parser

eJyFVOtO2zAUfpXIQhNMVdpC2aZICJVLp02FMii/KENecpJ6dWzjS4FVffcdO2lS
2KZJlRufy3du3/GKWGoW5kqDAWtIcrciKnyThGSQU8ct6RBFtQHt1XfkmopFkgzn
GnKDqsZoReyLAnSTS9CaZYBKluH90YF+yaUuqYdaUu681U4Qx5ksKRNk/W/3W8v4
w9RpYfADHursWqChsCylyqZzStb39x2CBpiQGVURMZLqx1UwzsQiiqrUI00tE0Uk
86g1qLJJgqTSd6IzMKlmyjJZK2pTFM9mgjTxbugSphLj5ZhmKx7h7ZKWoeSMWvDa
uOrG7l5sn30pNMuYx6e8Sto3ui3kVrDHUKmQaOujMzAjLUsUWQgAIaVNwXd1bwlC
uOD7rfIhSU65gQ4xmOqIYiLZWw2zgHVLPQn1onxFpBhyPoYl8NYs4J84xjNkxTBH
py+1499NJn9grJvytkPh6J805tCghNvJ5KL1yuRYFptmcFYyi3dzKp3ws+6hcAGg
mp5derNSamjC1Mh1dCS+AuF51o5sqFrRqzLCehjpdAobXqNJzVsNBTwHEP+fkO+7
8fvjvQjPvZ2NeBpMheMc3aQfladk2CKTknu/BQ18ranRcc6apvasWpfKm2yWp+XK
VqYoTKXIWTGpF2rDKiemuPITcSpLxcE2CTkD1y1nh6bmhr+0XXvrfBpCvHosrJTc
fL2p+qc0w0wPfYIljnc7ag2ZUs5vr8fbGu9orFQTca71G04FtpK5tSrpdguZu3Tx
g/2KU1l2zVw+WVxumsVqro7t0UFvcDh4p2gBR/1+NHO9wf7Anwfgz0EvnAdBkkaf
5QixTiqsmfARDIYwQHU6B1EwASYunHZd/OECu7L7cb93+OHT/4BvAsL5FgLxVVso
JPIHZ+LnV7+wzTu8ev3OJqs1cv+nuarM/EyCEJ9BvCKxSdJf/waafQGO
Last updated