Skip to main content

SE::Yandex::Suggest - Yandex search suggestions parser

Yandex Suggest parser overview

Parser of search suggestions by keywords in Yandex. With the SE::Yandex::Suggest parser, you can automatically collect keyword databases from Yandex search suggestions by query. Using the SE::Yandex::Suggest parser, you can easily and quickly parse Yandex suggestions by query based on region.

The Yandex suggestions parser solves one of the main SEO tasks, namely, fast automated obtaining of an extended semantic core. Google search suggestions allow you to cover the maximum number of phrases, and in combination with the Yandex Keywords Parser - SE::Yandex::WordStatSE::Yandex::WordStat, you will get the most complete semantics that will help attract more organic traffic.

Thanks to the multi-threaded work of A-Parser, the processing speed of requests can reach 5700 requests per minute, which on average allows you to receive up to 17000 - 18000 results per minute.

SE::Yandex::Suggest parser speed

You can use automatic query multiplication, substitution of subqueries from files, enumeration of alphanumeric combinations and lists to get the maximum possible number of results. Using result filtering, you can immediately clean up the result by removing all unnecessary garbage (using minus words).

The functionality of A-Parser allows you to save the parsing settings of the SE::Yandex::Suggest parser for further use (presets), set a parsing schedule, and much more.

Saving results is possible in the form and structure that you need, thanks to the built-in powerful Template Toolkit template engine, which allows you to apply additional logic to results and output data in various formats, including JSON, SQL, and CSV.

List of collected data

  • Number of results by query
  • Suggestions for the query
  • When choosing the 2nd query method, additional data and type of suggestions are also collected

SE::Yandex::Suggest parser collected data

Usage options

  • Collection of keyword databases

Query examples

  • Search phrases must be specified as queries, for example:
форекс
написать реферат
рефераты онлайн
купить машину в Москве
новости

Query substitutions

You can use built-in macros for automatic substitution of subqueries from files, for example, we want to add some list of other words to each query, specify several main queries:

essay
article
thesis

In the query format, specify a macro for substituting additional words from the Keywords.txt file, this method allows you to increase the variability of queries many times:

{subs:Keywords} $query 

This macro will create as many additional queries as there are in the file for each original search query, which in total will give [number of original queries (domains)] x [number of queries in the Keywords file] = [total number of queries] as a result of the macro operation.

For example, if the Keywords.txt file contains:

buy
cheap

As a result, the substitution macro will turn 3 main queries into 6:

buy essay
cheap essay
buy article
cheap article
buy thesis
cheap thesis

Result output options

A-Parser supports flexible result formatting thanks to the built-in Template Toolkit template engine, which allows it to output results in any form, as well as in a structured form, for example, CSV or JSON.

Exporting a list of suggestions

Result format:

$results.format('$suggest\n')

Result example:

рефераты онлайн бесплатно
рефераты онлайн заказ
рефераты онлайн скачать бесплатно
рефераты онлайн скачать
рефераты онлайн сделать
рефераты онлайн делать
рефераты онлайн найти
рефераты онлайн бесплатно сделать
рефераты онлайн заказать

Output of the query, the number of found suggestions, suggestions for the query

Result format:

$query - $totalcount:\n$results.format('$suggest\n')

Result example:

рефераты онлайн - 10:
рефераты онлайн
рефераты онлайн бесплатно
рефераты онлайн заказ
рефераты онлайн скачать бесплатно
рефераты онлайн скачать
рефераты онлайн сделать
рефераты онлайн делать
рефераты онлайн найти
рефераты онлайн бесплатно сделать
рефераты онлайн заказать

Output of suggestions to a CSV table

The built-in tools.CSVLine utility allows you to create correct tabular documents ready for import into Excel or Google Sheets.

Result format:

[%  FOREACH i IN results;    tools.CSVline(i.suggest); END  %]

File name:

$datefile.format().csv

Initial text:

Подсказки

tip

In the General result format, the Template Toolkit template engine is used to output elements of the suggest array of results in a FOREACH loop.
What is the general result format.

In the results file name, simply change the file extension to csv.

To make the "Initial text" option available in the Task Editor, you need to activate "More options". In the "Initial text" field, enter the column names separated by commas and leave the second line blank.

Competition of keywords

Same as in SE::Yandex.

Saving in SQL format

Result format:

[%  FOREACH p1.results;     "INSERT INTO serp VALUES('" _ query _ "', '";   suggest _ "')\n"; END  %]

Example result:

INSERT INTO serp VALUES('рефераты онлайн', 'рефераты онлайн')
INSERT INTO serp VALUES('рефераты онлайн', 'рефераты онлайн бесплатно')
INSERT INTO serp VALUES('рефераты онлайн', 'рефераты онлайн заказ')
INSERT INTO serp VALUES('рефераты онлайн', 'рефераты онлайн скачать бесплатно')
INSERT INTO serp VALUES('рефераты онлайн', 'рефераты онлайн скачать')
INSERT INTO serp VALUES('рефераты онлайн', 'рефераты онлайн сделать')
INSERT INTO serp VALUES('рефераты онлайн', 'рефераты онлайн делать')
INSERT INTO serp VALUES('рефераты онлайн', 'рефераты онлайн найти')
...

Dumping results in JSON

Result format:

[%  data = {};  data.totalcount = p1.totalcount; data.suggests = []; FOREACH i IN p1.results;    data.suggests.push(i.suggest); END;  result = {}; result = data  %]

Initial text

[% result = {} %]

Final text

[% result.json %]

Example result:

{"suggests":["рефераты онлайн","рефераты онлайн бесплатно","рефераты онлайн заказ","рефераты онлайн скачать бесплатно","рефераты онлайн скачать","рефераты онлайн сделать","рефераты онлайн делать","рефераты онлайн найти","рефераты онлайн бесплатно сделать","рефераты онлайн заказать"],"totalcount":10}
tip

To make the "Initial text" and "Final text" options available in the Task Editor, you need to activate "More options".

Processing results

A-Parser allows you to process results directly during parsing. In this section, we have provided the most popular cases for the SE::Yandex::Suggest parser.

Parse to level option

The option tells the parser to navigate through neighboring pages of the site in depth to the specified level, for example:

  • If the 1st level is specified, the parser will navigate through all links specified on the source page.
  • If the 2nd level is specified, the parser will navigate through all links specified on the source page + all links collected from pages at the first level.
  • etc.

In simple words, this is the minimum number of clicks between the source page and the final one. Since there will most likely be links to the source page or link duplicates on neighboring pages, it is necessary to include query uniqueness (Unique queries) to prevent the parser from looping and not going in circles.

Example of using the Parse to level option in the SE::Yandex::Suggest parser

Download example

How to import an example into A-Parser

eJx1VFtv2jAU/iuRhdRVYohSeFjeKBrSJlZYaR8m4MGrD5FXx85sh1FF+e89xwlJ
WOmL5XP7zncudsE8dy9uZcGBdyzeFCwLdxaz9dc4/sW1gGMcr/MkAeejz9GKWweR
N5GCA6gIjjzNFLA+y8hgCWNzKRQ9BOx5rvBWMP+aAaYwB7BWCgqXAuW9sSn3SCC4
sQNXObn1Ko0bVPZPVz1XgW63+uqalR3AzEuj3QkvcFoQ0RbtZlh+TEDZTtrRaMLK
3a7P6vTzkJ34ZDeDuk2Ncc0P8GioBhnacYpB6Z6noQrBPZD1VMb1wB8JgQshiTZX
VQbqYZv1Scu/gY7zVuoE/VG0EtzcmhTVHgIIKV9PDDesF2SGMHmI/1nFsNjbHPrM
Ids5Ry6iMey5cmiRHiz3xi7rTsYFM3qqVOhi6xbg73KpBM58usegb3XgZZflO4yy
qbCbCufxzyKHBiVId8sfbZQwC5Ng4dpg2Uqm0qPsZibXNJshKl8AsqZt9+SWGgtN
mhq5zo67n4Gm4bdTm2at6qyMs8mcK5+N3stkWS/UyTPXj/jAlnpm6JlQXTpXCqfi
4KHdkKmrx0BCS/D/4FlIgbSal8S8Mcp9X1dUMytxAydEMMVOdrPWkM9cqaeHRdfC
2o1CYZsPx+MhnbeTcB937pU+nONRFAQIpwjn79Z8+6XSM0rpITG4i9iQctf8E82X
U1z8LeKixFH/cavKm/pCvqjDBjucIz7k8g0dHqJw

Filtering results (using minus-words)

Using minus-words, you can immediately remove the results you don't need. Similarly, using a filter, you can leave only those results that contain the necessary words.

Example of filtering in SE::Yandex::Suggest

Download example

How to import an example into A-Parser

eJx1VFtv0zAU/iuVNWlMGlWvEuStq6gEKutYuwfU9sFrToKZYwfbKZ1C/jvHl1zK
yot1rt+5uySG6hf9oECD0STaliR3NInI+lMUfacihlMUrYs0BW1673sLxg2oHpxo
lnMgtySnSoOyvttLLmgRQ0ILjlRJzGsOCC2PoBSLrTuLkU+kyqjBwM6MHCkvrNmV
l+i+17+7vtIedLcT1zek6gDmhkmhazyX0xKOwFu04aD6fwJcdcKORtMuduIqRn3I
L9oGyoYLCZH9bbDbeCcFQhrM+fCjA7wrBpPJxL7jD+59dpKDow9/HDN0zNTRg46p
p5+d0XjUUUxah7Gtx7cCo5Fqv6+T1gvXQdvTfNgPI26Ua3qEjfSlQivGUcM9zdwk
YmrAautR3PTNySLQOGY2HuU+gt2DNuqTYL9c5dooJlK0R1Yx0AslMxQbcCBW+Fpn
uCVXjrctLZz/N+9DIqMKwJZjtguKucSNIqFco4Zh/6mRahW2ISqJFDPO3Sa0Zg7+
rmA8xr2dJej0OTheNlm9waiaCruhcKd+K8yhQXHc3epr6xXLpUyxcCGxbM4yZpDX
c1kIO5sBCl8A8qZt99YskwqaMAE5RMe7zUHYBW6nNstb0VkZZ5M5Fx6kSFi6CkdR
WxZig5/DSsylPXVblyg4x6loeGw3ZKbDGCzTJviv89yFwLSa34AYKbn+svap5orh
Bk5tghl2shs1QB4o50+Py66GtBtVn9egcz+TN7fk3smo56/FvXF7ieHIPno5sSEN
pBJ3ERtS7Zu/rvkuy4s/XlRWOOqf+sFb275YW5Rhg7U7zmH1F8zL3Bw=

tip

See also: Results filters

Possible settings

Parameter nameDefault valueDescription
RegionRussiaSelect the region from which the search is performed
Request methodMethod 1Request method: Method 1 - old method, the same as before; Method 2 - new method, allows you to collect all extended suggestions (ads, facts, links to sites)