Skip to main content

SE::Rambler - Rambler search engine results parser

img

Overview of the parser​

Rambler search results parser. Thanks to the Rambler parser, you will be able to obtain large databases of links ready for further use. You can use queries in the same form as you enter them in the Rambler search bar, including search operators (site, ip, etc.).

A-Parser functionality allows you to save Rambler parser settings for future use (presets), set a parsing schedule, and much more. You can use automatic query multiplication, substitution of subqueries from files, brute-forcing of alphanumeric combinations and lists to obtain the maximum possible number of results.

Saving results is possible in the form and structure you need, thanks to the built-in powerful template engine Template Toolkit which allows applying additional logic to results and outputting data in various formats, including JSON, SQL, and CSV.

Collected data​

  • Number of results in the SERP
  • Links, anchors, and snippets from the SERP
  • List of related keywords (hints)

what data the SE::Rambler parser collects

Capabilities​

  • Support for Rambler search operators (url:, site:, inurl:, host:, rhost:, domain:.)
  • Parses up to 25 pages, from 10 to 50 results per page
  • Parses related keywords ($hints)
  • Ability to use solving services to bypass captchas
  • Choice of delivery device: regular desktop, mobile Android, or mobile iOS

Use cases​

  • Collecting link databases
  • Assessing competition for keywords
  • Searching for backlinks (mentions) of sites
  • All cases when you need to parse Rambler search results

Queries​

Specify queries just as in Rambler search. For example, if you only need links from one site. Enter in the queries field:

"buy doors" site:http://kp.ru

Query substitutions​

You can use built-in macros for query multiplication, for example, if we want to get a very large database of forums, we will specify several main queries in different languages:

forum
forum
foro
论坛

In the query format, we will specify a character brute-force from a to zzzz, this method allows for maximum rotation of search results and obtaining many new unique results:

$query {az:a:zzzz}

This macro will create 475254 additional queries for each original search query, which in total will give 4 x 475254 = 1901016 search queries, an impressive figure, but it is not a problem at all for A-Parser. At a speed of 2000 queries per minute, such a task will be processed in just 16 hours.

Using operators​

You can use search operators in the query format, so it will be automatically added to each query from your list:

site:$query

Output results examples​

A-Parser supports flexible result formatting thanks to the built-in template engine Template Toolkit, which allows it to output results in an arbitrary form, as well as in a structured one, such as CSV or JSON

Exporting a list of links​

Same as in SE::Google.

Same as in SE::Google.

Same as in SE::Google.

Result format:

$hints.format('$hint\n')

Result example:

habrahabr
habr
habrahabr ru
xabra
livebusiness
eureka
electronic accountant
elba island
elba electronic accountant
habrahabr
...

Saving in SQL format​

Same as in SE::Google.

Result dump in JSON​

Same as in SE::Google.

Results processing​

A-Parser allows processing results directly during parsing; in this section, we have provided the most popular cases for the Rambler parser

Same as in SE::Google.

Same as in SE::Google.

Extracting domains​

Same as in SE::Google.

Removing tags from anchors and snippets​

Same as in SE::Google.

Same as in SE::Google.

Possible settings​

note

Common settings for all parsers

Parameter nameDefault valueDescription
DeviceDesktopChoice of delivery device: regular desktop, mobile Android, or mobile iOS
Pages count5Number of pages to parse (from 1 to 25)
Links per page10Number of results per page (10/15/30/50)
Rambler region IDAbility to set a region. You need to specify the region ID. How to find the ID of the required region is described here
SortSites by relevanceChoice of result sorting option
Results filteringModerateChoice of result filtering option
Results languageAny languageChoice of result search language
Serp timeAnytimeChoice of result period
Results typeAny formatChoice of result type (mime type)
Exact match☐Strict match to the query
Disable autocorrect☐Disables autocorrection, allows parsing the SERP exactly for the specified query
Use sessions☑Saves good sessions, which allows parsing even faster, receiving fewer errors
AntiGate presetdefaultDetermines whether to use Util::AntiGateUtil::AntiGate to bypass captchas