Results Builder

Results Builder - allows you to transform the results from each #PARSER_TAG_001# before formatting them and saving them to disk.

Capabilities

• Splitting the result into parts using a regular expression or a custom separator
• Replacing a substring in the result or replacing by regular expression
• Extracting the domain or main domain from a link
• Converting the result to upper/lower case
• Removing HTML tags (<b>text</b> -> text)
• Removing HTML tags (#CODEKEEP_L_22#
• Converting HTML entities to their Unicode equivalents (© -> ©)

Examples

Domain Parsing

Saving only domains when scraping links from search engines:

The source elements used are link from the array serp from the first scraper, the function to extract the main domain from the link will be applied to each element, the new result will be saved under the same name (the link element in the serp array) - therefore, no change to the result format is required

Snippet Parsing with Cleaning

Saving snippets from search engines, cleaned of HTML tags and with HTML entities converted

By default, anchors and snippets are parsed with all nested tags, which allows preserving the same formatting as when viewing search engine results. If only plain text is needed, you can use the capabilities of the Results Builder:

In this example, two Results Builders are sequentially applied to the snippets: HTML tag removal and HTML entity conversion

Parsing using XPath

Parsing links from search results using XPath:

This example shows parsing links from Google search engine. The following XPath query is used:

//*[@id="rso"]/div[3]/div/div[1]/a/@href