Representation of results

A-Parser was created for parsing of information of any kinds, were for this purpose introduced 2 types of results :

• Simple results (Flat)
• Arrays of results (Array)

We will consider each type on the example of a parcer SE::Google, screenshot of search result:

Simple results(top)

Simple results - when corresponds to one request one result, examples:

• Amount of results on request ($totalcount)
• Whether the request is a misprint ($misspell, on a screenshot isn't displayed)

Other examples:

• Value of PageRank ($pr) in a parser SE::Google::pR
• Value of TIC ($tic) in a parcer SE::Yandex::TIC
• Number of the referring domains ($domains), IP addresses ($ips), backlinks ($backlinks), etc. in a parser Rank::MajesticSEO

Single results contains in normal variables ($ prefix + name)

Arrays of results(top)

Arrays of results - when corresponds to one request the list of results, each element of list in turn may contain some nested elements. Let us consider on example of search output of Google - it is provided in a parser by an array $serp, for descriptive reasons we will use the table, in which write the first 5 results of output:
Each line item of output writers in array with 3 nested elements - the link ($link), an anchor ($anchor), a snippet ($snippet)
Other example - the list of the related keywords, which remains in array $related:
Apparently in this array only one nested element - keyword ($key)
Numbering of elements in arrays begins with 0, an example of access to separate array cells:

• $serp.0.link - the first link from output
• $serp.3.anchor - the fourth anchor from output
• $related.0.key - first related keyword

More details about formatting of simple results and arrays it will be described below

Viewing of possible results(top)

Each parser has the result set, view the list of available results possible to having guided at a parcer the pointer, in the tooltip balloon will be displayed the list of simple results and arrays, with the list of nested elements:Yellow are marked results which is the general for all parsers :

• $query - the request transferred to a parser after formatting
• $query.orig - original request (in that look as it was in the file or in a field of request)
• $query.first - the first request when using options of nested parsing (Parse all results or Parse to level)
• $info.success - information about success of parsing of this request
• $info.retries - number of the used retries for this request
• $info.stats - statistics of work a parcer for this request
• $pages.$i.data - an array with the raw responses from the server for possibility of free extraction of additional information

Green are marked results available only to a parser SE::Google:

• $related.$i.key - an array with the list of the related keywords
• $ads with elements $link, $anchor and $snippet - an array with the list of ads
  $serp
• with $link elements , the $anchor and the $snippet - an array with the main output of the searcher

Pay attention that for arrays $i variable obviously is specified, meaning that elements a few and it is possible to address to them on an index (number of position) or look over each element in a cycle

Also available variable $response, which allows you get any query variables, including all previous redirections.

Basic principles of formatting(top)

After the parser collected data in simple results and arrays, they need to be displayed (or save to the file) in the necessary format. For convenience and functionality in A-Parser used Template Toolkit. We will investigate often used constructions, for this purpose we will use the tool Template tester. We will select the project for a parser SE::Google:

On a screenshot 3 fields are provided:

• JSON - internal data representation in a parcer
• Template - a template on which there is a formatting of result
• Result - directly the transformed data on the specified template, in such look result will be written in the file

Changing a template we can change a type of result, we will consider the following template:

Select the basic rules:

• Plain text is output in result as is, without changes
• For output of simple results it is necessary in the right place to output the variable, containing the necessary result with $ prefix
• For formatting of arrays is used format method, about it is below
• \n is responsible for line break

Formatting of arrays(top)

Formatting of arrays, we will investigate construction: This record means that for an array of the $serp it is necessary to call the method format with parameter '$link $anchor\n$snippet\n\n'. Method format joins to a string all array cells on the template specified in parameter, and the template means For everyone element in array of $serp to output the link and anchor through a gap, then since a new line to output a snippet, then there are two more line breaks, as a result of generating blank line between results

The output of variable values in JSON(top)

The output of variable values in JSON:
.json method allows you to display data in JSON format:


Examples
Output of competition on request (amount of results on request) for all parsers of search engines ( SE::Google, SE::Yandex...): Result:
Output of links from output of search engines: Result:
Output of suggests from search engines: Result:
Output of statistics on a keyword using a parser SE::Yandex::WordStat: