SE::Yahoo - Yahoo search results parser
Yahoo parser overviewโ
Yahoo search results parser. With the Yahoo parser, you can get large databases of links ready for further use. You can use queries in the same way as you enter them in the Yahoo search bar, including search operators (site, ip, etc.).
A-Parser functionality allows you to save Yahoo parser parsing settings for further use (presets), set a parsing schedule, and much more. You can use automatic query replication, substitution of subqueries from files, enumeration of alphanumeric combinations and lists to get the maximum possible number of results.
Saving results is possible in the form and structure that you need, thanks to the built-in powerful Template Toolkit template engine, which allows you to apply additional logic to results and output data in various formats, including JSON, SQL, and CSV.
List of collected dataโ
- Links, anchors, and snippets from search results
- List of related keywords
Featuresโ
- Support for all Yahoo search operators (site:, ip:, etc.)
- Parses the maximum number of results returned by Yahoo - 50 pages of 100 items in the search results
- Can automatically parse more than 1000 results per query - substitutes additional characters (option Parse all results)
- Ability to parse related keywords in depth (Parse related to level)
- Ability to search for related keywords
- Supports time of issuance indication
Use casesโ
- Collecting link databases - for A-Poster, XRumer, AllSubmitter, etc.
- Evaluating keyword competition
- Finding backlinks (mentions) of sites
- Checking site indexing
- Finding sites on the same IP address
- Finding vulnerable sites
- Any other options involving Yahoo parsing in one way or another
Query examplesโ
- Queries must be specified as search phrases, just as if you were entering them directly into the Yahoo search bar, for example:
test
ะพะบะฝะฐ ะะพัะบะฒะฐ
site:http://lenta.ru
ip:222.36.12.12
Query substitutionsโ
You can use built-in macros to replicate queries, for example, we want to get a very large database of forums, specify several basic queries in different languages:
forum
ัะพััะผ
foro
่ฎบๅ
In the query format, we specify the enumeration of characters from a to zzzz, this method allows us to rotate the search results to the maximum and get many new unique results:
$query {az:a:zzzz}
This macro will create 475254 additional queries for each original search query, which in total will give 4 x 475254 = 1901016 search queries, an impressive figure, but this is not a problem for A-Parser. At a speed of 2000 requests per minute, this task will be processed in just 16 hours.
Using operatorsโ
You can use search operators in the query format, so it will be automatically added to each query from your list:
site:$query
Result output optionsโ
A-Parser supports flexible result formatting thanks to the built-in Template Toolkit template engine, which allows it to output results in any form, as well as in a structured form, such as CSV or JSON.
Exporting a list of linksโ
Links + anchors + snippets with position outputโ
Output of links, anchors, and snippets in CSV tableโ
Saving related keywordsโ
Keyword competitionโ
Checking link indexingโ
Saving in SQL formatโ
Dumping results to JSONโ
Results processingโ
A-Parser allows processing results directly during parsing, in this section we have provided the most popular cases for the Yahoo parser.
Link uniquenessโ
Link uniqueness by domainโ
Domain extractionโ
Removing tags from anchors and snippetsโ
Filtering links by inclusionโ
Possible settingsโ
| Parameter name | Default value | Description |
|---|---|---|
| Pages count | 5 | Number of pages to parse (from 1 to 50) |
| Links per page | 100 | Number of links in the output on each page (10 / 15 / 20 / 30 / 40 / 100) |
| Serp time | All time | Serp time (temporally dependent search, parameter "tbs=": All time / Past 24 hours / Past week / Past month) |
| Safe Search | Moderate | Safe search option (Off / Moderate / Strict) |
| Yahoo domain | United States (English) | Yahoo domain selection |
| Yahoo language | Any | Yahoo language selection, allows you to choose the language of search |
| Yahoo country | Any | Country selection, allows you to choose the country for which the search will be performed |
| Not found is error | โ | Whether to consider the absence of results as an error |