SE::Yahoo::Suggest - Yahoo Suggestions Scraper
Scraper Overview
Scraper of search suggestions by keywords in Yahoo. Yahoo suggestions scraper solves one of the main SEO tasks, namely, fast automated retrieval of an extended semantic core. Thanks to the SE::Yahoo::Suggest scraper, you can automatically collect keyword databases from Yahoo search suggestions by request. By using the SE::Yahoo::Suggest scraper, you can easily and quickly scrape Yahoo suggestions based on the selected domain.
Thanks to the multi-threaded work of A-Parser, the processing speed of requests can reach 7700 requests per minute, which on average allows obtaining up to 51000 results per minute.
You can use automatic query multiplication, substitution of subqueries from files, enumeration of alphanumeric combinations and lists to obtain the maximum possible number of results. By using results filtering you can immediately clean up the result by removing all unnecessary garbage (using minus-words).
The functionality of A-Parser allows you to save the settings of the SE::Yahoo::Suggest scraper for further use (presets), set up a parsing schedule, and much more.
Saving results is possible in the form and structure that you need, thanks to the built-in powerful templating engine Template Toolkit which allows you to apply additional logic to the results and output data in various formats, including JSON, SQL, and CSV.
Collected Data
- Number of results by request
- Suggestions for the request
Capabilities
- Domain selection
Use Cases
- Collection of keyword databases
Queries
Search phrases should be specified as queries, for example:
write essay
Football
Waterfall
Speak in english
Cats and dogs
forex
cheap essay
Query Substitutions
You can use built-in macros for automatic substitution of subqueries from files, for example, if we want to add some list of other words to each query, we specify several main queries:
essay
article
thesis
In the query format, we specify a macro for substituting additional words from the Keywords.txt file, this method allows to increase the variability of queries many times:
{subs:Keywords} $query
This macro will create as many additional queries as there are in the file for each original search query, which in total will give [number of original queries(domains)] x [number of queries in the Keywords file] = [total number of queries] as a result of the macro operation.
For example, if the Keywords.txt file contains:
buy
cheap
As a result, the substitution macro will turn 3 main queries into 6:
buy essay
cheap essay
buy article
cheap article
buy thesis
cheap thesis
Output Results Options
A-Parser supports flexible formatting of results thanks to the built-in templating engine Template Toolkit, which allows it to output results in any form, as well as in a structured form, for example, CSV or JSON
Export of suggestions list
Similar to SE::Google::Suggest.
Output in CSV table
Similar to SE::Google::Suggest.
Keyword competition
Saving in SQL format
Result format:
[% FOREACH results;
"INSERT INTO serp VALUES('" _ query _ "', '"; suggest _ "')\n";
END %]
Example of result:
INSERT INTO serp VALUES('write essay', 'write essay for me')
INSERT INTO serp VALUES('write essay', 'write essay online')
INSERT INTO serp VALUES('write essay', 'write essay for you')
INSERT INTO serp VALUES('write essay', 'write essay free')
INSERT INTO serp VALUES('write essay', 'write essays')
INSERT INTO serp VALUES('write essay', 'write essay conclusion')
INSERT INTO serp VALUES('write essay', 'write essay on covid 19')
INSERT INTO serp VALUES('write essay', 'write essay today')
INSERT INTO serp VALUES('write essay', 'write essays for money')
INSERT INTO serp VALUES('write essay', 'write essay online for free')
...
Dumping results to JSON
Similar to SE::Google::Suggest.
Results processing
A-Parser allows processing results directly during scraping, in this section we have provided the most popular use cases for the SE::Yahoo::Suggest scraper.
Parse to level option
Similar to SE::Google::Suggest.
Filtering results (using negative keywords)
Similar to SE::Google::Suggest.
Possible settings
| Parameter name | Default value | Description |
|---|---|---|
| Yahoo domain | sugg.search.yahoo.com | Selects the Yahoo domain, allowing to choose the search language |