Skip to main content

SE::Yahoo::Suggest - Yahoo Suggestions Scraper

Scraper Overview

Scraper of search suggestions by keywords in Yahoo. Yahoo suggestions scraper solves one of the main SEO tasks, namely, fast automated retrieval of an extended semantic core. Thanks to the SE::Yahoo::Suggest scraper, you can automatically collect keyword databases from Yahoo search suggestions by request. By using the SE::Yahoo::Suggest scraper, you can easily and quickly scrape Yahoo suggestions based on the selected domain.

Thanks to the multi-threaded work of A-Parser, the processing speed of requests can reach 7700 requests per minute, which on average allows obtaining up to 51000 results per minute.

Overview: speed of operation

You can use automatic query multiplication, substitution of subqueries from files, enumeration of alphanumeric combinations and lists to obtain the maximum possible number of results. By using results filtering you can immediately clean up the result by removing all unnecessary garbage (using minus-words).

The functionality of A-Parser allows you to save the settings of the SE::Yahoo::Suggest scraper for further use (presets), set up a parsing schedule, and much more.

Saving results is possible in the form and structure that you need, thanks to the built-in powerful templating engine Template Toolkit which allows you to apply additional logic to the results and output data in various formats, including JSON, SQL, and CSV.

Collected Data

  • Number of results by request
  • Suggestions for the request
Collected data

Capabilities

  • Domain selection

Use Cases

  • Collection of keyword databases

Queries

Search phrases should be specified as queries, for example:

write essay
Football
Waterfall
Speak in english
Cats and dogs
forex
cheap essay

Query Substitutions

You can use built-in macros for automatic substitution of subqueries from files, for example, if we want to add some list of other words to each query, we specify several main queries:

essay
article
thesis

In the query format, we specify a macro for substituting additional words from the Keywords.txt file, this method allows to increase the variability of queries many times:

{subs:Keywords} $query 

This macro will create as many additional queries as there are in the file for each original search query, which in total will give [number of original queries(domains)] x [number of queries in the Keywords file] = [total number of queries] as a result of the macro operation.

For example, if the Keywords.txt file contains:

buy
cheap

As a result, the substitution macro will turn 3 main queries into 6:

buy essay
cheap essay
buy article
cheap article
buy thesis
cheap thesis

Output Results Options

A-Parser supports flexible formatting of results thanks to the built-in templating engine Template Toolkit, which allows it to output results in any form, as well as in a structured form, for example, CSV or JSON

Export of suggestions list

Similar to SE::Google::Suggest.

Output in CSV table

Similar to SE::Google::Suggest.

Keyword competition

Similar to SE::Google.

Saving in SQL format

Result format:

[% FOREACH results;
"INSERT INTO serp VALUES('" _ query _ "', '"; suggest _ "')\n";
END %]

Example of result:

INSERT INTO serp VALUES('write essay', 'write essay for me')
INSERT INTO serp VALUES('write essay', 'write essay online')
INSERT INTO serp VALUES('write essay', 'write essay for you')
INSERT INTO serp VALUES('write essay', 'write essay free')
INSERT INTO serp VALUES('write essay', 'write essays')
INSERT INTO serp VALUES('write essay', 'write essay conclusion')
INSERT INTO serp VALUES('write essay', 'write essay on covid 19')
INSERT INTO serp VALUES('write essay', 'write essay today')
INSERT INTO serp VALUES('write essay', 'write essays for money')
INSERT INTO serp VALUES('write essay', 'write essay online for free')
...

Dumping results to JSON

Similar to SE::Google::Suggest.

Results processing

A-Parser allows processing results directly during scraping, in this section we have provided the most popular use cases for the SE::Yahoo::Suggest scraper.

Parse to level option

Similar to SE::Google::Suggest.

Filtering results (using negative keywords)

Similar to SE::Google::Suggest.

Possible settings

Parameter nameDefault valueDescription
Yahoo domainsugg.search.yahoo.comSelects the Yahoo domain, allowing to choose the search language