SE::Ask - American Google search results scraper through Ask.com
Scraper Overview
Ask search results scraper. Thanks to the Ask scraper, you can get large databases of links ready for further use. You can use queries in the same way as you enter them in the Ask search bar, including search operators (site, inurl, etc.).
A-Parser functionality allows you to save the Ask scraper parsing settings for further use (presets), set up a parsing schedule, and much more. You can use automatic query multiplication, substitution of subqueries from files, enumeration of alphanumeric combinations and lists to obtain the maximum possible number of results.
Saving results is possible in the form and structure you need, thanks to the built-in powerful templating engine Template Toolkit which allows you to apply additional logic to the results and output data in various formats, including JSON, SQL, and CSV.
Collected Data
- Links, anchors, and snippets from the results
- Related keywords
Capabilities
- Scrapes the maximum number of results - 10 pages
- Scrapes up to 100 results of American Ask.com search results
- Ability to collect related keywords
Use Cases
- Collecting link databases - for A-Poster, XRumer, AllSubmitter, etc.
- Competition assessment for keywords
- Backlink (mentions) search for sites
- Site indexing check
- Vulnerable site search
- Any other options involving scraping Ask.com in one way or another
Queries
Queries should be specified as search phrases, just as if you were entering them directly into the Ask.com search form, for example:
test
окна Москва
Query Substitutions
You can use built-in macros to expand queries. For example, if we want to get a very large database of forums, we will specify several main queries in different languages:
forum
форум
foro
论坛
In the query format, we will specify the enumeration of characters from a to zzzz, this method allows for maximum rotation of the search results and obtaining many new unique results:
$query {az:a:zzzz}
This macro will create 475254 additional queries for each original search query, which will give a total of 4 x 475254 = 1901016 search queries, an impressive figure, but not a problem for A-Parser. At a speed of 2000 requests per minute, this task will be processed in just 16 hours.
Using Operators
You can use search operators in the query format, so it will be automatically added to each query in your list:
site:$query
Output Results Examples
A-Parser supports flexible formatting of results thanks to the built-in templating engine Template Toolkit, which allows it to output results in any form, as well as in a structured form, for example CSV or JSON
Exporting a list of links
Links + anchors + snippets with position output
Output of links, anchors, and snippets in CSV table
Saving related keywords
Saving in SQL format
Dumping results to JSON
Results processing
A-Parser allows processing results directly during scraping, in this section we have provided the most popular use cases for the Ask scraper
Link deduplication
Link deduplication by domain
Extracting domains
Removing tags from anchors and snippets
Filtering links by inclusion
Possible settings
| Parameter name | Default value | Description |
|---|---|---|
| Pages count | 5 | Number of pages to scrape (from 1 to 10) |
| Use http2 | ☑ | Use http2 |