Additional options for some scrapers

Some scrapers support additional options that can be added via the settings context menu.

Parse all results

This option is available for SE::Google, SE::Yandex, SE::Bing, SE::Yahoo scrapers and allows bypassing the output limits of 1000 results per query:

• When parsing queries, A-Parser estimates the number of results in the SERP displayed by Google or Yandex
• Depending on the number of results, the scraper adds many additional queries, thereby allowing significantly more results (often all) to be scraped for a single query

Parse to level

This option is available for suggestion scrapers (e.g., SE::Google::Suggest), for the SE::Yandex::WordStat scraper and for the link scraperHTML::LinkExtractor:

• For suggestion and wordstat scrapers, scraped keywords are re-substituted into queries, allowing all nested keywords to be scraped up to the specified level
• For the HTML::LinkExtractor scraper, all internal links of the site are re-substituted into queries, allowing the entire site to be traversed, compiling its link map

note

For this option, it is essential to enable query deduplication, otherwise, a situation may arise where the scraper continuously scrapes the same keywords or links in a loop

Parse related to level

This option allows specifying the possibility of deep scraping through related keywords. Supported by SE::Google, SE::Bing, SE::Yahoo.

Other options

There are a number of additional options for different scrapers; you can find more details about their purpose in the documentation for each scraper:

• Use Pages, Check Content, Check Next Page - options for the Net::HTTP
• Parse People also ask - option for the SE::Google