Skip to main content

SE::Bing - Bing search results scraper

Bing

Overview of the scraper​

The Bing search results scraper. allows you to get huge link databases ready for further use. You can use queries in the same form as you enter them into the Bing search bar, including search operators (contains, intitle, language, site etc.). More details on the official Advanced search keywords.

A-Parser's functionality allows you to save Bing scraper parsing settings for future use (presets), ), set a parsing schedule, and much more. You can use automatic query multiplication, substitution of subqueries from files, iteration of alphanumeric combinations and lists to get the maximum possible number of results.

Results can be saved in the form and structure you need, thanks to the powerful built-in templater Template Toolkit which allows you to apply additional logic to the results and output data in various formats, including JSON, SQL and CSV.

Use cases for the scraper​

Collected data​

  • Number of results per query
  • Links, anchors, and snippets from search results
  • List of related keywords
  • Links, visible links, anchors, snippets, and position of ads from advertising results
Collected data

Capabilities​

  • Support for all Bing search operators (site:, ip: etc.). More details about search operators on the official Advanced search keywords.
  • Scrapes the maximum number of results provided by Bing - up to 200 pages of search results
  • Can automatically scrape more than 1000 results per query - substitutes additional characters (the Parse all results option)
  • Ability to deep scrape related keywords (Parse related to level)
  • Ability to find related keywords
  • Ability to scrape links to cached pages
  • Ability to scrape mobile search results
  • Support for loading data when scrolling in the mobile layout

The following scrapers work based on the Bing scraper:

  • SE::Bing::PositionSE::Bing::Position - determining the positions of any sites in the search results based on a list of queries

Use Cases​

  • Collecting link bases - for A-Poster, XRumer, AllSubmitter, etc.
  • Assessing competition for keywords
  • Searching for backlinks (mentions) of sites
  • Checking site indexing
  • Finding vulnerable sites
  • Finding sites on the same IP address
  • Any other options involving Bing scraping in some form

Queries​

Search phrases should be specified as queries, exactly as if they were entered directly into the Bing search form, for example:

test
windows Moscow
site:http://lenta.ru  
ip:222.36.12.12

Query substitutions​

You can use built-in macros to multiply queries, for example, if we want to get a very large database of forums, we specify several main queries in different languages:

forum
forum
foro
论坛

In the query format, we specify iterating through characters from a to zzzz, this method allows maximum rotation of search results and retrieval of many new unique results:

$query {az:a:zzzz}

This macro will create 475254 additional queries for each source search query, which will total 4 x 475254 = 1901016 search queries, an impressive number, but this is not a problem for A-Parser. At a speed of 2000 queries per minute, this task will be processed in just 16 hours.

Using operators​

You can use search operators in the query format; this way, they will be automatically added to each query in your list:

site:$query

Output Results Examples​

A-Parser supports flexible results formatting thanks to the built-in templater Template Toolkit, which allows it to output results in any form, as well as in a structured format, such as CSV or JSON

Exporting a list of links​

Same as in SE::Google.

Same as in SE::Google.

Same as in SE::Google.

Same as in SE::Google.

Keyword competition​

Same as in SE::Google.

Checking link indexing​

Same as in SE::Google.

Saving in SQL format​

Same as in SE::Google.

Dumping results to JSON​

Same as in SE::Google.

Results Processing​

A-Parser allows you to process results directly during scraping; in this section, we provide the most popular use cases for the Bing scraper

Same as in SE::Google.

Same as in SE::Google.

Extracting domains​

Same as in SE::Google.

Removing tags from anchors and snippets​

Same as in SE::Google.

Same as in SE::Google.

Possible settings​

note

Common settings for all scrapers

Parameter NameDefault ValueDescription
Pages count10Number of pages to scrape (from 1 to 200)
RegionBased on IPRegion selection. List of regions.
Interface languageAnyInterface language selection. List of languages.
Safe SearchModerateSafe search option selection (Strict / Moderate / Off)
DeviceDesktopSearch device selection (Desktop / Mobile)
Show inaccessible results☐Allows you to enable the display of hidden results
Stop pagination by results count0Stops pagination traversal upon reaching a specified number of results. Works in addition to Pages count; scraping stops depending on which is reached first: the set number of pages or the set number of results.
Last updated on