Skip to main content

SE::Bing - Bing search engine scraper

Bing

Parser overview​

Scraper of Bing search results. Thanks to the SE::Bing scraper, you can obtain huge databases of links ready for further use. You can use queries in the same form as you enter them in the Bing search bar, including search operators (contains, intitle, language, site etc.). More details on the official page Advanced search keywords.

A-Parser functionality allows you to save scraping settings for the Bing scraper for future use (presets), set scraping schedules, and much more. You can use automatic query multiplication, substitution of subqueries from files, enumeration of alphanumeric combinations, and lists to obtain the maximum possible number of results.

Saving results is possible in the form and structure you need, thanks to the powerful built-in template engine Template Toolkit which allows applying additional logic to results and outputting data in various formats, including JSON, SQL and CSV.

Scraper use cases​

Collected data​

  • Number of results for the query
  • Links, anchors, and snippets from search results
  • List of related keywords
  • Links, visible links, anchors, snippets, and ad position from ad results
Collected data

Capabilities​

  • Support for all Bing search operators (site:, ip: etc.). More details about search operators on the official page Advanced search keywords.
  • Scrapes the maximum number of results provided by Bing - up to 200 search result pages
  • Can automatically scrape more than 1000 results per query - by appending additional characters (option Parse all results)
  • Ability to scrape in depth by related keywords (Parse related to level)
  • Ability to search for related keywords
  • Ability to scrape links to cached pages
  • Ability to scrape mobile search results
  • Support for data loading during scrolling in mobile layout

The following scrapers are based on the Bing scraper:

  • SE::Bing::PositionSE::Bing::Position - determining positions of any websites in search results by a list of queries

Use cases​

  • Collecting link databases - for A-Poster, XRumer, AllSubmitter, etc.
  • Keyword competition assessment
  • Search for inbound links (mentions) of websites
  • Website indexing check
  • Search for vulnerable websites
  • Search for websites on the same IP address
  • Any other cases involving Bing scraping in one form or another

Queries​

Search phrases should be specified as queries, exactly as if they were entered directly into the Bing search form, for example:

test
windows Moscow   
site:http://lenta.ru  
ip:222.36.12.12

Query substitutions​

You can use built-in macros for query multiplication; for example, if we want to get a very large database of forums, we specify several main queries in different languages:

forum
forum
foro
论坛

In the query format, we specify character enumeration from a to zzzz, this method allows for maximum rotation of search results and obtaining many new unique results:

$query {az:a:zzzz}

This macro will create 475254 additional queries for each original search query, which in total will give 4 x 475254 = 1901016 search queries, an impressive figure, but not a problem for A-Parser at all. At a speed of 2000 queries per minute, such a task will be processed in just 16 hours.

Using operators​

You can use search operators in the query format, so they will be automatically added to each query from your list:

site:$query

Result output options​

A-Parser supports flexible result formatting thanks to the built-in template engine Template Toolkit, which allows it to output results in arbitrary form, as well as structured, such as CSV or JSON

Exporting a list of links​

Same as in SE::Google.

Same as in SE::Google.

Same as in SE::Google.

Same as in SE::Google.

Keyword competition​

Same as in SE::Google.

Link indexing check​

Same as in SE::Google.

Saving in SQL format​

Same as in SE::Google.

Result dump in JSON​

Same as in SE::Google.

Results processing​

A-Parser allows processing results directly during scraping; in this section, we have listed the most popular cases for the Bing scraper

Same as in SE::Google.

Same as in SE::Google.

Extracting domains​

Same as in SE::Google.

Removing tags from anchors and snippets​

Same as in SE::Google.

Same as in SE::Google.

Possible settings​

note

General settings for all scrapers

Parameter nameDefault valueDescription
Pages count10Number of pages to scrape (from 1 to 200)
RegionBased on IPRegion selection. List of regions.
Interface languageAnyInterface language selection. List of languages.
Safe SearchModerateSafe search option selection (Strict / Moderate / Off)
DeviceDesktopSearch device selection (Desktop / Mobile)
Show inaccessible results☐Allows enabling the display of hidden results
Stop pagination by results count0Stopping pagination traversal upon reaching a specified number of results. Works in addition to Pages count, scraping stops depending on what is reached first: the specified number of pages or the specified number of results.