SE::Bing - Bing Search Results Parser
Bing Parser Overviewโ
Bing search results parser. With the SE::Bing parser, you can get huge databases of links ready for further use. You can use queries in the same format as you enter them in the Bing search bar, including search operators (contains, intitle, language, site, etc.). More details on the official page Advanced search keywords.
The A-Parser functionality allows you to save the parsing settings of the Bing parser for further use (presets), set a parsing schedule, and much more. You can use automatic query multiplication, substitution of subqueries from files, enumeration of alphanumeric combinations and lists to get the maximum possible number of results.
Saving results is possible in the format and structure that you need, thanks to the built-in powerful Template Toolkit template engine, which allows you to apply additional logic to the results and output data in various formats, including JSON, SQL, and CSV.
Bing Parser Use Casesโ
Parsing Bing search results
Parsing Bing with automatic query multiplication (Parse all results)
Parsing top 10 and tag content
Multilevel parsing. Parsing top 10 and title and description tag content for these sites
JS parser based on Bing parser
Creating JS parsers. Getting results from the standard parser
Parsing all results in Bing
Parsing with intelligent query substitution through the Template Toolkit template engine and tools.query.add
Uniqueness in Bing
Parsing unique URLs by key and uniqueness by domain, with the ability to specify the maximum number of URLs on one domain
Multiple parsers in a preset
The preset shows an example of using multiple parsers
List of Collected Dataโ
- Number of results for the query
- Links, anchors, and snippets from the search results
- List of related keywords(Related keywords)
Featuresโ
- Support for all Bing search operators (site:, ip:, etc.). More details on search operators on the official page Advanced search keywords.
- Parses the maximum number of results returned by Bing - 50 pages of 50 items in the search results
- Can automatically parse more than 1000 results per query - substitutes additional characters (option Parse all results)
- Ability to parse in depth by related keywords (Parse related to level)
- Ability to search for related keywords
- Ability to parse links to cached pages
- Ability to parse mobile search results
The following parsers are based on the Bing parser:
SE::Bing::Position - determining the positions of any sites in the search results by a list of queries
Use Casesโ
- Collecting link databases - for A-Poster, XRumer, AllSubmitter, etc.
- Evaluating competition for keywords
- Finding backlinks (mentions) of sites
- Checking site indexing
- Finding vulnerable sites
- Finding sites on the same IP address
- Any other use cases involving parsing Bing in one way or another
Query Examplesโ
- Queries must be specified as search phrases, just as if you were entering them directly into the Bing search form, for example:
test
ะพะบะฝะฐ ะะพัะบะฒะฐ
site:http://lenta.ru
ip:222.36.12.12
Query Substitutionsโ
You can use built-in macros to multiply queries, for example, we want to get a very large database of forums, specify several basic queries in different languages:
forum
ัะพััะผ
foro
่ฎบๅ
In the query format, we specify the enumeration of characters from a to zzzz, this method allows you to rotate the search results to the maximum and get many new unique results:
$query {az:a:zzzz}
This macro will create 475254
additional requests for each original search query, which in total will give 4 x 475254 = 1901016
search queries, an impressive number, but it is not a problem for A-Parser. With a speed of 2000
requests per minute, this task will be processed in just 16
hours.
Using Operatorsโ
You can use search operators in the query format, so it will be automatically added to each query from your list:
site:$query
Result Output Optionsโ
A-Parser supports flexible result formatting thanks to the built-in Template Toolkit, which allows it to output results in any form, as well as in a structured form, such as CSV or JSON.
Exporting a List of Linksโ
Links + Anchors + Snippets with Position Outputโ
Outputting Links, Anchors, and Snippets to a CSV Tableโ
Saving Related Keywordsโ
Keyword Competitionโ
Checking Link Indexingโ
Saving in SQL Formatโ
Dumping Results in JSONโ
Result Processingโ
A-Parser allows you to process results during parsing, and in this section, we have provided the most popular cases for the Bing parser.
Link Uniquenessโ
Link Uniqueness by Domainโ
Extracting Domainsโ
Removing Tags from Anchors and Snippetsโ
Filtering Links by Inclusionโ
Possible Settingsโ
Parameter Name | Default Value | Description |
---|---|---|
Pages count | 10 | Number of pages to parse (from 1 to 50) |
Links per page | 30 | Number of links in the search results on each page (Auto / 10 / 15 / 30 / 50) |
Region | Based on IP | Region selection. List of regions. |
Interface language | Any | Interface language selection. List of languages. |
Safe Search | Moderate | Safe search option selection (Strict / Moderate / Off) |
Device | Desktop | Search device selection (Desktop / Mobile) |
Fix pagination bug | โ | Fixing a bug in Bing search that returns empty 2nd and subsequent pages |