Skip to main content

SE::Startpage - startpage.com search results parser

img

Startpage parser overviewโ€‹

Startpage search results parser. With the Startpage parser, you can retrieve large databases of links ready for further use. You can use queries in the same way as you enter them in the Startpage search bar, including search operators (site, inurl, etc.).

The A-Parser functionality allows you to save the parsing settings of the Startpage parser for further use (presets), set a parsing schedule, and much more. You can use automatic query replication, substitution of subqueries from files, enumeration of alphanumeric combinations and lists to get the maximum possible number of results.

Saving results is possible in the form and structure that you need, thanks to the built-in powerful Template Toolkit that allows you to apply additional logic to the results and output data in various formats, including JSON, SQL, and CSV.

List of collected dataโ€‹

  • Links, anchors, and snippets from search results

Data collected by the SE::Startpage parser

Capabilitiesโ€‹

  • Supports country, search language, and page language selection
  • Ability to output anchors, links, and snippets together or separately
  • Ability to specify the number of results displayed
  • Specifying the size of the output (10 or 20 results)

Use casesโ€‹

  • Collecting databases of links, anchors, and snippets
  • Obtaining a list of sites that are most frequently mentioned in search engines
  • Any other use cases for obtaining information

Query examplesโ€‹

  • Queries are specified as words, phrases, or phrases in the same way as they are entered in the search engine. Example:
ั‚ะตัั‚  
site:http://test.ru
ะบั€ะฐัะฝั‹ะต ั€ะพะทั‹

Query substitutionsโ€‹

You can use built-in macros to replicate queries. For example, we want to get a very large database of forums, we will specify several main queries in different languages:

forum
ั„ะพั€ัƒะผ
foro
่ฎบๅ›

In the query format, we will specify the enumeration of characters from a to zzzz, this method allows us to rotate the search results to the maximum and get many new unique results:

$query {az:a:zzzz}

This macro will create 475254 additional queries for each original search query, which in total will give 4 x 475254 = 1901016 search queries, an impressive number, but it is not a problem for A-Parser. At a speed of 2000 requests per minute, this task will be processed in just 16 hours.

Using operatorsโ€‹

You can use search operators in the query format, so it will be automatically added to each query from your list:

site:$query

Result output optionsโ€‹

A-Parser supports flexible result formatting thanks to the built-in Template Toolkit, which allows it to output results in any form, as well as in a structured form, such as CSV or JSON.

Same as in SE::Google.

Same as in SE::Google.

Same as in SE::Google.

Saving in SQL formatโ€‹

Same as in SE::Google.

Dumping results in JSONโ€‹

Same as in SE::Google.

Result processingโ€‹

A-Parser allows you to process results during parsing, in this section, we have provided the most popular cases for the Startpage parser.

Same as in SE::Google.

Same as in SE::Google.

Domain extractionโ€‹

Same as in SE::Google.

Removing tags from anchors and snippetsโ€‹

Same as in SE::Google.

Same as in SE::Google.

Possible settingsโ€‹

Parameter nameDefault valueDescription
Pages count5Number of pages to parse (from 1 to 50)
Family filterFilter depending on searchSelect filtering level (Filter all results / Filter depending on search / Do not filter my results)
PeriodAny timeSelect period of issuance (Any time / Past 24 hours / Past week / Past month / Past year)
Links per page10Size of issuance (10 / 20)
Results languageEnglishSelect language of results
Page languageEnglishSelect language of page
Search countryAllSelect country from which the search is being carried out