SE::Quora - Quora SERP scraper
Overview of the scraper
SE::Quora - Quora search results scraper.Collects results from the service of the same name.
You can use automatic query multiplication, substitution of subqueries from files, iteration of alphanumeric combinations and lists to get the maximum possible number of results.
A-Parser's functionality allows you to save scraping settings for the SE::Quora scraper for later use (presets), ), set a scraping schedule, and much more.
Result saving is possible in the form and structure that you need, thanks to the powerful built-in templating engine Template Toolkit which allows you to apply additional logic to the results and output data in various formats, including JSON, SQL and CSV.
Collected data
Quora has 6 result types: Questions, Answers, Posts, Profiles, Topics, and Spaces. The data set differs for each type, so in the scraper, each type is recorded in its own separate array. Depending on the type, the following are collected:
- Link to the question, question text, number of answers, and date
- Answer author, answer text, links to media in the answer, date and time of the answer, number of votes, views, and shares
- Link to the post, post title, post text, links to media in the post, author's name and profile link, publication date and time, number of votes, views, and shares
- and other data depending on the result type
Capabilities
- Select the desired result type or scrape all at once
- Select the results time frame
Use Cases
- Any scenarios where data needs to be retrieved from Quora
Queries
Keywords must be specified as queries, for example:
test
Examples of output results
A-Parser supports flexible result formatting thanks to the powerful built-in templating engine Template Toolkit, which allows it to output results in any desired form, as well as in structured formats, such as CSV or JSON
Default output
Result format:
$questions.format('$question\n')
Example result:
What is the best free online IQ test?
What is software testing?
How reliable is the DNA testing offered by sites like Ancestry.com or 23andMe?
How can I pass a urine drug test for meth?
How do you know if you're really smart without taking an IQ test?
Which is the best test series for CAT?
How reliable are online IQ tests?
Is software testing a good career choice?
What is the best test series for the GATE examination?
What is the best way to get my IQ checked online?
...
Getting cookies
Getting the required option for authorization
Spoiler: how to find the cookie?
- Go to quora.com, log in
- Open Developer Tools (F12) and refresh the page
- Go to the Network tab, find a request to quora.com
- Copy the entire cookie string
According to our tests, accounts are not banned (this may change in the future), but when scraping with more than 10 threads, Quora starts issuing errors and messages about too many requests. Therefore, it is recommended to scrape with a small number of threads or use cookies from multiple accounts.
Possible settings
| Parameter | Default value | Description |
|---|---|---|
| Pages count | 5 | Number of output pages |
| Results type | Questions | Result type |
| Results time | All time | Results time frame |
| Cookie | Field for specifying cookies from authorized accounts. You can specify cookies from multiple accounts, the scraper will randomly select from them for each attempt. |