SE::Quora - Quora search results scraper
Overview of the parser
SE::Quora - Quora search results parser.Collects results from the service of the same name.
You can use automatic query multiplication, substitution of subqueries from files, permutation of alphanumeric combinations, and lists to obtain the maximum possible number of results.
A-Parser functionality allows you to save SE::Quora parsing settings for future use (presets), set a parsing schedule, and much more.
Saving results is possible in any form and structure you need, thanks to the built-in powerful Template Toolkit which allows you to apply additional logic to results and output data in various formats, including JSON, SQL, and CSV.
Collected data
Quora has 6 types of results: Questions, Answers, Posts, Profiles, Topics, and Spaces. Each type has a different set of data, so the parser records each type into its own separate array. Depending on the type, the following are collected:
- Link to the question, question text, number of answers, and date
- Answer author, answer text, links to media in the answer, date and time of the answer, number of upvotes, views, and shares
- Link to the post, post title, post text, links to media in the post, author name and profile link, publication date and time, number of upvotes, views, and shares
- and other data depending on the result type
Capabilities
- Selection of the required result type or parsing all at once
- Selection of the results time range
Use cases
- Any scenarios where you need to obtain data from Quora
Queries
You should specify keywords as queries, for example:
test
Output results examples
A-Parser supports flexible result formatting thanks to the built-in Template Toolkit, which allows it to output results in an arbitrary form, as well as in a structured one, such as CSV or JSON
Default output
Result format:
$questions.format('$question\n')
Result example:
What is the best free online IQ test?
What is software testing?
How reliable is the DNA testing offered by sites like Ancestry.com or 23andMe?
How can I pass a urine drug test for meth?
How do you know if you're really smart without taking an IQ test?
Which is the best test series for CAT?
How reliable are online IQ tests?
Is software testing a good career choice?
What is the best test series for the GATE examination?
What is the best way to get my IQ checked online?
...
Obtaining cookies
Obtaining the mandatory option for authorization
Spoiler: how to find cookies?
- Go to quora.com and log in
- Open Developer Tools (F12) and refresh the page
- Go to the Network tab, find the request to quora.com
- Copy the entire cookie string
According to our tests, accounts are not banned (this may change in the future), but when parsing in more than 10 threads, Quora starts returning errors and messages about too many requests. Therefore, it is recommended to parse in a small number of threads or use cookies from several accounts.
Possible settings
| Parameter | Default value | Description |
|---|---|---|
| Pages count | 5 | Number of search result pages |
| Results type | Questions | Result type |
| Results time | All time | Result time |
| Cookie | Field for specifying cookies from authorized accounts. You can specify cookies from multiple accounts; the parser will randomly select from them for each attempt. |