Rank::Curlie - check site presence in Curlie catalog (DMOZ analog)
Overview of the scraper
Curlie is the largest and most comprehensive human-edited directory on the web. It is built and maintained by a vast community of volunteer editors from all over the world. Formerly known as DMOZ and the Open Directory Project (ODP).
Results can be saved in the form and structure you need, thanks to the built-in powerful templating engine Template Toolkit which allows applying additional logic to the results and outputting data in various formats, including JSON, SQL and CSV.
Collected data
Data is collected from the service curlie.org:
- Finding the website in the Curlie catalog (analog of DMOZ)
Use cases
- Checking the presence of a website in the curlie.org catalog
Queries
As queries, you must specify a list of domains, for example:
bing.com
learn.javascript.ru
trello.com
ellistalks.com
megastom.ru
Output results examples
A-Parser supports flexible result formatting thanks to the built-in templating engine Template Toolkit, which allows it to output results in an arbitrary form, as well as in structured formats, such as CSV or JSON
Default output
Result format:
$query: $exists\n
The result shows the domain and its presence (1) or absence (0) in the curlie.org catalog:
bing.com: 1
trello.com: 1
megastom.ru: 0
ellistalks.com: 1
learn.javascript.ru: 1
Output in CSV table
Result format:
[% tools.CSVline(query, exists) %]
Result example:
"trello.com",1
"bing.com",1
"ellistalks.com",1
"learn.javascript.ru",1
"megastom.ru",0