Skip to main content

Cloudflare::Radar - Cloudflare Radar Parser

Cloudflare Radar Parser Overview

img

Cloudflare Radar Parser allows you to quickly determine the category of a website by its domain name.

Results can be saved in the format and structure you need, thanks to the built-in powerful Template Toolkit template engine that allows you to apply additional logic to the results and output data in various formats, including JSON, SQL, and CSV.

Collected data

  • Data is collected from https://radar.cloudflare.com/
  • Website categories

Use cases

  • Determining which category a domain belongs to

Queries

  • A list of domains must be specified as queries, for example:

a-parser.com
yandex.ru
google.com
vk.com
facebook.com
youtube.com

Results

  • The results display categories and their descriptions:
a-parser.com: Business, Business & Economy, 
yandex.ru: News & Media, Entertainment,
vk.com: Social Networks, Society & Lifestyle,
youtube.com: Video Streaming, Entertainment,
facebook.com: Social Networks, Society & Lifestyle,
google.com: Search Engines, Technology,

Result output options

A-Parser supports flexible result formatting thanks to the built-in Template Toolkit template engine, which allows it to output results in any form, as well as in a structured form, such as CSV or JSON.

Outputting basic domain data

Result format:

$query:\n$categories.format('$name - $desc\n')

Result format for CSV:

[%  FOREACH categories;    tools.CSVline(name, desc); END  %]

Example result:

Business,"Sites related to business."
"Business & Economy","Sites that are related to business, economy, finance, education, science and technology."
"Social Networks","Sites that facilitate interaction and networking between people."
"Society & Lifestyle","Sites related to lifestyle that are not included in other categories like fashion, food & drink etc."
"Social Networks","Sites that facilitate interaction and networking between people."
"Society & Lifestyle","Sites related to lifestyle that are not included in other categories like fashion, food & drink etc."
"Search Engines","Sites that allow users to search for content using keywords."
Technology,"Sites related to technology that are not included in the science category."
"News & Media","Sites related to news and media."
Entertainment,"Sites related to entertainment that are not includeded in other categories like Comic books, Audio streaming, Video streaming etc."

Result format in JSON:

Initial text:

[% data = {} %]

Final text:

[% data.json %]

Overall result format:

[%  
obj = {};
obj.query = query;
obj.categories = [];
FOREACH p1.categories;
category = {};
category.name = name;
category.desc = desc;
obj.categories.push(category);
END;
data.push(obj)
%]

Example result:

[{"query":"yandex.ru","categories":[{"desc":"Sites related to news and media.","name":"News & Media"},{"desc":"Sites related to entertainment that are not includeded in other categories like Comic books, Audio streaming, Video streaming etc.","name":"Entertainment"}]},{"query":"google.com","categories":[{"desc":"Sites that allow users to search for content using keywords.","name":"Search Engines"},{"desc":"Sites related to technology that are not included in the science category.","name":"Technology"}]},{"query":"a-parser.com","categories":[{"desc":"Sites related to business.","name":"Business"},{"desc":"Sites that are related to business, economy, finance, education, science and technology.","name":"Business & Economy"}]}]
tip

To make the "Initial text" and "Final text" options available in the Task Editor, you need to activate "More options".

Possible settings

Parameter nameDefault valueDescription
User-AgentMozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36The User-Agent header when requesting pages
Chrome HeadlessIf enabled, the browser will not be displayed