Skip to main content

SE::Yandex::SafeBrowsing - Checking a domain in the Yandex blacklist

Overview of the parser​

Overview of the parserSE::Yandex::SafeBrowsingSE::Yandex::SafeBrowsing – checks if a domain is present in the Yandex blacklist.

A-Parser functionality allows you to save parsing settings for the SE::Yandex::SafeBrowsing parser for future use (presets), set up parsing schedules, and much more.

Saving results is possible in any form and structure you need, thanks to the built-in powerful Template Toolkit which allows applying additional logic to results and outputting data in various formats, including JSON, SQL, and CSV.

Collected data​

  • Presence in the list of suspicious sites

what data the SE::Yandex::SafeBrowsing parser collects

Use cases​

  • Checking a list of domains for inclusion in the Yandex blacklist
  • Monitoring your own domains for inclusion in the Yandex blacklist

Queries​

You should specify the URL of the target site as queries, for example:

http://a-parser.com/  
http://www.yandex.ru/  
http://google.com/  
http://vk.com/  
http://facebook.com/  
http://youtube.com/

Output results examples​

A-Parser supports flexible result formatting thanks to the built-in Template Toolkit, which allows it to output results in arbitrary form, as well as in structured formats like CSV or JSON

Default output​

Result format:

$query: $exists\n

Example of a result showing the URL and whether it is in the Yandex blacklist:

http://vk.com/: 0  
http://www.yandex.ru/: 0  
http://youtube.com/: 0  
http://facebook.com/: 0  
http://google.com/: 0  
http://a-parser.com/: 0

Saving in SQL format​

Result format:

[% "INSERT INTO yandexSafeBrowsing VALUES('" _ query _ "', '" _ p1.exists _ "')\n" %]

Result example:

INSERT INTO dns VALUES('http://google.com', '0')
INSERT INTO yandexSafeBrowsing VALUES('http://yandex.ru', '0')
INSERT INTO yandexSafeBrowsing VALUES('http://a-parser.com', '0')
INSERT INTO yandexSafeBrowsing VALUES('http://vk.com', '0')
INSERT INTO yandexSafeBrowsing VALUES('http://facebook.com', '0')

Dump results to JSON​

General output format:

[% IF notFirst;
  ",\n";
ELSE;
  notFirst = 1;
END;

obj = {};
obj.query = query;
obj.ip = ip;

obj.json %]

Initial text:

[

Final text:

]

Result example:

[{"ip":"31.13.79.35","query":"facebook.com"},
{"ip":"172.217.174.174","query":"google.com"},
{"ip":"5.255.255.50","query":"yandex.ru"},
{"ip":"142.250.71.14","query":"youtube.com"},
{"ip":"87.240.190.67","query":"vk.com"},
{"ip":"176.9.9.90","query":"a-parser.com"}]
tip

To make the "Head text" and "End text" options available in the Task Editor, you need to activate "More options".

Possible settings​

note

Common settings for all parsers