SE::Google::SafeBrowsing - Checking domain in Google blacklist
Google Safe Browsing parser overview
Google Safe Browsing parser allows you to check if a domain is in the Google blacklist. With the Google Safe Browsing parser, you can check your own domain databases for inclusion in the Google blacklist. You can learn more about this label in the Google Search Help.
A-Parser's functionality allows you to save parsing settings for further use (presets), set up a parsing schedule, and much more.
Thanks to A-Parser's multithreading, the processing speed can reach 3,800 - 4,000 requests per minute.
Saving results is possible in the format and structure that you need, thanks to the built-in powerful Template Toolkit template engine that allows you to apply additional logic to the results and output data in various formats, including JSON, SQL, and CSV.
List of collected data
- Detection in the list of suspicious sites
Usage scenarios
- Checking a list of domains for inclusion in the Google blacklist
- Monitoring your domains for inclusion in the Google blacklist
Query examples
- As queries, you need to specify the URL of the desired site, for example:
http://a-parser.com/
http://www.yandex.ru/
http://facebook.com/
http://youtube.com/
http://perfect-soft.net/
Output options
A-Parser supports flexible formatting of results thanks to the built-in Template Toolkit template engine, which allows it to output results in any form, as well as in a structured form, such as CSV or JSON.
Exporting the check list to the blacklist
Result format:
$query: $exists\n
The URL is displayed in the result, and whether it is in the Google blacklist.
Example result:
http://youtube.com/: 0
http://www.yandex.ru/: 0
http://a-parser.com/: 0
http://perfect-soft.net: 1
http://facebook.com/: 0
Outputting results to a CSV table
The built-in tools.CSVLine utility allows you to create correct tabular documents ready for import into Excel or Google Sheets.
General result format:
[% tools.CSVline(query.orig,p1.exists) %]
File name:
$datefile.format().csv
Initial text:
Сайт,Результат проверки
Example result:
Сайт,Результат проверки
http://youtube.com/,0
http://www.yandex.ru/,0
http://a-parser.com/,0
http://perfect-soft.net,1
http://facebook.com/,0
The Template Toolkit template engine is used in the General Results Format to output the query and blacklist check.
What is the General Results Format?
In the results file name, simply change the file extension to csv.
To make the "Initial text" option available in the Task Editor, you need to activate "More options". In "Initial text", write the column names separated by commas, and make the second row blank.
Saving in SQL format
Result format:
INSERT INTO serp VALUES('$p1.query.query', '$p1.exists')\n
Example result:
INSERT INTO serp VALUES('http://www.yandex.ru/', '0')
INSERT INTO serp VALUES('http://a-parser.com/', '0')
INSERT INTO serp VALUES('http://perfect-soft.net', '1')
INSERT INTO serp VALUES('http://facebook.com/', '0')
INSERT INTO serp VALUES('http://youtube.com/', '0')
Dumping results to JSON
Result format:
[% data = {};
data.query = p1.query.orig;
data.exists = p1.exists; %]$data.json\n
Example result:
{"query":"http://www.yandex.ru/","exists":"0"}
{"query":"http://youtube.com/","exists":"0"}
{"query":"http://facebook.com/","exists":"0"}
{"query":"http://a-parser.com/","exists":"0"}
{"query":"http://perfect-soft.net","exists":"1"}
Results processing
A-Parser allows you to process results during parsing, in this section, we have provided the most popular use cases for the SE::Google::SafeBrowsing parser.
Saving domains with a check value of "1"
Add a filter and select the check value variable ($exists - Listed as suspicious) from the drop-down list. Select type: String equals. Then you need to enter the value we need in "String": 1. With this filter, you can remove all results with an unnecessary value.
Download example
How to import an example into A-Parser
eJx1VEuP2jAQ/ivI4tBKEMqhl9wAlaoVXbYLe2I5mGTCujger+3wUJT/3rETEth2
b57H983bJXPcHuyjAQvOsnhTMh3eLGarb3H8HXEvIY5XPIOpwZMVat8b9uZCgunB
medaAhswzY0F4/GbD2HklkLGC+nYoGTuooFi4BGMEannECnJySskBxKOXBbenmLO
hWJVh8iEdGDIhdL0XDGDs7CU+6AxrWs/eCu4vGEa0xu1E6hIsKAsq7bbK4udo8m5
J+vrcdR0oDWu+BHWWMeGTu2b8MBzT95PuQNvjbJA9Olz5M6egaep8DG5rCP4FnVR
n5V4C8kpJF96GgF2bjAnlYNA4JWXa3Yb1g8yI4oiYH/XGBZnXFoYMEupzjklkr63
CGoNd2iWoQekLxmqiZQLOILs3AL/tBAypXlOMgL9aID/d1n+w1G15d2GojmfDOXQ
sgRpuvzVoVJc4N7PfEd1S5ELR7KdYaH8YL6Q8gCg2549+J7laKAN0zA30WmnNSi/
VN3IJrpT3ZVxN5Z7ZYIqE/tls6hXz0Kt6XCWaob+BHxdqpCSxmLhqVuPiW3G4IUu
wffgWQjhS78eCHOI0v5c1alqI2j9vvoEc+rkbdSGMuFSPj8tbi2sWykSXp3T8WjE
h/WpRgnmoxfVaE+nU3ThKoVzZIpOnfEEdoiHe+cLFq7Ywb1Sg8kgcUOLmYtUOJ6E
TmKPtKzUsGrb/hHtV1N+/FPEZUX78Mc+1hDfPA8gHU3BhhMeV38BeN+pvw==
See also: Results filters
Possible settings
| Parameter name | Default value | Description |
|---|---|---|
| Check | Domain | Select the type of check (Domain / Full link) |