Skip to main content

Rank::Archive - Parser of the first and last caching date of a website in the web archive

Rank::Archive

Rank::Archive parser overview​

Rank::ArchiveRank::Archive - the Web Archive parser determines the date of the first and last caching, as well as the number of saved copies of the site.

A-Parser functionality allows you to save parsing settings for Rank::Archive parser for further use (presets), set up a parsing schedule, and much more.

Saving results is possible in the format and structure that you need, thanks to the built-in powerful Template Toolkit which allows you to apply additional logic to the results and output data in various formats, including JSON, SQL and CSV.

List of collected data​

  • Date of the first caching
  • Date of the last caching
  • Number of saved copies of the site

Data collected by Rank::Archive parser

Use cases​

  • Checking the availability of a site copy in the web archive, as well as the dates of indexing of the first and last copy
  • Useful for evaluating domains. A large number of site copies in the web archive can indicate a high site traffic

Query examples​

As queries, you need to specify the domain of the desired site, for example:

a-parser.com
www.yahoo.com
google.com
vk.com
youtube.com

As a result, the site, the dates of indexing of the first and last copy, and the number of saved copies of the site are displayed. Example:

vk.com: 11.05.2000 - 21.05.2014(8965 times)  
youtube.com: 28.04.2005 - 21.05.2014(28150 times)  
a-parser.com: 16.03.2012 - 17.05.2014(56 times)  
google.com: 11.11.1998 - 21.05.2014(34575 times)  
www.yahoo.com: 17.10.1996 - 20.05.2014(28537 times)

Output options​

A-Parser supports flexible formatting of results thanks to the built-in Template Toolkit, which allows it to output results in any form, as well as in a structured form, for example CSV or JSON.

Saving in SQL format​

Result format:

[% "INSERT INTO archive VALUES('" _ query _ "', '" _ p1.first _ "', '" _ p1.last _ "', '" _ p1.times _ "')\n" %]

Example of result:

INSERT INTO archive VALUES('http://a-parser.com/', '16.03.2012', '16.01.2021', '290')
INSERT INTO archive VALUES('http://yandex.ru/', '06.12.1998', '25.03.2021', '141421')
INSERT INTO archive VALUES('http://facebook.com/', '12.12.1998', '25.03.2021', '4877156')
INSERT INTO archive VALUES('http://vk.com/', '11.05.2000', '25.03.2021', '172132')
INSERT INTO archive VALUES('http://google.com/', '11.11.1998', '25.03.2021', '5969502')
INSERT INTO archive VALUES('http://youtube.com/', '28.04.2005', '25.03.2021', '2309673')

Dumping results to JSON​

Result format:

[% data = {}; 
data.query = query;
data.first = p1.first;
data.last = p1.last;
data.times = p1.times; %]$data.json\n

Example of result:

{"first":"12.12.1998","query":"http://facebook.com/","last":"25.03.2021","times":4877156}
{"first":"06.12.1998","query":"http://yandex.ru/","last":"25.03.2021","times":141421}
{"first":"16.03.2012","query":"http://a-parser.com/","last":"16.01.2021","times":290}
{"first":"28.04.2005","query":"http://youtube.com/","last":"25.03.2021","times":2309673}
{"first":"11.11.1998","query":"http://google.com/","last":"25.03.2021","times":5969502}
{"first":"11.05.2000","query":"http://vk.com/","last":"25.03.2021","times":172132}

Possible settings​

info

General settings for all parsers.

Last updated