Terminology List

Scraper

A scraper is a script that collects data from specified web resources based on specified queries, processes them, and outputs the result in a default or specified format.

Pre-installed Scrapers

Pre-installed scrapers are pre-set scrapers available by default, whose functionality is constantly maintained.

Custom JS Scrapers

Custom JS scrapers are open-source scrapers written in JavaScript and available in the JS Scraper Editor, which can be exported and imported along with the task. Examples of such scrapers can be found in the Scraper and Preset Catalog.

Preset

A Preset is both a saved task, created in the Task Editor by selecting a set of scrapers, settings, and options to perform the task, and individual scraper settings ((a settings preset).

Scraper Settings

Scraper settings are options that can be edited or changed (overridden) for a different scraper operation algorithm to obtain a non-standard result.

Saved Task

A saved task is a preset that has been saved and can be reused.

Threads Configuration

The Thread Config is a set of thread settings that can be saved under a name and reused with different presets.

Threads

Threads are multiple contexts launched simultaneously for scraping, in which the scraper performs requests in parallel, iterates through proxies according to a specific strategy defined in the Thread Config, and logs the scraping process for each request.

Proxy Checkers

A Proxy Checker is a controller responsible for loading and checking proxies using a set of proxy checker settings.

Proxies

A Proxy is a string/array of strings of a specific format (or a link to a string/array of strings) that allows masking the real IP address by sending requests in scraping and transferring data packets from the server to the client using an intermediate proxy server.

Result Template

The Result Template is a template that defines the format and collected data of the result, specified directly or using the built-in templating engine Template Toolkit.