Skip to main content

Configuration File

In A-Scraper, there are several hidden settings that can be overridden through a special configuration file config/config.txt. Initially, this file is not included in the A-Scraper distribution, and if there is a need to override some of the hidden settings, it must be created beforehand.

caution

This category of settings requires a mandatory restart of A-Scraper when changed.

Possible Settings

ParameterDefault ValueDescription
bind: ip:port0.0.0.0:9091IP address and port used to access the A-Scraper interface
outgoing_ip: ip0.0.0.0IP address for outgoing connections to websites or proxy servers
dns: ip1, ip2, ip3...Preinstalled Google/CloudFlare DNSList of used DNS addresses
dns_retries: N2Number of attempts to get a response from the DNS server
dns_timeout: N5Timeout for a response from the DNS server in seconds
dns_random: N0Randomize requests to DNS servers
dns_cache_size: N131072Size of the DNS cache in records
dns_cache_time: N3600Time to store a record in the DNS cache in seconds
proxies_reuse: N0Allows using the same proxy for repeated attempts to parse a request, also set the proxy ban time to 0
https: N1Determines whether to support HTTPS
save_interval: N10Interval for saving task progress to disk in seconds
allow_outside_files: N0Determines the ability to work with files outside the parser directory
allow_dangerous_node_modules: N0This option allows using all built-in modules without restrictions, including process, child_process, os... Using this option can compromise the entire system if an attacker gains remote access to A-Scraper, so access (firewall) must be restricted and a complex password used.
allow_javascript_editor: N0This option opens access to the JS parser editor. If you are working with A-Scraper not locally, you need to additionally set a password for A-Scraper to access the JS parser editor.