Configuration File
In A-Scraper, there are several hidden settings that can be overridden through a special configuration file config/config.txt. Initially, this file is not included in the A-Scraper distribution, and if there is a need to override some of the hidden settings, it must be created beforehand.
caution
This category of settings requires a mandatory restart of A-Scraper when changed.
Possible Settings
| Parameter | Default Value | Description |
|---|---|---|
| bind: ip:port | 0.0.0.0:9091 | IP address and port used to access the A-Scraper interface |
| outgoing_ip: ip | 0.0.0.0 | IP address for outgoing connections to websites or proxy servers |
| dns: ip1, ip2, ip3... | Preinstalled Google/CloudFlare DNS | List of used DNS addresses |
| dns_retries: N | 2 | Number of attempts to get a response from the DNS server |
| dns_timeout: N | 5 | Timeout for a response from the DNS server in seconds |
| dns_random: N | 0 | Randomize requests to DNS servers |
| dns_cache_size: N | 131072 | Size of the DNS cache in records |
| dns_cache_time: N | 3600 | Time to store a record in the DNS cache in seconds |
| proxies_reuse: N | 0 | Allows using the same proxy for repeated attempts to parse a request, also set the proxy ban time to 0 |
| https: N | 1 | Determines whether to support HTTPS |
| save_interval: N | 10 | Interval for saving task progress to disk in seconds |
| allow_outside_files: N | 0 | Determines the ability to work with files outside the parser directory |
| allow_dangerous_node_modules: N | 0 | This option allows using all built-in modules without restrictions, including process, child_process, os... Using this option can compromise the entire system if an attacker gains remote access to A-Scraper, so access (firewall) must be restricted and a complex password used. |
| allow_javascript_editor: N | 0 | This option opens access to the JS parser editor. If you are working with A-Scraper not locally, you need to additionally set a password for A-Scraper to access the JS parser editor. |