Configuration File
In A-Parser, there are a number of hidden settings that are overridden through a special configuration file config/config.txt. Initially, this file is not included in the A-Parser distribution, and if there is a need to override some of the hidden settings, it must be created in advance.
caution
This category of settings requires a mandatory restart of A-Parser when changed
Possible Settings
| Parameter | Default Value | Description |
|---|---|---|
| bind: ip:port | 0.0.0.0:9091 | IP address and port used to access the A-Parser interface |
| outgoing_ip: ip | 0.0.0.0 | IP address for outgoing connections to websites or proxy servers |
| dns: ip1, ip2, ip3... | Pre-set Google/CloudFlare DNS | List of used DNS addresses |
| dns_retries: N | 2 | Number of attempts to get a response from the DNS server |
| dns_timeout: N | 5 | DNS server response timeout in seconds |
| dns_random: N | 0 | Randomize requests to DNS servers |
| dns_cache_size: N | 131072 | Size of the DNS cache in entries |
| dns_cache_time: N | 3600 | Time to store an entry in the DNS cache in seconds |
| proxies_reuse: N | 0 | Allows the same proxy to be used for repeated attempts to scrape a request, it is also necessary to set the proxy ban time to 0 |
| https: N | 1 | Determines whether to support HTTPS |
| save_interval: N | 10 | Interval for saving job progress to disk in seconds |
| allow_outside_files: N | 0 | Determines the ability to work with files outside the scraper directory |
| allow_dangerous_node_modules: N | 0 | This option allows the use of all built-in modules without restrictions, including process, child_process, os... Using this option can compromise the entire system if an attacker gains remote access to A-Parser, it is necessary to restrict access (firewall) and use a complex password. |
| allow_javascript_editor: N | 0 | This option opens access to the JS scraper editor. If you are working in A-Parser not locally, you also need to set a password for A-Parser to access the JS scraper editor |
| proxies_dns_local: N | 0 | DNS through proxy. Possible values: 0 - resolved through proxy, 1 - resolved locally, 2 - resolved locally and for http proxy the connect method is always used |