-
Join our Telegram chat: https://t.me/a_parser_enDismiss Notice
Tasks and queue
-
Work of A-Parser based on an tasks queue - you are adding a tasks and they are executed one after another, allowing to load parser on long time and do not watch when it finish the job.
Basic advantages of tasks queue in A-Parser:
- Support for multiple tasks at the same time
- Pause or full stop of the task processing
- Saving intermediate results of work, that allows you to continue the work from moment when the parser off (or turn off the computer\server)
- Moving individual tasks in a queue
- The ability to edit the completing tasks, and also copying tasks for the repeated use
- The completed tasks pass to the completed tasks queue, where you can watch the results of each task and download the result
Quantity of at the same time working tasks is regulated by working slots, this parameter is specified in Global settings (Settings -> Global settings -> Max active tasks). Standartly set value 1, i.e. one at the same time operating task, others will expect the queue
Each task has the status, here the list of possible statuses:
In case of change value of the Maximum active tasks parameter over one should be considered that the quantity of threads will increase, as well as the general consuming of resources a parser. For achievement of maximum speed of operation always use only one task, with the fitted optimum number of threads for the specific computer\server..
samcram, Dellius and high_skill like this.