Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add possibility to configure the number of max concurrent archivers: --concurrent-archivers #13161

Merged
merged 2 commits into from Jul 12, 2018

Conversation

tsteur
Copy link
Member

@tsteur tsteur commented Jul 11, 2018

There is already a setting concurrent-requests-per-website to specify how many requests one archiver may issue at a time. This new setting concurrent-archivers allows additionally to limit how many archivers should run max. This is useful when an archiver takes a very long time and you don't want to eventually have like 10 or 20 archivers running at the same time.

I don't think this needs to be mentioned in the developer changelog.

@tsteur tsteur added Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc. Needs Review PRs that need a code review labels Jul 11, 2018
@tsteur tsteur added this to the 3.6.0 milestone Jul 11, 2018
@tsteur tsteur requested a review from mattab July 11, 2018 23:58
@diosmosis diosmosis merged commit 8239152 into 3.x-dev Jul 12, 2018
@diosmosis diosmosis deleted the maxconcurrentarchivers branch July 12, 2018 13:39
tsteur added a commit that referenced this pull request Jul 12, 2018
Small tweak to #13161 . Noticed this on a different linux... otherwise the same archive command would appear multiple times see eg 

```
string(468) "11112 ?        Ss     0:00 /bin/sh -c php /home/foo/console core:archive --no-ansi >> /home/foo/test.log EDITOR=nano LANG=en_US.UTF-8 MAILTO=foo@foo.com SHELL=/bin/sh HOME=/home/fooPATH=/usr/bin:/bin LOGNAME=foo"
  string(502) "11113 ?        S      0:00 /usr/php /home/foo/console core:archive --no-ansi SHELL=/bin/sh MAILTO=foo@foo.com PHPRC=/home/foo/admin/config/php PATH=/usr/bin:/bin PWD=/home/foo EDITOR=nano LANG=en_US.UTF-8 SHLVL=0 HOME=/home/foo LOGNAME=foo"
```

When using `ps ex` in this case it figured the same archiver is running twice when it is only once.
@mattab mattab changed the title Add possibility to configure the number of max concurrent archivers Add possibility to configure the number of max concurrent archivers: --concurrent-archivers Aug 28, 2018
InfinityVoid pushed a commit to InfinityVoid/matomo that referenced this pull request Oct 11, 2018
…atomo-org#13161)

* Add possibility to limit max archivers

* add missing files
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc. Needs Review PRs that need a code review
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants