Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Processing segment data takes to long and skips data. #16525

Closed
Jinzol opened this issue Oct 5, 2020 · 1 comment
Closed

Processing segment data takes to long and skips data. #16525

Jinzol opened this issue Oct 5, 2020 · 1 comment
Labels
answered For when a question was asked and we referred to forum or answered it.

Comments

@Jinzol
Copy link

Jinzol commented Oct 5, 2020

Hi,
We have a problem that we have too much data and too many segments and not enough time. We run our archiver with
--force-periods=day,week,month --force-data-last-n=2
The archiver can take upto 4 days and it will finish without any errors. Only when we access the web interface it seems that the graphs are incomplete. It looks like it skipped data between the runs. I know in the past I could increase N to a bigger number then the days it took to process the data. Only with the example above I don't want N=5 and process 5 months of data. Because we don't have the time.

Is there a commando that I can process with day,week,month with a parameter for only processing the last 5 days and keep week,month on the default settings?

I Am looking into date-range but I want it to be dynamic. So I don't have to change that with every new run.

@tsteur
Copy link
Member

tsteur commented Oct 5, 2020

Hi @Jinzol thanks for creating the issue. Unfortunately we don't reply to questions here as we're only handling bug reports and feature requests here. Could you to ask this question in our forum https://forum.matomo.org/ ?

BTW not sure if https://matomo.org/faq/roll-up-reporting/faq_25754/ would maybe help to process them less often.

In Matomo 4 I think we have already made a few improvements for all this but not sure if the "force date last n" behaviour was changed (probably not). Be great to ask this in the forum and if you can provide any more info to understand the problem better that will be helpful too.

@tsteur tsteur closed this as completed Oct 5, 2020
@mattab mattab added the answered For when a question was asked and we referred to forum or answered it. label Nov 23, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
answered For when a question was asked and we referred to forum or answered it.
Projects
None yet
Development

No branches or pull requests

3 participants