Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add option to skip specific segments during archiving #20068

Open
Starker3 opened this issue Dec 1, 2022 · 2 comments
Open

Add option to skip specific segments during archiving #20068

Starker3 opened this issue Dec 1, 2022 · 2 comments
Labels
Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc.

Comments

@Starker3
Copy link
Contributor

Starker3 commented Dec 1, 2022

We have a case where a customer needs to skip the processing of specific ID Segments during the core:archive task. The segments are currently causing performance issues with archiving and may be fixed with a future release of a plugin.

In the mean time, we need to ensure that archiving is still able to complete for all other segments on their server, but still retain the already processed data for the segment. Setting auto_archive in the db for the segment doesn't seem to cause the segments to be skipped during archiving.

If we had an option that was similar to the --skip-idsites one such as --skip-idsegments this could be quite useful.

@Starker3 Starker3 added Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc. To Triage An issue awaiting triage by a Matomo core team member labels Dec 1, 2022
@snake14
Copy link
Contributor

snake14 commented Dec 1, 2022

I think that this would be a good option to add. Looking in the FAQ about archiving and the code plugins/CoreConsole/Commands/CoreArchiver.php, but best workaround that we could come up with was having one cron run with the skip-all-segments option and then another run with the force-idsegments option. That's not a great user experience though.

@snake14 snake14 added this to the For Prioritization milestone Dec 1, 2022
@snake14 snake14 removed the To Triage An issue awaiting triage by a Matomo core team member label Dec 1, 2022
@baa-ableton
Copy link

baa-ableton commented Jan 9, 2023

Same problem here. I separated archiving of long running segments into their own archiving host/server using --force-idsegments . It is quite user unfriendly as the commentor above mentioned. Additionally, I need to update the list of segmentids now whenever Matomo end users create new segments.

This all is to say that I would really appreciate a --skip-idsegments option or flag :) .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc.
Projects
None yet
Development

No branches or pull requests

3 participants