Segments may not be archived anymore when there are archive invalidations for segments that don't exist #19892
Labels
Bug
For errors / faults / flaws / inconsistencies etc.
Milestone
see PG-820
When there are too many invalid archive invalidations, then the archiving may stop archive any segment data.
There was a bug in Roll-Up Reporting where it would create archive invalidations that the archiver cannot process and considers invalid. In particular it goes into: https://github.com/matomo-org/matomo/blob/4.12.0-rc1/core/CronArchive/QueueConsumer.php#L539-L542
In matomo/QueueConsumer.php at 4.12.0-rc1 · matomo-org/matomo where it finds the next invalidated archive there is a limit of 100 tries to find an archive to process. However, there are currently for example around 14256 invalidated archives for idsite 13 that it cannot process because there is no matching segment. Meaning after the first 100 out of these 14256 it always stops and never proceeds to the one it actually can and should process.
Maybe, in matomo/QueueConsumer.php at 4.12.0-rc1 · matomo-org/matomo we also need to delete the archive invalidation similar to how we do this in matomo/QueueConsumer.php at 4.12.0-rc1 · matomo-org/matomo. I’m not sure if there’s a reason we’re not doing it or not.
To reproduce (I haven't actually checked it can be reproduced like this):
today
today
./console core:archive
Another way to reproduce this is described in PG-820 via the RollUp Reporting plugin (it's fixed in latest version)
The text was updated successfully, but these errors were encountered: