Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow invalidating non-day periods even if the period is for a date that had logs purged #17530

Closed
wants to merge 1 commit into from

Conversation

diosmosis
Copy link
Member

Description:

When invalidating data, we check for dates that are before the configured log data deletion month count, and ignore them. This is a safety mechanism to make sure we do not invalidate day periods that have archive data, but for whom log data was deleted. This safety mechanism, however, breaks the GoogleAnalyticsImporter, when importing data that is before log data deletion threshold.

The importer imports day periods, then invalidates week periods and above to calculate the rest. If the data is before the log deletion threshold, the higher periods are never recomputed.

Fixed in this PR by only applying the check for day periods. If a week period is invalidated and there is no log data, the day periods should used.

TODO: check if week periods will trigger rearchiving of the day if the day is for some reason invalidated.

FYI @tsteur

Review

  • Functional review done
  • Potential edge cases thought about (behavior of the code with strange input, with strange internal state or possible interactions with other Matomo subsystems)
  • Usability review done (is anything maybe unclear or think about anything that would cause people to reach out to support)
  • Security review done see checklist
  • Code review done
  • Tests were added if useful/possible
  • Reviewed for breaking changes
  • Developer changelog updated if needed
  • Documentation added if needed
  • Existing documentation updated if needed

…hat had logs purged (since non-day periods do not (generally) aggregate log data).
@diosmosis
Copy link
Member Author

closing in favor of a new option

@diosmosis diosmosis closed this May 10, 2021
@diosmosis diosmosis deleted the allow-invalidate-purged-dates-if-not-day branch May 10, 2021 03:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant