Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow creating pre-processed segments archived only forward #7223

Closed
mgazdzik opened this issue Feb 16, 2015 · 6 comments
Closed

Allow creating pre-processed segments archived only forward #7223

mgazdzik opened this issue Feb 16, 2015 · 6 comments
Assignees
Labels
c: Performance For when we could improve the performance / speed of Matomo. c: Usability For issues that let users achieve a defined goal more effectively or efficiently. Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc.
Milestone

Comments

@mgazdzik
Copy link
Contributor

Goal of this ticked is to allow following action:

  • user defines new segments
  • first archiving will only process those segments since day of their creation, instead going all way back
  • this way segments will be lighter in some cases where user doesn't need historical data (which is sometimes huge)

I think that initiall this could be a setting in config, and after some time it could be turned into per-segment setting.

@mgazdzik mgazdzik added Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc. c: Performance For when we could improve the performance / speed of Matomo. c: Usability For issues that let users achieve a defined goal more effectively or efficiently. labels Feb 16, 2015
@RMastop
Copy link
Contributor

RMastop commented Feb 16, 2015

+1 for this feature. Another +1 if one could change the date a segment should be archived from.

@diosmosis
Copy link
Member

Thinking of adding a new INI config option like:

[General]
process_new_segments_from = ... ; allows special values 'beginning_of_time', 'creation_time', 'lastN' (lastN days)

which would be handled by CronArchive. May need to add a flag to segment table to track whether segment has been archived for the first time (haven't really looked or thought of alternatives yet, but this is more stable than option values).

@mattab
Copy link
Member

mattab commented Mar 17, 2015

@mgazdzik could you confirm whether such solution of a new INI setting would solve the problem at hand?

refs #6759

@mgazdzik
Copy link
Contributor Author

As ultimate feature I would vote for adding possibility to define such things per segment from UI.
However what was proposed by @diosmosis also looks nice for initial change, as I guess that in most cases this setting would work well as global.
Therefore 👍 for implementing this config setting

diosmosis pushed a commit that referenced this issue Mar 18, 2015
…hat controls the start date of archiving for segments that have not been archived before. If a creation date cannot be found, now is used.
@mattab
Copy link
Member

mattab commented Mar 19, 2015

@mgazdzik issue was created for follow up step #7483

I'll take a look at the PR from @diosmosis and aim to merge it for 2.12.0

@mattab mattab closed this as completed Mar 19, 2015
mattab pushed a commit that referenced this issue Mar 19, 2015
Fixes #7223, add option to limit earliest date initial segments are archived from.
@mgazdzik
Copy link
Contributor Author

Cool to hear, thanks 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
c: Performance For when we could improve the performance / speed of Matomo. c: Usability For issues that let users achieve a defined goal more effectively or efficiently. Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc.
Projects
None yet
Development

No branches or pull requests

4 participants