Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve memory usage for some action archivers #12930

Merged
merged 5 commits into from May 19, 2018
Merged

Conversation

tsteur
Copy link
Member

@tsteur tsteur commented May 18, 2018

Tested on some high load instance I noticed that when using previous query, it may for example create a 30GB temporary table whereas this way it uses only a 26MB temp table and should be faster. The explain for both queries is quite similar, although there is a slight difference:

image

It may even only depend on the data whether it makes a huge difference, but on the given dataset it certainly does.

cc @mattab

@tsteur tsteur added the Needs Review PRs that need a code review label May 18, 2018
@tsteur tsteur added this to the 3.5.1 milestone May 18, 2018
@diosmosis
Copy link
Member

Looks like two of the system tests are now failing. Unfortunately have no idea which ones... Could merge w/ @sgiehl PR #12822 in a new branch to figure out which.

@tsteur
Copy link
Member Author

tsteur commented May 18, 2018

As discussed they are currently also failing in 3.x-dev

@diosmosis diosmosis merged commit 34191a7 into 3.x-dev May 19, 2018
@diosmosis diosmosis deleted the eventarchivememory branch May 19, 2018 01:21
@mattab
Copy link
Member

mattab commented May 21, 2018

Great find!! 🚀

InfinityVoid pushed a commit to InfinityVoid/matomo that referenced this pull request Oct 11, 2018
* Improve memory performance of event queries

* also improve memory of action archive queries

* improve memory usage for content tracking

* fix typo
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Needs Review PRs that need a code review
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants