Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Auto archiving memory consumption a first archiving #422

Closed
anonymous-matomo-user opened this issue Nov 19, 2008 · 4 comments
Closed

Auto archiving memory consumption a first archiving #422

anonymous-matomo-user opened this issue Nov 19, 2008 · 4 comments
Labels
Bug For errors / faults / flaws / inconsistencies etc. Major Indicates the severity or impact or benefit of an issue is much higher than normal but not critical.
Milestone
RobotRock

Comments

@anonymous-matomo-user
Copy link

Using Piwik 0.2.22 auto archiving feature on a website with around 1400 visitors a day, (howto.landure.fr), the first use of archive.sh script is a memory black hole.

I do not use often the piwik web interface, so no auto archiving was done.

I’ve run at least 3 times archive.sh raising php memory limit at each time. It was finaly completed with a 768 MB memory limit !.

It is a big number for archiving.
Keywords: archiving memory cli
@anonymous-matomo-user
Copy link
Author

For more information, here is the messages i get:

128 MB:
Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 8208 bytes) in /var/www/piwik/core/DataTable.php on line 807

256 MB:
Fatal error: Allowed memory size of 268435456 bytes exhausted (tried to allocate 8208 bytes) in /var/www/piwik/core/DataTable.php on line 807

@anonymous-matomo-user
Copy link
Author

I’ve took a look at my table sizes

I’ve got 3 piwik_archive_blob archives tables with over 30000 records.
The memory problem seems to come from the year archiving. Piwik is probably loading all of month records blob without unloading them once they are not usefull anymore.

Hope this help locating the problem.

Keep the good work, and thank you for this wonderfull tool

@mattab
Copy link
Member

mattab commented Nov 24, 2008

Maciej (mauser) is working on the issue and should come up with a patch soon. please use this ticket to post patches etc.
thanks!

@anonymous-matomo-user
Copy link
Author

Thank you, now it take less than 64MB to run the daily Piwik archiving.

Thank your for your great work :D.

@anonymous-matomo-user anonymous-matomo-user added this to the RobotRock milestone Jul 8, 2014
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Bug For errors / faults / flaws / inconsistencies etc. Major Indicates the severity or impact or benefit of an issue is much higher than normal but not critical.
Projects
None yet
Milestone
RobotRock
Development

No branches or pull requests
2 participants
@mattab @anonymous-matomo-user