Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Running archive.php concurrently should process different websites #3708

Closed
anonymous-matomo-user opened this issue Jan 25, 2013 · 3 comments · May be fixed by sirinartk/matomo#2
Closed

Running archive.php concurrently should process different websites #3708

anonymous-matomo-user opened this issue Jan 25, 2013 · 3 comments · May be fixed by sirinartk/matomo#2
Assignees
Labels
Bug For errors / faults / flaws / inconsistencies etc. duplicate For issues that already existed in our issue tracker and were reported previously. Major Indicates the severity or impact or benefit of an issue is much higher than normal but not critical.
Milestone

Comments

@anonymous-matomo-user
Copy link

If you schedule the archiving of Piwik by cron jobs in a regular basis time, if you got a lot of data to archive during the period the script keeps more than one time.

That's ilogical because there is more than one process calculating the same data.

Example output of msqyl showprocesslist:

| 119784 | piwik | localhost | piwik | Query | 1 | query end | INSERT IGNORE
INTO piwik_archive_blob_2013_01
(idarchive,idsite,date1,date2,period,ts_arch |
| 119859 | piwik | localhost | piwik | Query | 0 | query end | INSERT IGNORE
INTO piwik_archive_blob_2013_01
(idarchive,idsite,date1,date2,period,ts_arch |

To process are archiving the same data.

So the archiving process should be smart enought to determine if there is another process archiving the data and kill itself until the other process ends.

@mattab
Copy link
Member

mattab commented Feb 5, 2013

Thanks for the report, it's a regression as it used to work. I'll investigate

@mattab
Copy link
Member

mattab commented Oct 25, 2013

Thanks for the report, duplicate of: #3708

@mattab
Copy link
Member

mattab commented Apr 2, 2014

See follow up #4903 Add possibility to run multiple archiver in parallel

This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug For errors / faults / flaws / inconsistencies etc. duplicate For issues that already existed in our issue tracker and were reported previously. Major Indicates the severity or impact or benefit of an issue is much higher than normal but not critical.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants