Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Piwik Log Archiving no longer working in 2.1 #4895

Closed
anonymous-matomo-user opened this issue Mar 22, 2014 · 9 comments
Closed

Piwik Log Archiving no longer working in 2.1 #4895

anonymous-matomo-user opened this issue Mar 22, 2014 · 9 comments
Labels
Bug For errors / faults / flaws / inconsistencies etc. worksforme The issue cannot be reproduced and things work as intended.
Milestone

Comments

@anonymous-matomo-user
Copy link

Ever since the upgrade to version 2.1 of Piwik, the archive.php script is not working correctly.

I have two servers that are importing logs running the script import_logs.py from Piwik 2.1 to a primary installation running 2.03. This works fine.

Upgrading the primary piwik installation to version 2.1 causes the archive.php script to stop working. I can run archive.php by hand and the script output shows that everything was archived and working as expected.However, when I log into the web interface it only shows random minor visits on a couple of sites. The rest of the sites (40+) show no visits. Downgrading to 2.0.3 fixes the problem and all the sites are archived as expected.

I stress that there are no errors and all the script output indicates everything is working. The setup is running on Nginx with PHP 5.5 using FPM. This same setup works perfectly with 2.0.3. and earlier versions.

I have full access to the servers and can provide any debug or diagnostic assistance you need. How can I help fix this?
Keywords: archive.php

@mattab
Copy link
Member

mattab commented Mar 24, 2014

we have fixed few bugs, could you try with latest 2.1.1 beta?

@anonymous-matomo-user
Copy link
Author

I'll give it a try and report back.

@anonymous-matomo-user
Copy link
Author

This is not working for me with the most recent stable version. I will be testing the beta version tonight and tomorrow.

@anonymous-matomo-user
Copy link
Author

I've tested this with 2.2 beta 16 and have the same exact results. There are no errors in the logs and the archive script runs without error. No data is archived and Piwik continues to show zero visits.

Is there any other information I can provide?

@anonymous-matomo-user
Copy link
Author

I did some more testing and imported data using the log import script. I then ran the archiving script. The command to run the archive script is:

/usr/local/bin/php /usr/home/ftp/dev-piwik.censored.com/public_html/misc/cron/archive.php --url=https://dev-piwik.censored.com > /usr/home/ftp/dev-piwik.censored.com/logs/piwik-archive.log

Here is the output from the piwik-archive.log.

INFO 17:00:32 [6b8b6] ---------------------------
INFO 17:00:32 [6b8b6] INIT
INFO 17:00:32 [6b8b6] Piwik is installed at: https://dev-piwik.censored.com/index.php
INFO 17:00:32 [6b8b6] Running Piwik 2.2.0-b16 as Super User: dev-piwik
INFO 17:00:34 [6b8b6] ---------------------------
INFO 17:00:34 [6b8b6] NOTES
INFO 17:00:34 [6b8b6] - Reports for today will be processed at most every 10 seconds. You can change this value in Piwik UI > Settings > General Settings.
INFO 17:00:34 [6b8b6] - Reports for the current week/month/year will be refreshed at most every 3600 seconds.
INFO 17:00:34 [6b8b6] - Archiving was last executed without error 1 hours 15 min ago
INFO 17:00:34 [6b8b6] - Will process 0 websites with new visits since 1 hours 15 min
INFO 17:00:34 [6b8b6] - Will process 4 other websites because some old data reports have been invalidated (eg. using the Log Import script) , IDs: 3, 2, 5, 4
INFO 17:00:34 [6b8b6] ---------------------------
INFO 17:00:34 [6b8b6] START
INFO 17:00:34 [6b8b6] Starting Piwik reports archiving...
INFO 17:00:35 [6b8b6] Archived website id = 3, period = day, 0 visits in last 4 days, 0 visits today, Time elapsed: 0.735s
INFO 17:00:35 [6b8b6] Archived website id = 3, period = week, 0 visits in last 2 weeks, 0 visits this week, Time elapsed: 0.733s
INFO 17:00:36 [6b8b6] Archived website id = 3, period = month, 0 visits in last 2 months, 0 visits this month, Time elapsed: 0.527s
INFO 17:00:36 [6b8b6] Archived website id = 3, period = year, 0 visits in last 2 years, 0 visits this year, Time elapsed: 0.527s
INFO 17:00:36 [Archived website id = 3, 4 API requests, Time elapsed: 2.572s 1/4 done
INFO 17:00:37 [6b8b6] Archived website id = 2, period = day, 0 visits in last 4 days, 0 visits today, Time elapsed: 0.735s
INFO 17:00:38 [6b8b6] Archived website id = 2, period = week, 0 visits in last 2 weeks, 0 visits this week, Time elapsed: 0.837s
INFO 17:00:39 [6b8b6] Archived website id = 2, period = month, 0 visits in last 2 months, 0 visits this month, Time elapsed: 0.734s
INFO 17:00:39 [6b8b6] Archived website id = 2, period = year, 0 visits in last 2 years, 0 visits this year, Time elapsed: 0.422s
INFO 17:00:39 [Archived website id = 2, 4 API requests, Time elapsed: 2.762s 2/4 done
INFO 17:00:40 [6b8b6] Archived website id = 5, period = day, 0 visits in last 4 days, 0 visits today, Time elapsed: 0.736s
INFO 17:00:41 [6b8b6] Archived website id = 5, period = week, 0 visits in last 4 weeks, 0 visits this week, Time elapsed: 0.630s
INFO 17:00:41 [6b8b6] Archived website id = 5, period = month, 0 visits in last 4 months, 0 visits this month, Time elapsed: 0.423s
INFO 17:00:42 [6b8b6] Archived website id = 5, period = year, 0 visits in last 4 years, 0 visits this year, Time elapsed: 0.526s
INFO 17:00:42 [Archived website id = 5, 4 API requests, Time elapsed: 2.331s 3/4 done
INFO 17:00:42 [6b8b6] Archived website id = 4, period = day, 0 visits in last 4 days, 0 visits today, Time elapsed: 0.632s
INFO 17:00:43 [6b8b6] Archived website id = 4, period = week, 0 visits in last 4 weeks, 0 visits this week, Time elapsed: 0.526s
INFO 17:00:44 [6b8b6] Archived website id = 4, period = month, 0 visits in last 4 months, 0 visits this month, Time elapsed: 0.942s
INFO 17:00:44 [6b8b6] Archived website id = 4, period = year, 0 visits in last 4 years, 0 visits this year, Time elapsed: 0.528s
INFO 17:00:44 [Archived website id = 4, 4 API requests, Time elapsed: 2.647s 4/4 done
INFO 17:00:44 [6b8b6] Done archiving!
INFO 17:00:44 [6b8b6] ---------------------------
INFO 17:00:44 [6b8b6] SUMMARY
INFO 17:00:44 [6b8b6] Total visits for today across archived websites: 0
INFO 17:00:44 [6b8b6] Archived today's reports for 4 websites
INFO 17:00:44 [6b8b6] Archived week/month/year for 4 websites
INFO 17:00:44 [6b8b6] Skipped 1 websites: no new visit since the last script execution
INFO 17:00:44 [6b8b6] Skipped 0 websites day archiving: existing daily reports are less than 10 seconds old
INFO 17:00:44 [6b8b6] Skipped 0 websites week/month/year archiving: existing periods reports are less than 3600 seconds old
INFO 17:00:44 [6b8b6] Total API requests: 16
INFO 17:00:44 [6b8b6] done: 4/4 100%, 0 vtoday, 4 wtoday, 4 wperiods, 16 req, 10387 ms, no error
INFO 17:00:44 [6b8b6] Time elapsed: 10.387s
INFO 17:00:44 [6b8b6] ---------------------------
INFO 17:00:44 [6b8b6] SCHEDULED TASKS
INFO 17:00:44 [6b8b6] Starting Scheduled tasks...
INFO 17:00:44 [6b8b6] No task to run
INFO 17:00:44 [6b8b6] done
INFO 17:00:44 [6b8b6] ---------------------------

The web interface still indicates zero visitors to all sites. Is there a way I can gather further debug information?

@anonymous-matomo-user
Copy link
Author

Another note, the database table piwik_log_visit is empty with the beta.

Using version 2.0.3 causes visits to be recorded as normal using the same import data and archive commands as used above.

@mattab
Copy link
Member

mattab commented May 11, 2014

Another note, the database table piwik_log_visit is empty with the beta.

This particular bug (no data in log_visit) should be fixed in 2.2.2 (it may require a clean install), please try with this version?

@anonymous-matomo-user
Copy link
Author

I'll give that a try. I found that setting --recorder-max-payload-size to 1 allows the data import to work. The archiving issues are ongoing. I'm still trying to find an underlying cause.

@mattab
Copy link
Member

mattab commented May 14, 2014

please re-open if you experience the problem after a fresh install of the latest beta: http://piwik.org/faq/how-to-update/faq_159/

@anonymous-matomo-user anonymous-matomo-user added this to the 2.3.0 - Piwik 2.3.0 milestone Jul 8, 2014
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug For errors / faults / flaws / inconsistencies etc. worksforme The issue cannot be reproduced and things work as intended.
Projects
None yet
Development

No branches or pull requests

2 participants