Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Strange increase in statistics from previous days #11658

Closed
ghost opened this issue Apr 28, 2017 · 2 comments
Closed

Strange increase in statistics from previous days #11658

ghost opened this issue Apr 28, 2017 · 2 comments
Labels
answered For when a question was asked and we referred to forum or answered it.

Comments

@ghost
Copy link

ghost commented Apr 28, 2017 •
edited by ghost

FR

Mon piwik a un comportement étrange, peut-être normal ou pas je ne sais pas.
J'exporte mes fichiers logs de façon régulière puis un script lance l'analyse des logs avec import_logs.py avant de les vider via echo "" > /var/log/apache2/access.log.
Donc il y a 4 jours (24/04/2017) pour le 21 avril j'avais +-97k vues, hors aujourd'hui (28/04/2017), toujours pour le 21 avril, j'ai maintenant +-195k vues.
Screenshot_1

Screenshot_2
Est-ce normal?

USA

My piwik has a strange behavior, maybe normal or not I do not know.
I export my log files regularly and then a script runs the log analysis with import_logs.py before emptying them via echo "" > /var/log/apache2/access.log.
So there are 4 days (24/04/2017) for the 21st of April I had + -97k views, and today (28/04/2017), still for the 21st of April, I now have + -195k Views.
Screenshot_1

Screenshot_2
Is it normal?

Edit : lol, now it's 279k views for the 21st april xD (the logs files are successed purge after the read by piwik)
@ghost
Copy link
Author

ghost commented May 1, 2017 •
edited by ghost

Well i have checked, my export and my purge is good. All my (imported) hosts have this really boring bug.

Views (not visit) are duplicate at all import (cron 2x/hour), their is zero lines in my log for previous day.
Exemple if a day i have 1 visit and 1 views, after 2 import (with zero line about this day) i haved 1 visit and 3 views. The bug begin at 17 april 2017 and after, 16 april and previous don't have problem.

My Method (explain here in french : export , import in piwik) :

Server A (apache2) export his log and purge it with :
cat /var/log/apache2/access.log >> /media/cloud/log/server1_apache2_access.log echo "" > /var/log/apache2/access.log

Server B (piwik) import logs with :
python /var/www/html/services/piwik/misc/log-analytics/import_logs.py --url=http://127.0.0.1/services/piwik/ --idsite=2 --recorders=1 --enable-http-errors --enable-http-redirects --enable-bots /media/cloud/log/server1_apache2_access.log echo "" > /media/cloud/log/server1_apache2_access.log

Please help, my Database is overbooked.

@ghost
Copy link
Author

ghost commented May 2, 2017 •
edited by ghost

Ok, after search i know where is the bug :
It's a problem of synchro in the sharing folder of nextcloud. I need try for solve the problem but i think use only files via webdav is a solution for force the update of nextcloud database.

More infos in french :
Serveur 1 exporte via webdav ses logs sur le cloud. Ensuite le cloud lisait les fichiers et les vidait directement depuis le filesystem. Nextcloud ne surveillant les filesystem que des "montages externe", il ré-injectait une copie du précédent fichier (qu'il va chercher où, bonne question) + les nouveaux logs.
Se qui fait que les logs s'additionnait constamment et ce malgré que les fichiers avait l'air propre.

@ghost ghost closed this as completed May 2, 2017
@mattab mattab added the answered For when a question was asked and we referred to forum or answered it. label May 16, 2017
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
answered For when a question was asked and we referred to forum or answered it.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mattab