Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Matomo dashboard does not show statistics which are more that 10 years old! #14255

Closed
glatzenarsch opened this issue Mar 22, 2019 · 6 comments
Closed
Labels
worksforme The issue cannot be reproduced and things work as intended.

Comments

@glatzenarsch
Copy link

Hello

I am using Matomo over 3 years now. My project is to import very large amount of logs over 15years.
Problem is that when i imported logs nad archive them with:
/usr/bin/php /usr/share/matomo/console core:archive --force-idsites=42 --force-date-range=2008-01-01,2009-01-01 --url=…

dashboard doesnt show them. Is there some limit because everything from 2009-2019 shows fantastic.

32 users
21 segments
49 websites
45 activated plugins
Matomo version: 3.5.1
MySQL version: 10.1.37-MariaDB-0+deb9u1
PHP version: 7.0.33-0+deb9u2

Thank you very much.

@tsteur
Copy link
Member

tsteur commented Mar 25, 2019

I do remember seeing some limits around 2008 or so somewhere in the code but can't find the right timestamp right now.

Maybe @mattab remembers?

Can you otherwise maybe check in the database in the matomo_log_visit table and visit_last_action_time column if there are entries for before 2009?

@mattab
Copy link
Member

mattab commented Mar 25, 2019

AFAIK there shouldn't be a limit, except for data before when the first website came online - Tue, 06 Aug 1991 00:00:00 GMT.
see error triggered in

matomo/core/Date.php

Lines 154 to 162 in 2ec7485

if ($timestamp < self::FIRST_WEBSITE_TIMESTAMP) {
$dateOfFirstWebsite = new self(self::FIRST_WEBSITE_TIMESTAMP);
$message = Piwik::translate('General_ExceptionInvalidDateBeforeFirstWebsite', array(
$date->toString(),
$dateOfFirstWebsite->getLocalized(self::DATE_FORMAT_SHORT),
$dateOfFirstWebsite->getTimestamp()
));
throw new Exception($message . ": $dateString");
}

But this was 28 years ago

@tsteur
Copy link
Member

tsteur commented Mar 25, 2019

I just remembered this was fixed in Matomo 3.9. I saw this morning the limit in the tracker is set to 20 years so figured that can't be it. But just now randomly remembered we only increased it from 10 to 20 years a month ago. So if you update to the latest version and try again then it should work.

@tsteur tsteur closed this as completed Mar 25, 2019
@tsteur tsteur added the worksforme The issue cannot be reproduced and things work as intended. label Mar 25, 2019
@glatzenarsch
Copy link
Author

I do imported one month from 2008 year:

Logs import summary

341972 requests imported successfully
542 requests were downloads
2316284 requests ignored:
    23695 HTTP errors
    30083 HTTP redirects
    0 invalid log lines
    0 filtered log lines
    0 requests did not match any known site
    0 requests did not match any --hostname
    669 requests done by bots, search engines...
    2261837 requests to static resources (css, js, images, ico, ttf...)
    0 requests to file downloads did not match any --download-extensions

Website import summary

341972 requests imported to 1 sites
    1 sites already existed
    0 sites were created:

0 distinct hostnames did not match any existing site:

and run core:archive --force-all-websites --force-all-periods=315576000 --force-date-last-n=1000 --url='https://matomo.srce.hr/'

and

core:archive --url="https://matomo.srce.hr/" instead.
That do nothing...

MariaDB [matomo]> select visit_last_action_time from piwik_log_visit where visit_last_action_time like '2008%';
Empty set (36.10 sec)

this query does show no results.. i dont understand.

thank you.

@tsteur
Copy link
Member

tsteur commented Mar 25, 2019

See #14255 (comment) you need to update to the latest version.

@glatzenarsch
Copy link
Author

thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
worksforme The issue cannot be reproduced and things work as intended.
Projects
None yet
Development

No branches or pull requests

3 participants