Hi again,

After some investigation I found the following:

The only difference between two HTTP calls (each one corresponds to one of the lines in the file) to the Piwik Server is:

'action_name': u'303/URL=http%3A%2F%2Fwww.british-library.co.uk%2Fid%2Fresource%2F013541591'

Specifically, 'action_name' is only included if the hit (i.e. line in the file) is an error or redirect. If it is not included (i.e. http 200 status), then the line is ignored by Piwik Server completely.

Is this behavior a bug? Do I miss something? If I alter the import_log.py script to always include 'action_name' for all lines, then all lines are included in the results of the Piwik Server. But I am not sure if by doing so I could possibly cause other issues.

Looking forward to a reply by a more Piwik familiar programmer.. :-)

Thanks in advance!

In detail:

{
    'apiv': '1',
    'cvar': u'{
        "1": [
            "HTTP-code",
            "303"
        ]
    }',
    'action_name': u'303/URL=http%3A%2F%2Fwww.british-library.co.uk%2Fid%2Fresource%2F013541591',
    'cdt': '2014-05-1122: 59: 59',
    'urlref': '',
    'dp': '1',
    'url': 'http: //www.british-library.co.uk/id/resource/013541591',
    'cip': u'66.249.76.11',
    'idsite': '1',
    '_cvar': u'{
        "1": [
            "Bot",
            "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html"
        ]
    }',
    'rec': '1',
    'bots': '1',
    'ua': 'Mozilla/5.0(compatible;Googlebot/2.1;+http: //www.google.com/bot.html'
},
{
    'apiv': '1',
    'cvar': u'{
        "1": [
            "HTTP-code",
            "200"
        ]
    }',
    'cdt': '2014-05-1105: 18: 14',
    'urlref': '',
    'dp': '1',
    'url': 'http: //www.british-library.co.uk/doc/resource/GBB138900',
    'cip': u'88.198.56.239',
    'idsite': '1',
    '_cvar': u'{
        "1": [
            "Not-Bot",
            "Mozilla/5.0 (compatible; Windows; U; Windows NT 6.2; WOW64; en-US; rv:12.0) Gecko/20120403211507 Firefox/12.0"
        ]
    }',
    'rec': '1',
    'bots': '1',
    'ua': 'Mozilla/5.0(compatible;Windows;U;WindowsNT6.2;WOW64;en-US;rv: 12.0)Gecko/20120403211507Firefox/12.0'
} 

I just import (access.log : file with just 2 lines)

What happens is that these two lines are for the same pageview, in the same second. By design Piwik tracks a given pageview only once per second. So could you try to set the other pageview 1 or 2 seconds later and try again?

Hi Matt,

Tried (clean Piwik installation) with the following lines:

66.249.76.11 - - +0100 "GET /id/resource/013541581 HTTP/1.1" 303 - "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.76.11 - - +0100 "GET /doc/resource/007667231 HTTP/1.1" 200 - "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

Add still the result is the same. Also, the requests are for different resources in both cases. So I assumed that they should not be counted as a single page view even if the time-stamp was exactly the same.

Any ideas?

Thanks,
Vassilis

Attachment:
two requests imported.png

I created test-log.log as follows:

66.249.76.11 - - [14/May/2014:23:59:50 +0100] "GET /id/resource/013541589 HTTP/1.1" 303 - "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.76.11 - - [14/May/2014:23:59:59 +0100] "GET /doc/resource/007667232 HTTP/1.1" 200 - "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

Then imported it with:
$ ./misc/log-analytics/import_logs.py --url=localhost/piwik-master test-log.log --idsite=1 --enable-bots --enable-http-redirects

Then I see both requests in the visitor log, see screenshot: http://issues.piwik.org/attachments/5161/two%20requests%20imported.png

So please upgrade to latest beta: http://piwik.org/faq/how-to-update/faq_159/

and let me know if you still have the problem?

Hi Matt,

I followed the instruction at http://piwik.org/faq/how-to-update/faq_159/.

I selected --> When checking for new version of Piwik, always get: "The latest beta release", but when I press "Check for updates" I get "You are using the latest piwik version: 2.2.2"..

Can you please help.

Is there any direct link for piwik latest beta?

Thanks again!
Vassilis

I found this one: http://builds.piwik.org/piwik-2.2.3-b4.zip, which seems to be the latest. I will try it and come back to you.

ok it works fine with 2.2.3-b4!

Thanks for the help Matt!

When do we expect the stable 2.2.3?

Do you think I could go live with 2.2.3-b4?

I think the best solution is a patch, as the bug is quite serious. Is there a patch I could apply to 2.2.2?

Regards,
Vassilis

Attachment: two_lines_import
piwik_problem.jpg

Hi again,

sorry for the wrong feedback.

It still does not work with 2.2.3-b4. I imported after a fresh install the two lines and only the 303 is depicted.

Is the latest beta 2.2.3-b4?

Thanks,
Vassilis

Hi @vspiliop do you still experience the issue with 2.9.1 ? please let us know, thanks

Issue was moved to the new repository for Piwik Log Analytics: https://github.com/piwik/piwik-log-analytics/issues

refs #7163