Navigation Menu

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Discrepancies noticed within the performance report #19729

Open
Chardonneaur opened this issue Sep 13, 2022 · 8 comments
Open

Discrepancies noticed within the performance report #19729

Chardonneaur opened this issue Sep 13, 2022 · 8 comments
Labels
Bug For errors / faults / flaws / inconsistencies etc.

Comments

@Chardonneaur
Copy link

Hi guys,

A client of mine reported me the following issue, the total of the performance report for a given month on the bar graph is different than the one of the table shown below it.
hidden
Did anyone else already saw a similar issue?

@Chardonneaur Chardonneaur added the Potential Bug Something that might be a bug, but needs validation and confirmation it can be reproduced. label Sep 13, 2022
@sgiehl
Copy link
Member

sgiehl commented Sep 13, 2022

Hey @Chardonneaur
This could maybe be rounding issues. The bar evolution chart simply displays a sum of all average metrics, while the average load time metric is calculated on a per visit base, summed up and divided through the number of visits.

@MatomoForumNotifications

This issue has been mentioned on Matomo forums. There might be relevant details there:

https://forum.matomo.org/t/average-page-load-time-incoherence/47384/2

@Chardonneaur
Copy link
Author

@sgiehl I tried to test the rounding hypothesis and to me it is not because the difference is too high.
Is there any possibility to check the calculation that Matomo is doing to perform the total of this table report?

@heurteph-ei
Copy link

@sgiehl, I agree @Chardonneaur, even with rounding, you can't have such difference.
On the tooltip, the rounding is acceptable (and not visible): 0.2 + 1.0 + 0.08+0.93+1.09+0=3.30, on the KPI, it is not. with approximations, the maximum gap should be 0.06 (in the screenshot the difference is 0.51s, or 15%, what a huge difference!)

@sgiehl
Copy link
Member

sgiehl commented Oct 12, 2022

Those are some sort of rounding and calculation issues.
Each single performance metric is calculated by using the sum over all actions, having the metric set, divided through the count of actions.
But the overall metric is computed by summing all metrics over all actions, where one of those metrics have a value, divided through the actions.
So in theory there can be actions, that e.g. only have a transport time set. Those would then also be used for the overall metric, but would lower it's value bit more, as other metrics aren't set.
Hope that makes sense. If not I might need to explain that a bit more in detail.

@heurteph-ei
Copy link

I think that on the same page (see Chardonneaur screenshot), you should not have 2 different values for the same thing:
image
image
All values are the same, except Total...

@Chardonneaur
Copy link
Author

@sgiehl @heurteph-ei thank you very much for taking the time investing in this issue, I think it is really important that an answer can be provided to the community in an FAQ or similar as the question will come on and on.

@sgiehl
Copy link
Member

sgiehl commented Oct 14, 2022

@heurteph-ei @Chardonneaur I agree that there shouldn't be two different values. I guess we actually should change the calculation of the value used for the sparkline. Otherwise it might be a bit strange that the total page load time isn't the sum of all other metrics. 🤔

@sgiehl sgiehl added Bug For errors / faults / flaws / inconsistencies etc. and removed Potential Bug Something that might be a bug, but needs validation and confirmation it can be reproduced. labels Oct 14, 2022
@sgiehl sgiehl added this to the For Prioritization milestone Oct 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug For errors / faults / flaws / inconsistencies etc.
Projects
None yet
Development

No branches or pull requests

4 participants