@dave-anh-kpi opened this Issue on August 2nd 2022

Expected Behavior

Normally, Matomo is based on a last-click attribution model by default. This means, if you look at your sales per channel in the Sales report, you should find a specific number per each channel. Let's say you are looking at your sales from "Direct" traffic.
If you look at your sales while using a segment based on "Direct Traffic", you should find the exact same number of sales in the "E-commerce > Overview" report.

Current Behavior

Well, this is not happening. The data is different, which mean I don't know how to assess the performance of my different traffic channels.

Here's an example of my case (find enclosed some screenshots Screenshot Matomo problème attrib.pdf):

In the Sales Report: I have 4 orders attributed to “Direct” channel (1).
When I am using a segment based on “Direct traffic”, Matomo shows me 10 orders (2, 3).
These 10 orders are also found in the User Log report of Direct Traffic" (4).
I also tried the Multi Attribution Report but the data shown is once again different… (5)

Steps to Reproduce (for Bugs)

I noticed that the issue is the same for all the dimensions you use to segment your traffic. Here's an example to reproduce the problem on https://demo.matomo.cloud/

  1. Select the following dates: From 2022-07-01 To 2022-07-31
  2. Go to "E-commerce > Sales"
  3. Click on "Country" in the section "Sales by User location"
  4. Search for New Zealand (you will find 13 e-commerce orders)
  5. Now, Go to E-commerce > Overview
  6. Apply the segment "NZ visitors" (you will find 10 e-commerce orders)

Context

I already talked to Matthieu about this issue, he told me to send an email to the support team, which I did. The support Team told me to post a message here.

Your Environment

I use Matomo Cloud

@sgiehl commented on August 2nd 2022 Member

Hi @dave-anh-kpi
Thanks for creating this issue. I guess we might need to dig a beet deeper into how the conversions are calculated in detail.
A first assumption would be that, the reports might differ as the dimension stored for the visit differs from the conversion.
The conversion reports should be calculated based on the data stored together with the conversion, while segments are mostly applied to the data stored with the visit. So if bother differs, that could cause some conversions not to show up in the segmented report.
I'll hand this over to our product team to plan the further investigation of this issue.

@dave-anh-kpi commented on September 21st 2022

Hello,
Do you have any update on the issue ?
We are talking about a major issue --> My client (+10K€ Matomo Subscription) is not able to understand which channel is converting the most ! This is a basic in Web Analytics...
Here more recent screenshots showing the huge difference between the ways of looking at the data :

image

image

image

Thank you for your help.

@jane-twizel commented on September 22nd 2022

@dave-anh-kpi I really appreciate you letting us know about this issue and also the great description. Our developers will investigate this more to work out next steps.

@gwizcole commented on January 11th 2023

Can confirm we are seeing a similar issue. In addition, we’re seeing large variances in how conversions are grouped into which channel based on the report we choose. There is no solid consistency when comparing metrics for the same dimension for the same date range between different sales reports that are intended to show essentially the same thing.

  • Channel grouping reports, sales/eComm reports, UTM reports, multi-attribution reports are not consistent.
  • We use the UTM add-on. Figures in UTM add-on reports are not matching Sales reports, and UTM data is not accurately grouped or included at all. We use the same UTM structure across all tracked campaigns. In the case of Google Ads, email, referring websites, and other channels, a portion of our campaigns get grouped and identified in Matomo, others do not, and this also changes depending on which report we view.
  • Viewing the live log, watch can watch in real time as some conversion journeys get split after the user lands on-site and visits a specific page, or the ID gets split before they enter, each showing different source attribution metrics.

An a related note. In the multi Attribution comparison tools, the last click model show different figures than Matomo’s default reports, which are stated as using last referrer.

Is there something we can do to remedy this before 5.0? We would love to support Matomo but at this stage we can’t make use of reports.

Powered by GitHub Issue Mirror