Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve in-app feedback mechanism to gain insight from users about pain points #18186

Closed
2 tasks done
justinvelluppillai opened this issue Oct 20, 2021 · 7 comments · Fixed by #18280
Closed
2 tasks done
Assignees
Labels
Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc. Major Indicates the severity or impact or benefit of an issue is much higher than normal but not critical.
Milestone

Comments

@justinvelluppillai
Copy link
Contributor

justinvelluppillai commented Oct 20, 2021

In line with our objective to generate a feedback loop to understand our users better this issue will allow us to combine our ideas and create a better feedback mechanism in Matomo than the existing thumbs up/down.

We will need to think about:

  • UI changes
  • CTA, eg "Not finding something you need?" or something that invites the right type of feedback
  • Structured vs qualitative feedback (will we provide radios/checkboxes or text fields or a combination?)

refs

@justinvelluppillai justinvelluppillai added Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc. RFC Indicates the issue is a request for comments where the author is looking for feedback. labels Oct 20, 2021
@justinvelluppillai justinvelluppillai added this to the 4.6.0 milestone Oct 20, 2021
@bx80
Copy link
Contributor

bx80 commented Oct 20, 2021

I think a choice for structured feedback will help increase engagement since not everyone has the time or inclination to compose a message. While individual qualitative feedback has more value, aggregate structured feedback could provide a valuable reinforcing metric. If we can design a mechanism that can gather structured feedback on specific usage while retaining the option to provide more detailed comments or suggestions then we will have a broader range of user experiences from which to gain insights.

How many structured feedback questions are too many? Could 'Rate your experience' [1-5 star] coexist with a rating dependent 'How could this be better?' ['Better help', 'More intuitive UI', 'More options', ...] or 'Why did you like this?' ['Easy to use', 'Configurable', ...] ?

That would be as little as three clicks to get a general rating for feature combined with an easy to analyze tag for improvement, without removing the option for more detailed written feedback.

If the delivery mechanism for feedback is to be an automatically generated email then we could add specially formatted tags from structured feedback data which could be automatically aggregated into a report when the email is received. eg. every feedback email with [Goals-Chart-Rating-4] would affect the rating for the Goals Chart feature or [Goals-Chart-Improve-Better-Help] would be another vote for improving the help in that area.

@tsteur
Copy link
Member

tsteur commented Oct 29, 2021

Here are specs:

  • Require a message to be entered. Sending feedback will only work when at least 5 characters entered. Otherwise we show a message telling them to enter a message. Or maybe we could also highlight the textarea red or so.
  • When hovering a title, directly show both thumbs up and down, not just the thumbs up initially and on hover of the thumbs up the thumbs down. As soon as we show thumbs up, we also want to show immediately thumbs down alwatys.
  • In the popups where you enter the feedback show the buttons in the bottom like in below screenshot. Basically send feedback needs to have css class btn not btn-flat
    image

If they click on thumbs up

  • Use below wording

What do you like about this feature? (“this feature” to be replaced with feature name where we have it)
Please let us know more about how you use this feature so we can improve Matomo further. Thank you ❤️

  • Use below thank you screen for the good rating

image

  • Note the button in above screen should say Close, not OK.

If they click on thumbs down

  • Use below wording

How can we improve this feature? (“this feature” to be replaced with feature name where we have it)
Please let us know more about how we can do better so we can improve Matomo. Thank you ❤️

  • Thank you confirmation
    image

Text:
Thank you for helping us to make Matomo better!
We really appreciate your feedback. ❤️ We will be in touch in case we require more information about your feedback.

  • Note here also the button in above image should be Close and not OK.

Tooltip text

When hovering the thumbs icons, let's change the below message

image

To: Do you like the '...' feature? Please let us know so we can improve Matomo

If easily doable, the email we receive with the feedback could also track the source whether this was from On-Premise, Matomo for WordPress or the demo. This may not be that easy though. On the Cloud this feature is not available so it might not be that important.

@tsteur
Copy link
Member

tsteur commented Oct 29, 2021

'How could this be better?' ['Too difficult to use', 'Lack of features', 'Buggy', 'Too slow', 'Other', ...] (if click on thumbs down)
or 'Why did you like this?' ['Easy to use', 'Configurable', ...] ? (if click on thumbs up)

Having a select option in the feedback additionally could be otherwise good too. Once this feedback has been sent, we could then follow up with showing a textarea and asking for more details.

Like we always show the radio fields (single choise) on the top, and then adjust the textarea description

image

I couldn't prepare proper UI but imagine it looked better and there be radio fields :)

however, I'm not sure what to show as options for "why do you like this"

@tsteur tsteur added the Major Indicates the severity or impact or benefit of an issue is much higher than normal but not critical. label Nov 1, 2021
@justinvelluppillai justinvelluppillai removed the RFC Indicates the issue is a request for comments where the author is looking for feedback. label Nov 3, 2021
@bx80 bx80 self-assigned this Nov 5, 2021
@bx80
Copy link
Contributor

bx80 commented Nov 7, 2021

@tsteur Can I clarify if we're going to a) show a single dialog with select option choices at the top and optional text comments below, or b) if we're going to first show a mandatory text feedback dialog and then after submitting that show another dialog with selection option choices and then send that as a second email?

Seems like a single dialog would be a better UX?

@tsteur
Copy link
Member

tsteur commented Nov 7, 2021

I was thinking a). And then the question for the text comment changes depending on the selected field. The textarea could be hidden or disabled until a radio field has been selected. So all in a single dialog 👍

@GreenReaper
Copy link

I wanted to give feedback but I got an error: "Could not instantiate mail function." This is correct; the system is not set up to send mail, but it would've been nice if it suggested an alternative method to give feedback. Or better, if it didn't rely on mail; or didn't solicit the user to send feedback if it wasn't going to work, though I'm not sure if you can easily determine that before trying.

@sgiehl
Copy link
Member

sgiehl commented Jan 18, 2022

Hi @GreenReaper
Thanks for your suggestion. I'll create a new issue with your feedback. It would indeed be valuable to at least give the user an alternative method to send the feedback if mail doesn't work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Enhancement For new feature suggestions that enhance Matomo's capabilities or add a new report, new API etc. Major Indicates the severity or impact or benefit of an issue is much higher than normal but not critical.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants