I checked and in the case where we have a memory issue, $dataTableBlobs variable alone consumes 3.1GB memory. This is before any data table is expanded.

I was running into memory issues in my Matomo installation, which I also discussed in this forum post. It sounds like solving this issue would also resolve my problems with the archiver. Do you also think this is the case, or do you think there is a separate issue going on there?

It might @gijshendriksen it's hard to say without knowing all the details.

Generally what might also help is to lower the number of actions in the report see https://matomo.org/faq/how-to/faq_54/

eg setting something like

[General]
datatable_archiving_maximum_rows_actions = 500
datatable_archiving_maximum_rows_subtable_actions = 100

Sometimes this does not fix it alone, and if it happens eg for a yearly period, then the archives for each month in the year would need to be invalidated see https://matomo.org/faq/how-to/faq_155/

Hae you maybe already lowered the number of rows in the reports before?

@tsteur thanks for your help! I wasn't aware these configuration options would help with the memory usage, but after applying your suggested changes the archiver now seems to be working again. Thanks!

We're having this issue daily quite a few times with various customers.

We again have an issue with a customer where archiving stopped working because of this issue

Seeing this issue happening again for a URL like this:

/index.php?date=2021-06-01,2022-12-31&filter_limit=300&flat=1&format=CSV&format_metrics=1&idSite=1&language=en&method=Actions.getPageUrls&module=API&period=day&segment=&token_auth=ANONYMOUS&force_session_api=1&translateColumnNames=1&convertToUnicode=0&1

Not fully sure if it is this specific problem but I assume so and it should reduce memory quite a bit if we had this logic.

Again issues today

Again happened few times.

We're having issues pretty much daily with this one

@tsteur Is this one fully fixed with #20332 ?

@sgiehl yes it is. #20512 should be merged too though.