Memory usage keeps increasing despite config for memory constrained environments

[dchancogne]

Based on the documentation here: https://github.com/salesforce/sloop#memory-consumption
I'm using this config in my helm chart:

config: |-
        {
          "badger-use-lsm-only-options": false,
          "badger-keep-l0-in-memory": false,
          "badger-sync-writes": false,
          "badger-vlog-fileIO-mapping": true,
          "badger-max-table-size": 33554432,
          "badger-number-of-compactors": 1,
          "badger-number-of-level-zero-tables": 2,
          "badger-number-of-zero-tables-stall": 3
        }

I can see these values in the ConfigMap in EKS, so I know the values are loaded.

This should limit memory usage to 5GB.

But after 24h, the Sloop container is reaching +7GB.

Helm chart version: 0.1.0
Sloop version: sloopimage/sloop:latest (default value in chart)

[sana-jawad]

@dchancogne This config value triggers garbage collection "max-disk-mb" by default it is set to 32GB. Please adjust it according to your needs.

[kartik-sareen]

@sana-jawad max-disk-mb is "Max disk storage in MB" i don't think reducing this will reduce sloop container's memory usage as it seems to be used for PVC max disk usage after that data will be deleted. Do you have any other solution?