grafana/mimir

helm: Stateful components emptyDir inMemory option

Open

#8,169 创建于 2024年5月22日

在 GitHub 查看
 (6 评论) (0 反应) (0 负责人)Go (808 fork)auto 404
enhancementhelmhelp wanted

仓库指标

Star
 (5,181 star)
PR 合并指标
 (PR 指标待抓取)

描述

Describe the bug

"emptyDir: {}" is hardcoded in statefulset templates. In our case this causes impossibility to set "medium: Memory" for compactor's persistent volumes when one can't use PVC. Therefore that volumes always use k8s ephemeral storage, the default behavior of which has changed greatly in k8s v1.27. As a result, the compactor pods go into the "Completed" state a few seconds after start (time depends of load). If you perform "kubectl describe" compactor pod at this moment, you can see error "Pod ephemeral local storage usage exceeds the total limit of containers <some_size>" This is default for k8s 1.27+ and if you aren't cluster admin you can do nothing to fix this behavior.

Another stateful components (Ingester etc) have similar problem.

It is necessary to add the ability to set emptyDir location (memory/disk) in chart values. The Grafana Tempo chart provides such an opportunity for stateful components (e.g. ingester) and we have no similar problems with Tempo after upgrade k8s to 1.27.

贡献者指南