kubernetes-sigs/cluster-api

High memory usage on ClusterResourceSet controllers

已关闭

#9,843 创建于 2023年12月11日

 (6 条评论) (0 个反应) (0 位负责人)Go (1,532 个派生)auto 404
area/clusterresourcesetarea/machinedeploymenthelp wantedkind/bugpriority/important-longtermtriage/accepted

仓库指标

星标
 (4,267 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

What steps did you take and what happened?

On a scale test we've been running, we have realized that ClusterResourceSet is consuming a large amount of memory from the environment.

The environment:

  • 200 clusters created
  • Every cluster contains 3 ClusterResourceSet (CNI = Antrea, CSI = vsphere-csi and CPI=vsphere-cloud-provider), with spec.strategy=Reconcile

The growth of memory is exponential with the cluster creation. Following is attached an extraction of the pprof flamegraph from the time the problem happened

What did you expect to happen?

  • First of all, to check if this is the expected behavior
  • If not, that the memory growth is not exponential with the ClusterResourceSet usage

Cluster API version

CAPI 1.5.4, CAPV 1.8.4

Kubernetes version

No response

Anything else you would like to add?

No response

Label(s) to be applied

/kind bug One or more /area label. See https://github.com/kubernetes-sigs/cluster-api/labels?q=area for the list of labels.

贡献者指南