[Bug] [imap] engine_runningJobMetrics size too long, imap monitoring data is too large

(7 条评论) (0 个反应) (0 位负责人)Java (1,432 个派生)batch import

bughelp wanted

仓库指标

星标: (6,897 个星标)
PR 合并指标: (PR 指标待抓取)

描述

Search before asking

I had searched in the issues and found no similar issues.

What happened

In split mode, after MySQL CDC runs for a period of time, the imap is stored on the local disk and takes up too much space, a full 200GB. The parameters configured as follows do not clear the data. If this continues, the task will definitely not be able to run.

seatunnel: engine: history-job-expire-minutes: 1440 telemetry: logs: scheduled-deletion-enable: true

SeaTunnel Version

2.3.9

SeaTunnel Config

MySQL的cdc

Running Command

MySQL的cdc

Error Exception

MySQL的cdc

Zeta or Flink or Spark Version

No response

Java or Scala Version