[Bug] [imap] engine_runningJobMetrics size too long, imap monitoring data is too large

(7 則留言) (0 個反應) (0 位負責人)Java (1,432 個分叉)batch import

bughelp wanted

倉庫指標

星標: (6,897 顆星)
PR 合併指標: (PR 指標待抓取)

描述

Search before asking

I had searched in the issues and found no similar issues.

What happened

In split mode, after MySQL CDC runs for a period of time, the imap is stored on the local disk and takes up too much space, a full 200GB. The parameters configured as follows do not clear the data. If this continues, the task will definitely not be able to run.

seatunnel: engine: history-job-expire-minutes: 1440 telemetry: logs: scheduled-deletion-enable: true

SeaTunnel Version

2.3.9

SeaTunnel Config

MySQL的cdc

Running Command

MySQL的cdc

Error Exception

MySQL的cdc

Zeta or Flink or Spark Version

No response

Java or Scala Version