apache/seatunnel

[Bug] [imap] engine_runningJobMetrics size too long, imap monitoring data is too large

オープン

#8,558 opened on 2025/01/20

 (7 件のコメント) (0 件のリアクション) (0 人の担当者)Java (1,432 件のフォーク)batch import
bughelp wanted

Repository metrics

Stars
 (6,897 個のスター)
PR merge metrics
 (PR metrics pending)

説明

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

In split mode, after MySQL CDC runs for a period of time, the imap is stored on the local disk and takes up too much space, a full 200GB. The parameters configured as follows do not clear the data. If this continues, the task will definitely not be able to run.

seatunnel: engine: history-job-expire-minutes: 1440 telemetry: logs: scheduled-deletion-enable: true

SeaTunnel Version

2.3.9

SeaTunnel Config

MySQL的cdc

Running Command

MySQL的cdc

Error Exception

MySQL的cdc

Zeta or Flink or Spark Version

No response

Java or Scala Version

No response

Screenshots

Image

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

コントリビューターガイド