apache/seatunnel

[Bug] [imap] engine_runningJobMetrics size too long, imap monitoring data is too large

Open

#8,558 建立於 2025年1月20日

在 GitHub 查看
 (7 留言) (0 反應) (0 負責人)Java (1,432 fork)batch import
bughelp wanted

倉庫指標

Star
 (6,897 star)
PR 合併指標
 (平均合併 13天 21小時) (30 天內合併 143 個 PR)

描述

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

In split mode, after MySQL CDC runs for a period of time, the imap is stored on the local disk and takes up too much space, a full 200GB. The parameters configured as follows do not clear the data. If this continues, the task will definitely not be able to run.

seatunnel: engine: history-job-expire-minutes: 1440 telemetry: logs: scheduled-deletion-enable: true

SeaTunnel Version

2.3.9

SeaTunnel Config

MySQL的cdc

Running Command

MySQL的cdc

Error Exception

MySQL的cdc

Zeta or Flink or Spark Version

No response

Java or Scala Version

No response

Screenshots

Image

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

貢獻者指南