fluent/fluentd

Buffer size metrics showing negative values

開放

#5,303 建立於 2020年9月24日

 (3 則留言) (0 個反應) (0 位負責人)Ruby (1,392 個分叉)batch import
bughelp wanted

倉庫指標

星標
 (13,529 顆星)
PR 合併指標
 (平均合併 9小時 42分鐘) (30 天內合併 30 個 PR)

描述

Details

I have Fluentd set up to forward logs to Kafka. In some of the Prometheus metrics for the buffers of those Kafka output plugins, I'm seeing negative values. Specifically, I'm seeing negative values for the following metrics:

  • fluentd_output_status_buffer_total_bytes
  • fluentd_output_status_buffer_stage_byte_size

Eg.

fluentd_output_status_buffer_total_bytes{worker_id="3",plugin_id="kafka_output",type="kafka2"} -7897834.0
fluentd_output_status_buffer_stage_byte_size{worker_id="3",plugin_id="kafka_output",type="kafka2"} -7897834.0

This appears to be the same issue as fluent/fluent-plugin-prometheus#55, open since 2018.

Prometheus Config

<source>
  @type prometheus
  port 24240
  metrics_path /metrics
  aggregated_metrics_path /aggregated_metrics
</source>

<source>
  @type prometheus_output_monitor
</source>

Env Info

  • Fluentd: 1.11.2
  • fluent-plugin-prometheus: 1.8.2
  • fluent-plugin-prometheus_pushgateway: 0.0.2
  • fluent-plugin-kafka: 0.14.1
  • Note that Fluentd has multi-process workers enabled

貢獻者指南