juspay/hyperswitch

feat(metrics): add Vector Throughput & health (via prometheus)

Open

#5,030 建立於 2024年6月18日

在 GitHub 查看
 (4 留言) (0 反應) (2 負責人)Rust (4,676 fork)batch import
A-infraC-featuregood first issue

倉庫指標

Star
 (42,690 star)
PR 合併指標
 (平均合併 6天 22小時) (30 天內合併 213 個 PR)

描述

Add a dashboard to monitor vector throughput usage and log loss. The dashboard should show throughput for the following pipes

Throughput

  1. stdout -> loki
  2. stdout -> opensearch
  3. kafka -> loki
  4. Kafka -> transform -> opensearch These flows should include incoming events / outgoing events & dropped events as a time series chart

kafka source should contain consumer lag metrics as well

Health (this would be primarily powered by these metrics)

  • CPU usage of vector
  • Memory usage of vector
  • buffer size
  • errors happening in transforms
  • utilization of each component

Ideally we can take most of the components from a openly available data source by modifying some components to make it geared towards our setup

貢獻者指南