juspay/hyperswitch

feat(metrics): add Vector Throughput & health (via prometheus)

Open

#5,030 opened on 2024年6月18日

GitHub で見る
 (4 comments) (0 reactions) (2 assignees)Rust (4,676 forks)batch import
A-infraC-featuregood first issue

Repository metrics

Stars
 (42,690 stars)
PR merge metrics
 (平均マージ 6d 22h) (30d で 213 merged PRs)

説明

Add a dashboard to monitor vector throughput usage and log loss. The dashboard should show throughput for the following pipes

Throughput

  1. stdout -> loki
  2. stdout -> opensearch
  3. kafka -> loki
  4. Kafka -> transform -> opensearch These flows should include incoming events / outgoing events & dropped events as a time series chart

kafka source should contain consumer lag metrics as well

Health (this would be primarily powered by these metrics)

  • CPU usage of vector
  • Memory usage of vector
  • buffer size
  • errors happening in transforms
  • utilization of each component

Ideally we can take most of the components from a openly available data source by modifying some components to make it geared towards our setup

コントリビューターガイド