solana-labs/solana

validator uses more memory than expected when metrics are enabled

Open

#24,319 opened on Apr 13, 2022

View on GitHub
 (26 comments) (0 reactions) (1 assignee)Rust (3,950 forks)batch import
do-not-closegood first issue

Repository metrics

Stars
 (12,651 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

Problem

80GB difference between RUST_LOG=solana=info and RUST_LOG=solana=warn for RPC nodes.

Proposed Solution

Relevant question.. is the channel that the metrics are sending to really large? Could there be some large amount of outstanding sends which each is taking some memory and state?

Debug and find why. Possibly reduce the occurrence of spammy metrics.

Contributor guide

Research direction
Investigate the metrics channel for large pending sends and identify spammy metrics that cause high memory usage.
Tech stack
rust
Domain
backend
Issue type
Performance
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
3-5 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Needs investigation
Prerequisites
Rust
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
30