influxdata/telegraf

Configuration option to drop oldest or newest data in the buffer when buffer is full

Open

#15,217 opened on Apr 24, 2024

View on GitHub
 (1 comment) (0 reactions) (0 assignees)Go (4,161 forks)batch import
feature requesthelp wantedsize/m

Repository metrics

Stars
 (9,892 stars)
PR merge metrics
 (Avg merge 2d 12h) (136 merged PRs in 30d)

Description

Use Case

Similar to https://github.com/influxdata/telegraf/issues/15208

(accommodating temporary high-write bursts to and influxdb instance)

Sometimes the newest data is more important to keep than the oldest data (if your computer failed, would you care more about what happened right before the failure or 5 minutes before the failure?)

Sometimes the oldest data is more important to keep than the newest data (ex: which events happened first in this very large burst of events?)

Expected behavior

I expected to see a configuration option like "buffer_drop_strategy" which would default to "drop_oldest".

Actual behavior

No configuration option to specify which metrics (newest or oldest) are dropped from the buffer.

Additional info

No response

Contributor guide

Research direction
Examine the existing buffer implementation in Telegraf, focusing on the `agent` package. Look for how metrics are currently dropped when the buffer is full and identify where a configuration option for drop strategy (oldest vs newest) could be added. Review the linked issue #15208 for additional context.
Tech stack
go
Domain
backend
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
Go
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
75