Debuggability for OOMs due to split explosions
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 25/100
Research direction
No file, test, or entry point is named. First clarify which debuggability proposal to pursue for the Split filter: trace and warning logs, split-event metrics, or a circuit-breaker limit. Done should mean an agreed scope, implementation location, configuration behavior, and diagnostics or event-tagging expectations.
Written by the indexing model from the issue text.
Description
Ideas to make the Split filter debuggable
-
Add a trace logger which logs the exact count of items before the actual split
-
Add a warning logger which logs only if:
- by default, if the items being generated >= bulk size
- configurable by the split filter itself (via a parameter e.g.
warn_threshold)
-
Collect metrics of min/max/average or an histogram of number of split events and report them in the diagnostics
-
Have an optional circuit breaker limit which would not split the events if they exceed a
thresholdand tag the events assplit_failedorsplit_limited
- Dominant language
- Ruby
- Stars
- 6
- Forks
- 29
- PR merge metrics
- No merged PRs in 30d
Getting set up
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from logstash-plugins/logstash-filter-split
-
enhancement status:needs-triage
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
bug
Difficulty 3/5 1-2 days Newbie friendliness 45/100
logstash-plugins/logstash-filter-split#47 · 1 comment · 1 reaction ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
logstash-plugins/logstash-filter-split#42 · 1 comment ·
-
Difficulty 3/5 1-2 days Newbie friendliness 35/100
logstash-plugins/logstash-filter-split#38 · 1 reaction ·
-
Split Filter is not multi thread, how to fix this?May be free again @colinsurprenant claimed this 2783 days ago, and no pull request is open. Open
logstash-plugins/logstash-filter-split#37 · 1 comment · 1 assignee ·
All issues in logstash-plugins/logstash-filter-split
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
security
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
IBM/ai-security-baseline#25 ·
-
security
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
Maintainers usually reply within 1 day
-
Mend: dependency security vulnerability
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
Maintainers usually reply within 1 day
-
Mend: dependency security vulnerability
Difficulty 2/5 1-3 hours Newbie friendliness 62/100