opensearch-project/OpenSearch

[Feature Request] Add granular logging for ingest pipeline processor failure

Open

#12 553 ouverte le 7 mars 2024

Voir sur GitHub
 (11 commentaires) (0 réactions) (1 assigné)Java (1 505 forks)batch import
enhancementgood first issueingest-pipeline

Métriques du dépôt

Stars
 (8 123 stars)
Métriques de merge PR
 (Merge moyen 5j 9h) (266 PRs mergées en 30 j)

Description

Is your feature request related to a problem? Please describe

Currently, within the OpenSearch project, the logging mechanism for failures in the ingest pipeline processors lacks granularity, we only have failure metric count. As a result, troubleshooting and debugging issues related to failed processors become cumbersome and inefficient for developers and administrators.

https://github.com/opensearch-project/OpenSearch/blob/3056b67fb0037df9045bbdd0b828929b2e17aaed/server/src/main/java/org/opensearch/ingest/CompoundProcessor.java#L164-L186

Describe the solution you'd like

We propose adding a debug level logging feature dedicated to capturing detailed information about failures occurring within ingest pipeline processors.

Related component

Indexing

Guide contributeur