opensearch-project/OpenSearch

[Feature Request] Add granular logging for ingest pipeline processor failure

Open

#12.553 geöffnet am 7. März 2024

Auf GitHub ansehen
 (11 Kommentare) (0 Reaktionen) (1 zugewiesene Person)Java (1.505 Forks)batch import
enhancementgood first issueingest-pipeline

Repository-Metriken

Stars
 (8.123 Stars)
PR-Merge-Metriken
 (Durchschn. Merge 5T 9h) (266 gemergte PRs in 30 T)

Beschreibung

Is your feature request related to a problem? Please describe

Currently, within the OpenSearch project, the logging mechanism for failures in the ingest pipeline processors lacks granularity, we only have failure metric count. As a result, troubleshooting and debugging issues related to failed processors become cumbersome and inefficient for developers and administrators.

https://github.com/opensearch-project/OpenSearch/blob/3056b67fb0037df9045bbdd0b828929b2e17aaed/server/src/main/java/org/opensearch/ingest/CompoundProcessor.java#L164-L186

Describe the solution you'd like

We propose adding a debug level logging feature dedicated to capturing detailed information about failures occurring within ingest pipeline processors.

Related component

Indexing

Contributor Guide