opensearch-project/OpenSearch

[Feature Request] Add granular logging for ingest pipeline processor failure

Open

#12.553 aperta il 7 mar 2024

Vedi su GitHub
 (11 commenti) (0 reazioni) (1 assegnatario)Java (1505 fork)batch import
enhancementgood first issueingest-pipeline

Metriche repository

Star
 (8123 star)
Metriche merge PR
 (Merge medio 5g 9h) (266 PR mergiate in 30 g)

Descrizione

Is your feature request related to a problem? Please describe

Currently, within the OpenSearch project, the logging mechanism for failures in the ingest pipeline processors lacks granularity, we only have failure metric count. As a result, troubleshooting and debugging issues related to failed processors become cumbersome and inefficient for developers and administrators.

https://github.com/opensearch-project/OpenSearch/blob/3056b67fb0037df9045bbdd0b828929b2e17aaed/server/src/main/java/org/opensearch/ingest/CompoundProcessor.java#L164-L186

Describe the solution you'd like

We propose adding a debug level logging feature dedicated to capturing detailed information about failures occurring within ingest pipeline processors.

Related component

Indexing

Guida contributor