opensearch-project/OpenSearch

[Feature Request] Add granular logging for ingest pipeline processor failure

Open

#12.553 aberto em 7 de mar. de 2024

Ver no GitHub
 (11 comments) (0 reactions) (1 assignee)Java (1.505 forks)batch import
enhancementgood first issueingest-pipeline

Métricas do repositório

Stars
 (8.123 stars)
Métricas de merge de PR
 (Mesclagem média 5d 9h) (266 fundiu PRs em 30d)

Description

Is your feature request related to a problem? Please describe

Currently, within the OpenSearch project, the logging mechanism for failures in the ingest pipeline processors lacks granularity, we only have failure metric count. As a result, troubleshooting and debugging issues related to failed processors become cumbersome and inefficient for developers and administrators.

https://github.com/opensearch-project/OpenSearch/blob/3056b67fb0037df9045bbdd0b828929b2e17aaed/server/src/main/java/org/opensearch/ingest/CompoundProcessor.java#L164-L186

Describe the solution you'd like

We propose adding a debug level logging feature dedicated to capturing detailed information about failures occurring within ingest pipeline processors.

Related component

Indexing

Guia do colaborador