[Feature]: Low-rate, self-triggering TCs are reported Delayed/Timing-out by definition, even when data is complete
Nadie ha tomado este issue todavía.
Evaluación
- Dificultad
- 3/5
- Tiempo estimado
- Medio día
- Aptitud para principiantes
- 65/100
Línea de trabajo
Examine DefaultRequestHandlerModel::get_fragment_pieces() where the buffer timestamp comparison causes false Delayed/Timing-out classifications for self-triggering TCs. Override the completeness check for TC/TA objects to determine if the found fragments already cover the requested time window instead of requiring a newer buffer entry. The fix is complete when these TCs no longer show kIncomplete/kRequestWindowAfterBuffer status during data-taking runs.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
Description
Some pictures to help with explanation:
Current state of trigger buffers for a common data-taking mode (using low rate random trigger):
Unpacking the data:
Description:
For a low-rate, self-triggering TC (e.g. Random, CTB), the dataflow request to read back its own TC-buffer entry is, by default, built from that same object's own time range. DefaultRequestHandlerModel::get_fragment_pieces() only reports kFound if the buffer's newest entry is timestamped strictly after the requested window's end. For an object reading back itself, both sides of that comparison come from the same object — so the comparison is unwinnable by construction. Every such request is classified Delayed, then Timing-out once retries exhaust (def-tc-handler-2), throughout the run.
Looking at the data, TC fragments and objects are actually present and complete — n_inputs==0 is expected for these TC types (no TPG->TAG chain) — despite being tagged kIncomplete/kRequestWindowAfterBuffer. This isn't specific to Random TCs: Hardware_Signal fragments show the identical pattern, for the same structural reason.
Potential impact radius
???
Reason for change
Dashboards/alerting built on these counters are currently unusable for these sources — they show permanent failure regardless of actual system health, so real problems in these sources can't be distinguished from this expected-by-construction behavior.
Suggested implementations
- Override the request-handler's completeness check for TC(/TA) (the base classes are virtual and already overridden for TPs) to be object-aware: "does what we found already cover the requested window" instead of "is there something newer in the buffer." Fixes the single-source, no-merging case; doesn't generalize to multi-TC-source/merged-decision configs.
- Per-source watermarking: each source publishes its own "processed up to T" marker independently. Avoids the single-point-of-failure/cross-source-delay problem that broke the earlier in-stream heartbeat/zipper attempt in trigger, since there's no shared ordering/merge point.
- Other options (using time sync, override the readout request 'to take all that is available without retries' for this case, ...)
Testing suggestions
No response
Anything else?
No response
- Lenguaje dominante
- C++
- Estrellas
- 0
- Forks
- 8
- Merge medio
- 3 h 50 min
- PR fusionados (30 d)
- 1
Preparar el entorno
- Sin Dockerfile ni archivo de Docker Compose
- Tiene una plantilla de pull request
- Sin guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de DUNE-DAQ/trigger
-
enhancement
Dificultad 5/5 Más de una semana Aptitud para principiantes 25/100
-
bug
Dificultad 4/5 3-5 días Aptitud para principiantes 35/100
-
Dificultad 4/5 3-5 días Aptitud para principiantes 38/100
-
Dificultad 5/5 Más de una semana Aptitud para principiantes 35/100
-
Dificultad 3/5 1-2 días Aptitud para principiantes 42/100
Todos los issues de DUNE-DAQ/trigger
Issues similares
-
(S1 - Need confirmation)
Dificultad 2/5 1-3 horas Aptitud para principiantes 68/100
CleverRaven/Cataclysm-DDA#89212 ·
Los mantenedores suelen responder en 1 día
-
Status: Needs confirmation Status: Needs triage
Dificultad 2/5 1-3 horas Aptitud para principiantes 70/100
Los mantenedores suelen responder en 1 día
-
ai_p2 comp-dictionary
Dificultad 2/5 1-3 horas Aptitud para principiantes 78/100
ClickHouse/ClickHouse#127261 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 82/100
NVIDIA-Omniverse/usd-brep#23 ·
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 68/100
qbittorrent/qBittorrent#25121 ·
Los mantenedores suelen responder en 2 días