A crash-looping ingester is invisible
Los mantenedores suelen responder en 1 día
@Notdayo ya está trabajando en esto.
Desde el 16/10/2026.
Evaluación
Este issue todavía no se ha evaluado.
Descripción
Background
src/index.ts restarts a crashed ingester like this:
const restartIngester = (name: string, network: NetworkName, fn: () => Promise<void>) => {
fn().catch(err => {
console.error(`[lens] ${name}/${network} ingester crashed, restarting in 10s:`, err.message)
setTimeout(() => restartIngester(name, network, fn), 10_000)
})
}
The fault isolation is good and the comment above it explains the design well.
What is missing is any awareness of how often this happens. An ingester that
crashes immediately on start will restart every ten seconds forever. There is no
backoff, no cap, no metric, and /status does not mention it — so the service
reports itself healthy while one venue has produced nothing for a week.
What to build
- Exponential backoff with a ceiling, instead of a flat ten seconds.
- A counter metric of restarts, labelled by ingester name and network, exported
through the existingprom-clientregistry insrc/metrics.ts. - A record of the last crash — time and message — per
(ingester, network), so
L167 can surface it on/status. - Reset the backoff once an ingester has run healthily for some period, so a
nightly blip does not permanently slow restarts.
Acceptance criteria
- Restart delay grows on repeated failure and is capped
- Backoff resets after a sustained healthy run
- A Prometheus counter exposes restarts per ingester and network
- Last crash time and message are retrievable per ingester
- The existing fault isolation is preserved — one venue crashing still cannot affect another
Drips Wave · Complexity: Intermediate · 150 points
Repo: Divinity-Labs/Lens. Node + TypeScript, Fastify, Prisma on Postgres,
Redis for queues, Prometheus via prom-client.
Run the tests: npm test. The tests are vitest, not jest. Running jest
against this repo reports "66 suites, 0 tests" and means nothing. A single file
is npx vitest run src/__tests__/yourfile.test.ts.
Load test (prices) is already failing on main and has been for some
time. It is not your PR that broke it. Every other check should be green.
This service prices real assets on Stellar mainnet. A number that is wrong
is worse than a number that is missing, because a caller cannot tell the
difference. Prefer failing loudly over returning a plausible value.
Never elide an address, a contract id or a key in code, a comment or a test
fixture. A previous batch wrote a shortened contract id in an issue text and
five contributors invented plausible-looking ids to fill the gap. Write the
whole thing or do not write it at all.
The house pattern for an outbound deadline already exists — see
src/alerts/delivery.ts, which passes signal: AbortSignal.timeout(10_000) to
fetch. Where an issue below asks for a timeout, copy that, do not invent a
second convention.
Required: Before submitting, join the contributor Telegram so your work can be tracked and counted toward the Stellar Wave: https://t.me/+fxHXq8f1SwlkZDBk
- Lenguaje dominante
- TypeScript
- Estrellas
- 4
- Forks
- 71
- Merge medio
- 1 d 15 h
- PR fusionados (30 d)
- 28
Preparar el entorno
- Incluye un Dockerfile o un archivo de Docker Compose
- Tiene una plantilla de pull request
- Leer la guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de Divinity-Labs/Lens
-
area:reliability difficulty:easy help wanted points:100 Stellar Wave
Dificultad 2/5 1-3 horas Aptitud para principiantes 80/100
Divinity-Labs/Lens#341 · 1 comentario ·
Los mantenedores suelen responder en 1 día
-
Startup does not verify the database schema matches the codePosiblemente ocupada @titankrypt-gif la tomó hoy. Abiertoarea:database difficulty:advanced help wanted points:200 Stellar Wave
Divinity-Labs/Lens#352 · 3 comentarios · 1 asignado ·
Los mantenedores suelen responder en 1 día
-
Ingester loops have no upper bound on a single cyclePosiblemente ocupada @felixumeh la tomó hoy. Abiertoarea:ingest difficulty:intermediate help wanted points:150 Stellar Wave
Divinity-Labs/Lens#351 · 4 comentarios · 1 asignado ·
Los mantenedores suelen responder en 1 día
-
There is no runbook for the servicePosiblemente ocupada @felixumeh la tomó hoy. Abiertoarea:docs difficulty:easy help wanted points:100 Stellar Wave
Divinity-Labs/Lens#350 · 2 comentarios · 1 asignado ·
Los mantenedores suelen responder en 1 día
-
The MCP server's upstream call has no deadline and no error handlingPosiblemente ocupada @Wittig18 la tomó hoy. Abiertoarea:mcp difficulty:easy help wanted points:100 Stellar Wave
Divinity-Labs/Lens#349 · 2 comentarios · 1 asignado ·
Los mantenedores suelen responder en 1 día
Todos los issues de Divinity-Labs/Lens
Issues similares
-
Dificultad 1/5 Menos de una hora Aptitud para principiantes 83/100
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 72/100
ranxianglei/billion-context#3583 ·
Los mantenedores suelen responder en 1 día
-
bug:new
Dificultad 2/5 1-3 horas Aptitud para principiantes 76/100
callstackincubator/simlock#673 ·
Los mantenedores suelen responder en 1 día
-
documentation v3
Dificultad 2/5 1-3 horas Aptitud para principiantes 73/100
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 73/100
anomalyco/opencode#56380 · 1 comentario ·
Los mantenedores suelen responder en 1 día