Silent self-deadlock with SetMaxOpenConns(1) when insert hooks use the pool
Los mantenedores suelen responder en 1 día
Nadie ha tomado este issue todavía.
Evaluación
- Dificultad
- 4/5
- Tiempo estimado
- 3-5 días
- Aptitud para principiantes
- 52/100
Línea de trabajo
Start by running the provided Go reproduction with MaxOpenConns(1), then compare the client.Insert and InsertTx paths with hook and middleware execution. Review the SetMaxOpenConns guidance and relevant hook documentation before choosing a scoped direction. Done should include coverage for the deadlock scenario and a clear user-facing explanation or failure mode.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
Note: this issue was written by Claude (an AI assistant) from an investigation it ran, and @bgentry reviewed it and okayed filing it. @brandur, could you take a look?
The riversqlite package docs recommend dbPool.SetMaxOpenConns(1) to avoid SQLITE_BUSY errors from River's parallel internal operations. With that setting, two fairly natural patterns hang silently until the context deadline, or forever if the context has none. database/sql has no way to detect the self-deadlock, so the user sees no error, only a stuck insert.
1. A hook or middleware that uses the pool during a non-transactional insert. client.Insert opens its own transaction, which takes the pool's only connection, and runs insert hooks and middleware inside it. Hooks and middleware don't receive that transaction, so a hook that needs the database has to go through the pool. It then waits for the connection its own insert is holding.
2. client.Insert (instead of InsertTx) while the app holds an open transaction on the same pool. River's BEGIN waits for the connection that the app's transaction holds.
Reproduction against master (9573203e) with riversqlite and modernc.org/sqlite, a file database in WAL mode:
type poolHook struct {
river.HookDefaults
db *sql.DB
}
func (h *poolHook) InsertBegin(ctx context.Context, params *rivertype.JobInsertParams) error {
_, err := h.db.ExecContext(ctx, "SELECT 1")
return err
}
// db.SetMaxOpenConns(n); client configured with Hooks: []rivertype.Hook{&poolHook{db: db}}
ctx, cancel := context.WithTimeout(ctx, 2*time.Second)
_, err := client.Insert(ctx, someArgs{}, nil)
MaxOpenConns(1) hook uses pool during client.Insert: err=context deadline exceeded after 2.001s
MaxOpenConns(4) hook uses pool during client.Insert: err=<nil> after 1ms
MaxOpenConns(1) client.Insert while app holds a tx: err=error beginning transaction: context deadline exceeded after 2s
This isn't strictly SQLite-specific. Any database/sql or pgx pool capped at one connection behaves the same way. It mostly bites SQLite users in practice, because that's where the docs recommend a single connection.
Some possible directions, not mutually exclusive:
- Document it. Next to the
SetMaxOpenConns(1)advice, and in the hooks/middleware docs, explain that hook and middleware code runs while River holds a connection, and that app code inside its own transaction should useInsertTx. - Fail fast on re-entry. River could mark the context while it holds its own insert transaction, so a re-entrant River call on the same client returns a clear error instead of hanging. This wouldn't catch a hook calling
db.Execdirectly on the raw pool, but it would cover River-level re-entry. - Let hooks and middleware use River's transaction. Expose the insert's transaction to them, for example through the context, so they can do database work without a second connection. This is a bigger API change.
My suggestion is (1) plus (2), with (3) as a possible follow-up.
- Lenguaje dominante
- Go
- Estrellas
- 5.7k
- Forks
- 187
- Merge medio
- 1 d 11 h
- PR fusionados (30 d)
- 63
Preparar el entorno
Este proyecto no incluye contenedor de desarrollo, Dockerfile ni guía de contribución, así que la configuración corre por tu cuenta: empieza por su README y consulta nuestra guía para la primera contribución para los pasos generales.
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de riverqueue/river
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 72/100
riverqueue/river#1454 · 1 comentario ·
Los mantenedores suelen responder en 1 día
-
AddWorkerSafely leaves registered kinds after an alias collisionPosiblemente ocupada @flcrom la tomó hace 3 días. Abierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 25/100
riverqueue/river#1433 ·
Los mantenedores suelen responder en 1 día
-
Remote JobCancel() can be silently lost while the notifier is reconnecting (no durable-poll fallback)Posiblemente ocupada Un pull request vinculado a esta issue está abierto o ya se fusionó. Abierto
Dificultad 5/5 Más de una semana Aptitud para principiantes 45/100
riverqueue/river#1358 · 1 comentario ·
Los mantenedores suelen responder en 1 día
-
River job stuck at runningAbierto
Dificultad 4/5 3-5 días Aptitud para principiantes 35/100
riverqueue/river#1258 · 7 comentarios ·
Los mantenedores suelen responder en 1 día
-
Dificultad 4/5 3-5 días Aptitud para principiantes 45/100
riverqueue/river#1225 · 14 comentarios ·
Los mantenedores suelen responder en 1 día
Todos los issues de riverqueue/river
Issues similares
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 76/100
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 76/100
evilmartians/lefthook#1588 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 85/100
kubernetes-sigs/kubebuilder#6084 ·
Los mantenedores suelen responder en 3 días
-
agent-research-recommend agent-review-finding chore
Dificultad 2/5 1-3 horas Aptitud para principiantes 78/100
jordansmall/spindrift#4821 · 1 comentario ·
Los mantenedores suelen responder en 1 día
-
area:web
Dificultad 2/5 1-3 horas Aptitud para principiantes 82/100
praetorianer777/GoTome#178 ·
Los mantenedores suelen responder en 1 día