OnceMap and singleflight leak an entry when a duplicate key's destructor panics
Los mantenedores suelen responder en 1 día
Nadie ha tomado este issue todavía.
Evaluación
- Dificultad
- 4/5
- Tiempo estimado
- 1-2 días
- Aptitud para principiantes
- 55/100
Línea de trabajo
Start with asyncband/src/once/once_map/mod.rs around get_or_insert and the pending-entry cleanup guard, then inspect asyncband/src/singleflight/mod.rs around get_or_insert and WorkCleanupGuard::new. Reproduce the panic cases described in the issue and trace what happens on pending and cached paths. Done means both APIs clean up correctly after a duplicate key's destructor panics, including cancellation during the drop.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
Summary
While working on #387 I found another way OnceMap can keep an empty entry. When compute or try_compute joins a computation that is already running for the key, the caller's own key is no longer needed and is dropped. If that destructor panics and the panic is caught, for example by tokio::spawn, the caller's reference to the entry leaks. Once the original computation is cancelled or fails, the empty entry stays in the map for good. singleflight::Group::work and try_work have the same problem.
Reproducer
On main (8febdc7, Rust 1.96.0) this prints OnceMap { len: 1, pending: 1 }, and the same program with singleflight::Group::work prints Group { in_flight: 1 }. Both are empty when the destructor doesn't panic.
use std::future::pending;
use std::hash::{Hash, Hasher};
use std::panic::{AssertUnwindSafe, catch_unwind};
use std::pin::pin;
use std::task::{Context, Waker};
use asyncband::once::OnceMap;
struct Key(&'static str, bool);
impl PartialEq for Key {
fn eq(&self, other: &Self) -> bool {
self.0 == other.0
}
}
impl Eq for Key {}
impl Hash for Key {
fn hash<H: Hasher>(&self, state: &mut H) {
self.0.hash(state);
}
}
impl Drop for Key {
fn drop(&mut self) {
if self.1 {
panic!("key destructor");
}
}
}
fn main() {
let mut cx = Context::from_waker(Waker::noop());
let map = OnceMap::<Key, i32>::new();
let mut original = Box::pin(map.compute(Key("k", false), async || pending().await));
assert!(original.as_mut().poll(&mut cx).is_pending());
let joined = catch_unwind(AssertUnwindSafe(|| {
let _ = pin!(map.compute(Key("k", true), async || pending().await)).poll(&mut cx);
}));
assert!(joined.is_err());
drop(original);
println!("{map:?}");
}
The leaked reference also keeps later values alive: if the key is computed again and then discarded, the value is never dropped. On a cached hit, the value clone that compute was about to return leaks instead.
Cause
The duplicate key is a parameter of get_or_insert (OnceMap, singleflight), so it is dropped when the function returns. If that destructor panics, Rust doesn't drop the value being returned (rust-lang/rust#47949, open since 2018), so the entry's Arc, or the cloned value on a cached hit, leaks. Even if it were dropped, no cleanup would run, because the guard is only created after get_or_insert returns. On OnceMap, making the drop explicit without moving the guard removes the permanent leak, but a cancellation that lands while the destructor runs still leaves an empty entry.
Possible fix
Drop the duplicate key explicitly, after creating the cleanup guard for a pending entry or cloning the value for a ready one. I tried this on OnceMap by having get_or_insert return either the value or the guard. Nothing leaks in the cases above, and the cached hit path still doesn't build a guard. singleflight would need the same change around WorkCleanupGuard::new.
Panicking destructors are unusual, so documenting the leak is also an option. I'd prefer to fix both, since the change is small. @tisonkun What do you think?
- Lenguaje dominante
- Rust
- Estrellas
- 285
- Forks
- 49
- Merge medio
- 1 d 1 h
- PR fusionados (30 d)
- 33
Preparar el entorno
Este proyecto no incluye contenedor de desarrollo, Dockerfile ni guía de contribución, así que la configuración corre por tu cuenta: empieza por su README y consulta nuestra guía para la primera contribución para los pasos generales.
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de apache/asyncband
-
Dificultad 3/5 1-2 días Aptitud para principiantes 57/100
Los mantenedores suelen responder en 1 día
-
enhancement good first issue help wanted
Dificultad 5/5 Más de una semana Aptitud para principiantes 35/100
apache/asyncband#324 · 1 comentario ·
Los mantenedores suelen responder en 1 día
-
Discuss shared broadcast receives without a Clone boundPosiblemente ocupada @orthur2 la tomó hace 18 días. Abiertoenhancement question
Dificultad 5/5 Más de una semana Aptitud para principiantes 30/100
apache/asyncband#312 · 5 comentarios ·
Los mantenedores suelen responder en 1 día
-
enhancement help wanted
Dificultad 5/5 Más de una semana Aptitud para principiantes 35/100
apache/asyncband#298 · 8 comentarios ·
Los mantenedores suelen responder en 1 día
-
Dificultad 5/5 Más de una semana Aptitud para principiantes 30/100
apache/asyncband#272 · 2 comentarios ·
Los mantenedores suelen responder en 1 día
Todos los issues de apache/asyncband
Issues similares
-
bug
Dificultad 2/5 1-3 horas Aptitud para principiantes 78/100
swc-project/swc-next#1165 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 73/100
Alive24/shea-symphony#574 ·
-
bug tests Windows
Dificultad 2/5 1-3 horas Aptitud para principiantes 78/100
Los mantenedores suelen responder en 1 día
-
[ko] Translate /team into KoreanAbiertodocumentation good first issue help wanted
Dificultad 2/5 1-3 horas Aptitud para principiantes 74/100
dev-five-git/devup-ui#879 ·
Los mantenedores suelen responder en 11 días
-
bug
Dificultad 2/5 1-3 horas Aptitud para principiantes 77/100
farion1231/cc-switch#9038 · 1 comentario ·
Los mantenedores suelen responder en 1 día