`timed_thread_context`: an operation stopped just before the context is destroyed never completes
Maintainer antworten meist innerhalb von 1 Tag
Bewertung
- Schwierigkeit
- 4/5
- Geschätzter Aufwand
- 3-5 Tage
- Anfängerfreundlichkeit
- 20/100
Rechercherichtung
The bug is in timed_thread_context::run() in the timed thread scheduler header that the reproducer includes (exec/timed_thread_scheduler.hpp). Read the loop that drains command_queue_ and the stop branch that closes submissions and calls set_stopped_() on the heap. Build the reproducer, which should report 1000 of 1000 lost completions. Done means every operation completes exactly once after a stop request races with destruction. Linked PR #2335 already proposes a fix, so check it before starting.
Vom Indexierungsmodell aus dem Issue-Text verfasst.
Beschreibung
Summary
When timed_thread_context::run() sees stop_requested_, it closes submissions, stops the operations in the heap and exits, without draining command_queue_ again:
while (true) {
while (command_type* op = command_queue_.pop_front()) { ... } // the only drain
...
cv_.wait_until(lock, deadline, [this] { return ready_ || stop_requested_; });
if (stop_requested) {
// close submissions (CAS n_submissions_in_flight_ to context_closed)
// set_stopped_() on every operation in heap_
break; // commands pushed since the drain above are never processed
}
}
A stop request from another thread raises the operation's ref_count_ from 1 to 2 and queues a stop command. If the context is destroyed before its thread drains that command, the heap pass only drops the count to 1. The stop command, which would drop it to 0 and call set_stopped, is never processed. So the receiver gets neither set_value nor set_stopped, and anything waiting on it (sync_wait, async_scope::on_empty(), ...) hangs.
A schedule command queued after the last drain is lost the same way: it is never inserted into the heap, so the heap pass doesn't stop it.
This breaks the context's own shutdown guarantee: the destructor stops the operations in the heap, and submissions made after close complete inline with set_stopped.
It seems that the current behavior violates https://eel.is/c++draft/exec.async.ops#8: “After its start operation has begun executing, exactly one completion operation shall execute.”
Reproducer
#include <exec/timed_thread_scheduler.hpp>
#include <stdexec/execution.hpp>
#include <atomic>
#include <chrono>
#include <cstdio>
#include <optional>
#include <thread>
namespace ex = STDEXEC;
struct env {
ex::inplace_stop_token token;
auto query(ex::get_stop_token_t) const noexcept { return token; }
};
struct receiver {
using receiver_concept = ex::receiver_tag;
std::atomic<int>* completed;
ex::inplace_stop_token token;
void set_value() noexcept { completed->store(1); }
void set_stopped() noexcept { completed->store(2); }
env get_env() const noexcept { return {token}; }
};
int main() {
int lost = 0;
const int runs = 1000;
for (int i = 0; i < runs; ++i) {
std::atomic<int> completed{0};
ex::inplace_stop_source source;
std::optional<exec::timed_thread_context> ctx{std::in_place};
auto op = ex::connect(exec::schedule_after(ctx->get_scheduler(), std::chrono::hours(1)),
receiver{&completed, source.get_token()});
ex::start(op);
std::this_thread::sleep_for(std::chrono::microseconds(200)); // the operation reaches the heap
source.request_stop(); // queues a stop command
ctx.reset(); // request_stop() + join, usually before the thread drains the command
if (completed.load() == 0) { // the thread has exited, so nothing will ever complete it
++lost;
}
}
std::printf("receiver never completed in %d of %d runs\n", lost, runs);
return lost == 0 ? 0 : 1;
}
The output will be: receiver never completed in 1000 of 1000 runs. It should be 0 of 1000.
Suggested fix: https://github.com/NVIDIA/stdexec/pull/2335
- Vorherrschende Sprache
- C++
- Sterne
- 2.5k
- Forks
- 276
- Ø Merge
- 1 T. 13 Std.
- Gemergte PRs (30 T.)
- 62
Entwicklungsumgebung
Dieses Projekt bietet weder Dev-Container noch Dockerfile noch Beitragsleitfaden – die Einrichtung liegt bei Ihnen. Beginnen Sie mit der README; die allgemeinen Schritte stehen in unserem Leitfaden für den ersten Beitrag.
Erste Schritte
- Lesen Sie das ganze Issue und danach den Beitragsleitfaden des Projekts.
- Schreiben Sie ins Issue, dass Sie es übernehmen — das erspart doppelte Arbeit.
- Forken Sie das Repository und arbeiten Sie in einem Branch.
- Öffnen Sie einen Pull Request, der die Issue-Nummer nennt.
Mehr aus NVIDIA/stdexec
-
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 68/100
NVIDIA/stdexec#1751 · 2 Kommentare ·
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 3/5 1-2 Tage Anfängerfreundlichkeit 54/100
Maintainer antworten meist innerhalb von 1 Tag
-
continues_on: hop opstate not connected with secondary environmentEvtl. vergeben @ericniebler hat das vor 24 Tagen übernommen. Offen
Schwierigkeit 4/5 3-5 Tage Anfängerfreundlichkeit 45/100
NVIDIA/stdexec#2268 · 4 Kommentare ·
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 4/5 3-5 Tage Anfängerfreundlichkeit 48/100
NVIDIA/stdexec#2240 · 5 Kommentare ·
Maintainer antworten meist innerhalb von 1 Tag
-
Schwierigkeit 4/5 3-5 Tage Anfängerfreundlichkeit 65/100
NVIDIA/stdexec#2230 · 2 Kommentare ·
Maintainer antworten meist innerhalb von 1 Tag
Ähnliche Issues
-
bug
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 74/100
Maintainer antworten meist innerhalb von 1 Tag
-
Ctrl-C can abort a node: the state timer asks for the node names after shutdownEvtl. vergeben @fmrico hat das heute übernommen. Offenbug
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 72/100
fmrico/cascade_lifecycle#24 ·
-
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 70/100
-
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 74/100
Deltakit/deltakit-stim#52 ·
-
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 74/100
Maintainer antworten meist innerhalb von 1 Tag