Dedicated queue version

Open
#37 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
15/100
Issue type
Feature
Clarity
Needs clarification
Activity status
Stale
Tech stack
python, rust
Domain
backend, distributed-systems

Research direction

The issue describes a proposed Python queue server and benchmark runner, including webhook handling, persistent queuing, polling, subprocess execution, and update delivery, but names no files or tests. Start by reviewing the repository's current benchmark entry points and architecture; done would require an agreed design and implementation of both separated services.

Written by the indexing model from the issue text.

Description

Switch to Python for more maintainers.

Separate queue server and benchmark runner.

Queue server

Two parts: webhook server and persistent queue.

  1. webhook server accepts webhook request
  2. transforms certain ones into event on persistent queue
  3. from time to time checks for updates and potentially apply them¹

in order for the updates to be applied without losing requests, maybe put a load balancer or something like that in front of the webhook server

Benchmark runner

The benchmark runner should be a simple loop that executes the following steps

  1. check for and potentially apply update¹ for step 3.
  2. poll queue server. if event is available, execute step 3, else sleep then goto 1
  3. handle event using a subprocess that potentially got updated in step 1
  4. goto 1

¹E.g. we could use something like TUF / TUFup to check for and download updates

Dominant language
Rust
Stars
4
Forks
0
Avg merge
5h 52m
Merged PRs (30d)
4

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from scverse/benchmark

All issues in scverse/benchmark

Similar issues

More Rust issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.