Some, but not all scripts report "load time" for stateless engines (time to download parquet and sync)
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 45/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Quiet
- Tech stack
- shell
- Domain
- data-engineering, databases
Research direction
Start with the linked datafusion-partitioned/results/20260511/c6a.4xlarge.json file and review the load_time addition from commit 6d5ee0a and pull request #860. Compare how the stateless-engine scripts report load time, clarify whether raw Parquet download and fsync belong in the measure, and consider the work complete when reporting is consistent across those engines.
Written by the indexing model from the issue text.
Description
While reviewing recent DataFusion results, I found there is now a "load time" reported for DataFusion
For example, this link
Here is the source file that has 17:
https://github.com/ClickHouse/ClickBench/blob/a377499b950b17b2d96b79625375d57b18a36634/datafusion-partitioned/results/20260511/c6a.4xlarge.json#L10
It was added in https://github.com/ClickHouse/ClickBench/commit/6d5ee0a68573bbb481fdb8f799cc3348a9bb0634 which was part of a large refactoring in https://github.com/ClickHouse/ClickBench/pull/860
I am not sure if you intended the load_time to include the download / fsync time for the raw parquet dataset, but if you did I would request that we measure it consistently across stateless engines
- Dominant language
- Shell
- Stars
- 1.1k
- Forks
- 328
- Avg merge
- 4h 12m
- Merged PRs (30d)
- 605
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- No contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from ClickHouse/ClickBench
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
ClickHouse/ClickBench#2650 ·
Maintainers usually reply within 1 day
-
Difficulty 3/5 1-2 days Newbie friendliness 48/100
ClickHouse/ClickBench#2425 ·
Maintainers usually reply within 1 day
-
doris-parquet-single fails before measurement on c6a.xlarge: FE cannot commit its 8 GiB initial heapOpen
Difficulty 4/5 3-5 days Newbie friendliness 35/100
ClickHouse/ClickBench#2208 · 2 comments ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 55/100
ClickHouse/ClickBench#2146 · 1 comment ·
Maintainers usually reply within 1 day
-
ClickBench+Possibly taken @4ertus2 claimed this 75 days ago. Open
Difficulty 5/5 Over a week Newbie friendliness 25/100
ClickHouse/ClickBench#1488 ·
Maintainers usually reply within 1 day
All issues in ClickHouse/ClickBench
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
leanprover-community/lean4game#589 ·
Maintainers usually reply within 2 days
-
Screensaver ignores mouse movement — cursor stays invisible until keyboard input or lock/unlockOpen
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
Maintainers usually reply within 1 day
-
agent-ready priority: medium status: ready work-class: scoped
Difficulty 1/5 Under an hour Newbie friendliness 75/100
melodic-software/claude-code-plugins#12762 ·
Maintainers usually reply within 1 day
-
examples/dnsdoctor: cleanup.sh stops at the first missing piece of a setup.sh that did not finishOpenseverity: low
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
luainkernel/lunatik#2263 ·
Maintainers usually reply within 1 day
-
Statusline crashes on Windows: Admission lock invariants hard-code '/' separatorPossibly taken A pull request linked to this issue is open or already merged. Open
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
danielmiessler/LifeOS#2567 ·
Maintainers usually reply within 9 days