Ballista 56.0.0 Release

Open
#2,872 1 comment 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
20/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Active
Tech stack
python, rust
Domain
release

Research direction

Read the linked issues and pull requests listed under each release section to understand what must land for Ballista 56.0.0; the release tasks also call for a workspace version bump and a Python bindings update. Start by checking the status of the listed blockers and the release process, then confirm the required items are complete before closing out the release.

Written by the indexing model from the issue text.

Description

Ballista 56.0.0 is close to release. Let's use this issue to track the work that should land first.

Please comment on this issue if there are issues or PRs that you feel should be included, and I can add them to the list below.

Ready to merge
  • #2871 sort-shuffle header read through its own file handle (approved, CI green)
  • #2826 final stage's schema for adaptive Flight SQL jobs (approved, rebased on main, CI pending)
Wrong results
  • #2874 keep a sort-merge join's embedded projection in the adaptive planner (release blocker, fixes #2873, needs review)
  • #2848 run nested-loop joins that emit build rows in one task (approved, pending upgrade note)
  • #2852 restrict a leaf a task runs none of to an empty leaf (changes requested)
Hangs
  • #2837 keep an empty exchange whose parent needs hash partitioning (approved)
  • #2860 fail jobs whose executor-loss rollback fails instead of hanging them (approved)
  • #2698 reset unlaunched tasks when executor metadata is missing (changes requested: test fails on current main)
Release notes
  • #2867 fail push-staged jobs with the task preparation error. This also corrects the 56.0.0 upgrade note (code looks good, waiting on an upgrade-note sentence)
Nice to have
  • #2845 count buffers shared by sliced batches once in BufferExec (in review)
  • #2803 reserve the sort-shuffle writer's encoded output (looks good, needs rebase)
  • #2780 stop the shuffle write of a cancelled task (looks good, needs rebase and a quick benchmark)
  • #2862 typed SessionConfigExt setter and getter for the execution mode (approved, in merge queue)
Release tasks
  • Bump the workspace version to 56.0.0
  • Update Python bindings to 56.0.0
Dominant language
Rust
Stars
2.2k
Forks
348
Avg merge
2d 4h
Merged PRs (30d)
166

Getting set up

Open in Codespaces

Starts the project's dev container in your browser, under your own GitHub account.

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from apache/datafusion-ballista

All issues in apache/datafusion-ballista

Similar issues

More Rust issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.