[VL] Move lance-spark off the 0.9.0 beta before the next Gluten release

Open
#13,527 0 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 3 days

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
1-2 days
Newbie friendliness
45/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Active
Tech stack
scala, spark

Research direction

Read the version change in #13515 and the linked lance-spark release notes for the official release that includes the required APIs and Lance 14.0 support. Update the lance-spark and lance-core versions before the next Gluten release, then rerun the Lance suites against them. Done when the project uses the official release and those suites pass.

Written by the indexing model from the issue text.

Description

#13515 bumps lance.version to lance-spark 0.9.0-beta.2, since that's the first release with the APIs the native Lance writer needs (lance-format/lance-spark#715 and lance-format/lance-spark#892).

We don't want to ship a Gluten release on a beta, so this is a reminder to move to lance-spark's next official release before then. lance-spark is planning that release together with Lance 14.0 support, so lance-core will move too and we'll want to rerun the Lance suites against it.

Came up in the review of #13515: https://github.com/apache/gluten/pull/13515#pullrequestreview-5748135535

Dominant language
Scala
Stars
1.6k
Forks
685
Avg merge
4d 16h
Merged PRs (30d)
84

Getting set up

Open in Codespaces

Starts the project's dev container in your browser, under your own GitHub account.

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from apache/gluten

All issues in apache/gluten

Similar issues

More Scala issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.