Schema datatype alignment across ibis backends
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 25/100
Research direction
The issue does not name files, tests, or entry points. Start by comparing the datatype representations returned through Ibis for DuckDB and Spark, focusing on capitalization and array types. Done should mean a defined, consistent datatype representation that pointblank can use across both backends.
Written by the indexing model from the issue text.
Description
Prework
- Read and agree to the code of conduct and contributing guidelines.
- If there is already a relevant issue, whether open or closed, comment on the existing thread instead of posting a new issue.
Question
What would you like to know?
- Is there a way or could you implement a way to align datatypes across ibis backends?
- I am working on a project that uses ibis to connect to DuckDB while working locally and Spark while working in DataBricks. There are differences in capitalization and differences for array types (
List(String)vsarray<string>) depending on the backend even though the data is the same. Consistency of datatypes across backends would simplify the validation process when using ibis with pointblank.
- Dominant language
- Python
- Stars
- 493
- Forks
- 34
- Avg merge
- 13h 39m
- Merged PRs (30d)
- 16
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from posit-dev/pointblank
-
Type: ★ Enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
posit-dev/pointblank#379 ·
Maintainers usually reply within 1 day
-
Difficulty 3/5 1-2 days Newbie friendliness 48/100
posit-dev/pointblank#395 ·
Maintainers usually reply within 1 day
-
Type: ★ Enhancement
Difficulty 5/5 Over a week Newbie friendliness 35/100
posit-dev/pointblank#394 ·
Maintainers usually reply within 1 day
-
ibis.pyspark col_vals_in_set produces invalid SQLMay be free again @rich-iannone claimed this 296 days ago, and no pull request is open. OpenDifficulty: [2] Intermediate Effort: [3] High Priority: [3] High Type: ☹︎ Bug
posit-dev/pointblank#335 · 1 comment · 1 assignee ·
Maintainers usually reply within 1 day
-
YAML value column selectorMay be free again @rich-iannone claimed this 314 days ago, and no pull request is open. OpenDifficulty: [2] Intermediate Effort: [3] High Priority: [3] High Type: ☹︎ Bug
posit-dev/pointblank#333 · 1 comment · 1 assignee ·
Maintainers usually reply within 1 day
All issues in posit-dev/pointblank
Similar issues
-
Agentic
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
Imbad0202/academic-research-skills#979 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
reflex-dev/reflex#7561 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
prometheus-community/ansible#906 · 2 comments ·