cube-js/cube

Dremio: Add support for Arrow Flight JDBC driver

Open

#8,829 建立於 2024年10月17日

在 GitHub 查看
 (2 留言) (0 反應) (0 負責人)Rust (19,563 star) (1,965 fork)batch import
driver:dremiohelp wanted

描述

Is your feature request related to a problem? Please describe.

We currently use Dremio as our backend and while the RESTful driver provided by the community works, the Arrow Flight JDBC driver should be significantly more performant especially with larger volumes of data

Describe the solution you'd like

Extend the jdbc cube driver to use org.apache.arrow.driver.jdbc.ArrowFlightJdbcDriver

Describe alternatives you've considered

A possible alternative is creating another bespoke Dremio driver that calls Dremio using the Flight RPC protocol directly, rather than using the JDBC wrapper. I think this is possible in node - there's a wrapper that calls to an implementation in Rust, iirc

貢獻者指南

技術棧
javarust
領域
backenddatabase
議題類型
feature
難度面向新貢獻者的預計實作難度，1 表示很小改動，5 表示專家級工作。
3
預計時間有經驗貢獻者完成調查、實作、測試並準備 pull request 的粗略時間範圍。
3-5 days
活動狀態議題目前的可參與程度：新鮮、活躍、陳舊、阻塞或等待維護者輸入。
fresh
清晰度議題是否清楚說明預期改動、驗收標準和下一步。
clear
前置要求
JDBC knowledgeCube driver architectureArrow Flight basics
新手友善度1-100 的估計分數，表示該議題對首次貢獻者的友善程度。
35
研究方向
Begin by examining Cube's existing JDBC driver implementation in the codebase, likely in packages/cubejs backend jdbc. Then research the Arrow Flight JDBC driver's API and how to configure it in Cube's driver abstraction. The issue suggests extending the existing JDBC driver to use ArrowFlightJdbcDriver, so you'll need to understand how Cube's drivers handle connection strings and class loading. Check any comments in the issue for further guidance.