[QUESTION] Sharing a Python cudf, or better, dask-cudf?

这是一个设计问题，而不是范围明确的实现任务；没有指定文件或测试。首先检查此处所述的 RMM/UCX CUDA IPC 路径以及 Python cudf 到 Node.js 的边界，然后定义一个最小的 cudf IPC 读取路径及其验证，再处理 dask-cudf 或已发布的数据集。

Hi @trxcllnt & team!

Curious if any pointers on this. Ultimately, we're trying to setup a basic ~LRU over Python-managed dask-cudf objects (raw ddf or published) and have node do reads+writes with it. That's probably too big a leap for now, but I'm wondering if we can do something in the near term by scoping down to just CUDA IPC + cudf, or something similar?

Ultimate ideal case: multi-gpu dask

Ideally for the read direction, for example:

Dask-based Python publish:

ddf = dask.dataframe....
client.persist(ddf)
client.publish_dataset(xyz=ddf)

Dask-based JS load:

var ddf = nodeDaskCudf.getDataset('xyz'); // does not exist
var gdf = ddf.compute(); // does not exist
var arr = ddf.toArrow();

Near-term workaround via cudf + CUDA IPC

So I'm wondering: If we scoped down to python cudf <> node cudf, would this become doable, say via CUDA IPC?

Ex: Read direction

Python cudf pointer publish:

ddf = dask.dataframe....
gdf = client.compute(ddf)
handle : str = gdf.get_ipc_handle() # RMM / UCX basically do this already afaict
request.post(f'/nodejs/?handle={handle})

JS cudf readback:

function cb(handle) {
   var gdf = cudf.fromIPCHandle(handle); // ???
   var arr = gdf.toArrow();
}