A-pythonarrowenhancementhelp wantedrust
Métricas do repositório
- Stars
- (6.582 stars)
- Métricas de merge de PR
- (Mesclagem média 6d 1h) (219 fundiu PRs em 30d)
Description
edit: use arrow::extension::FixedShapeTensorType
https://arrow.apache.org/docs/dev/format/CanonicalExtensions.html#fixed-shape-tensor-extension
Problem
In arrow, Tensors do not have corresponding Array type, as it can not be used to store in a Table / Dataset / RecordBatch.
To support ML datasets, it is desirable to have tensors stored within the datasets.
Desired Behavior
To support parametrized Tensors in a Table / Datasets. A TensorArray and TensorType should allow parameters, i.e., shade, data type (i.e., bid_width) and etc.
class TensorType {
TensorType(data_type, shade, ...)
}