A-pythonarrowenhancementhelp wantedrust
Repository metrics
- Stars
- (6,582 stars)
- PR merge metrics
- (平均マージ 6d 1h) (30d で 219 merged PRs)
説明
edit: use arrow::extension::FixedShapeTensorType
https://arrow.apache.org/docs/dev/format/CanonicalExtensions.html#fixed-shape-tensor-extension
Problem
In arrow, Tensors do not have corresponding Array type, as it can not be used to store in a Table / Dataset / RecordBatch.
To support ML datasets, it is desirable to have tensors stored within the datasets.
Desired Behavior
To support parametrized Tensors in a Table / Datasets. A TensorArray and TensorType should allow parameters, i.e., shade, data type (i.e., bid_width) and etc.
class TensorType {
TensorType(data_type, shade, ...)
}