A-pythonarrowenhancementhelp wantedrust
Repository-Metriken
- Stars
- (6.582 Stars)
- PR-Merge-Metriken
- (Durchschn. Merge 6T 1h) (219 gemergte PRs in 30 T)
Beschreibung
edit: use arrow::extension::FixedShapeTensorType
https://arrow.apache.org/docs/dev/format/CanonicalExtensions.html#fixed-shape-tensor-extension
Problem
In arrow, Tensors do not have corresponding Array type, as it can not be used to store in a Table / Dataset / RecordBatch.
To support ML datasets, it is desirable to have tensors stored within the datasets.
Desired Behavior
To support parametrized Tensors in a Table / Datasets. A TensorArray and TensorType should allow parameters, i.e., shade, data type (i.e., bid_width) and etc.
class TensorType {
TensorType(data_type, shade, ...)
}