A-pythonarrowenhancementhelp wantedrust
Métriques du dépôt
- Stars
- (6 582 stars)
- Métriques de merge PR
- (Merge moyen 6j 1h) (219 PRs mergées en 30 j)
Description
edit: use arrow::extension::FixedShapeTensorType
https://arrow.apache.org/docs/dev/format/CanonicalExtensions.html#fixed-shape-tensor-extension
Problem
In arrow, Tensors do not have corresponding Array type, as it can not be used to store in a Table / Dataset / RecordBatch.
To support ML datasets, it is desirable to have tensors stored within the datasets.
Desired Behavior
To support parametrized Tensors in a Table / Datasets. A TensorArray and TensorType should allow parameters, i.e., shade, data type (i.e., bid_width) and etc.
class TensorType {
TensorType(data_type, shade, ...)
}