vaexio/vaex

[FEATURE-REQUEST] Support for more special charcters in column names

Open

#1,255 opened on Mar 14, 2021

View on GitHub
 (3 comments) (0 reactions) (0 assignees)Python (591 forks)batch import
help wanted

Repository metrics

Stars
 (8,117 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

Based on the issue https://github.com/vaexio/vaex/issues/1254 I would like to file a feature-request in which the naming of the columns is checked before a hdf5 file is exported. In short, if you have special signs in you columns like [ ] ( ) * and so on, Vaex is able to write the dataframe to the disk in hdf5 format. Vaex will not be able to open it however. Considering that this issue is presented in retrospect, when loading the file, I would prefer to have explicit error-messaging when writing the file to disk.

Contributor guide

Research direction
Implement validation for special characters in column names before writing to HDF5. Add explicit error messages when invalid characters like [ ] ( ) * are detected, preventing export and informing the user.
Tech stack
python
Domain
data
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
Python
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
70