rapidsai/cudf

[BUG] Loading a missing column from a Parquet file results in ArrayIndexOutOfBoundsException

Open

#11 278 ouverte le 15 juil. 2022

Voir sur GitHub
 (2 commentaires) (0 réactions) (0 assignés)C++ (735 forks)batch import
JavaPythonSparkbuggood first issue

Métriques du dépôt

Stars
 (6 000 stars)
Métriques de merge PR
 (Merge moyen 17j 21h) (230 PRs mergées en 30 j)

Description

Describe the bug Attempting to load a non-existent column from a Parquet file throws ArrayIndexOutOfBoundsException instead of a more specific error.

Steps/Code to reproduce bug Try to load a single column name that does not exist from a Parquet file. For example:

Table.readParquet(ParquetOptions.builder().includeColumn("doesnotexist").build(), new java.io.File("data.parquet"))

throws the following exception:

java.lang.ArrayIndexOutOfBoundsException: 0
  at ai.rapids.cudf.Table.<init>(Table.java:96)
  at ai.rapids.cudf.Table.readParquet(Table.java:974)
  ... 49 elided

Expected behavior A more useful error exception/message should be used than an array index error.

Guide contributeur