File and column descriptions from dataset-metadata.json are still not saved (after #1055)

Abierto
#1,207 0 comentarios 1 reacción 0 asignados Ver en GitHub

Los mantenedores suelen responder en 1 día

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
4/5
Tiempo estimado
3-5 días
Aptitud para principiantes
45/100
Tipo de issue
Error
Claridad
Bastante claro
Estado de actividad
Activo
Stack tecnológico
python
Área
api, backend

Línea de trabajo

Start with docs/datasets_metadata.md and trace datasets create, datasets version, and metadata --update through DatasetApiService.UpdateDatasetMetadata. Reproduce with the supplied dataset-metadata.json, inspect GetDatasetMetadata, and verify that file and column descriptions survive each command and appear in the Data Explorer.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

bug dependencies

Summary

File and column descriptions in dataset-metadata.json are accepted without error but never saved. This happens on datasets create, datasets version and datasets metadata --update. #447 and #248 were closed by #1055, but that PR changed only how the CLI builds the request. The server still drops the descriptions. Descriptions entered in the web editor are saved as expected.

The documentation says this should work:

  • docs/datasets_metadata.md lists resources (with path, description and schema.fields[].description) as supported for kaggle datasets create and kaggle datasets version.
  • The same page says kaggle datasets metadata --update "supports all fields mentioned above for kaggle datasets version".

Environment

  • kaggle 2.2.4, kagglesdk 0.1.37
  • Python 3.14.3, Ubuntu (GitHub Actions ubuntu-latest)
  • Authenticated with KAGGLE_API_TOKEN

Steps to reproduce

  1. Make a folder with data.csv:

    year,category,grants
    1977-78,Refugee,9326
    1978-79,Refugee,12750
    
  2. Add dataset-metadata.json beside it, following the documented format:

    {
      "title": "Metadata description test",
      "id": "<your-username>/metadata-description-test",
      "licenses": [{"name": "CC0-1.0"}],
      "resources": [
        {
          "path": "data.csv",
          "description": "Rows of the table, as CSV.",
          "schema": {
            "fields": [
              {"name": "year", "description": "Financial year.", "type": "string"},
              {"name": "category", "description": "Visa category.", "type": "string"},
              {"name": "grants", "description": "Visas granted.", "type": "number"}
            ]
          }
        }
      ]
    }
    
  3. Create the dataset, wait until it is ready, then upload the same files as a new version:

    kaggle datasets create -p . -u
    kaggle datasets status <your-username>/metadata-description-test   # until "ready"
    kaggle datasets version -p . -m "second version with the same resources"
    
  4. Send the same file again as a metadata update:

    kaggle datasets metadata <your-username>/metadata-description-test --update -p .
    
  5. Open the dataset page and select data.csv in the Data Explorer.

Expected

"About this file" shows "Rows of the table, as CSV.", and each column shows its description. The usability rating ticks File Description and Column Description.

Actual

  • "About this file" says "This file does not have a description yet", and no column has a description.
  • The usability rating still crosses File Description and Column Description.
  • Every command exits 0. metadata --update prints "successfully updated dataset metadata".
  • The other fields in the same update are saved: keywords, expectedUpdateFrequency, userSpecifiedSources and the cover image.

What else we tried

All of these were accepted with an empty errors list, and none changed the page:

  • resources with the documented types (string, number, datetime), and with integer.
  • Calling DatasetApiService.UpdateDatasetMetadata through kagglesdk directly, with settings.data set to DatasetSettingsFile entries in four forms: description only; description and totalBytes; those plus columns; and all three files of the dataset.
  • Three dataset versions uploaded with resources present (create once, then version twice).

GetDatasetMetadata returns info.data as an empty list after each update, as #410 also notes.

Example

A public dataset that shows the problem: https://www.kaggle.com/datasets/nationaldigitalau/au-humanitarian-program-grants. Version 3 was uploaded with resources for all three files and then sent the same settings through metadata --update.

Lenguaje dominante
Python
Estrellas
7.7k
Forks
1.5k
Merge medio
1 d 6 h
PR fusionados (30 d)
17

Preparar el entorno

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de Kaggle/kaggle-cli

Todos los issues de Kaggle/kaggle-cli

Issues similares

Más issues de Python

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.