nteract/papermill

Huge notebook sizes with keplergl-jupyter

Open

#802 aberto em 7 de ago. de 2024

Ver no GitHub
 (1 comment) (0 reactions) (0 assignees)Python (402 forks)batch import
enhancementhelp wanted

Métricas do repositório

Stars
 (5.381 stars)
Métricas de merge de PR
 (Nenhuma PRs mesclada em 30d)

Description

🚀 Feature

I'm using papermill to generate KeplerGL HTML files. Papermill seems to persist all the inner states of the kepler map.

kepler_map = KeplerGl(height=700)
kepler_map.config = KEPLER_CONFIG
kepler_map.add_data(data=data, name="data")
kepler_map.save_to_html(file_name = 'kepler.html', read_only=False)

Inspecting the .ipynb file generated by papermill I see this:

 "metadata": {
...
"453e3a2bf8594314abd4080df83485c3": {
      "model_module": "keplergl-jupyter",
      "model_module_version": "^0.3.2",
      "model_name": "KeplerGlModal",
      "state": {
       "_dom_classes": [],
       "_model_module": "keplergl-jupyter",
       "_model_module_version": "^0.3.2",
       "_model_name": "KeplerGlModal",
       "_view_count": null,
       "_view_module": "keplergl-jupyter",
       "_view_module_version": "^0.3.2",
       "_view_name": "KeplerGlView",
...
      "layers": [
...

which basically stores all of the kepler data again.

Motivation

It would be great if I could tell papermill to not store all of the metadata to prevent storing unnecessary data - in some cases GBs.

Guia do colaborador