Caching example from the documentation fails in the latest version · kestra-io/kestra#8540

(13 留言) (0 反應) (1 負責人)Java (26,854 star) (2,579 fork)batch import

area/docsgood first issue

描述

Describe the issue

The Python example from the Caching section:

id: python_cached_dependencies
namespace: company.team

tasks:
  - id: working_dir
    type: io.kestra.plugin.core.flow.WorkingDirectory
    tasks:
      - id: python_script
        type: io.kestra.plugin.scripts.python.Script
        taskRunner:
          type: io.kestra.plugin.core.runner.Process
        warningOnStdErr: false
        beforeCommands:
          - python -m venv venv
          - source venv/bin/activate
          - pip install pandas
        script: |
          import pandas as pd
          print(pd.__version__)
    cache:
      patterns:
        - venv/**
      ttl: PT24H

... fails in the latest Kestra version.

The first error is due to the source binary not being available.

kestra-execution-1.log

ERROR /bin/sh: 3: source: not found

Replacing source with a dot doesn't seem to work, as the log starts showing a warning recommending to use a virtual environment.

ERROR WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

ERROR ModuleNotFoundError: No module named 'pandas'

kestra-execution-2.log

Environment

Kestra Version: 0.22.4 (Docker)

貢獻者指南

技術棧: pythonshell
領域: documentationbackend
議題類型: documentation
難度: 2
預計時間: half day
活動狀態: active
清晰度: clear
前置要求: Basic PythonUnderstanding of Kestra flows
新手友善度: 70
研究方向: The issue is that the caching example in the documentation uses 'source venv/bin/activate' which fails because the shell (likely /bin/sh) does not support 'source'. The fix should replace 'source' with '. venv/bin/activate' or adjust the command to work with /bin/sh. Additionally, the error about running pip as root suggests the virtual environment may not be activated properly. Investigate the correct sequence of commands for the Script task to ensure the virtual environment is activated before pip install. Update the documentation example accordingly and verify it works with the latest Kestra version (0.22.4) in a Docker environment.