apache/airflow

Add example of dockerfile with creating new virtualenv

Closed

#26,881 opened on Oct 5, 2022

View on GitHubContributor guide
 (17 comments) (0 reactions) (0 assignees)Python (16,781 forks)batch import
good first issuekind:documentation

Repository metrics

Stars
 (44,809 stars)
PR merge metrics
 (Avg merge 7d 18h) (834 merged PRs in 30d)

Description

What do you see as an issue?

https://hub.docker.com/r/apache/airflow Predefined set of popular providers (for details see the Dockerfile). https://hub.docker.com/r/apache/Dockerfile -> 404 ERROR

Solving the problem

Make the image visible/upload it/ update nd release it here -> https://hub.docker.com/r/apache/Dockerfile

Add a guide to the documentation here -> https://airflow.apache.org/docs/docker-stack/build.html#important-notes-for-the-base-images -> about how to add your own python venv and install packages via requirements.txt ExternalPythonOperator

because currently this is not helpful: "Only as of 2.0.1 image the --user flag is turned on by default by setting PIP_USER environment variable to true. This can be disabled by un-setting the variable or by setting it to false. In the 2.0.0 image you had to add the --user flag as pip install --user command."

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Contributor guide

Research direction
Review the existing documentation on Docker build and ExternalPythonOperator; create a simple example Dockerfile that creates a virtualenv and installs packages from requirements.txt.
Tech stack
pythondocker
Domain
documentationdevops
Issue type
Documentation
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
PythonDockerGit
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
80