sparkImage.pullPolicy does not propagate to driver
Nobody has claimed this yet.
Assessment
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Newbie friendliness
- 55/100
- Issue type
- Bug
- Clarity
- Mostly clear
- Activity status
- Active
- Tech stack
- kubernetes, rust, spark
- Domain
- infrastructure
Research direction
Start by tracing how sparkImage.pullPolicy is applied to the submit pod, then compare the configuration passed to the driver and executor pods. Reproduce the issue with sparkImage.pullPolicy set to Always and verify that the driver and executor pod settings match the requested sparkImage configuration.
Written by the indexing model from the issue text.
Description
Affected Stackable version
26.7
Affected Apache Spark-on-Kubernetes version
4.x
Current and expected behavior
When setting sparkImage.pullPolicy to Always, this is configured for the submit pod, but at least the driver keeps the default setting. Expected would be that we use the pullPolicy (and other sparkImage settings) on driver and executor pods.
Workaround
spec:
sparkConf:
spark.kubernetes.container.image.pullPolicy: "Always"
Possible solution
No response
Additional context
No response
Environment
No response
Would you like to work on fixing this bug?
No response
- Dominant language
- Rust
- Stars
- 72
- Forks
- 4
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 15
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from stackabletech/spark-k8s-operator
-
type/bug
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
-
Difficulty 4/5 3-5 days Newbie friendliness 55/100
stackabletech/spark-k8s-operator#774 · 1 comment ·
-
type/bug
Difficulty 4/5 3-5 days Newbie friendliness 45/100
-
type/bug
Difficulty 3/5 1-2 days Newbie friendliness 52/100
stackabletech/spark-k8s-operator#730 · 6 comments ·
-
customer-request type/bug
Difficulty 4/5 3-5 days Newbie friendliness 45/100
stackabletech/spark-k8s-operator#701 · 1 comment ·
All issues in stackabletech/spark-k8s-operator
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
TheLarkInn/aipm#2413 ·
-
documentation
Difficulty 1/5 Under an hour Newbie friendliness 90/100
alexgorbatchev/simple-ptt#15 ·
-
tooling
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
-
todo:ticket
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
taikoxyz/taiko-mono#22168 · 1 comment ·