area/sparkhelp wantedkind/feature
Repository metrics
- Stars
- (124 stars)
- PR merge metrics
- (PR metrics pending)
Description
What you would like to be added?
The goal of the issue is to expose a main_class parameter on the FileJob dataclass to enable jar file submission.
Why is this needed?
The Spark SDK KEP proposes a main_class parameter on the FileJob dataclass.
However, the current implementation for FileJob does not support this parameter. As such, jar file submission is not enabled on the Spark SDK.
Love this feature?
Give it a 👍 We prioritize the features with most 👍