Add information on file pattern used when raw file source can't find input files
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 65/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Active
- Tech stack
- scala, spark
- Domain
- data-engineering, observability
Research direction
Look for the raw file source component and its error handling, likely in a source or reader module. Find where file-not-found logs are generated and extend that to include the file pattern in email notifications. Check existing notification formatting to see how to add this detail.
Written by the indexing model from the issue text.
Description
Background
This is already printed in logs, but by adding it also to email notifications could help debug issues with raw file sources.
Feature
Add information on file pattern used when raw file source can't find input files.
Example [Optional]
--
Proposed Solution [Optional]
--
- Dominant language
- Scala
- Stars
- 33
- Forks
- 5
- Avg merge
- 6h 22m
- Merged PRs (30d)
- 14
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- No contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from AbsaOSS/pramen
-
bug
Difficulty 3/5 1-2 days Newbie friendliness 45/100
Maintainers usually reply within 1 day
-
bug
Difficulty 4/5 3-5 days Newbie friendliness 28/100
Maintainers usually reply within 1 day
-
Add a parallelism mode that allows parallel job runs but never the same job for different info datesOpenenhancement
Difficulty 4/5 3-5 days Newbie friendliness 45/100
Maintainers usually reply within 1 day
-
Jdbc Count doesn't use additional options from JDBC configPossibly taken @qwerty44-U claimed this 113 days ago. Openbug
Difficulty 4/5 3-5 days Newbie friendliness 35/100
Maintainers usually reply within 1 day
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 35/100
Maintainers usually reply within 1 day
Similar issues
-
[Bug] HiveDialect shares its colspecs dict with SQLAlchemy's DefaultDialect (python/pyhive)Possibly taken @rusackas claimed this today. Open
Difficulty 1/5 Under an hour Newbie friendliness 80/100
apache/kyuubi#7786 · 1 comment ·
Maintainers usually reply within 2 days
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
Maintainers usually reply within 1 day
-
requires-triage
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
apache/datafusion-comet#7001 ·
Maintainers usually reply within 1 day
-
? - Needs Triage documentation user_tools
Difficulty 2/5 Half a day Newbie friendliness 62/100
NVIDIA/cudf-spark-tools#2190 ·
Maintainers usually reply within 2 days
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
lichess-org/lila#22088 ·
Maintainers usually reply within 1 day