Demonstrate how to tie a database into the upstream data pipeline
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 25/100
- Issue type
- Feature
- Clarity
- Needs clarification
- Activity status
- Stale
- Domain
- build-system, data-engineering, databases
Research direction
No files, tests, or entry points are named. Start by reviewing the repository's existing GNU Make targets and data-pipeline examples, then determine how to populate a database, write a file containing the latest relevant last_updated_date values, and declare that file as a data dependency while accessing the database over the network. Done means the demonstration runs end to end without treating the database file itself as the dependency.
Written by the indexing model from the issue text.
Description
- Add a build target that populates a database with some random data
- Add a build target that writes to a file to match the most current last_updated_date for any database tables we're interested in.
- Add this file as a data dependency
... or something like that. Could trivially add the db file as a dependency, but let's pretend we only have network access to the database to prove the concept.
- Dominant language
- HTML
- Stars
- 3
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from dmarx/make_for_datascience
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
Difficulty 1/5 Under an hour Newbie friendliness 35/100
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
dmarx/make_for_datascience#27 · 2 comments ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
All issues in dmarx/make_for_datascience
Similar issues
-
type/automation type/tech-debt
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
priority: p3
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
googleapis/librarian#7636 ·
-
package-update
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
oSoWoSo/vOid_Community_repOsitory#147 · 1 comment ·
-
Builders
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 88/100