CSCL - Architecture

Open
#2,198 0 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
20/100
Issue type
Feature
Clarity
Needs clarification
Activity status
Stale
Tech stack
python

Research direction

No files, tests, or entry points are named. Start by reading the child issues referenced in the description and identify how the UI and direct-from-OracleDB ETL requirements are divided among them. Done would require an agreed architecture that addresses those requirements.

Written by the indexing model from the issue text.

Description

db-cscl

This pipeline is a bit different from our other build pipelines for a few reasons, the primary being that we are not the main users of it, and the users have some specific requirements. Among other requirements, they need

  • A UI that is not just github/azure/orchestration
  • ETL to start directly from source - we're not building from recipes but from an OracleDB that might have been updated just a few minutes before the pipeline is run

Main complications honestly are around the latter. I'll leave the details for the child issues

Dominant language
Python
Stars
2
Forks
0
Avg merge
13h 8m
Merged PRs (30d)
138

Getting set up

Open in Codespaces

Starts the project's dev container in your browser, under your own GitHub account.

  • No Dockerfile or Docker Compose file
  • Has a pull request template
  • No contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from NYCPlanning/data-engineering

All issues in NYCPlanning/data-engineering

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.