NYCPlanning/data-engineering

Primary repository for NYC DCP's Data Engineering team

Is NYCPlanning/data-engineering beginner-friendly?

In the last 30 days, NYCPlanning/data-engineering merged 78 of 85 pull requests from outside contributors, and its maintainers usually reply within 1 day. 4 beginner-friendly issues are open now.

Stars
2
Forks
0
Open beginner issues
4
Indexed issues
185
Avg merge
13h 8m
Merged PRs (30d)
138
Dominant language
Python
License
MIT
Last GitHub push
Nov 16, 2026
Latest indexed
Sep 20, 2026
Contributing guide
No contributing guide
Code of conduct
No code of conduct
Beginner labels
No beginner labels indexed

How to contribute to NYCPlanning/data-engineering

  1. There is no contributing guide, so start from the README and a few recently merged pull requests to see how changes are proposed.
  2. The project ships a dev container: open it in Codespaces to get a working environment in your browser.
  3. Your contributions will be published under the project's MIT license.
  4. Pick one of the 4 open beginner-friendly issues below and comment that you want to work on it before you start.

Issues somebody may already be working on are listed last. List everything by date

  • review developer setup doc
    Open

    Difficulty 2/5 1-3 hours Newbie friendliness 70/100

    NYCPlanning/data-engineering#2996 ·

    Maintainers usually reply within 1 day

  • Scheduled Action Failure - Ingest - 📁 ArcGIS Feature Server Updates
    Open
    ingest

    Difficulty 3/5 1-2 days Newbie friendliness 18/100

    NYCPlanning/data-engineering#2995 ·

    Maintainers usually reply within 1 day

  • Establish github action for monthly DD build and downloads - GIS Team
    Open

    Difficulty 4/5 3-5 days Newbie friendliness 48/100

    NYCPlanning/data-engineering#2869 · 4 comments ·

    Maintainers usually reply within 1 day

  • Scheduled Action Failure - ⚙️ Nightly QA
    Open
    QA

    Difficulty 3/5 1-2 days Newbie friendliness 20/100

    NYCPlanning/data-engineering#2848 · 1 comment · 1 assignee ·

    Maintainers usually reply within 1 day

  • FacDB - foodbankny_foodbanks has a new program_type with no factype
    Open
    db-facilities

    Difficulty 2/5 1-3 hours Newbie friendliness 64/100

    NYCPlanning/data-engineering#2847 · 1 assignee ·

    Maintainers usually reply within 1 day

  • dbt - plan upgrade to v2
    Open

    Difficulty 5/5 Over a week Newbie friendliness 24/100

    NYCPlanning/data-engineering#2846 · 1 comment · 1 assignee ·

    Maintainers usually reply within 1 day

  • Link FacDB rows in the managing agencies lookup to the agencies they repeat
    Open
    db-facilities

    Difficulty 3/5 1-2 days Newbie friendliness 48/100

    NYCPlanning/data-engineering#2759 · 1 assignee ·

    Maintainers usually reply within 1 day

  • move postgres connections from psycopg2 to psycopg 3
    Open

    Difficulty 4/5 3-5 days Newbie friendliness 35/100

    NYCPlanning/data-engineering#2723 ·

    Maintainers usually reply within 1 day

  • Scheduled Action Failure - PLUTO Inputs
    Open
    db-pluto ingest

    Difficulty 3/5 1-2 days Newbie friendliness 35/100

    NYCPlanning/data-engineering#2720 · 1 assignee ·

    Maintainers usually reply within 1 day

  • create a data catalog
    Open
    needs scoping

    Difficulty 5/5 Over a week Newbie friendliness 8/100

    NYCPlanning/data-engineering#2718 ·

    Maintainers usually reply within 1 day

  • create a data warehouse for analytics
    Open
    needs scoping

    Difficulty 5/5 Over a week Newbie friendliness 12/100

    NYCPlanning/data-engineering#2717 ·

    Maintainers usually reply within 1 day

  • use dlt to get source data
    Open
    needs scoping

    Difficulty 5/5 Over a week Newbie friendliness 8/100

    NYCPlanning/data-engineering#2716 ·

    Maintainers usually reply within 1 day

  • python geosupport package refresh
    Open
    needs scoping

    Difficulty 4/5 Over a week Newbie friendliness 12/100

    NYCPlanning/data-engineering#2715 ·

    Maintainers usually reply within 1 day

  • PLUTO 26v4
    Open
    data update db-pluto

    Difficulty 4/5 3-5 days Newbie friendliness 25/100

    NYCPlanning/data-engineering#2709 · 1 comment · 1 assignee ·

    Maintainers usually reply within 1 day

  • CBBR source data questions
    Open
    db-cbbr

    Difficulty 5/5 Over a week Newbie friendliness 35/100

    NYCPlanning/data-engineering#2700 · 1 assignee ·

    Maintainers usually reply within 1 day

  • KPDB - phasing uses current_date so a pinned recipe doesn't rebuild the same numbers
    Open
    db-knownprojects

    Difficulty 2/5 1-3 hours Newbie friendliness 74/100

    NYCPlanning/data-engineering#2629 ·

    Maintainers usually reply within 1 day

  • Hudson Square geometry correction is patching stale KPDB input, not ZAP
    Open
    db-knownprojects db-zap

    Difficulty 4/5 3-5 days Newbie friendliness 48/100

    NYCPlanning/data-engineering#2590 ·

    Maintainers usually reply within 1 day

  • KPDB 2026
    May be free again @damonmcc claimed this 89 days ago, and no pull request is open. Open
    data update db-knownprojects

    NYCPlanning/data-engineering#2587 · 1 assignee ·

    Maintainers usually reply within 1 day

  • Spatial network analysis
    Open
    needs scoping

    Difficulty 5/5 Over a week Newbie friendliness 25/100

    NYCPlanning/data-engineering#2577 ·

    Maintainers usually reply within 1 day

  • Azure POC deployment
    May be free again @alexrichey claimed this 96 days ago, and no pull request is open. Open
    needs scoping platform

    NYCPlanning/data-engineering#2575 · 1 assignee ·

    Maintainers usually reply within 1 day

  • COLP - migrate build SQL to dbt
    Open
    db-colp

    Difficulty 4/5 3-5 days Newbie friendliness 35/100

    NYCPlanning/data-engineering#2541 ·

    Maintainers usually reply within 1 day

  • Checkbook - migrate build SQL to dbt
    Open
    db-checkbook

    Difficulty 4/5 3-5 days Newbie friendliness 35/100

    NYCPlanning/data-engineering#2542 ·

    Maintainers usually reply within 1 day

  • DevDB - migrate build SQL to dbt
    Open
    db-developments

    Difficulty 5/5 Over a week Newbie friendliness 35/100

    NYCPlanning/data-engineering#2539 ·

    Maintainers usually reply within 1 day

  • KPDB - migrate build SQL to dbt
    Open
    db-knownprojects

    Difficulty 5/5 Over a week Newbie friendliness 38/100

    NYCPlanning/data-engineering#2540 · 2 comments ·

    Maintainers usually reply within 1 day

  • CBBR - migrate build SQL to dbt
    Open
    db-cbbr

    Difficulty 4/5 3-5 days Newbie friendliness 45/100

    NYCPlanning/data-engineering#2538 ·

    Maintainers usually reply within 1 day

  • FacDB - migrate build SQL to dbt
    Open
    db-facilities

    Difficulty 5/5 Over a week Newbie friendliness 35/100

    NYCPlanning/data-engineering#2536 ·

    Maintainers usually reply within 1 day

  • CEQR - migrate build SQL to dbt
    Open
    db-ceqr

    Difficulty 4/5 3-5 days Newbie friendliness 35/100

    NYCPlanning/data-engineering#2537 ·

    Maintainers usually reply within 1 day

  • PLUTO - migrate build SQL to dbt
    Open
    db-pluto

    Difficulty 5/5 Over a week Newbie friendliness 35/100

    NYCPlanning/data-engineering#2535 ·

    Maintainers usually reply within 1 day

  • ZTL - add tests to product models
    Open
    db-zoningtaxlots

    Difficulty 3/5 1-2 days Newbie friendliness 45/100

    NYCPlanning/data-engineering#2533 ·

    Maintainers usually reply within 1 day

  • CPDB - migrate build SQL to dbt
    Open
    db-cpdb

    Difficulty 4/5 3-5 days Newbie friendliness 35/100

    NYCPlanning/data-engineering#2534 ·

    Maintainers usually reply within 1 day

  • Lint dbt projects from shared config
    Open

    Difficulty 4/5 3-5 days Newbie friendliness 35/100

    NYCPlanning/data-engineering#2531 ·

    Maintainers usually reply within 1 day

  • GFT - add tests to staging models
    Open
    db-gft

    Difficulty 2/5 1-3 hours Newbie friendliness 68/100

    NYCPlanning/data-engineering#2532 ·

    Maintainers usually reply within 1 day

  • Compare exported geometry spatially
    Open

    Difficulty 3/5 1-2 days Newbie friendliness 65/100

    NYCPlanning/data-engineering#2530 ·

    Maintainers usually reply within 1 day

  • Compare `.gdb.zip` build exports
    Open

    Difficulty 3/5 1-2 days Newbie friendliness 68/100

    NYCPlanning/data-engineering#2529 ·

    Maintainers usually reply within 1 day

  • all SQL builds use dbt
    Open
    platform

    Difficulty 5/5 Over a week Newbie friendliness 32/100

    NYCPlanning/data-engineering#2525 ·

    Maintainers usually reply within 1 day

  • GDE data flows
    Open

    Difficulty 4/5 3-5 days Newbie friendliness 48/100

    NYCPlanning/data-engineering#2524 ·

    Maintainers usually reply within 1 day

  • dcpy and build lifecycle improvements
    Open
    platform

    Difficulty 5/5 Over a week Newbie friendliness 25/100

    NYCPlanning/data-engineering#2516 ·

    Maintainers usually reply within 1 day

  • QA app: infrastructure and per-product reports
    Open

    Difficulty 5/5 Over a week Newbie friendliness 25/100

    NYCPlanning/data-engineering#2515 ·

    Maintainers usually reply within 1 day

  • CEQR Data Hub maintenance
    Open
    db-ceqr

    Difficulty 5/5 Over a week Newbie friendliness 20/100

    NYCPlanning/data-engineering#2514 ·

    Maintainers usually reply within 1 day

  • fix COLP UID
    Open
    db-colp

    Difficulty 4/5 3-5 days Newbie friendliness 48/100

    NYCPlanning/data-engineering#2510 ·

    Maintainers usually reply within 1 day

  • Standardize formatting for facility operator names
    May be free again @damonmcc claimed this 153 days ago, and no pull request is open. Open
    db-facilities

    NYCPlanning/data-engineering#2454 · 1 assignee ·

    Maintainers usually reply within 1 day

  • FacDB refactor
    May be free again @damonmcc claimed this 185 days ago, and no pull request is open. Open
    db-facilities

    NYCPlanning/data-engineering#2386 · 1 assignee ·

    Maintainers usually reply within 1 day

  • Decompose the UD Tools Server [Parent]
    May be free again @Eeloh claimed this 264 days ago, and no pull request is open. Open
    needs scoping

    NYCPlanning/data-engineering#2260 · 3 assignees ·

    Maintainers usually reply within 1 day

  • Scheduled Action Failure - Ingest - 📁 Open Data Routine Updates
    Open
    ingest/library

    Difficulty 3/5 1-2 days Newbie friendliness 35/100

    NYCPlanning/data-engineering#2255 ·

    Maintainers usually reply within 1 day

  • usdot_ports new source
    Open

    Difficulty 4/5 3-5 days Newbie friendliness 35/100

    NYCPlanning/data-engineering#2238 · 2 comments ·

    Maintainers usually reply within 1 day

  • CSCL - Architecture
    Open
    db-cscl

    Difficulty 5/5 Over a week Newbie friendliness 20/100

    NYCPlanning/data-engineering#2198 ·

    Maintainers usually reply within 1 day

  • sca_capacity_project update needed for "capital_plan" column
    May be free again @damonmcc claimed this 314 days ago, and no pull request is open. Open

    NYCPlanning/data-engineering#2164 · 1 comment · 1 assignee ·

    Maintainers usually reply within 1 day

  • CSCL - Extract Working GDB
    May be free again @damonmcc claimed this 104 days ago, and no pull request is open. Open
    db-cscl

    NYCPlanning/data-engineering#2110 · 2 comments · 1 assignee ·

    Maintainers usually reply within 1 day

  • CSCL - GR/GSS lion gdb postprocessing
    Open
    db-cscl

    Difficulty 4/5 3-5 days Newbie friendliness 35/100

    NYCPlanning/data-engineering#2054 ·

    Maintainers usually reply within 1 day

  • PLUTO metadata PDFs
    Open
    db-pluto

    Difficulty 3/5 1-2 days Newbie friendliness 45/100

    NYCPlanning/data-engineering#2019 · 1 comment ·

    Maintainers usually reply within 1 day

Showing the newest 100

This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.

Open advanced filter

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.