CSCL - GR/GSS lion gdb postprocessing
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 35/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Stale
- Tech stack
- python
- Domain
- data-engineering
Research direction
Start with the standalone Python script that JD will share and identify how it uses Esri packages. Review the pipeline entry point where this transformation should be incorporated. Done means reproducing the node outputs and street-name lookup, removing floating nodes, and generating the preferred-record and missing-segment reports described in the issue.
Written by the indexing model from the issue text.
Description
Questions
are there steps taken before this is run?Nopeis the gdb prior to postprocessing script needed/used in any way?Nope
Notes from meeting
What the tool does
- main data outputs in gdb:
- node feature class
- node-streetname lookup table
- CSCL has a lot of "floating" nodes
- script deletes floating nodes, only keeps nodes which are connected to segments
- generate streetname associated with Node
- only take preferred streetnames
- generate report of "Y" preferred lgc records with no b7sc
- generate report of "missing" segments - exists in intersections table but not CSCL
Tool in this case is a standalone python script that uses esri packages. We will incorporate this transformation into the pipeline.
There is no documentation for this specific transformation, but JD will share the code
- Dominant language
- Python
- Stars
- 2
- Forks
- 0
- Avg merge
- 13h 8m
- Merged PRs (30d)
- 138
Getting set up
Starts the project's dev container in your browser, under your own GitHub account.
- No Dockerfile or Docker Compose file
- Has a pull request template
- No contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from NYCPlanning/data-engineering
-
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
NYCPlanning/data-engineering#2996 ·
Maintainers usually reply within 1 day
-
db-facilities
Difficulty 2/5 1-3 hours Newbie friendliness 64/100
NYCPlanning/data-engineering#2847 · 1 assignee ·
Maintainers usually reply within 1 day
-
db-knownprojects
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
NYCPlanning/data-engineering#2629 ·
Maintainers usually reply within 1 day
-
CSCL - coincident_seg_count double-counts subway/rail crossingsPossibly taken @alexrichey claimed this today. Opendb-cscl
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
NYCPlanning/data-engineering#2616 · 1 assignee ·
Maintainers usually reply within 1 day
-
db-gft
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
NYCPlanning/data-engineering#2532 ·
Maintainers usually reply within 1 day
All issues in NYCPlanning/data-engineering
Similar issues
-
Difficulty 1/5 Under an hour Newbie friendliness 85/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
pearu/agent-sandbox#451 ·
Maintainers usually reply within 1 day
-
run_gate loads a custom tasks file from outside the working directoryPossibly taken @Ru0k3 claimed this today. Openbug
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
MakazhanAlpamys/Soup#3189 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 80/100
Maintainers usually reply within 1 day