[Feature] Skip no-op edge CSR compaction after COPY
Maintainers usually reply within 1 day
@zhanglei1949 is already working on this.
Since Sep 14, 2026.
- #1071 by @zhanglei1949 — closed without merging
Assessment
This issue has not been assessed yet.
Description
Problem
The checkpoint finalization path compacts every edge table touched by COPY. For a plain edge table loaded through the timestamp-zero batch path, this CSR scan is redundant when the table contains no inherited ordinary writes or tombstones.
Proposed behavior
Track whether an edge table actually needs CSR normalization, persist that state across incremental checkpoints, and skip compaction only when both conditions hold:
- the edge table has no neighbor sort key;
- the table has no pending timestamps or tombstones from ordinary mutations.
Sort-key edge tables continue to compact and sort. Legacy nonzero checkpoints without the new state use a conservative fallback and still compact.
Acceptance criteria
- Plain timestamp-zero COPY targets skip both CSR compact calls.
- Ordinary add, update, and delete paths force later compaction.
- The state survives clone, checkpoint persistence, module reuse, and reopen.
- Legacy manifests cannot cause a required compaction to be skipped.
- Direct CSV COPY data remains correct before and after checkpoint reopen, without using a bulk-load
Session.
- Dominant language
- C++
- Stars
- 176
- Forks
- 36
- Avg merge
- 1d 12h
- Merged PRs (30d)
- 41
Getting set up
Starts the project's dev container in your browser, under your own GitHub account.
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from alibaba/neug
-
[Bug] Nightly Windows x86_64: test_issue_931_cosine_ann_returns_distance_with_normalize fails — ANN cosine distance out of [0, 2]Possibly taken @shirly121 claimed this today. Openbug ci:windows extension
alibaba/neug#1202 · 1 comment · 1 assignee ·
Maintainers usually reply within 1 day
-
[Tracking] NeuG Performance Issues Identified by the Ontology Business PlatformPossibly taken @shirly121 claimed this 12 days ago. Open
alibaba/neug#1154 · 1 assignee ·
Maintainers usually reply within 1 day
-
[Transaction] Enable concurrent Insert Transactions for indexed CREATEPossibly taken @shirly121 claimed this 9 days ago. Openstore transaction
Difficulty 5/5 Over a week Newbie friendliness 25/100
alibaba/neug#1152 · 1 comment · 1 assignee ·
Maintainers usually reply within 1 day
-
[Vector] Parallelize bulk HNSW construction for COPY FROM and index initializationPossibly taken @shirly121 claimed this 9 days ago. Openextension store
Difficulty 5/5 Over a week Newbie friendliness 28/100
alibaba/neug#1150 · 1 comment · 1 assignee ·
Maintainers usually reply within 1 day
-
[Feature] Add an Apache Flink DataStream and SQL sink connectorPossibly taken @matrixsparse claimed this 24 days ago. Openclient
Difficulty 5/5 Over a week Newbie friendliness 30/100
alibaba/neug#1112 · 8 comments · 1 assignee ·
Maintainers usually reply within 1 day
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 66/100
xiaoyifang/goldendict-ng#3148 ·
Maintainers usually reply within 1 day
-
Difficulty 1/5 Under an hour Newbie friendliness 91/100
triton-inference-server/server#9069 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 66/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
Maintainers usually reply within 4 days
-
documentation
Difficulty 2/5 1-3 hours Newbie friendliness 78/100