[BanyanDB] Data/Schema Import and Export
Maintainers usually reply within 1 day
@mrproliu is already working on this.
Since Sep 23, 2026.
Assessment
This issue has not been assessed yet.
Description
Search before asking
- I had searched in the issues and found no similar feature requirement.
Description
BanyanDB already supports snapshots, backup/restore, and lifecycle management. However, it still lacks an operations-oriented, cluster-level data import/export workflow.
The design is here: https://github.com/apache/skywalking-banyandb/tree/4b3fc26c5e5a37d0e96212c2e6cd299b5744095e/docs/design/0.12.0/data-export-import
It adds bydbctl data export and bydbctl data import, built around two channels: a CSV channel that replays logical rows and works across differing topologies and versions, and a native channel that relays part bytes through the liaison for speed but requires the source and target to match. Both are driven by a plan file, both support a dry run that touches nothing, and both can resume after an interruption.
The steps below are ordered so that each one ends with something demonstrable, and the two E2E steps close a channel before the next one opens.
- 1. Extend
databasev1.Nodeto expose supported file versions and timezone information. - 2. Build bydbctl and implement the export
PlanAPI to collect node information for dry run. - 3. Implement CSV export.
- 4. Implement CSV import.
- 5. Complete CSV import/export E2E.
- 6. Implement the
.bnccontainer format, with common read and write APIs. - 7. Add property file-chunk support to the file-chunk protocol.
- 8. Implement native import/export.
- 9. Complete native import/export E2E.
- 10. Add resume support to both workflows.
Use case
Using to export or import data from banyanDB cluster.
Related issues
No response
Are you willing to submit a pull request to implement this on your own?
- Yes I am willing to submit a pull request on my own!
Code of Conduct
- I agree to follow this project's Code of Conduct
- Dominant language
- Java
- Stars
- 25k
- Forks
- 6.6k
- Avg merge
- 10h 14m
- Merged PRs (30d)
- 23
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from apache/skywalking
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
apache/skywalking#14120 ·
Maintainers usually reply within 1 day
-
[Feature] horizon ui Logs should support horizontal scrolling; too much content requires opening each entryPossibly taken @wu-sheng claimed this 5 days ago. Openfeature UI
apache/skywalking#14118 · 2 comments · 1 assignee ·
Maintainers usually reply within 1 day
-
database
Difficulty 4/5 3-5 days Newbie friendliness 45/100
apache/skywalking#14104 ·
Maintainers usually reply within 1 day
-
[Bug] BanyanDB Canopy source build fails on macOS ARM64Possibly taken @hanahmily claimed this 16 days ago. Openbug database UI
apache/skywalking#14094 · 2 comments · 1 assignee ·
Maintainers usually reply within 1 day
-
database feature
Difficulty 5/5 Over a week Newbie friendliness 38/100
apache/skywalking#14092 ·
Maintainers usually reply within 1 day
All issues in apache/skywalking
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
area/docs
Difficulty 1/5 Under an hour Newbie friendliness 88/100
Maintainers usually reply within 1 day
-
BoxChart rejects valid List.of data with NullPointerExceptionPossibly taken @PHJ2000 claimed this today. Open
Difficulty 2/5 1-3 hours Newbie friendliness 76/100