[Feature] Lifecycle support for storing data into S3

Open
#13,989 15 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
30/100
Issue type
Feature
Clarity
Needs clarification
Activity status
Active
Tech stack
aws
Domain
cloud, data

Research direction

Start by surveying S3 storage backends, lifecycle policies, and integration approaches with BanyanDB's existing storage model. Produce a comparison document, build a working proof-of-concept, run write/read latency, throughput, and cost benchmarks, and use the findings to complete a final design proposal.

Written by the indexing model from the issue text.

Description

database feature

Summary

Add lifecycle support for storing data into S3, enabling tiered/archival storage of BanyanDB data.

Task Requirements

  1. Research — survey potential solutions (S3 storage backends, lifecycle policies, integration approaches with BanyanDB's existing storage model).
  2. PoC — implement a proof-of-concept for the chosen approach.
  3. Benchmark — run benchmarks (write/read latency, throughput, cost) before finalizing the design.

Acceptance Criteria

  • Research document comparing candidate solutions.
  • Working PoC.
  • Benchmark results.
  • Final design proposal based on PoC + bench findings.
Dominant language
Java
Stars
25k
Forks
6.6k
Avg merge
12h 1m
Merged PRs (30d)
43

Getting set up

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from apache/skywalking

All issues in apache/skywalking

Similar issues

More Java issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.