milvus-io/milvus

[Feature]: Can milvus adapt to open source storage CubeFS

Open

#26,189 opened on Aug 8, 2023

View on GitHub
 (1 comment) (0 reactions) (1 assignee)Go (44,298 stars) (4,000 forks)batch import
good first issuekind/feature

Description

Is there an existing issue for this?

  • I have searched the existing issues

Is your feature request related to a problem? Please describe.

The storage system we use is open source CubeFS , so we hope that milvus can connect to CubeFS

Describe the solution you'd like.

milvus can connect to the standard S3 protocol provided by CubeFS

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

Contributor guide

Tech stack
go
Domain
database
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
3-5 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
Go programmingS3 protocolMilvus storage architecture
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
30
Research direction
Investigate how Milvus currently integrates with S3 compatible storage (e.g., MinIO) in its storage layer. Look at files in the internal/storage directory and any existing S3 client configuration. Then, check CubeFS documentation for its S3 protocol compatibility. The goal is to add CubeFS as a new storage backend by implementing the same interface as existing object storages. The issue has one assignee but no PR yet; check the assignee's branch for any work in progress.