vectordotdev/vector

New `wasabi` sink

Open

#1782 opened on Feb 12, 2020

View on GitHub
 (2 comments) (0 reactions) (0 assignees)Rust (21,837 stars) (2,126 forks)batch import
domain: logsdomain: sinksgood first issuesink: new

Description

Wasabi offers a very fast, cost-effective storage alternative to s3 that some customers are interested in sending data to. It should be fully compatible with the s3 protocols, so I'm hoping this shouldn't be too much additional work.

Contributor guide

Tech stack
rust
Domain
backendapi
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
Rust programmingS3 API knowledgeVector sink architecture
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
50
Research direction
Investigate the existing S3 sink implementation in Vector's source code, likely in `src/sinks/`. Adapt that implementation for Wasabi, noting that Wasabi is S3 compatible but may require different endpoints or authentication. Review the two comments on the issue for any additional context or requirements. Ensure compatibility with Vector's sink configuration and testing framework.