rclone/rclone

Add support for conditional writes to `rclone serve s3`

Open

#8,566 建立於 2025年5月23日

在 GitHub 查看
 (3 留言) (0 反應) (0 負責人)Go (57,185 star) (5,090 fork)batch import
dependenciesenhancementhelp wantedserve s3

描述

rclone serve s3 currently does not seem to have support for conditional writes that AWS added a while ago. Conditional writes allow doing a CAS(Compare-and-Swap) Operation using headers during writes, which allows doing optimistic locking for writes.

What is your current rclone version (output from rclone version)?

v1.68.2

What problem are you are trying to solve?

I'd like to use rclone as a (singleton) proxy for applications that need atomic writes like litestream.

How do you think rclone should be changed to solve that?

Rclone serve s3 should add support for the compare-and-swap operation to be able to do writes with optimistic locking.

How to use GitHub

  • Please use the 👍 reaction to show that you are affected by the same issue.
  • Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
  • Subscribe to receive notifications on status change and new comments.

貢獻者指南

技術棧
go
領域
backendcloudapi
議題類型
feature
難度面向新貢獻者的預計實作難度，1 表示很小改動，5 表示專家級工作。
4
預計時間有經驗貢獻者完成調查、實作、測試並準備 pull request 的粗略時間範圍。
3-5 days
活動狀態議題目前的可參與程度：新鮮、活躍、陳舊、阻塞或等待維護者輸入。
fresh
清晰度議題是否清楚說明預期改動、驗收標準和下一步。
clear
前置要求
Go programmingS3 API knowledgerclone codebase familiarity
新手友善度1-100 的估計分數，表示該議題對首次貢獻者的友善程度。
25
研究方向
Examine the S3 serving code in cmd/serve/s3/. Understand how write operations are currently handled. Study the AWS documentation for conditional writes, specifically the If None Match header. Look at minio go implementation for guidance. Implement the header parsing and conditional logic in the PUT object handler.