storage: ApplyWriteRedirectErrors clears the write handle when a BidiWriteObjectRedirectedError omits it
メンテナーはふだん 1 日以内に返信
まだ誰も着手していません。
評価
調査の方向性
google/cloud/storage/internal/async/handle_redirect_error.cc から始め、ApplyWriteRedirectErrors と HandleBidiWriteRedirect を比較します。次に google/cloud/storage/internal/async/writer_connection_resumed.cc の Resume() を読みます。write_handle を持たないリダイレクトでは既存のハンドルが保持され、write_handle を提供するリダイレクトでは引き続きそれが適用されれば完了です。
索引モデルが issue の本文から書いたものです。
説明
Does this issue affect the google-cloud-cpp project? If the problem is with
the Google Cloud service exposed by the google-cloud-cpp libraries instead of
the client libraries themselves, you may consider opening a support request
instead. The google-cloud-cpp developers cannot help you troubleshoot problems
with the service itself.
Yes
What component of google-cloud-cpp is this related to? For example, is
this related to bigtable (i.e., something in google/cloud/bigtable), or GCS
(i.e., something in google/cloud/storage)?
google/cloud/storage
Describe the bug A clear and concise description of what the bug is.
Accidentally cleared write handle
To Reproduce Steps to reproduce the behavior:
Found through static analysis of the code
Expected behavior A clear and concise description of what you expected to
happen.
Don't clear the write handle
Operating system: If you are using a Linux distribution please include the
name and version of the distribution too.
N/A
What compiler and version are you using? Please include the output of
g++ -v or clang++ -v or the equivalent command-line flag.
N/A
What version of google-cloud-cpp are you using? Please include the output
from git rev-parse HEAD if you are compiling from source, or the version
number from the applicable google/cloud/*/version.h file.
Found by examining most recent version. 10/2/26.
Additional context Add any other context about the problem here.
When an appendable bidi write is redirected mid-upload, ApplyWriteRedirectErrors copies write_handle from the redirect without checking whether it is set:
// google/cloud/storage/internal/async/handle_redirect_error.cc
void ApplyWriteRedirectErrors(google::storage::v2::AppendObjectSpec& spec,
google::rpc::Status const& rpc_status) {
for (auto const& any : rpc_status.details()) {
...
*spec.mutable_write_handle() = std::move(*error.mutable_write_handle()); // unconditional
*spec.mutable_routing_token() = std::move(*error.mutable_routing_token()); // unconditional
if (error.has_generation()) spec.set_generation(error.generation()); // guarded
}
}
BidiWriteObjectRedirectedError.write_handle is optional. The proto says that if it is not set, "clients might retry the original request" (google/storage/v2/storage.proto). When the server omits it, the code above replaces the handle that AsyncWriterConnectionResumedState::Resume() just set from latest_write_handle_ with an empty one, so the resume request carries a write_handle that is set but empty:
// google/cloud/storage/internal/async/writer_connection_resumed.cc, Resume()
// Include write_handle to enable fast resume instead of slow
// takeover. Without handle, server performs full state validation.
if (latest_write_handle_) {
*append_object_spec.mutable_write_handle() = *latest_write_handle_;
}
append_object_spec.set_generation(first_response_.resource().generation());
ApplyWriteRedirectErrors(append_object_spec, std::move(proto_status));
This is inconsistent with the rest of the SDK:
generationon the next line is only overridden when the redirect sets it.HandleBidiWriteRedirect(same file, used when the stream is first opened) leaves the request unchanged when the redirect has nowrite_handle.
Impact: this isn't a correctness problem, since the resume still uses an AppendObjectSpec with the right generation. But per the comment in Resume(), resuming without a valid handle makes the server do a slow takeover with full state validation instead of a fast resume. This may be worth investigating for write performance after redirects. We haven't checked how the server treats a handle that is set but empty, as opposed to a missing one.
We hit token-only redirects in practice: a reconnect after a RESOURCE_EXHAUSTED stream failure received ABORTED: The object is not available from this location. with a BidiWriteObjectRedirectedError that had only a routing_token.
Suggested fix: guard the handle the same way as the generation:
if (error.has_write_handle()) {
*spec.mutable_write_handle() = std::move(*error.mutable_write_handle());
}
(Optionally also only override routing_token when it is non-empty, to match HandleBidiWriteRedirect. Note that routing tokens may expire, so keeping an old one has tradeoffs.)
- 主要言語
- C++
- スター
- 658
- フォーク
- 469
- 平均マージ
- 1日 10時間
- マージ済み PR(30日)
- 96
環境構築
- Dockerfile・Docker Compose ファイルなし
- プルリクエストのテンプレートなし
- コントリビューションガイドを読む
はじめの一歩
- issue を最後まで読み、次にプロジェクトのコントリビューションガイドを読みます。
- 着手することを issue にコメントします — 二人が同じ作業をするのを防げます。
- リポジトリをフォークし、ブランチを切って変更します。
- issue 番号を参照したプルリクエストを送ります。
googleapis/google-cloud-cpp のほかの issue
-
api: storage type: cleanup
難易度 2/5 1〜3時間 初心者へのやさしさ 84/100
googleapis/google-cloud-cpp#16522 ·
メンテナーはふだん 1 日以内に返信
-
type: feature request
難易度 2/5 1〜3時間 初心者へのやさしさ 73/100
googleapis/google-cloud-cpp#16193 ·
メンテナーはふだん 1 日以内に返信
-
Multiple quickstarts crashing with memory corruption (double free) and networksecurity timeouts対応中かも このイシューにリンクされたプルリクエストがオープン中、またはマージ済みです。 オープンcpp: flake
難易度 4/5 3〜5日 初心者へのやさしさ 45/100
googleapis/google-cloud-cpp#16475 · コメント 3 件 ·
メンテナーはふだん 1 日以内に返信
-
api: storage type: cleanup
難易度 3/5 1〜2日 初心者へのやさしさ 68/100
googleapis/google-cloud-cpp#16404 ·
メンテナーはふだん 1 日以内に返信
-
cpp: generator type: cleanup
難易度 3/5 1〜2日 初心者へのやさしさ 68/100
googleapis/google-cloud-cpp#16394 ·
メンテナーはふだん 1 日以内に返信
googleapis/google-cloud-cpp の issue をすべて見る
似ている issue
-
難易度 2/5 1〜3時間 初心者へのやさしさ 88/100
MerginMaps/mobile#4741 ·
メンテナーはふだん 1 日以内に返信
-
難易度 2/5 1〜3時間 初心者へのやさしさ 85/100
Icinga/icinga2#11077 · コメント 1 件 ·
メンテナーはふだん 1 日以内に返信
-
難易度 2/5 1〜3時間 初心者へのやさしさ 66/100
-
agent:WSL bug linux LOW ui
難易度 1/5 1時間未満 初心者へのやさしさ 78/100
メンテナーはふだん 1 日以内に返信
-
Copter: PosHold brake-entry threshold became 16 deg instead of 0.16 deg after the radians conversion対応中かも このイシューにリンクされたプルリクエストがオープン中、またはマージ済みです。 オープン
難易度 1/5 1時間未満 初心者へのやさしさ 78/100
ArduPilot/ardupilot#34617 · コメント 1 件 · リアクション 1 件 ·
メンテナーはふだん 1 日以内に返信