apache/beam

Bigquery queries should allow options to run in batch mode or not

Open

#18,486 建立於 2022年6月3日

在 GitHub 查看
 (0 留言) (0 反應) (0 負責人)Java (4,097 fork)batch import
P3buggcpgood first issueiojava

倉庫指標

Star
 (7,313 star)
PR 合併指標
 (平均合併 6天) (30 天內合併 243 個 PR)

描述

When bigquery read does a query it sets the mode to batch. A batch query can be very slow to schedule as it batches it with other queries. However it doesn't use batch quota which is better for some cases. However, in some cases a fast query is better (especially in timed tests). It would be a good idea to have a configuration to the bigquery source to set this per-read.

Imported from Jira BEAM-2817. Original Jira may contain additional context. Reported by: laraschmidt.

貢獻者指南