apache/beam

Bigquery queries should allow options to run in batch mode or not

オープン

#18,486 opened on 2022/06/03

 (0 件のコメント) (0 件のリアクション) (0 人の担当者)Java (4,097 件のフォーク)batch import
P3buggcpgood first issueiojava

Repository metrics

Stars
 (7,313 個のスター)
PR merge metrics
 (PR metrics pending)

説明

When bigquery read does a query it sets the mode to batch. A batch query can be very slow to schedule as it batches it with other queries. However it doesn't use batch quota which is better for some cases. However, in some cases a fast query is better (especially in timed tests). It would be a good idea to have a configuration to the bigquery source to set this per-read.

Imported from Jira BEAM-2817. Original Jira may contain additional context. Reported by: laraschmidt.

コントリビューターガイド