apache/beam

Set region when BigqueryIO.write using DirectRunner

Open

#18,812 opened on 2022年6月3日

GitHub で見る
 (0 comments) (0 reactions) (0 assignees)Java (4,097 forks)batch import
P3dataflowdirectgood first issuenew featurerunners

Repository metrics

Stars
 (7,313 stars)
PR merge metrics
 (平均マージ 6d) (30d で 243 merged PRs)

説明

Cannot set region for BigQuery dataset when using direct runner using Apache Beam. I'm trying to get data from Oracle via JdbcIO.read using apache beam to get data and push them to bigquery table. Problem is I have to use direct runner because Oracle DB is local, and the bigquery dataset must located in asia, not the default us-central. so now I cannot push data because the default location dont have my target dataset. I tried extending the GcpOption but no help. Don't suggest me to use the DataflowRunner, because it cannot load data from Oracle local. Thanks.

Imported from Jira BEAM-4247. Original Jira may contain additional context. Reported by: doduythao.

コントリビューターガイド