clickpipe create kafka/kinesis/pubsub: require --column, as object-storage does
Maintainers usually reply within 1 day
Assessment
This issue has not been assessed yet.
Description
What happens
chctl cloud clickpipe create kafka $SVC --name x --database default --table t --topics t1 --format JSONEachRow --brokers b:9092 --username u --password p sends the request without destination.columns. The server rejects it with BAD_REQUEST: Destination columns are required if source is not a database pipe ... (exit 1). Help for kafka, kinesis and pubsub shows --column as optional.
Evidence
cloud/clickpipes.rs:ObjectStorageCreateArgs.columnshasrequired = true(#840).KafkaCreateArgs,KinesisCreateArgsandPubSubCreateArgsdo not.build_streaming_destinationomits empty columns.- The #845 API-source findings (2026-11-02) say columns are required on create for Kafka, Kinesis, Pub/Sub, object storage and OneLake.
Expected vs actual
- Expected: a clap usage error (exit 2) before any lookup or HTTP request, with
--columnmarked required and repeatable in help, as on object-storage. - Actual: a server 400 with exit 1.
Likely cause
The columns arg in the Kafka/Kinesis/PubSub create args structs in cloud/clickpipes.rs lacks required = true.
Related: #840 (object-storage fix), #845, #928.
Scores: L=8 I=4
Basis: validated by source review plus local help output; the server error is from the tester.
From the 2026-11-04 user-testing sweep (medium severity): report finding 40. Checked against stack head 6859d2ac (PR 1220).
- Dominant language
- Rust
- Stars
- 80
- Forks
- 9
- Avg merge
- 2d 13h
- Merged PRs (30d)
- 47
Getting set up
- No Dockerfile or Docker Compose file
- No pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from ClickHouse/clickhousectl
-
cargo audit red on main: RUSTSEC-2026-0387 (crypto-bigint 0.5.5 via aws-config credentials-login)Possibly taken @sdairs claimed this 4 days ago. Open
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
ClickHouse/clickhousectl#1183 ·
Maintainers usually reply within 1 day
-
Reject empty positional IDs as usage errors instead of sending them to the APIPossibly taken @sdairs claimed this 2 days ago. Openbug cloud
ClickHouse/clickhousectl#1246 · 1 assignee ·
Maintainers usually reply within 1 day
-
AWS backup bucket create cannot succeed in orgs without the external-ID feature (iamRoleExternalId required by the library, rejected by the server)Possibly taken @sdairs claimed this 2 days ago. Openbug cloud
ClickHouse/clickhousectl#1245 · 1 assignee ·
Maintainers usually reply within 1 day
-
Cloud file-reading flags report bare 'No such file or directory' without the flag or pathPossibly taken @sdairs claimed this 2 days ago. Openbug cloud
ClickHouse/clickhousectl#1244 · 1 assignee ·
Maintainers usually reply within 1 day
-
clickpipe cdc-scaling update: a single --cpu-millicores or --memory-gb always fails, though help says omitted values are keptPossibly taken @sdairs claimed this 2 days ago. Openbug cloud
ClickHouse/clickhousectl#1242 · 1 assignee ·
Maintainers usually reply within 1 day
All issues in ClickHouse/clickhousectl
Similar issues
-
An EXE started from the shell with MAXALLOC FFFFh leaves a 0-paragraph free block after its ownOpenbug low-priority
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
dividebysandwich/rust-dos#629 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
eliasstravik/herdr-projects#758 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
enhancement needs:sonnet ready-for-agent
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Maintainers usually reply within 1 day