CLI-3550: Confluent kafka link create is not providing feedback from config.txt that the tasks are in error and has no documentation on what is expected in the config.txt file.

未关闭
#3,072 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 1 天内回复

还没有人认领这个 Issue。

评估

难度
4/5
预计耗时
3-5 天
新手友好度
35/100
Issue 类型
缺陷
描述清晰度
基本清楚
活跃度
停滞
技术栈
go
领域
cli, documentation

调研方向

从 Confluent CLI 对 confluent kafka link create 的实现和文档、--config 的处理以及 confluent kafka link task list 开始。使用 v4.21.0 或当前版本复现所提供的 config.txt 案例,然后记录所需的 ACL、topic 和 consumer-group 过滤器,并确保在创建 link 时能够显示配置错误。

由索引模型根据 Issue 内容生成。

描述

enhancement

Confluent CLI is lacking documentation on how to pass through arguments for syncing consumer offsets, ACL's and auto creating mirror topics.


confluent kafka link create $LINK_NAME \

--cluster $DEST_CLUSTER_ID \

--source-cluster $SOURCE_CLUSTER_ID \

--source-bootstrap-server $BOOTSTRAP_ENDPOINT \

--source-api-key $API_KEY \

--source-api-secret $API_SECRET \

--destination-cluster $DEST_CLUSTER_ID \

--config config.txt

# config.txt: 
auto.create.mirror.topics.enable=true
consumer.offset.sync.enable=true
acl.sync.enable=true

This creates the cluster link and reports no errors in the cli but when checking the tasks on the link they're reporting status in_error:

confluent kafka link task list --link [link-name]

---------------------+----------+------------------------------------
  AclSync            | IN_ERROR | MISCONFIGURATION_ERROR: "ACL
                     |          | migration is enabled but
                     |          | acl.filters is not set. Please
                     |          | set acl.filters to proceed
                     |          | with ACL migration."
  AutoCreateMirror   | IN_ERROR | MISCONFIGURATION_ERROR:
                     |          | "auto.create.mirror.topics.enable
                     |          | is true but no topic filters
                     |          | are specified. No topics will be
                     |          | mirrored."
  ConsumerOffsetSync | IN_ERROR | MISCONFIGURATION_ERROR:
                     |          | "consumer.offset.sync.enable
                     |          | is true but no consumer
                     |          | group filters are specified.
                     |          | No consumer offsets will be
                     |          | migrated."
  TopicConfigsSync   | ACTIVE   |

There are no hints in the cli for what is expected here, there is no documentation that I can find to get consumer offsets ACL's to sync or auto-create mirror topics via the cli

If I hadn't caught this before my DR failover, consumers wouldn't know where to begin with processing.

this is on confluent version v4.21.0

to temporarily resolve this I was able to create the link in the UI.

主要语言
Go
星标
82
派生
37
平均合并
1 天 13 小时
30 天内合并 PR
22

环境准备

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

confluentinc/cli 的其他 Issue

查看 confluentinc/cli 的全部 Issue

相似的 Issue

更多 Go Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。