希望flinkStreamSQL 1.10的Kafka数据源可以像flink原生版一样支持group-offsets模式

Open
#354 6 comments 5 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
35/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Stale
Tech stack
java, kafka, sql
Domain
stream-processing

Research direction

No file, test, or entry point is named in the issue. Start by locating the FlinkStreamSQL 1.10 Kafka source configuration and its offset-mode handling, then compare it with Flink's group-offsets behavior; done means a configured groupId resumes from committed group offsets while preserving the initial latest or earliest behavior for a new group.

Written by the indexing model from the issue text.

Description

flinkStreamSQL 1.10的Kafka数据源不支持group-offsets模式，Flink原生版支持的。 在实际应用中，最常用的就是这个模式，Flink原生版本只要设置了groupId， 即使是latest和earlist两种offset模式, 也只是在groupId有新值时，从最新或者最初始开始读，其后就是按照group-offsets来读取的，这样就可以保证任务重启后，准确地衔接上。 希望大佬们可以让flinkStreamSQL 也支持group-offset模式。

Dominant language
Java
Stars
2k
Forks
913
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from DTStack/flinkStreamSQL

All issues in DTStack/flinkStreamSQL

Similar issues

More Java issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.