taosdata/TDengine

java数据订阅报错

Open

#32558 opened on Aug 12, 2025

View on GitHub
 (3 comments) (0 reactions) (1 assignee)C (24,849 stars) (5,002 forks)batch import
help wantedquestion

Description

TDengine服务版本为3.3.6.13，使用如上方法进行数据订阅并拉取数据时会报错（509行），消费者配置如上图2。报错部分堆栈如下（jdbc驱动版本为3.7.1） Consumer error: readerIndex: 150996698, writerIndex: 30983 (expected: 0 <= readerIndex <= writerIndex <= capacity(30983)) java.lang.IndexOutOfBoundsException: readerIndex: 150996698, writerIndex: 30983 (expected: 0 <= readerIndex <= writerIndex <= capacity(30983)) at io.netty.buffer.AbstractByteBuf.checkIndexBounds(AbstractByteBuf.java:112) at io.netty.buffer.AbstractByteBuf.readerIndex(AbstractByteBuf.java:121) at com.taosdata.jdbc.ws.tmq.entity.FetchRawBlockResp.fetchBlockData(FetchRawBlockResp.java:516) at com.taosdata.jdbc.ws.tmq.entity.FetchRawBlockResp.parseBlockInfos(FetchRawBlockResp.java:155) at com.taosdata.jdbc.ws.tmq.WSConsumerResultSet.next(WSConsumerResultSet.java:90) at com.taosdata.jdbc.ws.tmq.WSConsumer.doPoll(WSConsumer.java:202) at com.taosdata.jdbc.ws.tmq.WSConsumer.poll(WSConsumer.java:228) at com.taosdata.jdbc.tmq.TaosConsumer.poll(TaosConsumer.java:93)

当jdbc驱动版本为3.3.3时，报错信息如下 Consumer error: newPosition > limit: (664423 > 4098) java.lang.IllegalArgumentException: newPosition > limit: (664423 > 4098) at java.base/java.nio.Buffer.createPositionException(Buffer.java:341) at java.base/java.nio.Buffer.position(Buffer.java:316) at java.base/java.nio.ByteBuffer.position(ByteBuffer.java:1516) at java.base/java.nio.ByteBuffer.position(ByteBuffer.java:267) at com.taosdata.jdbc.ws.tmq.entity.FetchRawBlockResp.skipSchema(FetchRawBlockResp.java:201) at com.taosdata.jdbc.ws.tmq.entity.FetchRawBlockResp.parseBlockInfos(FetchRawBlockResp.java:148) at com.taosdata.jdbc.ws.tmq.WSConsumerResultSet.next(WSConsumerResultSet.java:85) at com.taosdata.jdbc.ws.tmq.WSConsumer.doPoll(WSConsumer.java:146) at com.taosdata.jdbc.ws.tmq.WSConsumer.poll(WSConsumer.java:164) at com.taosdata.jdbc.tmq.TaosConsumer.poll(TaosConsumer.java:93)

Contributor guide

Tech stack
java
Domain
backenddatabase
Issue type
bug
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
4
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
blocked
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
mostly clear
Prerequisites
JavaNetty buffer fundamentalsTDengine subscription protocol
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
20
Research direction
The error occurs in FetchRawBlockResp.java (lines 516, 201, etc.) when processing data blocks. The issue involves a mismatch between readerIndex and writerIndex in a Netty ByteBuf. Investigate the fetchBlockData and skipSchema methods to understand how the raw block response is parsed. Check linked PRs or comments for any ongoing fixes. The stack trace for jdbc 3.3.3 shows a different error at skipSchema, suggesting changes in schema handling between versions. Reproduce with a minimal Java subscription example and trace the buffer operations.