lance-format/lance
在 GitHub 查看feat: bytes read and bytes write mectirc for per lance scanner and writer
Open
#3,570 建立於 2025年3月20日
help wanted
倉庫指標
- Star
- (6,582 star)
- PR 合併指標
- (平均合併 6天 1小時) (30 天內合併 219 個 PR)
描述
When we scan the lance dataset, it's better to provide the read metrics, especially for the io bytes and IOPS metric.
The Spark web UI has some task-level metrics, for example, the input bytes. But now Lance can't provide it.
The same metrics are required when we write a lance dataset.