vectordotdev/vector

MessagePack codec (or VRL functions)

Open

#8,675 建立於 2021年8月12日

在 GitHub 查看
 (2 留言) (8 反應) (0 負責人)Rust (21,837 star) (2,126 fork)batch import
domain: codecsdomain: vrlgood first issuetype: featurevrl: stdlib

描述

We have a Kafka topic with msgpack events we would like to deserialize (and reserialize after some transformations in an other topic). Currently, we use Logstash for that with this plugin : https://github.com/logstash-plugins/logstash-codec-msgpack

It could be very useful to have a generic msgpack codec in Vector like for JSON format, maybe in the form of a pair VRL functions parse_msgpack / encode_msgpack ?

貢獻者指南

技術棧
rustkafka
領域
backenddata
議題類型
feature
難度面向新貢獻者的預計實作難度，1 表示很小改動，5 表示專家級工作。
3
預計時間有經驗貢獻者完成調查、實作、測試並準備 pull request 的粗略時間範圍。
3-5 days
活動狀態議題目前的可參與程度：新鮮、活躍、陳舊、阻塞或等待維護者輸入。
stale
清晰度議題是否清楚說明預期改動、驗收標準和下一步。
clear
前置要求
Rust programmingVector codebase basicsMessagePack format
新手友善度1-100 的估計分數，表示該議題對首次貢獻者的友善程度。
40
研究方向
Review existing codec implementations (e.g., JSON codec) in the Vector codebase, likely under src/codecs/. Consider using the rmp (rmp serde) crate for MessagePack serialization. If implementing VRL functions, examine the VRL standard library for existing parse/encode functions (e.g., parse json, encode json) and follow that pattern. Check issue comments for any additional requirements. No linked PRs or assignees, so the issue is open for contribution.