vectordotdev/vector

MessagePack codec (or VRL functions)

Open

Aperta il 12 ago 2021

Vedi su GitHub
 (2 commenti) (8 reazioni) (0 assegnatari)Rust (21.837 star) (2126 fork)batch import
domain: codecsdomain: vrlgood first issuetype: featurevrl: stdlib

Descrizione

We have a Kafka topic with msgpack events we would like to deserialize (and reserialize after some transformations in an other topic). Currently, we use Logstash for that with this plugin : https://github.com/logstash-plugins/logstash-codec-msgpack

It could be very useful to have a generic msgpack codec in Vector like for JSON format, maybe in the form of a pair VRL functions parse_msgpack / encode_msgpack ?

Guida contributor

Tech stack
rustkafka
Dominio
backenddata
Tipo issue
feature
DifficoltàQuanto dovrebbe essere impegnativa per un nuovo contributor.
3
Tempo stimatoTempo stimato per completare e verificare uno scope piccolo.
3-5 days
Stato attivitàQuanto è probabile che la issue sia ancora attiva e reviewable.
stale
ChiarezzaQuanto chiaramente la issue descrive problema, scope e risultato atteso.
clear
Prerequisiti
Rust programmingVector codebase basicsMessagePack format
Adatta ai principiantiQuanto la issue è adatta a contributor alla prima esperienza.
40
Direzione di ricerca
Review existing codec implementations (e.g., JSON codec) in the Vector codebase, likely under src/codecs/. Consider using the rmp (rmp serde) crate for MessagePack serialization. If implementing VRL functions, examine the VRL standard library for existing parse/encode functions (e.g., parse json, encode json) and follow that pattern. Check issue comments for any additional requirements. No linked PRs or assignees, so the issue is open for contribution.