elastic/elasticsearch

Add CBOR-friendly bulk format

Open

#8.481 geöffnet am 14. Nov. 2014

Auf GitHub ansehen
 (4 Kommentare) (0 Reaktionen) (1 zugewiesene Person)Java (25.882 Forks)batch import
:Distributed/CRUD>enhancementTeam:Distributedhelp wanted

Repository-Metriken

Stars
 (76.700 Stars)
PR-Merge-Metriken
 (Durchschn. Merge 2T) (1.000 gemergte PRs in 30 T)

Beschreibung

The current bulk format in JSON uses the \n as end-of-line markers, allowing the coordinating node to parse just the metadata line, then skip over the body line.

CBOR doesn't have any disallowed characters or character sequences, so this mechanism will not work. Instead we should have a CBOR specific format which looks like this:

{ metadata line }
int_length_of_body_line
{ body line }

The int_length_of_body_line would allow us to skip to the next metadata line.

For the delete action, no int_length_of_body_line would be required, as we already know that it can't have a body.

Depends on #7640

Contributor Guide