mholt/PapaParse

Nodejs stream - support object mode

Open

#652 aperta il 1 apr 2019

Vedi su GitHub
 (1 commento) (0 reazioni) (0 assegnatari)JavaScript (1157 fork)batch import
help wantednodejs support

Metriche repository

Star
 (11.877 star)
Metriche merge PR
 (Nessuna PR mergiata in 30 g)

Descrizione

Upon further research, https://github.com/mholt/PapaParse/issues/568 indicates unparse does not support streaming at all.

The documentation for Nodejs stream support seems a bit limited and I'm not able to get it working in object mode. I'm getting an error when I attempt the following. Is object mode streaming supported?

Unable to serialize unrecognized input

const readable = new Readable({ objectMode: true, highWaterMark: 10000 })

// ...

const parser = Papa.unparse(Papa.NODE_STREAM_INPUT, {
  fastMode: true
});

pipeline(
  readable,
  through2.obj(function p(chunk, enc, cb) {
  // do stuff with data
  // chunk is a js object
    cb(null, chunk);
  }),
  parser,
  res
);

Guida contributor