mholt/PapaParse

Nodejs stream - support object mode

Aperta

#652 aperta il 1 apr 2019

 (1 commento) (0 reazioni) (0 assegnatari)JavaScript (1185 fork)batch import
help wantednodejs support

Metriche repository

Star
 (13.541 stelle)
Metriche merge PR
 (Merge medio 18h) (1 PR mergiata in 30 g)

Descrizione

Upon further research, https://github.com/mholt/PapaParse/issues/568 indicates unparse does not support streaming at all.

The documentation for Nodejs stream support seems a bit limited and I'm not able to get it working in object mode. I'm getting an error when I attempt the following. Is object mode streaming supported?

Unable to serialize unrecognized input

const readable = new Readable({ objectMode: true, highWaterMark: 10000 })

// ...

const parser = Papa.unparse(Papa.NODE_STREAM_INPUT, {
  fastMode: true
});

pipeline(
  readable,
  through2.obj(function p(chunk, enc, cb) {
  // do stuff with data
  // chunk is a js object
    cb(null, chunk);
  }),
  parser,
  res
);

Guida contributor