Trying to send large data from nodejs to python

[AbhayKD]

I'm trying to send around 500 Mb of data from nodejs to python zerorpc server. On receiving data the python process memory consumption is shooting upto 3 Gb. Data is in form of JSON. There are few possible ways i'm trying to solve the hurdle.

• Is there a way to stream this JSON data, so that it can be stream on the python server side and translated immediately?
• Can we set the unpacker raw value to True so that i can use raw msgpack format which will save a lot of memory consumption of converting msgpack back to JSON and also msgpack is smaller in size as compared to JSON. I can see the raw value set to False in the Events class.
• Also after successful execution of the task the memory is not released and as i'm trying to send large amount of data to server there a whole lot of memory stays consumed even after task is completed.

Thanks in advance. :)

[bombela]

Serualize your own way as a byte string.