Here are more comprehensive benchmarks. This is comparison with the next fastest JS projects using the benchmark tool from msgpack-lite
(and data is from some clinical research data we use that has a good mix of different value types and structures). It also includes comparison to V8 native JSON functionality, and JavaScript Avro (avsc
, a very optimized Avro implementation):
operation | op | ms | op/s |
---|---|---|---|
buf = Buffer(JSON.stringify(obj)); | 82000 | 5004 | 16386 |
obj = JSON.parse(buf); | 88600 | 5000 | 17720 |
require("cbor-x").encode(obj); | 161500 | 5002 | 32287 |
require("cbor-x").decode(buf); | 94600 | 5004 | 18904 |
cbor-x w/ shared structures: encoder.encode(obj); | 178400 | 5002 | 35665 |
cbor-x w/ shared structures: encoder.decode(buf); | 376700 | 5000 | 75340 |
buf = require("cbor").encode(obj); | 7700 | 5008 | 1537 |
obj = require("cbor").decode(buf); | 3100 | 5119 | 605 |
buf = require("cbor-sync").encode(obj); | 18000 | 5025 | 3582 |
obj = require("cbor-sync").decode(buf); | 20900 | 5011 | 4170 |
buf = require("msgpack-lite").encode(obj); | 30100 | 5012 | 6005 |
obj = require("msgpack-lite").decode(buf); | 16200 | 5001 | 3239 |
buf = require("@msgpack/msgpack").encode(obj); | 101200 | 5001 | 20235 |
obj = require("@msgpack/msgpack").decode(buf); | 71200 | 5004 | 14228 |
buf = require("notepack").encode(obj); | 62600 | 5005 | 12507 |
obj = require("notepack").decode(buf); | 32400 | 5007 | 6470 |
require("what-the-pack")... encoder.encode(obj); | 63500 | 5002 | 12694 |
require("what-the-pack")... encoder.decode(buf); | 32000 | 5001 | 6398 |
require("avsc")...make schema/type...type.toBuffer(obj); | 84600 | 5003 | 16909 |
require("avsc")...make schema/type...type.toBuffer(obj); | 99300 | 5001 | 19856 |
(avsc
is schema-based and more comparable in style to cbor-x with shared structures).
Here is a benchmark of streaming data (again borrowed from msgpack-lite
's benchmarking), where cbor-x is able to take advantage of the structured record extension and really pull away from other tools:
operation (1000000 x 2) | op | ms | op/s |
---|---|---|---|
new EncoderStream().write(obj); | 1000000 | 533 | 1876172 |
new DecoderStream().write(buf); | 1000000 | 297 | 3367003 |
stream.write(msgpack.encode(obj)); | 1000000 | 3179 | 314564 |
stream.write(msgpack.decode(buf)); | 1000000 | 2151 | 464900 |
stream.write(notepack.encode(obj)); | 1000000 | 944 | 1059322 |
stream.write(notepack.decode(buf)); | 1000000 | 1131 | 884173 |
msgpack.Encoder().on("data",ondata).encode(obj); | 1000000 | 1687 | 592768 |
msgpack.createDecodeStream().write(buf); | 1000000 | 2084 | 479846 |
msgpack.createEncodeStream().write(obj); | 1000000 | 1475 | 677966 |
msgpack.Decoder().on("data",ondata).decode(buf); | 1000000 | 2264 | 441696 |
These are the benchmarks from notepack package. The larger test data for these benchmarks is very heavily weighted with large binary/buffer data and objects with extreme numbers of keys (much more than I typically see with real-world data, but YMMV):
node ./benchmarks/encode
library | tiny | small | medium | large |
---|---|---|---|---|
notepack | 2,171,621 ops/sec | 546,905 ops/sec | 29,578 ops/sec | 265 ops/sec |
msgpack-js | 967,682 ops/sec | 184,455 ops/sec | 20,556 ops/sec | 259 ops/sec |
cbor-x | 2,392,826 ops/sec | 556,915 ops/sec | 70,573 ops/sec | 313 ops/sec |
msgpack-lite | 553,143 ops/sec | 132,318 ops/sec | 11,816 ops/sec | 186 ops/sec |
@msgpack/msgpack | 2,157,655 ops/sec | 573,236 ops/sec | 25,864 ops/sec | 90.26 ops/sec |
node ./benchmarks/decode
library | tiny | small | medium | large |
---|---|---|---|---|
notepack | 2,220,904 ops/sec | 560,630 ops/sec | 28,177 ops/sec | 275 ops/sec |
msgpack-js | 965,719 ops/sec | 222,047 ops/sec | 21,431 ops/sec | 257 ops/sec |
cbor-x | 2,320,046 ops/sec | 589,167 ops/sec | 70,299 ops/sec | 329 ops/sec |
cbor-x records | 3,750,547 ops/sec | 912,419 ops/sec | 136,853 ops/sec | 733 ops/sec |
msgpack-lite | 569,222 ops/sec | 129,008 ops/sec | 12,424 ops/sec | 180 ops/sec |
@msgpack/msgpack | 2,089,697 ops/sec | 557,507 ops/sec | 20,256 ops/sec | 85.03 ops/sec |
This was run by adding the cbor-x to the benchmarks for notepack.
All benchmarks were performed on Node 14.8.0 (Windows i7-4770 3.4Ghz). They can be run with: npm install --no-save msgpack msgpack-js @msgpack/msgpack msgpack-lite notepack avsc node tests/benchmark