-
Notifications
You must be signed in to change notification settings - Fork 18
Open
Labels
enhancementNew feature or requestNew feature or request
Description
For big datasets (either made in a supported CCE or elsewhere), being able to read/write BSON would help to speed up parsing and the general workflow. With some cursory tests in Python:
A smallish dataset in JSON format on disk at around 80mb and in BSON format at around 25mb parses around 7 times faster.
A large dataset in JSON format on disk at around 3.84GB and 1.74GB in BSON format parses around 4 times faster.
Obviously, there is the benefit of disk space being less consumptive too in BSON format.
In either case I am working with around 1000 short audio files, so the scope of working musically with such a collection is not out of the question. Anyway, this is more of a "could be nice" than something that is essential whatsoever.
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request