You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Array and Maps of primitive types are common in Avro schema. Java collections do an acceptable generic job, but type-specific collections such as fastutil can save overhead in multiple ways:
No boxing/unboxing of numbers.
Primitive type-specific collections lower memory overhead of underlying representations.
Which is more pronounced in JVM heaps over 32gb due to 16bit object reference overhead.
fastutil is well respected and widely adopted for performance, so using it for Java representation of Avro data could provide a nice benefit.
The text was updated successfully, but these errors were encountered:
j-tyler
changed the title
Consider adopting fastutil for codegen primitive collections
Consider adopting fastutil for deserialization of primitive collections
Oct 7, 2022
Array and Maps of primitive types are common in Avro schema. Java collections do an acceptable generic job, but type-specific collections such as fastutil can save overhead in multiple ways:
fastutil is well respected and widely adopted for performance, so using it for Java representation of Avro data could provide a nice benefit.
The text was updated successfully, but these errors were encountered: