-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
utf8 not supported #2
Comments
I should clarify that the message with utf chars does actually make it to the kafka server but fails with an InvalidMessageException
In the scala source code for InvalidMessageException, it says that the exception
|
I've investigated the problem a little more and it looks like the problem must be in import zlib
zlib.crc32('Guantnamo')
882229988
zlib.crc32('Guantánamo')
1464054322 which is the same in var std = require("std")
std.crc32('Guantnamo')
882229988
std.crc32('Guantánamo')
1464054322 |
I just noticed that utf8 isn't supported. I can't tell if this is occurring in the crc32 hashing algorithm or in the packing library. Here's what I've used to verify this behavior:
Producer initialization
Message with utf char that doesn't send
Remove the char and it sends:
The text was updated successfully, but these errors were encountered: