You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It is possible to register custom features using datasets.features.features.register_feature (#6727)
However such features are not compatible with Features.encode_example/decode_example if they require special encoding / decoding logic because encode_nested_example / decode_nested_example checks whether the feature is in a fixed list of encodable types:
alex-hh
changed the title
Custom features not compatible with special encoding logic
Custom features not compatible with special encoding/decoding logic
Oct 11, 2024
Describe the bug
It is possible to register custom features using datasets.features.features.register_feature (#6727)
However such features are not compatible with Features.encode_example/decode_example if they require special encoding / decoding logic because encode_nested_example / decode_nested_example checks whether the feature is in a fixed list of encodable types:
datasets/src/datasets/features/features.py
Line 1349 in 16a121d
This prevents the extensibility of features to complex cases
Steps to reproduce the bug
Expected behavior
Registered feature types should be encoded based on some property of the feature (e.g. requires_encoding)?
Environment info
3.0.2
The text was updated successfully, but these errors were encountered: