You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I think this would be a good first issue as it is primarily a code movement thing, doesn't require intimate knowledge of DataFusion's code, and would be a good introduction to the development workflow.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem or challenge?
#7283 (comment) added a
OutputFileFormat
enum that is very similar to the existingFileType
enum:https://github.com/apache/arrow-datafusion/blob/f2c0100a5a10bf3ea166a1a590d94b8c9b6cf673/datafusion/expr/src/logical_plan/dml.rs#L45-L53
Describe the solution you'd like
Move
FileType
intodatafusion_common
and removeOutputFileFormat
so it could be used by both the logical plan and datasource?The tricky bit of this PR will be disentangling FileType from the code that instantiates compression: https://github.com/apache/arrow-datafusion/blob/f2c0100a5a10bf3ea166a1a590d94b8c9b6cf673/datafusion/core/src/datasource/file_format/file_type.rs#L287
I think we could move
FileType
over, however, and define some trait withget_ext_with_compression
for the appropriate codeDescribe alternatives you've considered
No response
Additional context
@devinjdangelo and I discussed this here: #7283 (comment)
I think this would be a good first issue as it is primarily a code movement thing, doesn't require intimate knowledge of DataFusion's code, and would be a good introduction to the development workflow.
The text was updated successfully, but these errors were encountered: