Add missing serde/inputFormat combination for Hive#18989
Conversation
add information which release or which code change affected it
please feel in |
d827ea9 to
f7054ed
Compare
There was a problem hiding this comment.
This works for reads, but what happens if you attempt to write to such a table? I'm worried that this could silently create corrupted data that is not readable. I'd like to understand writing behavior for such a table with
- Current Trino
- Older version of Trino (before the change that prompted this fix)
- Hive
- Spark
Current trino/previous trino can't write to it as it is a non managed hive table. |
there is a toggle to enable writes to non-managed tables. |
|
When you write from Spark, are the files written in Parquet format? |
|
The test seems to only read with Spark, not write. Can you also read and write with Hive? |
2fa9650 to
4a556da
Compare
|
@electrum sorry, my bad. |
4a556da to
eefc5c8
Compare
electrum
left a comment
There was a problem hiding this comment.
Thanks for confirming the behavior. This change looks good. Can you also add a test to verify that writing fails with Trino? I'm assuming something similar to the Hive insert would work.
5674d53 to
3789811
Compare
3789811 to
c664648
Compare
|
@electrum can you merge this ? I don't have the button |
or maybe "[Hive] Fix reading from certain Parquet tables incorrectly created by Spark" cc @colebow |
Description
Support for this was accidentally removed in scope of #18556 (424)
Additional context and related issues
Release notes
(x) This is not user-visible or is docs only, and no release notes are required.
( ) Release notes are required. Please propose a release note for me.
( ) Release notes are required, with the following suggested text: